2024-02-28T15:57:06.594 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T15:57:06.595 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591 --name vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591/orig.config.yaml 2024-02-28T15:57:06.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T15:57:06.740 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7575591' kernel: flavor: default kdb: true sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2226 sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 targets: smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAnKwgqZEHMe4RsBy/ThSntGNITYD4uXGQ71h3JR5FkTkHpfEYNTKv7WE9kwcDWseoxksxLi1Fp3uVam+3lB18= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP6F2wes8Bf4zUMco5ITBlbFlUppRalAgJMJh5rnZvcc4gfxK43zRz/g/HzNzZ4qnPMOAq6DcbUb4bvw1+8InV0= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-28_15:21:56 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-28T15:57:06.741 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa; will attempt to use it 2024-02-28T15:57:06.741 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks 2024-02-28T15:57:06.742 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-28T15:57:06.743 INFO:teuthology.task.internal:Checking packages... 2024-02-28T15:57:06.767 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb5d10608dccee73edd6ef8a2c7b804a097c324' 2024-02-28T15:57:06.767 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T15:57:06.767 INFO:teuthology.packaging:ref: None 2024-02-28T15:57:06.767 INFO:teuthology.packaging:tag: None 2024-02-28T15:57:06.767 INFO:teuthology.packaging:branch: main 2024-02-28T15:57:06.767 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T15:57:06.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-02-28T15:57:07.018 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1716.g4a1c26b5 2024-02-28T15:57:07.019 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-28T15:57:07.027 INFO:teuthology.task.internal:no buildpackages task found 2024-02-28T15:57:07.027 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-28T15:57:07.064 INFO:teuthology.task.internal:Saving configuration 2024-02-28T15:57:07.084 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-28T15:57:07.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T15:57:07.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:51:32.655004', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAnKwgqZEHMe4RsBy/ThSntGNITYD4uXGQ71h3JR5FkTkHpfEYNTKv7WE9kwcDWseoxksxLi1Fp3uVam+3lB18='} 2024-02-28T15:57:07.146 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:51:32.656875', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP6F2wes8Bf4zUMco5ITBlbFlUppRalAgJMJh5rnZvcc4gfxK43zRz/g/HzNzZ4qnPMOAq6DcbUb4bvw1+8InV0='} 2024-02-28T15:57:07.146 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-28T15:57:07.157 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-28T15:57:07.158 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-28T15:57:07.158 INFO:teuthology.run_tasks:Running task console_log... 2024-02-28T15:57:07.257 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc60e910160>, signals=[15]) 2024-02-28T15:57:07.258 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-28T15:57:07.266 INFO:teuthology.task.internal:Opening connections... 2024-02-28T15:57:07.266 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T15:57:07.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:57:07.365 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-02-28T15:57:07.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:57:07.456 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-28T15:57:07.467 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-02-28T15:57:07.485 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-02-28T15:57:07.485 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-02-28T15:57:07.544 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-02-28T15:57:07.544 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-02-28T15:57:07.544 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-02-28T15:57:07.544 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:57:07.544 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-02-28T15:57:07.544 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:57:07.545 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:57:07.546 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-02-28T15:57:07.574 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-02-28T15:57:07.591 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-02-28T15:57:07.592 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-02-28T15:57:07.648 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T15:57:07.649 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T15:57:07.650 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-02-28T15:57:07.682 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-28T15:57:07.699 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-28T15:57:07.733 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-28T15:57:07.734 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-02-28T15:57:07.736 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-02-28T15:57:07.752 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-28T15:57:07.765 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-28T15:57:07.765 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-02-28T15:57:07.794 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-02-28T15:57:07.902 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-28T15:57:07.963 INFO:teuthology.run_tasks:Running task kernel... 2024-02-28T15:57:07.981 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'} 2024-02-28T15:57:07.981 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}}, timeout 300 2024-02-28T15:57:07.982 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T15:57:07.982 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T15:57:07.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:57:07.998 DEBUG:teuthology.task.kernel:sha1 for host.a is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:07.999 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T15:57:07.999 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-02-28T15:57:08.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T15:57:08.000 DEBUG:teuthology.task.kernel:sha1 for host.b is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:08.000 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T15:57:08.000 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-02-28T15:57:08.056 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-361.el9.x86_64 2024-02-28T15:57:08.056 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:08.057 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T15:57:08.057 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:08.061 INFO:teuthology.orchestra.run.smithi157.stdout:5.14.0-361.el9.x86_64 2024-02-28T15:57:08.061 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:08.061 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T15:57:08.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:08.213 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum upgrade -y linux-firmware 2024-02-28T15:57:08.293 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum upgrade -y linux-firmware 2024-02-28T15:57:10.423 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-02-28T15:57:10.456 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - AppStream 15 MB/s | 8.1 MB 00:00 2024-02-28T15:57:12.023 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - BaseOS 8.3 MB/s | 2.5 MB 00:00 2024-02-28T15:57:12.056 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - BaseOS 8.4 MB/s | 2.5 MB 00:00 2024-02-28T15:57:13.197 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-02-28T15:57:13.713 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-02-28T15:57:16.075 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-02-28T15:57:19.889 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 3.6 MB/s | 19 MB 00:05 2024-02-28T15:57:22.273 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.1 MB 00:02 2024-02-28T15:57:23.824 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2024-02-28T15:57:24.559 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 35 MB/s | 20 MB 00:00 2024-02-28T15:57:24.589 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.1 MB 00:01 2024-02-28T15:57:26.157 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2024-02-28T15:57:27.161 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2024-02-28T15:57:29.633 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-28T15:57:31.864 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T15:57:31.864 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T15:57:31.864 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T15:57:31.864 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.865 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T15:57:31.866 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.867 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T15:57:31.868 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.869 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:57:31.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:57:32.167 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-02-28T15:57:32.395 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T15:57:32.405 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 1 Package 2024-02-28T15:57:32.406 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T15:57:32.406 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 376 M 2024-02-28T15:57:32.406 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T15:57:34.394 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T15:57:34.394 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T15:57:34.394 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T15:57:34.394 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T15:57:34.395 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T15:57:34.396 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T15:57:34.397 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.398 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T15:57:34.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T15:57:34.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T15:57:34.926 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T15:57:34.940 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T15:57:34.940 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-02-28T15:57:34.940 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T15:57:34.940 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-02-28T15:57:34.940 INFO:teuthology.orchestra.run.smithi157.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T15:57:34.940 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T15:57:34.941 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T15:57:34.941 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T15:57:34.941 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 1 Package 2024-02-28T15:57:34.941 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T15:57:34.941 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 376 M 2024-02-28T15:57:34.941 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T15:57:43.184 INFO:teuthology.orchestra.run.smithi148.stdout:linux-firmware-20240219-143.el9.noarch.rpm 35 MB/s | 376 MB 00:10 2024-02-28T15:57:43.184 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:57:43.184 INFO:teuthology.orchestra.run.smithi148.stdout:Total 35 MB/s | 376 MB 00:10 2024-02-28T15:57:44.033 INFO:teuthology.orchestra.run.smithi157.stdout:linux-firmware-20240219-143.el9.noarch.rpm 42 MB/s | 376 MB 00:08 2024-02-28T15:57:44.034 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T15:57:44.034 INFO:teuthology.orchestra.run.smithi157.stdout:Total 41 MB/s | 376 MB 00:09 2024-02-28T15:57:46.215 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T15:57:46.407 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T15:57:46.408 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T15:57:47.073 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T15:57:47.225 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T15:57:47.225 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T15:57:49.603 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T15:57:49.603 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T15:57:50.437 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T15:57:50.437 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T15:57:56.881 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T15:57:57.236 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:57:57.320 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:57.640 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T15:57:58.021 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:57:58.119 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:58.496 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:58.496 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:57:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:58.894 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T15:57:58.895 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-02-28T15:57:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T15:57:58.895 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T15:57:58.895 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T15:57:59.237 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T15:57:59.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:57:59.383 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T15:57:59.383 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T15:57:59.386 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi148.front.sepia.ceph.com to complete... 2024-02-28T15:57:59.394 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:59.394 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T15:57:59.853 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T15:57:59.853 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T15:57:59.854 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-02-28T15:57:59.854 INFO:teuthology.orchestra.run.smithi157.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T15:57:59.854 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T15:57:59.854 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T15:58:00.179 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T15:58:00.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T15:58:00.329 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T15:58:00.329 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T15:58:00.331 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi157.front.sepia.ceph.com to complete... 2024-02-28T15:58:13.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28 15:58:13 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T15:58:13.789 INFO:teuthology.orchestra.run.smithi148.stderr:FINISHED --2024-02-28 15:58:13-- 2024-02-28T15:58:13.789 INFO:teuthology.orchestra.run.smithi148.stderr:Total wall clock time: 14s 2024-02-28T15:58:13.789 INFO:teuthology.orchestra.run.smithi148.stderr:Downloaded: 1 files, 320M in 14s (22.7 MB/s) 2024-02-28T15:58:13.792 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T15:58:13.792 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T15:58:15.741 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying... ######################################## 2024-02-28T15:58:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:Preparing... ######################################## 2024-02-28T15:58:15.870 INFO:teuthology.orchestra.run.smithi148.stdout:Updating / installing... 2024-02-28T15:58:22.887 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28 15:58:22 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T15:58:22.887 INFO:teuthology.orchestra.run.smithi157.stderr:FINISHED --2024-02-28 15:58:22-- 2024-02-28T15:58:22.887 INFO:teuthology.orchestra.run.smithi157.stderr:Total wall clock time: 23s 2024-02-28T15:58:22.887 INFO:teuthology.orchestra.run.smithi157.stderr:Downloaded: 1 files, 320M in 22s (14.7 MB/s) 2024-02-28T15:58:22.890 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T15:58:22.890 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T15:58:23.533 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T15:58:24.831 INFO:teuthology.orchestra.run.smithi157.stdout:Verifying... ######################################## 2024-02-28T15:58:24.964 INFO:teuthology.orchestra.run.smithi157.stdout:Preparing... ######################################## 2024-02-28T15:58:25.045 INFO:teuthology.orchestra.run.smithi157.stdout:Updating / installing... 2024-02-28T15:58:32.696 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T15:58:39.330 INFO:teuthology.orchestra.run.smithi148.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T15:58:48.501 INFO:teuthology.orchestra.run.smithi157.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T15:59:01.908 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T15:59:01.908 DEBUG:teuthology.orchestra.run.smithi148:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T15:59:01.990 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T15:59:01.991 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T15:59:01.992 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T15:59:01.993 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T15:59:01.994 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T15:59:01.995 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T15:59:01.996 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T15:59:01.997 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T15:59:01.998 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T15:59:01.999 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T15:59:02.000 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T15:59:02.001 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T15:59:02.002 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T15:59:02.003 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T15:59:02.004 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T15:59:02.005 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T15:59:02.006 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T15:59:02.007 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T15:59:02.008 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T15:59:02.009 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T15:59:02.010 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T15:59:02.011 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T15:59:02.012 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T15:59:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T15:59:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T15:59:02.015 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T15:59:02.016 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T15:59:02.017 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T15:59:02.018 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T15:59:02.019 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T15:59:02.020 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T15:59:02.021 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T15:59:02.022 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T15:59:02.023 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T15:59:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T15:59:02.025 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T15:59:02.026 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T15:59:02.027 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T15:59:02.028 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T15:59:02.029 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T15:59:02.030 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T15:59:02.031 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T15:59:02.032 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T15:59:02.033 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T15:59:02.034 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T15:59:02.035 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T15:59:02.036 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T15:59:02.037 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T15:59:02.038 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T15:59:02.039 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T15:59:02.040 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T15:59:02.041 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T15:59:02.042 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T15:59:02.043 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T15:59:02.044 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T15:59:02.045 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T15:59:02.046 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T15:59:02.047 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T15:59:02.048 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T15:59:02.049 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T15:59:02.050 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T15:59:02.051 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T15:59:02.052 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T15:59:02.053 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T15:59:02.054 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T15:59:02.055 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T15:59:02.056 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T15:59:02.057 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T15:59:02.058 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T15:59:02.059 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T15:59:02.060 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T15:59:02.061 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T15:59:02.062 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T15:59:02.063 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T15:59:02.064 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T15:59:02.065 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T15:59:02.066 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T15:59:02.067 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T15:59:02.068 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T15:59:02.069 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T15:59:02.070 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T15:59:02.071 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T15:59:02.072 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T15:59:02.073 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T15:59:02.074 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T15:59:02.075 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T15:59:02.076 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T15:59:02.077 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T15:59:02.078 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T15:59:02.079 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T15:59:02.080 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T15:59:02.081 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T15:59:02.082 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T15:59:02.083 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T15:59:02.084 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T15:59:02.085 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T15:59:02.086 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T15:59:02.087 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T15:59:02.088 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T15:59:02.089 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T15:59:02.090 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T15:59:02.091 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T15:59:02.092 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T15:59:02.093 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T15:59:02.094 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T15:59:02.095 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T15:59:02.096 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T15:59:02.097 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T15:59:02.098 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T15:59:02.099 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T15:59:02.100 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T15:59:02.101 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T15:59:02.102 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T15:59:02.103 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T15:59:02.104 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T15:59:02.105 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T15:59:02.106 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T15:59:02.107 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T15:59:02.108 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T15:59:02.109 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T15:59:02.110 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T15:59:02.111 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T15:59:02.112 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T15:59:02.113 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T15:59:02.114 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T15:59:02.115 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T15:59:02.116 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T15:59:02.117 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T15:59:02.118 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T15:59:02.119 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T15:59:02.120 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T15:59:02.121 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T15:59:02.122 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T15:59:02.123 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T15:59:02.124 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T15:59:02.125 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T15:59:02.126 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T15:59:02.127 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T15:59:02.128 INFO:teuthology.orchestra.run.smithi148.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:59:02.132 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:02.132 DEBUG:teuthology.orchestra.run.smithi148:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T15:59:02.156 INFO:teuthology.orchestra.run.smithi148.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T15:59:02.156 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:59:02.156 INFO:teuthology.orchestra.run.smithi148.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:59:02.156 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:for file in vmlinuz System.map config; do 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout: fi 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:done 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T15:59:02.157 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:02.158 INFO:teuthology.orchestra.run.smithi148.stdout:fi 2024-02-28T15:59:02.158 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 68.el9 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8264254 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T15:59:02.235 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-02-28T15:59:02.236 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T15:59:02.237 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T15:59:02.237 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T15:59:02.238 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:02.238 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T15:59:02.924 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-02-28T15:59:04.407 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T15:59:04.431 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-02-28T15:59:04.433 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-02-28T15:59:04.449 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.Hc6PFYARtG 2024-02-28T15:59:04.449 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Hc6PFYARtG 2024-02-28T15:59:04.518 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.Hc6PFYARtG 2024-02-28T15:59:04.655 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.Hc6PFYARtG is 6KB 2024-02-28T15:59:04.705 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.Hc6PFYARtG 2024-02-28T15:59:04.719 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T15:59:04.794 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T15:59:04.794 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T15:59:04.794 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T15:59:04.795 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T15:59:04.796 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:04.974 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-02-28T15:59:11.073 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T15:59:11.073 DEBUG:teuthology.orchestra.run.smithi157:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T15:59:11.142 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T15:59:11.143 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T15:59:11.144 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T15:59:11.145 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T15:59:11.146 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T15:59:11.147 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T15:59:11.148 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T15:59:11.149 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T15:59:11.150 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T15:59:11.151 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T15:59:11.152 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T15:59:11.153 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T15:59:11.154 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T15:59:11.155 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T15:59:11.156 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T15:59:11.157 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T15:59:11.158 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T15:59:11.159 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T15:59:11.160 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T15:59:11.161 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T15:59:11.162 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T15:59:11.163 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T15:59:11.164 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T15:59:11.165 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T15:59:11.166 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T15:59:11.167 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T15:59:11.168 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T15:59:11.169 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T15:59:11.170 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T15:59:11.171 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T15:59:11.172 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T15:59:11.173 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T15:59:11.174 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T15:59:11.175 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T15:59:11.176 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T15:59:11.177 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T15:59:11.178 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T15:59:11.179 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T15:59:11.180 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T15:59:11.181 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T15:59:11.182 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T15:59:11.183 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T15:59:11.184 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T15:59:11.185 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T15:59:11.186 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T15:59:11.187 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T15:59:11.188 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T15:59:11.189 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T15:59:11.190 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T15:59:11.191 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T15:59:11.192 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T15:59:11.193 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T15:59:11.194 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T15:59:11.195 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T15:59:11.196 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T15:59:11.197 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T15:59:11.198 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T15:59:11.199 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T15:59:11.200 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T15:59:11.201 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T15:59:11.202 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T15:59:11.203 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T15:59:11.204 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T15:59:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T15:59:11.206 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T15:59:11.207 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T15:59:11.208 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T15:59:11.209 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T15:59:11.210 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T15:59:11.211 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T15:59:11.212 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T15:59:11.213 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T15:59:11.214 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T15:59:11.215 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T15:59:11.216 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T15:59:11.217 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T15:59:11.218 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T15:59:11.219 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T15:59:11.220 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T15:59:11.221 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T15:59:11.222 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T15:59:11.223 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T15:59:11.224 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T15:59:11.225 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T15:59:11.226 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T15:59:11.227 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T15:59:11.228 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T15:59:11.229 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T15:59:11.230 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T15:59:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T15:59:11.232 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T15:59:11.233 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T15:59:11.234 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T15:59:11.235 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T15:59:11.236 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T15:59:11.237 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T15:59:11.238 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T15:59:11.239 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T15:59:11.240 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T15:59:11.241 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T15:59:11.242 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T15:59:11.243 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T15:59:11.244 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T15:59:11.245 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T15:59:11.246 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T15:59:11.247 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T15:59:11.248 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T15:59:11.249 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T15:59:11.250 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T15:59:11.251 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T15:59:11.252 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T15:59:11.253 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T15:59:11.254 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T15:59:11.255 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T15:59:11.256 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T15:59:11.257 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T15:59:11.258 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T15:59:11.259 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T15:59:11.260 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T15:59:11.261 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T15:59:11.262 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T15:59:11.263 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T15:59:11.264 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T15:59:11.265 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T15:59:11.266 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T15:59:11.267 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T15:59:11.268 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T15:59:11.269 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T15:59:11.270 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T15:59:11.271 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T15:59:11.272 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T15:59:11.273 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T15:59:11.274 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T15:59:11.275 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T15:59:11.276 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T15:59:11.277 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T15:59:11.278 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T15:59:11.279 INFO:teuthology.orchestra.run.smithi157.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:59:11.283 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:11.283 DEBUG:teuthology.orchestra.run.smithi157:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:for file in vmlinuz System.map config; do 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout: fi 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:done 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T15:59:11.307 INFO:teuthology.orchestra.run.smithi157.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T15:59:11.308 INFO:teuthology.orchestra.run.smithi157.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T15:59:11.308 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:11.308 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-02-28T15:59:11.308 INFO:teuthology.orchestra.run.smithi157.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T15:59:11.308 INFO:teuthology.orchestra.run.smithi157.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T15:59:11.308 INFO:teuthology.orchestra.run.smithi157.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:11.308 INFO:teuthology.orchestra.run.smithi157.stdout:fi 2024-02-28T15:59:11.312 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2024-02-28T15:59:11.388 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.06 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 68.el9 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Group : Unspecified 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 8264254 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T15:59:11.389 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : builder@centos.org 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : CentOS 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T15:59:11.390 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T15:59:11.391 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T15:59:11.391 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:11.391 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T15:59:11.987 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-02-28T15:59:13.359 INFO:teuthology.orchestra.run.smithi157.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T15:59:13.393 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-02-28T15:59:13.395 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-02-28T15:59:13.409 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.kF68egab6e 2024-02-28T15:59:13.410 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kF68egab6e 2024-02-28T15:59:13.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.kF68egab6e 2024-02-28T15:59:13.621 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.kF68egab6e is 6KB 2024-02-28T15:59:13.670 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.kF68egab6e 2024-02-28T15:59:13.684 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T15:59:13.749 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T15:59:13.749 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T15:59:13.749 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T15:59:13.749 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T15:59:13.750 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T15:59:13.899 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-02-28T15:59:34.990 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-28T15:59:34.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-02-28T15:59:34.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:59:43.911 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-28T15:59:43.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T15:59:43.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T15:59:53.404 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-02-28T16:00:02.364 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-28T16:00:02.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-02-28T16:00:02.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:05.468 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-02-28T16:00:11.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T16:00:11.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:14.428 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-28T16:00:17.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-02-28T16:00:17.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:26.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T16:00:26.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:29.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-28T16:00:35.900 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-02-28T16:00:44.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T16:00:44.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:50.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-02-28T16:00:50.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:00:54.329 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-02-28T16:00:55.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-02-28T16:00:55.064 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T16:00:55.064 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-02-28T16:00:55.101 INFO:teuthology.orchestra.run.smithi148.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T16:00:55.101 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T16:00:55.101 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T16:00:55.101 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T16:00:56.102 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-28T16:00:56.102 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T16:00:56.251 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-02-28T16:00:56.293 DEBUG:teuthology.parallel:result is None 2024-02-28T16:01:03.040 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-02-28T16:01:21.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T16:01:21.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:01:21.505 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-02-28T16:01:22.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T16:01:22.194 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T16:01:22.195 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-02-28T16:01:22.231 INFO:teuthology.orchestra.run.smithi157.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T16:01:22.231 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T16:01:22.231 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T16:01:22.232 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T16:01:23.232 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-28T16:01:23.233 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T16:01:23.390 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-02-28T16:01:23.427 DEBUG:teuthology.parallel:result is None 2024-02-28T16:01:23.427 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-28T16:01:23.439 INFO:teuthology.task.internal:Creating test directory... 2024-02-28T16:01:23.439 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T16:01:23.448 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T16:01:23.500 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-28T16:01:23.507 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-28T16:01:23.537 INFO:teuthology.task.internal:Creating archive directory... 2024-02-28T16:01:23.537 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T16:01:23.545 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T16:01:23.606 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-28T16:01:23.612 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-28T16:01:23.613 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T16:01:23.618 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T16:01:23.695 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:01:23.716 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:01:23.727 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:01:23.758 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T16:01:23.763 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-28T16:01:23.770 INFO:teuthology.task.internal:Configuring sudo... 2024-02-28T16:01:23.770 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T16:01:23.780 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T16:01:23.866 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-28T16:01:23.875 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-28T16:01:23.875 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T16:01:23.881 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T16:01:23.928 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:01:24.008 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:01:24.137 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:01:24.221 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:01:24.321 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:01:24.321 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T16:01:24.416 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:01:24.493 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T16:01:24.577 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:01:24.644 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T16:01:24.740 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:01:24.740 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T16:01:24.814 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-02-28T16:01:24.822 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-02-28T16:01:24.939 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:01:24.965 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:01:25.456 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-28T16:01:25.464 INFO:teuthology.task.internal:Starting timer... 2024-02-28T16:01:25.464 INFO:teuthology.run_tasks:Running task pcp... 2024-02-28T16:01:25.499 INFO:teuthology.run_tasks:Running task selinux... 2024-02-28T16:01:25.547 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-28T16:01:25.548 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-02-28T16:01:25.684 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-02-28T16:01:25.689 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-02-28T16:01:25.852 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-02-28T16:01:25.858 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-28T16:01:25.859 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-02-28T16:01:25.923 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-02-28T16:01:25.923 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-02-28T16:01:25.977 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-02-28T16:01:25.977 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi148.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive'} 2024-02-28T16:01:25.978 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:01:26.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:01:26.066 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:01:26.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:01:26.154 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-28T16:01:26.154 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-02-28T16:01:26.245 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-02-28T16:01:26.331 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-28T16:01:26.343 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-28T16:01:26.364 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-28T16:01:26.366 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi148.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-28T16:07:36.655 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi148.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-02-28T16:07:36.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-02-28T16:07:36.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:07:36.805 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-02-28T16:07:36.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-02-28T16:07:36.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T16:07:36.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T16:07:37.107 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-02-28T16:07:37.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-02-28T16:07:37.259 INFO:teuthology.run_tasks:Running task clock... 2024-02-28T16:07:37.271 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-28T16:07:37.271 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T16:07:37.271 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:07:37.279 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T16:07:37.279 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:07:37.373 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T16:07:37.380 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T16:07:37.426 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T16:07:37.434 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T16:07:37.517 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-02-28T16:07:37.523 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-02-28T16:07:37.556 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-02-28T16:07:37.566 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-02-28T16:07:37.608 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T16:07:37.616 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T16:07:37.659 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T16:07:37.667 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T16:07:37.796 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:07:37.797 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:07:37.802 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:07:37.803 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-02-28T16:07:37.803 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.803 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.803 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.803 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.805 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:07:37.805 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-02-28T16:07:37.805 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.805 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.805 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.805 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:07:37.806 INFO:teuthology.run_tasks:Running task install... 2024-02-28T16:07:37.815 DEBUG:teuthology.task.install:project ceph 2024-02-28T16:07:37.815 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}} 2024-02-28T16:07:37.816 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T16:07:37.816 INFO:teuthology.task.install:Using flavor: default 2024-02-28T16:07:37.824 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-28T16:07:37.824 INFO:teuthology.task.install:extra packages: [] 2024-02-28T16:07:37.824 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-02-28T16:07:37.825 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T16:07:37.825 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:37.825 INFO:teuthology.packaging:tag: None 2024-02-28T16:07:37.825 INFO:teuthology.packaging:branch: quincy 2024-02-28T16:07:37.825 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:37.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T16:07:37.827 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-02-28T16:07:37.827 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T16:07:37.827 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:37.827 INFO:teuthology.packaging:tag: None 2024-02-28T16:07:37.827 INFO:teuthology.packaging:branch: quincy 2024-02-28T16:07:37.827 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:37.827 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T16:07:38.053 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/ 2024-02-28T16:07:38.054 INFO:teuthology.task.install.rpm:Package version is 17.2.7-535.gc0f02e60 2024-02-28T16:07:38.158 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/ 2024-02-28T16:07:38.158 INFO:teuthology.task.install.rpm:Package version is 17.2.7-535.gc0f02e60 2024-02-28T16:07:38.165 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T16:07:38.165 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:07:38.165 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T16:07:38.267 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T16:07:38.267 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T16:07:38.267 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:38.268 INFO:teuthology.packaging:tag: None 2024-02-28T16:07:38.268 INFO:teuthology.packaging:branch: quincy 2024-02-28T16:07:38.268 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:38.268 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T16:07:38.329 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/c0f02e608ed955f887728ffa27c686f52f9fd400/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T16:07:38.329 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:07:38.329 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T16:07:38.411 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T16:07:38.425 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T16:07:38.425 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T16:07:38.426 INFO:teuthology.packaging:ref: None 2024-02-28T16:07:38.426 INFO:teuthology.packaging:tag: None 2024-02-28T16:07:38.426 INFO:teuthology.packaging:branch: quincy 2024-02-28T16:07:38.426 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:07:38.426 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T16:07:38.549 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T16:07:38.566 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T16:07:38.638 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-02-28T16:07:38.642 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-02-28T16:07:38.699 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T16:07:38.786 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-02-28T16:07:38.791 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-02-28T16:07:38.990 INFO:teuthology.orchestra.run.smithi148.stdout:74 files removed 2024-02-28T16:07:39.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw 2024-02-28T16:07:39.157 INFO:teuthology.orchestra.run.smithi157.stdout:74 files removed 2024-02-28T16:07:39.196 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw 2024-02-28T16:07:40.095 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 195 kB/s | 77 kB 00:00 2024-02-28T16:07:40.130 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 132 kB/s | 77 kB 00:00 2024-02-28T16:07:40.839 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 14 kB/s | 9.2 kB 00:00 2024-02-28T16:07:40.896 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 14 kB/s | 9.2 kB 00:00 2024-02-28T16:07:41.755 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 2.3 kB/s | 1.8 kB 00:00 2024-02-28T16:07:41.772 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 2.1 kB/s | 1.8 kB 00:00 2024-02-28T16:07:42.526 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - AppStream 12 MB/s | 8.1 MB 00:00 2024-02-28T16:07:42.558 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - AppStream 11 MB/s | 8.1 MB 00:00 2024-02-28T16:07:44.410 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.5 MB 00:00 2024-02-28T16:07:44.468 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - BaseOS 6.5 MB/s | 2.5 MB 00:00 2024-02-28T16:07:45.731 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-02-28T16:07:46.006 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.0 MB 00:00 2024-02-28T16:07:47.741 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-02-28T16:07:50.156 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 19 MB 00:02 2024-02-28T16:07:52.092 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-02-28T16:07:53.734 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 15 kB 00:00 2024-02-28T16:07:55.466 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.1 MB 00:01 2024-02-28T16:07:55.724 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2024-02-28T16:07:57.116 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2024-02-28T16:07:59.969 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 20 MB 00:02 2024-02-28T16:08:01.502 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-02-28T16:08:04.144 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:08:04.144 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:08:04.144 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:08:04.144 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.144 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:08:04.144 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.145 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:08:04.146 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:08:04.147 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:08:04.148 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.149 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:08:04.149 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.149 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:08:04.149 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.149 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:08:04.150 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.151 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.152 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.153 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.154 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.155 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:04.813 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:08:04.824 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 14 M 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.1 M 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 5.0 M 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 23 M 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 636 k 2024-02-28T16:08:04.825 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 458 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 4.9 M 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 45 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 116 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 156 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 320 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 293 k 2024-02-28T16:08:04.826 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 99 k 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:Install 22 Packages 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 2 Packages 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:04.827 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 58 M 2024-02-28T16:08:04.828 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:08:05.826 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-02-28T16:08:06.794 INFO:teuthology.orchestra.run.smithi157.stdout:(1/24): ceph-base-17.2.7-535.gc0f02e60.el9.x86_ 2.8 MB/s | 5.0 MB 00:01 2024-02-28T16:08:06.920 INFO:teuthology.orchestra.run.smithi157.stdout:(2/24): ceph-selinux-17.2.7-535.gc0f02e60.el9.x 202 kB/s | 25 kB 00:00 2024-02-28T16:08:07.137 INFO:teuthology.orchestra.run.smithi157.stdout:(3/24): libcephfs2-17.2.7-535.gc0f02e60.el9.x86 2.9 MB/s | 636 kB 00:00 2024-02-28T16:08:07.262 INFO:teuthology.orchestra.run.smithi157.stdout:(4/24): libradosstriper1-17.2.7-535.gc0f02e60.e 3.6 MB/s | 458 kB 00:00 2024-02-28T16:08:08.179 INFO:teuthology.orchestra.run.smithi157.stdout:(5/24): librgw2-17.2.7-535.gc0f02e60.el9.x86_64 5.4 MB/s | 4.9 MB 00:00 2024-02-28T16:08:08.296 INFO:teuthology.orchestra.run.smithi157.stdout:(6/24): python3-ceph-argparse-17.2.7-535.gc0f02 389 kB/s | 45 kB 00:00 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.436 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:08:08.437 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:08:08.438 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:08:08.439 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.440 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.441 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.442 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.443 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.444 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:08.463 INFO:teuthology.orchestra.run.smithi157.stdout:(7/24): python3-ceph-common-17.2.7-535.gc0f02e6 699 kB/s | 116 kB 00:00 2024-02-28T16:08:08.588 INFO:teuthology.orchestra.run.smithi157.stdout:(8/24): python3-cephfs-17.2.7-535.gc0f02e60.el9 1.2 MB/s | 156 kB 00:00 2024-02-28T16:08:08.713 INFO:teuthology.orchestra.run.smithi157.stdout:(9/24): python3-rados-17.2.7-535.gc0f02e60.el9. 2.5 MB/s | 320 kB 00:00 2024-02-28T16:08:08.847 INFO:teuthology.orchestra.run.smithi157.stdout:(10/24): python3-rbd-17.2.7-535.gc0f02e60.el9.x 2.2 MB/s | 293 kB 00:00 2024-02-28T16:08:09.083 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 14 M 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.1 M 2024-02-28T16:08:09.097 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 5.0 M 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 23 M 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 636 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 458 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 4.9 M 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T16:08:09.098 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 45 k 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 116 k 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 156 k 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 320 k 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 293 k 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 99 k 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout:Install 22 Packages 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2024-02-28T16:08:09.099 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:09.100 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 58 M 2024-02-28T16:08:09.100 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:08:09.139 INFO:teuthology.orchestra.run.smithi157.stdout:(11/24): ceph-radosgw-17.2.7-535.gc0f02e60.el9. 3.4 MB/s | 14 MB 00:04 2024-02-28T16:08:09.164 INFO:teuthology.orchestra.run.smithi157.stdout:(12/24): python3-rgw-17.2.7-535.gc0f02e60.el9.x 314 kB/s | 99 kB 00:00 2024-02-28T16:08:09.582 INFO:teuthology.orchestra.run.smithi157.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 109 kB/s | 45 kB 00:00 2024-02-28T16:08:09.765 INFO:teuthology.orchestra.run.smithi157.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 257 kB/s | 160 kB 00:00 2024-02-28T16:08:09.973 INFO:teuthology.orchestra.run.smithi157.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-02-28T16:08:10.082 INFO:teuthology.orchestra.run.smithi157.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 392 kB/s | 42 kB 00:00 2024-02-28T16:08:10.115 INFO:teuthology.orchestra.run.smithi157.stdout:(17/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.2 MB/s | 662 kB 00:00 2024-02-28T16:08:10.600 INFO:teuthology.orchestra.run.smithi157.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 100 kB/s | 49 kB 00:00 2024-02-28T16:08:10.708 INFO:teuthology.orchestra.run.smithi157.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 494 kB/s | 309 kB 00:00 2024-02-28T16:08:10.733 INFO:teuthology.orchestra.run.smithi157.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 512 kB/s | 67 kB 00:00 2024-02-28T16:08:11.017 INFO:teuthology.orchestra.run.smithi157.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 5.1 MB/s | 1.6 MB 00:00 2024-02-28T16:08:11.810 INFO:teuthology.orchestra.run.smithi148.stdout:(1/24): ceph-base-17.2.7-535.gc0f02e60.el9.x86_ 1.9 MB/s | 5.0 MB 00:02 2024-02-28T16:08:11.902 INFO:teuthology.orchestra.run.smithi148.stdout:(2/24): ceph-selinux-17.2.7-535.gc0f02e60.el9.x 278 kB/s | 25 kB 00:00 2024-02-28T16:08:12.042 INFO:teuthology.orchestra.run.smithi157.stdout:(22/24): librbd1-17.2.7-535.gc0f02e60.el9.x86_6 2.9 MB/s | 2.9 MB 00:01 2024-02-28T16:08:12.169 INFO:teuthology.orchestra.run.smithi148.stdout:(3/24): libcephfs2-17.2.7-535.gc0f02e60.el9.x86 2.3 MB/s | 636 kB 00:00 2024-02-28T16:08:12.377 INFO:teuthology.orchestra.run.smithi148.stdout:(4/24): libradosstriper1-17.2.7-535.gc0f02e60.e 2.2 MB/s | 458 kB 00:00 2024-02-28T16:08:13.603 INFO:teuthology.orchestra.run.smithi148.stdout:(5/24): librgw2-17.2.7-535.gc0f02e60.el9.x86_64 4.0 MB/s | 4.9 MB 00:01 2024-02-28T16:08:13.686 INFO:teuthology.orchestra.run.smithi148.stdout:(6/24): python3-ceph-argparse-17.2.7-535.gc0f02 549 kB/s | 45 kB 00:00 2024-02-28T16:08:13.878 INFO:teuthology.orchestra.run.smithi148.stdout:(7/24): python3-ceph-common-17.2.7-535.gc0f02e6 608 kB/s | 116 kB 00:00 2024-02-28T16:08:14.212 INFO:teuthology.orchestra.run.smithi148.stdout:(8/24): ceph-radosgw-17.2.7-535.gc0f02e60.el9.x 2.8 MB/s | 14 MB 00:05 2024-02-28T16:08:14.248 INFO:teuthology.orchestra.run.smithi148.stdout:(9/24): python3-cephfs-17.2.7-535.gc0f02e60.el9 427 kB/s | 156 kB 00:00 2024-02-28T16:08:14.404 INFO:teuthology.orchestra.run.smithi148.stdout:(10/24): python3-rados-17.2.7-535.gc0f02e60.el9 1.6 MB/s | 320 kB 00:00 2024-02-28T16:08:14.463 INFO:teuthology.orchestra.run.smithi148.stdout:(11/24): python3-rbd-17.2.7-535.gc0f02e60.el9.x 1.3 MB/s | 293 kB 00:00 2024-02-28T16:08:14.513 INFO:teuthology.orchestra.run.smithi148.stdout:(12/24): python3-rgw-17.2.7-535.gc0f02e60.el9.x 922 kB/s | 99 kB 00:00 2024-02-28T16:08:14.822 INFO:teuthology.orchestra.run.smithi148.stdout:(13/24): ceph-common-17.2.7-535.gc0f02e60.el9.x 4.0 MB/s | 23 MB 00:05 2024-02-28T16:08:14.914 INFO:teuthology.orchestra.run.smithi148.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 113 kB/s | 45 kB 00:00 2024-02-28T16:08:14.939 INFO:teuthology.orchestra.run.smithi148.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 337 kB/s | 160 kB 00:00 2024-02-28T16:08:14.959 INFO:teuthology.orchestra.run.smithi157.stdout:(23/24): ceph-common-17.2.7-535.gc0f02e60.el9.x 2.3 MB/s | 23 MB 00:09 2024-02-28T16:08:14.989 INFO:teuthology.orchestra.run.smithi148.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 860 kB/s | 42 kB 00:00 2024-02-28T16:08:15.023 INFO:teuthology.orchestra.run.smithi148.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-02-28T16:08:15.056 INFO:teuthology.orchestra.run.smithi148.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-02-28T16:08:15.159 INFO:teuthology.orchestra.run.smithi157.stdout:(24/24): librados2-17.2.7-535.gc0f02e60.el9.x86 712 kB/s | 3.1 MB 00:04 2024-02-28T16:08:15.170 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:15.170 INFO:teuthology.orchestra.run.smithi157.stdout:Total 5.6 MB/s | 58 MB 00:10 2024-02-28T16:08:15.332 INFO:teuthology.orchestra.run.smithi148.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 158 kB/s | 49 kB 00:00 2024-02-28T16:08:15.357 INFO:teuthology.orchestra.run.smithi148.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 360 kB/s | 67 kB 00:00 2024-02-28T16:08:15.362 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:08:15.424 INFO:teuthology.orchestra.run.smithi148.stdout:(21/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 713 kB/s | 309 kB 00:00 2024-02-28T16:08:15.438 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:08:15.438 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:08:15.733 INFO:teuthology.orchestra.run.smithi148.stdout:(22/24): librbd1-17.2.7-535.gc0f02e60.el9.x86_6 9.5 MB/s | 2.9 MB 00:00 2024-02-28T16:08:15.874 INFO:teuthology.orchestra.run.smithi148.stdout:(23/24): librados2-17.2.7-535.gc0f02e60.el9.x86 6.0 MB/s | 3.1 MB 00:00 2024-02-28T16:08:15.986 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:08:15.987 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:08:16.066 INFO:teuthology.orchestra.run.smithi148.stdout:(24/24): thrift-0.15.0-2.el9.x86_64.rpm 2.2 MB/s | 1.6 MB 00:00 2024-02-28T16:08:16.077 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:16.077 INFO:teuthology.orchestra.run.smithi148.stdout:Total 8.3 MB/s | 58 MB 00:06 2024-02-28T16:08:16.271 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:08:16.349 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:08:16.349 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:08:16.912 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:08:16.913 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:08:17.363 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:08:17.808 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-28T16:08:17.852 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T16:08:17.968 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T16:08:18.053 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T16:08:18.087 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T16:08:18.212 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T16:08:18.274 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-28T16:08:18.313 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:08:18.320 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-28T16:08:18.763 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-02-28T16:08:18.801 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T16:08:18.897 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-28T16:08:18.907 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T16:08:18.923 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T16:08:19.028 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T16:08:19.034 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T16:08:19.053 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T16:08:19.079 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-28T16:08:19.150 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 10/26 2024-02-28T16:08:19.179 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T16:08:19.203 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T16:08:19.276 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-02-28T16:08:19.310 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T16:08:19.311 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-02-28T16:08:19.368 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T16:08:19.461 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T16:08:19.528 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-28T16:08:19.579 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-28T16:08:19.620 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-28T16:08:19.861 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-02-28T16:08:19.964 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T16:08:20.025 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-28T16:08:20.048 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 8/26 2024-02-28T16:08:20.064 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T16:08:20.098 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-02-28T16:08:20.177 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T16:08:20.190 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 10/26 2024-02-28T16:08:20.248 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T16:08:20.271 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 19/26 2024-02-28T16:08:20.332 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 20/26 2024-02-28T16:08:20.353 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T16:08:20.392 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T16:08:20.490 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T16:08:20.561 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-02-28T16:08:20.611 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-02-28T16:08:20.652 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-02-28T16:08:21.031 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-02-28T16:08:21.071 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T16:08:21.185 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 18/26 2024-02-28T16:08:21.290 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 19/26 2024-02-28T16:08:21.348 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 20/26 2024-02-28T16:08:23.135 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T16:08:23.376 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T16:08:24.027 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T16:08:24.074 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T16:08:24.155 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T16:08:24.204 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T16:08:24.225 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T16:08:24.225 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T16:08:24.226 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T16:08:24.226 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:24.275 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T16:08:24.840 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 21/26 2024-02-28T16:08:24.915 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T16:08:25.072 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 22/26 2024-02-28T16:08:25.072 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T16:08:25.072 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T16:08:25.072 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:25.124 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T16:08:34.776 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T16:08:34.776 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-02-28T16:08:34.776 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-02-28T16:08:34.776 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-02-28T16:08:34.776 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-02-28T16:08:34.777 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-02-28T16:08:34.777 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /root 2024-02-28T16:08:34.777 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-02-28T16:08:34.777 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-02-28T16:08:36.095 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:36.234 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T16:08:36.389 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T16:08:36.389 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:36.389 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T16:08:36.389 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:36.389 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:36.389 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:36.394 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T16:08:36.523 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T16:08:36.523 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T16:08:37.586 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T16:08:37.749 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 24/26 2024-02-28T16:08:37.749 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:08:37.749 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T16:08:37.750 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:37.750 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T16:08:37.750 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:37.755 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T16:08:37.867 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-02-28T16:08:37.867 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T16:08:38.147 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T16:08:38.147 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 1/26 2024-02-28T16:08:38.148 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T16:08:38.148 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T16:08:38.148 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T16:08:38.148 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 5/26 2024-02-28T16:08:38.148 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 6/26 2024-02-28T16:08:38.148 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 7/26 2024-02-28T16:08:38.151 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 8/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 9/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 10/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-28T16:08:38.152 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-28T16:08:38.153 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T16:08:38.153 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-28T16:08:38.153 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 25/26 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.854 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T16:08:38.855 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:38.856 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:08:39.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-test 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 1/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 3/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 4/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 5/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 6/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 7/26 2024-02-28T16:08:39.587 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x 8/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86 9/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 10/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 11/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 12/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 13/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-02-28T16:08:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 23/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-02-28T16:08:39.589 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 25/26 2024-02-28T16:08:40.196 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:39 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:08:40.499 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:08:40.499 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:08:40.499 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:08:40.499 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.499 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:08:40.499 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.499 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:08:40.500 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:08:40.501 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:08:40.502 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:08:40.503 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.504 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:40.505 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:40.506 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.507 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:40.573 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:08:40.573 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 48 M 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 162 k 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:40.574 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-02-28T16:08:40.575 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:40.575 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 49 M 2024-02-28T16:08:40.575 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 196 M 2024-02-28T16:08:40.575 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.681 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T16:08:40.682 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.683 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.683 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:40.683 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T16:08:40.683 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:40.683 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:08:41.103 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-test 2024-02-28T16:08:41.185 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 843 kB/s | 187 kB 00:00 2024-02-28T16:08:41.251 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 218 kB 00:00 2024-02-28T16:08:41.427 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.7 MB/s | 305 kB 00:00 2024-02-28T16:08:41.477 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-02-28T16:08:41.685 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): libcephsqlite-17.2.7-535.gc0f02e60.el9.x 225 kB/s | 162 kB 00:00 2024-02-28T16:08:42.015 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:37 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:08:42.322 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:08:42.322 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:08:42.322 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.323 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.324 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:08:42.325 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.326 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.327 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.328 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.329 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.330 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.331 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:42.393 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:08:42.394 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:08:42.394 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 48 M 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 162 k 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:08:42.395 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:08:42.396 INFO:teuthology.orchestra.run.smithi148.stdout:Install 6 Packages 2024-02-28T16:08:42.396 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:08:42.396 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 49 M 2024-02-28T16:08:42.396 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 196 M 2024-02-28T16:08:42.396 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:08:43.217 INFO:teuthology.orchestra.run.smithi148.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 841 kB/s | 187 kB 00:00 2024-02-28T16:08:43.316 INFO:teuthology.orchestra.run.smithi148.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 218 kB 00:00 2024-02-28T16:08:43.476 INFO:teuthology.orchestra.run.smithi148.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 305 kB 00:00 2024-02-28T16:08:43.534 INFO:teuthology.orchestra.run.smithi148.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-02-28T16:08:43.701 INFO:teuthology.orchestra.run.smithi148.stdout:(5/6): libcephsqlite-17.2.7-535.gc0f02e60.el9.x 230 kB/s | 162 kB 00:00 2024-02-28T16:08:44.686 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): ceph-test-17.2.7-535.gc0f02e60.el9.x86_6 13 MB/s | 48 MB 00:03 2024-02-28T16:08:44.695 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:44.695 INFO:teuthology.orchestra.run.smithi157.stdout:Total 12 MB/s | 49 MB 00:04 2024-02-28T16:08:44.840 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:08:44.877 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:08:44.878 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:08:45.362 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:08:45.362 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:08:46.067 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:08:46.156 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T16:08:46.200 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T16:08:46.275 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T16:08:46.334 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T16:08:46.363 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T16:08:51.140 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T16:08:51.263 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T16:08:53.458 INFO:teuthology.orchestra.run.smithi148.stdout:(6/6): ceph-test-17.2.7-535.gc0f02e60.el9.x86_6 4.6 MB/s | 48 MB 00:10 2024-02-28T16:08:53.461 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:08:53.462 INFO:teuthology.orchestra.run.smithi148.stdout:Total 4.4 MB/s | 49 MB 00:11 2024-02-28T16:08:53.600 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:08:53.651 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T16:08:53.651 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 1/6 2024-02-28T16:08:53.651 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2/6 2024-02-28T16:08:53.651 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T16:08:53.651 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T16:08:53.651 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T16:08:53.652 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:08:53.652 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-16.el9.x86_64 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T16:08:54.016 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-28T16:08:54.017 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T16:08:54.017 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:54.017 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:08:54.140 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:08:54.140 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:08:54.357 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph 2024-02-28T16:08:54.867 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:08:54.973 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T16:08:55.016 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T16:08:55.060 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T16:08:55.128 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T16:08:55.153 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T16:08:55.261 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:54 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:08:55.563 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:08:55.564 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.565 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.566 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:08:55.567 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.568 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.569 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.570 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.571 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:08:55.651 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 6.5 k 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.1 M 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 1.4 M 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 239 k 2024-02-28T16:08:55.654 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.7 M 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 15 M 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T16:08:55.655 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T16:08:55.656 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T16:08:55.656 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T16:08:55.656 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T16:08:55.656 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T16:08:55.656 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T16:08:55.656 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T16:08:55.657 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T16:08:55.657 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T16:08:55.657 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout:Install 33 Packages 2024-02-28T16:08:55.658 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:08:55.659 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 27 M 2024-02-28T16:08:55.659 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 99 M 2024-02-28T16:08:55.659 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:08:56.754 INFO:teuthology.orchestra.run.smithi157.stdout:(1/33): ceph-17.2.7-535.gc0f02e60.el9.x86_64.rp 15 kB/s | 6.5 kB 00:00 2024-02-28T16:08:58.912 INFO:teuthology.orchestra.run.smithi157.stdout:(2/33): ceph-mgr-17.2.7-535.gc0f02e60.el9.x86_6 554 kB/s | 1.4 MB 00:02 2024-02-28T16:09:00.008 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 5/6 2024-02-28T16:09:00.103 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T16:09:01.229 INFO:teuthology.orchestra.run.smithi157.stdout:(3/33): ceph-mon-17.2.7-535.gc0f02e60.el9.x86_6 846 kB/s | 3.7 MB 00:04 2024-02-28T16:09:01.479 INFO:teuthology.orchestra.run.smithi157.stdout:(4/33): ceph-mgr-modules-core-17.2.7-535.gc0f02 960 kB/s | 239 kB 00:00 2024-02-28T16:09:01.762 INFO:teuthology.orchestra.run.smithi157.stdout:(5/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 897 kB/s | 253 kB 00:00 2024-02-28T16:09:01.904 INFO:teuthology.orchestra.run.smithi157.stdout:(6/33): python3-cryptography-36.0.1-4.el9.x86_6 8.7 MB/s | 1.2 MB 00:00 2024-02-28T16:09:01.996 INFO:teuthology.orchestra.run.smithi157.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-02-28T16:09:02.088 INFO:teuthology.orchestra.run.smithi157.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.5 MB/s | 135 kB 00:00 2024-02-28T16:09:02.197 INFO:teuthology.orchestra.run.smithi157.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-02-28T16:09:02.305 INFO:teuthology.orchestra.run.smithi157.stdout:(10/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.0 MB/s | 215 kB 00:00 2024-02-28T16:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 6/6 2024-02-28T16:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 1/6 2024-02-28T16:09:02.362 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2/6 2024-02-28T16:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T16:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T16:09:02.363 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T16:09:02.769 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: jq-1.6-16.el9.x86_64 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:02.770 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:02.823 INFO:teuthology.orchestra.run.smithi157.stdout:(11/33): ceph-mds-17.2.7-535.gc0f02e60.el9.x86_ 325 kB/s | 2.1 MB 00:06 2024-02-28T16:09:03.202 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph 2024-02-28T16:09:03.231 INFO:teuthology.orchestra.run.smithi157.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 186 kB/s | 172 kB 00:00 2024-02-28T16:09:03.481 INFO:teuthology.orchestra.run.smithi157.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 53 kB/s | 35 kB 00:00 2024-02-28T16:09:03.982 INFO:teuthology.orchestra.run.smithi157.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 68 kB/s | 51 kB 00:00 2024-02-28T16:09:04.098 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:59 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:04.123 INFO:teuthology.orchestra.run.smithi157.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 309 kB/s | 43 kB 00:00 2024-02-28T16:09:04.273 INFO:teuthology.orchestra.run.smithi157.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-02-28T16:09:04.307 INFO:teuthology.orchestra.run.smithi157.stdout:(17/33): python3-toml-0.10.2-6.el9.noarch.rpm 55 kB/s | 42 kB 00:00 2024-02-28T16:09:04.374 INFO:teuthology.orchestra.run.smithi157.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-02-28T16:09:04.400 INFO:teuthology.orchestra.run.smithi157.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 118 kB/s | 11 kB 00:00 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.407 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.408 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.409 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.410 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:04.411 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.412 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.413 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.414 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.415 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.415 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.415 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:04.415 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.415 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.415 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.415 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:04.450 INFO:teuthology.orchestra.run.smithi157.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 469 kB/s | 23 kB 00:00 2024-02-28T16:09:04.484 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:04.486 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:04.486 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:09:04.486 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:04.486 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:09:04.486 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 6.5 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.1 M 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 1.4 M 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 239 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 3.7 M 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 15 M 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T16:09:04.487 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T16:09:04.488 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout:Install 33 Packages 2024-02-28T16:09:04.489 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:04.490 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 27 M 2024-02-28T16:09:04.490 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 99 M 2024-02-28T16:09:04.490 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:09:04.500 INFO:teuthology.orchestra.run.smithi157.stdout:(21/33): python3-jaraco-functools-3.5.0-2.el9.n 393 kB/s | 19 kB 00:00 2024-02-28T16:09:04.550 INFO:teuthology.orchestra.run.smithi157.stdout:(22/33): python3-jaraco-text-3.2.0-6.el9.noarch 398 kB/s | 20 kB 00:00 2024-02-28T16:09:04.609 INFO:teuthology.orchestra.run.smithi157.stdout:(23/33): python3-logutils-0.3.5-21.el9.noarch.r 804 kB/s | 46 kB 00:00 2024-02-28T16:09:04.642 INFO:teuthology.orchestra.run.smithi157.stdout:(24/33): python3-jaraco-classes-3.2.1-5.el9.noa 66 kB/s | 18 kB 00:00 2024-02-28T16:09:04.676 INFO:teuthology.orchestra.run.smithi157.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2024-02-28T16:09:04.752 INFO:teuthology.orchestra.run.smithi157.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-02-28T16:09:04.802 INFO:teuthology.orchestra.run.smithi157.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 131 kB/s | 16 kB 00:00 2024-02-28T16:09:04.844 INFO:teuthology.orchestra.run.smithi157.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 872 kB/s | 36 kB 00:00 2024-02-28T16:09:04.869 INFO:teuthology.orchestra.run.smithi157.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 772 kB/s | 90 kB 00:00 2024-02-28T16:09:04.929 INFO:teuthology.orchestra.run.smithi157.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-02-28T16:09:04.970 INFO:teuthology.orchestra.run.smithi157.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 489 kB/s | 20 kB 00:00 2024-02-28T16:09:05.003 INFO:teuthology.orchestra.run.smithi157.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2024-02-28T16:09:05.510 INFO:teuthology.orchestra.run.smithi148.stdout:(1/33): ceph-17.2.7-535.gc0f02e60.el9.x86_64.rp 18 kB/s | 6.5 kB 00:00 2024-02-28T16:09:05.869 INFO:teuthology.orchestra.run.smithi148.stdout:(2/33): ceph-mgr-17.2.7-535.gc0f02e60.el9.x86_6 2.0 MB/s | 1.4 MB 00:00 2024-02-28T16:09:06.402 INFO:teuthology.orchestra.run.smithi148.stdout:(3/33): ceph-mds-17.2.7-535.gc0f02e60.el9.x86_6 1.7 MB/s | 2.1 MB 00:01 2024-02-28T16:09:07.230 INFO:teuthology.orchestra.run.smithi148.stdout:(4/33): ceph-mon-17.2.7-535.gc0f02e60.el9.x86_6 2.2 MB/s | 3.7 MB 00:01 2024-02-28T16:09:07.263 INFO:teuthology.orchestra.run.smithi148.stdout:(5/33): ceph-mgr-modules-core-17.2.7-535.gc0f02 278 kB/s | 239 kB 00:00 2024-02-28T16:09:07.497 INFO:teuthology.orchestra.run.smithi148.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 953 kB/s | 253 kB 00:00 2024-02-28T16:09:07.564 INFO:teuthology.orchestra.run.smithi148.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-02-28T16:09:07.631 INFO:teuthology.orchestra.run.smithi148.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-02-28T16:09:07.706 INFO:teuthology.orchestra.run.smithi148.stdout:(9/33): python3-requests-2.25.1-8.el9.noarch.rp 1.6 MB/s | 125 kB 00:00 2024-02-28T16:09:07.773 INFO:teuthology.orchestra.run.smithi148.stdout:(10/33): python3-cryptography-36.0.1-4.el9.x86_ 2.4 MB/s | 1.2 MB 00:00 2024-02-28T16:09:07.831 INFO:teuthology.orchestra.run.smithi148.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-02-28T16:09:07.865 INFO:teuthology.orchestra.run.smithi148.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-02-28T16:09:07.890 INFO:teuthology.orchestra.run.smithi148.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 598 kB/s | 35 kB 00:00 2024-02-28T16:09:07.932 INFO:teuthology.orchestra.run.smithi148.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 775 kB/s | 51 kB 00:00 2024-02-28T16:09:07.958 INFO:teuthology.orchestra.run.smithi148.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 629 kB/s | 42 kB 00:00 2024-02-28T16:09:08.541 INFO:teuthology.orchestra.run.smithi148.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 71 kB/s | 43 kB 00:00 2024-02-28T16:09:08.670 INFO:teuthology.orchestra.run.smithi157.stdout:(33/33): ceph-osd-17.2.7-535.gc0f02e60.el9.x86_ 1.6 MB/s | 15 MB 00:09 2024-02-28T16:09:08.677 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:08.678 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.1 MB/s | 27 MB 00:13 2024-02-28T16:09:08.758 INFO:teuthology.orchestra.run.smithi148.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 215 kB/s | 172 kB 00:00 2024-02-28T16:09:09.008 INFO:teuthology.orchestra.run.smithi148.stdout:(18/33): ceph-osd-17.2.7-535.gc0f02e60.el9.x86_ 4.9 MB/s | 15 MB 00:03 2024-02-28T16:09:09.033 INFO:teuthology.orchestra.run.smithi148.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 39 kB/s | 11 kB 00:00 2024-02-28T16:09:09.051 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:09:09.067 INFO:teuthology.orchestra.run.smithi148.stdout:(20/33): python3-cherrypy-18.6.1-2.el9.noarch.r 683 kB/s | 358 kB 00:00 2024-02-28T16:09:09.137 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:09:09.137 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:09:09.184 INFO:teuthology.orchestra.run.smithi148.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 155 kB/s | 23 kB 00:00 2024-02-28T16:09:09.209 INFO:teuthology.orchestra.run.smithi148.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 137 kB/s | 19 kB 00:00 2024-02-28T16:09:09.334 INFO:teuthology.orchestra.run.smithi148.stdout:(23/33): python3-logutils-0.3.5-21.el9.noarch.r 374 kB/s | 46 kB 00:00 2024-02-28T16:09:09.360 INFO:teuthology.orchestra.run.smithi148.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 132 kB/s | 20 kB 00:00 2024-02-28T16:09:09.443 INFO:teuthology.orchestra.run.smithi148.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 732 kB/s | 79 kB 00:00 2024-02-28T16:09:09.566 INFO:teuthology.orchestra.run.smithi148.stdout:(26/33): python3-jaraco-classes-3.2.1-5.el9.noa 32 kB/s | 18 kB 00:00 2024-02-28T16:09:09.588 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:09:09.589 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:09:09.594 INFO:teuthology.orchestra.run.smithi148.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 110 kB/s | 16 kB 00:00 2024-02-28T16:09:09.702 INFO:teuthology.orchestra.run.smithi148.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 332 kB/s | 36 kB 00:00 2024-02-28T16:09:09.794 INFO:teuthology.orchestra.run.smithi148.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 628 kB/s | 272 kB 00:00 2024-02-28T16:09:09.860 INFO:teuthology.orchestra.run.smithi148.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 306 kB/s | 90 kB 00:00 2024-02-28T16:09:09.978 INFO:teuthology.orchestra.run.smithi148.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 171 kB/s | 20 kB 00:00 2024-02-28T16:09:10.028 INFO:teuthology.orchestra.run.smithi148.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 707 kB/s | 230 kB 00:00 2024-02-28T16:09:10.387 INFO:teuthology.orchestra.run.smithi148.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 722 kB/s | 427 kB 00:00 2024-02-28T16:09:10.398 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:10.398 INFO:teuthology.orchestra.run.smithi148.stdout:Total 4.6 MB/s | 27 MB 00:05 2024-02-28T16:09:10.773 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:09:10.857 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:09:10.858 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:09:11.035 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:09:11.123 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T16:09:11.163 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T16:09:11.208 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T16:09:11.274 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:09:11.275 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:09:11.359 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T16:09:11.487 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T16:09:11.538 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T16:09:11.579 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T16:09:11.608 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T16:09:11.644 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T16:09:11.688 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T16:09:11.748 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T16:09:11.819 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T16:09:11.866 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T16:09:11.923 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T16:09:12.064 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T16:09:12.256 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T16:09:12.355 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T16:09:12.449 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T16:09:12.492 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T16:09:12.559 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T16:09:12.631 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T16:09:12.759 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:09:12.857 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T16:09:12.879 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T16:09:12.906 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T16:09:12.959 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T16:09:12.996 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T16:09:13.110 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T16:09:13.123 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T16:09:13.232 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T16:09:13.241 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T16:09:13.288 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T16:09:13.293 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T16:09:13.330 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T16:09:13.367 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T16:09:13.412 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T16:09:13.480 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T16:09:13.481 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T16:09:13.545 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T16:09:13.613 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T16:09:13.651 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 28/33 2024-02-28T16:09:13.658 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T16:09:13.701 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T16:09:13.716 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T16:09:13.800 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T16:09:13.800 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:13.800 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T16:09:13.800 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:09:13.800 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:09:13.800 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:13.866 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T16:09:14.057 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T16:09:14.164 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T16:09:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T16:09:14.276 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T16:09:14.341 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T16:09:14.420 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T16:09:14.677 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T16:09:14.739 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T16:09:14.828 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T16:09:14.947 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T16:09:15.002 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T16:09:15.154 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T16:09:15.310 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T16:09:15.329 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 28/33 2024-02-28T16:09:15.360 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T16:09:15.388 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T16:09:15.388 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:15.388 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T16:09:15.388 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:09:15.388 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:09:15.388 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:15.434 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 29/33 2024-02-28T16:09:15.434 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:15.434 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T16:09:15.434 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:09:15.434 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T16:09:15.434 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:15.802 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T16:09:15.878 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T16:09:15.878 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:15.878 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T16:09:15.878 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:09:15.878 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:09:15.878 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:16.103 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T16:09:16.179 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T16:09:16.179 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:16.179 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T16:09:16.179 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:09:16.179 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:09:16.179 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:16.247 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T16:09:16.372 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T16:09:16.372 INFO:teuthology.orchestra.run.smithi157.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T16:09:16.372 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:16.894 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T16:09:16.970 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 30/33 2024-02-28T16:09:16.971 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:16.971 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T16:09:16.971 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:09:16.971 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T16:09:16.971 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:17.419 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T16:09:17.489 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 31/33 2024-02-28T16:09:17.490 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:17.490 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T16:09:17.490 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:09:17.490 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T16:09:17.490 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:17.720 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T16:09:17.788 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 32/33 2024-02-28T16:09:17.788 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:17.788 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T16:09:17.788 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:09:17.788 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T16:09:17.788 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:17.879 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T16:09:17.993 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 33/33 2024-02-28T16:09:17.993 INFO:teuthology.orchestra.run.smithi148.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T16:09:17.993 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 1/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 3/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 4/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 5/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 6/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T16:09:18.079 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T16:09:18.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T16:09:18.081 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T16:09:18.081 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T16:09:18.081 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T16:09:18.081 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T16:09:18.081 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T16:09:18.082 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T16:09:18.082 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T16:09:18.082 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T16:09:18.082 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T16:09:18.082 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T16:09:19.080 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T16:09:19.080 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:19.080 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:09:19.080 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:19.080 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T16:09:19.081 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T16:09:19.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T16:09:19.083 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T16:09:19.083 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T16:09:19.083 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T16:09:19.083 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T16:09:19.083 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:19.083 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:19.498 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-base 2024-02-28T16:09:19.811 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 1/33 2024-02-28T16:09:19.811 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2/33 2024-02-28T16:09:19.811 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 3/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 4/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 5/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.n 6/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T16:09:19.812 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T16:09:19.813 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T16:09:19.814 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T16:09:20.373 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:19 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:20.685 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:20.686 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:20.687 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:20.688 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.689 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:20.690 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.691 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:20.691 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.691 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:20.691 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.691 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:20.691 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.691 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.692 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.693 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.694 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.695 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.695 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:20.695 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:09:20.760 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:09:20.761 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:09:20.761 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:20.842 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install cephadm 2024-02-28T16:09:20.910 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T16:09:20.910 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:20.910 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:09:20.910 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:20.910 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:20.910 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:20.910 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T16:09:20.911 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T16:09:20.912 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T16:09:20.913 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T16:09:20.913 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:20.913 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:21.399 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-base 2024-02-28T16:09:21.697 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:20 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:22.019 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:22.019 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:22.019 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:22.019 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:22.020 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:22.021 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:22.022 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:22.023 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.024 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.025 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.026 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.027 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.028 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.028 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:22.028 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.028 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.028 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.028 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.092 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:09:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:22.093 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:09:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:09:22.093 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 80 k 2024-02-28T16:09:22.093 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:22.093 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:09:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-28T16:09:22.094 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 80 k 2024-02-28T16:09:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 364 k 2024-02-28T16:09:22.094 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:09:22.279 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:17 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:22.592 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:22.592 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:22.592 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:22.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.592 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:22.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:22.594 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:22.595 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:22.596 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:22.597 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.598 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:22.599 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.600 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.600 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.600 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.600 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:22.600 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.600 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.600 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:22.601 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.602 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.602 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.602 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:22.602 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-base-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:09:22.634 INFO:teuthology.orchestra.run.smithi157.stdout:cephadm-17.2.7-535.gc0f02e60.el9.noarch.rpm 149 kB/s | 80 kB 00:00 2024-02-28T16:09:22.636 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:22.637 INFO:teuthology.orchestra.run.smithi157.stdout:Total 148 kB/s | 80 kB 00:00 2024-02-28T16:09:22.637 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:09:22.655 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:09:22.655 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:09:22.662 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:09:22.663 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:09:22.665 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:22.666 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:09:22.666 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:22.740 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install cephadm 2024-02-28T16:09:22.797 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:09:23.414 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:23.570 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:23.598 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:18 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:23.911 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:23.911 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:23.911 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:23.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.912 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:23.912 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.912 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:23.912 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.912 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:23.912 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.913 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:23.913 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.913 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:23.913 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.913 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:23.913 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.914 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:23.914 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.914 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:23.914 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.914 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:23.914 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.914 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.915 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:23.916 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.916 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:23.916 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.916 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:23.916 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.916 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:23.916 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.917 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:23.917 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.917 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:23.917 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.917 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:23.917 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.917 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:23.918 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.918 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:23.918 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.918 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:23.918 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.919 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:23.919 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.919 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:23.919 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.919 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:23.920 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.920 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:23.920 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.920 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:23.920 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.920 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.921 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:23.922 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.922 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:23.922 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.922 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:23.922 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.923 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.923 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.923 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:23.923 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.923 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.923 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.924 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.924 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:23.924 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.924 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.924 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.924 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.925 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.925 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.925 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:23.925 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.925 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.925 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.926 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.926 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:23.926 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.926 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.926 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.926 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.927 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:23.927 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.927 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.927 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.927 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.927 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:23.927 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.928 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.928 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.928 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.928 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:23.928 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.928 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.929 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.929 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.929 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:23.929 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.929 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.929 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.929 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:23.986 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:23.986 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:23.986 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 80 k 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 80 k 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 364 k 2024-02-28T16:09:23.987 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:09:24.045 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:24.292 INFO:teuthology.orchestra.run.smithi148.stdout:cephadm-17.2.7-535.gc0f02e60.el9.noarch.rpm 264 kB/s | 80 kB 00:00 2024-02-28T16:09:24.294 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:24.294 INFO:teuthology.orchestra.run.smithi148.stdout:Total 262 kB/s | 80 kB 00:00 2024-02-28T16:09:24.295 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:09:24.311 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:09:24.312 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:09:24.319 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:09:24.320 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:09:24.441 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:09:24.461 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:24.461 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:24.461 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:09:24.461 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:24.461 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:24.461 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:24.767 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T16:09:25.141 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:25.280 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:25.649 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:24 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:25.779 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:25.958 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.959 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:25.960 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:25.961 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.962 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.963 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:25.964 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.965 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.966 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.967 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.968 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:25.969 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.969 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.969 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:25.969 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:26.028 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 137 k 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-28T16:09:26.029 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:26.030 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 137 k 2024-02-28T16:09:26.030 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 379 k 2024-02-28T16:09:26.030 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:09:26.129 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/1 2024-02-28T16:09:26.129 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:26.129 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:09:26.129 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:26.130 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:26.130 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:26.375 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T16:09:26.381 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-immutable-object-cache-17.2.7-535.gc0f02e6 390 kB/s | 137 kB 00:00 2024-02-28T16:09:26.383 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:26.384 INFO:teuthology.orchestra.run.smithi157.stdout:Total 386 kB/s | 137 kB 00:00 2024-02-28T16:09:26.385 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:09:26.410 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:09:26.410 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:09:26.508 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:09:26.509 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:09:26.735 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:09:26.808 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T16:09:26.884 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T16:09:26.884 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:26.884 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T16:09:26.884 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:27.271 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:22 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:27.582 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:27.582 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:27.582 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.583 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:27.584 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:27.585 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.586 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.587 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.588 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.589 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:27.590 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.591 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.592 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.593 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:27.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.593 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:27.651 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 137 k 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:09:27.652 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:27.653 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-02-28T16:09:27.653 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:27.653 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 137 k 2024-02-28T16:09:27.653 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 379 k 2024-02-28T16:09:27.653 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:28.197 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:28.198 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-immutable-object-cache-17.2.7-535.gc0f02e6 252 kB/s | 137 kB 00:00 2024-02-28T16:09:28.199 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:28.200 INFO:teuthology.orchestra.run.smithi148.stdout:Total 250 kB/s | 137 kB 00:00 2024-02-28T16:09:28.201 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:09:28.227 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:09:28.227 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:09:28.325 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:09:28.326 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:09:28.539 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:09:28.542 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr 2024-02-28T16:09:28.607 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T16:09:28.682 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T16:09:28.682 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:09:28.682 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T16:09:28.682 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:29.429 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:28 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:29.743 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:29.743 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:29.743 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:29.743 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:29.744 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:29.745 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.746 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:29.746 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.746 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:29.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:29.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:29.754 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:09:29.817 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:09:29.818 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:09:29.818 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:29.892 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T16:09:30.075 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.e 1/1 2024-02-28T16:09:30.075 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:30.075 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:09:30.075 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:09:30.075 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:30.075 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:30.340 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr 2024-02-28T16:09:30.752 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:29 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:31.058 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.059 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.060 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.061 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.062 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.063 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:31.064 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.065 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.066 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.067 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.067 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.067 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:31.067 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.067 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.067 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.067 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.128 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:09:31.129 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 1.7 M 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 23 k 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 15 k 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:09:31.130 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:31.131 INFO:teuthology.orchestra.run.smithi157.stdout:Install 7 Packages 2024-02-28T16:09:31.131 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:31.131 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 2.0 M 2024-02-28T16:09:31.131 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 8.1 M 2024-02-28T16:09:31.131 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:09:31.225 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:26 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:31.545 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:31.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.551 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:31.554 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-mgr-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:09:31.618 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:31.619 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:09:31.619 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:31.709 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T16:09:31.877 INFO:teuthology.orchestra.run.smithi157.stdout:(1/7): ceph-grafana-dashboards-17.2.7-535.gc0f0 64 kB/s | 23 kB 00:00 2024-02-28T16:09:31.902 INFO:teuthology.orchestra.run.smithi157.stdout:(2/7): ceph-prometheus-alerts-17.2.7-535.gc0f02 37 kB/s | 15 kB 00:00 2024-02-28T16:09:32.077 INFO:teuthology.orchestra.run.smithi157.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 45 kB/s | 9.0 kB 00:00 2024-02-28T16:09:32.194 INFO:teuthology.orchestra.run.smithi157.stdout:(4/7): ceph-mgr-dashboard-17.2.7-535.gc0f02e60. 2.5 MB/s | 1.7 MB 00:00 2024-02-28T16:09:32.219 INFO:teuthology.orchestra.run.smithi157.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 129 kB/s | 41 kB 00:00 2024-02-28T16:09:32.236 INFO:teuthology.orchestra.run.smithi157.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 195 kB/s | 31 kB 00:00 2024-02-28T16:09:32.469 INFO:teuthology.orchestra.run.smithi157.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 687 kB/s | 188 kB 00:00 2024-02-28T16:09:32.474 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:32.475 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.5 MB/s | 2.0 MB 00:01 2024-02-28T16:09:32.475 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:09:32.502 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:09:32.503 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:09:32.579 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:27 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:32.644 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:09:32.644 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:09:32.902 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:32.902 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:32.902 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:32.902 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.902 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:32.902 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.903 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:32.904 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.905 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.906 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.907 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.908 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.909 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.910 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.911 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.912 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:32.975 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 1.7 M 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 23 k 2024-02-28T16:09:32.976 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 15 k 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout:Install 7 Packages 2024-02-28T16:09:32.977 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:32.978 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 2.0 M 2024-02-28T16:09:32.978 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 8.1 M 2024-02-28T16:09:32.978 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:09:33.100 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:09:33.154 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T16:09:33.215 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T16:09:33.315 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T16:09:33.318 INFO:teuthology.orchestra.run.smithi148.stdout:(1/7): ceph-grafana-dashboards-17.2.7-535.gc0f0 83 kB/s | 23 kB 00:00 2024-02-28T16:09:33.343 INFO:teuthology.orchestra.run.smithi148.stdout:(2/7): ceph-prometheus-alerts-17.2.7-535.gc0f02 48 kB/s | 15 kB 00:00 2024-02-28T16:09:33.361 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T16:09:33.432 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 5/7 2024-02-28T16:09:33.468 INFO:teuthology.orchestra.run.smithi148.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 61 kB/s | 9.0 kB 00:00 2024-02-28T16:09:33.519 INFO:teuthology.orchestra.run.smithi148.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 235 kB/s | 41 kB 00:00 2024-02-28T16:09:33.586 INFO:teuthology.orchestra.run.smithi148.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 265 kB/s | 31 kB 00:00 2024-02-28T16:09:33.644 INFO:teuthology.orchestra.run.smithi148.stdout:(6/7): ceph-mgr-dashboard-17.2.7-535.gc0f02e60. 2.8 MB/s | 1.7 MB 00:00 2024-02-28T16:09:33.703 INFO:teuthology.orchestra.run.smithi148.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2024-02-28T16:09:33.707 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:33.708 INFO:teuthology.orchestra.run.smithi148.stdout:Total 2.7 MB/s | 2.0 MB 00:00 2024-02-28T16:09:33.708 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:09:33.731 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 6/7 2024-02-28T16:09:33.736 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:09:33.737 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:09:33.774 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T16:09:33.880 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:09:33.881 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:09:34.278 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:09:34.346 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T16:09:34.399 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T16:09:34.414 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T16:09:34.414 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 1/7 2024-02-28T16:09:34.415 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2/7 2024-02-28T16:09:34.415 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 3/7 2024-02-28T16:09:34.415 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T16:09:34.415 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T16:09:34.415 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T16:09:34.491 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T16:09:34.537 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T16:09:34.583 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 5/7 2024-02-28T16:09:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T16:09:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:34.848 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:09:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:34.848 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T16:09:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T16:09:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T16:09:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T16:09:34.849 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:34.849 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:34.876 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 6/7 2024-02-28T16:09:34.915 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T16:09:35.155 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T16:09:35.641 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 7/7 2024-02-28T16:09:35.641 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.n 1/7 2024-02-28T16:09:35.642 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2/7 2024-02-28T16:09:35.642 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.no 3/7 2024-02-28T16:09:35.642 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T16:09:35.642 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T16:09:35.642 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T16:09:36.059 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T16:09:36.059 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:36.059 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:36.060 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:36.091 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:35 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:36.370 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T16:09:36.399 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:36.399 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:36.399 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:36.399 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.399 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.400 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.401 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.402 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.403 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:36.404 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.405 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.406 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.407 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.408 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.409 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:36.470 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:09:36.471 INFO:teuthology.orchestra.run.smithi157.stdout:====================================================================================== 2024-02-28T16:09:36.471 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:09:36.471 INFO:teuthology.orchestra.run.smithi157.stdout:====================================================================================== 2024-02-28T16:09:36.471 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:09:36.471 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 7.4 M 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T16:09:36.472 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T16:09:36.473 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:36.473 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:09:36.473 INFO:teuthology.orchestra.run.smithi157.stdout:====================================================================================== 2024-02-28T16:09:36.473 INFO:teuthology.orchestra.run.smithi157.stdout:Install 12 Packages 2024-02-28T16:09:36.473 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:36.473 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 38 M 2024-02-28T16:09:36.474 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 209 M 2024-02-28T16:09:36.474 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:09:36.960 INFO:teuthology.orchestra.run.smithi157.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 773 kB/s | 195 kB 00:00 2024-02-28T16:09:37.085 INFO:teuthology.orchestra.run.smithi157.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 264 kB/s | 33 kB 00:00 2024-02-28T16:09:37.194 INFO:teuthology.orchestra.run.smithi157.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-02-28T16:09:37.241 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:32 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:37.294 INFO:teuthology.orchestra.run.smithi157.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 184 kB/s | 18 kB 00:00 2024-02-28T16:09:37.386 INFO:teuthology.orchestra.run.smithi157.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 388 kB/s | 35 kB 00:00 2024-02-28T16:09:37.554 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:37.554 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:37.554 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:37.554 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.554 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:37.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:37.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:37.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:37.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:37.594 INFO:teuthology.orchestra.run.smithi157.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.9 MB/s | 3.0 MB 00:00 2024-02-28T16:09:37.630 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:37.631 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 7.4 M 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T16:09:37.632 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout:====================================================================================== 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout:Install 12 Packages 2024-02-28T16:09:37.633 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:37.634 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 38 M 2024-02-28T16:09:37.634 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 209 M 2024-02-28T16:09:37.634 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:09:37.689 INFO:teuthology.orchestra.run.smithi157.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-02-28T16:09:37.853 INFO:teuthology.orchestra.run.smithi157.stdout:(8/12): ceph-mgr-diskprediction-local-17.2.7-53 6.5 MB/s | 7.4 MB 00:01 2024-02-28T16:09:38.037 INFO:teuthology.orchestra.run.smithi157.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.3 MB/s | 250 kB 00:00 2024-02-28T16:09:38.351 INFO:teuthology.orchestra.run.smithi148.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 349 kB/s | 195 kB 00:00 2024-02-28T16:09:38.362 INFO:teuthology.orchestra.run.smithi157.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.9 MB/s | 4.7 MB 00:00 2024-02-28T16:09:38.485 INFO:teuthology.orchestra.run.smithi148.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 246 kB/s | 33 kB 00:00 2024-02-28T16:09:38.512 INFO:teuthology.orchestra.run.smithi157.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-02-28T16:09:38.710 INFO:teuthology.orchestra.run.smithi148.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 874 kB/s | 803 kB 00:00 2024-02-28T16:09:38.910 INFO:teuthology.orchestra.run.smithi148.stdout:(4/12): ceph-mgr-diskprediction-local-17.2.7-53 6.6 MB/s | 7.4 MB 00:01 2024-02-28T16:09:38.935 INFO:teuthology.orchestra.run.smithi148.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 81 kB/s | 18 kB 00:00 2024-02-28T16:09:39.011 INFO:teuthology.orchestra.run.smithi148.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 355 kB/s | 35 kB 00:00 2024-02-28T16:09:39.169 INFO:teuthology.orchestra.run.smithi148.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.4 MB/s | 3.0 MB 00:00 2024-02-28T16:09:39.203 INFO:teuthology.orchestra.run.smithi148.stdout:(8/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-02-28T16:09:39.312 INFO:teuthology.orchestra.run.smithi148.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 250 kB 00:00 2024-02-28T16:09:39.754 INFO:teuthology.orchestra.run.smithi148.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.7 MB/s | 5.1 MB 00:00 2024-02-28T16:09:39.921 INFO:teuthology.orchestra.run.smithi148.stdout:(11/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.8 MB/s | 4.7 MB 00:00 2024-02-28T16:09:40.871 INFO:teuthology.orchestra.run.smithi148.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-02-28T16:09:40.873 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:40.874 INFO:teuthology.orchestra.run.smithi148.stdout:Total 12 MB/s | 38 MB 00:03 2024-02-28T16:09:41.162 INFO:teuthology.orchestra.run.smithi157.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.2 MB/s | 16 MB 00:03 2024-02-28T16:09:41.164 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:41.165 INFO:teuthology.orchestra.run.smithi157.stdout:Total 8.1 MB/s | 38 MB 00:04 2024-02-28T16:09:41.515 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:09:41.593 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:09:41.594 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:09:41.804 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:09:41.881 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:09:41.882 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:09:42.204 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:09:42.205 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:09:42.493 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:09:42.493 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:09:43.149 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:09:43.231 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T16:09:43.306 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:09:43.438 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:09:43.443 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:09:43.488 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T16:09:43.523 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T16:09:43.595 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:09:43.718 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T16:09:43.744 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:09:43.769 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T16:09:43.813 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T16:09:43.874 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T16:09:44.070 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T16:09:44.119 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T16:09:44.230 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T16:09:44.703 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T16:09:44.837 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T16:09:45.103 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T16:09:45.243 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T16:09:46.372 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:09:46.782 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:09:47.527 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T16:09:47.551 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T16:09:47.933 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T16:09:47.992 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 1/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T16:09:50.140 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:09:50.141 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T16:09:50.626 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 12/12 2024-02-28T16:09:50.626 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e 1/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T16:09:50.627 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T16:09:50.628 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T16:09:50.628 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T16:09:50.718 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T16:09:50.719 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:50.719 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:50.719 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T16:09:50.719 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:50.719 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:51.154 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-rook 2024-02-28T16:09:51.202 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T16:09:51.202 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:51.202 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:51.203 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:51.621 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-rook 2024-02-28T16:09:52.037 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:47 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:52.346 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:52.347 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.348 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:52.349 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:52.350 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.351 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.352 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:52.353 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.354 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.418 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 47 k 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T16:09:52.419 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout:Install 13 Packages 2024-02-28T16:09:52.420 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 2.2 M 2024-02-28T16:09:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 26 M 2024-02-28T16:09:52.421 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:09:52.524 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:51 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:52.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:52.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.866 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.867 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:52.868 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.869 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:52.936 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:09:52.937 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:52.937 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:09:52.937 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:52.937 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:09:52.937 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 47 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T16:09:52.938 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:52.939 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:09:52.939 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:09:52.939 INFO:teuthology.orchestra.run.smithi157.stdout:Install 13 Packages 2024-02-28T16:09:52.939 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:52.939 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 2.2 M 2024-02-28T16:09:52.939 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 26 M 2024-02-28T16:09:52.940 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:09:52.993 INFO:teuthology.orchestra.run.smithi148.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 100 kB/s | 19 kB 00:00 2024-02-28T16:09:53.018 INFO:teuthology.orchestra.run.smithi148.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 118 kB/s | 26 kB 00:00 2024-02-28T16:09:53.119 INFO:teuthology.orchestra.run.smithi148.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-02-28T16:09:53.170 INFO:teuthology.orchestra.run.smithi148.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.2 MB/s | 222 kB 00:00 2024-02-28T16:09:53.203 INFO:teuthology.orchestra.run.smithi148.stdout:(5/13): ceph-mgr-rook-17.2.7-535.gc0f02e60.el9. 118 kB/s | 47 kB 00:00 2024-02-28T16:09:53.242 INFO:teuthology.orchestra.run.smithi157.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 285 kB/s | 19 kB 00:00 2024-02-28T16:09:53.262 INFO:teuthology.orchestra.run.smithi148.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 593 kB/s | 54 kB 00:00 2024-02-28T16:09:53.287 INFO:teuthology.orchestra.run.smithi148.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 389 kB/s | 32 kB 00:00 2024-02-28T16:09:53.320 INFO:teuthology.orchestra.run.smithi148.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-02-28T16:09:53.345 INFO:teuthology.orchestra.run.smithi148.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 180 kB/s | 15 kB 00:00 2024-02-28T16:09:53.371 INFO:teuthology.orchestra.run.smithi157.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 131 kB/s | 26 kB 00:00 2024-02-28T16:09:53.379 INFO:teuthology.orchestra.run.smithi148.stdout:(10/13): python3-google-auth-2.28.0-1.el9.noarc 2.2 MB/s | 203 kB 00:00 2024-02-28T16:09:53.421 INFO:teuthology.orchestra.run.smithi148.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-02-28T16:09:53.443 INFO:teuthology.orchestra.run.smithi157.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-02-28T16:09:53.468 INFO:teuthology.orchestra.run.smithi157.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-02-28T16:09:53.468 INFO:teuthology.orchestra.run.smithi148.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 488 kB/s | 59 kB 00:00 2024-02-28T16:09:53.521 INFO:teuthology.orchestra.run.smithi148.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-02-28T16:09:53.524 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:53.524 INFO:teuthology.orchestra.run.smithi148.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-02-28T16:09:53.526 INFO:teuthology.orchestra.run.smithi157.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 935 kB/s | 54 kB 00:00 2024-02-28T16:09:53.569 INFO:teuthology.orchestra.run.smithi157.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 279 kB 00:00 2024-02-28T16:09:53.736 INFO:teuthology.orchestra.run.smithi157.stdout:(7/13): ceph-mgr-rook-17.2.7-535.gc0f02e60.el9. 85 kB/s | 47 kB 00:00 2024-02-28T16:09:53.742 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:09:53.769 INFO:teuthology.orchestra.run.smithi157.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2024-02-28T16:09:53.788 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:09:53.788 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:09:53.803 INFO:teuthology.orchestra.run.smithi157.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 64 kB/s | 15 kB 00:00 2024-02-28T16:09:53.853 INFO:teuthology.orchestra.run.smithi157.stdout:(10/13): python3-google-auth-2.28.0-1.el9.noarc 1.7 MB/s | 203 kB 00:00 2024-02-28T16:09:53.895 INFO:teuthology.orchestra.run.smithi157.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 654 kB/s | 59 kB 00:00 2024-02-28T16:09:53.945 INFO:teuthology.orchestra.run.smithi157.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-02-28T16:09:53.946 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:09:53.947 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:09:53.970 INFO:teuthology.orchestra.run.smithi157.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 788 kB/s | 90 kB 00:00 2024-02-28T16:09:53.976 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:09:53.977 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-02-28T16:09:54.190 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:09:54.236 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:09:54.236 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:09:54.393 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:09:54.394 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:09:54.630 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:09:54.877 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T16:09:54.939 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T16:09:55.021 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T16:09:55.059 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T16:09:55.075 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:09:55.105 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T16:09:55.231 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T16:09:55.302 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T16:09:55.405 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T16:09:55.405 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T16:09:55.437 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T16:09:55.465 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T16:09:55.475 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T16:09:55.522 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T16:09:55.649 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T16:09:55.796 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T16:09:55.856 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T16:09:56.398 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T16:09:56.498 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T16:09:56.533 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T16:09:56.580 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T16:09:56.608 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T16:09:56.788 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T16:09:56.864 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T16:09:56.932 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T16:09:56.990 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T16:09:57.024 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 1/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T16:09:57.507 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T16:09:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T16:09:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T16:09:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T16:09:57.508 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T16:09:57.950 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 13/13 2024-02-28T16:09:57.950 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 1/13 2024-02-28T16:09:57.950 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T16:09:57.950 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T16:09:57.950 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T16:09:57.950 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T16:09:57.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T16:09:57.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T16:09:57.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T16:09:57.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T16:09:57.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T16:09:57.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T16:09:57.951 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T16:09:57.979 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T16:09:57.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T16:09:57.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T16:09:57.980 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T16:09:57.980 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:57.980 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:09:58.317 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T16:09:58.444 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T16:09:58.445 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T16:09:58.445 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T16:09:58.445 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T16:09:58.445 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T16:09:58.445 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:09:58.445 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:09:58.785 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T16:09:59.184 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:54 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.492 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:09:59.493 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:09:59.494 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:09:59.495 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.496 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.497 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.498 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.499 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.500 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.501 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.565 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:09:59.566 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:59.566 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:09:59.566 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:59.566 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:09:59.566 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 121 k 2024-02-28T16:09:59.566 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout:Install 6 Packages 2024-02-28T16:09:59.567 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:09:59.568 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 7.0 M 2024-02-28T16:09:59.568 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 33 M 2024-02-28T16:09:59.568 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:09:59.671 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:58 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:09:59.980 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:09:59.980 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:09:59.980 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:09:59.980 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.980 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:09:59.981 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.982 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.983 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:09:59.984 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.984 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:09:59.984 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.984 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:09:59.984 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.984 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:09:59.984 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.985 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.986 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.987 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:09:59.988 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:09:59.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:09:59.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:00.054 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:00.055 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:00.055 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:10:00.056 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:00.056 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:10:00.056 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:17.2.7-535.gc0f02e60.el9 ceph-noarch 121 k 2024-02-28T16:10:00.056 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:10:00.056 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T16:10:00.056 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-02-28T16:10:00.057 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:00.058 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 7.0 M 2024-02-28T16:10:00.058 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 33 M 2024-02-28T16:10:00.059 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:10:00.081 INFO:teuthology.orchestra.run.smithi148.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 789 kB/s | 248 kB 00:00 2024-02-28T16:10:00.531 INFO:teuthology.orchestra.run.smithi148.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.8 MB/s | 6.0 MB 00:00 2024-02-28T16:10:00.557 INFO:teuthology.orchestra.run.smithi148.stdout:(3/6): ceph-mgr-cephadm-17.2.7-535.gc0f02e60.el 154 kB/s | 121 kB 00:00 2024-02-28T16:10:00.571 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 920 kB/s | 248 kB 00:00 2024-02-28T16:10:00.590 INFO:teuthology.orchestra.run.smithi148.stdout:(4/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-02-28T16:10:00.849 INFO:teuthology.orchestra.run.smithi148.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 183 kB/s | 58 kB 00:00 2024-02-28T16:10:00.874 INFO:teuthology.orchestra.run.smithi148.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 161 kB/s | 51 kB 00:00 2024-02-28T16:10:00.881 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:00.882 INFO:teuthology.orchestra.run.smithi148.stdout:Total 5.3 MB/s | 7.0 MB 00:01 2024-02-28T16:10:01.010 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:10:01.030 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.2 MB/s | 6.0 MB 00:00 2024-02-28T16:10:01.047 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:10:01.047 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:10:01.055 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): ceph-mgr-cephadm-17.2.7-535.gc0f02e60.el 161 kB/s | 121 kB 00:00 2024-02-28T16:10:01.194 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:10:01.194 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:10:01.607 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:10:01.812 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T16:10:01.856 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 427 kB/s | 548 kB 00:01 2024-02-28T16:10:01.879 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T16:10:02.592 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T16:10:02.704 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T16:10:02.780 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T16:10:02.829 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/6 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T16:10:03.755 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T16:10:03.756 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T16:10:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T16:10:04.134 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:04.135 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:04.490 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 15 kB/s | 51 kB 00:03 2024-02-28T16:10:04.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-fuse 2024-02-28T16:10:05.384 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:00 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:05.696 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:05.697 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:05.697 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:05.698 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.698 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:05.698 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.698 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:05.698 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.698 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:05.699 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:05.700 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:05.701 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:05.702 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.703 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.704 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.705 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.706 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:05.707 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.708 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.708 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.708 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:05.767 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:05.768 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-02-28T16:10:05.768 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:05.768 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:10:05.768 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 812 k 2024-02-28T16:10:05.768 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-02-28T16:10:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T16:10:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:05.769 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:10:05.769 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:05.769 INFO:teuthology.orchestra.run.smithi148.stdout:Install 2 Packages 2024-02-28T16:10:05.769 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:05.770 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 892 k 2024-02-28T16:10:05.770 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 2.6 M 2024-02-28T16:10:05.770 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:10:06.026 INFO:teuthology.orchestra.run.smithi148.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 437 kB/s | 80 kB 00:00 2024-02-28T16:10:06.836 INFO:teuthology.orchestra.run.smithi148.stdout:(2/2): ceph-fuse-17.2.7-535.gc0f02e60.el9.x86_6 817 kB/s | 812 kB 00:00 2024-02-28T16:10:06.838 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:06.839 INFO:teuthology.orchestra.run.smithi148.stdout:Total 834 kB/s | 892 kB 00:01 2024-02-28T16:10:06.878 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:10:06.949 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:10:06.950 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:10:07.060 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:10:07.060 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:10:07.373 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:10:07.588 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T16:10:07.684 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T16:10:08.739 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T16:10:08.739 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/2 2024-02-28T16:10:09.060 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T16:10:09.060 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:09.060 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:10:09.060 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T16:10:09.060 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:09.060 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:09.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados-devel 2024-02-28T16:10:10.329 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:05 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:10.638 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:10.638 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:10.638 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:10.638 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.638 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:10.638 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.638 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:10.639 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:10.640 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.641 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.642 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.643 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.644 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.645 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.646 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.647 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:10.647 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.647 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.647 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.647 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:10.712 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 126 k 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-02-28T16:10:10.713 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 126 k 2024-02-28T16:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 448 k 2024-02-28T16:10:10.714 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:10:10.957 INFO:teuthology.orchestra.run.smithi148.stdout:librados-devel-17.2.7-535.gc0f02e60.el9.x86_64. 523 kB/s | 126 kB 00:00 2024-02-28T16:10:10.958 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:10.959 INFO:teuthology.orchestra.run.smithi148.stdout:Total 515 kB/s | 126 kB 00:00 2024-02-28T16:10:10.960 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:10:10.978 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:10:10.978 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:10:11.087 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:10:11.087 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:10:11.307 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:10:11.444 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:12.061 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:12.355 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:10:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:10:12.355 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:12.355 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:12.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs2 2024-02-28T16:10:13.631 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:08 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:13.948 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:13.948 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:13.949 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:13.950 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.951 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:13.952 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.953 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:13.955 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.955 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:13.955 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.955 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:13.955 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.955 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:13.955 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.956 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.957 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.958 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.959 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.960 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.960 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.960 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:13.960 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.960 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.960 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.961 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:13.961 INFO:teuthology.orchestra.run.smithi148.stdout:Package libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:14.023 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:14.025 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:10:14.025 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:14.110 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs-devel 2024-02-28T16:10:14.949 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:09 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:15.268 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.269 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.270 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:15.271 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.272 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.273 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.274 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.275 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.276 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.276 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:15.276 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.276 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.276 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.276 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:15.339 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:15.340 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-02-28T16:10:15.341 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:15.341 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 25 k 2024-02-28T16:10:15.341 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 110 k 2024-02-28T16:10:15.341 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:10:15.618 INFO:teuthology.orchestra.run.smithi148.stdout:libcephfs-devel-17.2.7-535.gc0f02e60.el9.x86_64 90 kB/s | 25 kB 00:00 2024-02-28T16:10:15.620 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:15.620 INFO:teuthology.orchestra.run.smithi148.stdout:Total 89 kB/s | 25 kB 00:00 2024-02-28T16:10:15.621 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:10:15.633 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:10:15.633 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:10:15.639 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:10:15.640 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:10:15.826 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:10:15.977 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:16.410 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:16.727 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:16.727 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:16.727 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:10:16.727 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:10:16.727 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:16.727 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:16.998 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados2 2024-02-28T16:10:17.896 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:12 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:18.202 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.203 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:18.204 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.205 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:18.206 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:18.207 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.208 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.209 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.210 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:18.211 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:18.272 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:18.273 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:10:18.274 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:18.358 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librbd1 2024-02-28T16:10:19.228 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:14 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:19.539 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:19.539 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:19.539 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.540 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.541 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:19.542 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.542 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:19.542 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.542 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:19.542 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.542 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:19.542 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:19.543 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.544 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:19.545 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.545 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:19.545 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.545 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:19.545 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:19.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:19.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.546 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:19.546 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:19.547 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:19.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:19.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.548 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:19.548 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:19.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.549 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:19.549 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.550 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.550 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:19.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.551 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.552 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:19.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.552 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.553 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:19.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.553 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.553 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:19.554 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.554 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.554 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.554 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.554 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:19.554 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.554 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.555 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:19.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.555 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.556 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:19.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.556 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.557 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:19.557 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:19.610 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:10:19.612 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:19.699 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rados 2024-02-28T16:10:20.568 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:15 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:20.883 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:20.883 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:20.883 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:20.883 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.883 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:20.883 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.883 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:20.884 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:20.885 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:20.886 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.887 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.888 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.889 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:20.890 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.891 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:20.892 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.892 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.892 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.892 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:20.892 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:20.958 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:10:20.959 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:21.036 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rgw 2024-02-28T16:10:21.892 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:16 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:22.220 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:22.220 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:22.220 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:22.220 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.220 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:22.220 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:22.221 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:22.222 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:22.223 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.224 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:22.225 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.225 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:22.225 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.227 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:22.227 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.227 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.228 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.229 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.230 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.231 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:22.232 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:22.295 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:22.297 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:10:22.297 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:22.383 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-cephfs 2024-02-28T16:10:23.251 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:18 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.558 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:23.559 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.560 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:23.561 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:23.562 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.563 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.564 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.565 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.566 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.567 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.567 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:23.567 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:23.630 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:23.631 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:10:23.632 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:23.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rbd 2024-02-28T16:10:24.558 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:19 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:24.870 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.871 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.872 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:24.873 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:24.874 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.875 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.876 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.877 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:24.878 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:24.945 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:24.946 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-02-28T16:10:24.946 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:25.032 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-fuse 2024-02-28T16:10:25.857 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:20 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:26.167 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.168 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.169 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.170 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.171 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.172 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.173 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.174 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:26.175 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.176 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:26.237 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 81 k 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 81 k 2024-02-28T16:10:26.238 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 222 k 2024-02-28T16:10:26.239 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:10:26.738 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-fuse-17.2.7-535.gc0f02e60.el9.x86_64.rpm 164 kB/s | 81 kB 00:00 2024-02-28T16:10:26.739 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:26.740 INFO:teuthology.orchestra.run.smithi148.stdout:Total 163 kB/s | 81 kB 00:00 2024-02-28T16:10:26.740 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:10:26.764 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:10:26.764 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:10:26.871 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:10:26.872 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:10:27.076 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:10:27.197 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:27.721 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:28.091 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:28.092 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:28.423 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-mirror 2024-02-28T16:10:29.307 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:24 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:29.628 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.629 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.630 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:29.631 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:29.632 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.633 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.634 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:29.635 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.636 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:29.703 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:29.703 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:29.703 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-02-28T16:10:29.703 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:29.704 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:10:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T16:10:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:29.704 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:10:29.704 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:29.704 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-02-28T16:10:29.704 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:29.705 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 2.9 M 2024-02-28T16:10:29.705 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 12 M 2024-02-28T16:10:29.705 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:10:30.725 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-mirror-17.2.7-535.gc0f02e60.el9.x86_64.rpm 2.9 MB/s | 2.9 MB 00:01 2024-02-28T16:10:30.727 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:30.728 INFO:teuthology.orchestra.run.smithi148.stdout:Total 2.9 MB/s | 2.9 MB 00:01 2024-02-28T16:10:30.728 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:10:30.759 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:10:30.759 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:10:30.878 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:10:30.879 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:10:31.400 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:10:31.510 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:31.583 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:31.583 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:10:31.583 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T16:10:31.583 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:10:31.583 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:10:31.583 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:33.122 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:33.122 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:33.122 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:10:33.122 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:10:33.122 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:33.123 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:33.462 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-nbd 2024-02-28T16:10:34.343 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:29 ago on Wed 28 Feb 2024 04:08:05 PM UTC. 2024-02-28T16:10:34.650 INFO:teuthology.orchestra.run.smithi148.stderr:Modular dependency problems: 2024-02-28T16:10:34.650 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:10:34.650 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 1: conflicting requests 2024-02-28T16:10:34.650 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 2: conflicting requests 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 3: conflicting requests 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 4: conflicting requests 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 5: conflicting requests 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 6: conflicting requests 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 7: conflicting requests 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 8: conflicting requests 2024-02-28T16:10:34.651 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 9: conflicting requests 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 10: conflicting requests 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 11: conflicting requests 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 12: conflicting requests 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 13: conflicting requests 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 14: conflicting requests 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 15: conflicting requests 2024-02-28T16:10:34.652 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 16: conflicting requests 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 17: conflicting requests 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 18: conflicting requests 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 19: conflicting requests 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 20: conflicting requests 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 21: conflicting requests 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 22: conflicting requests 2024-02-28T16:10:34.653 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 23: conflicting requests 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 24: conflicting requests 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 25: conflicting requests 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 26: conflicting requests 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 27: conflicting requests 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 28: conflicting requests 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 29: conflicting requests 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.654 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 30: conflicting requests 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 31: conflicting requests 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 32: conflicting requests 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 33: conflicting requests 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 34: conflicting requests 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 35: conflicting requests 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 36: conflicting requests 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.655 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 38: conflicting requests 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.656 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.657 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.658 INFO:teuthology.orchestra.run.smithi148.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:34.721 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 164 k 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-02-28T16:10:34.722 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:34.723 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 164 k 2024-02-28T16:10:34.723 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 477 k 2024-02-28T16:10:34.723 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-02-28T16:10:35.412 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-nbd-17.2.7-535.gc0f02e60.el9.x86_64.rpm 239 kB/s | 164 kB 00:00 2024-02-28T16:10:35.414 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:35.415 INFO:teuthology.orchestra.run.smithi148.stdout:Total 238 kB/s | 164 kB 00:00 2024-02-28T16:10:35.415 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-02-28T16:10:35.443 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-02-28T16:10:35.443 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-02-28T16:10:35.546 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-02-28T16:10:35.546 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-02-28T16:10:35.741 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-02-28T16:10:35.856 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:36.512 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:36.848 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:36.848 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-02-28T16:10:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:10:36.849 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:10:36.849 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-02-28T16:10:37.134 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.6 kB/s | 58 kB 00:36 2024-02-28T16:10:37.136 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:37.137 INFO:teuthology.orchestra.run.smithi157.stdout:Total 192 kB/s | 7.0 MB 00:37 2024-02-28T16:10:37.170 DEBUG:teuthology.parallel:result is None 2024-02-28T16:10:37.263 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:10:37.302 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:10:37.302 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:10:37.459 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:10:37.459 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:10:37.877 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:10:38.083 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T16:10:38.184 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T16:10:38.898 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T16:10:38.998 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T16:10:39.082 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T16:10:39.114 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T16:10:39.938 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 6/6 2024-02-28T16:10:39.938 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 1/6 2024-02-28T16:10:39.938 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T16:10:39.938 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T16:10:39.938 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T16:10:39.938 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T16:10:40.329 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:17.2.7-535.gc0f02e60.el9.noarch 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:40.330 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:40.665 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-fuse 2024-02-28T16:10:41.547 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:40 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:41.855 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:41.856 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.857 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.858 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.859 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.860 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:41.861 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.862 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.863 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.864 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.865 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:41.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.865 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:41.926 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:41.927 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:41.927 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-02-28T16:10:41.927 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:41.927 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:10:41.927 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 812 k 2024-02-28T16:10:41.927 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-02-28T16:10:41.927 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T16:10:41.928 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:41.928 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:10:41.928 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:41.928 INFO:teuthology.orchestra.run.smithi157.stdout:Install 2 Packages 2024-02-28T16:10:41.928 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:41.928 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 892 k 2024-02-28T16:10:41.928 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 2.6 M 2024-02-28T16:10:41.929 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:10:42.661 INFO:teuthology.orchestra.run.smithi157.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 180 kB/s | 80 kB 00:00 2024-02-28T16:10:43.319 INFO:teuthology.orchestra.run.smithi157.stdout:(2/2): ceph-fuse-17.2.7-535.gc0f02e60.el9.x86_6 735 kB/s | 812 kB 00:01 2024-02-28T16:10:43.321 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:43.322 INFO:teuthology.orchestra.run.smithi157.stdout:Total 640 kB/s | 892 kB 00:01 2024-02-28T16:10:43.361 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:10:43.433 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:10:43.433 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:10:43.546 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:10:43.546 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:10:43.863 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:10:44.056 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T16:10:44.135 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T16:10:45.088 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2/2 2024-02-28T16:10:45.088 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/2 2024-02-28T16:10:45.419 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T16:10:45.419 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:45.419 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:10:45.419 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T16:10:45.419 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:45.419 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:45.761 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados-devel 2024-02-28T16:10:46.675 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:45 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:46.988 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:46.988 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.989 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.990 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.991 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:46.992 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:46.993 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.994 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.995 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.996 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.997 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:46.997 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.997 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.997 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:46.997 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:47.062 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:47.062 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 126 k 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 126 k 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 448 k 2024-02-28T16:10:47.063 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:10:47.417 INFO:teuthology.orchestra.run.smithi157.stdout:librados-devel-17.2.7-535.gc0f02e60.el9.x86_64. 358 kB/s | 126 kB 00:00 2024-02-28T16:10:47.418 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:47.420 INFO:teuthology.orchestra.run.smithi157.stdout:Total 354 kB/s | 126 kB 00:00 2024-02-28T16:10:47.420 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:10:47.438 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:10:47.439 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:10:47.549 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:10:47.549 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:10:47.786 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:10:47.902 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:48.499 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:48.882 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:48.882 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:48.882 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:10:48.882 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:10:48.883 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:48.883 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:49.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs2 2024-02-28T16:10:50.124 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:49 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:50.443 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:50.443 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:50.443 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:50.443 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.443 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:50.443 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.444 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:50.445 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.446 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.447 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.448 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.449 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.450 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.451 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.452 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:50.452 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.452 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.452 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.452 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:50.452 INFO:teuthology.orchestra.run.smithi157.stdout:Package libcephfs2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:50.522 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:50.523 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:10:50.523 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:50.601 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs-devel 2024-02-28T16:10:51.486 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:50 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:51.796 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:51.797 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:51.798 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.799 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:51.800 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:51.801 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.802 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.803 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.804 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.804 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.804 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:51.804 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.804 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.804 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.804 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:51.868 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:51.868 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 25 k 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-28T16:10:51.869 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:51.870 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 25 k 2024-02-28T16:10:51.870 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 110 k 2024-02-28T16:10:51.870 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:10:52.045 INFO:teuthology.orchestra.run.smithi157.stdout:libcephfs-devel-17.2.7-535.gc0f02e60.el9.x86_64 143 kB/s | 25 kB 00:00 2024-02-28T16:10:52.046 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:10:52.047 INFO:teuthology.orchestra.run.smithi157.stdout:Total 141 kB/s | 25 kB 00:00 2024-02-28T16:10:52.047 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:10:52.055 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:10:52.056 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:10:52.060 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:10:52.060 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:10:52.205 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:10:52.351 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:52.813 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:53.122 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:10:53.122 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:53.123 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:10:53.123 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:10:53.123 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:10:53.123 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:53.358 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados2 2024-02-28T16:10:54.227 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:53 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:54.538 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:54.538 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:54.538 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:54.539 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.540 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.541 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.542 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.543 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.544 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.545 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.546 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:54.547 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.548 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:54.549 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:54.609 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:54.610 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:10:54.611 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:54.688 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librbd1 2024-02-28T16:10:55.525 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:54 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:55.844 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.845 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:55.846 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:55.847 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.848 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:55.849 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.850 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.851 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.851 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.851 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.851 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.852 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.853 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:55.854 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.854 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.854 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.854 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:55.854 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:55.916 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:55.917 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:10:55.917 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:55.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rados 2024-02-28T16:10:56.838 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:55 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:57.157 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:57.158 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:57.159 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:57.160 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:57.161 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.162 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.163 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.164 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.165 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.166 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:57.166 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rados-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:57.232 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:57.232 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:10:57.233 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:57.305 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rgw 2024-02-28T16:10:58.139 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:57 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:58.453 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:58.453 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:58.453 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:58.453 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.453 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:58.454 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:58.455 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:58.456 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.457 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:58.458 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.459 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.460 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.460 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.460 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:58.460 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.460 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.460 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.460 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.461 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.462 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:58.462 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.462 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.462 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.462 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:58.462 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rgw-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:58.530 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:58.533 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:10:58.533 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:58.608 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-cephfs 2024-02-28T16:10:59.491 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:58 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:10:59.804 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.805 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:10:59.806 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:10:59.807 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.808 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:10:59.809 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.810 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.811 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:10:59.812 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.813 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.813 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.813 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:10:59.813 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-cephfs-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:10:59.877 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:10:59.878 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:10:59.878 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:10:59.947 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rbd 2024-02-28T16:11:00.809 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:59 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:11:01.122 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:11:01.123 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.124 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.125 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.126 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.127 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:11:01.128 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:11:01.129 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:11:01.130 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rbd-2:17.2.7-535.gc0f02e60.el9.x86_64 is already installed. 2024-02-28T16:11:01.196 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:11:01.198 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-02-28T16:11:01.198 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:11:01.274 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-fuse 2024-02-28T16:11:02.120 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:01 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:11:02.426 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:11:02.426 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:11:02.426 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:11:02.426 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.426 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:11:02.427 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.428 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.429 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:11:02.430 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.431 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.432 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.433 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.434 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:11:02.497 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 81 k 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-28T16:11:02.498 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:02.499 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 81 k 2024-02-28T16:11:02.499 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 222 k 2024-02-28T16:11:02.499 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:11:02.956 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-fuse-17.2.7-535.gc0f02e60.el9.x86_64.rpm 178 kB/s | 81 kB 00:00 2024-02-28T16:11:02.957 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:11:02.958 INFO:teuthology.orchestra.run.smithi157.stdout:Total 177 kB/s | 81 kB 00:00 2024-02-28T16:11:02.959 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:11:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:11:02.983 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:11:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:11:03.089 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:11:03.274 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:11:03.397 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:03.876 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:04.253 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:11:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:11:04.253 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:04.253 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:11:04.529 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-mirror 2024-02-28T16:11:05.431 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:04 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:11:05.748 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:11:05.748 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:11:05.748 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:11:05.748 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:11:05.749 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:11:05.750 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:11:05.751 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:11:05.752 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:11:05.753 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:11:05.754 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.755 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.756 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.757 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:11:05.824 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:11:05.824 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:05.824 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-02-28T16:11:05.824 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:05.825 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:11:05.825 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 2.9 M 2024-02-28T16:11:05.825 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:05.825 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:11:05.825 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:05.825 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-28T16:11:05.825 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:05.826 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 2.9 M 2024-02-28T16:11:05.826 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 12 M 2024-02-28T16:11:05.826 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:11:08.359 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-mirror-17.2.7-535.gc0f02e60.el9.x86_64.rpm 1.2 MB/s | 2.9 MB 00:02 2024-02-28T16:11:08.360 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:11:08.361 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.2 MB/s | 2.9 MB 00:02 2024-02-28T16:11:08.361 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:11:08.392 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:11:08.392 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:11:08.510 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:11:08.510 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:11:09.037 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:11:09.092 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:09.167 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:09.167 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T16:11:09.167 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T16:11:09.167 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:11:09.167 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T16:11:09.167 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:10.729 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:10.729 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:10.729 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:11:10.730 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:11:10.730 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:10.730 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:11:11.034 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-nbd 2024-02-28T16:11:11.885 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:03:10 ago on Wed 28 Feb 2024 04:08:01 PM UTC. 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr:Modular dependency problems: 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 1: conflicting requests 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 2: conflicting requests 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 3: conflicting requests 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 4: conflicting requests 2024-02-28T16:11:12.192 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 5: conflicting requests 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 6: conflicting requests 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 7: conflicting requests 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 8: conflicting requests 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 9: conflicting requests 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 10: conflicting requests 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 11: conflicting requests 2024-02-28T16:11:12.193 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 12: conflicting requests 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 13: conflicting requests 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 14: conflicting requests 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 15: conflicting requests 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 16: conflicting requests 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 17: conflicting requests 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 18: conflicting requests 2024-02-28T16:11:12.194 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 19: conflicting requests 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 20: conflicting requests 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 21: conflicting requests 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 22: conflicting requests 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 23: conflicting requests 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 24: conflicting requests 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 25: conflicting requests 2024-02-28T16:11:12.195 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 26: conflicting requests 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 27: conflicting requests 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 28: conflicting requests 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 29: conflicting requests 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 30: conflicting requests 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 31: conflicting requests 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 32: conflicting requests 2024-02-28T16:11:12.196 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.197 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 33: conflicting requests 2024-02-28T16:11:12.197 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.197 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 34: conflicting requests 2024-02-28T16:11:12.197 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.197 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 35: conflicting requests 2024-02-28T16:11:12.197 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.198 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 36: conflicting requests 2024-02-28T16:11:12.198 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.198 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.198 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.198 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T16:11:12.198 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.198 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 38: conflicting requests 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.199 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.200 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T16:11:12.201 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.202 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.202 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.202 INFO:teuthology.orchestra.run.smithi157.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T16:11:12.262 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:17.2.7-535.gc0f02e60.el9 ceph 164 k 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-02-28T16:11:12.263 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-02-28T16:11:12.264 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-02-28T16:11:12.264 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:12.264 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 164 k 2024-02-28T16:11:12.264 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 477 k 2024-02-28T16:11:12.264 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-02-28T16:11:12.677 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-nbd-17.2.7-535.gc0f02e60.el9.x86_64.rpm 399 kB/s | 164 kB 00:00 2024-02-28T16:11:12.679 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:11:12.680 INFO:teuthology.orchestra.run.smithi157.stdout:Total 396 kB/s | 164 kB 00:00 2024-02-28T16:11:12.680 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-02-28T16:11:12.707 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-02-28T16:11:12.707 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-02-28T16:11:12.811 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-02-28T16:11:12.812 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-02-28T16:11:13.031 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-02-28T16:11:13.149 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:13.657 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:14.106 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 1/1 2024-02-28T16:11:14.106 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:14.107 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-02-28T16:11:14.107 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:17.2.7-535.gc0f02e60.el9.x86_64 2024-02-28T16:11:14.107 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:11:14.107 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-02-28T16:11:14.453 DEBUG:teuthology.parallel:result is None 2024-02-28T16:11:14.453 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T16:11:14.453 INFO:teuthology.packaging:ref: None 2024-02-28T16:11:14.453 INFO:teuthology.packaging:tag: None 2024-02-28T16:11:14.453 INFO:teuthology.packaging:branch: quincy 2024-02-28T16:11:14.453 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:11:14.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T16:11:14.658 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T16:11:14.727 INFO:teuthology.orchestra.run.smithi148.stdout:17.2.7-535.gc0f02e60.el9 2024-02-28T16:11:14.728 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-535.gc0f02e60.el9 2024-02-28T16:11:14.728 INFO:teuthology.task.install:The correct ceph version 17.2.7-535.gc0f02e60 is installed. 2024-02-28T16:11:14.730 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T16:11:14.730 INFO:teuthology.packaging:ref: None 2024-02-28T16:11:14.730 INFO:teuthology.packaging:tag: None 2024-02-28T16:11:14.730 INFO:teuthology.packaging:branch: quincy 2024-02-28T16:11:14.730 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:11:14.730 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-02-28T16:11:14.934 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T16:11:14.999 INFO:teuthology.orchestra.run.smithi157.stdout:17.2.7-535.gc0f02e60.el9 2024-02-28T16:11:14.999 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-535.gc0f02e60.el9 2024-02-28T16:11:14.999 INFO:teuthology.task.install:The correct ceph version 17.2.7-535.gc0f02e60 is installed. 2024-02-28T16:11:15.001 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-28T16:11:15.001 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:11:15.001 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T16:11:15.098 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:11:15.098 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T16:11:15.186 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-28T16:11:15.187 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:11:15.187 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T16:11:15.285 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T16:11:15.383 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:11:15.383 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T16:11:15.484 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T16:11:15.572 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-28T16:11:15.572 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:11:15.572 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T16:11:15.658 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T16:11:15.792 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:11:15.792 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T16:11:15.890 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T16:11:16.029 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-28T16:11:16.030 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:11:16.030 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T16:11:16.105 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T16:11:16.229 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:11:16.229 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T16:11:16.328 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T16:11:16.421 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:11:16.431 INFO:teuthology.task.print:**** done install task... 2024-02-28T16:11:16.431 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-28T16:11:16.555 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T16:11:16.555 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-02-28T16:11:16.556 INFO:tasks.cephadm:Cluster fsid is 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:11:16.556 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-28T16:11:16.556 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-28T16:11:16.556 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi148': '172.21.15.148', 'mon.smithi157': '172.21.15.157'} 2024-02-28T16:11:16.556 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-28T16:11:16.556 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname $(hostname -s) 2024-02-28T16:11:16.645 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2024-02-28T16:11:16.747 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-02-28T16:11:16.748 DEBUG:teuthology.orchestra.run.smithi148:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T16:11:17.100 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 28 16:11 /home/ubuntu/cephtest/cephadm 2024-02-28T16:11:17.101 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T16:11:17.345 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r--. 1 ubuntu ubuntu 367151 Feb 28 16:11 /home/ubuntu/cephtest/cephadm 2024-02-28T16:11:17.345 DEBUG:teuthology.orchestra.run.smithi148:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T16:11:17.404 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T16:11:17.474 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-02-28T16:11:17.474 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-28T16:11:17.483 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-02-28T16:11:18.633 INFO:teuthology.orchestra.run.smithi148.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T16:11:18.700 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T16:12:13.357 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:12:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T16:12:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "image_id": "1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f", 2024-02-28T16:12:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "repo_digests": [ 2024-02-28T16:12:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13" 2024-02-28T16:12:13.358 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-02-28T16:12:13.358 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:12:14.780 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-28T16:12:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T16:12:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f", 2024-02-28T16:12:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2024-02-28T16:12:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13" 2024-02-28T16:12:14.780 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-02-28T16:12:14.780 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-28T16:12:14.817 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph 2024-02-28T16:12:14.921 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2024-02-28T16:12:15.007 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /etc/ceph 2024-02-28T16:12:15.099 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2024-02-28T16:12:15.183 INFO:tasks.cephadm:Writing seed config... 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-28T16:12:15.185 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-28T16:12:15.186 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-28T16:12:15.187 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-28T16:12:15.188 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:12:15.188 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-28T16:12:15.244 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 004ac12e-d654-11ee-95c3-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-28T16:12:15.245 DEBUG:teuthology.orchestra.run.smithi148:mon.smithi148> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service 2024-02-28T16:12:15.291 INFO:tasks.cephadm:Bootstrapping... 2024-02-28T16:12:15.291 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 004ac12e-d654-11ee-95c3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.148 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:12:15.602 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-02-28T16:12:15.603 INFO:teuthology.orchestra.run.smithi148.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '004ac12e-d654-11ee-95c3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.148', '--skip-admin-label'] 2024-02-28T16:12:15.662 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T16:12:15.662 INFO:teuthology.orchestra.run.smithi148.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-28T16:12:15.662 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying podman|docker is present... 2024-02-28T16:12:15.712 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T16:12:15.713 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying lvm2 is present... 2024-02-28T16:12:15.713 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying time synchronization is in place... 2024-02-28T16:12:15.727 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T16:12:15.728 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T16:12:15.741 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T16:12:15.741 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-02-28T16:12:15.755 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout enabled 2024-02-28T16:12:15.769 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout active 2024-02-28T16:12:15.769 INFO:teuthology.orchestra.run.smithi148.stdout:Unit chronyd.service is enabled and running 2024-02-28T16:12:15.769 INFO:teuthology.orchestra.run.smithi148.stdout:Repeating the final host check... 2024-02-28T16:12:15.819 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T16:12:15.819 INFO:teuthology.orchestra.run.smithi148.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-28T16:12:15.820 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl is present 2024-02-28T16:12:15.820 INFO:teuthology.orchestra.run.smithi148.stdout:lvcreate is present 2024-02-28T16:12:15.836 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T16:12:15.836 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T16:12:15.854 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T16:12:15.854 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-02-28T16:12:15.879 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout enabled 2024-02-28T16:12:15.901 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout active 2024-02-28T16:12:15.901 INFO:teuthology.orchestra.run.smithi148.stdout:Unit chronyd.service is enabled and running 2024-02-28T16:12:15.902 INFO:teuthology.orchestra.run.smithi148.stdout:Host looks OK 2024-02-28T16:12:15.902 INFO:teuthology.orchestra.run.smithi148.stdout:Cluster fsid: 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:Acquiring lock 139727747070464 on /run/cephadm/004ac12e-d654-11ee-95c3-87774f69a715.lock 2024-02-28T16:12:15.903 INFO:teuthology.orchestra.run.smithi148.stdout:Lock 139727747070464 acquired on /run/cephadm/004ac12e-d654-11ee-95c3-87774f69a715.lock 2024-02-28T16:12:15.904 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying IP 172.21.15.148 port 3300 ... 2024-02-28T16:12:15.905 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying IP 172.21.15.148 port 6789 ... 2024-02-28T16:12:15.905 INFO:teuthology.orchestra.run.smithi148.stdout:Base mon IP(s) is [172.21.15.148:3300, 172.21.15.148:6789], mon addrv is [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-02-28T16:12:15.920 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.148 metric 100 2024-02-28T16:12:15.920 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.148 metric 100 2024-02-28T16:12:15.933 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-28T16:12:15.934 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-28T16:12:15.934 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1768sec hoplimit 64 pref medium 2024-02-28T16:12:15.946 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-28T16:12:15.946 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-28T16:12:15.946 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T16:12:15.946 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-28T16:12:15.946 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2024-02-28T16:12:15.946 INFO:teuthology.orchestra.run.smithi148.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T16:12:15.948 INFO:teuthology.orchestra.run.smithi148.stdout:Mon IP `172.21.15.148` is in CIDR network `172.21.0.0/20` 2024-02-28T16:12:15.949 INFO:teuthology.orchestra.run.smithi148.stdout:Mon IP `172.21.15.148` is in CIDR network `172.21.0.0/20` 2024-02-28T16:12:15.949 INFO:teuthology.orchestra.run.smithi148.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-28T16:12:15.952 INFO:teuthology.orchestra.run.smithi148.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-28T16:12:15.954 INFO:teuthology.orchestra.run.smithi148.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T16:12:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stdout 1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f 2024-02-28T16:12:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-02-28T16:12:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Getting image source signatures 2024-02-28T16:12:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-02-28T16:12:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying blob sha256:71fe8a47461413e338d0747cd84d29e39028a8869d35ba198bca4ef00bae3782 2024-02-28T16:12:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Copying config sha256:1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f 2024-02-28T16:12:16.616 INFO:teuthology.orchestra.run.smithi148.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-28T16:12:17.852 INFO:teuthology.orchestra.run.smithi148.stdout:ceph: stdout ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable) 2024-02-28T16:12:17.852 INFO:teuthology.orchestra.run.smithi148.stdout:Ceph version: ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable) 2024-02-28T16:12:17.852 INFO:teuthology.orchestra.run.smithi148.stdout:Extracting ceph user uid/gid from container image... 2024-02-28T16:12:19.095 INFO:teuthology.orchestra.run.smithi148.stdout:stat: stdout 167 167 2024-02-28T16:12:19.095 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial keys... 2024-02-28T16:12:20.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQBjW99lnK0bIxAA0cy8jHYp/gYTl0bHNSRzfQ== 2024-02-28T16:12:21.566 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQBkW99lsM5wLhAAFViLiBljL55lz4cGUg3kIg== 2024-02-28T16:12:22.807 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph-authtool: stdout AQBmW99l1dv2BBAAjRiJ3QT5CTLtIeT4BMLoTw== 2024-02-28T16:12:22.810 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial monmap... 2024-02-28T16:12:23.953 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T16:12:23.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-02-28T16:12:23.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:23.954 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T16:12:23.955 INFO:teuthology.orchestra.run.smithi148.stdout:monmaptool for smithi148 [v2:172.21.15.148:3300,v1:172.21.15.148:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T16:12:23.955 INFO:teuthology.orchestra.run.smithi148.stdout:setting min_mon_release = octopus 2024-02-28T16:12:23.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: set fsid to 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:23.955 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T16:12:23.955 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:12:23.955 INFO:teuthology.orchestra.run.smithi148.stdout:Creating mon... 2024-02-28T16:12:25.241 INFO:teuthology.orchestra.run.smithi148.stdout:create mon.smithi148 on 2024-02-28T16:12:25.569 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-28T16:12:25.804 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-28T16:12:26.063 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-004ac12e-d654-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-004ac12e-d654-11ee-95c3-87774f69a715.target. 2024-02-28T16:12:26.063 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-004ac12e-d654-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-004ac12e-d654-11ee-95c3-87774f69a715.target. 2024-02-28T16:12:26.366 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148 2024-02-28T16:12:26.366 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to reset failed state of unit ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service: Unit ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service not loaded. 2024-02-28T16:12:26.670 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-004ac12e-d654-11ee-95c3-87774f69a715.target.wants/ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service → /etc/systemd/system/ceph-004ac12e-d654-11ee-95c3-87774f69a715@.service. 2024-02-28T16:12:27.322 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:27 smithi148 podman[28377]: 2024-02-28 16:12:26.982001318 +0000 UTC m=+0.031141392 image pull 1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f quay.ceph.io/ceph-ci/ceph:quincy 2024-02-28T16:12:27.323 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:27 smithi148 podman[28377]: 2024-02-28 16:12:27.331020262 +0000 UTC m=+0.380160407 container init ad78cd818458dae7c60de599102b9683bf3378123459f4256d101a1da69b77b6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-c0f02e6) 2024-02-28T16:12:27.516 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:12:27.516 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-02-28T16:12:27.541 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:12:27.541 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-02-28T16:12:27.541 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-02-28T16:12:27.541 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T16:12:27.542 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mon to start... 2024-02-28T16:12:27.542 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mon... 2024-02-28T16:12:27.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:27 smithi148 podman[28377]: 2024-02-28 16:12:27.340935616 +0000 UTC m=+0.390075722 container start ad78cd818458dae7c60de599102b9683bf3378123459f4256d101a1da69b77b6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:12:27.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:27 smithi148 ceph-mon[28396]: mkfs 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:27.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:27 smithi148 ceph-mon[28396]: mon.smithi148 is new leader, mons smithi148 in quorum (ranks 0) 2024-02-28T16:12:27.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:27 smithi148 bash[28377]: ad78cd818458dae7c60de599102b9683bf3378123459f4256d101a1da69b77b6 2024-02-28T16:12:27.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:27 smithi148 systemd[1]: Started Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:12:28.584 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:28 smithi148 ceph-mon[28396]: mon.smithi148 is new leader, mons smithi148 in quorum (ranks 0) 2024-02-28T16:12:28.584 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:28 smithi148 ceph-mon[28396]: monmap e1: 1 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:12:28.584 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:28 smithi148 ceph-mon[28396]: fsmap 2024-02-28T16:12:28.584 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:28 smithi148 ceph-mon[28396]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T16:12:28.584 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:28 smithi148 ceph-mon[28396]: mgrmap e1: no daemons active 2024-02-28T16:12:28.584 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:28 smithi148 ceph-mon[28396]: from='client.? 172.21.15.148:0/782687097' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-28T16:12:28.895 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout cluster: 2024-02-28T16:12:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout id: 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-28T16:12:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:28.896 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout services: 2024-02-28T16:12:28.897 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi148 (age 0.842594s) 2024-02-28T16:12:28.897 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-28T16:12:28.898 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-28T16:12:28.898 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:28.898 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout data: 2024-02-28T16:12:28.898 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-28T16:12:28.898 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-28T16:12:28.899 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-28T16:12:28.899 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout pgs: 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.162+0000 7f4200600700 1 Processor -- start 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.162+0000 7f4200600700 1 -- start start 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.163+0000 7f4200600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.163+0000 7f4200600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81058a0 con 0x7f41f80714a0 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.163+0000 7f41fdc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.164+0000 7f41fdc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59560/0 (socket says 172.21.15.148:59560) 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.164+0000 7f41fdc00700 1 -- 172.21.15.148:0/4153202731 learned_addr learned my addr 172.21.15.148:0/4153202731 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.164+0000 7f41fdc00700 1 -- 172.21.15.148:0/4153202731 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f81059e0 con 0x7f41f80714a0 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.165+0000 7f41fdc00700 1 --2- 172.21.15.148:0/4153202731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8105360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098e0 tx=0x7f41ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d64e3305f6d4663 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:28.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.165+0000 7f41f7e00700 1 -- 172.21.15.148:0/4153202731 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41ec00b860 con 0x7f41f80714a0 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.165+0000 7f41f7e00700 1 -- 172.21.15.148:0/4153202731 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec00b9c0 con 0x7f41f80714a0 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.165+0000 7f41f7e00700 1 -- 172.21.15.148:0/4153202731 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41ec00bc90 con 0x7f41f80714a0 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.166+0000 7f4200600700 1 -- 172.21.15.148:0/4153202731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 msgr2=0x7f41f8105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.166+0000 7f4200600700 1 --2- 172.21.15.148:0/4153202731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8105360 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0098e0 tx=0x7f41ec009250 comp rx=0 tx=0).stop 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.166+0000 7f4200600700 1 -- 172.21.15.148:0/4153202731 shutdown_connections 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.166+0000 7f4200600700 1 --2- 172.21.15.148:0/4153202731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8105360 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.166+0000 7f4200600700 1 -- 172.21.15.148:0/4153202731 >> 172.21.15.148:0/4153202731 conn(0x7f41f80fcdd0 msgr2=0x7f41f80ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.166+0000 7f4200600700 1 -- 172.21.15.148:0/4153202731 shutdown_connections 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.166+0000 7f4200600700 1 -- 172.21.15.148:0/4153202731 wait complete. 2024-02-28T16:12:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.167+0000 7f4200600700 1 Processor -- start 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.167+0000 7f4200600700 1 -- start start 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.168+0000 7f4200600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8110d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.168+0000 7f4200600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f81112c0 con 0x7f41f80714a0 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.168+0000 7f41fdc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8110d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.168+0000 7f41fdc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8110d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59576/0 (socket says 172.21.15.148:59576) 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.168+0000 7f41fdc00700 1 -- 172.21.15.148:0/782687097 learned_addr learned my addr 172.21.15.148:0/782687097 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.168+0000 7f41fdc00700 1 -- 172.21.15.148:0/782687097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec0094f0 con 0x7f41f80714a0 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.169+0000 7f41fdc00700 1 --2- 172.21.15.148:0/782687097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8110d80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41ec003080 tx=0x7f41ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.169+0000 7f41f5600700 1 -- 172.21.15.148:0/782687097 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41ec01c5c0 con 0x7f41f80714a0 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.169+0000 7f41f5600700 1 -- 172.21.15.148:0/782687097 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec01c720 con 0x7f41f80714a0 2024-02-28T16:12:28.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.169+0000 7f41f5600700 1 -- 172.21.15.148:0/782687097 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41ec01ca30 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.169+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f81114c0 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.169+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f81120b0 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.169+0000 7f41f5600700 1 -- 172.21.15.148:0/782687097 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f41ec01a450 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.170+0000 7f41f5600700 1 -- 172.21.15.148:0/782687097 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f41ec02e790 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.170+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f805f5c0 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.174+0000 7f41f5600700 1 -- 172.21.15.148:0/782687097 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f41ec01a890 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.252+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f41f804bf20 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.252+0000 7f41f5600700 1 -- 172.21.15.148:0/782687097 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f41ec01aa30 con 0x7f41f80714a0 2024-02-28T16:12:28.906 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.253+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 msgr2=0x7f41f8110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:28.907 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.253+0000 7f4200600700 1 --2- 172.21.15.148:0/782687097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8110d80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f41ec003080 tx=0x7f41ec016000 comp rx=0 tx=0).stop 2024-02-28T16:12:28.907 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.254+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 shutdown_connections 2024-02-28T16:12:28.907 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.254+0000 7f4200600700 1 --2- 172.21.15.148:0/782687097 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41f80714a0 0x7f41f8110d80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:28.907 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.254+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 >> 172.21.15.148:0/782687097 conn(0x7f41f80fcdd0 msgr2=0x7f41f80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:28.907 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.254+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 shutdown_connections 2024-02-28T16:12:28.908 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:28.254+0000 7f4200600700 1 -- 172.21.15.148:0/782687097 wait complete. 2024-02-28T16:12:28.908 INFO:teuthology.orchestra.run.smithi148.stdout:mon is available 2024-02-28T16:12:28.908 INFO:teuthology.orchestra.run.smithi148.stdout:Assimilating anything we can from ceph.conf... 2024-02-28T16:12:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:29 smithi148 ceph-mon[28396]: from='client.? 172.21.15.148:0/1281899418' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T16:12:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:29 smithi148 ceph-mon[28396]: from='client.? 172.21.15.148:0/1281899418' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout fsid = 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.148:3300,v1:172.21.15.148:6789] 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T16:12:30.292 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.538+0000 7f59d6c00700 1 Processor -- start 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.538+0000 7f59d6c00700 1 -- start start 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.539+0000 7f59d6c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:30.293 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.539+0000 7f59d6c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d01030d0 con 0x7f59d0102780 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.539+0000 7f59cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.539+0000 7f59cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59584/0 (socket says 172.21.15.148:59584) 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.539+0000 7f59cfe00700 1 -- 172.21.15.148:0/3583274963 learned_addr learned my addr 172.21.15.148:0/3583274963 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.540+0000 7f59cfe00700 1 -- 172.21.15.148:0/3583274963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d0103210 con 0x7f59d0102780 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.540+0000 7f59cfe00700 1 --2- 172.21.15.148:0/3583274963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0102b90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f59c00098e0 tx=0x7f59c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110601277e53df08 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.540+0000 7f59cf400700 1 -- 172.21.15.148:0/3583274963 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59c000b860 con 0x7f59d0102780 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.541+0000 7f59cf400700 1 -- 172.21.15.148:0/3583274963 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000b9c0 con 0x7f59d0102780 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.541+0000 7f59cf400700 1 -- 172.21.15.148:0/3583274963 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59c000bc90 con 0x7f59d0102780 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.541+0000 7f59d6c00700 1 -- 172.21.15.148:0/3583274963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 msgr2=0x7f59d0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.541+0000 7f59d6c00700 1 --2- 172.21.15.148:0/3583274963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0102b90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f59c00098e0 tx=0x7f59c0009250 comp rx=0 tx=0).stop 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.542+0000 7f59d6c00700 1 -- 172.21.15.148:0/3583274963 shutdown_connections 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.542+0000 7f59d6c00700 1 --2- 172.21.15.148:0/3583274963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0102b90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.542+0000 7f59d6c00700 1 -- 172.21.15.148:0/3583274963 >> 172.21.15.148:0/3583274963 conn(0x7f59d00fdf00 msgr2=0x7f59d0100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:30.294 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.542+0000 7f59d6c00700 1 -- 172.21.15.148:0/3583274963 shutdown_connections 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.542+0000 7f59d6c00700 1 -- 172.21.15.148:0/3583274963 wait complete. 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.543+0000 7f59d6c00700 1 Processor -- start 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.543+0000 7f59d6c00700 1 -- start start 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.543+0000 7f59d6c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.543+0000 7f59d6c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d0113490 con 0x7f59d0102780 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.543+0000 7f59cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.543+0000 7f59cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59598/0 (socket says 172.21.15.148:59598) 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.543+0000 7f59cfe00700 1 -- 172.21.15.148:0/1281899418 learned_addr learned my addr 172.21.15.148:0/1281899418 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.544+0000 7f59cfe00700 1 -- 172.21.15.148:0/1281899418 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c00094f0 con 0x7f59d0102780 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.544+0000 7f59cfe00700 1 --2- 172.21.15.148:0/1281899418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0112f50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f59c0003080 tx=0x7f59c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.544+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59c001c5c0 con 0x7f59d0102780 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.544+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c001c720 con 0x7f59d0102780 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.544+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59c001ca30 con 0x7f59d0102780 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.544+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d0113690 con 0x7f59d0102780 2024-02-28T16:12:30.295 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.544+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d0114330 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.545+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f59c001a450 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.545+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f59c002e790 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.546+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d005f5c0 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.548+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f59c001a890 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.622+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f59d0103c80 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.630+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f59c002ede0 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.631+0000 7f59ccc00700 1 -- 172.21.15.148:0/1281899418 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f59d0103c80 con 0x7f59d0102780 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.632+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 msgr2=0x7f59d0112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.632+0000 7f59d6c00700 1 --2- 172.21.15.148:0/1281899418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0112f50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f59c0003080 tx=0x7f59c0016000 comp rx=0 tx=0).stop 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.632+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 shutdown_connections 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.632+0000 7f59d6c00700 1 --2- 172.21.15.148:0/1281899418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59d0102780 0x7f59d0112f50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.632+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 >> 172.21.15.148:0/1281899418 conn(0x7f59d00fdf00 msgr2=0x7f59d0077900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.632+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 shutdown_connections 2024-02-28T16:12:30.296 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:29.633+0000 7f59d6c00700 1 -- 172.21.15.148:0/1281899418 wait complete. 2024-02-28T16:12:30.297 INFO:teuthology.orchestra.run.smithi148.stdout:Generating new minimal ceph.conf... 2024-02-28T16:12:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:31 smithi148 ceph-mon[28396]: from='client.? 172.21.15.148:0/3882556813' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:12:31.721 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.927+0000 7fe1e3000700 1 Processor -- start 2024-02-28T16:12:31.721 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.928+0000 7fe1e3000700 1 -- start start 2024-02-28T16:12:31.721 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.928+0000 7fe1e3000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:31.721 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.928+0000 7fe1e3000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc1030c0 con 0x7fe1dc102770 2024-02-28T16:12:31.721 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.928+0000 7fe1dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.929+0000 7fe1dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59610/0 (socket says 172.21.15.148:59610) 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.929+0000 7fe1dbe00700 1 -- 172.21.15.148:0/3424417309 learned_addr learned my addr 172.21.15.148:0/3424417309 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.929+0000 7fe1dbe00700 1 -- 172.21.15.148:0/3424417309 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc103200 con 0x7fe1dc102770 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.929+0000 7fe1dbe00700 1 --2- 172.21.15.148:0/3424417309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0098e0 tx=0x7fe1cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caeaa7ce3bb64c2d server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.930+0000 7fe1db400700 1 -- 172.21.15.148:0/3424417309 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1cc00b860 con 0x7fe1dc102770 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.930+0000 7fe1db400700 1 -- 172.21.15.148:0/3424417309 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe1cc00be50 con 0x7fe1dc102770 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.930+0000 7fe1db400700 1 -- 172.21.15.148:0/3424417309 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1cc010380 con 0x7fe1dc102770 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.930+0000 7fe1e3000700 1 -- 172.21.15.148:0/3424417309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 msgr2=0x7fe1dc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.930+0000 7fe1e3000700 1 --2- 172.21.15.148:0/3424417309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc102b80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0098e0 tx=0x7fe1cc009250 comp rx=0 tx=0).stop 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.930+0000 7fe1e3000700 1 -- 172.21.15.148:0/3424417309 shutdown_connections 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.931+0000 7fe1e3000700 1 --2- 172.21.15.148:0/3424417309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc102b80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.931+0000 7fe1e3000700 1 -- 172.21.15.148:0/3424417309 >> 172.21.15.148:0/3424417309 conn(0x7fe1dc0fded0 msgr2=0x7fe1dc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.931+0000 7fe1e3000700 1 -- 172.21.15.148:0/3424417309 shutdown_connections 2024-02-28T16:12:31.722 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.931+0000 7fe1e3000700 1 -- 172.21.15.148:0/3424417309 wait complete. 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.931+0000 7fe1e3000700 1 Processor -- start 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.932+0000 7fe1e3000700 1 -- start start 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.932+0000 7fe1e3000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.932+0000 7fe1e3000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1dc076080 con 0x7fe1dc102770 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.932+0000 7fe1dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.932+0000 7fe1dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc077c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59614/0 (socket says 172.21.15.148:59614) 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.932+0000 7fe1dbe00700 1 -- 172.21.15.148:0/3882556813 learned_addr learned my addr 172.21.15.148:0/3882556813 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.933+0000 7fe1dbe00700 1 -- 172.21.15.148:0/3882556813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0094f0 con 0x7fe1dc102770 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.933+0000 7fe1dbe00700 1 --2- 172.21.15.148:0/3882556813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc077c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00b440 tx=0x7fe1cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.933+0000 7fe1d8c00700 1 -- 172.21.15.148:0/3882556813 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1cc0107c0 con 0x7fe1dc102770 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.933+0000 7fe1d8c00700 1 -- 172.21.15.148:0/3882556813 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe1cc010db0 con 0x7fe1dc102770 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.933+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1dc076280 con 0x7fe1dc102770 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.933+0000 7fe1d8c00700 1 -- 172.21.15.148:0/3882556813 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe1cc01ada0 con 0x7fe1dc102770 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.933+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1dc076710 con 0x7fe1dc102770 2024-02-28T16:12:31.723 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.934+0000 7fe1d8c00700 1 -- 172.21.15.148:0/3882556813 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe1cc02e6c0 con 0x7fe1dc102770 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.934+0000 7fe1d8c00700 1 -- 172.21.15.148:0/3882556813 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe1cc024600 con 0x7fe1dc102770 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.935+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1dc10b670 con 0x7fe1dc102770 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:30.937+0000 7fe1d8c00700 1 -- 172.21.15.148:0/3882556813 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe1cc02eb50 con 0x7fe1dc102770 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.012+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe1dc1045e0 con 0x7fe1dc102770 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.013+0000 7fe1d8c00700 1 -- 172.21.15.148:0/3882556813 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fe1cc02ecf0 con 0x7fe1dc102770 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.014+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 msgr2=0x7fe1dc077c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.014+0000 7fe1e3000700 1 --2- 172.21.15.148:0/3882556813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc077c00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00b440 tx=0x7fe1cc009250 comp rx=0 tx=0).stop 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.014+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 shutdown_connections 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.014+0000 7fe1e3000700 1 --2- 172.21.15.148:0/3882556813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1dc102770 0x7fe1dc077c00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.014+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 >> 172.21.15.148:0/3882556813 conn(0x7fe1dc0fded0 msgr2=0x7fe1dc0fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.015+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 shutdown_connections 2024-02-28T16:12:31.724 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:31.015+0000 7fe1e3000700 1 -- 172.21.15.148:0/3882556813 wait complete. 2024-02-28T16:12:31.725 INFO:teuthology.orchestra.run.smithi148.stdout:Restarting the monitor... 2024-02-28T16:12:32.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:31 smithi148 systemd[1]: Stopping Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:12:32.537 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:32 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[28392]: 2024-02-28T16:12:32.268+0000 7f7ff7a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi148 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:12:32.537 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:32 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[28392]: 2024-02-28T16:12:32.268+0000 7f7ff7a00700 -1 mon.smithi148@0(leader) e1 *** Got Signal Terminated *** 2024-02-28T16:12:32.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:32 smithi148 podman[28638]: 2024-02-28 16:12:32.546593657 +0000 UTC m=+0.458327782 container died ad78cd818458dae7c60de599102b9683bf3378123459f4256d101a1da69b77b6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:12:33.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:32 smithi148 podman[28638]: 2024-02-28 16:12:32.986632769 +0000 UTC m=+0.898366917 container cleanup ad78cd818458dae7c60de599102b9683bf3378123459f4256d101a1da69b77b6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:12:33.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:32 smithi148 bash[28638]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148 2024-02-28T16:12:33.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:33 smithi148 podman[28652]: 2024-02-28 16:12:33.295937563 +0000 UTC m=+0.739039024 container remove ad78cd818458dae7c60de599102b9683bf3378123459f4256d101a1da69b77b6 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=quincy-c0f02e6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-28T16:12:34.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:33 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service: Deactivated successfully. 2024-02-28T16:12:34.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:33 smithi148 systemd[1]: Stopped Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:12:34.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:33 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service: Consumed 1.884s CPU time. 2024-02-28T16:12:34.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:33 smithi148 systemd[1]: Starting Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:12:34.476 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 podman[28748]: 2024-02-28 16:12:34.124499143 +0000 UTC m=+0.036400847 image pull 1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f quay.ceph.io/ceph-ci/ceph:quincy 2024-02-28T16:12:34.476 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 podman[28748]: 2024-02-28 16:12:34.221621458 +0000 UTC m=+0.133523213 container create 76d7b5412223a193798e902466f7f3cb8aa04c2172df832f9adfbdcb7ce81a0f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=quincy-c0f02e6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:12:34.603 INFO:teuthology.orchestra.run.smithi148.stdout:Setting mon public_network to 172.21.0.0/20 2024-02-28T16:12:34.753 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 podman[28748]: 2024-02-28 16:12:34.484425185 +0000 UTC m=+0.396326973 container init 76d7b5412223a193798e902466f7f3cb8aa04c2172df832f9adfbdcb7ce81a0f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 podman[28748]: 2024-02-28 16:12:34.493914576 +0000 UTC m=+0.405816327 container start 76d7b5412223a193798e902466f7f3cb8aa04c2172df832f9adfbdcb7ce81a0f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, RELEASE=quincy-c0f02e6, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable), process ceph-mon, pid 2 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: pidfile_write: ignore empty --pid-file 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: load: jerasure load: lrc 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: RocksDB version: 6.15.5 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Compile date Feb 26 2024 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: DB SUMMARY 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: DB Session ID: BYN1OWJUS4Q456NGNHVX 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:12:34.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi148/store.db dir, Total Num: 1, files: 000008.sst 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi148/store.db: 000010.log size: 97310 ; 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.env: 0x557d053bda80 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.fs: Posix File System 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.info_log: 0x557d06139cc0 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.statistics: (nil) 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.use_fsync: 0 2024-02-28T16:12:34.755 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.db_log_dir: 2024-02-28T16:12:34.756 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi148/store.db 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.write_buffer_manager: 0x557d06eaeae0 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:12:34.757 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.unordered_write: 0 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.row_cache: None 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.wal_filter: None 2024-02-28T16:12:34.758 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:12:34.759 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:12:34.759 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.preserve_deletes: 0 2024-02-28T16:12:34.759 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:12:34.759 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:12:34.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_open_files: -1 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:12:34.761 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Compression algorithms supported: 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kZSTD supported: 0 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:12:34.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi148/store.db/MANIFEST-000009 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.merge_operator: 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_filter: None 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557d0618ef58) 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:12:34.763 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_type: 0 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_block_index_type: 0 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_shortening: 1 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: hash_index_allow_collision: 1 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: checksum: 1 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: no_block_cache: 0 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache: 0x557d061c1090 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_options: 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: capacity : 536870912 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: num_shard_bits : 4 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: strict_capacity_limit : 0 2024-02-28T16:12:34.764 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_compressed: (nil) 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: persistent_cache: (nil) 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_size: 4096 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_size_deviation: 10 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_restart_interval: 16 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_block_restart_interval: 1 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: metadata_block_size: 4096 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: partition_filters: 0 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: use_delta_encoding: 1 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: whole_key_filtering: 1 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: verify_compression: 0 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: format_version: 4 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: enable_index_compression: 1 2024-02-28T16:12:34.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_align: 0 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression: NoCompression 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.num_levels: 7 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:12:34.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:12:34.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.arena_block_size: 4194304 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:12:34.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:12:34.772 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.ttl: 2592000 2024-02-28T16:12:34.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi148/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136754547872, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136754549407, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 92582, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 90677, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83392, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1709136754, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "c13fb17a-8d90-4d38-b66b-ee3ec888474a", "db_session_id": "BYN1OWJUS4Q456NGNHVX"}} 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-02-28T16:12:34.774 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136754550088, "job": 1, "event": "recovery_finished"} 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi148/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x557d06155180 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: DB pointer 0x557d0622a000 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** DB Stats ** 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:12:34.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: L0 2/0 92.21 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Sum 2/0 92.21 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T16:12:34.776 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative compaction: 0.00 GB write, 12.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval compaction: 0.00 GB write, 12.33 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: L0 2/0 92.21 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Sum 2/0 92.21 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-28T16:12:34.777 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 86.1 0.00 0.00 1 0.001 0 0 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative compaction: 0.00 GB write, 12.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:12:34.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: starting mon.smithi148 rank 0 at public addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] at bind addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi148 fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???) e1 preinit fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???).mds e1 new map 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???).mds e1 print_map 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: e1 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: legacy client fscid: -1 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: No filesystems configured 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:12:34.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-28T16:12:34.780 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 bash[28748]: 76d7b5412223a193798e902466f7f3cb8aa04c2172df832f9adfbdcb7ce81a0f 2024-02-28T16:12:34.780 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 systemd[1]: Started Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:12:34.780 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mon.smithi148 is new leader, mons smithi148 in quorum (ranks 0) 2024-02-28T16:12:34.780 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: monmap e1: 1 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:12:34.780 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: fsmap 2024-02-28T16:12:34.780 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T16:12:34.780 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:34 smithi148 ceph-mon[28767]: mgrmap e1: no daemons active 2024-02-28T16:12:36.080 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.284+0000 7f7818600700 1 Processor -- start 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.285+0000 7f7818600700 1 -- start start 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.285+0000 7f7818600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.285+0000 7f7818600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810079130 con 0x7f7810078d20 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.286+0000 7f7815c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.286+0000 7f7815c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52750/0 (socket says 172.21.15.148:52750) 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.286+0000 7f7815c00700 1 -- 172.21.15.148:0/3709765012 learned_addr learned my addr 172.21.15.148:0/3709765012 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.286+0000 7f7815c00700 1 -- 172.21.15.148:0/3709765012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810077770 con 0x7f7810078d20 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.286+0000 7f7815c00700 1 --2- 172.21.15.148:0/3709765012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f78040098e0 tx=0x7f7804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbfacee42e77141 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.287+0000 7f780fe00700 1 -- 172.21.15.148:0/3709765012 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f780400b860 con 0x7f7810078d20 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.287+0000 7f780fe00700 1 -- 172.21.15.148:0/3709765012 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f780400be50 con 0x7f7810078d20 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.287+0000 7f780fe00700 1 -- 172.21.15.148:0/3709765012 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7804010380 con 0x7f7810078d20 2024-02-28T16:12:36.085 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.288+0000 7f7818600700 1 -- 172.21.15.148:0/3709765012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 msgr2=0x7f7810077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.288+0000 7f7818600700 1 --2- 172.21.15.148:0/3709765012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810077230 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f78040098e0 tx=0x7f7804009250 comp rx=0 tx=0).stop 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.288+0000 7f7818600700 1 -- 172.21.15.148:0/3709765012 shutdown_connections 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.288+0000 7f7818600700 1 --2- 172.21.15.148:0/3709765012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810077230 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.288+0000 7f7818600700 1 -- 172.21.15.148:0/3709765012 >> 172.21.15.148:0/3709765012 conn(0x7f78100fdf00 msgr2=0x7f7810100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.288+0000 7f7818600700 1 -- 172.21.15.148:0/3709765012 shutdown_connections 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.288+0000 7f7818600700 1 -- 172.21.15.148:0/3709765012 wait complete. 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.289+0000 7f7818600700 1 Processor -- start 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.289+0000 7f7818600700 1 -- start start 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.290+0000 7f7818600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.290+0000 7f7818600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7810113d40 con 0x7f7810078d20 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.290+0000 7f7815c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.290+0000 7f7815c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52764/0 (socket says 172.21.15.148:52764) 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.290+0000 7f7815c00700 1 -- 172.21.15.148:0/151260496 learned_addr learned my addr 172.21.15.148:0/151260496 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:36.086 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.291+0000 7f7815c00700 1 -- 172.21.15.148:0/151260496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040094f0 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.291+0000 7f7815c00700 1 --2- 172.21.15.148:0/151260496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810113800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7804006fd0 tx=0x7f7804009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.291+0000 7f780d600700 1 -- 172.21.15.148:0/151260496 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f78040107c0 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.291+0000 7f780d600700 1 -- 172.21.15.148:0/151260496 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7804010db0 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.291+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7810113f40 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.291+0000 7f780d600700 1 -- 172.21.15.148:0/151260496 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f780401ada0 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.291+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7810114be0 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.292+0000 7f780d600700 1 -- 172.21.15.148:0/151260496 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7804019690 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.292+0000 7f780d600700 1 -- 172.21.15.148:0/151260496 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f78040248c0 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.293+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781005f5c0 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.296+0000 7f780d600700 1 -- 172.21.15.148:0/151260496 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7804029060 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.371+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f7810108a60 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.376+0000 7f780d600700 1 -- 172.21.15.148:0/151260496 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7804020070 con 0x7f7810078d20 2024-02-28T16:12:36.087 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.378+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 msgr2=0x7f7810113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:36.088 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.378+0000 7f7818600700 1 --2- 172.21.15.148:0/151260496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810113800 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7804006fd0 tx=0x7f7804009250 comp rx=0 tx=0).stop 2024-02-28T16:12:36.088 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.378+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 shutdown_connections 2024-02-28T16:12:36.088 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.378+0000 7f7818600700 1 --2- 172.21.15.148:0/151260496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7810078d20 0x7f7810113800 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:36.088 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.378+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 >> 172.21.15.148:0/151260496 conn(0x7f78100fdf00 msgr2=0x7f78100ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:36.088 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.378+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 shutdown_connections 2024-02-28T16:12:36.088 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:35.378+0000 7f7818600700 1 -- 172.21.15.148:0/151260496 wait complete. 2024-02-28T16:12:36.089 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-28T16:12:36.089 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:12:36.089 INFO:teuthology.orchestra.run.smithi148.stdout:Creating mgr... 2024-02-28T16:12:36.089 INFO:teuthology.orchestra.run.smithi148.stdout:Verifying port 9283 ... 2024-02-28T16:12:36.405 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-004ac12e-d654-11ee-95c3-87774f69a715@mgr.smithi148.gelspy 2024-02-28T16:12:36.405 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Failed to reset failed state of unit ceph-004ac12e-d654-11ee-95c3-87774f69a715@mgr.smithi148.gelspy.service: Unit ceph-004ac12e-d654-11ee-95c3-87774f69a715@mgr.smithi148.gelspy.service not loaded. 2024-02-28T16:12:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:36 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/151260496' entity='client.admin' 2024-02-28T16:12:36.669 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-004ac12e-d654-11ee-95c3-87774f69a715.target.wants/ceph-004ac12e-d654-11ee-95c3-87774f69a715@mgr.smithi148.gelspy.service → /etc/systemd/system/ceph-004ac12e-d654-11ee-95c3-87774f69a715@.service. 2024-02-28T16:12:44.824 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:12:44.824 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-02-28T16:12:44.842 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:12:44.843 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-02-28T16:12:44.843 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-02-28T16:12:44.843 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T16:12:44.866 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:12:44.866 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-02-28T16:12:44.886 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:12:44.887 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-02-28T16:12:44.887 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-02-28T16:12:44.887 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-02-28T16:12:44.887 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr to start... 2024-02-28T16:12:44.887 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr... 2024-02-28T16:12:45.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:45 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/4220549686' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:12:46.375 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:46.378 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "004ac12e-d654-11ee-95c3-87774f69a715", 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "smithi148" 2024-02-28T16:12:46.379 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:12:46.380 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:12:46.390 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:12:46.391 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:12:27.415078+0000", 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.558+0000 7fb020200700 1 Processor -- start 2024-02-28T16:12:46.392 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.559+0000 7fb020200700 1 -- start start 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.559+0000 7fb020200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb018105420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.559+0000 7fb020200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018105960 con 0x7fb0180713e0 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.560+0000 7fb01d800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb018105420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.560+0000 7fb01d800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb018105420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41650/0 (socket says 172.21.15.148:41650) 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.560+0000 7fb01d800700 1 -- 172.21.15.148:0/2396616836 learned_addr learned my addr 172.21.15.148:0/2396616836 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.560+0000 7fb01d800700 1 -- 172.21.15.148:0/2396616836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb018105aa0 con 0x7fb0180713e0 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.560+0000 7fb01d800700 1 --2- 172.21.15.148:0/2396616836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb018105420 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0098e0 tx=0x7fb00c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624b3011635644fb server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.561+0000 7fb017e00700 1 -- 172.21.15.148:0/2396616836 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb00c00b860 con 0x7fb0180713e0 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.561+0000 7fb017e00700 1 -- 172.21.15.148:0/2396616836 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb00c00be50 con 0x7fb0180713e0 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.561+0000 7fb017e00700 1 -- 172.21.15.148:0/2396616836 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb00c010380 con 0x7fb0180713e0 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.562+0000 7fb020200700 1 -- 172.21.15.148:0/2396616836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 msgr2=0x7fb018105420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.562+0000 7fb020200700 1 --2- 172.21.15.148:0/2396616836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb018105420 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0098e0 tx=0x7fb00c009250 comp rx=0 tx=0).stop 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.562+0000 7fb020200700 1 -- 172.21.15.148:0/2396616836 shutdown_connections 2024-02-28T16:12:46.393 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.562+0000 7fb020200700 1 --2- 172.21.15.148:0/2396616836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb018105420 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.562+0000 7fb020200700 1 -- 172.21.15.148:0/2396616836 >> 172.21.15.148:0/2396616836 conn(0x7fb0180fcdd0 msgr2=0x7fb0180ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.562+0000 7fb020200700 1 -- 172.21.15.148:0/2396616836 shutdown_connections 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.562+0000 7fb020200700 1 -- 172.21.15.148:0/2396616836 wait complete. 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.563+0000 7fb020200700 1 Processor -- start 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.563+0000 7fb020200700 1 -- start start 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.563+0000 7fb020200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb0181137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.563+0000 7fb020200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb018113ce0 con 0x7fb0180713e0 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.564+0000 7fb01d800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb0181137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.564+0000 7fb01d800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb0181137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41662/0 (socket says 172.21.15.148:41662) 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.564+0000 7fb01d800700 1 -- 172.21.15.148:0/4220549686 learned_addr learned my addr 172.21.15.148:0/4220549686 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.564+0000 7fb01d800700 1 -- 172.21.15.148:0/4220549686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0094f0 con 0x7fb0180713e0 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.564+0000 7fb01d800700 1 --2- 172.21.15.148:0/4220549686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb0181137a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb00c006b00 tx=0x7fb00c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.565+0000 7fb015600700 1 -- 172.21.15.148:0/4220549686 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb00c0107c0 con 0x7fb0180713e0 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.565+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb018113ee0 con 0x7fb0180713e0 2024-02-28T16:12:46.394 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.565+0000 7fb015600700 1 -- 172.21.15.148:0/4220549686 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb00c010db0 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.565+0000 7fb015600700 1 -- 172.21.15.148:0/4220549686 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb00c01acf0 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.565+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb018114b80 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.565+0000 7fb015600700 1 -- 172.21.15.148:0/4220549686 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb00c024440 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.565+0000 7fb015600700 1 -- 172.21.15.148:0/4220549686 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb00c019710 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.566+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01805f5c0 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.569+0000 7fb015600700 1 -- 172.21.15.148:0/4220549686 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb00c0426d0 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.648+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb018106820 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.649+0000 7fb015600700 1 -- 172.21.15.148:0/4220549686 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7fb00c031030 con 0x7fb0180713e0 2024-02-28T16:12:46.395 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.650+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 msgr2=0x7fb0181137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:46.396 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.650+0000 7fb020200700 1 --2- 172.21.15.148:0/4220549686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb0181137a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb00c006b00 tx=0x7fb00c009250 comp rx=0 tx=0).stop 2024-02-28T16:12:46.396 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.650+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 shutdown_connections 2024-02-28T16:12:46.396 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.650+0000 7fb020200700 1 --2- 172.21.15.148:0/4220549686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0180713e0 0x7fb0181137a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:46.396 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.650+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 >> 172.21.15.148:0/4220549686 conn(0x7fb0180fcdd0 msgr2=0x7fb0180fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:46.396 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.650+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 shutdown_connections 2024-02-28T16:12:46.396 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:45.650+0000 7fb020200700 1 -- 172.21.15.148:0/4220549686 wait complete. 2024-02-28T16:12:46.397 INFO:teuthology.orchestra.run.smithi148.stdout:mgr not available, waiting (1/15)... 2024-02-28T16:12:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:49 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2894998241' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:12:50.245 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "004ac12e-d654-11ee-95c3-87774f69a715", 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "smithi148" 2024-02-28T16:12:50.246 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:12:50.247 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:12:50.255 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:12:50.255 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:12:50.255 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:12:50.255 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:50.255 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:12:50.255 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:12:50.255 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:50.256 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:12:50.257 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:12:27.415078+0000", 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.993+0000 7f1ed4800700 1 Processor -- start 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.993+0000 7f1ed4800700 1 -- start start 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.994+0000 7f1ed4800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.994+0000 7f1ed4800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1030c0 con 0x7f1ecc102770 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.994+0000 7f1ed1e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.994+0000 7f1ed1e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41670/0 (socket says 172.21.15.148:41670) 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.994+0000 7f1ed1e00700 1 -- 172.21.15.148:0/1676351748 learned_addr learned my addr 172.21.15.148:0/1676351748 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.994+0000 7f1ed1e00700 1 -- 172.21.15.148:0/1676351748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc103200 con 0x7f1ecc102770 2024-02-28T16:12:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.995+0000 7f1ed1e00700 1 --2- 172.21.15.148:0/1676351748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc102b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00098e0 tx=0x7f1ec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab41b3161fa8dda server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.995+0000 7f1ed0a00700 1 -- 172.21.15.148:0/1676351748 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec000b860 con 0x7f1ecc102770 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.995+0000 7f1ed0a00700 1 -- 172.21.15.148:0/1676351748 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1ec000be50 con 0x7f1ecc102770 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.995+0000 7f1ed0a00700 1 -- 172.21.15.148:0/1676351748 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec0010380 con 0x7f1ecc102770 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.996+0000 7f1ed4800700 1 -- 172.21.15.148:0/1676351748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 msgr2=0x7f1ecc102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.996+0000 7f1ed4800700 1 --2- 172.21.15.148:0/1676351748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc102b80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ec00098e0 tx=0x7f1ec0009250 comp rx=0 tx=0).stop 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.996+0000 7f1ed4800700 1 -- 172.21.15.148:0/1676351748 shutdown_connections 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.996+0000 7f1ed4800700 1 --2- 172.21.15.148:0/1676351748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc102b80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.996+0000 7f1ed4800700 1 -- 172.21.15.148:0/1676351748 >> 172.21.15.148:0/1676351748 conn(0x7f1ecc0fded0 msgr2=0x7f1ecc100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.996+0000 7f1ed4800700 1 -- 172.21.15.148:0/1676351748 shutdown_connections 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.996+0000 7f1ed4800700 1 -- 172.21.15.148:0/1676351748 wait complete. 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.997+0000 7f1ed4800700 1 Processor -- start 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.997+0000 7f1ed4800700 1 -- start start 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.998+0000 7f1ed4800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.998+0000 7f1ed4800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc113f40 con 0x7f1ecc102770 2024-02-28T16:12:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.998+0000 7f1ed1e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.998+0000 7f1ed1e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc113a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41674/0 (socket says 172.21.15.148:41674) 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.998+0000 7f1ed1e00700 1 -- 172.21.15.148:0/2894998241 learned_addr learned my addr 172.21.15.148:0/2894998241 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.998+0000 7f1ed1e00700 1 -- 172.21.15.148:0/2894998241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00094f0 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.999+0000 7f1ed1e00700 1 --2- 172.21.15.148:0/2894998241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc113a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b440 tx=0x7f1ec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.999+0000 7f1ec6000700 1 -- 172.21.15.148:0/2894998241 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec00107c0 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.999+0000 7f1ec6000700 1 -- 172.21.15.148:0/2894998241 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f1ec0010db0 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.999+0000 7f1ec6000700 1 -- 172.21.15.148:0/2894998241 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec001ada0 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.999+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc114140 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.999+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc114de0 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:48.999+0000 7f1ec6000700 1 -- 172.21.15.148:0/2894998241 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1ec002e6c0 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.000+0000 7f1ec6000700 1 -- 172.21.15.148:0/2894998241 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1ec0024950 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.000+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc05f5c0 con 0x7f1ecc102770 2024-02-28T16:12:50.260 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.003+0000 7f1ec6000700 1 -- 172.21.15.148:0/2894998241 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1ec0010920 con 0x7f1ecc102770 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.081+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1ecc04bed0 con 0x7f1ecc102770 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.081+0000 7f1ec6000700 1 -- 172.21.15.148:0/2894998241 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f1ec0010ac0 con 0x7f1ecc102770 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.083+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 msgr2=0x7f1ecc113a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.083+0000 7f1ed4800700 1 --2- 172.21.15.148:0/2894998241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc113a00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b440 tx=0x7f1ec0009250 comp rx=0 tx=0).stop 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.083+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 shutdown_connections 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.083+0000 7f1ed4800700 1 --2- 172.21.15.148:0/2894998241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ecc102770 0x7f1ecc113a00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.083+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 >> 172.21.15.148:0/2894998241 conn(0x7f1ecc0fded0 msgr2=0x7f1ecc0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.083+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 shutdown_connections 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:49.083+0000 7f1ed4800700 1 -- 172.21.15.148:0/2894998241 wait complete. 2024-02-28T16:12:50.261 INFO:teuthology.orchestra.run.smithi148.stdout:mgr not available, waiting (2/15)... 2024-02-28T16:12:53.345 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:52 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3214715375' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:12:53.665 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:53.665 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "004ac12e-d654-11ee-95c3-87774f69a715", 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "smithi148" 2024-02-28T16:12:53.666 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:53.668 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2024-02-28T16:12:53.668 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:12:53.668 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:53.668 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T16:12:53.669 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:12:53.669 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:53.669 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:12:53.669 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:53.669 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:12:53.669 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:12:53.669 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:12:53.678 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:12:53.678 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:12:53.679 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:12:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:12:27.415078+0000", 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.856+0000 7ff32e800700 1 Processor -- start 2024-02-28T16:12:53.681 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.856+0000 7ff32e800700 1 -- start start 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.856+0000 7ff32e800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff3280760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.856+0000 7ff32e800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff328077fe0 con 0x7ff328077bd0 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.857+0000 7ff327400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff3280760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.857+0000 7ff327400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff3280760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53622/0 (socket says 172.21.15.148:53622) 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.857+0000 7ff327400700 1 -- 172.21.15.148:0/562158992 learned_addr learned my addr 172.21.15.148:0/562158992 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.857+0000 7ff327400700 1 -- 172.21.15.148:0/562158992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328076620 con 0x7ff328077bd0 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.857+0000 7ff327400700 1 --2- 172.21.15.148:0/562158992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff3280760e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3180098e0 tx=0x7ff318009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7347c4a88c62d0b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff326000700 1 -- 172.21.15.148:0/562158992 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff31800b860 con 0x7ff328077bd0 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff326000700 1 -- 172.21.15.148:0/562158992 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff31800be50 con 0x7ff328077bd0 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff326000700 1 -- 172.21.15.148:0/562158992 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff318010380 con 0x7ff328077bd0 2024-02-28T16:12:53.682 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff32e800700 1 -- 172.21.15.148:0/562158992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 msgr2=0x7ff3280760e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff32e800700 1 --2- 172.21.15.148:0/562158992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff3280760e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3180098e0 tx=0x7ff318009250 comp rx=0 tx=0).stop 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff32e800700 1 -- 172.21.15.148:0/562158992 shutdown_connections 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff32e800700 1 --2- 172.21.15.148:0/562158992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff3280760e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.858+0000 7ff32e800700 1 -- 172.21.15.148:0/562158992 >> 172.21.15.148:0/562158992 conn(0x7ff3280fded0 msgr2=0x7ff328100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.859+0000 7ff32e800700 1 -- 172.21.15.148:0/562158992 shutdown_connections 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.859+0000 7ff32e800700 1 -- 172.21.15.148:0/562158992 wait complete. 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.859+0000 7ff32e800700 1 Processor -- start 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.859+0000 7ff32e800700 1 -- start start 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.860+0000 7ff32e800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff328113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.860+0000 7ff32e800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff328113fb0 con 0x7ff328077bd0 2024-02-28T16:12:53.683 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.860+0000 7ff327400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff328113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.860+0000 7ff327400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff328113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53636/0 (socket says 172.21.15.148:53636) 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.860+0000 7ff327400700 1 -- 172.21.15.148:0/3214715375 learned_addr learned my addr 172.21.15.148:0/3214715375 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.860+0000 7ff327400700 1 -- 172.21.15.148:0/3214715375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180094f0 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff327400700 1 --2- 172.21.15.148:0/3214715375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff328113a70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff318006fd0 tx=0x7ff318009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff31f400700 1 -- 172.21.15.148:0/3214715375 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3180107c0 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff31f400700 1 -- 172.21.15.148:0/3214715375 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff318010db0 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3281141b0 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff31f400700 1 -- 172.21.15.148:0/3214715375 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff31801add0 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff328114e50 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff31f400700 1 -- 172.21.15.148:0/3214715375 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff3180226d0 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.861+0000 7ff31f400700 1 -- 172.21.15.148:0/3214715375 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff31801e070 con 0x7ff328077bd0 2024-02-28T16:12:53.684 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.862+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32805f5c0 con 0x7ff328077bd0 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.865+0000 7ff31f400700 1 -- 172.21.15.148:0/3214715375 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff31801a5c0 con 0x7ff328077bd0 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.942+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff328064ad0 con 0x7ff328077bd0 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.943+0000 7ff31f400700 1 -- 172.21.15.148:0/3214715375 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7ff318010920 con 0x7ff328077bd0 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.944+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 msgr2=0x7ff328113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.944+0000 7ff32e800700 1 --2- 172.21.15.148:0/3214715375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff328113a70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff318006fd0 tx=0x7ff318009250 comp rx=0 tx=0).stop 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.944+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 shutdown_connections 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.944+0000 7ff32e800700 1 --2- 172.21.15.148:0/3214715375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff328077bd0 0x7ff328113a70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.944+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 >> 172.21.15.148:0/3214715375 conn(0x7ff3280fded0 msgr2=0x7ff3281001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.944+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 shutdown_connections 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:52.944+0000 7ff32e800700 1 -- 172.21.15.148:0/3214715375 wait complete. 2024-02-28T16:12:53.685 INFO:teuthology.orchestra.run.smithi148.stdout:mgr not available, waiting (3/15)... 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: Activating manager daemon smithi148.gelspy 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: mgrmap e2: smithi148.gelspy(active, starting, since 0.00906962s) 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:12:54.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' 2024-02-28T16:12:54.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:12:54.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' 2024-02-28T16:12:54.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:53 smithi148 ceph-mon[28767]: from='mgr.14100 172.21.15.148:0/688062098' entity='mgr.smithi148.gelspy' 2024-02-28T16:12:55.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:55 smithi148 ceph-mon[28767]: mgrmap e3: smithi148.gelspy(active, since 1.01873s) 2024-02-28T16:12:56.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:56 smithi148 ceph-mon[28767]: mgrmap e4: smithi148.gelspy(active, since 2s) 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsid": "004ac12e-d654-11ee-95c3-87774f69a715", 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T16:12:57.335 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 0 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "smithi148" 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "quorum_age": 22, 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:57.336 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T16:12:57.337 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T16:12:57.338 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ], 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T16:12:27.415078+0000", 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout }, 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.302+0000 7fb78b400700 1 Processor -- start 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.302+0000 7fb78b400700 1 -- start start 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.303+0000 7fb78b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784107780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.303+0000 7fb78b400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784103170 con 0x7fb784071480 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.303+0000 7fb788a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:57.339 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.303+0000 7fb788a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784107780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53732/0 (socket says 172.21.15.148:53732) 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.303+0000 7fb788a00700 1 -- 172.21.15.148:0/3445753641 learned_addr learned my addr 172.21.15.148:0/3445753641 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.303+0000 7fb788a00700 1 -- 172.21.15.148:0/3445753641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784107cc0 con 0x7fb784071480 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.304+0000 7fb788a00700 1 --2- 172.21.15.148:0/3445753641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784107780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb7780098e0 tx=0x7fb778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef4e4c8a3de130b server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.304+0000 7fb783400700 1 -- 172.21.15.148:0/3445753641 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb77800b860 con 0x7fb784071480 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.304+0000 7fb783400700 1 -- 172.21.15.148:0/3445753641 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb77800be50 con 0x7fb784071480 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.304+0000 7fb783400700 1 -- 172.21.15.148:0/3445753641 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb778010380 con 0x7fb784071480 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.305+0000 7fb78b400700 1 -- 172.21.15.148:0/3445753641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 msgr2=0x7fb784107780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.305+0000 7fb78b400700 1 --2- 172.21.15.148:0/3445753641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784107780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb7780098e0 tx=0x7fb778009250 comp rx=0 tx=0).stop 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.305+0000 7fb78b400700 1 -- 172.21.15.148:0/3445753641 shutdown_connections 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.305+0000 7fb78b400700 1 --2- 172.21.15.148:0/3445753641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784107780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.305+0000 7fb78b400700 1 -- 172.21.15.148:0/3445753641 >> 172.21.15.148:0/3445753641 conn(0x7fb7840fcdd0 msgr2=0x7fb7840ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.305+0000 7fb78b400700 1 -- 172.21.15.148:0/3445753641 shutdown_connections 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.305+0000 7fb78b400700 1 -- 172.21.15.148:0/3445753641 wait complete. 2024-02-28T16:12:57.340 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.306+0000 7fb78b400700 1 Processor -- start 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.306+0000 7fb78b400700 1 -- start start 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.306+0000 7fb78b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.306+0000 7fb78b400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784113cb0 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.306+0000 7fb788a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.306+0000 7fb788a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53740/0 (socket says 172.21.15.148:53740) 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.306+0000 7fb788a00700 1 -- 172.21.15.148:0/145322970 learned_addr learned my addr 172.21.15.148:0/145322970 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.307+0000 7fb788a00700 1 -- 172.21.15.148:0/145322970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780094f0 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.307+0000 7fb788a00700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784113770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb778006b00 tx=0x7fb778009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.307+0000 7fb780c00700 1 -- 172.21.15.148:0/145322970 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7780107c0 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.307+0000 7fb780c00700 1 -- 172.21.15.148:0/145322970 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb778010db0 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.307+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb784113eb0 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.307+0000 7fb780c00700 1 -- 172.21.15.148:0/145322970 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb77801acf0 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.307+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb784114b50 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.308+0000 7fb780c00700 1 -- 172.21.15.148:0/145322970 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fb778010920 con 0x7fb784071480 2024-02-28T16:12:57.341 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.308+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78405f5c0 con 0x7fb784071480 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.309+0000 7fb780c00700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fb76c036790 0x7fb76c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.309+0000 7fb780c00700 1 -- 172.21.15.148:0/145322970 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb77804a560 con 0x7fb784071480 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.309+0000 7fb783e00700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fb76c036790 0x7fb76c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.310+0000 7fb783e00700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fb76c036790 0x7fb76c038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb770009990 tx=0x7fb770006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.315+0000 7fb780c00700 1 -- 172.21.15.148:0/145322970 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb778010bd0 con 0x7fb784071480 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.604+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb78404bed0 con 0x7fb784071480 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.605+0000 7fb780c00700 1 -- 172.21.15.148:0/145322970 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7fb7780233a0 con 0x7fb784071480 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fb76c036790 msgr2=0x7fb76c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fb76c036790 0x7fb76c038c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb770009990 tx=0x7fb770006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 msgr2=0x7fb784113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784113770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb778006b00 tx=0x7fb778009250 comp rx=0 tx=0).stop 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 shutdown_connections 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fb76c036790 0x7fb76c038c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:57.342 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 --2- 172.21.15.148:0/145322970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb784071480 0x7fb784113770 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:57.343 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 >> 172.21.15.148:0/145322970 conn(0x7fb7840fcdd0 msgr2=0x7fb7840fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:57.343 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.608+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 shutdown_connections 2024-02-28T16:12:57.343 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:56.609+0000 7fb78b400700 1 -- 172.21.15.148:0/145322970 wait complete. 2024-02-28T16:12:57.343 INFO:teuthology.orchestra.run.smithi148.stdout:mgr is available 2024-02-28T16:12:57.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:57 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/145322970' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T16:12:58.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:12:58 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3479952199' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T16:12:58.845 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:58.845 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T16:12:58.845 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout fsid = 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:12:58.845 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T16:12:58.845 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.945+0000 7fba72a00700 1 Processor -- start 2024-02-28T16:12:58.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.945+0000 7fba72a00700 1 -- start start 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.945+0000 7fba72a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c07cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.945+0000 7fba72a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c07d0f0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.946+0000 7fba6be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c07cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.946+0000 7fba6be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c07cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53750/0 (socket says 172.21.15.148:53750) 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.946+0000 7fba6be00700 1 -- 172.21.15.148:0/1446722352 learned_addr learned my addr 172.21.15.148:0/1446722352 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.946+0000 7fba6be00700 1 -- 172.21.15.148:0/1446722352 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c07d230 con 0x7fba6c07c7a0 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.947+0000 7fba6be00700 1 --2- 172.21.15.148:0/1446722352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c07cbb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0098e0 tx=0x7fba5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119a51b68e6c55f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.947+0000 7fba6aa00700 1 -- 172.21.15.148:0/1446722352 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c00b860 con 0x7fba6c07c7a0 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.947+0000 7fba6aa00700 1 -- 172.21.15.148:0/1446722352 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fba5c00be50 con 0x7fba6c07c7a0 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.947+0000 7fba6aa00700 1 -- 172.21.15.148:0/1446722352 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c010380 con 0x7fba6c07c7a0 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.948+0000 7fba72a00700 1 -- 172.21.15.148:0/1446722352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 msgr2=0x7fba6c07cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.948+0000 7fba72a00700 1 --2- 172.21.15.148:0/1446722352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c07cbb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0098e0 tx=0x7fba5c009250 comp rx=0 tx=0).stop 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.948+0000 7fba72a00700 1 -- 172.21.15.148:0/1446722352 shutdown_connections 2024-02-28T16:12:58.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.948+0000 7fba72a00700 1 --2- 172.21.15.148:0/1446722352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c07cbb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.948+0000 7fba72a00700 1 -- 172.21.15.148:0/1446722352 >> 172.21.15.148:0/1446722352 conn(0x7fba6c078030 msgr2=0x7fba6c07a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.948+0000 7fba72a00700 1 -- 172.21.15.148:0/1446722352 shutdown_connections 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.948+0000 7fba72a00700 1 -- 172.21.15.148:0/1446722352 wait complete. 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.949+0000 7fba72a00700 1 Processor -- start 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.949+0000 7fba72a00700 1 -- start start 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.949+0000 7fba72a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c117bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.949+0000 7fba72a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6c1180f0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.949+0000 7fba6be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c117bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.949+0000 7fba6be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c117bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53756/0 (socket says 172.21.15.148:53756) 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.949+0000 7fba6be00700 1 -- 172.21.15.148:0/3479952199 learned_addr learned my addr 172.21.15.148:0/3479952199 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.950+0000 7fba6be00700 1 -- 172.21.15.148:0/3479952199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0094f0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.950+0000 7fba6be00700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c117bb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fba5c003050 tx=0x7fba5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.950+0000 7fba63e00700 1 -- 172.21.15.148:0/3479952199 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c010760 con 0x7fba6c07c7a0 2024-02-28T16:12:58.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.950+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6c1182f0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.950+0000 7fba63e00700 1 -- 172.21.15.148:0/3479952199 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fba5c010d50 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.950+0000 7fba63e00700 1 -- 172.21.15.148:0/3479952199 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c01ae20 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.950+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6c118f90 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.952+0000 7fba63e00700 1 -- 172.21.15.148:0/3479952199 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7fba5c0108c0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.952+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c05f5c0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.952+0000 7fba63e00700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fba50036790 0x7fba50038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.952+0000 7fba63e00700 1 -- 172.21.15.148:0/3479952199 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fba5c04a480 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.953+0000 7fba6b400700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fba50036790 0x7fba50038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.953+0000 7fba6b400700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fba50036790 0x7fba50038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba58009990 tx=0x7fba58006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:57.957+0000 7fba63e00700 1 -- 172.21.15.148:0/3479952199 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fba5c01a6a0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.161+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fba6c04bed0 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.164+0000 7fba63e00700 1 -- 172.21.15.148:0/3479952199 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fba5c018350 con 0x7fba6c07c7a0 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.166+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fba50036790 msgr2=0x7fba50038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.166+0000 7fba72a00700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fba50036790 0x7fba50038c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba58009990 tx=0x7fba58006e40 comp rx=0 tx=0).stop 2024-02-28T16:12:58.849 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.166+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 msgr2=0x7fba6c117bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.166+0000 7fba72a00700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c117bb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fba5c003050 tx=0x7fba5c009250 comp rx=0 tx=0).stop 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.167+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 shutdown_connections 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.167+0000 7fba72a00700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7fba50036790 0x7fba50038c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.167+0000 7fba72a00700 1 --2- 172.21.15.148:0/3479952199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba6c07c7a0 0x7fba6c117bb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.167+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 >> 172.21.15.148:0/3479952199 conn(0x7fba6c078030 msgr2=0x7fba6c07a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.167+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 shutdown_connections 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:58.167+0000 7fba72a00700 1 -- 172.21.15.148:0/3479952199 wait complete. 2024-02-28T16:12:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:Enabling cephadm module... 2024-02-28T16:13:00.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:00 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/256240502' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-28T16:13:01.316 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.445+0000 7f40f5000700 1 Processor -- start 2024-02-28T16:13:01.316 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.446+0000 7f40f5000700 1 -- start start 2024-02-28T16:13:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.446+0000 7f40f5000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0104d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.446+0000 7f40f5000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01052d0 con 0x7f40f0104980 2024-02-28T16:13:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.446+0000 7f40ede00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.447+0000 7f40ede00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0104d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53766/0 (socket says 172.21.15.148:53766) 2024-02-28T16:13:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.447+0000 7f40ede00700 1 -- 172.21.15.148:0/428391388 learned_addr learned my addr 172.21.15.148:0/428391388 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:01.317 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.447+0000 7f40ede00700 1 -- 172.21.15.148:0/428391388 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0105410 con 0x7f40f0104980 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.447+0000 7f40ede00700 1 --2- 172.21.15.148:0/428391388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0104d90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098e0 tx=0x7f40e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0cc02af8084a13 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.448+0000 7f40eca00700 1 -- 172.21.15.148:0/428391388 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e000b860 con 0x7f40f0104980 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.448+0000 7f40eca00700 1 -- 172.21.15.148:0/428391388 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f40e000be50 con 0x7f40f0104980 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.448+0000 7f40eca00700 1 -- 172.21.15.148:0/428391388 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e0010380 con 0x7f40f0104980 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.449+0000 7f40f5000700 1 -- 172.21.15.148:0/428391388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 msgr2=0x7f40f0104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.449+0000 7f40f5000700 1 --2- 172.21.15.148:0/428391388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0104d90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098e0 tx=0x7f40e0009250 comp rx=0 tx=0).stop 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.449+0000 7f40f5000700 1 -- 172.21.15.148:0/428391388 shutdown_connections 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.449+0000 7f40f5000700 1 --2- 172.21.15.148:0/428391388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0104d90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.449+0000 7f40f5000700 1 -- 172.21.15.148:0/428391388 >> 172.21.15.148:0/428391388 conn(0x7f40f0078030 msgr2=0x7f40f0078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.449+0000 7f40f5000700 1 -- 172.21.15.148:0/428391388 shutdown_connections 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.449+0000 7f40f5000700 1 -- 172.21.15.148:0/428391388 wait complete. 2024-02-28T16:13:01.322 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.450+0000 7f40f5000700 1 Processor -- start 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.450+0000 7f40f5000700 1 -- start start 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.451+0000 7f40f5000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.451+0000 7f40f5000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0113cb0 con 0x7f40f0104980 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.451+0000 7f40ede00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.451+0000 7f40ede00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53776/0 (socket says 172.21.15.148:53776) 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.451+0000 7f40ede00700 1 -- 172.21.15.148:0/256240502 learned_addr learned my addr 172.21.15.148:0/256240502 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.451+0000 7f40ede00700 1 -- 172.21.15.148:0/256240502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094f0 con 0x7f40f0104980 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.452+0000 7f40ede00700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0113770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000c00 tx=0x7f40e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.452+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e00107c0 con 0x7f40f0104980 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.452+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f40e0010db0 con 0x7f40f0104980 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.452+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e001ad00 con 0x7f40f0104980 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.452+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f0113eb0 con 0x7f40f0104980 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.452+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f0114b50 con 0x7f40f0104980 2024-02-28T16:13:01.323 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.453+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 4) v1 ==== 43357+0+0 (secure 0 0 0) 0x7f40e001a530 con 0x7f40f0104980 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.453+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f005f5c0 con 0x7f40f0104980 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.454+0000 7f40e6000700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f40d4036740 0x7f40d4038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.454+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f40e004a600 con 0x7f40f0104980 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.454+0000 7f40ed400700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f40d4036740 0x7f40d4038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.455+0000 7f40ed400700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f40d4036740 0x7f40d4038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009990 tx=0x7f40dc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.459+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f40e0010920 con 0x7f40f0104980 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:12:59.721+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f40f004bed0 con 0x7f40f0104980 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.580+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f40e0017db0 con 0x7f40f0104980 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.583+0000 7f40e6000700 1 -- 172.21.15.148:0/256240502 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f40e002be40 con 0x7f40f0104980 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.586+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f40d4036740 msgr2=0x7f40d4038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f40d4036740 0x7f40d4038bf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009990 tx=0x7f40dc006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 msgr2=0x7f40f0113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0113770 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40e0000c00 tx=0x7f40e0009250 comp rx=0 tx=0).stop 2024-02-28T16:13:01.324 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 shutdown_connections 2024-02-28T16:13:01.325 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f40d4036740 0x7f40d4038bf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:01.325 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 --2- 172.21.15.148:0/256240502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40f0104980 0x7f40f0113770 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:01.325 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 >> 172.21.15.148:0/256240502 conn(0x7f40f0078030 msgr2=0x7f40f01030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:01.325 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 shutdown_connections 2024-02-28T16:13:01.325 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:00.587+0000 7f40f5000700 1 -- 172.21.15.148:0/256240502 wait complete. 2024-02-28T16:13:01.831 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:01 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/256240502' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-28T16:13:01.831 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:01 smithi148 ceph-mon[28767]: mgrmap e5: smithi148.gelspy(active, since 7s) 2024-02-28T16:13:02.731 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:02 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1421820572' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T16:13:02.900 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "active_name": "smithi148.gelspy", 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.869+0000 7f52dcc00700 1 Processor -- start 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.870+0000 7f52dcc00700 1 -- start start 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.870+0000 7f52dcc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d80760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.870+0000 7f52dcc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8077fc0 con 0x7f52d8077bb0 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.871+0000 7f52d5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d80760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.871+0000 7f52d5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d80760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53796/0 (socket says 172.21.15.148:53796) 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.871+0000 7f52d5e00700 1 -- 172.21.15.148:0/3320012887 learned_addr learned my addr 172.21.15.148:0/3320012887 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:02.901 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.871+0000 7f52d5e00700 1 -- 172.21.15.148:0/3320012887 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8076600 con 0x7f52d8077bb0 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.871+0000 7f52d5e00700 1 --2- 172.21.15.148:0/3320012887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d80760c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52c80098e0 tx=0x7f52c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0d22f3cab1c397 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.872+0000 7f52d4a00700 1 -- 172.21.15.148:0/3320012887 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c800b860 con 0x7f52d8077bb0 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.872+0000 7f52d4a00700 1 -- 172.21.15.148:0/3320012887 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f52c800be50 con 0x7f52d8077bb0 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.872+0000 7f52d4a00700 1 -- 172.21.15.148:0/3320012887 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c8010380 con 0x7f52d8077bb0 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.873+0000 7f52dcc00700 1 -- 172.21.15.148:0/3320012887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 msgr2=0x7f52d80760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.873+0000 7f52dcc00700 1 --2- 172.21.15.148:0/3320012887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d80760c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f52c80098e0 tx=0x7f52c8009250 comp rx=0 tx=0).stop 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.873+0000 7f52dcc00700 1 -- 172.21.15.148:0/3320012887 shutdown_connections 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.873+0000 7f52dcc00700 1 --2- 172.21.15.148:0/3320012887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d80760c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:02.902 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.873+0000 7f52dcc00700 1 -- 172.21.15.148:0/3320012887 >> 172.21.15.148:0/3320012887 conn(0x7f52d80fded0 msgr2=0x7f52d8100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.873+0000 7f52dcc00700 1 -- 172.21.15.148:0/3320012887 shutdown_connections 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.873+0000 7f52dcc00700 1 -- 172.21.15.148:0/3320012887 wait complete. 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.874+0000 7f52dcc00700 1 Processor -- start 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.874+0000 7f52dcc00700 1 -- start start 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.874+0000 7f52dcc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.874+0000 7f52dcc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8113fc0 con 0x7f52d8077bb0 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.874+0000 7f52d5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.874+0000 7f52d5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d8113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53798/0 (socket says 172.21.15.148:53798) 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.874+0000 7f52d5e00700 1 -- 172.21.15.148:0/1421820572 learned_addr learned my addr 172.21.15.148:0/1421820572 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.875+0000 7f52d5e00700 1 -- 172.21.15.148:0/1421820572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c80094f0 con 0x7f52d8077bb0 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.875+0000 7f52d5e00700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d8113a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006fd0 tx=0x7f52c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.875+0000 7f52ce000700 1 -- 172.21.15.148:0/1421820572 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c80107c0 con 0x7f52d8077bb0 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.875+0000 7f52ce000700 1 -- 172.21.15.148:0/1421820572 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f52c8010db0 con 0x7f52d8077bb0 2024-02-28T16:13:02.903 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.875+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d81141c0 con 0x7f52d8077bb0 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.875+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d8114e60 con 0x7f52d8077bb0 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.875+0000 7f52ce000700 1 -- 172.21.15.148:0/1421820572 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52c801add0 con 0x7f52d8077bb0 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.877+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d805f5c0 con 0x7f52d8077bb0 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.877+0000 7f52ce000700 1 -- 172.21.15.148:0/1421820572 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f52c80214e0 con 0x7f52d8077bb0 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.877+0000 7f52ce000700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 0x7f52bc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.877+0000 7f52ce000700 1 -- 172.21.15.148:0/1421820572 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f52c801e070 con 0x7f52d8077bb0 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.877+0000 7f52d5400700 1 -- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 msgr2=0x7f52bc038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3589982370 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.877+0000 7f52d5400700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 0x7f52bc038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:01.882+0000 7f52ce000700 1 -- 172.21.15.148:0/1421820572 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f52c8029520 con 0x7f52d8077bb0 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.078+0000 7f52d5400700 1 -- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 msgr2=0x7f52bc038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3589982370 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.078+0000 7f52d5400700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 0x7f52bc038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:13:02.904 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.147+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f52d8108b50 con 0x7f52d8077bb0 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.148+0000 7f52ce000700 1 -- 172.21.15.148:0/1421820572 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f52c8029340 con 0x7f52d8077bb0 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 msgr2=0x7f52bc038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 0x7f52bc038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 msgr2=0x7f52d8113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d8113a80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006fd0 tx=0x7f52c8009250 comp rx=0 tx=0).stop 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 shutdown_connections 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7f52bc036790 0x7f52bc038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 --2- 172.21.15.148:0/1421820572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52d8077bb0 0x7f52d8113a80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 >> 172.21.15.148:0/1421820572 conn(0x7f52d80fded0 msgr2=0x7f52d8100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 shutdown_connections 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:02.151+0000 7f52dcc00700 1 -- 172.21.15.148:0/1421820572 wait complete. 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for the mgr to restart... 2024-02-28T16:13:02.905 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr epoch 5... 2024-02-28T16:13:09.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: Active manager daemon smithi148.gelspy restarted 2024-02-28T16:13:09.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: Activating manager daemon smithi148.gelspy 2024-02-28T16:13:09.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: osdmap e2: 0 total, 0 up, 0 in 2024-02-28T16:13:09.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: mgrmap e6: smithi148.gelspy(active, starting, since 0.00959088s) 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:09.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:08 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:09 smithi148 ceph-mon[28767]: Found migration_current of "None". Setting to last migration. 2024-02-28T16:13:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:09 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:09 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:09 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:09 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:13:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:09 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:13:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:09 smithi148 ceph-mon[28767]: mgrmap e7: smithi148.gelspy(active, since 1.01515s) 2024-02-28T16:13:10.576 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.487+0000 7ffba0e00700 1 Processor -- start 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.487+0000 7ffba0e00700 1 -- start start 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.488+0000 7ffba0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c0760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.488+0000 7ffba0e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c077fc0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.488+0000 7ffb99e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c0760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.488+0000 7ffb99e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c0760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56054/0 (socket says 172.21.15.148:56054) 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.488+0000 7ffb99e00700 1 -- 172.21.15.148:0/1292235444 learned_addr learned my addr 172.21.15.148:0/1292235444 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:10.577 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.489+0000 7ffb99e00700 1 -- 172.21.15.148:0/1292235444 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c076600 con 0x7ffb9c077bb0 2024-02-28T16:13:10.578 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.489+0000 7ffb99e00700 1 --2- 172.21.15.148:0/1292235444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c0760c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0098e0 tx=0x7ffb8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9c0e82368a0bbb server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.489+0000 7ffb98a00700 1 -- 172.21.15.148:0/1292235444 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c00b860 con 0x7ffb9c077bb0 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.489+0000 7ffb98a00700 1 -- 172.21.15.148:0/1292235444 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffb8c00be50 con 0x7ffb9c077bb0 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.489+0000 7ffb98a00700 1 -- 172.21.15.148:0/1292235444 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c010380 con 0x7ffb9c077bb0 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.490+0000 7ffba0e00700 1 -- 172.21.15.148:0/1292235444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 msgr2=0x7ffb9c0760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.490+0000 7ffba0e00700 1 --2- 172.21.15.148:0/1292235444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c0760c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0098e0 tx=0x7ffb8c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.490+0000 7ffba0e00700 1 -- 172.21.15.148:0/1292235444 shutdown_connections 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.490+0000 7ffba0e00700 1 --2- 172.21.15.148:0/1292235444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c0760c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.490+0000 7ffba0e00700 1 -- 172.21.15.148:0/1292235444 >> 172.21.15.148:0/1292235444 conn(0x7ffb9c0fded0 msgr2=0x7ffb9c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.490+0000 7ffba0e00700 1 -- 172.21.15.148:0/1292235444 shutdown_connections 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.490+0000 7ffba0e00700 1 -- 172.21.15.148:0/1292235444 wait complete. 2024-02-28T16:13:10.585 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.491+0000 7ffba0e00700 1 Processor -- start 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.491+0000 7ffba0e00700 1 -- start start 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.492+0000 7ffba0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.492+0000 7ffba0e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9c113fc0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.492+0000 7ffb99e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.492+0000 7ffb99e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56064/0 (socket says 172.21.15.148:56064) 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.492+0000 7ffb99e00700 1 -- 172.21.15.148:0/1698794357 learned_addr learned my addr 172.21.15.148:0/1698794357 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.492+0000 7ffb99e00700 1 -- 172.21.15.148:0/1698794357 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0094f0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.493+0000 7ffb99e00700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c113a80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c006fd0 tx=0x7ffb8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.493+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c0107c0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.493+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ffb8c010db0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.493+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb8c01add0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.493+0000 7ffba0e00700 1 -- 172.21.15.148:0/1698794357 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9c1141c0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.586 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.493+0000 7ffba0e00700 1 -- 172.21.15.148:0/1698794357 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9c114e60 con 0x7ffb9c077bb0 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.494+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 5) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ffb8c02b440 con 0x7ffb9c077bb0 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.494+0000 7ffb92000700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.494+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 --> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb80039350 con 0x7ffb80036790 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.494+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffb8c01e070 con 0x7ffb9c077bb0 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.495+0000 7ffb99400700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 msgr2=0x7ffb80038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3589982370 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.495+0000 7ffb99400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.696+0000 7ffb99400700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 msgr2=0x7ffb80038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3589982370 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:03.696+0000 7ffb99400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:04.097+0000 7ffb99400700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 msgr2=0x7ffb80038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3589982370 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:04.097+0000 7ffb99400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T16:13:10.587 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:04.898+0000 7ffb99400700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 msgr2=0x7ffb80038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3589982370 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:04.898+0000 7ffb99400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:06.500+0000 7ffb99400700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 msgr2=0x7ffb80038c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3589982370 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:06.500+0000 7ffb99400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:08.858+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mgrmap(e 6) v1 ==== 43135+0+0 (secure 0 0 0) 0x7ffb8c00fda0 con 0x7ffb9c077bb0 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:08.858+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 msgr2=0x7ffb80038c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:08.858+0000 7ffb92000700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.861+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 7) v1 ==== 43262+0+0 (secure 0 0 0) 0x7ffb8c02b920 con 0x7ffb9c077bb0 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.861+0000 7ffb92000700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ffb80039fc0 0x7ffb8003c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.861+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb80039350 con 0x7ffb80039fc0 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.862+0000 7ffb99400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ffb80039fc0 0x7ffb8003c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.863+0000 7ffb99400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ffb80039fc0 0x7ffb8003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffb880039d0 tx=0x7ffb88009350 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.864+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7ffb80039350 con 0x7ffb80039fc0 2024-02-28T16:13:10.588 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.871+0000 7ffb87400700 1 -- 172.21.15.148:0/1698794357 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ffb740025c0 con 0x7ffb80039fc0 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.871+0000 7ffb92000700 1 -- 172.21.15.148:0/1698794357 <== mgr.14120 v2:172.21.15.148:6800/1096845265 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ffb740025c0 con 0x7ffb80039fc0 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ffb80039fc0 msgr2=0x7ffb8003c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ffb80039fc0 0x7ffb8003c3a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ffb880039d0 tx=0x7ffb88009350 comp rx=0 tx=0).stop 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 -- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 msgr2=0x7ffb9c113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c113a80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c006fd0 tx=0x7ffb8c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 -- 172.21.15.148:0/1698794357 shutdown_connections 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ffb80039fc0 0x7ffb8003c3a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb9c077bb0 0x7ffb9c113a80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 --2- 172.21.15.148:0/1698794357 >> [v2:172.21.15.148:6800/3589982370,v1:172.21.15.148:6801/3589982370] conn(0x7ffb80036790 0x7ffb80038c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 -- 172.21.15.148:0/1698794357 >> 172.21.15.148:0/1698794357 conn(0x7ffb9c0fded0 msgr2=0x7ffb9c100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 -- 172.21.15.148:0/1698794357 shutdown_connections 2024-02-28T16:13:10.589 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:09.872+0000 7ffb87400700 1 -- 172.21.15.148:0/1698794357 wait complete. 2024-02-28T16:13:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:mgr epoch 5 is available 2024-02-28T16:13:10.590 INFO:teuthology.orchestra.run.smithi148.stdout:Setting orchestrator backend to cephadm... 2024-02-28T16:13:11.194 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:10 smithi148 ceph-mon[28767]: [28/Feb/2024:16:13:09] ENGINE Bus STARTING 2024-02-28T16:13:11.194 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:10 smithi148 ceph-mon[28767]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T16:13:11.194 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:10 smithi148 ceph-mon[28767]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T16:13:11.194 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:10 smithi148 ceph-mon[28767]: [28/Feb/2024:16:13:09] ENGINE Serving on https://172.21.15.148:7150 2024-02-28T16:13:11.194 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:10 smithi148 ceph-mon[28767]: [28/Feb/2024:16:13:09] ENGINE Bus STARTED 2024-02-28T16:13:11.194 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:10 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:11.194 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:10 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:12.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:11 smithi148 ceph-mon[28767]: mgrmap e8: smithi148.gelspy(active, since 2s) 2024-02-28T16:13:12.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:11 smithi148 ceph-mon[28767]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:12.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:11 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:12.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:11 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.213+0000 7f27e9600700 1 Processor -- start 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.213+0000 7f27e9600700 1 -- start start 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.213+0000 7f27e9600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e407cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.213+0000 7f27e9600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e407d0f0 con 0x7f27e407c7a0 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.214+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e407cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.214+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e407cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56132/0 (socket says 172.21.15.148:56132) 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.214+0000 7f27e2a00700 1 -- 172.21.15.148:0/1208086654 learned_addr learned my addr 172.21.15.148:0/1208086654 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.214+0000 7f27e2a00700 1 -- 172.21.15.148:0/1208086654 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e407d230 con 0x7f27e407c7a0 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.215+0000 7f27e2a00700 1 --2- 172.21.15.148:0/1208086654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e407cbb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27d40098e0 tx=0x7f27d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1012e310cfa7a80e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:12.182 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.215+0000 7f27e1600700 1 -- 172.21.15.148:0/1208086654 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27d400b860 con 0x7f27e407c7a0 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.215+0000 7f27e1600700 1 -- 172.21.15.148:0/1208086654 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f27d400be50 con 0x7f27e407c7a0 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.215+0000 7f27e1600700 1 -- 172.21.15.148:0/1208086654 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27d4010380 con 0x7f27e407c7a0 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.216+0000 7f27e9600700 1 -- 172.21.15.148:0/1208086654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 msgr2=0x7f27e407cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.216+0000 7f27e9600700 1 --2- 172.21.15.148:0/1208086654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e407cbb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27d40098e0 tx=0x7f27d4009250 comp rx=0 tx=0).stop 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.216+0000 7f27e9600700 1 -- 172.21.15.148:0/1208086654 shutdown_connections 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.216+0000 7f27e9600700 1 --2- 172.21.15.148:0/1208086654 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e407cbb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.216+0000 7f27e9600700 1 -- 172.21.15.148:0/1208086654 >> 172.21.15.148:0/1208086654 conn(0x7f27e4078030 msgr2=0x7f27e407a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.216+0000 7f27e9600700 1 -- 172.21.15.148:0/1208086654 shutdown_connections 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.216+0000 7f27e9600700 1 -- 172.21.15.148:0/1208086654 wait complete. 2024-02-28T16:13:12.183 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.217+0000 7f27e9600700 1 Processor -- start 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.217+0000 7f27e9600700 1 -- start start 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.218+0000 7f27e9600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e4117b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.218+0000 7f27e9600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41180d0 con 0x7f27e407c7a0 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.218+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e4117b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.218+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e4117b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56144/0 (socket says 172.21.15.148:56144) 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.218+0000 7f27e2a00700 1 -- 172.21.15.148:0/217131643 learned_addr learned my addr 172.21.15.148:0/217131643 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.218+0000 7f27e2a00700 1 -- 172.21.15.148:0/217131643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40094f0 con 0x7f27e407c7a0 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.218+0000 7f27e2a00700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e4117b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27d4006b00 tx=0x7f27d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:12.184 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.219+0000 7f27daa00700 1 -- 172.21.15.148:0/217131643 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27d40107c0 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.219+0000 7f27daa00700 1 -- 172.21.15.148:0/217131643 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f27d4010db0 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.219+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e41182d0 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.219+0000 7f27daa00700 1 -- 172.21.15.148:0/217131643 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27d401acf0 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.219+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e4118f70 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.220+0000 7f27daa00700 1 -- 172.21.15.148:0/217131643 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f27d4010920 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.220+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e405f5c0 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.220+0000 7f27daa00700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f27c80367e0 0x7f27c8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.220+0000 7f27daa00700 1 -- 172.21.15.148:0/217131643 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f27d404a6e0 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.221+0000 7f27e2000700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f27c80367e0 0x7f27c8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.221+0000 7f27e2000700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f27c80367e0 0x7f27c8038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009990 tx=0x7f27d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.226+0000 7f27daa00700 1 -- 172.21.15.148:0/217131643 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f27d401a530 con 0x7f27e407c7a0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.447+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f27e407b350 con 0x7f27c80367e0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.463+0000 7f27daa00700 1 -- 172.21.15.148:0/217131643 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f27e407b350 con 0x7f27c80367e0 2024-02-28T16:13:12.185 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f27c80367e0 msgr2=0x7f27c8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f27c80367e0 0x7f27c8038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009990 tx=0x7f27d0006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 msgr2=0x7f27e4117b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e4117b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27d4006b00 tx=0x7f27d4009250 comp rx=0 tx=0).stop 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 shutdown_connections 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f27c80367e0 0x7f27c8038c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 --2- 172.21.15.148:0/217131643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27e407c7a0 0x7f27e4117b90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.466+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 >> 172.21.15.148:0/217131643 conn(0x7f27e4078030 msgr2=0x7f27e407a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.467+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 shutdown_connections 2024-02-28T16:13:12.186 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:11.467+0000 7f27e9600700 1 -- 172.21.15.148:0/217131643 wait complete. 2024-02-28T16:13:13.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-28T16:13:13.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.860+0000 7f74be400700 1 Processor -- start 2024-02-28T16:13:13.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.860+0000 7f74be400700 1 -- start start 2024-02-28T16:13:13.782 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.860+0000 7f74be400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8109330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:13.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.860+0000 7f74be400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8109870 con 0x7f74b8108f20 2024-02-28T16:13:13.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.861+0000 7f74b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8109330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:13.784 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.861+0000 7f74b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8109330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55738/0 (socket says 172.21.15.148:55738) 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.861+0000 7f74b7400700 1 -- 172.21.15.148:0/1782682978 learned_addr learned my addr 172.21.15.148:0/1782682978 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.861+0000 7f74b7400700 1 -- 172.21.15.148:0/1782682978 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b81099b0 con 0x7f74b8108f20 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.861+0000 7f74b7400700 1 --2- 172.21.15.148:0/1782682978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8109330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f74a80098e0 tx=0x7f74a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e03dd2fa74fed81 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74b6000700 1 -- 172.21.15.148:0/1782682978 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a800b860 con 0x7f74b8108f20 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74b6000700 1 -- 172.21.15.148:0/1782682978 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f74a800be50 con 0x7f74b8108f20 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74b6000700 1 -- 172.21.15.148:0/1782682978 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a8010380 con 0x7f74b8108f20 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74be400700 1 -- 172.21.15.148:0/1782682978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 msgr2=0x7f74b8109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74be400700 1 --2- 172.21.15.148:0/1782682978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8109330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f74a80098e0 tx=0x7f74a8009250 comp rx=0 tx=0).stop 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74be400700 1 -- 172.21.15.148:0/1782682978 shutdown_connections 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74be400700 1 --2- 172.21.15.148:0/1782682978 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8109330 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.862+0000 7f74be400700 1 -- 172.21.15.148:0/1782682978 >> 172.21.15.148:0/1782682978 conn(0x7f74b8078030 msgr2=0x7f74b807a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.863+0000 7f74be400700 1 -- 172.21.15.148:0/1782682978 shutdown_connections 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.863+0000 7f74be400700 1 -- 172.21.15.148:0/1782682978 wait complete. 2024-02-28T16:13:13.785 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.863+0000 7f74be400700 1 Processor -- start 2024-02-28T16:13:13.786 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.864+0000 7f74be400700 1 -- start start 2024-02-28T16:13:13.789 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.864+0000 7f74be400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8117b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:13.789 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.864+0000 7f74be400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b81180c0 con 0x7f74b8108f20 2024-02-28T16:13:13.789 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.864+0000 7f74b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8117b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:13.789 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.864+0000 7f74b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8117b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55742/0 (socket says 172.21.15.148:55742) 2024-02-28T16:13:13.789 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.864+0000 7f74b7400700 1 -- 172.21.15.148:0/3546854415 learned_addr learned my addr 172.21.15.148:0/3546854415 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:13.789 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.864+0000 7f74b7400700 1 -- 172.21.15.148:0/3546854415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80094f0 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.865+0000 7f74b7400700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8117b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74a8000c00 tx=0x7f74a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.865+0000 7f74af400700 1 -- 172.21.15.148:0/3546854415 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a8010380 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.865+0000 7f74af400700 1 -- 172.21.15.148:0/3546854415 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f74a8010c50 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.865+0000 7f74af400700 1 -- 172.21.15.148:0/3546854415 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74a801ac50 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.865+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b81182c0 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.865+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b8118f60 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.866+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b805f5c0 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.866+0000 7f74af400700 1 -- 172.21.15.148:0/3546854415 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f74a80107c0 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.867+0000 7f74af400700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f749c0367e0 0x7f749c038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.867+0000 7f74af400700 1 -- 172.21.15.148:0/3546854415 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f74a804a5f0 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.867+0000 7f74b6a00700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f749c0367e0 0x7f749c038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.868+0000 7f74b6a00700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f749c0367e0 0x7f749c038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009990 tx=0x7f74a4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:12.872+0000 7f74af400700 1 -- 172.21.15.148:0/3546854415 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f74a801a430 con 0x7f74b8108f20 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.079+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f74b807b320 con 0x7f749c0367e0 2024-02-28T16:13:13.790 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.080+0000 7f74af400700 1 -- 172.21.15.148:0/3546854415 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f74b807b320 con 0x7f749c0367e0 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.083+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f749c0367e0 msgr2=0x7f749c038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.083+0000 7f74be400700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f749c0367e0 0x7f749c038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009990 tx=0x7f74a4006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.083+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 msgr2=0x7f74b8117b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.083+0000 7f74be400700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8117b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74a8000c00 tx=0x7f74a8009250 comp rx=0 tx=0).stop 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.084+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 shutdown_connections 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.084+0000 7f74be400700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f749c0367e0 0x7f749c038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.084+0000 7f74be400700 1 --2- 172.21.15.148:0/3546854415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f74b8108f20 0x7f74b8117b80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.084+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 >> 172.21.15.148:0/3546854415 conn(0x7f74b8078030 msgr2=0x7f74b807a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.084+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 shutdown_connections 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:13.084+0000 7f74be400700 1 -- 172.21.15.148:0/3546854415 wait complete. 2024-02-28T16:13:13.791 INFO:teuthology.orchestra.run.smithi148.stdout:Generating ssh key... 2024-02-28T16:13:14.095 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:13 smithi148 ceph-mon[28767]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:15.540 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.395+0000 7f64f8200700 1 Processor -- start 2024-02-28T16:13:15.540 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.396+0000 7f64f8200700 1 -- start start 2024-02-28T16:13:15.540 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.396+0000 7f64f8200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0105360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:15.541 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.396+0000 7f64f8200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f01058a0 con 0x7f64f00714a0 2024-02-28T16:13:15.541 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.396+0000 7f64f5800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0105360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:15.541 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.396+0000 7f64f5800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0105360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55752/0 (socket says 172.21.15.148:55752) 2024-02-28T16:13:15.541 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.396+0000 7f64f5800700 1 -- 172.21.15.148:0/921450900 learned_addr learned my addr 172.21.15.148:0/921450900 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:15.544 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.397+0000 7f64f5800700 1 -- 172.21.15.148:0/921450900 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f01059e0 con 0x7f64f00714a0 2024-02-28T16:13:15.544 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.397+0000 7f64f5800700 1 --2- 172.21.15.148:0/921450900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0105360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64e40098e0 tx=0x7f64e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e82dc2668a345e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.397+0000 7f64efe00700 1 -- 172.21.15.148:0/921450900 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64e400b860 con 0x7f64f00714a0 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64efe00700 1 -- 172.21.15.148:0/921450900 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f64e400be50 con 0x7f64f00714a0 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64efe00700 1 -- 172.21.15.148:0/921450900 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64e4010380 con 0x7f64f00714a0 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64f8200700 1 -- 172.21.15.148:0/921450900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 msgr2=0x7f64f0105360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64f8200700 1 --2- 172.21.15.148:0/921450900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0105360 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64e40098e0 tx=0x7f64e4009250 comp rx=0 tx=0).stop 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64f8200700 1 -- 172.21.15.148:0/921450900 shutdown_connections 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64f8200700 1 --2- 172.21.15.148:0/921450900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0105360 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64f8200700 1 -- 172.21.15.148:0/921450900 >> 172.21.15.148:0/921450900 conn(0x7f64f00fcdd0 msgr2=0x7f64f00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.398+0000 7f64f8200700 1 -- 172.21.15.148:0/921450900 shutdown_connections 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.399+0000 7f64f8200700 1 -- 172.21.15.148:0/921450900 wait complete. 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.399+0000 7f64f8200700 1 Processor -- start 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.399+0000 7f64f8200700 1 -- start start 2024-02-28T16:13:15.545 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.400+0000 7f64f8200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.400+0000 7f64f8200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f0113cb0 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.400+0000 7f64f5800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.400+0000 7f64f5800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55758/0 (socket says 172.21.15.148:55758) 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.400+0000 7f64f5800700 1 -- 172.21.15.148:0/3586711514 learned_addr learned my addr 172.21.15.148:0/3586711514 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.400+0000 7f64f5800700 1 -- 172.21.15.148:0/3586711514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40094f0 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.401+0000 7f64f5800700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0113770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64e4006b00 tx=0x7f64e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.401+0000 7f64ed600700 1 -- 172.21.15.148:0/3586711514 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64e40107c0 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.401+0000 7f64ed600700 1 -- 172.21.15.148:0/3586711514 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f64e4010db0 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.401+0000 7f64f8200700 1 -- 172.21.15.148:0/3586711514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f0113eb0 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.401+0000 7f64ed600700 1 -- 172.21.15.148:0/3586711514 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64e401acf0 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.401+0000 7f64f8200700 1 -- 172.21.15.148:0/3586711514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f0114b50 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.402+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f005f5c0 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.403+0000 7f64ed600700 1 -- 172.21.15.148:0/3586711514 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f64e4010920 con 0x7f64f00714a0 2024-02-28T16:13:15.546 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.403+0000 7f64ed600700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f64d80367e0 0x7f64d8038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:15.547 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.403+0000 7f64ed600700 1 -- 172.21.15.148:0/3586711514 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f64e404a5d0 con 0x7f64f00714a0 2024-02-28T16:13:15.547 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.404+0000 7f64f4e00700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f64d80367e0 0x7f64d8038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:15.547 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.404+0000 7f64f4e00700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f64d80367e0 0x7f64d8038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009990 tx=0x7f64dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.408+0000 7f64ed600700 1 -- 172.21.15.148:0/3586711514 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f64e401a530 con 0x7f64f00714a0 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.619+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f64f01067f0 con 0x7f64d80367e0 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.814+0000 7f64ed600700 1 -- 172.21.15.148:0/3586711514 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f64f01067f0 con 0x7f64d80367e0 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f64d80367e0 msgr2=0x7f64d8038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f64d80367e0 0x7f64d8038c90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009990 tx=0x7f64dc006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 msgr2=0x7f64f0113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0113770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64e4006b00 tx=0x7f64e4009250 comp rx=0 tx=0).stop 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 shutdown_connections 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f64d80367e0 0x7f64d8038c90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:15.549 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 --2- 172.21.15.148:0/3586711514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64f00714a0 0x7f64f0113770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:15.550 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 >> 172.21.15.148:0/3586711514 conn(0x7f64f00fcdd0 msgr2=0x7f64f00fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:15.550 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 shutdown_connections 2024-02-28T16:13:15.550 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:14.817+0000 7f64e2a00700 1 -- 172.21.15.148:0/3586711514 wait complete. 2024-02-28T16:13:15.842 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:15 smithi148 ceph-mon[28767]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:15.842 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:15 smithi148 ceph-mon[28767]: Generating ssh key... 2024-02-28T16:13:15.842 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:15 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:15.842 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:15 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:17.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:16 smithi148 ceph-mon[28767]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:17.200 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjpWELBNHWML0XVB1jdvmv8uAVLGOtPqYMNVPVFh7zm2SCqsZgI0d1v7DTX9Y5VAg56Zt7i5RXHTeVoypwkpr0HoglOu65hApAJ5tVsN/+UB+3PDx3hIAYeIOLVTyrooZgX6qYES9rz9TQ/kHFnVk0WyYh+0/iGDpv1caW2MdyqQmIA1nzvEQ+I+f+nVlPWI6vGboW2ed+Jf3mwT7LnklMm9UKzyryMqn18fBYni926ns6j0rMmMOx04sPteJJx/rRH6l2XSG/krtgpfdwELWLOKczjLn7aLs88OrTZgRk+rLJXHGBST3qRIJMu88U65Wq6xmUJb+GLSOb4J+2UV/oWNrNTnBoERdjAiC54D5L8V9LC6a9wn0klTJwRhCkdfFAR+N+3m9GWRtCPhNL/zL1UVL0gG7vma3RsmC0L1zpzYlvzdhkDm/KzISYNurCjH1gaDW8/0I7huPzXOxtEAC/tDc4J6UENYfQCGDGeAWvhiEHpBGGUjqybGbjTZTm7pk= ceph-004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:13:17.205 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.154+0000 7fb72ec00700 1 Processor -- start 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.154+0000 7fb72ec00700 1 -- start start 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.154+0000 7fb72ec00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb7280760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.154+0000 7fb72ec00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb728077fc0 con 0x7fb728077bb0 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.155+0000 7fb727e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb7280760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.155+0000 7fb727e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb7280760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55764/0 (socket says 172.21.15.148:55764) 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.155+0000 7fb727e00700 1 -- 172.21.15.148:0/638782266 learned_addr learned my addr 172.21.15.148:0/638782266 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.156+0000 7fb727e00700 1 -- 172.21.15.148:0/638782266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728076600 con 0x7fb728077bb0 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.156+0000 7fb727e00700 1 --2- 172.21.15.148:0/638782266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb7280760c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7180098e0 tx=0x7fb718009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16221a87d99b759 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.156+0000 7fb726a00700 1 -- 172.21.15.148:0/638782266 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb71800b860 con 0x7fb728077bb0 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.156+0000 7fb726a00700 1 -- 172.21.15.148:0/638782266 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb71800be50 con 0x7fb728077bb0 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.157+0000 7fb726a00700 1 -- 172.21.15.148:0/638782266 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb718010380 con 0x7fb728077bb0 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.157+0000 7fb72ec00700 1 -- 172.21.15.148:0/638782266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 msgr2=0x7fb7280760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.157+0000 7fb72ec00700 1 --2- 172.21.15.148:0/638782266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb7280760c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7180098e0 tx=0x7fb718009250 comp rx=0 tx=0).stop 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.157+0000 7fb72ec00700 1 -- 172.21.15.148:0/638782266 shutdown_connections 2024-02-28T16:13:17.206 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.157+0000 7fb72ec00700 1 --2- 172.21.15.148:0/638782266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb7280760c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.157+0000 7fb72ec00700 1 -- 172.21.15.148:0/638782266 >> 172.21.15.148:0/638782266 conn(0x7fb7280fded0 msgr2=0x7fb728100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.158+0000 7fb72ec00700 1 -- 172.21.15.148:0/638782266 shutdown_connections 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.158+0000 7fb72ec00700 1 -- 172.21.15.148:0/638782266 wait complete. 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.159+0000 7fb72ec00700 1 Processor -- start 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.159+0000 7fb72ec00700 1 -- start start 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.159+0000 7fb72ec00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb728113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.159+0000 7fb72ec00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb728113fc0 con 0x7fb728077bb0 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.160+0000 7fb727e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb728113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.160+0000 7fb727e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb728113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55772/0 (socket says 172.21.15.148:55772) 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.160+0000 7fb727e00700 1 -- 172.21.15.148:0/1244087937 learned_addr learned my addr 172.21.15.148:0/1244087937 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.160+0000 7fb727e00700 1 -- 172.21.15.148:0/1244087937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180094f0 con 0x7fb728077bb0 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.160+0000 7fb727e00700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb728113a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb718006fd0 tx=0x7fb718009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.161+0000 7fb71fe00700 1 -- 172.21.15.148:0/1244087937 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7180107c0 con 0x7fb728077bb0 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.161+0000 7fb71fe00700 1 -- 172.21.15.148:0/1244087937 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fb718010db0 con 0x7fb728077bb0 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.161+0000 7fb71fe00700 1 -- 172.21.15.148:0/1244087937 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb71801add0 con 0x7fb728077bb0 2024-02-28T16:13:17.207 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.161+0000 7fb72ec00700 1 -- 172.21.15.148:0/1244087937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7281141c0 con 0x7fb728077bb0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.161+0000 7fb72ec00700 1 -- 172.21.15.148:0/1244087937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb728114e60 con 0x7fb728077bb0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.162+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7000052b0 con 0x7fb728077bb0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.162+0000 7fb71fe00700 1 -- 172.21.15.148:0/1244087937 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fb718010920 con 0x7fb728077bb0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.163+0000 7fb71fe00700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb70c036790 0x7fb70c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.163+0000 7fb71fe00700 1 -- 172.21.15.148:0/1244087937 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb71801e070 con 0x7fb728077bb0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.163+0000 7fb727400700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb70c036790 0x7fb70c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.164+0000 7fb727400700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb70c036790 0x7fb70c038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb714009990 tx=0x7fb714006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.168+0000 7fb71fe00700 1 -- 172.21.15.148:0/1244087937 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb718010bd0 con 0x7fb728077bb0 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.381+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb700000bc0 con 0x7fb70c036790 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.383+0000 7fb71fe00700 1 -- 172.21.15.148:0/1244087937 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb700000bc0 con 0x7fb70c036790 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.385+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb70c036790 msgr2=0x7fb70c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb70c036790 0x7fb70c038c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb714009990 tx=0x7fb714006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 msgr2=0x7fb728113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb728113a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb718006fd0 tx=0x7fb718009250 comp rx=0 tx=0).stop 2024-02-28T16:13:17.208 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 shutdown_connections 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb70c036790 0x7fb70c038c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 --2- 172.21.15.148:0/1244087937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb728077bb0 0x7fb728113a80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 >> 172.21.15.148:0/1244087937 conn(0x7fb7280fded0 msgr2=0x7fb728100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 shutdown_connections 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:16.386+0000 7fb71d600700 1 -- 172.21.15.148:0/1244087937 wait complete. 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:Adding key to root@localhost authorized_keys... 2024-02-28T16:13:17.209 INFO:teuthology.orchestra.run.smithi148.stdout:Adding host smithi148... 2024-02-28T16:13:18.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:18 smithi148 ceph-mon[28767]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "addr": "172.21.15.148", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:20.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:20 smithi148 ceph-mon[28767]: Deploying cephadm binary to smithi148 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Added host 'smithi148' with addr '172.21.15.148' 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.867+0000 7f582a800700 1 Processor -- start 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.867+0000 7f582a800700 1 -- start start 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.868+0000 7f582a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824076100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.868+0000 7f582a800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5824078000 con 0x7f5824077bf0 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.868+0000 7f5823400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.868+0000 7f5823400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824076100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55774/0 (socket says 172.21.15.148:55774) 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.868+0000 7f5823400700 1 -- 172.21.15.148:0/814394195 learned_addr learned my addr 172.21.15.148:0/814394195 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.869+0000 7f5823400700 1 -- 172.21.15.148:0/814394195 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5824076640 con 0x7f5824077bf0 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.869+0000 7f5823400700 1 --2- 172.21.15.148:0/814394195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824076100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58140098e0 tx=0x7f5814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b67f5eebeed3b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:22.737 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.869+0000 7f5822a00700 1 -- 172.21.15.148:0/814394195 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f581400b860 con 0x7f5824077bf0 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.869+0000 7f5822a00700 1 -- 172.21.15.148:0/814394195 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f581400be50 con 0x7f5824077bf0 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.869+0000 7f5822a00700 1 -- 172.21.15.148:0/814394195 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5814010380 con 0x7f5824077bf0 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.870+0000 7f582a800700 1 -- 172.21.15.148:0/814394195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 msgr2=0x7f5824076100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.870+0000 7f582a800700 1 --2- 172.21.15.148:0/814394195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824076100 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58140098e0 tx=0x7f5814009250 comp rx=0 tx=0).stop 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.870+0000 7f582a800700 1 -- 172.21.15.148:0/814394195 shutdown_connections 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.870+0000 7f582a800700 1 --2- 172.21.15.148:0/814394195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824076100 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.870+0000 7f582a800700 1 -- 172.21.15.148:0/814394195 >> 172.21.15.148:0/814394195 conn(0x7f58240fded0 msgr2=0x7f5824100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.870+0000 7f582a800700 1 -- 172.21.15.148:0/814394195 shutdown_connections 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.870+0000 7f582a800700 1 -- 172.21.15.148:0/814394195 wait complete. 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.871+0000 7f582a800700 1 Processor -- start 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.871+0000 7f582a800700 1 -- start start 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.871+0000 7f582a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.871+0000 7f582a800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5824113f70 con 0x7f5824077bf0 2024-02-28T16:13:22.738 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.872+0000 7f5823400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.872+0000 7f5823400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55784/0 (socket says 172.21.15.148:55784) 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.872+0000 7f5823400700 1 -- 172.21.15.148:0/657756677 learned_addr learned my addr 172.21.15.148:0/657756677 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.872+0000 7f5823400700 1 -- 172.21.15.148:0/657756677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58140094f0 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.872+0000 7f5823400700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824113a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f581400b440 tx=0x7f5814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.872+0000 7f581be00700 1 -- 172.21.15.148:0/657756677 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f58140107c0 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.873+0000 7f581be00700 1 -- 172.21.15.148:0/657756677 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5814010db0 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.873+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5824114170 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.873+0000 7f581be00700 1 -- 172.21.15.148:0/657756677 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f581401ad30 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.873+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5824114e10 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.874+0000 7f581be00700 1 -- 172.21.15.148:0/657756677 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f5814010920 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.874+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582405f5c0 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.874+0000 7f581be00700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f5808036790 0x7f5808038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.874+0000 7f581be00700 1 -- 172.21.15.148:0/657756677 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f581404ad70 con 0x7f5824077bf0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.874+0000 7f581aa00700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f5808036790 0x7f5808038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:22.739 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.875+0000 7f581aa00700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f5808036790 0x7f5808038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f580c009990 tx=0x7f580c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:17.879+0000 7f581be00700 1 -- 172.21.15.148:0/657756677 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5814018350 con 0x7f5824077bf0 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:18.074+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi148", "addr": "172.21.15.148", "target": ["mon-mgr", ""]}) v1 -- 0x7f5824108be0 con 0x7f5808036790 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.035+0000 7f581be00700 1 -- 172.21.15.148:0/657756677 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5824108be0 con 0x7f5808036790 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.039+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f5808036790 msgr2=0x7f5808038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.039+0000 7f582a800700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f5808036790 0x7f5808038c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f580c009990 tx=0x7f580c006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.039+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 msgr2=0x7f5824113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.039+0000 7f582a800700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824113a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f581400b440 tx=0x7f5814009250 comp rx=0 tx=0).stop 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.040+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 shutdown_connections 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.040+0000 7f582a800700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f5808036790 0x7f5808038c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.040+0000 7f582a800700 1 --2- 172.21.15.148:0/657756677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5824077bf0 0x7f5824113a30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.040+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 >> 172.21.15.148:0/657756677 conn(0x7f58240fded0 msgr2=0x7f58240fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.040+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 shutdown_connections 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:22.040+0000 7f582a800700 1 -- 172.21.15.148:0/657756677 wait complete. 2024-02-28T16:13:22.740 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying mon service with default placement... 2024-02-28T16:13:23.321 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:23 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:23.321 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:23 smithi148 ceph-mon[28767]: Added host smithi148 2024-02-28T16:13:23.321 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:23 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:24.215 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.329+0000 7fee40a00700 1 Processor -- start 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.329+0000 7fee40a00700 1 -- start start 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.330+0000 7fee40a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c07cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.330+0000 7fee40a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c07d0f0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.330+0000 7fee39e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c07cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.331+0000 7fee39e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c07cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55976/0 (socket says 172.21.15.148:55976) 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.331+0000 7fee39e00700 1 -- 172.21.15.148:0/3291461582 learned_addr learned my addr 172.21.15.148:0/3291461582 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.331+0000 7fee39e00700 1 -- 172.21.15.148:0/3291461582 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c07d230 con 0x7fee3c07c7a0 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.331+0000 7fee39e00700 1 --2- 172.21.15.148:0/3291461582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c07cbb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651bed44047e119d server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee38a00700 1 -- 172.21.15.148:0/3291461582 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c00b860 con 0x7fee3c07c7a0 2024-02-28T16:13:24.216 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee38a00700 1 -- 172.21.15.148:0/3291461582 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fee2c00be50 con 0x7fee3c07c7a0 2024-02-28T16:13:24.217 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee38a00700 1 -- 172.21.15.148:0/3291461582 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c010380 con 0x7fee3c07c7a0 2024-02-28T16:13:24.217 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee40a00700 1 -- 172.21.15.148:0/3291461582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 msgr2=0x7fee3c07cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee40a00700 1 --2- 172.21.15.148:0/3291461582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c07cbb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0098e0 tx=0x7fee2c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee40a00700 1 -- 172.21.15.148:0/3291461582 shutdown_connections 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee40a00700 1 --2- 172.21.15.148:0/3291461582 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c07cbb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.332+0000 7fee40a00700 1 -- 172.21.15.148:0/3291461582 >> 172.21.15.148:0/3291461582 conn(0x7fee3c078030 msgr2=0x7fee3c07a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.333+0000 7fee40a00700 1 -- 172.21.15.148:0/3291461582 shutdown_connections 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.333+0000 7fee40a00700 1 -- 172.21.15.148:0/3291461582 wait complete. 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.333+0000 7fee40a00700 1 Processor -- start 2024-02-28T16:13:24.221 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.334+0000 7fee40a00700 1 -- start start 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.334+0000 7fee40a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c117bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.334+0000 7fee40a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1180f0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.334+0000 7fee39e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c117bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.334+0000 7fee39e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c117bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55990/0 (socket says 172.21.15.148:55990) 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.334+0000 7fee39e00700 1 -- 172.21.15.148:0/1917419032 learned_addr learned my addr 172.21.15.148:0/1917419032 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.334+0000 7fee39e00700 1 -- 172.21.15.148:0/1917419032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c0094f0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.335+0000 7fee39e00700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c117bb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee2c006b00 tx=0x7fee2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.335+0000 7fee32000700 1 -- 172.21.15.148:0/1917419032 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c0107c0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.335+0000 7fee32000700 1 -- 172.21.15.148:0/1917419032 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fee2c010db0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.335+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c1182f0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.335+0000 7fee32000700 1 -- 172.21.15.148:0/1917419032 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fee2c01acf0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.335+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c118f90 con 0x7fee3c07c7a0 2024-02-28T16:13:24.222 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.336+0000 7fee32000700 1 -- 172.21.15.148:0/1917419032 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fee2c010920 con 0x7fee3c07c7a0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.336+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c05f5c0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.337+0000 7fee32000700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fee200367e0 0x7fee20038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.337+0000 7fee32000700 1 -- 172.21.15.148:0/1917419032 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fee2c04a6e0 con 0x7fee3c07c7a0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.337+0000 7fee39400700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fee200367e0 0x7fee20038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.338+0000 7fee39400700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fee200367e0 0x7fee20038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee28009990 tx=0x7fee28006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.342+0000 7fee32000700 1 -- 172.21.15.148:0/1917419032 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fee2c01a530 con 0x7fee3c07c7a0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.558+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fee3c07b390 con 0x7fee200367e0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.569+0000 7fee32000700 1 -- 172.21.15.148:0/1917419032 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fee3c07b390 con 0x7fee200367e0 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fee200367e0 msgr2=0x7fee20038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fee200367e0 0x7fee20038c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fee28009990 tx=0x7fee28006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 msgr2=0x7fee3c117bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c117bb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee2c006b00 tx=0x7fee2c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 shutdown_connections 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fee200367e0 0x7fee20038c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:24.223 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 --2- 172.21.15.148:0/1917419032 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee3c07c7a0 0x7fee3c117bb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:24.224 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 >> 172.21.15.148:0/1917419032 conn(0x7fee3c078030 msgr2=0x7fee3c07a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:24.224 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 shutdown_connections 2024-02-28T16:13:24.224 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:23.572+0000 7fee40a00700 1 -- 172.21.15.148:0/1917419032 wait complete. 2024-02-28T16:13:24.224 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying mgr service with default placement... 2024-02-28T16:13:24.796 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:24 smithi148 ceph-mon[28767]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:24.796 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:24 smithi148 ceph-mon[28767]: Saving service mon spec with placement count:5 2024-02-28T16:13:24.796 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:24 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:26.026 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-28T16:13:26.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.961+0000 7f6f9ca00700 1 Processor -- start 2024-02-28T16:13:26.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.961+0000 7f6f9ca00700 1 -- start start 2024-02-28T16:13:26.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.961+0000 7f6f9ca00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.961+0000 7f6f9ca00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981031d0 con 0x7f6f98071420 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.962+0000 7f6f95e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.962+0000 7f6f95e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981077e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56004/0 (socket says 172.21.15.148:56004) 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.962+0000 7f6f95e00700 1 -- 172.21.15.148:0/3401424204 learned_addr learned my addr 172.21.15.148:0/3401424204 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.962+0000 7f6f95e00700 1 -- 172.21.15.148:0/3401424204 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98107d20 con 0x7f6f98071420 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.962+0000 7f6f95e00700 1 --2- 172.21.15.148:0/3401424204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981077e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f880098e0 tx=0x7f6f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bc87498fba6d09 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f94a00700 1 -- 172.21.15.148:0/3401424204 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f8800b860 con 0x7f6f98071420 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f94a00700 1 -- 172.21.15.148:0/3401424204 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6f8800be50 con 0x7f6f98071420 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f94a00700 1 -- 172.21.15.148:0/3401424204 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f88010380 con 0x7f6f98071420 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3401424204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 msgr2=0x7f6f981077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f9ca00700 1 --2- 172.21.15.148:0/3401424204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981077e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f880098e0 tx=0x7f6f88009250 comp rx=0 tx=0).stop 2024-02-28T16:13:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3401424204 shutdown_connections 2024-02-28T16:13:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f9ca00700 1 --2- 172.21.15.148:0/3401424204 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981077e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.963+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3401424204 >> 172.21.15.148:0/3401424204 conn(0x7f6f980fcdd0 msgr2=0x7f6f980ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.964+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3401424204 shutdown_connections 2024-02-28T16:13:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.964+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3401424204 wait complete. 2024-02-28T16:13:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.964+0000 7f6f9ca00700 1 Processor -- start 2024-02-28T16:13:26.034 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.965+0000 7f6f9ca00700 1 -- start start 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.965+0000 7f6f9ca00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.965+0000 7f6f9ca00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98113ce0 con 0x7f6f98071420 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.965+0000 7f6f95e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.965+0000 7f6f95e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56008/0 (socket says 172.21.15.148:56008) 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.965+0000 7f6f95e00700 1 -- 172.21.15.148:0/3356480743 learned_addr learned my addr 172.21.15.148:0/3356480743 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.965+0000 7f6f95e00700 1 -- 172.21.15.148:0/3356480743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880094f0 con 0x7f6f98071420 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.966+0000 7f6f95e00700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981137a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006b00 tx=0x7f6f88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.966+0000 7f6f8e000700 1 -- 172.21.15.148:0/3356480743 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f880107c0 con 0x7f6f98071420 2024-02-28T16:13:26.035 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.966+0000 7f6f8e000700 1 -- 172.21.15.148:0/3356480743 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6f88010db0 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.966+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f98113ee0 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.966+0000 7f6f8e000700 1 -- 172.21.15.148:0/3356480743 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f8801acf0 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.966+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f98114b80 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.967+0000 7f6f8e000700 1 -- 172.21.15.148:0/3356480743 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f6f88010920 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.967+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9805f5c0 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.968+0000 7f6f8e000700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f6f7c036790 0x7f6f7c038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.968+0000 7f6f8e000700 1 -- 172.21.15.148:0/3356480743 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6f8804a720 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.968+0000 7f6f95400700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f6f7c036790 0x7f6f7c038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.969+0000 7f6f95400700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f6f7c036790 0x7f6f7c038c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009990 tx=0x7f6f84006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:24.973+0000 7f6f8e000700 1 -- 172.21.15.148:0/3356480743 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6f8801a530 con 0x7f6f98071420 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.199+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f980ff100 con 0x7f6f7c036790 2024-02-28T16:13:26.036 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.207+0000 7f6f8e000700 1 -- 172.21.15.148:0/3356480743 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6f980ff100 con 0x7f6f7c036790 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f6f7c036790 msgr2=0x7f6f7c038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f6f7c036790 0x7f6f7c038c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009990 tx=0x7f6f84006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 msgr2=0x7f6f981137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981137a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f88006b00 tx=0x7f6f88009250 comp rx=0 tx=0).stop 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 shutdown_connections 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f6f7c036790 0x7f6f7c038c40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 --2- 172.21.15.148:0/3356480743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6f98071420 0x7f6f981137a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.210+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 >> 172.21.15.148:0/3356480743 conn(0x7f6f980fcdd0 msgr2=0x7f6f980fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.211+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 shutdown_connections 2024-02-28T16:13:26.037 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:25.211+0000 7f6f9ca00700 1 -- 172.21.15.148:0/3356480743 wait complete. 2024-02-28T16:13:26.038 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying crash service with default placement... 2024-02-28T16:13:26.323 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:26 smithi148 ceph-mon[28767]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:26.323 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:26 smithi148 ceph-mon[28767]: Saving service mgr spec with placement count:2 2024-02-28T16:13:26.323 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:26 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:27.838 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-28T16:13:27.838 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.721+0000 7efdf3800700 1 Processor -- start 2024-02-28T16:13:27.839 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.721+0000 7efdf3800700 1 -- start start 2024-02-28T16:13:27.839 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.722+0000 7efdf3800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.839 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.722+0000 7efdf3800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec079130 con 0x7efdec078d20 2024-02-28T16:13:27.839 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.722+0000 7efdf0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.839 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.723+0000 7efdf0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56010/0 (socket says 172.21.15.148:56010) 2024-02-28T16:13:27.840 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.723+0000 7efdf0e00700 1 -- 172.21.15.148:0/3441715504 learned_addr learned my addr 172.21.15.148:0/3441715504 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:27.842 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.723+0000 7efdf0e00700 1 -- 172.21.15.148:0/3441715504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec077770 con 0x7efdec078d20 2024-02-28T16:13:27.842 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.723+0000 7efdf0e00700 1 --2- 172.21.15.148:0/3441715504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec077230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efddc0098e0 tx=0x7efddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da727c98baddbfca server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.842 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.724+0000 7efdeb400700 1 -- 172.21.15.148:0/3441715504 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efddc00b860 con 0x7efdec078d20 2024-02-28T16:13:27.842 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.724+0000 7efdeb400700 1 -- 172.21.15.148:0/3441715504 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efddc00be50 con 0x7efdec078d20 2024-02-28T16:13:27.842 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.724+0000 7efdeb400700 1 -- 172.21.15.148:0/3441715504 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efddc010380 con 0x7efdec078d20 2024-02-28T16:13:27.842 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.724+0000 7efdf3800700 1 -- 172.21.15.148:0/3441715504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 msgr2=0x7efdec077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.724+0000 7efdf3800700 1 --2- 172.21.15.148:0/3441715504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec077230 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efddc0098e0 tx=0x7efddc009250 comp rx=0 tx=0).stop 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.724+0000 7efdf3800700 1 -- 172.21.15.148:0/3441715504 shutdown_connections 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.724+0000 7efdf3800700 1 --2- 172.21.15.148:0/3441715504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec077230 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.725+0000 7efdf3800700 1 -- 172.21.15.148:0/3441715504 >> 172.21.15.148:0/3441715504 conn(0x7efdec0fdf00 msgr2=0x7efdec100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.725+0000 7efdf3800700 1 -- 172.21.15.148:0/3441715504 shutdown_connections 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.725+0000 7efdf3800700 1 -- 172.21.15.148:0/3441715504 wait complete. 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.725+0000 7efdf3800700 1 Processor -- start 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.726+0000 7efdf3800700 1 -- start start 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.726+0000 7efdf3800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.726+0000 7efdf3800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdec113d50 con 0x7efdec078d20 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.726+0000 7efdf0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.726+0000 7efdf0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56024/0 (socket says 172.21.15.148:56024) 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.726+0000 7efdf0e00700 1 -- 172.21.15.148:0/1074677811 learned_addr learned my addr 172.21.15.148:0/1074677811 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:27.843 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.726+0000 7efdf0e00700 1 -- 172.21.15.148:0/1074677811 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc0094f0 con 0x7efdec078d20 2024-02-28T16:13:27.844 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.727+0000 7efdf0e00700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec113810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efddc006fd0 tx=0x7efddc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.727+0000 7efde8c00700 1 -- 172.21.15.148:0/1074677811 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efddc0107c0 con 0x7efdec078d20 2024-02-28T16:13:27.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.727+0000 7efde8c00700 1 -- 172.21.15.148:0/1074677811 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7efddc010db0 con 0x7efdec078d20 2024-02-28T16:13:27.846 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.727+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdec113f50 con 0x7efdec078d20 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.727+0000 7efde8c00700 1 -- 172.21.15.148:0/1074677811 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efddc01adc0 con 0x7efdec078d20 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.727+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdec114bf0 con 0x7efdec078d20 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.728+0000 7efde8c00700 1 -- 172.21.15.148:0/1074677811 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7efddc010920 con 0x7efdec078d20 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.728+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdec05f5c0 con 0x7efdec078d20 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.729+0000 7efde8c00700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7efdd40367e0 0x7efdd4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.729+0000 7efde8c00700 1 -- 172.21.15.148:0/1074677811 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7efddc049dc0 con 0x7efdec078d20 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.729+0000 7efdebe00700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7efdd40367e0 0x7efdd4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.729+0000 7efdebe00700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7efdd40367e0 0x7efdd4038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efde0009990 tx=0x7efde0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.734+0000 7efde8c00700 1 -- 172.21.15.148:0/1074677811 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efddc02b300 con 0x7efdec078d20 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.958+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7efdec100250 con 0x7efdd40367e0 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.967+0000 7efde8c00700 1 -- 172.21.15.148:0/1074677811 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7efdec100250 con 0x7efdd40367e0 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7efdd40367e0 msgr2=0x7efdd4038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7efdd40367e0 0x7efdd4038c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efde0009990 tx=0x7efde0006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:27.847 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 msgr2=0x7efdec113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec113810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efddc006fd0 tx=0x7efddc009250 comp rx=0 tx=0).stop 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 shutdown_connections 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7efdd40367e0 0x7efdd4038c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 --2- 172.21.15.148:0/1074677811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efdec078d20 0x7efdec113810 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 >> 172.21.15.148:0/1074677811 conn(0x7efdec0fdf00 msgr2=0x7efdec0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 shutdown_connections 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:26.970+0000 7efdf3800700 1 -- 172.21.15.148:0/1074677811 wait complete. 2024-02-28T16:13:27.848 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying prometheus service with default placement... 2024-02-28T16:13:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:27 smithi148 ceph-mon[28767]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:27 smithi148 ceph-mon[28767]: Saving service crash spec with placement * 2024-02-28T16:13:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:27 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:27 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:28.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:27 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:29.455 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-28T16:13:29.455 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.417+0000 7f051e400700 1 Processor -- start 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.417+0000 7f051e400700 1 -- start start 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.418+0000 7f051e400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.418+0000 7f051e400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0518101fc0 con 0x7f0518101670 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.418+0000 7f0517400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.418+0000 7f0517400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56030/0 (socket says 172.21.15.148:56030) 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.418+0000 7f0517400700 1 -- 172.21.15.148:0/2665682670 learned_addr learned my addr 172.21.15.148:0/2665682670 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.419+0000 7f0517400700 1 -- 172.21.15.148:0/2665682670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0518102100 con 0x7f0518101670 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.419+0000 7f0517400700 1 --2- 172.21.15.148:0/2665682670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518101a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05080098e0 tx=0x7f0508009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31356cb5901302bd server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.419+0000 7f0516000700 1 -- 172.21.15.148:0/2665682670 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f050800b860 con 0x7f0518101670 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.419+0000 7f0516000700 1 -- 172.21.15.148:0/2665682670 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f050800be90 con 0x7f0518101670 2024-02-28T16:13:29.456 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.419+0000 7f0516000700 1 -- 172.21.15.148:0/2665682670 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05080103c0 con 0x7f0518101670 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.420+0000 7f051e400700 1 -- 172.21.15.148:0/2665682670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 msgr2=0x7f0518101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.420+0000 7f051e400700 1 --2- 172.21.15.148:0/2665682670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518101a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05080098e0 tx=0x7f0508009250 comp rx=0 tx=0).stop 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.420+0000 7f051e400700 1 -- 172.21.15.148:0/2665682670 shutdown_connections 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.420+0000 7f051e400700 1 --2- 172.21.15.148:0/2665682670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518101a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.420+0000 7f051e400700 1 -- 172.21.15.148:0/2665682670 >> 172.21.15.148:0/2665682670 conn(0x7f05180fcdd0 msgr2=0x7f05180ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.421+0000 7f051e400700 1 -- 172.21.15.148:0/2665682670 shutdown_connections 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.421+0000 7f051e400700 1 -- 172.21.15.148:0/2665682670 wait complete. 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.422+0000 7f051e400700 1 Processor -- start 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.422+0000 7f051e400700 1 -- start start 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.422+0000 7f051e400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.422+0000 7f051e400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0518105f30 con 0x7f0518101670 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.423+0000 7f0517400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:29.457 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.423+0000 7f0517400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518107ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56046/0 (socket says 172.21.15.148:56046) 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.423+0000 7f0517400700 1 -- 172.21.15.148:0/4127220012 learned_addr learned my addr 172.21.15.148:0/4127220012 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.423+0000 7f0517400700 1 -- 172.21.15.148:0/4127220012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080094f0 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.423+0000 7f0517400700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518107ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05080090b0 tx=0x7f0508009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.424+0000 7f050f400700 1 -- 172.21.15.148:0/4127220012 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0508010840 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.424+0000 7f050f400700 1 -- 172.21.15.148:0/4127220012 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0508010e70 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.424+0000 7f050f400700 1 -- 172.21.15.148:0/4127220012 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0508024e40 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.424+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0518106130 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.424+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05181065c0 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.425+0000 7f050f400700 1 -- 172.21.15.148:0/4127220012 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f0508024430 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.425+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051804bed0 con 0x7f0518101670 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.425+0000 7f050f400700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f04fc036790 0x7f04fc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:29.458 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.425+0000 7f050f400700 1 -- 172.21.15.148:0/4127220012 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f050804a810 con 0x7f0518101670 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.426+0000 7f0516a00700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f04fc036790 0x7f04fc038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.426+0000 7f0516a00700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f04fc036790 0x7f04fc038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0504009990 tx=0x7f0504006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.430+0000 7f050f400700 1 -- 172.21.15.148:0/4127220012 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f050802c930 con 0x7f0518101670 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.664+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f0518106e00 con 0x7f04fc036790 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.674+0000 7f050f400700 1 -- 172.21.15.148:0/4127220012 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f0518106e00 con 0x7f04fc036790 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.677+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f04fc036790 msgr2=0x7f04fc038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.677+0000 7f051e400700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f04fc036790 0x7f04fc038c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0504009990 tx=0x7f0504006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.677+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 msgr2=0x7f0518107ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.677+0000 7f051e400700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518107ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05080090b0 tx=0x7f0508009250 comp rx=0 tx=0).stop 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.678+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 shutdown_connections 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.678+0000 7f051e400700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f04fc036790 0x7f04fc038c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:29.459 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.678+0000 7f051e400700 1 --2- 172.21.15.148:0/4127220012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0518101670 0x7f0518107ab0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f05080090b0 tx=0x7f0508009250 comp rx=0 tx=0).stop 2024-02-28T16:13:29.460 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.678+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 >> 172.21.15.148:0/4127220012 conn(0x7f05180fcdd0 msgr2=0x7f0518071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:29.460 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.678+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 shutdown_connections 2024-02-28T16:13:29.460 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:28.678+0000 7f051e400700 1 -- 172.21.15.148:0/4127220012 wait complete. 2024-02-28T16:13:29.460 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying grafana service with default placement... 2024-02-28T16:13:29.705 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:29 smithi148 ceph-mon[28767]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:29.705 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:29 smithi148 ceph-mon[28767]: Saving service prometheus spec with placement count:1 2024-02-28T16:13:29.705 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:29 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:31.097 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:30 smithi148 ceph-mon[28767]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:31.097 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:30 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.509+0000 7fe41b800700 1 Processor -- start 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.509+0000 7fe41b800700 1 -- start start 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.509+0000 7fe41b800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe4140760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.509+0000 7fe41b800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe414077fc0 con 0x7fe414077bb0 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.510+0000 7fe418e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe4140760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.510+0000 7fe418e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe4140760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56056/0 (socket says 172.21.15.148:56056) 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.510+0000 7fe418e00700 1 -- 172.21.15.148:0/3212441125 learned_addr learned my addr 172.21.15.148:0/3212441125 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:31.479 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.510+0000 7fe418e00700 1 -- 172.21.15.148:0/3212441125 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414076600 con 0x7fe414077bb0 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.511+0000 7fe418e00700 1 --2- 172.21.15.148:0/3212441125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe4140760c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4080098e0 tx=0x7fe408009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56559bbac39998b server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.511+0000 7fe413400700 1 -- 172.21.15.148:0/3212441125 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe40800b860 con 0x7fe414077bb0 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.511+0000 7fe413400700 1 -- 172.21.15.148:0/3212441125 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe40800be90 con 0x7fe414077bb0 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.511+0000 7fe413400700 1 -- 172.21.15.148:0/3212441125 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4080103c0 con 0x7fe414077bb0 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.512+0000 7fe41b800700 1 -- 172.21.15.148:0/3212441125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 msgr2=0x7fe4140760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.512+0000 7fe41b800700 1 --2- 172.21.15.148:0/3212441125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe4140760c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe4080098e0 tx=0x7fe408009250 comp rx=0 tx=0).stop 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.512+0000 7fe41b800700 1 -- 172.21.15.148:0/3212441125 shutdown_connections 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.512+0000 7fe41b800700 1 --2- 172.21.15.148:0/3212441125 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe4140760c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.512+0000 7fe41b800700 1 -- 172.21.15.148:0/3212441125 >> 172.21.15.148:0/3212441125 conn(0x7fe4140fded0 msgr2=0x7fe414100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.512+0000 7fe41b800700 1 -- 172.21.15.148:0/3212441125 shutdown_connections 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.512+0000 7fe41b800700 1 -- 172.21.15.148:0/3212441125 wait complete. 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.513+0000 7fe41b800700 1 Processor -- start 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.513+0000 7fe41b800700 1 -- start start 2024-02-28T16:13:31.480 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.513+0000 7fe41b800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe414102690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.513+0000 7fe41b800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe414102bd0 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.514+0000 7fe418e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe414102690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.514+0000 7fe418e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe414102690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56068/0 (socket says 172.21.15.148:56068) 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.514+0000 7fe418e00700 1 -- 172.21.15.148:0/522606115 learned_addr learned my addr 172.21.15.148:0/522606115 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.514+0000 7fe418e00700 1 -- 172.21.15.148:0/522606115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080094f0 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.515+0000 7fe418e00700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe414102690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4080090b0 tx=0x7fe408009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.515+0000 7fe410c00700 1 -- 172.21.15.148:0/522606115 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4080118f0 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.515+0000 7fe410c00700 1 -- 172.21.15.148:0/522606115 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe408010d10 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.515+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe414102dd0 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.515+0000 7fe410c00700 1 -- 172.21.15.148:0/522606115 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe408024e70 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.515+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe414103260 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.516+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41404bed0 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.516+0000 7fe410c00700 1 -- 172.21.15.148:0/522606115 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fe408010840 con 0x7fe414077bb0 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.517+0000 7fe410c00700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fe3fc036790 0x7fe3fc038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:31.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.517+0000 7fe410c00700 1 -- 172.21.15.148:0/522606115 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe40804a5a0 con 0x7fe414077bb0 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.517+0000 7fe413e00700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fe3fc036790 0x7fe3fc038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.518+0000 7fe413e00700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fe3fc036790 0x7fe3fc038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe400009990 tx=0x7fe400006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.522+0000 7fe410c00700 1 -- 172.21.15.148:0/522606115 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe408022520 con 0x7fe414077bb0 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.749+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fe414103b80 con 0x7fe3fc036790 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.756+0000 7fe410c00700 1 -- 172.21.15.148:0/522606115 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fe414103b80 con 0x7fe3fc036790 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.758+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fe3fc036790 msgr2=0x7fe3fc038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.758+0000 7fe41b800700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fe3fc036790 0x7fe3fc038c40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe400009990 tx=0x7fe400006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.758+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 msgr2=0x7fe414102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.758+0000 7fe41b800700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe414102690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe4080090b0 tx=0x7fe408009250 comp rx=0 tx=0).stop 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.758+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 shutdown_connections 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.758+0000 7fe41b800700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fe3fc036790 0x7fe3fc038c40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.759+0000 7fe41b800700 1 --2- 172.21.15.148:0/522606115 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe414077bb0 0x7fe414102690 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.759+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 >> 172.21.15.148:0/522606115 conn(0x7fe4140fded0 msgr2=0x7fe414100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.759+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 shutdown_connections 2024-02-28T16:13:31.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:30.759+0000 7fe41b800700 1 -- 172.21.15.148:0/522606115 wait complete. 2024-02-28T16:13:31.483 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying node-exporter service with default placement... 2024-02-28T16:13:32.095 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:31 smithi148 ceph-mon[28767]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:32.095 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:31 smithi148 ceph-mon[28767]: Saving service grafana spec with placement count:1 2024-02-28T16:13:32.095 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:31 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:32.095 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:31 smithi148 ceph-mon[28767]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:33.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:32 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:33.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:32 smithi148 ceph-mon[28767]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:33.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:32 smithi148 ceph-mon[28767]: Saving service node-exporter spec with placement * 2024-02-28T16:13:33.091 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:32 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:33.101 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-28T16:13:33.102 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.115+0000 7fb80a800700 1 Processor -- start 2024-02-28T16:13:33.102 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.115+0000 7fb80a800700 1 -- start start 2024-02-28T16:13:33.102 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.115+0000 7fb80a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb8040760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:33.103 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.116+0000 7fb80a800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804077fc0 con 0x7fb804077bb0 2024-02-28T16:13:33.103 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.116+0000 7fb803400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb8040760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:33.103 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.116+0000 7fb803400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb8040760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33552/0 (socket says 172.21.15.148:33552) 2024-02-28T16:13:33.103 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.116+0000 7fb803400700 1 -- 172.21.15.148:0/1754320106 learned_addr learned my addr 172.21.15.148:0/1754320106 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:33.103 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.116+0000 7fb803400700 1 -- 172.21.15.148:0/1754320106 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804076600 con 0x7fb804077bb0 2024-02-28T16:13:33.103 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.117+0000 7fb803400700 1 --2- 172.21.15.148:0/1754320106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb8040760c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098e0 tx=0x7fb7f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f637f8cad0819a60 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:33.104 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.117+0000 7fb802000700 1 -- 172.21.15.148:0/1754320106 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7f400b860 con 0x7fb804077bb0 2024-02-28T16:13:33.104 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.117+0000 7fb802000700 1 -- 172.21.15.148:0/1754320106 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7f400be90 con 0x7fb804077bb0 2024-02-28T16:13:33.104 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.117+0000 7fb802000700 1 -- 172.21.15.148:0/1754320106 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7f40103c0 con 0x7fb804077bb0 2024-02-28T16:13:33.104 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.118+0000 7fb80a800700 1 -- 172.21.15.148:0/1754320106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 msgr2=0x7fb8040760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:33.104 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.118+0000 7fb80a800700 1 --2- 172.21.15.148:0/1754320106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb8040760c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098e0 tx=0x7fb7f4009250 comp rx=0 tx=0).stop 2024-02-28T16:13:33.105 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.118+0000 7fb80a800700 1 -- 172.21.15.148:0/1754320106 shutdown_connections 2024-02-28T16:13:33.105 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.118+0000 7fb80a800700 1 --2- 172.21.15.148:0/1754320106 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb8040760c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:33.105 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.118+0000 7fb80a800700 1 -- 172.21.15.148:0/1754320106 >> 172.21.15.148:0/1754320106 conn(0x7fb8040fded0 msgr2=0x7fb804100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:33.106 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.118+0000 7fb80a800700 1 -- 172.21.15.148:0/1754320106 shutdown_connections 2024-02-28T16:13:33.106 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.118+0000 7fb80a800700 1 -- 172.21.15.148:0/1754320106 wait complete. 2024-02-28T16:13:33.106 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.119+0000 7fb80a800700 1 Processor -- start 2024-02-28T16:13:33.106 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.119+0000 7fb80a800700 1 -- start start 2024-02-28T16:13:33.106 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.119+0000 7fb80a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb804113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:33.107 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.119+0000 7fb80a800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb804113fc0 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.120+0000 7fb803400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb804113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.120+0000 7fb803400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb804113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33558/0 (socket says 172.21.15.148:33558) 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.120+0000 7fb803400700 1 -- 172.21.15.148:0/2944847818 learned_addr learned my addr 172.21.15.148:0/2944847818 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.120+0000 7fb803400700 1 -- 172.21.15.148:0/2944847818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40094f0 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.120+0000 7fb803400700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb804113a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40090b0 tx=0x7fb7f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.121+0000 7fb7fb400700 1 -- 172.21.15.148:0/2944847818 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7f40118f0 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.121+0000 7fb7fb400700 1 -- 172.21.15.148:0/2944847818 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7f4010d10 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.121+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8041141c0 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.121+0000 7fb7fb400700 1 -- 172.21.15.148:0/2944847818 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7f4024e70 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.121+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb804114e60 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.122+0000 7fb7fb400700 1 -- 172.21.15.148:0/2944847818 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7fb7f401a5b0 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.122+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80405f5c0 con 0x7fb804077bb0 2024-02-28T16:13:33.110 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.122+0000 7fb7fb400700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb7e8036740 0x7fb7e8038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.122+0000 7fb7fb400700 1 -- 172.21.15.148:0/2944847818 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb7f404a680 con 0x7fb804077bb0 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.123+0000 7fb802a00700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb7e8036740 0x7fb7e8038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.123+0000 7fb802a00700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb7e8036740 0x7fb7e8038bf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009990 tx=0x7fb7f0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.132+0000 7fb7fb400700 1 -- 172.21.15.148:0/2944847818 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb7f4018350 con 0x7fb804077bb0 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.360+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fb804108bc0 con 0x7fb7e8036740 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.368+0000 7fb7fb400700 1 -- 172.21.15.148:0/2944847818 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb804108bc0 con 0x7fb7e8036740 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb7e8036740 msgr2=0x7fb7e8038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb7e8036740 0x7fb7e8038bf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009990 tx=0x7fb7f0006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 msgr2=0x7fb804113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb804113a80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40090b0 tx=0x7fb7f4009250 comp rx=0 tx=0).stop 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 shutdown_connections 2024-02-28T16:13:33.111 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fb7e8036740 0x7fb7e8038bf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:33.112 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 --2- 172.21.15.148:0/2944847818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb804077bb0 0x7fb804113a80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:33.112 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 >> 172.21.15.148:0/2944847818 conn(0x7fb8040fded0 msgr2=0x7fb804100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:33.112 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 shutdown_connections 2024-02-28T16:13:33.112 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:32.371+0000 7fb80a800700 1 -- 172.21.15.148:0/2944847818 wait complete. 2024-02-28T16:13:33.113 INFO:teuthology.orchestra.run.smithi148.stdout:Deploying alertmanager service with default placement... 2024-02-28T16:13:33.954 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:33 smithi148 ceph-mon[28767]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:35.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-28T16:13:35.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.043+0000 7f1d81800700 1 Processor -- start 2024-02-28T16:13:35.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.043+0000 7f1d81800700 1 -- start start 2024-02-28T16:13:35.027 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.044+0000 7f1d81800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c104c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.044+0000 7f1d81800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c105140 con 0x7f1d7c1047d0 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.044+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c104c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.044+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c104c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33568/0 (socket says 172.21.15.148:33568) 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.044+0000 7f1d7be00700 1 -- 172.21.15.148:0/2719817398 learned_addr learned my addr 172.21.15.148:0/2719817398 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.045+0000 7f1d7be00700 1 -- 172.21.15.148:0/2719817398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c105280 con 0x7f1d7c1047d0 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.046+0000 7f1d7be00700 1 --2- 172.21.15.148:0/2719817398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c104c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098e0 tx=0x7f1d6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d69a26c0ea6d8b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.046+0000 7f1d7aa00700 1 -- 172.21.15.148:0/2719817398 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6c00b860 con 0x7f1d7c1047d0 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.046+0000 7f1d7aa00700 1 -- 172.21.15.148:0/2719817398 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d6c00be90 con 0x7f1d7c1047d0 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.046+0000 7f1d7aa00700 1 -- 172.21.15.148:0/2719817398 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6c0103c0 con 0x7f1d7c1047d0 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.047+0000 7f1d81800700 1 -- 172.21.15.148:0/2719817398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 msgr2=0x7f1d7c104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.047+0000 7f1d81800700 1 --2- 172.21.15.148:0/2719817398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c104c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098e0 tx=0x7f1d6c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.047+0000 7f1d81800700 1 -- 172.21.15.148:0/2719817398 shutdown_connections 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.047+0000 7f1d81800700 1 --2- 172.21.15.148:0/2719817398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c104c00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:35.028 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.047+0000 7f1d81800700 1 -- 172.21.15.148:0/2719817398 >> 172.21.15.148:0/2719817398 conn(0x7f1d7c077d50 msgr2=0x7f1d7c078170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.047+0000 7f1d81800700 1 -- 172.21.15.148:0/2719817398 shutdown_connections 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.047+0000 7f1d81800700 1 -- 172.21.15.148:0/2719817398 wait complete. 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.048+0000 7f1d81800700 1 Processor -- start 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.048+0000 7f1d81800700 1 -- start start 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.048+0000 7f1d81800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c1135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.048+0000 7f1d81800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c113af0 con 0x7f1d7c1047d0 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.048+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c1135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.049+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c1135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33576/0 (socket says 172.21.15.148:33576) 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.049+0000 7f1d7be00700 1 -- 172.21.15.148:0/816311294 learned_addr learned my addr 172.21.15.148:0/816311294 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.049+0000 7f1d7be00700 1 -- 172.21.15.148:0/816311294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0094f0 con 0x7f1d7c1047d0 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.049+0000 7f1d7be00700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c1135b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0090b0 tx=0x7f1d6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.049+0000 7f1d73e00700 1 -- 172.21.15.148:0/816311294 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6c0118f0 con 0x7f1d7c1047d0 2024-02-28T16:13:35.029 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.049+0000 7f1d73e00700 1 -- 172.21.15.148:0/816311294 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d6c010d10 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.050+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c113cf0 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.050+0000 7f1d73e00700 1 -- 172.21.15.148:0/816311294 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d6c0193c0 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.050+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c114990 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.051+0000 7f1d73e00700 1 -- 172.21.15.148:0/816311294 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f1d6c010840 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.051+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c05f5c0 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.051+0000 7f1d73e00700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f1d60036790 0x7f1d60038c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.051+0000 7f1d73e00700 1 -- 172.21.15.148:0/816311294 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1d6c04a740 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.051+0000 7f1d7b400700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f1d60036790 0x7f1d60038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.052+0000 7f1d7b400700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f1d60036790 0x7f1d60038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009990 tx=0x7f1d64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.056+0000 7f1d73e00700 1 -- 172.21.15.148:0/816311294 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1d6c01a430 con 0x7f1d7c1047d0 2024-02-28T16:13:35.030 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.277+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d7c103c50 con 0x7f1d60036790 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.288+0000 7f1d73e00700 1 -- 172.21.15.148:0/816311294 <== mgr.14120 v2:172.21.15.148:6800/1096845265 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f1d7c103c50 con 0x7f1d60036790 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f1d60036790 msgr2=0x7f1d60038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f1d60036790 0x7f1d60038c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009990 tx=0x7f1d64006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 msgr2=0x7f1d7c1135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c1135b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0090b0 tx=0x7f1d6c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 shutdown_connections 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f1d60036790 0x7f1d60038c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 --2- 172.21.15.148:0/816311294 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d7c1047d0 0x7f1d7c1135b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.290+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 >> 172.21.15.148:0/816311294 conn(0x7f1d7c077d50 msgr2=0x7f1d7c103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.291+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 shutdown_connections 2024-02-28T16:13:35.031 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:34.291+0000 7f1d81800700 1 -- 172.21.15.148:0/816311294 wait complete. 2024-02-28T16:13:35.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:35 smithi148 ceph-mon[28767]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:35.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:35 smithi148 ceph-mon[28767]: Saving service alertmanager spec with placement count:1 2024-02-28T16:13:35.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:35 smithi148 ceph-mon[28767]: from='mgr.14120 172.21.15.148:0/3029015232' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:36 smithi148 ceph-mon[28767]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:36 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1100583729' entity='client.admin' 2024-02-28T16:13:37.055 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.147+0000 7f9169600700 1 Processor -- start 2024-02-28T16:13:37.055 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.147+0000 7f9169600700 1 -- start start 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.147+0000 7f9169600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164104190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.147+0000 7f9169600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91641046d0 con 0x7f9164103d80 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.148+0000 7f9162a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164104190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.148+0000 7f9162a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164104190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33586/0 (socket says 172.21.15.148:33586) 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.148+0000 7f9162a00700 1 -- 172.21.15.148:0/3855836923 learned_addr learned my addr 172.21.15.148:0/3855836923 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.148+0000 7f9162a00700 1 -- 172.21.15.148:0/3855836923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164104810 con 0x7f9164103d80 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.149+0000 7f9162a00700 1 --2- 172.21.15.148:0/3855836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164104190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91540098e0 tx=0x7f9154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c250e71b91bf87b server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.149+0000 7f9161600700 1 -- 172.21.15.148:0/3855836923 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f915400b860 con 0x7f9164103d80 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.149+0000 7f9161600700 1 -- 172.21.15.148:0/3855836923 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f915400be90 con 0x7f9164103d80 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.149+0000 7f9161600700 1 -- 172.21.15.148:0/3855836923 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91540103c0 con 0x7f9164103d80 2024-02-28T16:13:37.056 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.150+0000 7f9169600700 1 -- 172.21.15.148:0/3855836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 msgr2=0x7f9164104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.150+0000 7f9169600700 1 --2- 172.21.15.148:0/3855836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164104190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f91540098e0 tx=0x7f9154009250 comp rx=0 tx=0).stop 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.150+0000 7f9169600700 1 -- 172.21.15.148:0/3855836923 shutdown_connections 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.150+0000 7f9169600700 1 --2- 172.21.15.148:0/3855836923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164104190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.150+0000 7f9169600700 1 -- 172.21.15.148:0/3855836923 >> 172.21.15.148:0/3855836923 conn(0x7f91640fc580 msgr2=0x7f91640fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.150+0000 7f9169600700 1 -- 172.21.15.148:0/3855836923 shutdown_connections 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.150+0000 7f9169600700 1 -- 172.21.15.148:0/3855836923 wait complete. 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.151+0000 7f9169600700 1 Processor -- start 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.151+0000 7f9169600700 1 -- start start 2024-02-28T16:13:37.061 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.151+0000 7f9169600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.151+0000 7f9169600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9164113fb0 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.152+0000 7f9162a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.152+0000 7f9162a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33594/0 (socket says 172.21.15.148:33594) 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.152+0000 7f9162a00700 1 -- 172.21.15.148:0/1100583729 learned_addr learned my addr 172.21.15.148:0/1100583729 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.152+0000 7f9162a00700 1 -- 172.21.15.148:0/1100583729 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540094f0 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.152+0000 7f9162a00700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164113a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9154011650 tx=0x7f9154009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.153+0000 7f915aa00700 1 -- 172.21.15.148:0/1100583729 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9154010890 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.153+0000 7f915aa00700 1 -- 172.21.15.148:0/1100583729 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9154010ec0 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.153+0000 7f915aa00700 1 -- 172.21.15.148:0/1100583729 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f915401a430 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.153+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91641141b0 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.153+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9164114e50 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.154+0000 7f915aa00700 1 -- 172.21.15.148:0/1100583729 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f91540247a0 con 0x7f9164103d80 2024-02-28T16:13:37.062 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.154+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916405f5c0 con 0x7f9164103d80 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.154+0000 7f915aa00700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f91480367e0 0x7f9148038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.154+0000 7f915aa00700 1 -- 172.21.15.148:0/1100583729 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f915404a580 con 0x7f9164103d80 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.155+0000 7f9162000700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f91480367e0 0x7f9148038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.155+0000 7f9162000700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f91480367e0 0x7f9148038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9150009990 tx=0x7f9150006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.160+0000 7f915aa00700 1 -- 172.21.15.148:0/1100583729 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9154022900 con 0x7f9164103d80 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.368+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f9164101390 con 0x7f9164103d80 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.377+0000 7f915aa00700 1 -- 172.21.15.148:0/1100583729 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f9154022330 con 0x7f9164103d80 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f91480367e0 msgr2=0x7f9148038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f91480367e0 0x7f9148038c90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9150009990 tx=0x7f9150006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 msgr2=0x7f9164113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164113a70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9154011650 tx=0x7f9154009250 comp rx=0 tx=0).stop 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 shutdown_connections 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f91480367e0 0x7f9148038c90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:37.063 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 --2- 172.21.15.148:0/1100583729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9164103d80 0x7f9164113a70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:37.064 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.379+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 >> 172.21.15.148:0/1100583729 conn(0x7f91640fc580 msgr2=0x7f91640fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:37.064 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.380+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 shutdown_connections 2024-02-28T16:13:37.064 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:36.380+0000 7f9169600700 1 -- 172.21.15.148:0/1100583729 wait complete. 2024-02-28T16:13:38.513 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.633+0000 7f9682c00700 1 Processor -- start 2024-02-28T16:13:38.513 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.633+0000 7f9682c00700 1 -- start start 2024-02-28T16:13:38.513 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.634+0000 7f9682c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c104d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:38.513 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.634+0000 7f9682c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c1052b0 con 0x7f967c104960 2024-02-28T16:13:38.513 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.634+0000 7f967be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:38.517 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.634+0000 7f967be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c104d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33598/0 (socket says 172.21.15.148:33598) 2024-02-28T16:13:38.517 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.634+0000 7f967be00700 1 -- 172.21.15.148:0/1403929082 learned_addr learned my addr 172.21.15.148:0/1403929082 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:38.517 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.634+0000 7f967be00700 1 -- 172.21.15.148:0/1403929082 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c1053f0 con 0x7f967c104960 2024-02-28T16:13:38.517 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.635+0000 7f967be00700 1 --2- 172.21.15.148:0/1403929082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c104d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f966c0098e0 tx=0x7f966c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f751cbde5ac931 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:38.517 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.635+0000 7f967aa00700 1 -- 172.21.15.148:0/1403929082 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f966c00b860 con 0x7f967c104960 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.635+0000 7f967aa00700 1 -- 172.21.15.148:0/1403929082 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f966c00be90 con 0x7f967c104960 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.635+0000 7f967aa00700 1 -- 172.21.15.148:0/1403929082 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f966c0103c0 con 0x7f967c104960 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.636+0000 7f9682c00700 1 -- 172.21.15.148:0/1403929082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 msgr2=0x7f967c104d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.636+0000 7f9682c00700 1 --2- 172.21.15.148:0/1403929082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c104d70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f966c0098e0 tx=0x7f966c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.636+0000 7f9682c00700 1 -- 172.21.15.148:0/1403929082 shutdown_connections 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.636+0000 7f9682c00700 1 --2- 172.21.15.148:0/1403929082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c104d70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.636+0000 7f9682c00700 1 -- 172.21.15.148:0/1403929082 >> 172.21.15.148:0/1403929082 conn(0x7f967c100340 msgr2=0x7f967c102720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.636+0000 7f9682c00700 1 -- 172.21.15.148:0/1403929082 shutdown_connections 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.636+0000 7f9682c00700 1 -- 172.21.15.148:0/1403929082 wait complete. 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.637+0000 7f9682c00700 1 Processor -- start 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.637+0000 7f9682c00700 1 -- start start 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.637+0000 7f9682c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.637+0000 7f9682c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967c113fb0 con 0x7f967c104960 2024-02-28T16:13:38.518 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.637+0000 7f967be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f967be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33610/0 (socket says 172.21.15.148:33610) 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f967be00700 1 -- 172.21.15.148:0/3838700041 learned_addr learned my addr 172.21.15.148:0/3838700041 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f967be00700 1 -- 172.21.15.148:0/3838700041 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0094f0 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f967be00700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c113a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f966c006b00 tx=0x7f966c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f9673e00700 1 -- 172.21.15.148:0/3838700041 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f966c0109a0 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f9673e00700 1 -- 172.21.15.148:0/3838700041 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f966c01a430 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f9673e00700 1 -- 172.21.15.148:0/3838700041 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f966c0245b0 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.638+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967c1141b0 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.639+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967c114e50 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.640+0000 7f9673e00700 1 -- 172.21.15.148:0/3838700041 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7f966c01aaa0 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.640+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967c05f5c0 con 0x7f967c104960 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.640+0000 7f9673e00700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f96600367e0 0x7f9660038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:38.519 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.640+0000 7f9673e00700 1 -- 172.21.15.148:0/3838700041 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f966c04a740 con 0x7f967c104960 2024-02-28T16:13:38.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.640+0000 7f967b400700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f96600367e0 0x7f9660038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:38.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.641+0000 7f967b400700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f96600367e0 0x7f9660038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9668009990 tx=0x7f9668006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:38.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.645+0000 7f9673e00700 1 -- 172.21.15.148:0/3838700041 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f966c018940 con 0x7f967c104960 2024-02-28T16:13:38.521 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.852+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f967c1068b0 con 0x7f967c104960 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.860+0000 7f9673e00700 1 -- 172.21.15.148:0/3838700041 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f966c018350 con 0x7f967c104960 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f96600367e0 msgr2=0x7f9660038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f96600367e0 0x7f9660038c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9668009990 tx=0x7f9668006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 msgr2=0x7f967c113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c113a70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f966c006b00 tx=0x7f966c009250 comp rx=0 tx=0).stop 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 shutdown_connections 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f96600367e0 0x7f9660038c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 --2- 172.21.15.148:0/3838700041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f967c104960 0x7f967c113a70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 >> 172.21.15.148:0/3838700041 conn(0x7f967c100340 msgr2=0x7f967c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 shutdown_connections 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:37.863+0000 7f9682c00700 1 -- 172.21.15.148:0/3838700041 wait complete. 2024-02-28T16:13:38.522 INFO:teuthology.orchestra.run.smithi148.stdout:Enabling the dashboard module... 2024-02-28T16:13:38.815 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:38 smithi148 ceph-mon[28767]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:13:38.815 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:38 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3838700041' entity='client.admin' 2024-02-28T16:13:39.674 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:39 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3365344749' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-28T16:13:40.279 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.110+0000 7ff869600700 1 Processor -- start 2024-02-28T16:13:40.279 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.110+0000 7ff869600700 1 -- start start 2024-02-28T16:13:40.279 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.111+0000 7ff869600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.111+0000 7ff869600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8641030d0 con 0x7ff864102780 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.111+0000 7ff862a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.111+0000 7ff862a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33622/0 (socket says 172.21.15.148:33622) 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.111+0000 7ff862a00700 1 -- 172.21.15.148:0/3605300722 learned_addr learned my addr 172.21.15.148:0/3605300722 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.112+0000 7ff862a00700 1 -- 172.21.15.148:0/3605300722 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864103210 con 0x7ff864102780 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.112+0000 7ff862a00700 1 --2- 172.21.15.148:0/3605300722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864102b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098e0 tx=0x7ff854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac4852a0cf5c8e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.112+0000 7ff861600700 1 -- 172.21.15.148:0/3605300722 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff85400b860 con 0x7ff864102780 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.112+0000 7ff861600700 1 -- 172.21.15.148:0/3605300722 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff85400be90 con 0x7ff864102780 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.112+0000 7ff861600700 1 -- 172.21.15.148:0/3605300722 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8540103c0 con 0x7ff864102780 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.113+0000 7ff869600700 1 -- 172.21.15.148:0/3605300722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 msgr2=0x7ff864102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.113+0000 7ff869600700 1 --2- 172.21.15.148:0/3605300722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864102b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8540098e0 tx=0x7ff854009250 comp rx=0 tx=0).stop 2024-02-28T16:13:40.280 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.113+0000 7ff869600700 1 -- 172.21.15.148:0/3605300722 shutdown_connections 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.113+0000 7ff869600700 1 --2- 172.21.15.148:0/3605300722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864102b90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.113+0000 7ff869600700 1 -- 172.21.15.148:0/3605300722 >> 172.21.15.148:0/3605300722 conn(0x7ff8640fdf00 msgr2=0x7ff864100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.113+0000 7ff869600700 1 -- 172.21.15.148:0/3605300722 shutdown_connections 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.113+0000 7ff869600700 1 -- 172.21.15.148:0/3605300722 wait complete. 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.114+0000 7ff869600700 1 Processor -- start 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.114+0000 7ff869600700 1 -- start start 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.115+0000 7ff869600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.115+0000 7ff869600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff864111ad0 con 0x7ff864102780 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.115+0000 7ff862a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.115+0000 7ff862a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33628/0 (socket says 172.21.15.148:33628) 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.115+0000 7ff862a00700 1 -- 172.21.15.148:0/3365344749 learned_addr learned my addr 172.21.15.148:0/3365344749 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.115+0000 7ff862a00700 1 -- 172.21.15.148:0/3365344749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540094f0 con 0x7ff864102780 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.116+0000 7ff862a00700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864111590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8540090b0 tx=0x7ff854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.116+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff854010840 con 0x7ff864102780 2024-02-28T16:13:40.281 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.116+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff854010e70 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.116+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff854024e40 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.116+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff864111cd0 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.116+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff864112970 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.117+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 8) v1 ==== 43368+0+0 (secure 0 0 0) 0x7ff8540109a0 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.117+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86405f5c0 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.117+0000 7ff85aa00700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ff848036740 0x7ff848038bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.118+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff85404a790 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.118+0000 7ff862000700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ff848036740 0x7ff848038bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.118+0000 7ff862000700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ff848036740 0x7ff848038bf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff850009990 tx=0x7ff850006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.123+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff85402c520 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.384+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ff86404bed0 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.597+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7ff85402e440 con 0x7ff864102780 2024-02-28T16:13:40.282 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.600+0000 7ff85aa00700 1 -- 172.21.15.148:0/3365344749 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ff85400f8b0 con 0x7ff864102780 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ff848036740 msgr2=0x7ff848038bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ff848036740 0x7ff848038bf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff850009990 tx=0x7ff850006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 msgr2=0x7ff864111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864111590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff8540090b0 tx=0x7ff854009250 comp rx=0 tx=0).stop 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 shutdown_connections 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7ff848036740 0x7ff848038bf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 --2- 172.21.15.148:0/3365344749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff864102780 0x7ff864111590 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 >> 172.21.15.148:0/3365344749 conn(0x7ff8640fdf00 msgr2=0x7ff8640fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 shutdown_connections 2024-02-28T16:13:40.283 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:39.604+0000 7ff869600700 1 -- 172.21.15.148:0/3365344749 wait complete. 2024-02-28T16:13:40.871 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:40 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3365344749' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-28T16:13:40.871 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:40 smithi148 ceph-mon[28767]: mgrmap e9: smithi148.gelspy(active, since 30s) 2024-02-28T16:13:41.796 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:41 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/929432290' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "active_name": "smithi148.gelspy", 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.879+0000 7f77d7000700 1 Processor -- start 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.879+0000 7f77d7000700 1 -- start start 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.880+0000 7f77d7000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d0101a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.880+0000 7f77d7000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0101fc0 con 0x7f77d0101670 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.880+0000 7f77cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d0101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.880+0000 7f77cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d0101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33660/0 (socket says 172.21.15.148:33660) 2024-02-28T16:13:41.850 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.880+0000 7f77cfe00700 1 -- 172.21.15.148:0/1712708451 learned_addr learned my addr 172.21.15.148:0/1712708451 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.881+0000 7f77cfe00700 1 -- 172.21.15.148:0/1712708451 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0102100 con 0x7f77d0101670 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.881+0000 7f77cfe00700 1 --2- 172.21.15.148:0/1712708451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d0101a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77c00098e0 tx=0x7f77c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117529e2804d5688 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.881+0000 7f77cea00700 1 -- 172.21.15.148:0/1712708451 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c000b860 con 0x7f77d0101670 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.881+0000 7f77cea00700 1 -- 172.21.15.148:0/1712708451 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77c000be90 con 0x7f77d0101670 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.881+0000 7f77cea00700 1 -- 172.21.15.148:0/1712708451 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c00103c0 con 0x7f77d0101670 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.882+0000 7f77d7000700 1 -- 172.21.15.148:0/1712708451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 msgr2=0x7f77d0101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.882+0000 7f77d7000700 1 --2- 172.21.15.148:0/1712708451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d0101a80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f77c00098e0 tx=0x7f77c0009250 comp rx=0 tx=0).stop 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.882+0000 7f77d7000700 1 -- 172.21.15.148:0/1712708451 shutdown_connections 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.882+0000 7f77d7000700 1 --2- 172.21.15.148:0/1712708451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d0101a80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.882+0000 7f77d7000700 1 -- 172.21.15.148:0/1712708451 >> 172.21.15.148:0/1712708451 conn(0x7f77d00fcdd0 msgr2=0x7f77d00ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.883+0000 7f77d7000700 1 -- 172.21.15.148:0/1712708451 shutdown_connections 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.883+0000 7f77d7000700 1 -- 172.21.15.148:0/1712708451 wait complete. 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.883+0000 7f77d7000700 1 Processor -- start 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.883+0000 7f77d7000700 1 -- start start 2024-02-28T16:13:41.851 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.884+0000 7f77d7000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d01137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.884+0000 7f77d7000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0113ce0 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.884+0000 7f77cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d01137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.884+0000 7f77cfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d01137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33662/0 (socket says 172.21.15.148:33662) 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.884+0000 7f77cfe00700 1 -- 172.21.15.148:0/929432290 learned_addr learned my addr 172.21.15.148:0/929432290 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.884+0000 7f77cfe00700 1 -- 172.21.15.148:0/929432290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c00094f0 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.885+0000 7f77cfe00700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d01137a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77c00090b0 tx=0x7f77c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.885+0000 7f77c7e00700 1 -- 172.21.15.148:0/929432290 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c0010840 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.885+0000 7f77c7e00700 1 -- 172.21.15.148:0/929432290 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77c0010e70 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.885+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d0113ee0 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.885+0000 7f77c7e00700 1 -- 172.21.15.148:0/929432290 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f77c0024e40 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.885+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d0114b80 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.886+0000 7f77c7e00700 1 -- 172.21.15.148:0/929432290 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f77c001a4c0 con 0x7f77d0101670 2024-02-28T16:13:41.852 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.886+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d005f5c0 con 0x7f77d0101670 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.887+0000 7f77c7e00700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 0x7f77b4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.887+0000 7f77c7e00700 1 -- 172.21.15.148:0/929432290 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f77c004a880 con 0x7f77d0101670 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.887+0000 7f77cf400700 1 -- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 msgr2=0x7f77b4038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1096845265 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.887+0000 7f77cf400700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 0x7f77b4038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:40.892+0000 7f77c7e00700 1 -- 172.21.15.148:0/929432290 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f77c0018940 con 0x7f77d0101670 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.088+0000 7f77cf400700 1 -- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 msgr2=0x7f77b4038c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1096845265 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.088+0000 7f77cf400700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 0x7f77b4038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.159+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f77d0114f20 con 0x7f77d0101670 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.160+0000 7f77c7e00700 1 -- 172.21.15.148:0/929432290 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f77c0018350 con 0x7f77d0101670 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 msgr2=0x7f77b4038c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 0x7f77b4038c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 msgr2=0x7f77d01137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d01137a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f77c00090b0 tx=0x7f77c0009250 comp rx=0 tx=0).stop 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 shutdown_connections 2024-02-28T16:13:41.853 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7f77b40367e0 0x7f77b4038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:41.854 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 --2- 172.21.15.148:0/929432290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d0101670 0x7f77d01137a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:41.854 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 >> 172.21.15.148:0/929432290 conn(0x7f77d00fcdd0 msgr2=0x7f77d0071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:41.854 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 shutdown_connections 2024-02-28T16:13:41.854 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:41.163+0000 7f77d7000700 1 -- 172.21.15.148:0/929432290 wait complete. 2024-02-28T16:13:41.854 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for the mgr to restart... 2024-02-28T16:13:41.854 INFO:teuthology.orchestra.run.smithi148.stdout:Waiting for mgr epoch 9... 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: Active manager daemon smithi148.gelspy restarted 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: Activating manager daemon smithi148.gelspy 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: osdmap e3: 0 total, 0 up, 0 in 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: mgrmap e10: smithi148.gelspy(active, starting, since 0.00824727s) 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:13:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:13:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:13:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:13:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:48 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:13:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:49 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:13:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:49 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:13:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:49 smithi148 ceph-mon[28767]: [28/Feb/2024:16:13:48] ENGINE Bus STARTING 2024-02-28T16:13:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:49 smithi148 ceph-mon[28767]: [28/Feb/2024:16:13:48] ENGINE Serving on https://172.21.15.148:7150 2024-02-28T16:13:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:49 smithi148 ceph-mon[28767]: [28/Feb/2024:16:13:48] ENGINE Bus STARTED 2024-02-28T16:13:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:49 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:49 smithi148 ceph-mon[28767]: mgrmap e11: smithi148.gelspy(active, since 1.0106s) 2024-02-28T16:13:50.607 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout { 2024-02-28T16:13:50.614 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-28T16:13:50.614 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout } 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.377+0000 7fa967400700 1 Processor -- start 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.377+0000 7fa967400700 1 -- start start 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.378+0000 7fa967400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960102b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.378+0000 7fa967400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9601030c0 con 0x7fa960102770 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.378+0000 7fa964a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.378+0000 7fa964a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960102b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58492/0 (socket says 172.21.15.148:58492) 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.378+0000 7fa964a00700 1 -- 172.21.15.148:0/3459860799 learned_addr learned my addr 172.21.15.148:0/3459860799 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.378+0000 7fa964a00700 1 -- 172.21.15.148:0/3459860799 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960103200 con 0x7fa960102770 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.379+0000 7fa964a00700 1 --2- 172.21.15.148:0/3459860799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960102b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9540098e0 tx=0x7fa954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18c113ddf532dc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.379+0000 7fa95f400700 1 -- 172.21.15.148:0/3459860799 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa95400b860 con 0x7fa960102770 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.379+0000 7fa95f400700 1 -- 172.21.15.148:0/3459860799 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa95400be90 con 0x7fa960102770 2024-02-28T16:13:50.615 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.379+0000 7fa95f400700 1 -- 172.21.15.148:0/3459860799 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9540103c0 con 0x7fa960102770 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.380+0000 7fa967400700 1 -- 172.21.15.148:0/3459860799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 msgr2=0x7fa960102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.380+0000 7fa967400700 1 --2- 172.21.15.148:0/3459860799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960102b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa9540098e0 tx=0x7fa954009250 comp rx=0 tx=0).stop 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.380+0000 7fa967400700 1 -- 172.21.15.148:0/3459860799 shutdown_connections 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.380+0000 7fa967400700 1 --2- 172.21.15.148:0/3459860799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960102b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.380+0000 7fa967400700 1 -- 172.21.15.148:0/3459860799 >> 172.21.15.148:0/3459860799 conn(0x7fa9600fded0 msgr2=0x7fa960100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.380+0000 7fa967400700 1 -- 172.21.15.148:0/3459860799 shutdown_connections 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.380+0000 7fa967400700 1 -- 172.21.15.148:0/3459860799 wait complete. 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.381+0000 7fa967400700 1 Processor -- start 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.381+0000 7fa967400700 1 -- start start 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.381+0000 7fa967400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.381+0000 7fa967400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa960113fb0 con 0x7fa960102770 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.382+0000 7fa964a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.382+0000 7fa964a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58508/0 (socket says 172.21.15.148:58508) 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.382+0000 7fa964a00700 1 -- 172.21.15.148:0/3197866949 learned_addr learned my addr 172.21.15.148:0/3197866949 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:50.616 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.382+0000 7fa964a00700 1 -- 172.21.15.148:0/3197866949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540094f0 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.382+0000 7fa964a00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960113a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa954006b00 tx=0x7fa954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.383+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9540109a0 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.383+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa95401a430 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.383+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9540245b0 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.383+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9601141b0 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.383+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa960114e50 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.384+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 9) v1 ==== 43381+0+0 (secure 0 0 0) 0x7fa95401aaa0 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.384+0000 7fa95cc00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.384+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 --> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9480393f0 con 0x7fa948036830 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.384+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa95404a6f0 con 0x7fa960102770 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.385+0000 7fa95fe00700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 msgr2=0x7fa948038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1096845265 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.385+0000 7fa95fe00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.586+0000 7fa95fe00700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 msgr2=0x7fa948038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1096845265 2024-02-28T16:13:50.617 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.586+0000 7fa95fe00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.987+0000 7fa95fe00700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 msgr2=0x7fa948038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1096845265 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:42.987+0000 7fa95fe00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:43.788+0000 7fa95fe00700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 msgr2=0x7fa948038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1096845265 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:43.788+0000 7fa95fe00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:45.389+0000 7fa95fe00700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 msgr2=0x7fa948038ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/1096845265 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:45.389+0000 7fa95fe00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:48.096+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mgrmap(e 10) v1 ==== 43148+0+0 (secure 0 0 0) 0x7fa954010b00 con 0x7fa960102770 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:48.097+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 msgr2=0x7fa948038ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:48.097+0000 7fa95cc00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.096+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 11) v1 ==== 43275+0+0 (secure 0 0 0) 0x7fa95404bfa0 con 0x7fa960102770 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.097+0000 7fa95cc00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa94803a070 0x7fa94803c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.097+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9480393f0 con 0x7fa94803a070 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.099+0000 7fa95fe00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa94803a070 0x7fa94803c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:50.618 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.101+0000 7fa95fe00700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa94803a070 0x7fa94803c450 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0039d0 tx=0x7fa94c009350 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.103+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mgr.14162 v2:172.21.15.148:6800/3553564677 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fa9480393f0 con 0x7fa94803a070 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.110+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa960114640 con 0x7fa94803a070 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.110+0000 7fa95cc00700 1 -- 172.21.15.148:0/3197866949 <== mgr.14162 v2:172.21.15.148:6800/3553564677 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fa960114640 con 0x7fa94803a070 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa94803a070 msgr2=0x7fa94803c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa94803a070 0x7fa94803c450 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0039d0 tx=0x7fa94c009350 comp rx=0 tx=0).stop 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 msgr2=0x7fa960113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960113a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa954006b00 tx=0x7fa954009250 comp rx=0 tx=0).stop 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 shutdown_connections 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa94803a070 0x7fa94803c450 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa960102770 0x7fa960113a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 --2- 172.21.15.148:0/3197866949 >> [v2:172.21.15.148:6800/1096845265,v1:172.21.15.148:6801/1096845265] conn(0x7fa948036830 0x7fa948038ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 >> 172.21.15.148:0/3197866949 conn(0x7fa9600fded0 msgr2=0x7fa9600fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 shutdown_connections 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:49.111+0000 7fa967400700 1 -- 172.21.15.148:0/3197866949 wait complete. 2024-02-28T16:13:50.619 INFO:teuthology.orchestra.run.smithi148.stdout:mgr epoch 9 is available 2024-02-28T16:13:50.620 INFO:teuthology.orchestra.run.smithi148.stdout:Generating a dashboard self-signed certificate... 2024-02-28T16:13:50.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:50 smithi148 ceph-mon[28767]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T16:13:50.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:50 smithi148 ceph-mon[28767]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T16:13:50.768 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:50 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:51.695 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:51 smithi148 ceph-mon[28767]: mgrmap e12: smithi148.gelspy(active, since 2s) 2024-02-28T16:13:52.476 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-28T16:13:52.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.220+0000 7f15aa400700 1 Processor -- start 2024-02-28T16:13:52.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.220+0000 7f15aa400700 1 -- start start 2024-02-28T16:13:52.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.221+0000 7f15aa400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:52.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.221+0000 7f15aa400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4105900 con 0x7f15a4071440 2024-02-28T16:13:52.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.221+0000 7f15a3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:52.481 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.221+0000 7f15a3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58582/0 (socket says 172.21.15.148:58582) 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.221+0000 7f15a3400700 1 -- 172.21.15.148:0/392120561 learned_addr learned my addr 172.21.15.148:0/392120561 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.222+0000 7f15a3400700 1 -- 172.21.15.148:0/392120561 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4105a40 con 0x7f15a4071440 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.222+0000 7f15a3400700 1 --2- 172.21.15.148:0/392120561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41053c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15940098e0 tx=0x7f1594009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e915d2dc8b398a76 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.222+0000 7f15a2000700 1 -- 172.21.15.148:0/392120561 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f159400b860 con 0x7f15a4071440 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15a2000700 1 -- 172.21.15.148:0/392120561 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f159400be90 con 0x7f15a4071440 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15a2000700 1 -- 172.21.15.148:0/392120561 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15940103c0 con 0x7f15a4071440 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15aa400700 1 -- 172.21.15.148:0/392120561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 msgr2=0x7f15a41053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15aa400700 1 --2- 172.21.15.148:0/392120561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41053c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15940098e0 tx=0x7f1594009250 comp rx=0 tx=0).stop 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15aa400700 1 -- 172.21.15.148:0/392120561 shutdown_connections 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15aa400700 1 --2- 172.21.15.148:0/392120561 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41053c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15aa400700 1 -- 172.21.15.148:0/392120561 >> 172.21.15.148:0/392120561 conn(0x7f15a40fcdd0 msgr2=0x7f15a40ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15aa400700 1 -- 172.21.15.148:0/392120561 shutdown_connections 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.223+0000 7f15aa400700 1 -- 172.21.15.148:0/392120561 wait complete. 2024-02-28T16:13:52.482 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.224+0000 7f15aa400700 1 Processor -- start 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.224+0000 7f15aa400700 1 -- start start 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.225+0000 7f15aa400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.225+0000 7f15aa400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a4113cf0 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.225+0000 7f15a3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.225+0000 7f15a3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58592/0 (socket says 172.21.15.148:58592) 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.225+0000 7f15a3400700 1 -- 172.21.15.148:0/3316713174 learned_addr learned my addr 172.21.15.148:0/3316713174 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.226+0000 7f15a3400700 1 -- 172.21.15.148:0/3316713174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940094f0 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.226+0000 7f15a3400700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41137b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1594006d40 tx=0x7f1594009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.226+0000 7f159b400700 1 -- 172.21.15.148:0/3316713174 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1594010840 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.227+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a4113ef0 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.227+0000 7f159b400700 1 -- 172.21.15.148:0/3316713174 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1594010e70 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.227+0000 7f159b400700 1 -- 172.21.15.148:0/3316713174 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1594024ea0 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.227+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a4114b90 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.228+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a405f5c0 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.228+0000 7f159b400700 1 -- 172.21.15.148:0/3316713174 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f1594024780 con 0x7f15a4071440 2024-02-28T16:13:52.483 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.229+0000 7f159b400700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f15880367e0 0x7f1588038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.229+0000 7f159b400700 1 -- 172.21.15.148:0/3316713174 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f159404a7a0 con 0x7f15a4071440 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.229+0000 7f15a2a00700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f15880367e0 0x7f1588038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.230+0000 7f15a2a00700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f15880367e0 0x7f1588038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1590009990 tx=0x7f1590006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.235+0000 7f159b400700 1 -- 172.21.15.148:0/3316713174 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f159402c930 con 0x7f15a4071440 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.452+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f15a40ff090 con 0x7f15880367e0 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.701+0000 7f159b400700 1 -- 172.21.15.148:0/3316713174 <== mgr.14162 v2:172.21.15.148:6800/3553564677 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f15a40ff090 con 0x7f15880367e0 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f15880367e0 msgr2=0x7f1588038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f15880367e0 0x7f1588038c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1590009990 tx=0x7f1590006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 msgr2=0x7f15a41137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41137b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1594006d40 tx=0x7f1594009250 comp rx=0 tx=0).stop 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 shutdown_connections 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f15880367e0 0x7f1588038c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 --2- 172.21.15.148:0/3316713174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f15a4071440 0x7f15a41137b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:52.484 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 >> 172.21.15.148:0/3316713174 conn(0x7f15a40fcdd0 msgr2=0x7f15a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:52.485 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 shutdown_connections 2024-02-28T16:13:52.485 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:51.704+0000 7f15aa400700 1 -- 172.21.15.148:0/3316713174 wait complete. 2024-02-28T16:13:52.485 INFO:teuthology.orchestra.run.smithi148.stdout:Creating initial admin user... 2024-02-28T16:13:52.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:52 smithi148 ceph-mon[28767]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:52.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:52 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:52.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:52 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:52.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:52 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:54.531 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$l/rsZ3SLOn2V3cf96O4Qa.CsqaB6dFHfy5xYl.Nk7HBBqiP6kWKf2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1709136833, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-28T16:13:54.531 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.167+0000 7f68e2e00700 1 Processor -- start 2024-02-28T16:13:54.531 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.167+0000 7f68e2e00700 1 -- start start 2024-02-28T16:13:54.531 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.168+0000 7f68e2e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc105340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:54.531 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.168+0000 7f68e2e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc105880 con 0x7f68dc0714c0 2024-02-28T16:13:54.531 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.168+0000 7f68dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc105340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:54.531 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.168+0000 7f68dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc105340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34510/0 (socket says 172.21.15.148:34510) 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.168+0000 7f68dbe00700 1 -- 172.21.15.148:0/994695907 learned_addr learned my addr 172.21.15.148:0/994695907 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.169+0000 7f68dbe00700 1 -- 172.21.15.148:0/994695907 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68dc1059c0 con 0x7f68dc0714c0 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.170+0000 7f68dbe00700 1 --2- 172.21.15.148:0/994695907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc105340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0098e0 tx=0x7f68cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08ce35fa11760fc server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.170+0000 7f68daa00700 1 -- 172.21.15.148:0/994695907 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68cc00b860 con 0x7f68dc0714c0 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.170+0000 7f68daa00700 1 -- 172.21.15.148:0/994695907 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68cc00be90 con 0x7f68dc0714c0 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.170+0000 7f68daa00700 1 -- 172.21.15.148:0/994695907 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68cc0103c0 con 0x7f68dc0714c0 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.171+0000 7f68e2e00700 1 -- 172.21.15.148:0/994695907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 msgr2=0x7f68dc105340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.171+0000 7f68e2e00700 1 --2- 172.21.15.148:0/994695907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc105340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0098e0 tx=0x7f68cc009250 comp rx=0 tx=0).stop 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.171+0000 7f68e2e00700 1 -- 172.21.15.148:0/994695907 shutdown_connections 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.171+0000 7f68e2e00700 1 --2- 172.21.15.148:0/994695907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc105340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.171+0000 7f68e2e00700 1 -- 172.21.15.148:0/994695907 >> 172.21.15.148:0/994695907 conn(0x7f68dc0fcdd0 msgr2=0x7f68dc0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.171+0000 7f68e2e00700 1 -- 172.21.15.148:0/994695907 shutdown_connections 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.171+0000 7f68e2e00700 1 -- 172.21.15.148:0/994695907 wait complete. 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.172+0000 7f68e2e00700 1 Processor -- start 2024-02-28T16:13:54.532 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.172+0000 7f68e2e00700 1 -- start start 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.172+0000 7f68e2e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc1137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.172+0000 7f68e2e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68dc113d10 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.173+0000 7f68dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc1137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.173+0000 7f68dbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc1137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34514/0 (socket says 172.21.15.148:34514) 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.173+0000 7f68dbe00700 1 -- 172.21.15.148:0/3830262934 learned_addr learned my addr 172.21.15.148:0/3830262934 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.173+0000 7f68dbe00700 1 -- 172.21.15.148:0/3830262934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc0094f0 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.173+0000 7f68dbe00700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc1137d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68cc006d40 tx=0x7f68cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.174+0000 7f68d3e00700 1 -- 172.21.15.148:0/3830262934 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68cc010840 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.174+0000 7f68d3e00700 1 -- 172.21.15.148:0/3830262934 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68cc010e70 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.174+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68dc113f10 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.174+0000 7f68d3e00700 1 -- 172.21.15.148:0/3830262934 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f68cc024ea0 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.174+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68dc114bb0 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.175+0000 7f68d3e00700 1 -- 172.21.15.148:0/3830262934 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 12) v1 ==== 43381+0+0 (secure 0 0 0) 0x7f68cc024780 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.175+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68dc05f5c0 con 0x7f68dc0714c0 2024-02-28T16:13:54.533 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.175+0000 7f68d3e00700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f68c00367e0 0x7f68c0038c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.175+0000 7f68d3e00700 1 -- 172.21.15.148:0/3830262934 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f68cc04a7b0 con 0x7f68dc0714c0 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.176+0000 7f68db400700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f68c00367e0 0x7f68c0038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.177+0000 7f68db400700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f68c00367e0 0x7f68c0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009990 tx=0x7f68c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.181+0000 7f68d3e00700 1 -- 172.21.15.148:0/3830262934 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f68cc02c930 con 0x7f68dc0714c0 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.416+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f68dc05f3e0 con 0x7f68c00367e0 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.654+0000 7f68d3e00700 1 -- 172.21.15.148:0/3830262934 <== mgr.14162 v2:172.21.15.148:6800/3553564677 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f68dc05f3e0 con 0x7f68c00367e0 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.658+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f68c00367e0 msgr2=0x7f68c0038c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.658+0000 7f68e2e00700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f68c00367e0 0x7f68c0038c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009990 tx=0x7f68c8006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.658+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 msgr2=0x7f68dc1137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.658+0000 7f68e2e00700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc1137d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68cc006d40 tx=0x7f68cc009250 comp rx=0 tx=0).stop 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.659+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 shutdown_connections 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.659+0000 7f68e2e00700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f68c00367e0 0x7f68c0038c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.659+0000 7f68e2e00700 1 --2- 172.21.15.148:0/3830262934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68dc0714c0 0x7f68dc1137d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.659+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 >> 172.21.15.148:0/3830262934 conn(0x7f68dc0fcdd0 msgr2=0x7f68dc0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:54.534 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.659+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 shutdown_connections 2024-02-28T16:13:54.535 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:53.659+0000 7f68e2e00700 1 -- 172.21.15.148:0/3830262934 wait complete. 2024-02-28T16:13:54.535 INFO:teuthology.orchestra.run.smithi148.stdout:Fetching dashboard port number... 2024-02-28T16:13:54.815 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:54 smithi148 ceph-mon[28767]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:13:54.815 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:54 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:13:55.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:55 smithi148 ceph-mon[28767]: mgrmap e13: smithi148.gelspy(active, since 6s) 2024-02-28T16:13:55.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:55 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/795191045' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-28T16:13:56.367 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stdout 8443 2024-02-28T16:13:56.367 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.407+0000 7fdfc4000700 1 Processor -- start 2024-02-28T16:13:56.367 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.407+0000 7fdfc4000700 1 -- start start 2024-02-28T16:13:56.368 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.407+0000 7fdfc4000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:56.368 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.407+0000 7fdfc4000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc079ff0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.369 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.408+0000 7fdfc1600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:56.369 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.408+0000 7fdfc1600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc079ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34530/0 (socket says 172.21.15.148:34530) 2024-02-28T16:13:56.369 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.408+0000 7fdfc1600700 1 -- 172.21.15.148:0/3703615633 learned_addr learned my addr 172.21.15.148:0/3703615633 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.408+0000 7fdfc1600700 1 -- 172.21.15.148:0/3703615633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc07a130 con 0x7fdfbc0796a0 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.408+0000 7fdfc1600700 1 --2- 172.21.15.148:0/3703615633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc079ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b131e8d54295512a server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfbbe00700 1 -- 172.21.15.148:0/3703615633 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfb000b860 con 0x7fdfbc0796a0 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfbbe00700 1 -- 172.21.15.148:0/3703615633 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfb000be90 con 0x7fdfbc0796a0 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfbbe00700 1 -- 172.21.15.148:0/3703615633 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfb00103c0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfc4000700 1 -- 172.21.15.148:0/3703615633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 msgr2=0x7fdfbc079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfc4000700 1 --2- 172.21.15.148:0/3703615633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc079ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb0009250 comp rx=0 tx=0).stop 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfc4000700 1 -- 172.21.15.148:0/3703615633 shutdown_connections 2024-02-28T16:13:56.370 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfc4000700 1 --2- 172.21.15.148:0/3703615633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc079ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:56.372 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.409+0000 7fdfc4000700 1 -- 172.21.15.148:0/3703615633 >> 172.21.15.148:0/3703615633 conn(0x7fdfbc078030 msgr2=0x7fdfbc078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:56.372 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.410+0000 7fdfc4000700 1 -- 172.21.15.148:0/3703615633 shutdown_connections 2024-02-28T16:13:56.372 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.410+0000 7fdfc4000700 1 -- 172.21.15.148:0/3703615633 wait complete. 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.410+0000 7fdfc4000700 1 Processor -- start 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.411+0000 7fdfc4000700 1 -- start start 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.411+0000 7fdfc4000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc117bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.411+0000 7fdfc4000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc1180f0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.411+0000 7fdfc1600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc117bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.411+0000 7fdfc1600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc117bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34538/0 (socket says 172.21.15.148:34538) 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.411+0000 7fdfc1600700 1 -- 172.21.15.148:0/795191045 learned_addr learned my addr 172.21.15.148:0/795191045 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.411+0000 7fdfc1600700 1 -- 172.21.15.148:0/795191045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00094f0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.412+0000 7fdfc1600700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc117bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0006fd0 tx=0x7fdfb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.412+0000 7fdfb9600700 1 -- 172.21.15.148:0/795191045 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfb0010630 con 0x7fdfbc0796a0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.412+0000 7fdfb9600700 1 -- 172.21.15.148:0/795191045 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfb0010c60 con 0x7fdfbc0796a0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.412+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc1182f0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.412+0000 7fdfb9600700 1 -- 172.21.15.148:0/795191045 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfb001ad40 con 0x7fdfbc0796a0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.412+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc118f90 con 0x7fdfbc0796a0 2024-02-28T16:13:56.373 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.413+0000 7fdfb9600700 1 -- 172.21.15.148:0/795191045 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fdfb001a5f0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.374 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.413+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc05f5c0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.414+0000 7fdfb9600700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdfa4036880 0x7fdfa4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.414+0000 7fdfb9600700 1 -- 172.21.15.148:0/795191045 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdfb004a260 con 0x7fdfbc0796a0 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.414+0000 7fdfc0c00700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdfa4036880 0x7fdfa4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.415+0000 7fdfc0c00700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdfa4036880 0x7fdfa4038d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009990 tx=0x7fdfa8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.419+0000 7fdfb9600700 1 -- 172.21.15.148:0/795191045 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdfb0023930 con 0x7fdfbc0796a0 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.623+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fdfbc04bed0 con 0x7fdfbc0796a0 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.624+0000 7fdfb9600700 1 -- 172.21.15.148:0/795191045 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fdfb0020030 con 0x7fdfbc0796a0 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.626+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdfa4036880 msgr2=0x7fdfa4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.626+0000 7fdfc4000700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdfa4036880 0x7fdfa4038d30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009990 tx=0x7fdfa8006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.626+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 msgr2=0x7fdfbc117bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.626+0000 7fdfc4000700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc117bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0006fd0 tx=0x7fdfb0009250 comp rx=0 tx=0).stop 2024-02-28T16:13:56.376 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.627+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 shutdown_connections 2024-02-28T16:13:56.377 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.627+0000 7fdfc4000700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdfa4036880 0x7fdfa4038d30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:56.377 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.627+0000 7fdfc4000700 1 --2- 172.21.15.148:0/795191045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdfbc0796a0 0x7fdfbc117bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:56.377 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.627+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 >> 172.21.15.148:0/795191045 conn(0x7fdfbc078030 msgr2=0x7fdfbc103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:56.377 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.627+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 shutdown_connections 2024-02-28T16:13:56.377 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:55.627+0000 7fdfc4000700 1 -- 172.21.15.148:0/795191045 wait complete. 2024-02-28T16:13:56.413 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T16:13:56.413 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout disabled 2024-02-28T16:13:56.439 INFO:teuthology.orchestra.run.smithi148.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T16:13:56.439 INFO:teuthology.orchestra.run.smithi148.stdout:systemctl: stdout inactive 2024-02-28T16:13:56.439 INFO:teuthology.orchestra.run.smithi148.stdout:firewalld.service is not enabled 2024-02-28T16:13:56.439 INFO:teuthology.orchestra.run.smithi148.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-28T16:13:56.443 INFO:teuthology.orchestra.run.smithi148.stdout:Ceph Dashboard is now available at: 2024-02-28T16:13:56.443 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:56.443 INFO:teuthology.orchestra.run.smithi148.stdout: URL: https://smithi148.front.sepia.ceph.com:8443/ 2024-02-28T16:13:56.443 INFO:teuthology.orchestra.run.smithi148.stdout: User: admin 2024-02-28T16:13:56.443 INFO:teuthology.orchestra.run.smithi148.stdout: Password: itxhzjkhcw 2024-02-28T16:13:56.443 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:56.444 INFO:teuthology.orchestra.run.smithi148.stdout:Saving cluster configuration to /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config directory 2024-02-28T16:13:56.445 INFO:teuthology.orchestra.run.smithi148.stdout:Enabling autotune for osd_memory_target 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.077+0000 7efc5fc00700 1 Processor -- start 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.077+0000 7efc5fc00700 1 -- start start 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.078+0000 7efc5fc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.078+0000 7efc5fc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc58079110 con 0x7efc58078d00 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.078+0000 7efc5d200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.078+0000 7efc5d200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34542/0 (socket says 172.21.15.148:34542) 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.078+0000 7efc5d200700 1 -- 172.21.15.148:0/2554753266 learned_addr learned my addr 172.21.15.148:0/2554753266 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:58.006 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.079+0000 7efc5d200700 1 -- 172.21.15.148:0/2554753266 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58077750 con 0x7efc58078d00 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.079+0000 7efc5d200700 1 --2- 172.21.15.148:0/2554753266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58077210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009e50 tx=0x7efc4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d8adc58f8ea6ba server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.079+0000 7efc57400700 1 -- 172.21.15.148:0/2554753266 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc4c0092e0 con 0x7efc58078d00 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.079+0000 7efc57400700 1 -- 172.21.15.148:0/2554753266 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc4c012430 con 0x7efc58078d00 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.079+0000 7efc57400700 1 -- 172.21.15.148:0/2554753266 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc4c0075a0 con 0x7efc58078d00 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.080+0000 7efc5fc00700 1 -- 172.21.15.148:0/2554753266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 msgr2=0x7efc58077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.080+0000 7efc5fc00700 1 --2- 172.21.15.148:0/2554753266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58077210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009e50 tx=0x7efc4c009840 comp rx=0 tx=0).stop 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.080+0000 7efc5fc00700 1 -- 172.21.15.148:0/2554753266 shutdown_connections 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.080+0000 7efc5fc00700 1 --2- 172.21.15.148:0/2554753266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58077210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.080+0000 7efc5fc00700 1 -- 172.21.15.148:0/2554753266 >> 172.21.15.148:0/2554753266 conn(0x7efc580fdf00 msgr2=0x7efc58100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:58.007 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.080+0000 7efc5fc00700 1 -- 172.21.15.148:0/2554753266 shutdown_connections 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.080+0000 7efc5fc00700 1 -- 172.21.15.148:0/2554753266 wait complete. 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.081+0000 7efc5fc00700 1 Processor -- start 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.081+0000 7efc5fc00700 1 -- start start 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.082+0000 7efc5fc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.082+0000 7efc5fc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc58113d50 con 0x7efc58078d00 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.082+0000 7efc5d200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.082+0000 7efc5d200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34548/0 (socket says 172.21.15.148:34548) 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.082+0000 7efc5d200700 1 -- 172.21.15.148:0/2900527990 learned_addr learned my addr 172.21.15.148:0/2900527990 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.082+0000 7efc5d200700 1 -- 172.21.15.148:0/2900527990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009ae0 con 0x7efc58078d00 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.083+0000 7efc5d200700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58113810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009fd0 tx=0x7efc4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.083+0000 7efc54c00700 1 -- 172.21.15.148:0/2900527990 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc4c0092e0 con 0x7efc58078d00 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.083+0000 7efc54c00700 1 -- 172.21.15.148:0/2900527990 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc4c007ce0 con 0x7efc58078d00 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.083+0000 7efc54c00700 1 -- 172.21.15.148:0/2900527990 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efc4c0259c0 con 0x7efc58078d00 2024-02-28T16:13:58.008 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.083+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc58113f50 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.083+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc58114bf0 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.084+0000 7efc54c00700 1 -- 172.21.15.148:0/2900527990 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7efc4c019050 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.084+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5805f5c0 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.085+0000 7efc54c00700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7efc400368d0 0x7efc40038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.085+0000 7efc54c00700 1 -- 172.21.15.148:0/2900527990 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7efc4c04a270 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.085+0000 7efc57e00700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7efc400368d0 0x7efc40038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.086+0000 7efc57e00700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7efc400368d0 0x7efc40038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc44009990 tx=0x7efc44006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.090+0000 7efc54c00700 1 -- 172.21.15.148:0/2900527990 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efc4c00be50 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.296+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7efc5804bed0 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.297+0000 7efc54c00700 1 -- 172.21.15.148:0/2900527990 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7efc4c020030 con 0x7efc58078d00 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.300+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7efc400368d0 msgr2=0x7efc40038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.009 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.300+0000 7efc5fc00700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7efc400368d0 0x7efc40038d80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efc44009990 tx=0x7efc44006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.300+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 msgr2=0x7efc58113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.300+0000 7efc5fc00700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58113810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009fd0 tx=0x7efc4c009840 comp rx=0 tx=0).stop 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.301+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 shutdown_connections 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.301+0000 7efc5fc00700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7efc400368d0 0x7efc40038d80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.301+0000 7efc5fc00700 1 --2- 172.21.15.148:0/2900527990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc58078d00 0x7efc58113810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.301+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 >> 172.21.15.148:0/2900527990 conn(0x7efc580fdf00 msgr2=0x7efc581002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.301+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 shutdown_connections 2024-02-28T16:13:58.010 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:57.301+0000 7efc5fc00700 1 -- 172.21.15.148:0/2900527990 wait complete. 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.585+0000 7f51d2600700 1 Processor -- start 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.585+0000 7f51d2600700 1 -- start start 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.585+0000 7f51d2600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc102b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.585+0000 7f51d2600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc1030d0 con 0x7f51cc102780 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.586+0000 7f51cb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.586+0000 7f51cb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34552/0 (socket says 172.21.15.148:34552) 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.586+0000 7f51cb400700 1 -- 172.21.15.148:0/3838062678 learned_addr learned my addr 172.21.15.148:0/3838062678 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.586+0000 7f51cb400700 1 -- 172.21.15.148:0/3838062678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc103210 con 0x7f51cc102780 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.587+0000 7f51cb400700 1 --2- 172.21.15.148:0/3838062678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc102b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0098e0 tx=0x7f51bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f42db155f8cc12 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.587+0000 7f51ca000700 1 -- 172.21.15.148:0/3838062678 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51bc00b860 con 0x7f51cc102780 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.587+0000 7f51ca000700 1 -- 172.21.15.148:0/3838062678 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51bc00be90 con 0x7f51cc102780 2024-02-28T16:13:59.628 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.587+0000 7f51ca000700 1 -- 172.21.15.148:0/3838062678 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51bc0103c0 con 0x7f51cc102780 2024-02-28T16:13:59.629 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.588+0000 7f51d2600700 1 -- 172.21.15.148:0/3838062678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 msgr2=0x7f51cc102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.633 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.588+0000 7f51d2600700 1 --2- 172.21.15.148:0/3838062678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc102b90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0098e0 tx=0x7f51bc009250 comp rx=0 tx=0).stop 2024-02-28T16:13:59.633 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.588+0000 7f51d2600700 1 -- 172.21.15.148:0/3838062678 shutdown_connections 2024-02-28T16:13:59.633 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.588+0000 7f51d2600700 1 --2- 172.21.15.148:0/3838062678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc102b90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.633 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.588+0000 7f51d2600700 1 -- 172.21.15.148:0/3838062678 >> 172.21.15.148:0/3838062678 conn(0x7f51cc0fdf00 msgr2=0x7f51cc100310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:59.633 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.588+0000 7f51d2600700 1 -- 172.21.15.148:0/3838062678 shutdown_connections 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.588+0000 7f51d2600700 1 -- 172.21.15.148:0/3838062678 wait complete. 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.589+0000 7f51d2600700 1 Processor -- start 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.589+0000 7f51d2600700 1 -- start start 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.589+0000 7f51d2600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc078d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.589+0000 7f51d2600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc077190 con 0x7f51cc102780 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.590+0000 7f51cb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc078d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.590+0000 7f51cb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc078d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34568/0 (socket says 172.21.15.148:34568) 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.590+0000 7f51cb400700 1 -- 172.21.15.148:0/173607376 learned_addr learned my addr 172.21.15.148:0/173607376 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.590+0000 7f51cb400700 1 -- 172.21.15.148:0/173607376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0094f0 con 0x7f51cc102780 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.590+0000 7f51cb400700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc078d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0090b0 tx=0x7f51bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.591+0000 7f51c3400700 1 -- 172.21.15.148:0/173607376 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51bc010840 con 0x7f51cc102780 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.591+0000 7f51c3400700 1 -- 172.21.15.148:0/173607376 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51bc010e70 con 0x7f51cc102780 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.591+0000 7f51c3400700 1 -- 172.21.15.148:0/173607376 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51bc024e40 con 0x7f51cc102780 2024-02-28T16:13:59.634 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.591+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc077390 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.591+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc077820 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.592+0000 7f51c3400700 1 -- 172.21.15.148:0/173607376 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f51bc024430 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.592+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc04bed0 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.592+0000 7f51c3400700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f51b0036880 0x7f51b0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.592+0000 7f51c3400700 1 -- 172.21.15.148:0/173607376 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f51bc04a950 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.593+0000 7f51caa00700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f51b0036880 0x7f51b0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.593+0000 7f51caa00700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f51b0036880 0x7f51b0038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009990 tx=0x7f51b8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.598+0000 7f51c3400700 1 -- 172.21.15.148:0/173607376 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f51bc02c930 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.910+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f51cc077d60 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.914+0000 7f51c3400700 1 -- 172.21.15.148:0/173607376 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f51bc02c340 con 0x7f51cc102780 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f51b0036880 msgr2=0x7f51b0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f51b0036880 0x7f51b0038d30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009990 tx=0x7f51b8006e40 comp rx=0 tx=0).stop 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 msgr2=0x7f51cc078d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc078d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f51bc0090b0 tx=0x7f51bc009250 comp rx=0 tx=0).stop 2024-02-28T16:13:59.635 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 shutdown_connections 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f51b0036880 0x7f51b0038d30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 --2- 172.21.15.148:0/173607376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f51cc102780 0x7f51cc078d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 >> 172.21.15.148:0/173607376 conn(0x7f51cc0fdf00 msgr2=0x7f51cc0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 shutdown_connections 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr 2024-02-28T16:13:58.917+0000 7f51d2600700 1 -- 172.21.15.148:0/173607376 wait complete. 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:Or, if you are only running a single cluster on this host: 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.636 INFO:teuthology.orchestra.run.smithi148.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout: ceph telemetry on 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout:For more information see: 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:13:59.637 INFO:teuthology.orchestra.run.smithi148.stdout:Bootstrap complete. 2024-02-28T16:13:59.752 INFO:tasks.cephadm:Fetching config... 2024-02-28T16:13:59.752 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:13:59.752 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-28T16:13:59.799 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-28T16:13:59.799 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:13:59.799 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-28T16:13:59.880 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-28T16:13:59.880 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:13:59.880 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/keyring of=/dev/stdout 2024-02-28T16:14:00.010 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-28T16:14:00.010 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:14:00.010 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-28T16:14:00.058 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-28T16:14:00.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjpWELBNHWML0XVB1jdvmv8uAVLGOtPqYMNVPVFh7zm2SCqsZgI0d1v7DTX9Y5VAg56Zt7i5RXHTeVoypwkpr0HoglOu65hApAJ5tVsN/+UB+3PDx3hIAYeIOLVTyrooZgX6qYES9rz9TQ/kHFnVk0WyYh+0/iGDpv1caW2MdyqQmIA1nzvEQ+I+f+nVlPWI6vGboW2ed+Jf3mwT7LnklMm9UKzyryMqn18fBYni926ns6j0rMmMOx04sPteJJx/rRH6l2XSG/krtgpfdwELWLOKczjLn7aLs88OrTZgRk+rLJXHGBST3qRIJMu88U65Wq6xmUJb+GLSOb4J+2UV/oWNrNTnBoERdjAiC54D5L8V9LC6a9wn0klTJwRhCkdfFAR+N+3m9GWRtCPhNL/zL1UVL0gG7vma3RsmC0L1zpzYlvzdhkDm/KzISYNurCjH1gaDW8/0I7huPzXOxtEAC/tDc4J6UENYfQCGDGeAWvhiEHpBGGUjqybGbjTZTm7pk= ceph-004ac12e-d654-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T16:14:00.169 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:13:59 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/173607376' entity='client.admin' 2024-02-28T16:14:00.216 INFO:teuthology.orchestra.run.smithi148.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjpWELBNHWML0XVB1jdvmv8uAVLGOtPqYMNVPVFh7zm2SCqsZgI0d1v7DTX9Y5VAg56Zt7i5RXHTeVoypwkpr0HoglOu65hApAJ5tVsN/+UB+3PDx3hIAYeIOLVTyrooZgX6qYES9rz9TQ/kHFnVk0WyYh+0/iGDpv1caW2MdyqQmIA1nzvEQ+I+f+nVlPWI6vGboW2ed+Jf3mwT7LnklMm9UKzyryMqn18fBYni926ns6j0rMmMOx04sPteJJx/rRH6l2XSG/krtgpfdwELWLOKczjLn7aLs88OrTZgRk+rLJXHGBST3qRIJMu88U65Wq6xmUJb+GLSOb4J+2UV/oWNrNTnBoERdjAiC54D5L8V9LC6a9wn0klTJwRhCkdfFAR+N+3m9GWRtCPhNL/zL1UVL0gG7vma3RsmC0L1zpzYlvzdhkDm/KzISYNurCjH1gaDW8/0I7huPzXOxtEAC/tDc4J6UENYfQCGDGeAWvhiEHpBGGUjqybGbjTZTm7pk= ceph-004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:14:00.259 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjpWELBNHWML0XVB1jdvmv8uAVLGOtPqYMNVPVFh7zm2SCqsZgI0d1v7DTX9Y5VAg56Zt7i5RXHTeVoypwkpr0HoglOu65hApAJ5tVsN/+UB+3PDx3hIAYeIOLVTyrooZgX6qYES9rz9TQ/kHFnVk0WyYh+0/iGDpv1caW2MdyqQmIA1nzvEQ+I+f+nVlPWI6vGboW2ed+Jf3mwT7LnklMm9UKzyryMqn18fBYni926ns6j0rMmMOx04sPteJJx/rRH6l2XSG/krtgpfdwELWLOKczjLn7aLs88OrTZgRk+rLJXHGBST3qRIJMu88U65Wq6xmUJb+GLSOb4J+2UV/oWNrNTnBoERdjAiC54D5L8V9LC6a9wn0klTJwRhCkdfFAR+N+3m9GWRtCPhNL/zL1UVL0gG7vma3RsmC0L1zpzYlvzdhkDm/KzISYNurCjH1gaDW8/0I7huPzXOxtEAC/tDc4J6UENYfQCGDGeAWvhiEHpBGGUjqybGbjTZTm7pk= ceph-004ac12e-d654-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T16:14:00.398 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjpWELBNHWML0XVB1jdvmv8uAVLGOtPqYMNVPVFh7zm2SCqsZgI0d1v7DTX9Y5VAg56Zt7i5RXHTeVoypwkpr0HoglOu65hApAJ5tVsN/+UB+3PDx3hIAYeIOLVTyrooZgX6qYES9rz9TQ/kHFnVk0WyYh+0/iGDpv1caW2MdyqQmIA1nzvEQ+I+f+nVlPWI6vGboW2ed+Jf3mwT7LnklMm9UKzyryMqn18fBYni926ns6j0rMmMOx04sPteJJx/rRH6l2XSG/krtgpfdwELWLOKczjLn7aLs88OrTZgRk+rLJXHGBST3qRIJMu88U65Wq6xmUJb+GLSOb4J+2UV/oWNrNTnBoERdjAiC54D5L8V9LC6a9wn0klTJwRhCkdfFAR+N+3m9GWRtCPhNL/zL1UVL0gG7vma3RsmC0L1zpzYlvzdhkDm/KzISYNurCjH1gaDW8/0I7huPzXOxtEAC/tDc4J6UENYfQCGDGeAWvhiEHpBGGUjqybGbjTZTm7pk= ceph-004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:14:00.465 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-28T16:14:00.915 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.787+0000 7fe288800700 1 -- 172.21.15.148:0/710054384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 msgr2=0x7fe280070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.787+0000 7fe288800700 1 --2- 172.21.15.148:0/710054384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe280070380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2740048c0 tx=0x7fe274009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.787+0000 7fe288800700 1 -- 172.21.15.148:0/710054384 shutdown_connections 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.787+0000 7fe288800700 1 --2- 172.21.15.148:0/710054384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe280070380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.787+0000 7fe288800700 1 -- 172.21.15.148:0/710054384 >> 172.21.15.148:0/710054384 conn(0x7fe2800f82a0 msgr2=0x7fe2800fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.787+0000 7fe288800700 1 -- 172.21.15.148:0/710054384 shutdown_connections 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.787+0000 7fe288800700 1 -- 172.21.15.148:0/710054384 wait complete. 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.788+0000 7fe288800700 1 Processor -- start 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.788+0000 7fe288800700 1 -- start start 2024-02-28T16:14:03.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.788+0000 7fe288800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe28010f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.788+0000 7fe288800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28010f5c0 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.788+0000 7fe285e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe28010f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.788+0000 7fe285e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe28010f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37128/0 (socket says 172.21.15.148:37128) 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.788+0000 7fe285e00700 1 -- 172.21.15.148:0/3812742667 learned_addr learned my addr 172.21.15.148:0/3812742667 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.789+0000 7fe285e00700 1 -- 172.21.15.148:0/3812742667 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe274005040 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.789+0000 7fe285e00700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe28010f080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe274009b80 tx=0x7fe274009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.789+0000 7fe27a000700 1 -- 172.21.15.148:0/3812742667 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe27400b5c0 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.789+0000 7fe27a000700 1 -- 172.21.15.148:0/3812742667 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe27400be70 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.789+0000 7fe27a000700 1 -- 172.21.15.148:0/3812742667 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe27401c660 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.789+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28010f7c0 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.790+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe280110460 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.791+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28005f5c0 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.792+0000 7fe27a000700 1 -- 172.21.15.148:0/3812742667 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fe274004d30 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.792+0000 7fe27a000700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fe2680368c0 0x7fe268038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.792+0000 7fe27a000700 1 -- 172.21.15.148:0/3812742667 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe274049a00 con 0x7fe280071f10 2024-02-28T16:14:03.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.792+0000 7fe285400700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fe2680368c0 0x7fe268038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:03.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.793+0000 7fe285400700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fe2680368c0 0x7fe268038d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe270009990 tx=0x7fe270006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:03.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:03.798+0000 7fe27a000700 1 -- 172.21.15.148:0/3812742667 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe274025400 con 0x7fe280071f10 2024-02-28T16:14:04.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.008+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fe28004bed0 con 0x7fe280071f10 2024-02-28T16:14:04.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.014+0000 7fe27a000700 1 -- 172.21.15.148:0/3812742667 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe274011370 con 0x7fe280071f10 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.016+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fe2680368c0 msgr2=0x7fe268038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.016+0000 7fe288800700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fe2680368c0 0x7fe268038d70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe270009990 tx=0x7fe270006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.016+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 msgr2=0x7fe28010f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.016+0000 7fe288800700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe28010f080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe274009b80 tx=0x7fe274009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.017+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 shutdown_connections 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.017+0000 7fe288800700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fe2680368c0 0x7fe268038d70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.017+0000 7fe288800700 1 --2- 172.21.15.148:0/3812742667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe280071f10 0x7fe28010f080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.017+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 >> 172.21.15.148:0/3812742667 conn(0x7fe2800f82a0 msgr2=0x7fe2800f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:04.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.017+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 shutdown_connections 2024-02-28T16:14:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:04.017+0000 7fe288800700 1 -- 172.21.15.148:0/3812742667 wait complete. 2024-02-28T16:14:04.849 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-28T16:14:04.850 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-28T16:14:05.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:05 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3812742667' entity='client.admin' 2024-02-28T16:14:06.041 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:14:07.251 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:07.251 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:07.251 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:14:07.251 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:07.251 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:14:07.251 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T16:14:07.251 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:14:07.252 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:07 smithi148 ceph-mon[28767]: Deploying daemon crash.smithi148 on smithi148 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.061+0000 7f7e97800700 1 -- 172.21.15.148:0/167429878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 msgr2=0x7f7e901035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.061+0000 7f7e97800700 1 --2- 172.21.15.148:0/167429878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901035e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7e840048c0 tx=0x7f7e84009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.061+0000 7f7e97800700 1 -- 172.21.15.148:0/167429878 shutdown_connections 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.061+0000 7f7e97800700 1 --2- 172.21.15.148:0/167429878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901035e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.061+0000 7f7e97800700 1 -- 172.21.15.148:0/167429878 >> 172.21.15.148:0/167429878 conn(0x7f7e900722d0 msgr2=0x7f7e900746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.061+0000 7f7e97800700 1 -- 172.21.15.148:0/167429878 shutdown_connections 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.061+0000 7f7e97800700 1 -- 172.21.15.148:0/167429878 wait complete. 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.062+0000 7f7e97800700 1 Processor -- start 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.063+0000 7f7e97800700 1 -- start start 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.063+0000 7f7e97800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.063+0000 7f7e97800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90113a20 con 0x7f7e901031d0 2024-02-28T16:14:08.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.063+0000 7f7e94e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.063+0000 7f7e94e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901134e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:37138/0 (socket says 172.21.15.148:37138) 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.063+0000 7f7e94e00700 1 -- 172.21.15.148:0/63456633 learned_addr learned my addr 172.21.15.148:0/63456633 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.064+0000 7f7e94e00700 1 -- 172.21.15.148:0/63456633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84005040 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.064+0000 7f7e94e00700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901134e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009b80 tx=0x7f7e84009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.064+0000 7f7e8cc00700 1 -- 172.21.15.148:0/63456633 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e8400b5c0 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.064+0000 7f7e8cc00700 1 -- 172.21.15.148:0/63456633 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e8400be70 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.064+0000 7f7e8cc00700 1 -- 172.21.15.148:0/63456633 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e8401c660 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.064+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e90113c20 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.065+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e901148c0 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.066+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9005f5c0 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.066+0000 7f7e8cc00700 1 -- 172.21.15.148:0/63456633 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f7e84004d30 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.067+0000 7f7e8cc00700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f7e78036870 0x7f7e78038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.067+0000 7f7e8cc00700 1 -- 172.21.15.148:0/63456633 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7e84049af0 con 0x7f7e901031d0 2024-02-28T16:14:08.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.067+0000 7f7e8fe00700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f7e78036870 0x7f7e78038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:08.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.067+0000 7f7e8fe00700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f7e78036870 0x7f7e78038d20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009990 tx=0x7f7e7c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:08.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.072+0000 7f7e8cc00700 1 -- 172.21.15.148:0/63456633 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7e84025400 con 0x7f7e901031d0 2024-02-28T16:14:08.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.289+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e90115480 con 0x7f7e78036870 2024-02-28T16:14:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.296+0000 7f7e8cc00700 1 -- 172.21.15.148:0/63456633 <== mgr.14162 v2:172.21.15.148:6800/3553564677 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7e90115480 con 0x7f7e78036870 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.298+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f7e78036870 msgr2=0x7f7e78038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.298+0000 7f7e97800700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f7e78036870 0x7f7e78038d20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009990 tx=0x7f7e7c006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.298+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 msgr2=0x7f7e901134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.298+0000 7f7e97800700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901134e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009b80 tx=0x7f7e84009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.299+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 shutdown_connections 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.299+0000 7f7e97800700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f7e78036870 0x7f7e78038d20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.299+0000 7f7e97800700 1 --2- 172.21.15.148:0/63456633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7e901031d0 0x7f7e901134e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.299+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 >> 172.21.15.148:0/63456633 conn(0x7f7e900722d0 msgr2=0x7f7e90073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:08.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.299+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 shutdown_connections 2024-02-28T16:14:08.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:08.299+0000 7f7e97800700 1 -- 172.21.15.148:0/63456633 wait complete. 2024-02-28T16:14:08.971 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2024-02-28T16:14:08.971 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:14:08.971 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2024-02-28T16:14:09.027 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:14:09.027 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:14:09.122 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2024-02-28T16:14:09.122 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch host add smithi157 2024-02-28T16:14:09.599 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:14:09.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:09 smithi148 ceph-mon[28767]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:09.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:09 smithi148 ceph-mon[28767]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:09.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:09 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:11.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:11 smithi148 ceph-mon[28767]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.044+0000 7f5349200700 1 -- 172.21.15.148:0/626747590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 msgr2=0x7f53440ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.044+0000 7f5349200700 1 --2- 172.21.15.148:0/626747590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f53440ff1e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f53340048c0 tx=0x7f5334009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.044+0000 7f5349200700 1 -- 172.21.15.148:0/626747590 shutdown_connections 2024-02-28T16:14:12.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.044+0000 7f5349200700 1 --2- 172.21.15.148:0/626747590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f53440ff1e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.044+0000 7f5349200700 1 -- 172.21.15.148:0/626747590 >> 172.21.15.148:0/626747590 conn(0x7f53440fa5a0 msgr2=0x7f53440fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.044+0000 7f5349200700 1 -- 172.21.15.148:0/626747590 shutdown_connections 2024-02-28T16:14:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.044+0000 7f5349200700 1 -- 172.21.15.148:0/626747590 wait complete. 2024-02-28T16:14:12.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.045+0000 7f5349200700 1 Processor -- start 2024-02-28T16:14:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.045+0000 7f5349200700 1 -- start start 2024-02-28T16:14:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.046+0000 7f5349200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f534410f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:12.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.046+0000 7f5349200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534410f640 con 0x7f53440fedd0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.046+0000 7f5341e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f534410f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.046+0000 7f5341e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f534410f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56626/0 (socket says 172.21.15.148:56626) 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.046+0000 7f5341e00700 1 -- 172.21.15.148:0/2476179243 learned_addr learned my addr 172.21.15.148:0/2476179243 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.046+0000 7f5341e00700 1 -- 172.21.15.148:0/2476179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334005040 con 0x7f53440fedd0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.047+0000 7f5341e00700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f534410f100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5334009b80 tx=0x7f5334009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.047+0000 7f533a000700 1 -- 172.21.15.148:0/2476179243 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f533400b5c0 con 0x7f53440fedd0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.047+0000 7f533a000700 1 -- 172.21.15.148:0/2476179243 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f533400be70 con 0x7f53440fedd0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.047+0000 7f5349200700 1 -- 172.21.15.148:0/2476179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534410f840 con 0x7f53440fedd0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.047+0000 7f533a000700 1 -- 172.21.15.148:0/2476179243 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f533401c660 con 0x7f53440fedd0 2024-02-28T16:14:12.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.047+0000 7f5349200700 1 -- 172.21.15.148:0/2476179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53441104e0 con 0x7f53440fedd0 2024-02-28T16:14:12.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.048+0000 7f533a000700 1 -- 172.21.15.148:0/2476179243 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f5334013b10 con 0x7f53440fedd0 2024-02-28T16:14:12.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.048+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534405f5c0 con 0x7f53440fedd0 2024-02-28T16:14:12.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.049+0000 7f533a000700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5328036870 0x7f5328038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:12.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.049+0000 7f533a000700 1 -- 172.21.15.148:0/2476179243 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5334049a00 con 0x7f53440fedd0 2024-02-28T16:14:12.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.049+0000 7f5341400700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5328036870 0x7f5328038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:12.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.050+0000 7f5341400700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5328036870 0x7f5328038d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5330009990 tx=0x7f5330006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:12.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.054+0000 7f533a000700 1 -- 172.21.15.148:0/2476179243 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f53340137a0 con 0x7f53440fedd0 2024-02-28T16:14:12.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:12.274+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}) v1 -- 0x7f534404bf40 con 0x7f5328036870 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: Deploying daemon node-exporter.smithi148 on smithi148 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:13.461 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:13 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:14.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:14 smithi148 ceph-mon[28767]: Deploying cephadm binary to smithi157 2024-02-28T16:14:15.868 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:15 smithi148 ceph-mon[28767]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:16.377 INFO:teuthology.orchestra.run.smithi148.stdout:Added host 'smithi157' with addr '172.21.15.157' 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.383+0000 7f533a000700 1 -- 172.21.15.148:0/2476179243 <== mgr.14162 v2:172.21.15.148:6800/3553564677 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f534404bf40 con 0x7f5328036870 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5328036870 msgr2=0x7f5328038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5328036870 0x7f5328038d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5330009990 tx=0x7f5330006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 msgr2=0x7f534410f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f534410f100 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5334009b80 tx=0x7f5334009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 shutdown_connections 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5328036870 0x7f5328038d20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:16.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 --2- 172.21.15.148:0/2476179243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f53440fedd0 0x7f534410f100 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.386+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 >> 172.21.15.148:0/2476179243 conn(0x7f53440fa5a0 msgr2=0x7f53440fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.387+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 shutdown_connections 2024-02-28T16:14:16.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:16.387+0000 7f532f400700 1 -- 172.21.15.148:0/2476179243 wait complete. 2024-02-28T16:14:17.426 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch host ls --format=json 2024-02-28T16:14:17.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:17 smithi148 ceph-mon[28767]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:17.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:17 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:17.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:17 smithi148 ceph-mon[28767]: Added host smithi157 2024-02-28T16:14:18.074 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:14:19.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:19 smithi148 ceph-mon[28767]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:19.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:19 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:19.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:19 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:19.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:19 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:19.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:19 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:19.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:19 smithi148 ceph-mon[28767]: Deploying daemon alertmanager.smithi148 on smithi148 2024-02-28T16:14:19.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:19 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:20.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.362+0000 7f5c0be00700 1 -- 172.21.15.148:0/2535165359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 msgr2=0x7f5c0c0ff920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:20.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.362+0000 7f5c0be00700 1 --2- 172.21.15.148:0/2535165359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c0ff920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009c60 tx=0x7f5bfc004d10 comp rx=0 tx=0).stop 2024-02-28T16:14:20.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.362+0000 7f5c0be00700 1 -- 172.21.15.148:0/2535165359 shutdown_connections 2024-02-28T16:14:20.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.362+0000 7f5c0be00700 1 --2- 172.21.15.148:0/2535165359 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c0ff920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:20.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.362+0000 7f5c0be00700 1 -- 172.21.15.148:0/2535165359 >> 172.21.15.148:0/2535165359 conn(0x7f5c0c0f6fc0 msgr2=0x7f5c0c0f93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:20.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.362+0000 7f5c0be00700 1 -- 172.21.15.148:0/2535165359 shutdown_connections 2024-02-28T16:14:20.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.362+0000 7f5c0be00700 1 -- 172.21.15.148:0/2535165359 wait complete. 2024-02-28T16:14:20.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.363+0000 7f5c0be00700 1 Processor -- start 2024-02-28T16:14:20.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.363+0000 7f5c0be00700 1 -- start start 2024-02-28T16:14:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.363+0000 7f5c0be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c10ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.363+0000 7f5c0be00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c10f450 con 0x7f5c0c0fd540 2024-02-28T16:14:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.364+0000 7f5c0aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c10ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.364+0000 7f5c0aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c10ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56638/0 (socket says 172.21.15.148:56638) 2024-02-28T16:14:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.364+0000 7f5c0aa00700 1 -- 172.21.15.148:0/1322087203 learned_addr learned my addr 172.21.15.148:0/1322087203 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:14:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.364+0000 7f5c0aa00700 1 -- 172.21.15.148:0/1322087203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc009940 con 0x7f5c0c0fd540 2024-02-28T16:14:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.364+0000 7f5c0aa00700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c10ef10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc004e60 tx=0x7f5bfc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:20.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.365+0000 7f5c02a00700 1 -- 172.21.15.148:0/1322087203 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bfc01d440 con 0x7f5c0c0fd540 2024-02-28T16:14:20.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.365+0000 7f5c02a00700 1 -- 172.21.15.148:0/1322087203 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bfc01da70 con 0x7f5c0c0fd540 2024-02-28T16:14:20.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.365+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c10f650 con 0x7f5c0c0fd540 2024-02-28T16:14:20.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.365+0000 7f5c02a00700 1 -- 172.21.15.148:0/1322087203 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bfc012aa0 con 0x7f5c0c0fd540 2024-02-28T16:14:20.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.365+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c1102f0 con 0x7f5c0c0fd540 2024-02-28T16:14:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.366+0000 7f5c02a00700 1 -- 172.21.15.148:0/1322087203 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f5bfc019040 con 0x7f5c0c0fd540 2024-02-28T16:14:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.366+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c05f5c0 con 0x7f5c0c0fd540 2024-02-28T16:14:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.366+0000 7f5c02a00700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5bf00368c0 0x7f5bf0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.366+0000 7f5c02a00700 1 -- 172.21.15.148:0/1322087203 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5bfc04a2e0 con 0x7f5c0c0fd540 2024-02-28T16:14:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.367+0000 7f5c0a000700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5bf00368c0 0x7f5bf0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.367+0000 7f5c0a000700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5bf00368c0 0x7f5bf0038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009990 tx=0x7f5bf8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:20.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.372+0000 7f5c02a00700 1 -- 172.21.15.148:0/1322087203 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5bfc02eb40 con 0x7f5c0c0fd540 2024-02-28T16:14:20.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.603+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c0c0fba60 con 0x7f5bf00368c0 2024-02-28T16:14:20.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.605+0000 7f5c02a00700 1 -- 172.21.15.148:0/1322087203 <== mgr.14162 v2:172.21.15.148:6800/3553564677 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f5c0c0fba60 con 0x7f5bf00368c0 2024-02-28T16:14:20.597 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:14:20.597 INFO:teuthology.orchestra.run.smithi148.stdout:[{"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2024-02-28T16:14:20.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.608+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5bf00368c0 msgr2=0x7f5bf0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:20.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.608+0000 7f5c0be00700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5bf00368c0 0x7f5bf0038d70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009990 tx=0x7f5bf8006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:20.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.608+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 msgr2=0x7f5c0c10ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:20.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.608+0000 7f5c0be00700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c10ef10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc004e60 tx=0x7f5bfc004d10 comp rx=0 tx=0).stop 2024-02-28T16:14:20.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.609+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 shutdown_connections 2024-02-28T16:14:20.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.609+0000 7f5c0be00700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f5bf00368c0 0x7f5bf0038d70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:20.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.609+0000 7f5c0be00700 1 --2- 172.21.15.148:0/1322087203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c0c0fd540 0x7f5c0c10ef10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:20.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.609+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 >> 172.21.15.148:0/1322087203 conn(0x7f5c0c0f6fc0 msgr2=0x7f5c0c0fb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:20.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.609+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 shutdown_connections 2024-02-28T16:14:20.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:20.609+0000 7f5c0be00700 1 -- 172.21.15.148:0/1322087203 wait complete. 2024-02-28T16:14:21.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:21 smithi148 ceph-mon[28767]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:21.778 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:21 smithi148 ceph-mon[28767]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:14:22.517 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-28T16:14:22.518 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd crush tunables default 2024-02-28T16:14:22.987 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:14:23.729 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:23 smithi148 ceph-mon[28767]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:25.839 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:25 smithi148 ceph-mon[28767]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.106+0000 7f0db1000700 1 -- 172.21.15.148:0/3870197802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 msgr2=0x7f0dac1035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.106+0000 7f0db1000700 1 --2- 172.21.15.148:0/3870197802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1035e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0048c0 tx=0x7f0d9c009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.106+0000 7f0db1000700 1 -- 172.21.15.148:0/3870197802 shutdown_connections 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.106+0000 7f0db1000700 1 --2- 172.21.15.148:0/3870197802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1035e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.106+0000 7f0db1000700 1 -- 172.21.15.148:0/3870197802 >> 172.21.15.148:0/3870197802 conn(0x7f0dac0722d0 msgr2=0x7f0dac0746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.107+0000 7f0db1000700 1 -- 172.21.15.148:0/3870197802 shutdown_connections 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.107+0000 7f0db1000700 1 -- 172.21.15.148:0/3870197802 wait complete. 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.108+0000 7f0db1000700 1 Processor -- start 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.108+0000 7f0db1000700 1 -- start start 2024-02-28T16:14:26.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.108+0000 7f0db1000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.108+0000 7f0db1000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac113a30 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.108+0000 7f0da9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0da9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1134f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45336/0 (socket says 172.21.15.148:45336) 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0da9e00700 1 -- 172.21.15.148:0/3971732692 learned_addr learned my addr 172.21.15.148:0/3971732692 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0da9e00700 1 -- 172.21.15.148:0/3971732692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c005040 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0da9e00700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1134f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009680 tx=0x7f0d9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0da2000700 1 -- 172.21.15.148:0/3971732692 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d9c00bed0 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0da2000700 1 -- 172.21.15.148:0/3971732692 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d9c00b5c0 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac113c30 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.109+0000 7f0da2000700 1 -- 172.21.15.148:0/3971732692 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d9c01c5b0 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.110+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac1148d0 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.111+0000 7f0da2000700 1 -- 172.21.15.148:0/3971732692 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f0d9c013a80 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.111+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac05f5c0 con 0x7f0dac1031d0 2024-02-28T16:14:26.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.111+0000 7f0da2000700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f0d90036870 0x7f0d90038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:26.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.111+0000 7f0da2000700 1 -- 172.21.15.148:0/3971732692 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0d9c049ba0 con 0x7f0dac1031d0 2024-02-28T16:14:26.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.112+0000 7f0da9400700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f0d90036870 0x7f0d90038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:26.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.112+0000 7f0da9400700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f0d90036870 0x7f0d90038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009990 tx=0x7f0d98006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:26.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.117+0000 7f0da2000700 1 -- 172.21.15.148:0/3971732692 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0d9c011dd0 con 0x7f0dac1031d0 2024-02-28T16:14:26.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.334+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0dac115420 con 0x7f0dac1031d0 2024-02-28T16:14:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.617+0000 7f0da2000700 1 -- 172.21.15.148:0/3971732692 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0d9c011370 con 0x7f0dac1031d0 2024-02-28T16:14:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.621+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f0d90036870 msgr2=0x7f0d90038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.621+0000 7f0db1000700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f0d90036870 0x7f0d90038d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009990 tx=0x7f0d98006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.621+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 msgr2=0x7f0dac1134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.621+0000 7f0db1000700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1134f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009680 tx=0x7f0d9c009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:26.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.622+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 shutdown_connections 2024-02-28T16:14:26.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.622+0000 7f0db1000700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f0d90036870 0x7f0d90038d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:26.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.622+0000 7f0db1000700 1 --2- 172.21.15.148:0/3971732692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dac1031d0 0x7f0dac1134f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:26.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.622+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 >> 172.21.15.148:0/3971732692 conn(0x7f0dac0722d0 msgr2=0x7f0dac073070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:26.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.622+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 shutdown_connections 2024-02-28T16:14:26.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:14:26.622+0000 7f0db1000700 1 -- 172.21.15.148:0/3971732692 wait complete. 2024-02-28T16:14:26.615 INFO:teuthology.orchestra.run.smithi148.stderr:adjusted tunables profile to default 2024-02-28T16:14:26.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:26 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3971732692' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-28T16:14:27.485 INFO:tasks.cephadm:Adding mon.smithi148 on smithi148 2024-02-28T16:14:27.486 INFO:tasks.cephadm:Adding mon.smithi157 on smithi157 2024-02-28T16:14:27.486 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch apply mon '2;smithi148:172.21.15.148=smithi148;smithi157:172.21.15.157=smithi157' 2024-02-28T16:14:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:27 smithi148 ceph-mon[28767]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:27 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3971732692' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-28T16:14:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:27 smithi148 ceph-mon[28767]: osdmap e4: 0 total, 0 up, 0 in 2024-02-28T16:14:27.927 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:28.021 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:29 smithi148 ceph-mon[28767]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.699+0000 7ff496600700 1 -- 172.21.15.157:0/295433904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 msgr2=0x7ff490070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.699+0000 7ff496600700 1 --2- 172.21.15.157:0/295433904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff490070380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff4800048c0 tx=0x7ff480009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.699+0000 7ff496600700 1 -- 172.21.15.157:0/295433904 shutdown_connections 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.699+0000 7ff496600700 1 --2- 172.21.15.157:0/295433904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff490070380 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.699+0000 7ff496600700 1 -- 172.21.15.157:0/295433904 >> 172.21.15.157:0/295433904 conn(0x7ff4900f82a0 msgr2=0x7ff4900fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.699+0000 7ff496600700 1 -- 172.21.15.157:0/295433904 shutdown_connections 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.699+0000 7ff496600700 1 -- 172.21.15.157:0/295433904 wait complete. 2024-02-28T16:14:30.691 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.700+0000 7ff496600700 1 Processor -- start 2024-02-28T16:14:30.692 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.700+0000 7ff496600700 1 -- start start 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.700+0000 7ff496600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff49010f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.701+0000 7ff496600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49010f5c0 con 0x7ff490071f10 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.701+0000 7ff48f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff49010f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.701+0000 7ff48f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff49010f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:38592/0 (socket says 172.21.15.157:38592) 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.701+0000 7ff48f400700 1 -- 172.21.15.157:0/1424218242 learned_addr learned my addr 172.21.15.157:0/1424218242 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.702+0000 7ff48f400700 1 -- 172.21.15.157:0/1424218242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480005040 con 0x7ff490071f10 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.702+0000 7ff48f400700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff49010f080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff480009b80 tx=0x7ff480009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:30.693 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.702+0000 7ff487400700 1 -- 172.21.15.157:0/1424218242 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff48000b5c0 con 0x7ff490071f10 2024-02-28T16:14:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.702+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49010f7c0 con 0x7ff490071f10 2024-02-28T16:14:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.702+0000 7ff487400700 1 -- 172.21.15.157:0/1424218242 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff48000be70 con 0x7ff490071f10 2024-02-28T16:14:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.702+0000 7ff487400700 1 -- 172.21.15.157:0/1424218242 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff48001c660 con 0x7ff490071f10 2024-02-28T16:14:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.703+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff490110460 con 0x7ff490071f10 2024-02-28T16:14:30.694 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.704+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49005f5c0 con 0x7ff490071f10 2024-02-28T16:14:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.704+0000 7ff487400700 1 -- 172.21.15.157:0/1424218242 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7ff480004d30 con 0x7ff490071f10 2024-02-28T16:14:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.704+0000 7ff487400700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff474036870 0x7ff474038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:30.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.705+0000 7ff487400700 1 -- 172.21.15.157:0/1424218242 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff480049b40 con 0x7ff490071f10 2024-02-28T16:14:30.696 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.705+0000 7ff48ea00700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff474036870 0x7ff474038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:30.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.706+0000 7ff48ea00700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff474036870 0x7ff474038d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009990 tx=0x7ff47c006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:30.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.720+0000 7ff487400700 1 -- 172.21.15.157:0/1424218242 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff480025400 con 0x7ff490071f10 2024-02-28T16:14:30.954 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.963+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 --> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi148:172.21.15.148=smithi148;smithi157:172.21.15.157=smithi157", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4901110f0 con 0x7ff474036870 2024-02-28T16:14:30.968 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mon update... 2024-02-28T16:14:30.969 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.977+0000 7ff487400700 1 -- 172.21.15.157:0/1424218242 <== mgr.14162 v2:172.21.15.148:6800/3553564677 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff4901110f0 con 0x7ff474036870 2024-02-28T16:14:30.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff474036870 msgr2=0x7ff474038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:30.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff474036870 0x7ff474038d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff47c009990 tx=0x7ff47c006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:30.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 msgr2=0x7ff49010f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:30.971 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff49010f080 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff480009b80 tx=0x7ff480009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:30.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 shutdown_connections 2024-02-28T16:14:30.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff474036870 0x7ff474038d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:30.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 --2- 172.21.15.157:0/1424218242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff490071f10 0x7ff49010f080 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:30.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 >> 172.21.15.157:0/1424218242 conn(0x7ff4900f82a0 msgr2=0x7ff4900f8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:30.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 shutdown_connections 2024-02-28T16:14:30.972 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:30.980+0000 7ff496600700 1 -- 172.21.15.157:0/1424218242 wait complete. 2024-02-28T16:14:31.696 DEBUG:teuthology.orchestra.run.smithi157:mon.smithi157> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi157.service 2024-02-28T16:14:31.701 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:31.701 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:31 smithi148 ceph-mon[28767]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:31 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:31 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:31 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:31 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:31 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:32.131 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:32.227 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:32.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: from='client.14194 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi148:172.21.15.148=smithi148;smithi157:172.21.15.157=smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:14:32.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: Saving service mon spec with placement smithi148:172.21.15.148=smithi148;smithi157:172.21.15.157=smithi157;count:2 2024-02-28T16:14:32.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:32.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:32.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T16:14:32.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T16:14:32.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:32.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:32 smithi148 ceph-mon[28767]: Deploying daemon grafana.smithi148 on smithi148 2024-02-28T16:14:34.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:33 smithi148 ceph-mon[28767]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:34.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:33 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.147+0000 7fefc6800700 1 -- 172.21.15.157:0/1332647082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 msgr2=0x7fefc01035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.147+0000 7fefc6800700 1 --2- 172.21.15.157:0/1332647082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01035e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fefb00048c0 tx=0x7fefb0009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.147+0000 7fefc6800700 1 -- 172.21.15.157:0/1332647082 shutdown_connections 2024-02-28T16:14:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.147+0000 7fefc6800700 1 --2- 172.21.15.157:0/1332647082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01035e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.147+0000 7fefc6800700 1 -- 172.21.15.157:0/1332647082 >> 172.21.15.157:0/1332647082 conn(0x7fefc00722d0 msgr2=0x7fefc00746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.147+0000 7fefc6800700 1 -- 172.21.15.157:0/1332647082 shutdown_connections 2024-02-28T16:14:34.139 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.147+0000 7fefc6800700 1 -- 172.21.15.157:0/1332647082 wait complete. 2024-02-28T16:14:34.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.148+0000 7fefc6800700 1 Processor -- start 2024-02-28T16:14:34.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.149+0000 7fefc6800700 1 -- start start 2024-02-28T16:14:34.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.149+0000 7fefc6800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:34.140 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.149+0000 7fefc6800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0113a20 con 0x7fefc01031d0 2024-02-28T16:14:34.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.150+0000 7fefbf400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:34.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.150+0000 7fefbf400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01134e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:38616/0 (socket says 172.21.15.157:38616) 2024-02-28T16:14:34.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.150+0000 7fefbf400700 1 -- 172.21.15.157:0/2600232565 learned_addr learned my addr 172.21.15.157:0/2600232565 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:14:34.141 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.151+0000 7fefbf400700 1 -- 172.21.15.157:0/2600232565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0005040 con 0x7fefc01031d0 2024-02-28T16:14:34.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.151+0000 7fefbf400700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01134e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009680 tx=0x7fefb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:34.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.151+0000 7fefb7400700 1 -- 172.21.15.157:0/2600232565 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb000bed0 con 0x7fefc01031d0 2024-02-28T16:14:34.142 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.152+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc0113c20 con 0x7fefc01031d0 2024-02-28T16:14:34.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.152+0000 7fefb7400700 1 -- 172.21.15.157:0/2600232565 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefb000b5c0 con 0x7fefc01031d0 2024-02-28T16:14:34.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.152+0000 7fefb7400700 1 -- 172.21.15.157:0/2600232565 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fefb001c5b0 con 0x7fefc01031d0 2024-02-28T16:14:34.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.152+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc01148c0 con 0x7fefc01031d0 2024-02-28T16:14:34.143 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.153+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc005f5c0 con 0x7fefc01031d0 2024-02-28T16:14:34.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.153+0000 7fefb7400700 1 -- 172.21.15.157:0/2600232565 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fefb0013a80 con 0x7fefc01031d0 2024-02-28T16:14:34.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.154+0000 7fefb7400700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fefa4036870 0x7fefa4038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:34.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.154+0000 7fefb7400700 1 -- 172.21.15.157:0/2600232565 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fefb0049b60 con 0x7fefc01031d0 2024-02-28T16:14:34.145 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.154+0000 7fefbea00700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fefa4036870 0x7fefa4038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:34.146 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.155+0000 7fefbea00700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fefa4036870 0x7fefa4038d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fefac009990 tx=0x7fefac006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:34.160 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.169+0000 7fefb7400700 1 -- 172.21.15.157:0/2600232565 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fefb0011960 con 0x7fefc01031d0 2024-02-28T16:14:34.450 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.458+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fefc0115410 con 0x7fefc01031d0 2024-02-28T16:14:34.451 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.460+0000 7fefb7400700 1 -- 172.21.15.157:0/2600232565 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fefb0011370 con 0x7fefc01031d0 2024-02-28T16:14:34.451 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:14:34.451 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:34.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fefa4036870 msgr2=0x7fefa4038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:34.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fefa4036870 0x7fefa4038d20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fefac009990 tx=0x7fefac006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:34.453 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 msgr2=0x7fefc01134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:34.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01134e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009680 tx=0x7fefb0009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:34.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 shutdown_connections 2024-02-28T16:14:34.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fefa4036870 0x7fefa4038d20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:34.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 --2- 172.21.15.157:0/2600232565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fefc01031d0 0x7fefc01134e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:34.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 >> 172.21.15.157:0/2600232565 conn(0x7fefc00722d0 msgr2=0x7fefc0073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:34.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 shutdown_connections 2024-02-28T16:14:34.454 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:34.463+0000 7fefc6800700 1 -- 172.21.15.157:0/2600232565 wait complete. 2024-02-28T16:14:34.455 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:14:35.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:34 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2600232565' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:36.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:35 smithi148 ceph-mon[28767]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:36.241 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:36.241 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:36.678 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:36.779 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:37 smithi148 ceph-mon[28767]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:38.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.968+0000 7f23cb000700 1 -- 172.21.15.157:0/1881303063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 msgr2=0x7f23c40fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:38.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.968+0000 7f23cb000700 1 --2- 172.21.15.157:0/1881303063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c40fcfd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23b40048c0 tx=0x7f23b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:38.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.969+0000 7f23cb000700 1 -- 172.21.15.157:0/1881303063 shutdown_connections 2024-02-28T16:14:38.960 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.969+0000 7f23cb000700 1 --2- 172.21.15.157:0/1881303063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c40fcfd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.969+0000 7f23cb000700 1 -- 172.21.15.157:0/1881303063 >> 172.21.15.157:0/1881303063 conn(0x7f23c40f82a0 msgr2=0x7f23c40fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.969+0000 7f23cb000700 1 -- 172.21.15.157:0/1881303063 shutdown_connections 2024-02-28T16:14:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.969+0000 7f23cb000700 1 -- 172.21.15.157:0/1881303063 wait complete. 2024-02-28T16:14:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.970+0000 7f23cb000700 1 Processor -- start 2024-02-28T16:14:38.961 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.970+0000 7f23cb000700 1 -- start start 2024-02-28T16:14:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.970+0000 7f23cb000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c410f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.970+0000 7f23cb000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c410f610 con 0x7f23c40fcbc0 2024-02-28T16:14:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.971+0000 7f23c3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c410f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.971+0000 7f23c3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c410f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:39038/0 (socket says 172.21.15.157:39038) 2024-02-28T16:14:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.971+0000 7f23c3e00700 1 -- 172.21.15.157:0/1168290546 learned_addr learned my addr 172.21.15.157:0/1168290546 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:14:38.962 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.971+0000 7f23c3e00700 1 -- 172.21.15.157:0/1168290546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4005040 con 0x7f23c40fcbc0 2024-02-28T16:14:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.972+0000 7f23c3e00700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c410f0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009680 tx=0x7f23b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.972+0000 7f23bbe00700 1 -- 172.21.15.157:0/1168290546 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23b400bed0 con 0x7f23c40fcbc0 2024-02-28T16:14:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.972+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c410f810 con 0x7f23c40fcbc0 2024-02-28T16:14:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.972+0000 7f23bbe00700 1 -- 172.21.15.157:0/1168290546 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23b400b5c0 con 0x7f23c40fcbc0 2024-02-28T16:14:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.972+0000 7f23bbe00700 1 -- 172.21.15.157:0/1168290546 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f23b401c5b0 con 0x7f23c40fcbc0 2024-02-28T16:14:38.963 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.972+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c41104b0 con 0x7f23c40fcbc0 2024-02-28T16:14:38.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.973+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c405f5c0 con 0x7f23c40fcbc0 2024-02-28T16:14:38.964 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.974+0000 7f23bbe00700 1 -- 172.21.15.157:0/1168290546 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f23b4013a80 con 0x7f23c40fcbc0 2024-02-28T16:14:38.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.974+0000 7f23bbe00700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f23a8036820 0x7f23a8038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:38.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.974+0000 7f23bbe00700 1 -- 172.21.15.157:0/1168290546 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f23b4049bb0 con 0x7f23c40fcbc0 2024-02-28T16:14:38.965 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.975+0000 7f23c3400700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f23a8036820 0x7f23a8038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:38.966 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.976+0000 7f23c3400700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f23a8036820 0x7f23a8038cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009990 tx=0x7f23b0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:38.990 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:38.999+0000 7f23bbe00700 1 -- 172.21.15.157:0/1168290546 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f23b4011960 con 0x7f23c40fcbc0 2024-02-28T16:14:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.289+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f23c4110830 con 0x7f23c40fcbc0 2024-02-28T16:14:39.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.290+0000 7f23bbe00700 1 -- 172.21.15.157:0/1168290546 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f23b4011370 con 0x7f23c40fcbc0 2024-02-28T16:14:39.281 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:14:39.281 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:39.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.292+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f23a8036820 msgr2=0x7f23a8038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.292+0000 7f23cb000700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f23a8036820 0x7f23a8038cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009990 tx=0x7f23b0006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.292+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 msgr2=0x7f23c410f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.292+0000 7f23cb000700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c410f0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009680 tx=0x7f23b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.293+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 shutdown_connections 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.293+0000 7f23cb000700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f23a8036820 0x7f23a8038cd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.293+0000 7f23cb000700 1 --2- 172.21.15.157:0/1168290546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23c40fcbc0 0x7f23c410f0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.293+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 >> 172.21.15.157:0/1168290546 conn(0x7f23c40f82a0 msgr2=0x7f23c40701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.293+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 shutdown_connections 2024-02-28T16:14:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:39.293+0000 7f23cb000700 1 -- 172.21.15.157:0/1168290546 wait complete. 2024-02-28T16:14:39.285 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:14:40.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:39 smithi148 ceph-mon[28767]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:40.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:39 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/1168290546' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:41.000 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:41.000 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:41.458 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:41.552 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:41 smithi148 ceph-mon[28767]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.500+0000 7f64e4600700 1 -- 172.21.15.157:0/3887031436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 msgr2=0x7f64dc0fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.500+0000 7f64e4600700 1 --2- 172.21.15.157:0/3887031436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc0fcfd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64d00048c0 tx=0x7f64d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.500+0000 7f64e4600700 1 -- 172.21.15.157:0/3887031436 shutdown_connections 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.500+0000 7f64e4600700 1 --2- 172.21.15.157:0/3887031436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc0fcfd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.500+0000 7f64e4600700 1 -- 172.21.15.157:0/3887031436 >> 172.21.15.157:0/3887031436 conn(0x7f64dc0f82a0 msgr2=0x7f64dc0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.500+0000 7f64e4600700 1 -- 172.21.15.157:0/3887031436 shutdown_connections 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.500+0000 7f64e4600700 1 -- 172.21.15.157:0/3887031436 wait complete. 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.501+0000 7f64e4600700 1 Processor -- start 2024-02-28T16:14:43.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.501+0000 7f64e4600700 1 -- start start 2024-02-28T16:14:43.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.502+0000 7f64e4600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc10cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:43.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.502+0000 7f64e4600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc10d420 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.502+0000 7f64e1c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc10cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:43.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.502+0000 7f64e1c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc10cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:39056/0 (socket says 172.21.15.157:39056) 2024-02-28T16:14:43.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.502+0000 7f64e1c00700 1 -- 172.21.15.157:0/530262785 learned_addr learned my addr 172.21.15.157:0/530262785 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:14:43.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.503+0000 7f64e1c00700 1 -- 172.21.15.157:0/530262785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0005040 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.503+0000 7f64e1c00700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc10cee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009b80 tx=0x7f64d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.504+0000 7f64d9600700 1 -- 172.21.15.157:0/530262785 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64d000b5c0 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.504+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc10d620 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.504+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc10e2c0 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.504+0000 7f64d9600700 1 -- 172.21.15.157:0/530262785 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f64d000be70 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.504+0000 7f64d9600700 1 -- 172.21.15.157:0/530262785 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f64d00255c0 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.505+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc0052e0 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.505+0000 7f64d9600700 1 -- 172.21.15.157:0/530262785 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f64d0004d30 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.506+0000 7f64d9600700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f64c4036870 0x7f64c4038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:43.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.506+0000 7f64d9600700 1 -- 172.21.15.157:0/530262785 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f64d0049a00 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.506+0000 7f64e1200700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f64c4036870 0x7f64c4038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:43.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.507+0000 7f64e1200700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f64c4036870 0x7f64c4038d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009990 tx=0x7f64c8006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:43.513 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.523+0000 7f64d9600700 1 -- 172.21.15.157:0/530262785 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f64d00238f0 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.809+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f64bc005590 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.810+0000 7f64d9600700 1 -- 172.21.15.157:0/530262785 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f64d0011370 con 0x7f64dc0fcbc0 2024-02-28T16:14:43.802 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:14:43.802 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:43.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f64c4036870 msgr2=0x7f64c4038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:43.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f64c4036870 0x7f64c4038d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009990 tx=0x7f64c8006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:43.804 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 msgr2=0x7f64dc10cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc10cee0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009b80 tx=0x7f64d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 shutdown_connections 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f64c4036870 0x7f64c4038d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 --2- 172.21.15.157:0/530262785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f64dc0fcbc0 0x7f64dc10cee0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 >> 172.21.15.157:0/530262785 conn(0x7f64dc0f82a0 msgr2=0x7f64dc0f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.813+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 shutdown_connections 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:43.814+0000 7f64e4600700 1 -- 172.21.15.157:0/530262785 wait complete. 2024-02-28T16:14:43.805 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:14:44.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:43 smithi148 ceph-mon[28767]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:45.027 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:44 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/530262785' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:45.581 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:45.582 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:46.035 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:46.060 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:45 smithi148 ceph-mon[28767]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:46.134 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:48.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:47 smithi148 ceph-mon[28767]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:48.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.187+0000 7f751b000700 1 -- 172.21.15.157:0/2201763697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 msgr2=0x7f75140ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:48.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.187+0000 7f751b000700 1 --2- 172.21.15.157:0/2201763697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f75140ff260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75040048c0 tx=0x7f7504009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:48.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.187+0000 7f751b000700 1 -- 172.21.15.157:0/2201763697 shutdown_connections 2024-02-28T16:14:48.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.187+0000 7f751b000700 1 --2- 172.21.15.157:0/2201763697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f75140ff260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:48.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.187+0000 7f751b000700 1 -- 172.21.15.157:0/2201763697 >> 172.21.15.157:0/2201763697 conn(0x7f75140fa5a0 msgr2=0x7f75140fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:48.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.187+0000 7f751b000700 1 -- 172.21.15.157:0/2201763697 shutdown_connections 2024-02-28T16:14:48.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.187+0000 7f751b000700 1 -- 172.21.15.157:0/2201763697 wait complete. 2024-02-28T16:14:48.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.188+0000 7f751b000700 1 Processor -- start 2024-02-28T16:14:48.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.189+0000 7f751b000700 1 -- start start 2024-02-28T16:14:48.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.189+0000 7f751b000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f751410f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:48.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.189+0000 7f751b000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751410f5d0 con 0x7f75140fee50 2024-02-28T16:14:48.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.189+0000 7f7513e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f751410f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:48.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.190+0000 7f7513e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f751410f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:39080/0 (socket says 172.21.15.157:39080) 2024-02-28T16:14:48.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.190+0000 7f7513e00700 1 -- 172.21.15.157:0/2341912529 learned_addr learned my addr 172.21.15.157:0/2341912529 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:14:48.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.190+0000 7f7513e00700 1 -- 172.21.15.157:0/2341912529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504005040 con 0x7f75140fee50 2024-02-28T16:14:48.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.191+0000 7f7513e00700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f751410f090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7504009b80 tx=0x7f7504009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:48.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.191+0000 7f750be00700 1 -- 172.21.15.157:0/2341912529 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f750400b5c0 con 0x7f75140fee50 2024-02-28T16:14:48.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.191+0000 7f750be00700 1 -- 172.21.15.157:0/2341912529 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f750400be70 con 0x7f75140fee50 2024-02-28T16:14:48.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.191+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751410f7d0 con 0x7f75140fee50 2024-02-28T16:14:48.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.191+0000 7f750be00700 1 -- 172.21.15.157:0/2341912529 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f750401c660 con 0x7f75140fee50 2024-02-28T16:14:48.182 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.191+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7514110470 con 0x7f75140fee50 2024-02-28T16:14:48.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.192+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751405f5c0 con 0x7f75140fee50 2024-02-28T16:14:48.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.193+0000 7f750be00700 1 -- 172.21.15.157:0/2341912529 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f7504013420 con 0x7f75140fee50 2024-02-28T16:14:48.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.193+0000 7f750be00700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f74f8036870 0x7f74f8038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:48.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.193+0000 7f750be00700 1 -- 172.21.15.157:0/2341912529 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7504049b30 con 0x7f75140fee50 2024-02-28T16:14:48.184 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.194+0000 7f7513400700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f74f8036870 0x7f74f8038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:48.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.195+0000 7f7513400700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f74f8036870 0x7f74f8038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7500009990 tx=0x7f7500006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:48.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.208+0000 7f750be00700 1 -- 172.21.15.157:0/2341912529 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f7504013b10 con 0x7f75140fee50 2024-02-28T16:14:48.485 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.494+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7514110fc0 con 0x7f75140fee50 2024-02-28T16:14:48.486 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.495+0000 7f750be00700 1 -- 172.21.15.157:0/2341912529 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f7504011370 con 0x7f75140fee50 2024-02-28T16:14:48.487 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:14:48.487 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f74f8036870 msgr2=0x7f74f8038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f74f8036870 0x7f74f8038d20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7500009990 tx=0x7f7500006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 msgr2=0x7f751410f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f751410f090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7504009b80 tx=0x7f7504009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 shutdown_connections 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f74f8036870 0x7f74f8038d20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 --2- 172.21.15.157:0/2341912529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f75140fee50 0x7f751410f090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 >> 172.21.15.157:0/2341912529 conn(0x7f75140fa5a0 msgr2=0x7f75140fb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 shutdown_connections 2024-02-28T16:14:48.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:48.499+0000 7f751b000700 1 -- 172.21.15.157:0/2341912529 wait complete. 2024-02-28T16:14:48.491 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:14:49.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:48 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2341912529' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:49.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:49 smithi148 ceph-mon[28767]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:50.237 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:50.237 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:50.671 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:50.769 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:52.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:51 smithi148 ceph-mon[28767]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:52.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.003+0000 7fb873c00700 1 -- 172.21.15.157:0/28358515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 msgr2=0x7fb86c0fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:52.994 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.003+0000 7fb873c00700 1 --2- 172.21.15.157:0/28358515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c0fcfd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb8600048c0 tx=0x7fb860009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.003+0000 7fb873c00700 1 -- 172.21.15.157:0/28358515 shutdown_connections 2024-02-28T16:14:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.003+0000 7fb873c00700 1 --2- 172.21.15.157:0/28358515 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c0fcfd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.003+0000 7fb873c00700 1 -- 172.21.15.157:0/28358515 >> 172.21.15.157:0/28358515 conn(0x7fb86c0f82a0 msgr2=0x7fb86c0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.003+0000 7fb873c00700 1 -- 172.21.15.157:0/28358515 shutdown_connections 2024-02-28T16:14:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.003+0000 7fb873c00700 1 -- 172.21.15.157:0/28358515 wait complete. 2024-02-28T16:14:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.004+0000 7fb873c00700 1 Processor -- start 2024-02-28T16:14:52.995 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.004+0000 7fb873c00700 1 -- start start 2024-02-28T16:14:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.004+0000 7fb873c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c10f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.004+0000 7fb873c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c10f600 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.005+0000 7fb871200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c10f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.005+0000 7fb871200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c10f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:43906/0 (socket says 172.21.15.157:43906) 2024-02-28T16:14:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.005+0000 7fb871200700 1 -- 172.21.15.157:0/756638035 learned_addr learned my addr 172.21.15.157:0/756638035 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:14:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.006+0000 7fb871200700 1 -- 172.21.15.157:0/756638035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860005040 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.006+0000 7fb871200700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c10f0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb860009b80 tx=0x7fb860009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.006+0000 7fb868c00700 1 -- 172.21.15.157:0/756638035 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb86000b5c0 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.006+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c10f800 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.007+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c1104a0 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.007+0000 7fb868c00700 1 -- 172.21.15.157:0/756638035 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb86000be70 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.997 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.007+0000 7fb868c00700 1 -- 172.21.15.157:0/756638035 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb8600255c0 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.008+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c05f5c0 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.008+0000 7fb868c00700 1 -- 172.21.15.157:0/756638035 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fb860013420 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.008+0000 7fb868c00700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fb854036870 0x7fb854038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.008+0000 7fb868c00700 1 -- 172.21.15.157:0/756638035 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb860049a00 con 0x7fb86c0fcbc0 2024-02-28T16:14:52.999 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.009+0000 7fb86be00700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fb854036870 0x7fb854038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:53.001 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.010+0000 7fb86be00700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fb854036870 0x7fb854038d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb858009990 tx=0x7fb858006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:53.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.024+0000 7fb868c00700 1 -- 172.21.15.157:0/756638035 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb860013a60 con 0x7fb86c0fcbc0 2024-02-28T16:14:53.298 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.307+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb86c04bed0 con 0x7fb86c0fcbc0 2024-02-28T16:14:53.299 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.308+0000 7fb868c00700 1 -- 172.21.15.157:0/756638035 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fb860023300 con 0x7fb86c0fcbc0 2024-02-28T16:14:53.299 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:14:53.299 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fb854036870 msgr2=0x7fb854038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fb854036870 0x7fb854038d20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb858009990 tx=0x7fb858006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:53.301 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 msgr2=0x7fb86c10f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c10f0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb860009b80 tx=0x7fb860009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 shutdown_connections 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fb854036870 0x7fb854038d20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 --2- 172.21.15.157:0/756638035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb86c0fcbc0 0x7fb86c10f0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 >> 172.21.15.157:0/756638035 conn(0x7fb86c0f82a0 msgr2=0x7fb86c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 shutdown_connections 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:53.310+0000 7fb873c00700 1 -- 172.21.15.157:0/756638035 wait complete. 2024-02-28T16:14:53.302 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:14:53.765 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:53.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:53.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:53.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:53.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:53.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:53.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:53.766 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:53 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/756638035' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:55.060 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:55.060 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:14:55.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:54 smithi148 ceph-mon[28767]: Deploying daemon prometheus.smithi148 on smithi148 2024-02-28T16:14:55.499 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:55.601 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:14:56.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:55 smithi148 ceph-mon[28767]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:57.715 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.724+0000 7f27ce800700 1 -- 172.21.15.157:0/1210457458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 msgr2=0x7f27c81035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:57.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.724+0000 7f27ce800700 1 --2- 172.21.15.157:0/1210457458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81035e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27b80048c0 tx=0x7f27b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:57.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.724+0000 7f27ce800700 1 -- 172.21.15.157:0/1210457458 shutdown_connections 2024-02-28T16:14:57.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.724+0000 7f27ce800700 1 --2- 172.21.15.157:0/1210457458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81035e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:57.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.724+0000 7f27ce800700 1 -- 172.21.15.157:0/1210457458 >> 172.21.15.157:0/1210457458 conn(0x7f27c80722d0 msgr2=0x7f27c80746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:57.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.724+0000 7f27ce800700 1 -- 172.21.15.157:0/1210457458 shutdown_connections 2024-02-28T16:14:57.716 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.725+0000 7f27ce800700 1 -- 172.21.15.157:0/1210457458 wait complete. 2024-02-28T16:14:57.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.725+0000 7f27ce800700 1 Processor -- start 2024-02-28T16:14:57.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.726+0000 7f27ce800700 1 -- start start 2024-02-28T16:14:57.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.726+0000 7f27ce800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:57.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.726+0000 7f27ce800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c8113a20 con 0x7f27c81031d0 2024-02-28T16:14:57.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.727+0000 7f27c7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:57.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.727+0000 7f27c7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81134e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:43936/0 (socket says 172.21.15.157:43936) 2024-02-28T16:14:57.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.727+0000 7f27c7400700 1 -- 172.21.15.157:0/2146233128 learned_addr learned my addr 172.21.15.157:0/2146233128 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:14:57.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.727+0000 7f27c7400700 1 -- 172.21.15.157:0/2146233128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8005040 con 0x7f27c81031d0 2024-02-28T16:14:57.719 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.728+0000 7f27c7400700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81134e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009b80 tx=0x7f27b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:57.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.732+0000 7f27bf400700 1 -- 172.21.15.157:0/2146233128 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27b800b5c0 con 0x7f27c81031d0 2024-02-28T16:14:57.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.732+0000 7f27bf400700 1 -- 172.21.15.157:0/2146233128 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27b800be70 con 0x7f27c81031d0 2024-02-28T16:14:57.723 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.733+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c8113c20 con 0x7f27c81031d0 2024-02-28T16:14:57.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.733+0000 7f27bf400700 1 -- 172.21.15.157:0/2146233128 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27b801c660 con 0x7f27c81031d0 2024-02-28T16:14:57.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.733+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c81148c0 con 0x7f27c81031d0 2024-02-28T16:14:57.724 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.734+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c805f5c0 con 0x7f27c81031d0 2024-02-28T16:14:57.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.734+0000 7f27bf400700 1 -- 172.21.15.157:0/2146233128 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f27b8004d30 con 0x7f27c81031d0 2024-02-28T16:14:57.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.735+0000 7f27bf400700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f27ac0368c0 0x7f27ac038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:14:57.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.735+0000 7f27bf400700 1 -- 172.21.15.157:0/2146233128 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f27b8049aa0 con 0x7f27c81031d0 2024-02-28T16:14:57.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.736+0000 7f27bfe00700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f27ac0368c0 0x7f27ac038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:14:57.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.737+0000 7f27bfe00700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f27ac0368c0 0x7f27ac038d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009990 tx=0x7f27b0006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:14:57.741 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:57.750+0000 7f27bf400700 1 -- 172.21.15.157:0/2146233128 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f27b8025400 con 0x7f27c81031d0 2024-02-28T16:14:58.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.038+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f27c8115410 con 0x7f27c81031d0 2024-02-28T16:14:58.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.039+0000 7f27bf400700 1 -- 172.21.15.157:0/2146233128 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f27b8011370 con 0x7f27c81031d0 2024-02-28T16:14:58.030 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:14:58.030 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f27ac0368c0 msgr2=0x7f27ac038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f27ac0368c0 0x7f27ac038d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f27b0009990 tx=0x7f27b0006e40 comp rx=0 tx=0).stop 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 msgr2=0x7f27c81134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81134e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009b80 tx=0x7f27b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 shutdown_connections 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f27ac0368c0 0x7f27ac038d70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 --2- 172.21.15.157:0/2146233128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c81031d0 0x7f27c81134e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 >> 172.21.15.157:0/2146233128 conn(0x7f27c80722d0 msgr2=0x7f27c8073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 shutdown_connections 2024-02-28T16:14:58.033 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:14:58.042+0000 7f27ce800700 1 -- 172.21.15.157:0/2146233128 wait complete. 2024-02-28T16:14:58.034 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:14:58.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:57 smithi148 ceph-mon[28767]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:14:59.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:58 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2146233128' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:14:59.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:58 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:14:59.747 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:14:59.747 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:00.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:14:59 smithi148 ceph-mon[28767]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:00.190 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:00.296 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:02.079 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:01 smithi148 ceph-mon[28767]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.359+0000 7f97b2c00700 1 -- 172.21.15.157:0/2160267783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 msgr2=0x7f97ac1035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.359+0000 7f97b2c00700 1 --2- 172.21.15.157:0/2160267783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1035e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f979c0048c0 tx=0x7f979c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.359+0000 7f97b2c00700 1 -- 172.21.15.157:0/2160267783 shutdown_connections 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.359+0000 7f97b2c00700 1 --2- 172.21.15.157:0/2160267783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1035e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.359+0000 7f97b2c00700 1 -- 172.21.15.157:0/2160267783 >> 172.21.15.157:0/2160267783 conn(0x7f97ac0722d0 msgr2=0x7f97ac0746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.359+0000 7f97b2c00700 1 -- 172.21.15.157:0/2160267783 shutdown_connections 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.359+0000 7f97b2c00700 1 -- 172.21.15.157:0/2160267783 wait complete. 2024-02-28T16:15:02.351 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.360+0000 7f97b2c00700 1 Processor -- start 2024-02-28T16:15:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.361+0000 7f97b2c00700 1 -- start start 2024-02-28T16:15:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.361+0000 7f97b2c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1134e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.361+0000 7f97b2c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac113a20 con 0x7f97ac1031d0 2024-02-28T16:15:02.352 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.361+0000 7f97abe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:02.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.361+0000 7f97abe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1134e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:35026/0 (socket says 172.21.15.157:35026) 2024-02-28T16:15:02.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.361+0000 7f97abe00700 1 -- 172.21.15.157:0/774554700 learned_addr learned my addr 172.21.15.157:0/774554700 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:02.353 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.362+0000 7f97abe00700 1 -- 172.21.15.157:0/774554700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c005040 con 0x7f97ac1031d0 2024-02-28T16:15:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.362+0000 7f97abe00700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1134e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f979c009040 tx=0x7f979c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.362+0000 7f97a3e00700 1 -- 172.21.15.157:0/774554700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f979c00b5c0 con 0x7f97ac1031d0 2024-02-28T16:15:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.362+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac113c20 con 0x7f97ac1031d0 2024-02-28T16:15:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.362+0000 7f97a3e00700 1 -- 172.21.15.157:0/774554700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f979c004e60 con 0x7f97ac1031d0 2024-02-28T16:15:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.362+0000 7f97a3e00700 1 -- 172.21.15.157:0/774554700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f979c01c5c0 con 0x7f97ac1031d0 2024-02-28T16:15:02.354 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.363+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac1148c0 con 0x7f97ac1031d0 2024-02-28T16:15:02.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.363+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac05f5c0 con 0x7f97ac1031d0 2024-02-28T16:15:02.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.364+0000 7f97a3e00700 1 -- 172.21.15.157:0/774554700 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f979c0097e0 con 0x7f97ac1031d0 2024-02-28T16:15:02.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.364+0000 7f97a3e00700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f9790036910 0x7f9790038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:02.355 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.364+0000 7f97a3e00700 1 -- 172.21.15.157:0/774554700 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f979c04a100 con 0x7f97ac1031d0 2024-02-28T16:15:02.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.368+0000 7f97ab400700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f9790036910 0x7f9790038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:02.359 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.369+0000 7f97ab400700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f9790036910 0x7f9790038dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9798009990 tx=0x7f9798006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:02.365 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.374+0000 7f97a3e00700 1 -- 172.21.15.157:0/774554700 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f979c011940 con 0x7f97ac1031d0 2024-02-28T16:15:02.629 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.638+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f97ac1153b0 con 0x7f97ac1031d0 2024-02-28T16:15:02.630 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.639+0000 7f97a3e00700 1 -- 172.21.15.157:0/774554700 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f979c020070 con 0x7f97ac1031d0 2024-02-28T16:15:02.630 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:02.630 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f9790036910 msgr2=0x7f9790038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f9790036910 0x7f9790038dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9798009990 tx=0x7f9798006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 msgr2=0x7f97ac1134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1134e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f979c009040 tx=0x7f979c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 shutdown_connections 2024-02-28T16:15:02.633 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f9790036910 0x7f9790038dc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 --2- 172.21.15.157:0/774554700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97ac1031d0 0x7f97ac1134e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.642+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 >> 172.21.15.157:0/774554700 conn(0x7f97ac0722d0 msgr2=0x7f97ac073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.643+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 shutdown_connections 2024-02-28T16:15:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:02.643+0000 7f97b2c00700 1 -- 172.21.15.157:0/774554700 wait complete. 2024-02-28T16:15:02.634 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:03.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:02 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/774554700' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:04.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:03 smithi148 ceph-mon[28767]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:04.560 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:04.561 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:04.994 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:05.101 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:05.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:05 smithi148 ceph-mon[28767]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:07.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.182+0000 7fa381a00700 1 -- 172.21.15.157:0/472077179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 msgr2=0x7fa37c0fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:07.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.182+0000 7fa381a00700 1 --2- 172.21.15.157:0/472077179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c0fcfe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa36c0048c0 tx=0x7fa36c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:07.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.182+0000 7fa381a00700 1 -- 172.21.15.157:0/472077179 shutdown_connections 2024-02-28T16:15:07.175 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.182+0000 7fa381a00700 1 --2- 172.21.15.157:0/472077179 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c0fcfe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:07.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.182+0000 7fa381a00700 1 -- 172.21.15.157:0/472077179 >> 172.21.15.157:0/472077179 conn(0x7fa37c0f8270 msgr2=0x7fa37c0fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:07.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.183+0000 7fa381a00700 1 -- 172.21.15.157:0/472077179 shutdown_connections 2024-02-28T16:15:07.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.183+0000 7fa381a00700 1 -- 172.21.15.157:0/472077179 wait complete. 2024-02-28T16:15:07.176 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.184+0000 7fa381a00700 1 Processor -- start 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.184+0000 7fa381a00700 1 -- start start 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.184+0000 7fa381a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c10cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.184+0000 7fa381a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c10d400 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.185+0000 7fa37aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c10cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.185+0000 7fa37aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c10cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:35046/0 (socket says 172.21.15.157:35046) 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.185+0000 7fa37aa00700 1 -- 172.21.15.157:0/372562077 learned_addr learned my addr 172.21.15.157:0/372562077 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.186+0000 7fa37aa00700 1 -- 172.21.15.157:0/372562077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c005040 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.177 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.186+0000 7fa37aa00700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c10cec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009b80 tx=0x7fa36c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.186+0000 7fa372a00700 1 -- 172.21.15.157:0/372562077 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa36c00b5c0 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.186+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c10d600 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.187+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c10e2a0 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.187+0000 7fa372a00700 1 -- 172.21.15.157:0/372562077 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa36c00be70 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.178 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.187+0000 7fa372a00700 1 -- 172.21.15.157:0/372562077 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa36c0255c0 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.188+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c05f5c0 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.179 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.188+0000 7fa372a00700 1 -- 172.21.15.157:0/372562077 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fa36c004d30 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.189+0000 7fa372a00700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa360036870 0x7fa360038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:07.180 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.189+0000 7fa372a00700 1 -- 172.21.15.157:0/372562077 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa36c049ae0 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.189+0000 7fa37a000700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa360036870 0x7fa360038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:07.181 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.190+0000 7fa37a000700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa360036870 0x7fa360038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa368009990 tx=0x7fa368006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:07.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.204+0000 7fa372a00700 1 -- 172.21.15.157:0/372562077 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa36c0238f0 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.492+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa37c04bed0 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.484 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.493+0000 7fa372a00700 1 -- 172.21.15.157:0/372562077 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fa36c023300 con 0x7fa37c0fcbd0 2024-02-28T16:15:07.485 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:07.485 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa360036870 msgr2=0x7fa360038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa360036870 0x7fa360038d20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa368009990 tx=0x7fa368006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 msgr2=0x7fa37c10cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c10cec0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009b80 tx=0x7fa36c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 shutdown_connections 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fa360036870 0x7fa360038d20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 --2- 172.21.15.157:0/372562077 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa37c0fcbd0 0x7fa37c10cec0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 >> 172.21.15.157:0/372562077 conn(0x7fa37c0f8270 msgr2=0x7fa37c0f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 shutdown_connections 2024-02-28T16:15:07.488 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:07.496+0000 7fa381a00700 1 -- 172.21.15.157:0/372562077 wait complete. 2024-02-28T16:15:07.489 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:07.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:07 smithi148 ceph-mon[28767]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:07.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:07 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/372562077' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:09.291 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:09.291 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:09.727 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:09.827 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:09.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:09 smithi148 ceph-mon[28767]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:11.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.787+0000 7f3151800700 1 -- 172.21.15.157:0/87883680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 msgr2=0x7f314c0ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:11.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.787+0000 7f3151800700 1 --2- 172.21.15.157:0/87883680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c0ff1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f313c0048c0 tx=0x7f313c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:11.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.787+0000 7f3151800700 1 -- 172.21.15.157:0/87883680 shutdown_connections 2024-02-28T16:15:11.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.787+0000 7f3151800700 1 --2- 172.21.15.157:0/87883680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c0ff1e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:11.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.787+0000 7f3151800700 1 -- 172.21.15.157:0/87883680 >> 172.21.15.157:0/87883680 conn(0x7f314c0fa5a0 msgr2=0x7f314c0fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:11.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.787+0000 7f3151800700 1 -- 172.21.15.157:0/87883680 shutdown_connections 2024-02-28T16:15:11.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.787+0000 7f3151800700 1 -- 172.21.15.157:0/87883680 wait complete. 2024-02-28T16:15:11.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.788+0000 7f3151800700 1 Processor -- start 2024-02-28T16:15:11.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.788+0000 7f3151800700 1 -- start start 2024-02-28T16:15:11.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.789+0000 7f3151800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c10f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:11.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.789+0000 7f3151800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c10f650 con 0x7f314c0fedd0 2024-02-28T16:15:11.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.789+0000 7f314aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c10f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:11.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.790+0000 7f314aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c10f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:59346/0 (socket says 172.21.15.157:59346) 2024-02-28T16:15:11.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.790+0000 7f314aa00700 1 -- 172.21.15.157:0/3835474477 learned_addr learned my addr 172.21.15.157:0/3835474477 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:11.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.790+0000 7f314aa00700 1 -- 172.21.15.157:0/3835474477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c005040 con 0x7f314c0fedd0 2024-02-28T16:15:11.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.791+0000 7f314aa00700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c10f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f313c009b80 tx=0x7f313c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:11.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.791+0000 7f3142a00700 1 -- 172.21.15.157:0/3835474477 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f313c00b5c0 con 0x7f314c0fedd0 2024-02-28T16:15:11.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.792+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c10f850 con 0x7f314c0fedd0 2024-02-28T16:15:11.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.792+0000 7f3142a00700 1 -- 172.21.15.157:0/3835474477 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f313c00be70 con 0x7f314c0fedd0 2024-02-28T16:15:11.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.792+0000 7f3142a00700 1 -- 172.21.15.157:0/3835474477 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f313c01c660 con 0x7f314c0fedd0 2024-02-28T16:15:11.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.792+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c1104f0 con 0x7f314c0fedd0 2024-02-28T16:15:11.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.793+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c05f5c0 con 0x7f314c0fedd0 2024-02-28T16:15:11.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.794+0000 7f3142a00700 1 -- 172.21.15.157:0/3835474477 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7f313c004d30 con 0x7f314c0fedd0 2024-02-28T16:15:11.785 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.794+0000 7f3142a00700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f31300368c0 0x7f3130038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:11.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.794+0000 7f3142a00700 1 -- 172.21.15.157:0/3835474477 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f313c04a550 con 0x7f314c0fedd0 2024-02-28T16:15:11.786 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.795+0000 7f314a000700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f31300368c0 0x7f3130038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:11.787 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.796+0000 7f314a000700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f31300368c0 0x7f3130038d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3138009990 tx=0x7f3138006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:11.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:11.809+0000 7f3142a00700 1 -- 172.21.15.157:0/3835474477 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f313c01bba0 con 0x7f314c0fedd0 2024-02-28T16:15:11.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:11 smithi148 ceph-mon[28767]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:12.089 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.097+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f314c111040 con 0x7f314c0fedd0 2024-02-28T16:15:12.090 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.098+0000 7f3142a00700 1 -- 172.21.15.157:0/3835474477 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f313c01b7b0 con 0x7f314c0fedd0 2024-02-28T16:15:12.090 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:12.090 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f31300368c0 msgr2=0x7f3130038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f31300368c0 0x7f3130038d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3138009990 tx=0x7f3138006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 msgr2=0x7f314c10f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c10f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f313c009b80 tx=0x7f313c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 shutdown_connections 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f31300368c0 0x7f3130038d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 --2- 172.21.15.157:0/3835474477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f314c0fedd0 0x7f314c10f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:12.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.101+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 >> 172.21.15.157:0/3835474477 conn(0x7f314c0fa5a0 msgr2=0x7f314c0fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:12.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.102+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 shutdown_connections 2024-02-28T16:15:12.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:12.102+0000 7f3151800700 1 -- 172.21.15.157:0/3835474477 wait complete. 2024-02-28T16:15:12.094 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:12.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:12 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/3835474477' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:13.736 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:13 smithi148 ceph-mon[28767]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:13.928 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:13.928 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:14.368 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:14.465 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:15.668 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:15 smithi148 ceph-mon[28767]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:16.489 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.497+0000 7fdd09400700 1 -- 172.21.15.157:0/2551218133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 msgr2=0x7fdd040fd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.497+0000 7fdd09400700 1 --2- 172.21.15.157:0/2551218133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd040fd920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40048c0 tx=0x7fdcf4009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.497+0000 7fdd09400700 1 -- 172.21.15.157:0/2551218133 shutdown_connections 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.497+0000 7fdd09400700 1 --2- 172.21.15.157:0/2551218133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd040fd920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.497+0000 7fdd09400700 1 -- 172.21.15.157:0/2551218133 >> 172.21.15.157:0/2551218133 conn(0x7fdd040f7190 msgr2=0x7fdd040f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.498+0000 7fdd09400700 1 -- 172.21.15.157:0/2551218133 shutdown_connections 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.498+0000 7fdd09400700 1 -- 172.21.15.157:0/2551218133 wait complete. 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.499+0000 7fdd09400700 1 Processor -- start 2024-02-28T16:15:16.490 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.499+0000 7fdd09400700 1 -- start start 2024-02-28T16:15:16.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.499+0000 7fdd09400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd04113490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:16.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.499+0000 7fdd09400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd041139d0 con 0x7fdd040fb500 2024-02-28T16:15:16.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.500+0000 7fdd02800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd04113490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:16.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.500+0000 7fdd02800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd04113490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:59378/0 (socket says 172.21.15.157:59378) 2024-02-28T16:15:16.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.500+0000 7fdd02800700 1 -- 172.21.15.157:0/2284101383 learned_addr learned my addr 172.21.15.157:0/2284101383 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:16.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.500+0000 7fdd02800700 1 -- 172.21.15.157:0/2284101383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4005040 con 0x7fdd040fb500 2024-02-28T16:15:16.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.500+0000 7fdd02800700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd04113490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009b80 tx=0x7fdcf4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:16.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.501+0000 7fdcfb400700 1 -- 172.21.15.157:0/2284101383 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcf400b5c0 con 0x7fdd040fb500 2024-02-28T16:15:16.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.501+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd04113bd0 con 0x7fdd040fb500 2024-02-28T16:15:16.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.501+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd04114870 con 0x7fdd040fb500 2024-02-28T16:15:16.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.501+0000 7fdcfb400700 1 -- 172.21.15.157:0/2284101383 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcf400be70 con 0x7fdd040fb500 2024-02-28T16:15:16.493 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.501+0000 7fdcfb400700 1 -- 172.21.15.157:0/2284101383 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdcf40255c0 con 0x7fdd040fb500 2024-02-28T16:15:16.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.502+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0405f5c0 con 0x7fdd040fb500 2024-02-28T16:15:16.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.502+0000 7fdcfb400700 1 -- 172.21.15.157:0/2284101383 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 13) v1 ==== 43425+0+0 (secure 0 0 0) 0x7fdcf401c3f0 con 0x7fdd040fb500 2024-02-28T16:15:16.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.503+0000 7fdcfb400700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdce8036820 0x7fdce8038cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:16.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.503+0000 7fdcfb400700 1 -- 172.21.15.157:0/2284101383 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdcf4049cc0 con 0x7fdd040fb500 2024-02-28T16:15:16.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.503+0000 7fdcf9e00700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdce8036820 0x7fdce8038cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:16.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.504+0000 7fdcf9e00700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdce8036820 0x7fdce8038cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009990 tx=0x7fdcec006e40 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:16.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.510+0000 7fdcfb400700 1 -- 172.21.15.157:0/2284101383 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdcf401a8e0 con 0x7fdd040fb500 2024-02-28T16:15:16.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.796+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdd0404bed0 con 0x7fdd040fb500 2024-02-28T16:15:16.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.797+0000 7fdcfb400700 1 -- 172.21.15.157:0/2284101383 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fdcf4011370 con 0x7fdd040fb500 2024-02-28T16:15:16.789 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:16.789 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:16.791 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdce8036820 msgr2=0x7fdce8038cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdce8036820 0x7fdce8038cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009990 tx=0x7fdcec006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 msgr2=0x7fdd04113490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd04113490 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009b80 tx=0x7fdcf4009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 shutdown_connections 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7fdce8036820 0x7fdce8038cd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 --2- 172.21.15.157:0/2284101383 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd040fb500 0x7fdd04113490 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 >> 172.21.15.157:0/2284101383 conn(0x7fdd040f7190 msgr2=0x7fdd040f7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 shutdown_connections 2024-02-28T16:15:16.792 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:16.800+0000 7fdd09400700 1 -- 172.21.15.157:0/2284101383 wait complete. 2024-02-28T16:15:16.793 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:17.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:17 smithi148 ceph-mon[28767]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:17.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:17 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:17.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:17 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:17.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:17 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:17.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:17 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-28T16:15:17.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:17 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2284101383' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:18.515 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:18.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:18.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:18 smithi148 ceph-mon[28767]: from='mgr.14162 172.21.15.148:0/992690821' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-28T16:15:18.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:18 smithi148 ceph-mon[28767]: mgrmap e14: smithi148.gelspy(active, since 89s) 2024-02-28T16:15:18.971 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:19.080 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:21.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.100+0000 7f72e0c00700 1 -- 172.21.15.157:0/1979418605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 msgr2=0x7f72dc0ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:21.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.100+0000 7f72e0c00700 1 --2- 172.21.15.157:0/1979418605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0ff7e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0048c0 tx=0x7f72cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.100+0000 7f72e0c00700 1 -- 172.21.15.157:0/1979418605 shutdown_connections 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.100+0000 7f72e0c00700 1 --2- 172.21.15.157:0/1979418605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0ff7e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.100+0000 7f72e0c00700 1 -- 172.21.15.157:0/1979418605 >> 172.21.15.157:0/1979418605 conn(0x7f72dc0f7190 msgr2=0x7f72dc0f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.100+0000 7f72e0c00700 1 -- 172.21.15.157:0/1979418605 shutdown_connections 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.100+0000 7f72e0c00700 1 -- 172.21.15.157:0/1979418605 wait complete. 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.101+0000 7f72e0c00700 1 Processor -- start 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.102+0000 7f72e0c00700 1 -- start start 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.102+0000 7f72e0c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:21.093 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.102+0000 7f72e0c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc0fb6e0 con 0x7f72dc065d90 2024-02-28T16:15:21.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.102+0000 7f72d9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:21.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.102+0000 7f72d9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:60120/0 (socket says 172.21.15.157:60120) 2024-02-28T16:15:21.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.102+0000 7f72d9e00700 1 -- 172.21.15.157:0/1026947447 learned_addr learned my addr 172.21.15.157:0/1026947447 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:21.094 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.103+0000 7f72d9e00700 1 -- 172.21.15.157:0/1026947447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc005040 con 0x7f72dc065d90 2024-02-28T16:15:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.103+0000 7f72d9e00700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0fd260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009680 tx=0x7f72cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.103+0000 7f72d2a00700 1 -- 172.21.15.157:0/1026947447 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72cc00b5c0 con 0x7f72dc065d90 2024-02-28T16:15:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.103+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc0fb8e0 con 0x7f72dc065d90 2024-02-28T16:15:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.103+0000 7f72d2a00700 1 -- 172.21.15.157:0/1026947447 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72cc004e60 con 0x7f72dc065d90 2024-02-28T16:15:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.103+0000 7f72d2a00700 1 -- 172.21.15.157:0/1026947447 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72cc01c590 con 0x7f72dc065d90 2024-02-28T16:15:21.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.103+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0fbdd0 con 0x7f72dc065d90 2024-02-28T16:15:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.104+0000 7f72d2a00700 1 -- 172.21.15.157:0/1026947447 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7f72cc013a80 con 0x7f72dc065d90 2024-02-28T16:15:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.104+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc1069a0 con 0x7f72dc065d90 2024-02-28T16:15:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.105+0000 7f72d2a00700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 0x7f72c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.105+0000 7f72d2a00700 1 -- 172.21.15.157:0/1026947447 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f72cc049c30 con 0x7f72dc065d90 2024-02-28T16:15:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.105+0000 7f72d1400700 1 -- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 msgr2=0x7f72c0038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3553564677 2024-02-28T16:15:21.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.105+0000 7f72d1400700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 0x7f72c0038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:15:21.101 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.110+0000 7f72d2a00700 1 -- 172.21.15.157:0/1026947447 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f72cc025400 con 0x7f72dc065d90 2024-02-28T16:15:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.306+0000 7f72d1400700 1 -- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 msgr2=0x7f72c0038dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3553564677 2024-02-28T16:15:21.297 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.306+0000 7f72d1400700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 0x7f72c0038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T16:15:21.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.395+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f72dc02b340 con 0x7f72dc065d90 2024-02-28T16:15:21.387 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.397+0000 7f72d2a00700 1 -- 172.21.15.157:0/1026947447 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f72cc011370 con 0x7f72dc065d90 2024-02-28T16:15:21.388 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:21.388 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:21.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 msgr2=0x7f72c0038dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:15:21.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 0x7f72c0038dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:21.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 msgr2=0x7f72dc0fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:21.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0fd260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009680 tx=0x7f72cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:21.390 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 shutdown_connections 2024-02-28T16:15:21.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7f72c0036910 0x7f72c0038dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:21.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 --2- 172.21.15.157:0/1026947447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72dc065d90 0x7f72dc0fd260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:21.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 >> 172.21.15.157:0/1026947447 conn(0x7f72dc0f7190 msgr2=0x7f72dc0f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:21.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.399+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 shutdown_connections 2024-02-28T16:15:21.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:21.400+0000 7f72e0c00700 1 -- 172.21.15.157:0/1026947447 wait complete. 2024-02-28T16:15:21.391 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:21.745 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:21 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/1026947447' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:23.181 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:23.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:23.624 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:23.723 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:25.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.744+0000 7ff169600700 1 -- 172.21.15.157:0/1604173589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 msgr2=0x7ff164103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:25.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.744+0000 7ff169600700 1 --2- 172.21.15.157:0/1604173589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164103590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff1540048c0 tx=0x7ff154009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:25.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.744+0000 7ff169600700 1 -- 172.21.15.157:0/1604173589 shutdown_connections 2024-02-28T16:15:25.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.744+0000 7ff169600700 1 --2- 172.21.15.157:0/1604173589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164103590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:25.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.744+0000 7ff169600700 1 -- 172.21.15.157:0/1604173589 >> 172.21.15.157:0/1604173589 conn(0x7ff164072270 msgr2=0x7ff1640746a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:25.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.744+0000 7ff169600700 1 -- 172.21.15.157:0/1604173589 shutdown_connections 2024-02-28T16:15:25.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.744+0000 7ff169600700 1 -- 172.21.15.157:0/1604173589 wait complete. 2024-02-28T16:15:25.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.745+0000 7ff169600700 1 Processor -- start 2024-02-28T16:15:25.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.746+0000 7ff169600700 1 -- start start 2024-02-28T16:15:25.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.746+0000 7ff169600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:25.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.746+0000 7ff169600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164113860 con 0x7ff164103180 2024-02-28T16:15:25.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.746+0000 7ff163e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:25.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.746+0000 7ff163e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:60150/0 (socket says 172.21.15.157:60150) 2024-02-28T16:15:25.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.746+0000 7ff163e00700 1 -- 172.21.15.157:0/591760814 learned_addr learned my addr 172.21.15.157:0/591760814 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:25.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.747+0000 7ff163e00700 1 -- 172.21.15.157:0/591760814 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff154005040 con 0x7ff164103180 2024-02-28T16:15:25.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.747+0000 7ff163e00700 1 --2- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164113320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff154009b80 tx=0x7ff154009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:25.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.747+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff15400b5c0 con 0x7ff164103180 2024-02-28T16:15:25.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.747+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff164113a60 con 0x7ff164103180 2024-02-28T16:15:25.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.747+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff15400be70 con 0x7ff164103180 2024-02-28T16:15:25.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.747+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff15401c660 con 0x7ff164103180 2024-02-28T16:15:25.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.747+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff164114700 con 0x7ff164103180 2024-02-28T16:15:25.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.749+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16405f5c0 con 0x7ff164103180 2024-02-28T16:15:25.739 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.749+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 14) v1 ==== 43439+0+0 (secure 0 0 0) 0x7ff154004d30 con 0x7ff164103180 2024-02-28T16:15:25.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.749+0000 7ff15be00700 1 --2- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff1480368c0 0x7ff148038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:25.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.749+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff154049b50 con 0x7ff164103180 2024-02-28T16:15:25.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.749+0000 7ff163400700 1 -- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff1480368c0 msgr2=0x7ff148038d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.148:6800/3553564677 2024-02-28T16:15:25.740 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.749+0000 7ff163400700 1 --2- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff1480368c0 0x7ff148038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:15:25.747 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.757+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff154025400 con 0x7ff164103180 2024-02-28T16:15:25.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.798+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mgrmap(e 15) v1 ==== 43162+0+0 (secure 0 0 0) 0x7ff154013b10 con 0x7ff164103180 2024-02-28T16:15:25.788 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.798+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff1480368c0 msgr2=0x7ff148038d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:15:25.789 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:25.798+0000 7ff15be00700 1 --2- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff1480368c0 0x7ff148038d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:26.034 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.043+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff164115250 con 0x7ff164103180 2024-02-28T16:15:26.035 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.044+0000 7ff15be00700 1 -- 172.21.15.157:0/591760814 <== mon.0 v2:172.21.15.148:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff154013420 con 0x7ff164103180 2024-02-28T16:15:26.035 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:26.035 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 msgr2=0x7ff164113320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 --2- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164113320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff154009b80 tx=0x7ff154009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 shutdown_connections 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 --2- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:6800/3553564677,v1:172.21.15.148:6801/3553564677] conn(0x7ff1480368c0 0x7ff148038d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 --2- 172.21.15.157:0/591760814 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff164103180 0x7ff164113320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 >> 172.21.15.157:0/591760814 conn(0x7ff164072270 msgr2=0x7ff164073fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 shutdown_connections 2024-02-28T16:15:26.038 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:26.047+0000 7ff169600700 1 -- 172.21.15.157:0/591760814 wait complete. 2024-02-28T16:15:26.039 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: Active manager daemon smithi148.gelspy restarted 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: Activating manager daemon smithi148.gelspy 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: mgrmap e15: smithi148.gelspy(active, starting, since 0.00929705s) 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:15:26.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:15:26.048 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:15:26.048 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:15:26.048 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:26.048 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:15:27.109 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:27.109 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:27.109 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:15:27.109 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:15:27.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: [28/Feb/2024:16:15:25] ENGINE Bus STARTING 2024-02-28T16:15:27.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/591760814' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:27.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: [28/Feb/2024:16:15:26] ENGINE Serving on https://172.21.15.148:7150 2024-02-28T16:15:27.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: [28/Feb/2024:16:15:26] ENGINE Bus STARTED 2024-02-28T16:15:27.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:27.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:26 smithi148 ceph-mon[28767]: mgrmap e16: smithi148.gelspy(active, since 1.01056s) 2024-02-28T16:15:27.781 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:27.781 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:28.207 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:28.229 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:28.230 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:28.309 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:30.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:29 smithi148 ceph-mon[28767]: mgrmap e17: smithi148.gelspy(active, since 2s) 2024-02-28T16:15:30.010 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.566+0000 7f3e06000700 1 -- 172.21.15.157:0/314372478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 msgr2=0x7f3e000ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.566+0000 7f3e06000700 1 --2- 172.21.15.157:0/314372478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e000ff1e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3df00048c0 tx=0x7f3df0009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.566+0000 7f3e06000700 1 -- 172.21.15.157:0/314372478 shutdown_connections 2024-02-28T16:15:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.566+0000 7f3e06000700 1 --2- 172.21.15.157:0/314372478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e000ff1e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.566+0000 7f3e06000700 1 -- 172.21.15.157:0/314372478 >> 172.21.15.157:0/314372478 conn(0x7f3e000fa5a0 msgr2=0x7f3e000fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.566+0000 7f3e06000700 1 -- 172.21.15.157:0/314372478 shutdown_connections 2024-02-28T16:15:30.557 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.566+0000 7f3e06000700 1 -- 172.21.15.157:0/314372478 wait complete. 2024-02-28T16:15:30.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.567+0000 7f3e06000700 1 Processor -- start 2024-02-28T16:15:30.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.567+0000 7f3e06000700 1 -- start start 2024-02-28T16:15:30.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.567+0000 7f3e06000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e0010f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:30.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.567+0000 7f3e06000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0010f650 con 0x7f3e000fedd0 2024-02-28T16:15:30.558 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.568+0000 7f3dff400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e0010f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:30.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.568+0000 7f3dff400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e0010f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:32802/0 (socket says 172.21.15.157:32802) 2024-02-28T16:15:30.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.568+0000 7f3dff400700 1 -- 172.21.15.157:0/2040037504 learned_addr learned my addr 172.21.15.157:0/2040037504 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:30.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.568+0000 7f3dff400700 1 -- 172.21.15.157:0/2040037504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0005040 con 0x7f3e000fedd0 2024-02-28T16:15:30.559 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.569+0000 7f3dff400700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e0010f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009b80 tx=0x7f3df0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:30.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.569+0000 7f3df7400700 1 -- 172.21.15.157:0/2040037504 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3df000b5c0 con 0x7f3e000fedd0 2024-02-28T16:15:30.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.569+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0010f850 con 0x7f3e000fedd0 2024-02-28T16:15:30.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.569+0000 7f3df7400700 1 -- 172.21.15.157:0/2040037504 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3df000be70 con 0x7f3e000fedd0 2024-02-28T16:15:30.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.569+0000 7f3df7400700 1 -- 172.21.15.157:0/2040037504 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3df001c660 con 0x7f3e000fedd0 2024-02-28T16:15:30.560 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.569+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e001104f0 con 0x7f3e000fedd0 2024-02-28T16:15:30.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.570+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0005f5c0 con 0x7f3e000fedd0 2024-02-28T16:15:30.561 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.571+0000 7f3df7400700 1 -- 172.21.15.157:0/2040037504 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f3df0004d30 con 0x7f3e000fedd0 2024-02-28T16:15:30.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.571+0000 7f3df7400700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3de40369b0 0x7f3de4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:30.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.571+0000 7f3df7400700 1 -- 172.21.15.157:0/2040037504 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3df0049c70 con 0x7f3e000fedd0 2024-02-28T16:15:30.562 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.572+0000 7f3dfea00700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3de40369b0 0x7f3de4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:30.563 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.573+0000 7f3dfea00700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3de40369b0 0x7f3de4038e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009990 tx=0x7f3dec006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:30.572 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.581+0000 7f3df7400700 1 -- 172.21.15.157:0/2040037504 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3df0025400 con 0x7f3e000fedd0 2024-02-28T16:15:30.875 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.884+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3e00111040 con 0x7f3e000fedd0 2024-02-28T16:15:30.877 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.885+0000 7f3df7400700 1 -- 172.21.15.157:0/2040037504 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f3df0023300 con 0x7f3e000fedd0 2024-02-28T16:15:30.877 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:30.877 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3de40369b0 msgr2=0x7f3de4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3de40369b0 0x7f3de4038e60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009990 tx=0x7f3dec006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 msgr2=0x7f3e0010f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e0010f110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009b80 tx=0x7f3df0009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 shutdown_connections 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3de40369b0 0x7f3de4038e60 secure :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009990 tx=0x7f3dec006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 --2- 172.21.15.157:0/2040037504 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3e000fedd0 0x7f3e0010f110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:30.879 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.888+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 >> 172.21.15.157:0/2040037504 conn(0x7f3e000fa5a0 msgr2=0x7f3e000fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:30.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.889+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 shutdown_connections 2024-02-28T16:15:30.880 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:30.889+0000 7f3e06000700 1 -- 172.21.15.157:0/2040037504 wait complete. 2024-02-28T16:15:30.880 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:31.226 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:30 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2040037504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:32.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:32 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:32.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:32 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:33.148 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:33.149 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:33.588 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:33.702 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T16:15:34.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:34.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:34.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.440+0000 7ff71b200700 1 -- 172.21.15.157:0/3804049175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 msgr2=0x7ff71c0fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.440+0000 7ff71b200700 1 --2- 172.21.15.157:0/3804049175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c0fce10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0048c0 tx=0x7ff70c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.440+0000 7ff71b200700 1 -- 172.21.15.157:0/3804049175 shutdown_connections 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.440+0000 7ff71b200700 1 --2- 172.21.15.157:0/3804049175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c0fce10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.440+0000 7ff71b200700 1 -- 172.21.15.157:0/3804049175 >> 172.21.15.157:0/3804049175 conn(0x7ff71c0f80c0 msgr2=0x7ff71c0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.440+0000 7ff71b200700 1 -- 172.21.15.157:0/3804049175 shutdown_connections 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.441+0000 7ff71b200700 1 -- 172.21.15.157:0/3804049175 wait complete. 2024-02-28T16:15:36.432 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.441+0000 7ff71b200700 1 Processor -- start 2024-02-28T16:15:36.433 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.442+0000 7ff71b200700 1 -- start start 2024-02-28T16:15:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.442+0000 7ff71b200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c10cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.442+0000 7ff71b200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c10d310 con 0x7ff71c0fca00 2024-02-28T16:15:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.442+0000 7ff719e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c10cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.442+0000 7ff719e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c10cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:32814/0 (socket says 172.21.15.157:32814) 2024-02-28T16:15:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.442+0000 7ff719e00700 1 -- 172.21.15.157:0/547198962 learned_addr learned my addr 172.21.15.157:0/547198962 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.443+0000 7ff719e00700 1 -- 172.21.15.157:0/547198962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c005040 con 0x7ff71c0fca00 2024-02-28T16:15:36.434 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.443+0000 7ff719e00700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c10cdd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009b80 tx=0x7ff70c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.443+0000 7ff712000700 1 -- 172.21.15.157:0/547198962 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff70c00b5c0 con 0x7ff71c0fca00 2024-02-28T16:15:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.443+0000 7ff712000700 1 -- 172.21.15.157:0/547198962 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff70c00be70 con 0x7ff71c0fca00 2024-02-28T16:15:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.444+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c10d510 con 0x7ff71c0fca00 2024-02-28T16:15:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.444+0000 7ff712000700 1 -- 172.21.15.157:0/547198962 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff70c01c660 con 0x7ff71c0fca00 2024-02-28T16:15:36.435 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.444+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c10e100 con 0x7ff71c0fca00 2024-02-28T16:15:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.445+0000 7ff712000700 1 -- 172.21.15.157:0/547198962 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7ff70c013420 con 0x7ff71c0fca00 2024-02-28T16:15:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.445+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c10d980 con 0x7ff71c0fca00 2024-02-28T16:15:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.445+0000 7ff712000700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7000369b0 0x7ff700038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.445+0000 7ff712000700 1 -- 172.21.15.157:0/547198962 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff70c049ba0 con 0x7ff71c0fca00 2024-02-28T16:15:36.436 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.446+0000 7ff719400700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7000369b0 0x7ff700038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:36.437 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.446+0000 7ff719400700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7000369b0 0x7ff700038e60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff708009990 tx=0x7ff708006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:36.442 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.452+0000 7ff712000700 1 -- 172.21.15.157:0/547198962 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff70c013b10 con 0x7ff71c0fca00 2024-02-28T16:15:36.749 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.759+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff71c10ec10 con 0x7ff71c0fca00 2024-02-28T16:15:36.750 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.759+0000 7ff712000700 1 -- 172.21.15.157:0/547198962 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff70c011370 con 0x7ff71c0fca00 2024-02-28T16:15:36.750 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:36.750 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7000369b0 msgr2=0x7ff700038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7000369b0 0x7ff700038e60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff708009990 tx=0x7ff708006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 msgr2=0x7ff71c10cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c10cdd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009b80 tx=0x7ff70c009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 shutdown_connections 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7000369b0 0x7ff700038e60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 --2- 172.21.15.157:0/547198962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff71c0fca00 0x7ff71c10cdd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 >> 172.21.15.157:0/547198962 conn(0x7ff71c0f80c0 msgr2=0x7ff71c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 shutdown_connections 2024-02-28T16:15:36.753 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:36.762+0000 7ff71b200700 1 -- 172.21.15.157:0/547198962 wait complete. 2024-02-28T16:15:36.754 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:15:36.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:36 smithi148 ceph-mon[28767]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:15:37.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:37 smithi148 ceph-mon[28767]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:15:37.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:37 smithi148 ceph-mon[28767]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:15:37.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:37 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/547198962' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:38.591 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:38.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:38.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:15:38.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:15:38.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:15:38.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:15:38.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:38.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:38.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:38.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:38.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:38.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:15:38.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T16:15:38.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:15:39.014 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:15:39.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:39 smithi148 ceph-mon[28767]: Deploying daemon crash.smithi157 on smithi157 2024-02-28T16:15:41.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:42.303 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.311+0000 7f4bcc600700 1 -- 172.21.15.157:0/1214789069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 msgr2=0x7f4bc40706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.311+0000 7f4bcc600700 1 --2- 172.21.15.157:0/1214789069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc40706a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4bb80048c0 tx=0x7f4bb8009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.311+0000 7f4bcc600700 1 -- 172.21.15.157:0/1214789069 shutdown_connections 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.311+0000 7f4bcc600700 1 --2- 172.21.15.157:0/1214789069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc40706a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.311+0000 7f4bcc600700 1 -- 172.21.15.157:0/1214789069 >> 172.21.15.157:0/1214789069 conn(0x7f4bc40f8760 msgr2=0x7f4bc40fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.311+0000 7f4bcc600700 1 -- 172.21.15.157:0/1214789069 shutdown_connections 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.311+0000 7f4bcc600700 1 -- 172.21.15.157:0/1214789069 wait complete. 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.312+0000 7f4bcc600700 1 Processor -- start 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.313+0000 7f4bcc600700 1 -- start start 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.313+0000 7f4bcc600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc4115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:42.304 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.313+0000 7f4bcc600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc41156d0 con 0x7f4bc40702d0 2024-02-28T16:15:42.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.314+0000 7f4bc9c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc4115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:42.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.314+0000 7f4bc9c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc4115190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:44224/0 (socket says 172.21.15.157:44224) 2024-02-28T16:15:42.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.314+0000 7f4bc9c00700 1 -- 172.21.15.157:0/697279852 learned_addr learned my addr 172.21.15.157:0/697279852 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:42.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.314+0000 7f4bc9c00700 1 -- 172.21.15.157:0/697279852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8005040 con 0x7f4bc40702d0 2024-02-28T16:15:42.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.315+0000 7f4bc9c00700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc4115190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009300 tx=0x7f4bb8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:42.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.315+0000 7f4bc1600700 1 -- 172.21.15.157:0/697279852 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bb8004e60 con 0x7f4bc40702d0 2024-02-28T16:15:42.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.315+0000 7f4bc1600700 1 -- 172.21.15.157:0/697279852 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4bb8013420 con 0x7f4bc40702d0 2024-02-28T16:15:42.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.315+0000 7f4bc1600700 1 -- 172.21.15.157:0/697279852 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bb801c5b0 con 0x7f4bc40702d0 2024-02-28T16:15:42.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.315+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc41158d0 con 0x7f4bc40702d0 2024-02-28T16:15:42.306 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.316+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc4115d40 con 0x7f4bc40702d0 2024-02-28T16:15:42.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.317+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc405f5c0 con 0x7f4bc40702d0 2024-02-28T16:15:42.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.317+0000 7f4bc1600700 1 -- 172.21.15.157:0/697279852 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f4bb8013a90 con 0x7f4bc40702d0 2024-02-28T16:15:42.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.318+0000 7f4bc1600700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4bac0369b0 0x7f4bac038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:42.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.318+0000 7f4bc1600700 1 -- 172.21.15.157:0/697279852 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4bb8049bd0 con 0x7f4bc40702d0 2024-02-28T16:15:42.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.319+0000 7f4bc9200700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4bac0369b0 0x7f4bac038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:42.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.320+0000 7f4bc9200700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4bac0369b0 0x7f4bac038e60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009990 tx=0x7f4bb0006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:42.325 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.334+0000 7f4bc1600700 1 -- 172.21.15.157:0/697279852 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4bb8011960 con 0x7f4bc40702d0 2024-02-28T16:15:42.634 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.643+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4bc4110850 con 0x7f4bc40702d0 2024-02-28T16:15:42.635 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.644+0000 7f4bc1600700 1 -- 172.21.15.157:0/697279852 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4bb8011370 con 0x7f4bc40702d0 2024-02-28T16:15:42.635 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:42.635 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4bac0369b0 msgr2=0x7f4bac038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4bac0369b0 0x7f4bac038e60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4bb0009990 tx=0x7f4bb0006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 msgr2=0x7f4bc4115190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc4115190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009300 tx=0x7f4bb8009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 shutdown_connections 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4bac0369b0 0x7f4bac038e60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 --2- 172.21.15.157:0/697279852 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bc40702d0 0x7f4bc4115190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 >> 172.21.15.157:0/697279852 conn(0x7f4bc40f8760 msgr2=0x7f4bc4103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 shutdown_connections 2024-02-28T16:15:42.639 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:42.648+0000 7f4bcc600700 1 -- 172.21.15.157:0/697279852 wait complete. 2024-02-28T16:15:42.640 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:43.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:42 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/697279852' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:44.421 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:44.422 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:44.868 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:15:45.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:45 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:45.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:45 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:45.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:45 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:45.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:45 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:45.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:45 smithi148 ceph-mon[28767]: Deploying daemon node-exporter.smithi157 on smithi157 2024-02-28T16:15:47.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.017+0000 7f0009800700 1 -- 172.21.15.157:0/3348726927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 msgr2=0x7f0004102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:47.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.017+0000 7f0009800700 1 --2- 172.21.15.157:0/3348726927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004102fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efff40048c0 tx=0x7efff4009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:47.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.018+0000 7f0009800700 1 -- 172.21.15.157:0/3348726927 shutdown_connections 2024-02-28T16:15:47.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.018+0000 7f0009800700 1 --2- 172.21.15.157:0/3348726927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004102fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:47.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.018+0000 7f0009800700 1 -- 172.21.15.157:0/3348726927 >> 172.21.15.157:0/3348726927 conn(0x7f00040f8760 msgr2=0x7f00040fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:47.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.018+0000 7f0009800700 1 -- 172.21.15.157:0/3348726927 shutdown_connections 2024-02-28T16:15:47.009 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.018+0000 7f0009800700 1 -- 172.21.15.157:0/3348726927 wait complete. 2024-02-28T16:15:47.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.019+0000 7f0009800700 1 Processor -- start 2024-02-28T16:15:47.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.019+0000 7f0009800700 1 -- start start 2024-02-28T16:15:47.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.019+0000 7f0009800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004115130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:47.010 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.019+0000 7f0009800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004115670 con 0x7f0004102bd0 2024-02-28T16:15:47.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.020+0000 7f0002a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004115130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:47.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.020+0000 7f0002a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004115130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:44256/0 (socket says 172.21.15.157:44256) 2024-02-28T16:15:47.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.020+0000 7f0002a00700 1 -- 172.21.15.157:0/611901168 learned_addr learned my addr 172.21.15.157:0/611901168 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:47.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.021+0000 7f0002a00700 1 -- 172.21.15.157:0/611901168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4005040 con 0x7f0004102bd0 2024-02-28T16:15:47.011 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.021+0000 7f0002a00700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004115130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efff4009330 tx=0x7efff4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:47.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.022+0000 7efffaa00700 1 -- 172.21.15.157:0/611901168 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efff400be50 con 0x7f0004102bd0 2024-02-28T16:15:47.012 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.022+0000 7efffaa00700 1 -- 172.21.15.157:0/611901168 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efff4009630 con 0x7f0004102bd0 2024-02-28T16:15:47.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.022+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0004115870 con 0x7f0004102bd0 2024-02-28T16:15:47.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.022+0000 7efffaa00700 1 -- 172.21.15.157:0/611901168 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efff401c3f0 con 0x7f0004102bd0 2024-02-28T16:15:47.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.022+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0004115d60 con 0x7f0004102bd0 2024-02-28T16:15:47.013 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.023+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000405f5c0 con 0x7f0004102bd0 2024-02-28T16:15:47.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.023+0000 7efffaa00700 1 -- 172.21.15.157:0/611901168 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7efff40097a0 con 0x7f0004102bd0 2024-02-28T16:15:47.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.024+0000 7efffaa00700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effe8036960 0x7effe8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:47.014 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.024+0000 7efffaa00700 1 -- 172.21.15.157:0/611901168 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7efff4049c50 con 0x7f0004102bd0 2024-02-28T16:15:47.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.024+0000 7f0002000700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effe8036960 0x7effe8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:47.015 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.025+0000 7f0002000700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effe8036960 0x7effe8038e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efff0009990 tx=0x7efff0006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:47.029 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.039+0000 7efffaa00700 1 -- 172.21.15.157:0/611901168 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efff4011960 con 0x7f0004102bd0 2024-02-28T16:15:47.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:46 smithi148 ceph-mon[28767]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:47.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:15:47.318 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.327+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f00041108a0 con 0x7f0004102bd0 2024-02-28T16:15:47.319 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.328+0000 7efffaa00700 1 -- 172.21.15.157:0/611901168 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7efff4011370 con 0x7f0004102bd0 2024-02-28T16:15:47.319 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:47.319 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effe8036960 msgr2=0x7effe8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effe8036960 0x7effe8038e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efff0009990 tx=0x7efff0006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 msgr2=0x7f0004115130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004115130 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efff4009330 tx=0x7efff4009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 shutdown_connections 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effe8036960 0x7effe8038e10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 --2- 172.21.15.157:0/611901168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0004102bd0 0x7f0004115130 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 >> 172.21.15.157:0/611901168 conn(0x7f00040f8760 msgr2=0x7f0004071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 shutdown_connections 2024-02-28T16:15:47.322 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:47.331+0000 7f0009800700 1 -- 172.21.15.157:0/611901168 wait complete. 2024-02-28T16:15:47.323 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:48.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:47 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/611901168' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:49.082 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:49.083 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:49.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:48 smithi148 ceph-mon[28767]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:49.532 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:15:51.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.504+0000 7fe6bfe00700 1 -- 172.21.15.157:0/195071382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 msgr2=0x7fe6c0102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:51.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.504+0000 7fe6bfe00700 1 --2- 172.21.15.157:0/195071382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0102e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009c60 tx=0x7fe6b0004d10 comp rx=0 tx=0).stop 2024-02-28T16:15:51.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.504+0000 7fe6bfe00700 1 -- 172.21.15.157:0/195071382 shutdown_connections 2024-02-28T16:15:51.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.504+0000 7fe6bfe00700 1 --2- 172.21.15.157:0/195071382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0102e40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:51.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.504+0000 7fe6bfe00700 1 -- 172.21.15.157:0/195071382 >> 172.21.15.157:0/195071382 conn(0x7fe6c00f85b0 msgr2=0x7fe6c00fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:51.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.504+0000 7fe6bfe00700 1 -- 172.21.15.157:0/195071382 shutdown_connections 2024-02-28T16:15:51.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.505+0000 7fe6bfe00700 1 -- 172.21.15.157:0/195071382 wait complete. 2024-02-28T16:15:51.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.505+0000 7fe6bfe00700 1 Processor -- start 2024-02-28T16:15:51.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.506+0000 7fe6bfe00700 1 -- start start 2024-02-28T16:15:51.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.506+0000 7fe6bfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0114ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:51.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.506+0000 7fe6bfe00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c0115530 con 0x7fe6c0102a70 2024-02-28T16:15:51.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.507+0000 7fe6bea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0114ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:51.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.507+0000 7fe6bea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0114ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:45432/0 (socket says 172.21.15.157:45432) 2024-02-28T16:15:51.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.507+0000 7fe6bea00700 1 -- 172.21.15.157:0/3488095892 learned_addr learned my addr 172.21.15.157:0/3488095892 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:51.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.507+0000 7fe6bea00700 1 -- 172.21.15.157:0/3488095892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0009940 con 0x7fe6c0102a70 2024-02-28T16:15:51.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.508+0000 7fe6bea00700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0114ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0004e60 tx=0x7fe6b0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:51.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.508+0000 7fe6b7400700 1 -- 172.21.15.157:0/3488095892 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6b0007c80 con 0x7fe6c0102a70 2024-02-28T16:15:51.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.508+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c0115730 con 0x7fe6c0102a70 2024-02-28T16:15:51.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.508+0000 7fe6b7400700 1 -- 172.21.15.157:0/3488095892 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6b001d910 con 0x7fe6c0102a70 2024-02-28T16:15:51.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.508+0000 7fe6b7400700 1 -- 172.21.15.157:0/3488095892 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6b0012a00 con 0x7fe6c0102a70 2024-02-28T16:15:51.499 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.508+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c0115c20 con 0x7fe6c0102a70 2024-02-28T16:15:51.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.509+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c005f5c0 con 0x7fe6c0102a70 2024-02-28T16:15:51.500 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.510+0000 7fe6b7400700 1 -- 172.21.15.157:0/3488095892 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fe6b0019040 con 0x7fe6c0102a70 2024-02-28T16:15:51.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.510+0000 7fe6b7400700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe6a40369b0 0x7fe6a4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:51.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.510+0000 7fe6b7400700 1 -- 172.21.15.157:0/3488095892 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe6b004a400 con 0x7fe6c0102a70 2024-02-28T16:15:51.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.512+0000 7fe6b6000700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe6a40369b0 0x7fe6a4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:51.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.513+0000 7fe6b6000700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe6a40369b0 0x7fe6a4038e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009990 tx=0x7fe6a8006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:51.516 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.525+0000 7fe6b7400700 1 -- 172.21.15.157:0/3488095892 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fe6b002eb40 con 0x7fe6c0102a70 2024-02-28T16:15:51.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.815+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe6c01106f0 con 0x7fe6c0102a70 2024-02-28T16:15:51.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.816+0000 7fe6b7400700 1 -- 172.21.15.157:0/3488095892 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fe6b0017020 con 0x7fe6c0102a70 2024-02-28T16:15:51.807 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:51.807 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe6a40369b0 msgr2=0x7fe6a4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe6a40369b0 0x7fe6a4038e60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009990 tx=0x7fe6a8006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 msgr2=0x7fe6c0114ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0114ff0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0004e60 tx=0x7fe6b0004d10 comp rx=0 tx=0).stop 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 shutdown_connections 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe6a40369b0 0x7fe6a4038e60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 --2- 172.21.15.157:0/3488095892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe6c0102a70 0x7fe6c0114ff0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 >> 172.21.15.157:0/3488095892 conn(0x7fe6c00f85b0 msgr2=0x7fe6c0071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 shutdown_connections 2024-02-28T16:15:51.810 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:51.819+0000 7fe6bfe00700 1 -- 172.21.15.157:0/3488095892 wait complete. 2024-02-28T16:15:51.811 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:51.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:51 smithi148 ceph-mon[28767]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:53.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:52 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/3488095892' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:53.445 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:53.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:53.894 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:15:54.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:53 smithi148 ceph-mon[28767]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.848+0000 7f6c18200700 1 -- 172.21.15.157:0/3559338731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 msgr2=0x7f6c10105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.848+0000 7f6c18200700 1 --2- 172.21.15.157:0/3559338731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10105190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c040048c0 tx=0x7f6c04009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.848+0000 7f6c18200700 1 -- 172.21.15.157:0/3559338731 shutdown_connections 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.848+0000 7f6c18200700 1 --2- 172.21.15.157:0/3559338731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10105190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.848+0000 7f6c18200700 1 -- 172.21.15.157:0/3559338731 >> 172.21.15.157:0/3559338731 conn(0x7f6c100fa950 msgr2=0x7f6c100fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.848+0000 7f6c18200700 1 -- 172.21.15.157:0/3559338731 shutdown_connections 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.848+0000 7f6c18200700 1 -- 172.21.15.157:0/3559338731 wait complete. 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.849+0000 7f6c18200700 1 Processor -- start 2024-02-28T16:15:55.840 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.849+0000 7f6c18200700 1 -- start start 2024-02-28T16:15:55.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.850+0000 7f6c18200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10115160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:55.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.850+0000 7f6c18200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101156a0 con 0x7f6c10104dc0 2024-02-28T16:15:55.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.850+0000 7f6c15800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10115160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:55.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.850+0000 7f6c15800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10115160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:45454/0 (socket says 172.21.15.157:45454) 2024-02-28T16:15:55.841 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.850+0000 7f6c15800700 1 -- 172.21.15.157:0/1865232371 learned_addr learned my addr 172.21.15.157:0/1865232371 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:15:55.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.851+0000 7f6c15800700 1 -- 172.21.15.157:0/1865232371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c04005040 con 0x7f6c10104dc0 2024-02-28T16:15:55.842 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.851+0000 7f6c15800700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10115160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009330 tx=0x7f6c04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:55.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.852+0000 7f6c0d600700 1 -- 172.21.15.157:0/1865232371 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c0400be50 con 0x7f6c10104dc0 2024-02-28T16:15:55.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.852+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c101158a0 con 0x7f6c10104dc0 2024-02-28T16:15:55.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.852+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c10115d90 con 0x7f6c10104dc0 2024-02-28T16:15:55.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.852+0000 7f6c0d600700 1 -- 172.21.15.157:0/1865232371 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c04009630 con 0x7f6c10104dc0 2024-02-28T16:15:55.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.852+0000 7f6c0d600700 1 -- 172.21.15.157:0/1865232371 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6c04025400 con 0x7f6c10104dc0 2024-02-28T16:15:55.843 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.853+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1005f5c0 con 0x7f6c10104dc0 2024-02-28T16:15:55.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.853+0000 7f6c0d600700 1 -- 172.21.15.157:0/1865232371 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f6c040097a0 con 0x7f6c10104dc0 2024-02-28T16:15:55.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.854+0000 7f6c0d600700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6bf80369b0 0x7f6bf8038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:15:55.844 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.854+0000 7f6c0d600700 1 -- 172.21.15.157:0/1865232371 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6c04049bd0 con 0x7f6c10104dc0 2024-02-28T16:15:55.845 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.854+0000 7f6c14e00700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6bf80369b0 0x7f6bf8038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:15:55.846 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.855+0000 7f6c14e00700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6bf80369b0 0x7f6bf8038e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009990 tx=0x7f6bfc006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:15:55.860 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:55.869+0000 7f6c0d600700 1 -- 172.21.15.157:0/1865232371 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6c040238f0 con 0x7f6c10104dc0 2024-02-28T16:15:56.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:55 smithi148 ceph-mon[28767]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:56.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.160+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6c101108c0 con 0x7f6c10104dc0 2024-02-28T16:15:56.153 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.162+0000 7f6c0d600700 1 -- 172.21.15.157:0/1865232371 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f6c04023300 con 0x7f6c10104dc0 2024-02-28T16:15:56.153 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:15:56.153 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:15:56.155 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6bf80369b0 msgr2=0x7f6bf8038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6bf80369b0 0x7f6bf8038e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009990 tx=0x7f6bfc006e40 comp rx=0 tx=0).stop 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 msgr2=0x7f6c10115160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10115160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009330 tx=0x7f6c04009e30 comp rx=0 tx=0).stop 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 shutdown_connections 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6bf80369b0 0x7f6bf8038e60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 --2- 172.21.15.157:0/1865232371 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c10104dc0 0x7f6c10115160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.164+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 >> 172.21.15.157:0/1865232371 conn(0x7f6c100fa950 msgr2=0x7f6c100fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.165+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 shutdown_connections 2024-02-28T16:15:56.156 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:15:56.165+0000 7f6c18200700 1 -- 172.21.15.157:0/1865232371 wait complete. 2024-02-28T16:15:56.157 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:15:56.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:15:56.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:56 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/1865232371' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:15:57.818 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:15:57.818 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:15:58.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:57 smithi148 ceph-mon[28767]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:15:58.280 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:00.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:15:59 smithi148 ceph-mon[28767]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.232+0000 7fdb3a400700 1 -- 172.21.15.157:0/1674429956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 msgr2=0x7fdb34101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.232+0000 7fdb3a400700 1 --2- 172.21.15.157:0/1674429956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34101f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdb240048c0 tx=0x7fdb24009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.233+0000 7fdb3a400700 1 -- 172.21.15.157:0/1674429956 shutdown_connections 2024-02-28T16:16:00.224 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.233+0000 7fdb3a400700 1 --2- 172.21.15.157:0/1674429956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34101f10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:00.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.233+0000 7fdb3a400700 1 -- 172.21.15.157:0/1674429956 >> 172.21.15.157:0/1674429956 conn(0x7fdb340f7640 msgr2=0x7fdb340f9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:00.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.233+0000 7fdb3a400700 1 -- 172.21.15.157:0/1674429956 shutdown_connections 2024-02-28T16:16:00.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.233+0000 7fdb3a400700 1 -- 172.21.15.157:0/1674429956 wait complete. 2024-02-28T16:16:00.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.234+0000 7fdb3a400700 1 Processor -- start 2024-02-28T16:16:00.225 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.234+0000 7fdb3a400700 1 -- start start 2024-02-28T16:16:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.234+0000 7fdb3a400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.234+0000 7fdb3a400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb341156d0 con 0x7fdb34101b40 2024-02-28T16:16:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.235+0000 7fdb33400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.235+0000 7fdb33400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34115190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:36176/0 (socket says 172.21.15.157:36176) 2024-02-28T16:16:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.235+0000 7fdb33400700 1 -- 172.21.15.157:0/3475420326 learned_addr learned my addr 172.21.15.157:0/3475420326 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:00.226 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.235+0000 7fdb33400700 1 -- 172.21.15.157:0/3475420326 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24005040 con 0x7fdb34101b40 2024-02-28T16:16:00.227 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.236+0000 7fdb33400700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34115190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009300 tx=0x7fdb24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.236+0000 7fdb2b400700 1 -- 172.21.15.157:0/3475420326 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb24004e60 con 0x7fdb34101b40 2024-02-28T16:16:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.236+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb341158d0 con 0x7fdb34101b40 2024-02-28T16:16:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.237+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb34115d40 con 0x7fdb34101b40 2024-02-28T16:16:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.237+0000 7fdb2b400700 1 -- 172.21.15.157:0/3475420326 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb24013420 con 0x7fdb34101b40 2024-02-28T16:16:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.237+0000 7fdb2b400700 1 -- 172.21.15.157:0/3475420326 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdb240255a0 con 0x7fdb34101b40 2024-02-28T16:16:00.228 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.238+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb140052e0 con 0x7fdb34101b40 2024-02-28T16:16:00.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.238+0000 7fdb2b400700 1 -- 172.21.15.157:0/3475420326 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fdb24013590 con 0x7fdb34101b40 2024-02-28T16:16:00.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.239+0000 7fdb2b400700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdb18036910 0x7fdb18038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:00.229 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.239+0000 7fdb2b400700 1 -- 172.21.15.157:0/3475420326 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdb24049ce0 con 0x7fdb34101b40 2024-02-28T16:16:00.230 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.239+0000 7fdb32a00700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdb18036910 0x7fdb18038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:00.231 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.240+0000 7fdb32a00700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdb18036910 0x7fdb18038dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009990 tx=0x7fdb20006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:00.244 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.254+0000 7fdb2b400700 1 -- 172.21.15.157:0/3475420326 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdb24013a90 con 0x7fdb34101b40 2024-02-28T16:16:00.532 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.541+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdb14005590 con 0x7fdb34101b40 2024-02-28T16:16:00.533 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.542+0000 7fdb2b400700 1 -- 172.21.15.157:0/3475420326 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fdb24024590 con 0x7fdb34101b40 2024-02-28T16:16:00.533 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:00.533 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:16:00.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.545+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdb18036910 msgr2=0x7fdb18038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:00.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.545+0000 7fdb3a400700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdb18036910 0x7fdb18038dc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb20009990 tx=0x7fdb20006e40 comp rx=0 tx=0).stop 2024-02-28T16:16:00.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.545+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 msgr2=0x7fdb34115190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:00.536 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.545+0000 7fdb3a400700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34115190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009300 tx=0x7fdb24009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:00.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.546+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 shutdown_connections 2024-02-28T16:16:00.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.546+0000 7fdb3a400700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdb18036910 0x7fdb18038dc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:00.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.546+0000 7fdb3a400700 1 --2- 172.21.15.157:0/3475420326 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdb34101b40 0x7fdb34115190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:00.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.546+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 >> 172.21.15.157:0/3475420326 conn(0x7fdb340f7640 msgr2=0x7fdb34065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:00.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.546+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 shutdown_connections 2024-02-28T16:16:00.537 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:00.546+0000 7fdb3a400700 1 -- 172.21.15.157:0/3475420326 wait complete. 2024-02-28T16:16:00.537 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:16:01.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:00 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/3475420326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:02.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:01 smithi148 ceph-mon[28767]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:02.267 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:16:02.267 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:16:02.724 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:04.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:03 smithi148 ceph-mon[28767]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:04.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.782+0000 7fd32f600700 1 -- 172.21.15.157:0/431376962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 msgr2=0x7fd3280fe000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:04.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.782+0000 7fd32f600700 1 --2- 172.21.15.157:0/431376962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd3280fe000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0048c0 tx=0x7fd31c009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:04.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.782+0000 7fd32f600700 1 -- 172.21.15.157:0/431376962 shutdown_connections 2024-02-28T16:16:04.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.782+0000 7fd32f600700 1 --2- 172.21.15.157:0/431376962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd3280fe000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:04.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.782+0000 7fd32f600700 1 -- 172.21.15.157:0/431376962 >> 172.21.15.157:0/431376962 conn(0x7fd3280f7660 msgr2=0x7fd3280f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:04.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.782+0000 7fd32f600700 1 -- 172.21.15.157:0/431376962 shutdown_connections 2024-02-28T16:16:04.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.783+0000 7fd32f600700 1 -- 172.21.15.157:0/431376962 wait complete. 2024-02-28T16:16:04.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.784+0000 7fd32f600700 1 Processor -- start 2024-02-28T16:16:04.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.784+0000 7fd32f600700 1 -- start start 2024-02-28T16:16:04.777 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.784+0000 7fd32f600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd328112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:04.778 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.784+0000 7fd32f600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd328113530 con 0x7fd3280fdc30 2024-02-28T16:16:04.779 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.785+0000 7fd32cc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd328112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:04.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.785+0000 7fd32cc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd328112ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:36204/0 (socket says 172.21.15.157:36204) 2024-02-28T16:16:04.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.785+0000 7fd32cc00700 1 -- 172.21.15.157:0/2346573934 learned_addr learned my addr 172.21.15.157:0/2346573934 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:04.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.786+0000 7fd32cc00700 1 -- 172.21.15.157:0/2346573934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c005040 con 0x7fd3280fdc30 2024-02-28T16:16:04.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.786+0000 7fd32cc00700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd328112ff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009330 tx=0x7fd31c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:04.780 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.787+0000 7fd324c00700 1 -- 172.21.15.157:0/2346573934 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd31c00be50 con 0x7fd3280fdc30 2024-02-28T16:16:04.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.787+0000 7fd324c00700 1 -- 172.21.15.157:0/2346573934 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd31c009630 con 0x7fd3280fdc30 2024-02-28T16:16:04.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.787+0000 7fd324c00700 1 -- 172.21.15.157:0/2346573934 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd31c01c3f0 con 0x7fd3280fdc30 2024-02-28T16:16:04.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.787+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd328113730 con 0x7fd3280fdc30 2024-02-28T16:16:04.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.787+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd328113ba0 con 0x7fd3280fdc30 2024-02-28T16:16:04.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.788+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32805f5c0 con 0x7fd3280fdc30 2024-02-28T16:16:04.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.789+0000 7fd324c00700 1 -- 172.21.15.157:0/2346573934 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fd31c0097a0 con 0x7fd3280fdc30 2024-02-28T16:16:04.782 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.789+0000 7fd324c00700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd3100369b0 0x7fd310038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:04.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.789+0000 7fd324c00700 1 -- 172.21.15.157:0/2346573934 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd31c049c00 con 0x7fd3280fdc30 2024-02-28T16:16:04.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.790+0000 7fd327e00700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd3100369b0 0x7fd310038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:04.784 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.791+0000 7fd327e00700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd3100369b0 0x7fd310038e60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd314009990 tx=0x7fd314006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:04.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:04.805+0000 7fd324c00700 1 -- 172.21.15.157:0/2346573934 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd31c011960 con 0x7fd3280fdc30 2024-02-28T16:16:05.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.100+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd328106f10 con 0x7fd3280fdc30 2024-02-28T16:16:05.092 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.101+0000 7fd324c00700 1 -- 172.21.15.157:0/2346573934 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd31c049e60 con 0x7fd3280fdc30 2024-02-28T16:16:05.093 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:05.093 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:16:05.095 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.103+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd3100369b0 msgr2=0x7fd310038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.103+0000 7fd32f600700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd3100369b0 0x7fd310038e60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd314009990 tx=0x7fd314006e40 comp rx=0 tx=0).stop 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.103+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 msgr2=0x7fd328112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.103+0000 7fd32f600700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd328112ff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009330 tx=0x7fd31c009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.104+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 shutdown_connections 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.104+0000 7fd32f600700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd3100369b0 0x7fd310038e60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.104+0000 7fd32f600700 1 --2- 172.21.15.157:0/2346573934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3280fdc30 0x7fd328112ff0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.104+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 >> 172.21.15.157:0/2346573934 conn(0x7fd3280f7660 msgr2=0x7fd328101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.104+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 shutdown_connections 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:05.104+0000 7fd32f600700 1 -- 172.21.15.157:0/2346573934 wait complete. 2024-02-28T16:16:05.096 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:16:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:05 smithi148 ceph-mon[28767]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:05 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2346573934' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:06.813 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:16:06.813 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:16:07.271 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:08.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:07 smithi148 ceph-mon[28767]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:09.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.274+0000 7ff7cde00700 1 -- 172.21.15.157:0/2063703835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 msgr2=0x7ff7c8102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:09.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.274+0000 7ff7cde00700 1 --2- 172.21.15.157:0/2063703835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8102fa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80048c0 tx=0x7ff7b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:09.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.274+0000 7ff7cde00700 1 -- 172.21.15.157:0/2063703835 shutdown_connections 2024-02-28T16:16:09.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.274+0000 7ff7cde00700 1 --2- 172.21.15.157:0/2063703835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8102fa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.274+0000 7ff7cde00700 1 -- 172.21.15.157:0/2063703835 >> 172.21.15.157:0/2063703835 conn(0x7ff7c80f8760 msgr2=0x7ff7c80fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:09.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.274+0000 7ff7cde00700 1 -- 172.21.15.157:0/2063703835 shutdown_connections 2024-02-28T16:16:09.267 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.274+0000 7ff7cde00700 1 -- 172.21.15.157:0/2063703835 wait complete. 2024-02-28T16:16:09.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.275+0000 7ff7cde00700 1 Processor -- start 2024-02-28T16:16:09.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.276+0000 7ff7cde00700 1 -- start start 2024-02-28T16:16:09.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.276+0000 7ff7cde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8115160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:09.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.276+0000 7ff7cde00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c81156a0 con 0x7ff7c8102bd0 2024-02-28T16:16:09.268 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.277+0000 7ff7c6a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8115160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:09.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.277+0000 7ff7c6a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8115160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:51292/0 (socket says 172.21.15.157:51292) 2024-02-28T16:16:09.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.277+0000 7ff7c6a00700 1 -- 172.21.15.157:0/1918743833 learned_addr learned my addr 172.21.15.157:0/1918743833 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:09.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.278+0000 7ff7c6a00700 1 -- 172.21.15.157:0/1918743833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b8005040 con 0x7ff7c8102bd0 2024-02-28T16:16:09.269 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.278+0000 7ff7c6a00700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8115160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009330 tx=0x7ff7b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:09.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.278+0000 7ff7bea00700 1 -- 172.21.15.157:0/1918743833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7b800be50 con 0x7ff7c8102bd0 2024-02-28T16:16:09.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.279+0000 7ff7bea00700 1 -- 172.21.15.157:0/1918743833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7b8009630 con 0x7ff7c8102bd0 2024-02-28T16:16:09.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.279+0000 7ff7bea00700 1 -- 172.21.15.157:0/1918743833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7b801c3f0 con 0x7ff7c8102bd0 2024-02-28T16:16:09.270 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.279+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c81158a0 con 0x7ff7c8102bd0 2024-02-28T16:16:09.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.279+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c8115d90 con 0x7ff7c8102bd0 2024-02-28T16:16:09.271 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.280+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c805f5c0 con 0x7ff7c8102bd0 2024-02-28T16:16:09.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.280+0000 7ff7bea00700 1 -- 172.21.15.157:0/1918743833 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7ff7b80097a0 con 0x7ff7c8102bd0 2024-02-28T16:16:09.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.281+0000 7ff7bea00700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7ac0369b0 0x7ff7ac038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:09.272 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.281+0000 7ff7bea00700 1 -- 172.21.15.157:0/1918743833 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff7b804a070 con 0x7ff7c8102bd0 2024-02-28T16:16:09.273 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.282+0000 7ff7c6000700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7ac0369b0 0x7ff7ac038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:09.274 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.283+0000 7ff7c6000700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7ac0369b0 0x7ff7ac038e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009990 tx=0x7ff7b4006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:09.286 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.294+0000 7ff7bea00700 1 -- 172.21.15.157:0/1918743833 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff7b8011550 con 0x7ff7c8102bd0 2024-02-28T16:16:09.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.579+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff7c81107e0 con 0x7ff7c8102bd0 2024-02-28T16:16:09.571 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.580+0000 7ff7bea00700 1 -- 172.21.15.157:0/1918743833 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7ff7b8011370 con 0x7ff7c8102bd0 2024-02-28T16:16:09.572 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:09.572 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:16:09.574 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.582+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7ac0369b0 msgr2=0x7ff7ac038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.582+0000 7ff7cde00700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7ac0369b0 0x7ff7ac038e60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009990 tx=0x7ff7b4006e40 comp rx=0 tx=0).stop 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 msgr2=0x7ff7c8115160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8115160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009330 tx=0x7ff7b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 shutdown_connections 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff7ac0369b0 0x7ff7ac038e60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 --2- 172.21.15.157:0/1918743833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff7c8102bd0 0x7ff7c8115160 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 >> 172.21.15.157:0/1918743833 conn(0x7ff7c80f8760 msgr2=0x7ff7c8071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 shutdown_connections 2024-02-28T16:16:09.575 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:09.583+0000 7ff7cde00700 1 -- 172.21.15.157:0/1918743833 wait complete. 2024-02-28T16:16:09.576 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:16:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:09 smithi148 ceph-mon[28767]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:10.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:09 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/1918743833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:11.260 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:16:11.260 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:16:11.717 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:12.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:11 smithi148 ceph-mon[28767]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:12.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:13.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.806+0000 7f20ed000700 1 -- 172.21.15.157:0/1977202028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 msgr2=0x7f20e8102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:13.798 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.806+0000 7f20ed000700 1 --2- 172.21.15.157:0/1977202028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8102fa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f20d80048c0 tx=0x7f20d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:13.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.806+0000 7f20ed000700 1 -- 172.21.15.157:0/1977202028 shutdown_connections 2024-02-28T16:16:13.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.806+0000 7f20ed000700 1 --2- 172.21.15.157:0/1977202028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8102fa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:13.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.806+0000 7f20ed000700 1 -- 172.21.15.157:0/1977202028 >> 172.21.15.157:0/1977202028 conn(0x7f20e80f8760 msgr2=0x7f20e80fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:13.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.806+0000 7f20ed000700 1 -- 172.21.15.157:0/1977202028 shutdown_connections 2024-02-28T16:16:13.799 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.806+0000 7f20ed000700 1 -- 172.21.15.157:0/1977202028 wait complete. 2024-02-28T16:16:13.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.807+0000 7f20ed000700 1 Processor -- start 2024-02-28T16:16:13.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.808+0000 7f20ed000700 1 -- start start 2024-02-28T16:16:13.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.808+0000 7f20ed000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8115130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:13.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.808+0000 7f20ed000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8115670 con 0x7f20e8102bd0 2024-02-28T16:16:13.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.809+0000 7f20e5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8115130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:13.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.809+0000 7f20e5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8115130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:51312/0 (socket says 172.21.15.157:51312) 2024-02-28T16:16:13.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.809+0000 7f20e5e00700 1 -- 172.21.15.157:0/583664358 learned_addr learned my addr 172.21.15.157:0/583664358 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:13.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.810+0000 7f20e5e00700 1 -- 172.21.15.157:0/583664358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8005040 con 0x7f20e8102bd0 2024-02-28T16:16:13.803 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.810+0000 7f20e5e00700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8115130 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009330 tx=0x7f20d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:13.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.811+0000 7f20de000700 1 -- 172.21.15.157:0/583664358 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20d800be50 con 0x7f20e8102bd0 2024-02-28T16:16:13.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.811+0000 7f20de000700 1 -- 172.21.15.157:0/583664358 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20d8009630 con 0x7f20e8102bd0 2024-02-28T16:16:13.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.811+0000 7f20de000700 1 -- 172.21.15.157:0/583664358 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20d801c3f0 con 0x7f20e8102bd0 2024-02-28T16:16:13.805 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.811+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e8115870 con 0x7f20e8102bd0 2024-02-28T16:16:13.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.811+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e8115d60 con 0x7f20e8102bd0 2024-02-28T16:16:13.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.812+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e805f5c0 con 0x7f20e8102bd0 2024-02-28T16:16:13.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.813+0000 7f20de000700 1 -- 172.21.15.157:0/583664358 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f20d80097a0 con 0x7f20e8102bd0 2024-02-28T16:16:13.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.813+0000 7f20de000700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20cc0369b0 0x7f20cc038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:13.806 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.813+0000 7f20de000700 1 -- 172.21.15.157:0/583664358 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f20d8049c00 con 0x7f20e8102bd0 2024-02-28T16:16:13.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.814+0000 7f20e5400700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20cc0369b0 0x7f20cc038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:13.807 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.815+0000 7f20e5400700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20cc0369b0 0x7f20cc038e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009990 tx=0x7f20d4006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:13.820 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:13.829+0000 7f20de000700 1 -- 172.21.15.157:0/583664358 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f20d8011960 con 0x7f20e8102bd0 2024-02-28T16:16:14.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.118+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f20e81108a0 con 0x7f20e8102bd0 2024-02-28T16:16:14.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.119+0000 7f20de000700 1 -- 172.21.15.157:0/583664358 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f20d8049e60 con 0x7f20e8102bd0 2024-02-28T16:16:14.111 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:14.111 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:16:14.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20cc0369b0 msgr2=0x7f20cc038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20cc0369b0 0x7f20cc038e60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009990 tx=0x7f20d4006e40 comp rx=0 tx=0).stop 2024-02-28T16:16:14.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 msgr2=0x7f20e8115130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:14.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8115130 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009330 tx=0x7f20d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:14.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 shutdown_connections 2024-02-28T16:16:14.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20cc0369b0 0x7f20cc038e60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 --2- 172.21.15.157:0/583664358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e8102bd0 0x7f20e8115130 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:14.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 >> 172.21.15.157:0/583664358 conn(0x7f20e80f8760 msgr2=0x7f20e8071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:14.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 shutdown_connections 2024-02-28T16:16:14.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:14.122+0000 7f20ed000700 1 -- 172.21.15.157:0/583664358 wait complete. 2024-02-28T16:16:14.116 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:16:14.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:13 smithi148 ceph-mon[28767]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:15.027 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:14 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/583664358' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:15.902 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:16:15.902 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:16:16.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:15 smithi148 ceph-mon[28767]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:16.346 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:18.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:17 smithi148 ceph-mon[28767]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:18.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.318+0000 7f4472a00700 1 -- 172.21.15.157:0/1992823180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 msgr2=0x7f446c102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.318+0000 7f4472a00700 1 --2- 172.21.15.157:0/1992823180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c102fa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f445c0048c0 tx=0x7f445c009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:18.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.318+0000 7f4472a00700 1 -- 172.21.15.157:0/1992823180 shutdown_connections 2024-02-28T16:16:18.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.318+0000 7f4472a00700 1 --2- 172.21.15.157:0/1992823180 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c102fa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.318+0000 7f4472a00700 1 -- 172.21.15.157:0/1992823180 >> 172.21.15.157:0/1992823180 conn(0x7f446c0f8760 msgr2=0x7f446c0fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:18.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.318+0000 7f4472a00700 1 -- 172.21.15.157:0/1992823180 shutdown_connections 2024-02-28T16:16:18.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.318+0000 7f4472a00700 1 -- 172.21.15.157:0/1992823180 wait complete. 2024-02-28T16:16:18.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.319+0000 7f4472a00700 1 Processor -- start 2024-02-28T16:16:18.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.319+0000 7f4472a00700 1 -- start start 2024-02-28T16:16:18.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.319+0000 7f4472a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c115170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.310 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.320+0000 7f4472a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1156b0 con 0x7f446c102bd0 2024-02-28T16:16:18.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.320+0000 7f446be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c115170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.320+0000 7f446be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c115170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:51332/0 (socket says 172.21.15.157:51332) 2024-02-28T16:16:18.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.320+0000 7f446be00700 1 -- 172.21.15.157:0/2611309283 learned_addr learned my addr 172.21.15.157:0/2611309283 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:18.311 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.321+0000 7f446be00700 1 -- 172.21.15.157:0/2611309283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c005040 con 0x7f446c102bd0 2024-02-28T16:16:18.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.322+0000 7f446be00700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c115170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f445c009330 tx=0x7f445c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:18.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.322+0000 7f4463e00700 1 -- 172.21.15.157:0/2611309283 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f445c00be50 con 0x7f446c102bd0 2024-02-28T16:16:18.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.322+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c1158b0 con 0x7f446c102bd0 2024-02-28T16:16:18.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.322+0000 7f4463e00700 1 -- 172.21.15.157:0/2611309283 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f445c009630 con 0x7f446c102bd0 2024-02-28T16:16:18.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.322+0000 7f4463e00700 1 -- 172.21.15.157:0/2611309283 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f445c01c3f0 con 0x7f446c102bd0 2024-02-28T16:16:18.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.322+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c115da0 con 0x7f446c102bd0 2024-02-28T16:16:18.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.323+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c05f5c0 con 0x7f446c102bd0 2024-02-28T16:16:18.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.324+0000 7f4463e00700 1 -- 172.21.15.157:0/2611309283 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f445c0097a0 con 0x7f446c102bd0 2024-02-28T16:16:18.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.324+0000 7f4463e00700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f44500369b0 0x7f4450038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:18.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.324+0000 7f4463e00700 1 -- 172.21.15.157:0/2611309283 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f445c049fb0 con 0x7f446c102bd0 2024-02-28T16:16:18.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.325+0000 7f446b400700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f44500369b0 0x7f4450038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:18.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.326+0000 7f446b400700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f44500369b0 0x7f4450038e60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4458009990 tx=0x7f4458006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:18.329 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.339+0000 7f4463e00700 1 -- 172.21.15.157:0/2611309283 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f445c075bd0 con 0x7f446c102bd0 2024-02-28T16:16:18.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.630+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f446c110830 con 0x7f446c102bd0 2024-02-28T16:16:18.622 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.632+0000 7f4463e00700 1 -- 172.21.15.157:0/2611309283 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f445c011370 con 0x7f446c102bd0 2024-02-28T16:16:18.623 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:18.623 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:16:18.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f44500369b0 msgr2=0x7f4450038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f44500369b0 0x7f4450038e60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4458009990 tx=0x7f4458006e40 comp rx=0 tx=0).stop 2024-02-28T16:16:18.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 msgr2=0x7f446c115170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:18.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c115170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f445c009330 tx=0x7f445c009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:18.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 shutdown_connections 2024-02-28T16:16:18.625 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f44500369b0 0x7f4450038e60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 --2- 172.21.15.157:0/2611309283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f446c102bd0 0x7f446c115170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:18.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.634+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 >> 172.21.15.157:0/2611309283 conn(0x7f446c0f8760 msgr2=0x7f446c0fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:18.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.635+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 shutdown_connections 2024-02-28T16:16:18.626 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:18.635+0000 7f4472a00700 1 -- 172.21.15.157:0/2611309283 wait complete. 2024-02-28T16:16:18.626 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:16:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:18 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2611309283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:20.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:19 smithi148 ceph-mon[28767]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:20.583 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:16:20.584 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:16:21.045 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:22.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:21 smithi148 ceph-mon[28767]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:23.811 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.820+0000 7fd87ac00700 1 -- 172.21.15.157:0/70956095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 msgr2=0x7fd8740fdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:23.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.820+0000 7fd87ac00700 1 --2- 172.21.15.157:0/70956095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8740fdd90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8640048c0 tx=0x7fd864009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:23.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.820+0000 7fd87ac00700 1 -- 172.21.15.157:0/70956095 shutdown_connections 2024-02-28T16:16:23.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.820+0000 7fd87ac00700 1 --2- 172.21.15.157:0/70956095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8740fdd90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:23.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.820+0000 7fd87ac00700 1 -- 172.21.15.157:0/70956095 >> 172.21.15.157:0/70956095 conn(0x7fd8740720b0 msgr2=0x7fd8740724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:23.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.820+0000 7fd87ac00700 1 -- 172.21.15.157:0/70956095 shutdown_connections 2024-02-28T16:16:23.812 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.820+0000 7fd87ac00700 1 -- 172.21.15.157:0/70956095 wait complete. 2024-02-28T16:16:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.821+0000 7fd87ac00700 1 Processor -- start 2024-02-28T16:16:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.821+0000 7fd87ac00700 1 -- start start 2024-02-28T16:16:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.822+0000 7fd87ac00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8741151e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.822+0000 7fd87ac00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd874115720 con 0x7fd8740fd9c0 2024-02-28T16:16:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.822+0000 7fd873e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8741151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.823+0000 7fd873e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8741151e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:45196/0 (socket says 172.21.15.157:45196) 2024-02-28T16:16:23.813 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.823+0000 7fd873e00700 1 -- 172.21.15.157:0/957137490 learned_addr learned my addr 172.21.15.157:0/957137490 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:23.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.823+0000 7fd873e00700 1 -- 172.21.15.157:0/957137490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864005040 con 0x7fd8740fd9c0 2024-02-28T16:16:23.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.824+0000 7fd873e00700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8741151e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd864009330 tx=0x7fd864009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.814 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.824+0000 7fd86be00700 1 -- 172.21.15.157:0/957137490 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd86400be50 con 0x7fd8740fd9c0 2024-02-28T16:16:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.824+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874115920 con 0x7fd8740fd9c0 2024-02-28T16:16:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.824+0000 7fd86be00700 1 -- 172.21.15.157:0/957137490 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd864009630 con 0x7fd8740fd9c0 2024-02-28T16:16:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.824+0000 7fd86be00700 1 -- 172.21.15.157:0/957137490 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd86401c3f0 con 0x7fd8740fd9c0 2024-02-28T16:16:23.815 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.824+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd874115d90 con 0x7fd8740fd9c0 2024-02-28T16:16:23.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.825+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87405f5c0 con 0x7fd8740fd9c0 2024-02-28T16:16:23.816 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.826+0000 7fd86be00700 1 -- 172.21.15.157:0/957137490 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7fd8640097a0 con 0x7fd8740fd9c0 2024-02-28T16:16:23.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.826+0000 7fd86be00700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd858036960 0x7fd858038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:23.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.826+0000 7fd86be00700 1 -- 172.21.15.157:0/957137490 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd864049b30 con 0x7fd8740fd9c0 2024-02-28T16:16:23.817 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.827+0000 7fd873400700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd858036960 0x7fd858038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:23.818 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.828+0000 7fd873400700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd858036960 0x7fd858038e10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd860009990 tx=0x7fd860006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:23.831 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:23.841+0000 7fd86be00700 1 -- 172.21.15.157:0/957137490 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd864011940 con 0x7fd8740fd9c0 2024-02-28T16:16:24.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.128+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd8741108a0 con 0x7fd8740fd9c0 2024-02-28T16:16:24.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.129+0000 7fd86be00700 1 -- 172.21.15.157:0/957137490 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7fd864011370 con 0x7fd8740fd9c0 2024-02-28T16:16:24.120 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:24.120 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd858036960 msgr2=0x7fd858038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd858036960 0x7fd858038e10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd860009990 tx=0x7fd860006e40 comp rx=0 tx=0).stop 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 msgr2=0x7fd8741151e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8741151e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd864009330 tx=0x7fd864009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 shutdown_connections 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd858036960 0x7fd858038e10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 --2- 172.21.15.157:0/957137490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8740fd9c0 0x7fd8741151e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:24.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 >> 172.21.15.157:0/957137490 conn(0x7fd8740720b0 msgr2=0x7fd8740fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:24.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 shutdown_connections 2024-02-28T16:16:24.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:24.133+0000 7fd87ac00700 1 -- 172.21.15.157:0/957137490 wait complete. 2024-02-28T16:16:24.127 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:16:24.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:23 smithi148 ceph-mon[28767]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: Deploying daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:16:25.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:25.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:24 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/957137490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:25.930 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:16:25.931 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:16:26.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:26.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:26.416 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:27.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:26 smithi148 ceph-mon[28767]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.808+0000 7f4255c00700 1 -- 172.21.15.157:0/4226549199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 msgr2=0x7f42500fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.808+0000 7f4255c00700 1 --2- 172.21.15.157:0/4226549199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42500fe020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42400048c0 tx=0x7f4240009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:28.889 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.808+0000 7f4255c00700 1 -- 172.21.15.157:0/4226549199 shutdown_connections 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.808+0000 7f4255c00700 1 --2- 172.21.15.157:0/4226549199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42500fe020 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.808+0000 7f4255c00700 1 -- 172.21.15.157:0/4226549199 >> 172.21.15.157:0/4226549199 conn(0x7f4250072850 msgr2=0x7f4250072c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.809+0000 7f4255c00700 1 -- 172.21.15.157:0/4226549199 shutdown_connections 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.809+0000 7f4255c00700 1 -- 172.21.15.157:0/4226549199 wait complete. 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.809+0000 7f4255c00700 1 Processor -- start 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.810+0000 7f4255c00700 1 -- start start 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.810+0000 7f4255c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42501151c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.810+0000 7f4255c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4250115700 con 0x7f42500fdc50 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.811+0000 7f424ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42501151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.811+0000 7f424ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42501151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.157:45238/0 (socket says 172.21.15.157:45238) 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.811+0000 7f424ea00700 1 -- 172.21.15.157:0/4186465203 learned_addr learned my addr 172.21.15.157:0/4186465203 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.812+0000 7f424ea00700 1 -- 172.21.15.157:0/4186465203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240005040 con 0x7f42500fdc50 2024-02-28T16:16:28.890 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.812+0000 7f424ea00700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42501151c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4240009300 tx=0x7f4240009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.812+0000 7f4246a00700 1 -- 172.21.15.157:0/4186465203 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4240004e60 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.813+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4250115900 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.813+0000 7f4246a00700 1 -- 172.21.15.157:0/4186465203 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4240013420 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.813+0000 7f4246a00700 1 -- 172.21.15.157:0/4186465203 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f424001c5b0 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.813+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4250115d70 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.814+0000 7f4246a00700 1 -- 172.21.15.157:0/4186465203 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 17) v1 ==== 43483+0+0 (secure 0 0 0) 0x7f4240013a90 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.814+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425005f5c0 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.815+0000 7f4246a00700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4234036960 0x7f4234038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.815+0000 7f4246a00700 1 -- 172.21.15.157:0/4186465203 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4240049bf0 con 0x7f42500fdc50 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.815+0000 7f424e000700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4234036960 0x7f4234038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.816+0000 7f424e000700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4234036960 0x7f4234038e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f423c009990 tx=0x7f423c006e40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:28.891 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:28.829+0000 7f4246a00700 1 -- 172.21.15.157:0/4186465203 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4240011960 con 0x7f42500fdc50 2024-02-28T16:16:29.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.126+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4250106f30 con 0x7f42500fdc50 2024-02-28T16:16:29.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.127+0000 7f4246a00700 1 -- 172.21.15.157:0/4186465203 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+743 (secure 0 0 0) 0x7f4240011370 con 0x7f42500fdc50 2024-02-28T16:16:29.118 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:29.118 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":1,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:12:23.284287Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T16:16:29.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.130+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4234036960 msgr2=0x7f4234038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.130+0000 7f4255c00700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4234036960 0x7f4234038e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f423c009990 tx=0x7f423c006e40 comp rx=0 tx=0).stop 2024-02-28T16:16:29.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.130+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 msgr2=0x7f42501151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.130+0000 7f4255c00700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42501151c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4240009300 tx=0x7f4240009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.131+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 shutdown_connections 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.131+0000 7f4255c00700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4234036960 0x7f4234038e10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.131+0000 7f4255c00700 1 --2- 172.21.15.157:0/4186465203 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42500fdc50 0x7f42501151c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.131+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 >> 172.21.15.157:0/4186465203 conn(0x7f4250072850 msgr2=0x7f4250103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.131+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 shutdown_connections 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:29.131+0000 7f4255c00700 1 -- 172.21.15.157:0/4186465203 wait complete. 2024-02-28T16:16:29.122 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 1 2024-02-28T16:16:29.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:28 smithi148 ceph-mon[28767]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:29.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:29.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:16:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:29 smithi148 ceph-mon[28767]: Deploying daemon mon.smithi157 on smithi157 2024-02-28T16:16:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:29 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/4186465203' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:31.167 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T16:16:31.168 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T16:16:32.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:31 smithi148 ceph-mon[28767]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:32.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:32.739 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:16:33.633 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:33 smithi157 systemd[1]: Starting Ceph mon.smithi157 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:16:34.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:33 smithi148 ceph-mon[28767]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:34.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 podman[38301]: 2024-02-28 16:16:34.186455129 +0000 UTC m=+0.042600035 image pull 1c37ed3713489866ca403a4faaa38eb6c635a16f541c47d5bb849a203de99e6f quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13 2024-02-28T16:16:34.536 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 podman[38301]: 2024-02-28 16:16:34.301036562 +0000 UTC m=+0.157181505 container create b959330f9a4318a46bc6b0501d5a6b921752cb9a75b9196e3768c7634b9550f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=quincy-c0f02e6, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 podman[38301]: 2024-02-28 16:16:34.807278598 +0000 UTC m=+0.663423526 container init b959330f9a4318a46bc6b0501d5a6b921752cb9a75b9196e3768c7634b9550f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=quincy-c0f02e6, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 podman[38301]: 2024-02-28 16:16:34.816176931 +0000 UTC m=+0.672321846 container start b959330f9a4318a46bc6b0501d5a6b921752cb9a75b9196e3768c7634b9550f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c0f02e6, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD) 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable), process ceph-mon, pid 2 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pidfile_write: ignore empty --pid-file 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: load: jerasure load: lrc 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: RocksDB version: 6.15.5 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Compile date Feb 26 2024 2024-02-28T16:16:35.142 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: DB SUMMARY 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: DB Session ID: KYP4424EBGDBHGO9C5H4 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi157/store.db dir, Total Num: 0, files: 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi157/store.db: 000004.log size: 511 ; 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.env: 0x55b6bc60aa80 2024-02-28T16:16:35.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.fs: Posix File System 2024-02-28T16:16:35.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.info_log: 0x55b6bdc53cc0 2024-02-28T16:16:35.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:16:35.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.statistics: (nil) 2024-02-28T16:16:35.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.use_fsync: 0 2024-02-28T16:16:35.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:16:35.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:16:35.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.db_log_dir: 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi157/store.db 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:16:35.145 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.write_buffer_manager: 0x55b6be9c8ae0 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:16:35.146 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.unordered_write: 0 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.row_cache: None 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.wal_filter: None 2024-02-28T16:16:35.147 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:16:35.148 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:16:35.148 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.preserve_deletes: 0 2024-02-28T16:16:35.148 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:16:35.148 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:16:35.148 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:16:35.149 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:16:35.150 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_open_files: -1 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Compression algorithms supported: 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kZSTD supported: 0 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:16:35.151 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000003 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.merge_operator: 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_filter: None 2024-02-28T16:16:35.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b6bdca8f58) 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_type: 0 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_index_type: 0 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_shortening: 1 2024-02-28T16:16:35.153 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: hash_index_allow_collision: 1 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: checksum: 1 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: no_block_cache: 0 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache: 0x55b6bdcdb090 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_options: 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: capacity : 536870912 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: num_shard_bits : 4 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: strict_capacity_limit : 0 2024-02-28T16:16:35.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_compressed: (nil) 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: persistent_cache: (nil) 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size: 4096 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size_deviation: 10 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_restart_interval: 16 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_block_restart_interval: 1 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: metadata_block_size: 4096 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: partition_filters: 0 2024-02-28T16:16:35.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: use_delta_encoding: 1 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: whole_key_filtering: 1 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: verify_compression: 0 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: format_version: 4 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_index_compression: 1 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_align: 0 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression: NoCompression 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:16:35.156 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.num_levels: 7 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:16:35.158 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:16:35.159 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:16:35.160 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.arena_block_size: 4194304 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:16:35.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:16:35.162 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.ttl: 2592000 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-02-28T16:16:35.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136994862350, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136994863132, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1709136994, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "ed3120bf-6a1e-4b4d-9346-ec2133ebae98", "db_session_id": "KYP4424EBGDBHGO9C5H4"}} 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709136994863731, "job": 1, "event": "recovery_finished"} 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi157/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55b6bdc6f180 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: DB pointer 0x55b6bdd44000 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-02-28T16:16:35.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** DB Stats ** 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-28T16:16:35.165 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:16:35.166 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-02-28T16:16:35.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:16:35.168 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157 does not exist in monmap, will attempt to join an existing cluster 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: using public_addr v2:172.21.15.157:0/0 -> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: starting mon.smithi157 rank -1 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi157 fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(???) e0 preinit fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 bash[38301]: b959330f9a4318a46bc6b0501d5a6b921752cb9a75b9196e3768c7634b9550f3 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).mds e1 new map 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).mds e1 print_map 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: e1 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:16:35.169 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: legacy client fscid: -1 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: No filesystems configured 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-28T16:16:35.170 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 systemd[1]: Started Ceph mon.smithi157 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mgrmap e17: smithi148.gelspy(active, since 2s) 2024-02-28T16:16:35.171 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/2040037504' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.172 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:16:35.173 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:35.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:35.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:16:35.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:16:35.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:35.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:35.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/547198962' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T16:16:35.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Deploying daemon crash.smithi157 on smithi157 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/697279852' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Deploying daemon node-exporter.smithi157 on smithi157 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.177 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/611901168' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/3488095892' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/1865232371' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/3475420326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/2346573934' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/1918743833' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/583664358' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/2611309283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-28T16:16:35.180 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Deploying daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/957137490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.181 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:16:35.182 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:35.182 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: Deploying daemon mon.smithi157 on smithi157 2024-02-28T16:16:35.182 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/4186465203' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:35.182 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.182 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:35.182 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:35.182 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:34 smithi157 ceph-mon[38346]: mon.smithi157@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-02-28T16:16:40.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: mon.smithi148 calling monitor election 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: mon.smithi157 calling monitor election 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: mon.smithi148 is new leader, mons smithi148,smithi157 in quorum (ranks 0,1) 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: monmap e2: 2 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: fsmap 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: mgrmap e17: smithi148.gelspy(active, since 74s) 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: overall HEALTH_OK 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:40.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:40.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:16:40.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: mon.smithi148 calling monitor election 2024-02-28T16:16:40.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: mon.smithi157 calling monitor election 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: mon.smithi148 is new leader, mons smithi148,smithi157 in quorum (ranks 0,1) 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: monmap e2: 2 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: fsmap 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T16:16:40.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: mgrmap e17: smithi148.gelspy(active, since 74s) 2024-02-28T16:16:40.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:16:40.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:16:40.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: overall HEALTH_OK 2024-02-28T16:16:40.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:16:40.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/217848466' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:16:40.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:40.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.191+0000 7f3cd0600700 1 -- 172.21.15.157:0/76714136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb00061f0 msgr2=0x7f3cb0008650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.191+0000 7f3cd0600700 1 --2- 172.21.15.157:0/76714136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb00061f0 0x7f3cb0008650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80fdda0 tx=0x7f3cbc002040 comp rx=0 tx=0).stop 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.191+0000 7f3cd0600700 1 -- 172.21.15.157:0/76714136 shutdown_connections 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.191+0000 7f3cd0600700 1 --2- 172.21.15.157:0/76714136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cb00061f0 0x7f3cb0008650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.191+0000 7f3cd0600700 1 -- 172.21.15.157:0/76714136 >> 172.21.15.157:0/76714136 conn(0x7f3cc80f8860 msgr2=0x7f3cc80fac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.191+0000 7f3cd0600700 1 -- 172.21.15.157:0/76714136 shutdown_connections 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.191+0000 7f3cd0600700 1 -- 172.21.15.157:0/76714136 wait complete. 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.192+0000 7f3cd0600700 1 Processor -- start 2024-02-28T16:16:41.183 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.192+0000 7f3cd0600700 1 -- start start 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.193+0000 7f3cd0600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 0x7f3cc8113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.193+0000 7f3cd0600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc81136b0 0x7f3cc810d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.193+0000 7f3cd0600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8113cc0 con 0x7f3cc81136b0 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.193+0000 7f3cd0600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc810d550 con 0x7f3cb00061f0 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccdc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 0x7f3cc8113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccdc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 0x7f3cc8113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34540/0 (socket says 172.21.15.157:34540) 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccdc00700 1 -- 172.21.15.157:0/1918004353 learned_addr learned my addr 172.21.15.157:0/1918004353 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccdc00700 1 -- 172.21.15.157:0/1918004353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 msgr2=0x7f3cc8113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccdc00700 1 -- 172.21.15.157:0/1918004353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 msgr2=0x7f3cc8113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccdc00700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 0x7f3cc8113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccdc00700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 0x7f3cc8113170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T16:16:41.185 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.194+0000 7f3ccd200700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc81136b0 0x7f3cc810d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:41.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.195+0000 7f3ccd200700 1 -- 172.21.15.157:0/1918004353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 msgr2=0x7f3cc8113170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T16:16:41.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.195+0000 7f3ccd200700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 0x7f3cc8113170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:41.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.195+0000 7f3ccd200700 1 -- 172.21.15.157:0/1918004353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc005040 con 0x7f3cc81136b0 2024-02-28T16:16:41.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.195+0000 7f3ccd200700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc81136b0 0x7f3cc810d010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400b790 tx=0x7f3cb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:41.186 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.196+0000 7f3cc5600700 1 -- 172.21.15.157:0/1918004353 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb4011810 con 0x7f3cc81136b0 2024-02-28T16:16:41.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.196+0000 7f3cc5600700 1 -- 172.21.15.157:0/1918004353 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cb4011e40 con 0x7f3cc81136b0 2024-02-28T16:16:41.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.196+0000 7f3cc5600700 1 -- 172.21.15.157:0/1918004353 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb400f2e0 con 0x7f3cc81136b0 2024-02-28T16:16:41.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.196+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc810d830 con 0x7f3cc81136b0 2024-02-28T16:16:41.187 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.196+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc810ddf0 con 0x7f3cc81136b0 2024-02-28T16:16:41.188 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.198+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc805f5c0 con 0x7f3cc81136b0 2024-02-28T16:16:41.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.199+0000 7f3cc5600700 1 -- 172.21.15.157:0/1918004353 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f3cb4010380 con 0x7f3cc81136b0 2024-02-28T16:16:41.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.200+0000 7f3cc5600700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3ca8069370 0x7f3ca806b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:41.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.201+0000 7f3cc5600700 1 -- 172.21.15.157:0/1918004353 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3cb4086580 con 0x7f3cc81136b0 2024-02-28T16:16:41.191 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.201+0000 7f3ccdc00700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3ca8069370 0x7f3ca806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:41.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.202+0000 7f3ccdc00700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3ca8069370 0x7f3ca806b820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0045a0 tx=0x7f3cbc002040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:41.196 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.206+0000 7f3cc5600700 1 -- 172.21.15.157:0/1918004353 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3cb4057380 con 0x7f3cc81136b0 2024-02-28T16:16:41.375 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:41.375 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: mgrmap e18: smithi148.gelspy(active, since 74s), standbys: smithi157.cmcxzj 2024-02-28T16:16:41.375 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:16:41.375 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: mgrmap e18: smithi148.gelspy(active, since 74s), standbys: smithi157.cmcxzj 2024-02-28T16:16:41.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:16:41.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:16:41.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:41.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:41.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:16:41.491 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.500+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3cc81049f0 con 0x7f3cc81136b0 2024-02-28T16:16:41.492 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.502+0000 7f3cc5600700 1 -- 172.21.15.157:0/1918004353 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1021 (secure 0 0 0) 0x7f3cb4015020 con 0x7f3cc81136b0 2024-02-28T16:16:41.493 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-02-28T16:16:41.493 INFO:teuthology.orchestra.run.smithi157.stdout:{"epoch":2,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","modified":"2024-02-28T16:16:34.922074Z","created":"2024-02-28T16:12:23.284287Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi148","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi157","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:3300","nonce":0},{"type":"v1","addr":"172.21.15.157:6789","nonce":0}]},"addr":"172.21.15.157:6789/0","public_addr":"172.21.15.157:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-28T16:16:41.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.504+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3ca8069370 msgr2=0x7f3ca806b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:41.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.504+0000 7f3cd0600700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3ca8069370 0x7f3ca806b820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0045a0 tx=0x7f3cbc002040 comp rx=0 tx=0).stop 2024-02-28T16:16:41.495 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.504+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc81136b0 msgr2=0x7f3cc810d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.504+0000 7f3cd0600700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc81136b0 0x7f3cc810d010 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400b790 tx=0x7f3cb40091a0 comp rx=0 tx=0).stop 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.505+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 shutdown_connections 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.505+0000 7f3cd0600700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3ca8069370 0x7f3ca806b820 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.505+0000 7f3cd0600700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cb00061f0 0x7f3cc8113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.505+0000 7f3cd0600700 1 --2- 172.21.15.157:0/1918004353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc81136b0 0x7f3cc810d010 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.505+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 >> 172.21.15.157:0/1918004353 conn(0x7f3cc80f8860 msgr2=0x7f3cc80fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.505+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 shutdown_connections 2024-02-28T16:16:41.496 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:16:41.505+0000 7f3cd0600700 1 -- 172.21.15.157:0/1918004353 wait complete. 2024-02-28T16:16:41.497 INFO:teuthology.orchestra.run.smithi157.stderr:dumped monmap epoch 2 2024-02-28T16:16:42.100 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:42 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/1918004353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:42.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:42 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/1918004353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T16:16:42.506 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-28T16:16:42.507 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph config generate-minimal-conf 2024-02-28T16:16:42.989 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:16:43.067 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:43 smithi157 ceph-mon[38346]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:43.292 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:43 smithi148 ceph-mon[28767]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:44.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:44 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:44.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:44 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:44.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:44 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:44.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:44 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:44.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:44 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:44.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:44 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:44.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:44 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:44.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:44 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:16:45.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.107+0000 7fdd16c00700 1 -- 172.21.15.148:0/3946439694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 msgr2=0x7fdd10102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:45.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.107+0000 7fdd16c00700 1 --2- 172.21.15.148:0/3946439694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10102f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdd000048c0 tx=0x7fdd00009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:45.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.107+0000 7fdd16c00700 1 -- 172.21.15.148:0/3946439694 shutdown_connections 2024-02-28T16:16:45.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.107+0000 7fdd16c00700 1 --2- 172.21.15.148:0/3946439694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10102f80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:45.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.107+0000 7fdd16c00700 1 -- 172.21.15.148:0/3946439694 >> 172.21.15.148:0/3946439694 conn(0x7fdd100f8760 msgr2=0x7fdd100fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:45.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.107+0000 7fdd16c00700 1 -- 172.21.15.148:0/3946439694 shutdown_connections 2024-02-28T16:16:45.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.107+0000 7fdd16c00700 1 -- 172.21.15.148:0/3946439694 wait complete. 2024-02-28T16:16:45.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.108+0000 7fdd16c00700 1 Processor -- start 2024-02-28T16:16:45.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.108+0000 7fdd16c00700 1 -- start start 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd16c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10115270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd16c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd101157b0 0x7fdd1010f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd16c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd10115dc0 con 0x7fdd10102bb0 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd16c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1010f650 con 0x7fdd101157b0 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd0fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10115270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd0fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10115270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38668/0 (socket says 172.21.15.148:38668) 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd0fe00700 1 -- 172.21.15.148:0/373787802 learned_addr learned my addr 172.21.15.148:0/373787802 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.109+0000 7fdd0f400700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd101157b0 0x7fdd1010f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.110+0000 7fdd0fe00700 1 -- 172.21.15.148:0/373787802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd101157b0 msgr2=0x7fdd1010f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.110+0000 7fdd0fe00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd101157b0 0x7fdd1010f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:45.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.110+0000 7fdd0fe00700 1 -- 172.21.15.148:0/373787802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00005040 con 0x7fdd10102bb0 2024-02-28T16:16:45.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.110+0000 7fdd0fe00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10115270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000b870 tx=0x7fdd00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:45.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.110+0000 7fdd07e00700 1 -- 172.21.15.148:0/373787802 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0000e040 con 0x7fdd10102bb0 2024-02-28T16:16:45.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.110+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1010f8d0 con 0x7fdd10102bb0 2024-02-28T16:16:45.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.111+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1010fe90 con 0x7fdd10102bb0 2024-02-28T16:16:45.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.111+0000 7fdd07e00700 1 -- 172.21.15.148:0/373787802 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd00013420 con 0x7fdd10102bb0 2024-02-28T16:16:45.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.111+0000 7fdd07e00700 1 -- 172.21.15.148:0/373787802 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0001c630 con 0x7fdd10102bb0 2024-02-28T16:16:45.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.112+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf00052e0 con 0x7fdd10102bb0 2024-02-28T16:16:45.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.114+0000 7fdd07e00700 1 -- 172.21.15.148:0/373787802 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fdd00013590 con 0x7fdd10102bb0 2024-02-28T16:16:45.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.115+0000 7fdd07e00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdcf4069380 0x7fdcf406b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:45.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.115+0000 7fdd07e00700 1 -- 172.21.15.148:0/373787802 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fdd00087380 con 0x7fdd10102bb0 2024-02-28T16:16:45.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.116+0000 7fdd0f400700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdcf4069380 0x7fdcf406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:45.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.116+0000 7fdd0f400700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdcf4069380 0x7fdcf406b830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009c10 tx=0x7fdcfc0091a0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:45.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.121+0000 7fdd07e00700 1 -- 172.21.15.148:0/373787802 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fdd00058200 con 0x7fdd10102bb0 2024-02-28T16:16:45.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.333+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fdcf0005590 con 0x7fdd10102bb0 2024-02-28T16:16:45.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.333+0000 7fdd07e00700 1 -- 172.21.15.148:0/373787802 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7fdd00013840 con 0x7fdd10102bb0 2024-02-28T16:16:45.525 INFO:teuthology.orchestra.run.smithi148.stdout:# minimal ceph.conf for 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:16:45.525 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-02-28T16:16:45.525 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:16:45.525 INFO:teuthology.orchestra.run.smithi148.stdout: mon_host = [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] 2024-02-28T16:16:45.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.337+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdcf4069380 msgr2=0x7fdcf406b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:45.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.337+0000 7fdd16c00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdcf4069380 0x7fdcf406b830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009c10 tx=0x7fdcfc0091a0 comp rx=0 tx=0).stop 2024-02-28T16:16:45.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.337+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 msgr2=0x7fdd10115270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:45.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.337+0000 7fdd16c00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10115270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000b870 tx=0x7fdd00009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:45.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.338+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 shutdown_connections 2024-02-28T16:16:45.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.338+0000 7fdd16c00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd10102bb0 0x7fdd10115270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:45.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.338+0000 7fdd16c00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdcf4069380 0x7fdcf406b830 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:45.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.338+0000 7fdd16c00700 1 --2- 172.21.15.148:0/373787802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdd101157b0 0x7fdd1010f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:45.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.338+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 >> 172.21.15.148:0/373787802 conn(0x7fdd100f8760 msgr2=0x7fdd10071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:45.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.338+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 shutdown_connections 2024-02-28T16:16:45.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:45.338+0000 7fdd16c00700 1 -- 172.21.15.148:0/373787802 wait complete. 2024-02-28T16:16:45.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:45 smithi157 ceph-mon[38346]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:45.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:45 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:16:45.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:45 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:16:45.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:45 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/373787802' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:45 smithi148 ceph-mon[28767]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:46.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:45 smithi148 ceph-mon[28767]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:16:46.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:45 smithi148 ceph-mon[28767]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:16:46.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:45 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/373787802' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:46.249 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-28T16:16:46.249 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:16:46.249 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T16:16:46.338 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:16:46.339 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:16:46.450 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:16:46.450 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T16:16:46.547 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:16:46.547 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:16:46.686 INFO:tasks.cephadm:Deploying OSDs... 2024-02-28T16:16:46.686 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:16:46.686 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T16:16:46.702 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:46.702 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:46.702 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:16:46.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:16:46.703 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:46.727 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T16:16:46.727 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-02-28T16:16:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T16:16:46.807 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:46.807 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-02-28T16:16:46.807 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:46.807 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:46.808 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-02-28 16:15:15.555218941 +0000 2024-02-28T16:16:46.808 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-02-28 16:07:02.085416483 +0000 2024-02-28T16:16:46.808 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-02-28 16:07:02.085416483 +0000 2024-02-28T16:16:46.808 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-02-28 16:07:02.085416483 +0000 2024-02-28T16:16:46.808 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T16:16:46.929 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-02-28T16:16:46.929 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-02-28T16:16:46.929 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000312869 s, 1.6 MB/s 2024-02-28T16:16:46.932 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T16:16:46.980 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-02-28T16:16:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:16:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:46.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:16:46.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:16:46.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:47.075 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-02-28 16:15:15.556218918 +0000 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-02-28 16:07:02.664402859 +0000 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-02-28 16:07:02.664402859 +0000 2024-02-28T16:16:47.076 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-02-28 16:07:02.664402859 +0000 2024-02-28T16:16:47.076 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T16:16:47.156 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-02-28T16:16:47.156 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-02-28T16:16:47.156 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000328246 s, 1.6 MB/s 2024-02-28T16:16:47.159 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T16:16:47.209 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-02-28 16:15:15.557218895 +0000 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-02-28 16:07:03.227389612 +0000 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-02-28 16:07:03.227389612 +0000 2024-02-28T16:16:47.253 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-02-28 16:07:03.227389612 +0000 2024-02-28T16:16:47.254 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T16:16:47.366 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-02-28T16:16:47.367 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-02-28T16:16:47.367 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000313008 s, 1.6 MB/s 2024-02-28T16:16:47.369 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T16:16:47.417 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-02-28 16:15:15.558218871 +0000 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-02-28 16:07:03.799376154 +0000 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-02-28 16:07:03.799376154 +0000 2024-02-28T16:16:47.462 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-02-28 16:07:03.799376154 +0000 2024-02-28T16:16:47.463 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T16:16:47.591 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-02-28T16:16:47.592 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-02-28T16:16:47.592 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000333494 s, 1.5 MB/s 2024-02-28T16:16:47.595 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T16:16:47.649 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:16:47.649 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T16:16:47.707 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T16:16:47.707 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-28 16:16:33.299452179 +0000 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-28 16:06:57.608922357 +0000 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-28 16:06:57.608922357 +0000 2024-02-28T16:16:47.758 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-02-28 16:06:57.608922357 +0000 2024-02-28T16:16:47.759 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T16:16:47.841 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-28T16:16:47.842 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-28T16:16:47.842 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000298058 s, 1.7 MB/s 2024-02-28T16:16:47.844 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T16:16:47.899 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-02-28T16:16:47.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:47 smithi148 ceph-mon[28767]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:47.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:47 smithi148 ceph-mon[28767]: Reconfiguring mon.smithi148 (unknown last config time)... 2024-02-28T16:16:47.926 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:47 smithi148 ceph-mon[28767]: Reconfiguring daemon mon.smithi148 on smithi148 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-28 16:16:33.299452179 +0000 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-28 16:06:58.236911327 +0000 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-28 16:06:58.236911327 +0000 2024-02-28T16:16:47.949 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-02-28 16:06:58.236911327 +0000 2024-02-28T16:16:47.950 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T16:16:47.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:47 smithi157 ceph-mon[38346]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:47.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:47 smithi157 ceph-mon[38346]: Reconfiguring mon.smithi148 (unknown last config time)... 2024-02-28T16:16:47.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:47 smithi157 ceph-mon[38346]: Reconfiguring daemon mon.smithi148 on smithi148 2024-02-28T16:16:48.033 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-28T16:16:48.034 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-28T16:16:48.034 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000235299 s, 2.2 MB/s 2024-02-28T16:16:48.037 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T16:16:48.137 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-28 16:16:33.300452162 +0000 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-28 16:06:58.797901472 +0000 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-28 16:06:58.797901472 +0000 2024-02-28T16:16:48.185 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-02-28 16:06:58.797901472 +0000 2024-02-28T16:16:48.185 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T16:16:48.272 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-28T16:16:48.272 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-28T16:16:48.273 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000242978 s, 2.1 MB/s 2024-02-28T16:16:48.277 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T16:16:48.334 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-02-28T16:16:48.384 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-02-28 16:16:33.301452145 +0000 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-28 16:06:59.360891583 +0000 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-28 16:06:59.360891583 +0000 2024-02-28T16:16:48.385 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-02-28 16:06:59.360891583 +0000 2024-02-28T16:16:48.385 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T16:16:48.467 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-02-28T16:16:48.468 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-02-28T16:16:48.468 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000312661 s, 1.6 MB/s 2024-02-28T16:16:48.472 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T16:16:48.526 INFO:tasks.cephadm:Deploying osd.0 on smithi148 with /dev/vg_nvme/lv_4... 2024-02-28T16:16:48.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T16:16:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: Reconfiguring mgr.smithi148.gelspy (unknown last config time)... 2024-02-28T16:16:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:16:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:16:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:49 smithi157 ceph-mon[38346]: Reconfiguring daemon mgr.smithi148.gelspy on smithi148 2024-02-28T16:16:49.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:49.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:49.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:49.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: Reconfiguring mgr.smithi148.gelspy (unknown last config time)... 2024-02-28T16:16:49.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:16:49.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:16:49.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:49.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:49 smithi148 ceph-mon[28767]: Reconfiguring daemon mgr.smithi148.gelspy on smithi148 2024-02-28T16:16:49.646 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:16:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:51 smithi148 ceph-mon[28767]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:51 smithi148 ceph-mon[28767]: Reconfiguring crash.smithi148 (monmap changed)... 2024-02-28T16:16:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:16:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:51 smithi148 ceph-mon[28767]: Reconfiguring daemon crash.smithi148 on smithi148 2024-02-28T16:16:51.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:51 smithi157 ceph-mon[38346]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:51.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:51.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:51.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:51 smithi157 ceph-mon[38346]: Reconfiguring crash.smithi148 (monmap changed)... 2024-02-28T16:16:51.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:16:51.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:16:51.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:51 smithi157 ceph-mon[38346]: Reconfiguring daemon crash.smithi148 on smithi148 2024-02-28T16:16:53.366 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:53 smithi148 ceph-mon[28767]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:53.366 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:53 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:53.366 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:53 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:53.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:53 smithi157 ceph-mon[38346]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:53.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:53 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:53.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:53 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:16:54.105 INFO:teuthology.orchestra.run.smithi148.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T16:16:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T16:16:54.106 INFO:teuthology.orchestra.run.smithi148.stderr: stderr: 10+0 records in 2024-02-28T16:16:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:10+0 records out 2024-02-28T16:16:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0368256 s, 285 MB/s 2024-02-28T16:16:54.106 INFO:teuthology.orchestra.run.smithi148.stderr:--> Zapping successful for: 2024-02-28T16:16:54.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:54 smithi148 ceph-mon[28767]: Reconfiguring alertmanager.smithi148 (dependencies changed)... 2024-02-28T16:16:54.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:54 smithi148 ceph-mon[28767]: Reconfiguring daemon alertmanager.smithi148 on smithi148 2024-02-28T16:16:54.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:54 smithi157 ceph-mon[38346]: Reconfiguring alertmanager.smithi148 (dependencies changed)... 2024-02-28T16:16:54.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:54 smithi157 ceph-mon[38346]: Reconfiguring daemon alertmanager.smithi148 on smithi148 2024-02-28T16:16:55.422 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi148:vg_nvme/lv_4 2024-02-28T16:16:55.986 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:55 smithi148 ceph-mon[28767]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:55.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:55 smithi157 ceph-mon[38346]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:56.658 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:16:56.890 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:56.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:16:57.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:57 smithi148 ceph-mon[28767]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:57.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:57 smithi157 ceph-mon[38346]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:59.805 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 -- 172.21.15.148:0/1423033898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f50100360 msgr2=0x7f2f501007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 --2- 172.21.15.148:0/1423033898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f50100360 0x7f2f501007b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c004940 tx=0x7f2f3c009e30 comp rx=0 tx=0).stop 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 -- 172.21.15.148:0/1423033898 shutdown_connections 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 --2- 172.21.15.148:0/1423033898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f50100360 0x7f2f501007b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 --2- 172.21.15.148:0/1423033898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f500ff150 0x7f2f500ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 -- 172.21.15.148:0/1423033898 >> 172.21.15.148:0/1423033898 conn(0x7f2f500fa920 msgr2=0x7f2f500fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 -- 172.21.15.148:0/1423033898 shutdown_connections 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.814+0000 7f2f56e00700 1 -- 172.21.15.148:0/1423033898 wait complete. 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f56e00700 1 Processor -- start 2024-02-28T16:16:59.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f56e00700 1 -- start start 2024-02-28T16:16:59.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f56e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500ff150 0x7f2f5010fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f56e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f50100360 0x7f2f501100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f56e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50110780 con 0x7f2f500ff150 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f56e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50110fc0 con 0x7f2f50100360 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f4fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500ff150 0x7f2f5010fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f4fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500ff150 0x7f2f5010fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33394/0 (socket says 172.21.15.148:33394) 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.815+0000 7f2f4fe00700 1 -- 172.21.15.148:0/3133419420 learned_addr learned my addr 172.21.15.148:0/3133419420 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f4fe00700 1 -- 172.21.15.148:0/3133419420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f50100360 msgr2=0x7f2f501100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f4fe00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f50100360 0x7f2f501100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f4fe00700 1 -- 172.21.15.148:0/3133419420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c005040 con 0x7f2f500ff150 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f4fe00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500ff150 0x7f2f5010fbb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000b790 tx=0x7f2f40009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f47e00700 1 -- 172.21.15.148:0/3133419420 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f4000f6f0 con 0x7f2f500ff150 2024-02-28T16:16:59.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f47e00700 1 -- 172.21.15.148:0/3133419420 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f4000fd20 con 0x7f2f500ff150 2024-02-28T16:16:59.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f501112a0 con 0x7f2f500ff150 2024-02-28T16:16:59.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f47e00700 1 -- 172.21.15.148:0/3133419420 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f400103a0 con 0x7f2f500ff150 2024-02-28T16:16:59.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.816+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f501117e0 con 0x7f2f500ff150 2024-02-28T16:16:59.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.818+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5004bed0 con 0x7f2f500ff150 2024-02-28T16:16:59.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.818+0000 7f2f47e00700 1 -- 172.21.15.148:0/3133419420 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f2f40011400 con 0x7f2f500ff150 2024-02-28T16:16:59.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.819+0000 7f2f47e00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f2f34069210 0x7f2f3406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:16:59.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.819+0000 7f2f47e00700 1 -- 172.21.15.148:0/3133419420 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f2f40085ee0 con 0x7f2f500ff150 2024-02-28T16:16:59.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.820+0000 7f2f4f400700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f2f34069210 0x7f2f3406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:16:59.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.820+0000 7f2f4f400700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f2f34069210 0x7f2f3406b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c004f90 tx=0x7f2f3c009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:16:59.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:16:59.824+0000 7f2f47e00700 1 -- 172.21.15.148:0/3133419420 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2f40056ce0 con 0x7f2f500ff150 2024-02-28T16:16:59.930 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:16:59 smithi148 ceph-mon[28767]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:16:59.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:16:59 smithi157 ceph-mon[38346]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:00.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:00.047+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f50111d90 con 0x7f2f34069210 2024-02-28T16:17:00.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:00.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:00.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:01.034 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:01.034 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:01.034 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:01.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:01 smithi148 ceph-mon[28767]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:01.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:01 smithi148 ceph-mon[28767]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:01.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:01 smithi157 ceph-mon[38346]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:01.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:01 smithi157 ceph-mon[38346]: from='client.14266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:03.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:03 smithi157 ceph-mon[38346]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:03.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:03 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:03.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:03 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:04.016 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:03 smithi148 ceph-mon[28767]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:04.016 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:03 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:04.016 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:03 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:04 smithi157 ceph-mon[38346]: Reconfiguring grafana.smithi148 (dependencies changed)... 2024-02-28T16:17:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:04 smithi157 ceph-mon[38346]: Reconfiguring daemon grafana.smithi148 on smithi148 2024-02-28T16:17:05.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:04 smithi148 ceph-mon[28767]: Reconfiguring grafana.smithi148 (dependencies changed)... 2024-02-28T16:17:05.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:04 smithi148 ceph-mon[28767]: Reconfiguring daemon grafana.smithi148 on smithi148 2024-02-28T16:17:05.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:05 smithi157 ceph-mon[38346]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:05.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:05 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2712394718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14a7fb44-646e-4c79-82b1-a6911b120a28"}]: dispatch 2024-02-28T16:17:05.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:05 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2712394718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14a7fb44-646e-4c79-82b1-a6911b120a28"}]': finished 2024-02-28T16:17:05.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:05 smithi157 ceph-mon[38346]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T16:17:05.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:05 smithi148 ceph-mon[28767]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:05 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2712394718' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14a7fb44-646e-4c79-82b1-a6911b120a28"}]: dispatch 2024-02-28T16:17:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:05 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2712394718' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14a7fb44-646e-4c79-82b1-a6911b120a28"}]': finished 2024-02-28T16:17:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:05 smithi148 ceph-mon[28767]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T16:17:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:06.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:06 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1202675001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:07.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:06 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1202675001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:07.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:07 smithi157 ceph-mon[38346]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:08.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:07 smithi148 ceph-mon[28767]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:09.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:09 smithi148 ceph-mon[28767]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:09.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:09 smithi157 ceph-mon[38346]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:10.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:10 smithi148 ceph-mon[28767]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:10.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:10 smithi157 ceph-mon[38346]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:11.826 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:11.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:12.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:12 smithi148 ceph-mon[28767]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:12.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:12 smithi157 ceph-mon[38346]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:15.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:15 smithi148 ceph-mon[28767]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:15.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:15 smithi157 ceph-mon[38346]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:17.771 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:17 smithi148 ceph-mon[28767]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:17.771 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:17.771 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:17 smithi157 ceph-mon[38346]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:18.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:18 smithi148 ceph-mon[28767]: Reconfiguring prometheus.smithi148 (dependencies changed)... 2024-02-28T16:17:18.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:18 smithi148 ceph-mon[28767]: Reconfiguring daemon prometheus.smithi148 on smithi148 2024-02-28T16:17:18.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:18 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:17:18.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:18 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:18 smithi157 ceph-mon[38346]: Reconfiguring prometheus.smithi148 (dependencies changed)... 2024-02-28T16:17:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:18 smithi157 ceph-mon[38346]: Reconfiguring daemon prometheus.smithi148 on smithi148 2024-02-28T16:17:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:18 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:17:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:18 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:19.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:19 smithi148 ceph-mon[28767]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:19.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:19 smithi148 ceph-mon[28767]: Deploying daemon osd.0 on smithi148 2024-02-28T16:17:19.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:19 smithi157 ceph-mon[38346]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:19.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:19 smithi157 ceph-mon[38346]: Deploying daemon osd.0 on smithi148 2024-02-28T16:17:21.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:21 smithi157 ceph-mon[38346]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:22.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:21 smithi148 ceph-mon[28767]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:23.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:23 smithi148 ceph-mon[28767]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:23.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:23 smithi157 ceph-mon[38346]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:25.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:25 smithi157 ceph-mon[38346]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:17:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:26.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:25 smithi148 ceph-mon[28767]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:26.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:26.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:26.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:17:26.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:26.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:26 smithi157 ceph-mon[38346]: Reconfiguring crash.smithi157 (monmap changed)... 2024-02-28T16:17:26.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:26 smithi157 ceph-mon[38346]: Reconfiguring daemon crash.smithi157 on smithi157 2024-02-28T16:17:26.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:27.092 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:26 smithi148 ceph-mon[28767]: Reconfiguring crash.smithi157 (monmap changed)... 2024-02-28T16:17:27.092 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:26 smithi148 ceph-mon[28767]: Reconfiguring daemon crash.smithi157 on smithi157 2024-02-28T16:17:27.092 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:27.972 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:27 smithi157 ceph-mon[38346]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:27.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:27.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:27.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:17:27.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:17:27.973 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:27 smithi148 ceph-mon[28767]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:17:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:17:28.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:28.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:28 smithi157 ceph-mon[38346]: Reconfiguring mgr.smithi157.cmcxzj (monmap changed)... 2024-02-28T16:17:28.818 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:28 smithi157 ceph-mon[38346]: Reconfiguring daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:17:28.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:28 smithi148 ceph-mon[28767]: Reconfiguring mgr.smithi157.cmcxzj (monmap changed)... 2024-02-28T16:17:28.937 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:28 smithi148 ceph-mon[28767]: Reconfiguring daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:17:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:29 smithi148 ceph-mon[28767]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:17:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:17:29.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:29 smithi157 ceph-mon[38346]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:17:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:17:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:30.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:30 smithi157 ceph-mon[38346]: Reconfiguring mon.smithi157 (monmap changed)... 2024-02-28T16:17:30.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:30 smithi157 ceph-mon[38346]: Reconfiguring daemon mon.smithi157 on smithi157 2024-02-28T16:17:31.049 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:30 smithi148 ceph-mon[28767]: Reconfiguring mon.smithi157 (monmap changed)... 2024-02-28T16:17:31.049 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:30 smithi148 ceph-mon[28767]: Reconfiguring daemon mon.smithi157 on smithi157 2024-02-28T16:17:31.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi148.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi148.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi148.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi148.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:17:31.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:17:31.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi148.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:17:31.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi148.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:17:31.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:31.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:32.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:32.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:32.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:32.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:17:32.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:17:32.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi148.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:17:32.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi148.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi148.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi148.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi148.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi148.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:32.019 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:32.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:32 smithi157 ceph-mon[38346]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:33.057 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:32 smithi148 ceph-mon[28767]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:34.086 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:33 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:34.086 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:33 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:34.086 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:33 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:34.086 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:33 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:34.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:33 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:34.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:33 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:34.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:33 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:34.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:33 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:35.956 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:35 smithi148 ceph-mon[28767]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:35.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:35 smithi157 ceph-mon[38346]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:37.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:37 smithi148 ceph-mon[28767]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:37.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:37 smithi148 ceph-mon[28767]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:17:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:37 smithi157 ceph-mon[38346]: pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:37 smithi157 ceph-mon[38346]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:17:38.015 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.024+0000 7f2f47e00700 1 -- 172.21.15.148:0/3133419420 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2f50111d90 con 0x7f2f34069210 2024-02-28T16:17:38.015 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 0 on host 'smithi148' 2024-02-28T16:17:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.027+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f2f34069210 msgr2=0x7f2f3406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.027+0000 7f2f56e00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f2f34069210 0x7f2f3406b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c004f90 tx=0x7f2f3c009e30 comp rx=0 tx=0).stop 2024-02-28T16:17:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.027+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500ff150 msgr2=0x7f2f5010fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.027+0000 7f2f56e00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500ff150 0x7f2f5010fbb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000b790 tx=0x7f2f40009220 comp rx=0 tx=0).stop 2024-02-28T16:17:38.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.028+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 shutdown_connections 2024-02-28T16:17:38.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.028+0000 7f2f56e00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2f500ff150 0x7f2f5010fbb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:38.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.028+0000 7f2f56e00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f2f34069210 0x7f2f3406b6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:38.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.028+0000 7f2f56e00700 1 --2- 172.21.15.148:0/3133419420 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f50100360 0x7f2f501100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:38.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.028+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 >> 172.21.15.148:0/3133419420 conn(0x7f2f500fa920 msgr2=0x7f2f50103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:17:38.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.028+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 shutdown_connections 2024-02-28T16:17:38.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:38.028+0000 7f2f56e00700 1 -- 172.21.15.148:0/3133419420 wait complete. 2024-02-28T16:17:38.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:38 smithi157 ceph-mon[38346]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:17:38.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:38 smithi157 ceph-mon[38346]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T16:17:38.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:38 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:38.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:38 smithi157 ceph-mon[38346]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:17:38.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:38 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:38.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:38 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:39.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:38 smithi148 ceph-mon[28767]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:17:39.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:38 smithi148 ceph-mon[28767]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T16:17:39.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:39.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:38 smithi148 ceph-mon[28767]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:17:39.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:39.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:38 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:39.449 DEBUG:teuthology.orchestra.run.smithi148:osd.0> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.0.service 2024-02-28T16:17:39.454 INFO:tasks.cephadm:Deploying osd.1 on smithi148 with /dev/vg_nvme/lv_3... 2024-02-28T16:17:39.454 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T16:17:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:39 smithi157 ceph-mon[38346]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:39 smithi157 ceph-mon[38346]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-02-28T16:17:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:39 smithi157 ceph-mon[38346]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T16:17:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:40.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:39 smithi148 ceph-mon[28767]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:40.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:39 smithi148 ceph-mon[28767]: from='osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-02-28T16:17:40.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:39 smithi148 ceph-mon[28767]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T16:17:40.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:40.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:40.233 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:17:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: purged_snaps scrub starts 2024-02-28T16:17:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: purged_snaps scrub ok 2024-02-28T16:17:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] boot 2024-02-28T16:17:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T16:17:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:40.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:40.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:40.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: purged_snaps scrub starts 2024-02-28T16:17:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: purged_snaps scrub ok 2024-02-28T16:17:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: osd.0 [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] boot 2024-02-28T16:17:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T16:17:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:17:41.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T16:17:41.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:41.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:41.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:41 smithi148 ceph-mon[28767]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T16:17:41.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:41.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:41 smithi157 ceph-mon[38346]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T16:17:41.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:42.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:42 smithi157 ceph-mon[38346]: pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:43.054 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:42 smithi148 ceph-mon[28767]: pgmap v66: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:44.681 INFO:teuthology.orchestra.run.smithi148.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T16:17:44.681 INFO:teuthology.orchestra.run.smithi148.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T16:17:44.681 INFO:teuthology.orchestra.run.smithi148.stderr: stderr: 10+0 records in 2024-02-28T16:17:44.681 INFO:teuthology.orchestra.run.smithi148.stderr:10+0 records out 2024-02-28T16:17:44.681 INFO:teuthology.orchestra.run.smithi148.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0343383 s, 305 MB/s 2024-02-28T16:17:44.681 INFO:teuthology.orchestra.run.smithi148.stderr: stderr: 2024-02-28T16:17:44.681 INFO:teuthology.orchestra.run.smithi148.stderr:--> Zapping successful for: 2024-02-28T16:17:45.628 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi148:vg_nvme/lv_3 2024-02-28T16:17:45.983 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:45 smithi148 ceph-mon[28767]: pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:45.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:45 smithi157 ceph-mon[38346]: pgmap v67: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:46.521 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:17:47.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:47.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi148 2024-02-28T16:17:47.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:47.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi148 to 12867M 2024-02-28T16:17:47.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:47.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:47.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:47.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: pgmap v68: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:47.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: Detected new or changed devices on smithi148 2024-02-28T16:17:47.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:17:47.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi148 to 12867M 2024-02-28T16:17:47.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:47.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:47.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:47.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:17:48.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.646+0000 7f34aee00700 1 -- 172.21.15.148:0/1167080119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 msgr2=0x7f34a81007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.646+0000 7f34aee00700 1 --2- 172.21.15.148:0/1167080119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81007d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3494004940 tx=0x7f3494009e30 comp rx=0 tx=0).stop 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.646+0000 7f34aee00700 1 -- 172.21.15.148:0/1167080119 shutdown_connections 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.646+0000 7f34aee00700 1 --2- 172.21.15.148:0/1167080119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81007d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.646+0000 7f34aee00700 1 --2- 172.21.15.148:0/1167080119 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a80ff170 0x7f34a80ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.646+0000 7f34aee00700 1 -- 172.21.15.148:0/1167080119 >> 172.21.15.148:0/1167080119 conn(0x7f34a80fa920 msgr2=0x7f34a80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.647+0000 7f34aee00700 1 -- 172.21.15.148:0/1167080119 shutdown_connections 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.647+0000 7f34aee00700 1 -- 172.21.15.148:0/1167080119 wait complete. 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.648+0000 7f34aee00700 1 Processor -- start 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.648+0000 7f34aee00700 1 -- start start 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.648+0000 7f34aee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a80ff170 0x7f34a810fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.648+0000 7f34aee00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.648+0000 7f34aee00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8110770 con 0x7f34a8100380 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.648+0000 7f34aee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a8110fb0 con 0x7f34a80ff170 2024-02-28T16:17:48.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.648+0000 7f34a7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34a7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a80ff170 0x7f34a810fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34a7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43786/0 (socket says 172.21.15.148:43786) 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34a7400700 1 -- 172.21.15.148:0/1644839794 learned_addr learned my addr 172.21.15.148:0/1644839794 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34a7400700 1 -- 172.21.15.148:0/1644839794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a80ff170 msgr2=0x7f34a810fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34a7400700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a80ff170 0x7f34a810fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34a7400700 1 -- 172.21.15.148:0/1644839794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494005040 con 0x7f34a8100380 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34a7400700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81100e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f349400b3b0 tx=0x7f3494009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f349fe00700 1 -- 172.21.15.148:0/1644839794 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349400e040 con 0x7f34a8100380 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f349fe00700 1 -- 172.21.15.148:0/1644839794 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f349400bd90 con 0x7f34a8100380 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f349fe00700 1 -- 172.21.15.148:0/1644839794 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349401c630 con 0x7f34a8100380 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.649+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a8111230 con 0x7f34a8100380 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.650+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a8111770 con 0x7f34a8100380 2024-02-28T16:17:48.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.651+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a804bed0 con 0x7f34a8100380 2024-02-28T16:17:48.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.651+0000 7f349fe00700 1 -- 172.21.15.148:0/1644839794 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7f3494013980 con 0x7f34a8100380 2024-02-28T16:17:48.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.653+0000 7f349fe00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f348c069210 0x7f348c06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:17:48.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.653+0000 7f349fe00700 1 -- 172.21.15.148:0/1644839794 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f3494087750 con 0x7f34a8100380 2024-02-28T16:17:48.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.653+0000 7f34a7e00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f348c069210 0x7f348c06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:17:48.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.654+0000 7f34a7e00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f348c069210 0x7f348c06b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f34a81001e0 tx=0x7f34980091a0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:17:48.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.658+0000 7f349fe00700 1 -- 172.21.15.148:0/1644839794 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3494058420 con 0x7f34a8100380 2024-02-28T16:17:48.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:17:48.861+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f34a8111d10 con 0x7f348c069210 2024-02-28T16:17:49.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:49 smithi157 ceph-mon[38346]: pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:49.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:49.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:49.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:49.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:49.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:49.825 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:49 smithi148 ceph-mon[28767]: pgmap v69: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:49.826 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:17:49.826 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:17:49.826 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:49.826 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:49.826 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:50.735 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:50 smithi148 ceph-mon[28767]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:50.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:50 smithi157 ceph-mon[38346]: from='client.14284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:17:51.820 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:51 smithi148 ceph-mon[28767]: pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:51.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:51 smithi157 ceph-mon[38346]: pgmap v70: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:53.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:53 smithi148 ceph-mon[28767]: pgmap v71: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:53.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:53 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/410401460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d4be70-889a-48bb-8354-5c1191cd11d1"}]: dispatch 2024-02-28T16:17:53.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:53 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/410401460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d4be70-889a-48bb-8354-5c1191cd11d1"}]': finished 2024-02-28T16:17:53.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:53 smithi148 ceph-mon[28767]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T16:17:53.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:53 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:17:53.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:53 smithi157 ceph-mon[38346]: pgmap v71: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:53.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:53 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/410401460' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86d4be70-889a-48bb-8354-5c1191cd11d1"}]: dispatch 2024-02-28T16:17:53.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:53 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/410401460' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86d4be70-889a-48bb-8354-5c1191cd11d1"}]': finished 2024-02-28T16:17:53.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:53 smithi157 ceph-mon[38346]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T16:17:53.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:53 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:17:54.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:54 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1857057134' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:54.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:54 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1857057134' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:17:55.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:55 smithi157 ceph-mon[38346]: pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:55.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:55.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:55 smithi148 ceph-mon[28767]: pgmap v73: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:56.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:56.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:56.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:56.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:56.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:56.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:57.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:17:57.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:17:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:17:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:17:57.779 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:57 smithi148 ceph-mon[28767]: pgmap v74: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:57.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:57 smithi157 ceph-mon[38346]: pgmap v74: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:59.810 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:17:59 smithi148 ceph-mon[28767]: pgmap v75: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:17:59.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:17:59 smithi157 ceph-mon[38346]: pgmap v75: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:01.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:01 smithi157 ceph-mon[38346]: pgmap v76: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:02.060 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:01 smithi148 ceph-mon[28767]: pgmap v76: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:02.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:02 smithi157 ceph-mon[38346]: pgmap v77: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:02.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:02 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:18:02.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:02 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:02.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:02 smithi157 ceph-mon[38346]: Deploying daemon osd.1 on smithi148 2024-02-28T16:18:03.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:02 smithi148 ceph-mon[28767]: pgmap v77: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:03.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:02 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:18:03.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:02 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:03.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:02 smithi148 ceph-mon[28767]: Deploying daemon osd.1 on smithi148 2024-02-28T16:18:05.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:05 smithi157 ceph-mon[38346]: pgmap v78: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:05 smithi148 ceph-mon[28767]: pgmap v78: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:07.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:07 smithi148 ceph-mon[28767]: pgmap v79: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:07.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:07 smithi157 ceph-mon[38346]: pgmap v79: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:09.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:09 smithi157 ceph-mon[38346]: pgmap v80: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:10.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:09 smithi148 ceph-mon[28767]: pgmap v80: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:11.943 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:11 smithi157 ceph-mon[38346]: pgmap v81: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:11.943 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:11.943 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:11.943 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:11.943 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:11.965 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:11 smithi148 ceph-mon[28767]: pgmap v81: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:11.965 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:11.965 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:11.965 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:11.965 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:13.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:13 smithi148 ceph-mon[28767]: pgmap v82: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:13.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:13 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:13.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:13 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:13.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:13 smithi157 ceph-mon[38346]: pgmap v82: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:13.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:13 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:13.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:13 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:15.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:15 smithi148 ceph-mon[28767]: pgmap v83: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:15.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:15 smithi148 ceph-mon[28767]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:18:15.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:15 smithi157 ceph-mon[38346]: pgmap v83: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:15.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:15 smithi157 ceph-mon[38346]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:18:16.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.157+0000 7f349fe00700 1 -- 172.21.15.148:0/1644839794 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f34a8111d10 con 0x7f348c069210 2024-02-28T16:18:16.148 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 1 on host 'smithi148' 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f348c069210 msgr2=0x7f348c06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f348c069210 0x7f348c06b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f34a81001e0 tx=0x7f34980091a0 comp rx=0 tx=0).stop 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 msgr2=0x7f34a81100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81100e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f349400b3b0 tx=0x7f3494009e30 comp rx=0 tx=0).stop 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 shutdown_connections 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f348c069210 0x7f348c06b6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f34a80ff170 0x7f34a810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 --2- 172.21.15.148:0/1644839794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f34a8100380 0x7f34a81100e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:16.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.161+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 >> 172.21.15.148:0/1644839794 conn(0x7f34a80fa920 msgr2=0x7f34a81035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:16.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.162+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 shutdown_connections 2024-02-28T16:18:16.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:16.162+0000 7f34aee00700 1 -- 172.21.15.148:0/1644839794 wait complete. 2024-02-28T16:18:16.790 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:18:16.790 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T16:18:16.790 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:16.790 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:18:16.790 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:16.790 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:16.791 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-02-28T16:18:16.791 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T16:18:16.791 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:16 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: from='osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T16:18:16.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:16 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:17.420 DEBUG:teuthology.orchestra.run.smithi148:osd.1> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.1.service 2024-02-28T16:18:17.428 INFO:tasks.cephadm:Deploying osd.2 on smithi148 with /dev/vg_nvme/lv_2... 2024-02-28T16:18:17.429 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T16:18:17.912 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:18:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:17 smithi157 ceph-mon[38346]: pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:18.336 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:17 smithi148 ceph-mon[28767]: pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:18.336 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:18.336 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:18 smithi157 ceph-mon[38346]: purged_snaps scrub starts 2024-02-28T16:18:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:18 smithi157 ceph-mon[38346]: purged_snaps scrub ok 2024-02-28T16:18:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:18 smithi157 ceph-mon[38346]: osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] boot 2024-02-28T16:18:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:18 smithi157 ceph-mon[38346]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T16:18:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:18 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:18.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:18 smithi157 ceph-mon[38346]: pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:19.035 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:18 smithi148 ceph-mon[28767]: purged_snaps scrub starts 2024-02-28T16:18:19.035 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:18 smithi148 ceph-mon[28767]: purged_snaps scrub ok 2024-02-28T16:18:19.035 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:18 smithi148 ceph-mon[28767]: osd.1 [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] boot 2024-02-28T16:18:19.035 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:18 smithi148 ceph-mon[28767]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T16:18:19.035 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:18 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:18:19.035 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:18 smithi148 ceph-mon[28767]: pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-02-28T16:18:20.031 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:19 smithi148 ceph-mon[28767]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T16:18:20.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:19 smithi157 ceph-mon[38346]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T16:18:20.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:20 smithi148 ceph-mon[28767]: pgmap v90: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:21.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:20 smithi157 ceph-mon[38346]: pgmap v90: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:22.071 INFO:teuthology.orchestra.run.smithi148.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T16:18:22.072 INFO:teuthology.orchestra.run.smithi148.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T16:18:22.072 INFO:teuthology.orchestra.run.smithi148.stderr: stderr: 10+0 records in 2024-02-28T16:18:22.072 INFO:teuthology.orchestra.run.smithi148.stderr:10+0 records out 2024-02-28T16:18:22.072 INFO:teuthology.orchestra.run.smithi148.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0582996 s, 180 MB/s 2024-02-28T16:18:22.072 INFO:teuthology.orchestra.run.smithi148.stderr:--> Zapping successful for: 2024-02-28T16:18:22.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:22 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:22.692 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:22 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:22.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:22 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:22.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:22 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:23.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi148:vg_nvme/lv_2 2024-02-28T16:18:23.722 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:23 smithi148 ceph-mon[28767]: pgmap v91: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:23.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:23 smithi157 ceph-mon[38346]: pgmap v91: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:24.263 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:18:25.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:25 smithi157 ceph-mon[38346]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:26.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:25 smithi148 ceph-mon[28767]: pgmap v92: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:26.842 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 -- 172.21.15.148:0/517522313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fe0e0 msgr2=0x7fa7c40fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 --2- 172.21.15.148:0/517522313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fe0e0 0x7fa7c40fe550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac004940 tx=0x7fa7ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 -- 172.21.15.148:0/517522313 shutdown_connections 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 --2- 172.21.15.148:0/517522313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fe0e0 0x7fa7c40fe550 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 --2- 172.21.15.148:0/517522313 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7c40fcef0 0x7fa7c40fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 -- 172.21.15.148:0/517522313 >> 172.21.15.148:0/517522313 conn(0x7fa7c40f8620 msgr2=0x7fa7c40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 -- 172.21.15.148:0/517522313 shutdown_connections 2024-02-28T16:18:27.017 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.026+0000 7fa7c9800700 1 -- 172.21.15.148:0/517522313 wait complete. 2024-02-28T16:18:27.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.027+0000 7fa7c9800700 1 Processor -- start 2024-02-28T16:18:27.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.027+0000 7fa7c9800700 1 -- start start 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.027+0000 7fa7c9800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fcef0 0x7fa7c410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.027+0000 7fa7c9800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7c40fe0e0 0x7fa7c410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.027+0000 7fa7c9800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c410e4b0 con 0x7fa7c40fcef0 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.027+0000 7fa7c9800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c410ed50 con 0x7fa7c40fe0e0 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7c2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fcef0 0x7fa7c410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7c2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fcef0 0x7fa7c410d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46658/0 (socket says 172.21.15.148:46658) 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7c2a00700 1 -- 172.21.15.148:0/1124963390 learned_addr learned my addr 172.21.15.148:0/1124963390 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7ba000700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7c40fe0e0 0x7fa7c410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7c2a00700 1 -- 172.21.15.148:0/1124963390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7c40fe0e0 msgr2=0x7fa7c410deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7c2a00700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7c40fe0e0 0x7fa7c410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7c2a00700 1 -- 172.21.15.148:0/1124963390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac005040 con 0x7fa7c40fcef0 2024-02-28T16:18:27.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7c2a00700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fcef0 0x7fa7c410d970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4002a80 tx=0x7fa7b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:27.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.028+0000 7fa7bb400700 1 -- 172.21.15.148:0/1124963390 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b4007cc0 con 0x7fa7c40fcef0 2024-02-28T16:18:27.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.029+0000 7fa7bb400700 1 -- 172.21.15.148:0/1124963390 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7b400f040 con 0x7fa7c40fcef0 2024-02-28T16:18:27.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.029+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c410f030 con 0x7fa7c40fcef0 2024-02-28T16:18:27.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.029+0000 7fa7bb400700 1 -- 172.21.15.148:0/1124963390 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7b400dad0 con 0x7fa7c40fcef0 2024-02-28T16:18:27.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.029+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c410f570 con 0x7fa7c40fcef0 2024-02-28T16:18:27.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.030+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c404bed0 con 0x7fa7c40fcef0 2024-02-28T16:18:27.021 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.031+0000 7fa7bb400700 1 -- 172.21.15.148:0/1124963390 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) v1 ==== 86567+0+0 (secure 0 0 0) 0x7fa7b400dc30 con 0x7fa7c40fcef0 2024-02-28T16:18:27.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.031+0000 7fa7bb400700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa7a4069210 0x7fa7a406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:18:27.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.032+0000 7fa7bb400700 1 -- 172.21.15.148:0/1124963390 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7fa7b4086170 con 0x7fa7c40fcef0 2024-02-28T16:18:27.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.032+0000 7fa7ba000700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa7a4069210 0x7fa7a406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:18:27.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.032+0000 7fa7ba000700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa7a4069210 0x7fa7a406b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b840 tx=0x7fa7ac009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:18:27.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.036+0000 7fa7bb400700 1 -- 172.21.15.148:0/1124963390 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa7b4056c00 con 0x7fa7c40fcef0 2024-02-28T16:18:27.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:27.260+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7c4102ac0 con 0x7fa7a4069210 2024-02-28T16:18:27.810 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:27 smithi148 ceph-mon[28767]: pgmap v93: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:27.810 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:18:27.811 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:18:27.811 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:27 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:27.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:27 smithi157 ceph-mon[38346]: pgmap v93: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:27.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:18:27.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:18:27.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:27 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='client.14302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:28.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='client.14302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:28.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:29.969 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:29 smithi148 ceph-mon[28767]: pgmap v94: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:29.969 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:29 smithi148 ceph-mon[28767]: Detected new or changed devices on smithi148 2024-02-28T16:18:29.969 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:29 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi148 to 6433M 2024-02-28T16:18:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:29 smithi157 ceph-mon[38346]: pgmap v94: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:29 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi148 2024-02-28T16:18:29.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:29 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi148 to 6433M 2024-02-28T16:18:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:31 smithi148 ceph-mon[28767]: pgmap v95: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:31 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2593482257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9f2df8-5f7c-4a5d-897b-7816093d2f45"}]: dispatch 2024-02-28T16:18:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:31 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2593482257' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb9f2df8-5f7c-4a5d-897b-7816093d2f45"}]': finished 2024-02-28T16:18:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:31 smithi148 ceph-mon[28767]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T16:18:31.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:31 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:31.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:31 smithi157 ceph-mon[38346]: pgmap v95: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:31.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:31 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2593482257' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb9f2df8-5f7c-4a5d-897b-7816093d2f45"}]: dispatch 2024-02-28T16:18:31.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:31 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2593482257' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb9f2df8-5f7c-4a5d-897b-7816093d2f45"}]': finished 2024-02-28T16:18:31.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:31 smithi157 ceph-mon[38346]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T16:18:31.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:31 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:33.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:32 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3828973211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:18:33.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:32 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3828973211' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:18:34.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:33 smithi148 ceph-mon[28767]: pgmap v97: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:34.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:33 smithi157 ceph-mon[38346]: pgmap v97: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:35.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:35 smithi148 ceph-mon[28767]: pgmap v98: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:35.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:35 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:35.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:35 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:35.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:35 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:35.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:35 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:35.951 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:35 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:35.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:35 smithi157 ceph-mon[38346]: pgmap v98: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:35.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:35 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:35.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:35 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:35.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:35 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:35.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:35 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:18:35.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:35 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:37.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:37 smithi148 ceph-mon[28767]: pgmap v99: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:37 smithi157 ceph-mon[38346]: pgmap v99: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:39 smithi157 ceph-mon[38346]: pgmap v100: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:40.017 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:39 smithi148 ceph-mon[28767]: pgmap v100: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:41.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:41 smithi157 ceph-mon[38346]: pgmap v101: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:41.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:41.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:18:41.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:42.036 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:41 smithi148 ceph-mon[28767]: pgmap v101: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:42.036 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:42.037 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:18:42.037 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:18:42.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:42 smithi157 ceph-mon[38346]: Deploying daemon osd.2 on smithi148 2024-02-28T16:18:43.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:42 smithi148 ceph-mon[28767]: Deploying daemon osd.2 on smithi148 2024-02-28T16:18:43.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:43 smithi157 ceph-mon[38346]: pgmap v102: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:43.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:43 smithi148 ceph-mon[28767]: pgmap v102: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:45.867 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:45 smithi148 ceph-mon[28767]: pgmap v103: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:45.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:45 smithi157 ceph-mon[38346]: pgmap v103: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:47.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:47 smithi157 ceph-mon[38346]: pgmap v104: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:48.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:47 smithi148 ceph-mon[28767]: pgmap v104: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:49.084 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:48 smithi148 ceph-mon[28767]: pgmap v105: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:48 smithi157 ceph-mon[38346]: pgmap v105: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:50.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:50.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:50.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:49 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:50.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:18:50.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:50.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:49 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:51.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:50 smithi148 ceph-mon[28767]: pgmap v106: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:51.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:50 smithi157 ceph-mon[38346]: pgmap v106: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:53.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:52 smithi148 ceph-mon[28767]: pgmap v107: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:53.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:52 smithi157 ceph-mon[38346]: pgmap v107: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:54.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:53 smithi157 ceph-mon[38346]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:18:54.313 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:53 smithi148 ceph-mon[28767]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:18:55.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:54 smithi148 ceph-mon[28767]: pgmap v108: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:55.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:54 smithi148 ceph-mon[28767]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:18:55.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:54 smithi148 ceph-mon[28767]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T16:18:55.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:54 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:55.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:54 smithi148 ceph-mon[28767]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:18:55.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:54 smithi157 ceph-mon[38346]: pgmap v108: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:55.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:54 smithi157 ceph-mon[38346]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:18:55.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:54 smithi157 ceph-mon[38346]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T16:18:55.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:54 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:55.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:54 smithi157 ceph-mon[38346]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:18:55.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.599+0000 7fa7bb400700 1 -- 172.21.15.148:0/1124963390 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa7c4102ac0 con 0x7fa7a4069210 2024-02-28T16:18:55.591 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 2 on host 'smithi148' 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa7a4069210 msgr2=0x7fa7a406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa7a4069210 0x7fa7a406b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b840 tx=0x7fa7ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fcef0 msgr2=0x7fa7c410d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fcef0 0x7fa7c410d970 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4002a80 tx=0x7fa7b4004600 comp rx=0 tx=0).stop 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 shutdown_connections 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7c40fcef0 0x7fa7c410d970 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa7a4069210 0x7fa7a406b6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 --2- 172.21.15.148:0/1124963390 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7c40fe0e0 0x7fa7c410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:18:55.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.602+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 >> 172.21.15.148:0/1124963390 conn(0x7fa7c40f8620 msgr2=0x7fa7c41013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:18:55.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.603+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 shutdown_connections 2024-02-28T16:18:55.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:18:55.603+0000 7fa7c9800700 1 -- 172.21.15.148:0/1124963390 wait complete. 2024-02-28T16:18:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:55 smithi148 ceph-mon[28767]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-02-28T16:18:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:55 smithi148 ceph-mon[28767]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T16:18:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:56.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:55 smithi157 ceph-mon[38346]: from='osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-02-28T16:18:56.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:55 smithi157 ceph-mon[38346]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T16:18:56.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:56.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:56.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:56.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:56.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:18:57.052 DEBUG:teuthology.orchestra.run.smithi148:osd.2> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.2.service 2024-02-28T16:18:57.057 INFO:tasks.cephadm:Deploying osd.3 on smithi157 with /dev/vg_nvme/lv_4... 2024-02-28T16:18:57.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T16:18:57.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:56 smithi157 ceph-mon[38346]: purged_snaps scrub starts 2024-02-28T16:18:57.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:56 smithi157 ceph-mon[38346]: purged_snaps scrub ok 2024-02-28T16:18:57.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:56 smithi157 ceph-mon[38346]: pgmap v111: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:57.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:56 smithi157 ceph-mon[38346]: osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] boot 2024-02-28T16:18:57.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:56 smithi157 ceph-mon[38346]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T16:18:57.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:57.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-28T16:18:57.333 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:56 smithi148 ceph-mon[28767]: purged_snaps scrub starts 2024-02-28T16:18:57.333 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:56 smithi148 ceph-mon[28767]: purged_snaps scrub ok 2024-02-28T16:18:57.333 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:56 smithi148 ceph-mon[28767]: pgmap v111: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-02-28T16:18:57.333 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:56 smithi148 ceph-mon[28767]: osd.2 [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] boot 2024-02-28T16:18:57.333 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:56 smithi148 ceph-mon[28767]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T16:18:57.333 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:18:57.334 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-28T16:18:57.542 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:18:58.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:57 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-28T16:18:58.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:57 smithi157 ceph-mon[38346]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T16:18:58.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:57 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T16:18:58.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:57 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-02-28T16:18:58.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:57 smithi148 ceph-mon[28767]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T16:18:58.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:57 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T16:18:59.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:58 smithi157 ceph-mon[38346]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:18:59.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:58 smithi157 ceph-mon[38346]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-28T16:18:59.163 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:58 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T16:18:59.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:58 smithi157 ceph-mon[38346]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T16:18:59.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:58 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:59.164 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:18:58 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:59.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:58 smithi148 ceph-mon[28767]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:18:59.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:58 smithi148 ceph-mon[28767]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-28T16:18:59.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:58 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T16:18:59.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:58 smithi148 ceph-mon[28767]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T16:18:59.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:58 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:59.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:18:58 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:18:59.376 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:58 smithi148 sudo[64404]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:18:59.376 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:58 smithi148 sudo[64404]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:18:59.376 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:58 smithi148 sudo[64404]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:18:59.376 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:58 smithi148 sudo[64404]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:18:59.875 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:59 smithi148 sudo[64485]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:18:59.875 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:59 smithi148 sudo[64485]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:18:59.875 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:59 smithi148 sudo[64485]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:18:59.875 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:18:59 smithi148 sudo[64485]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T16:19:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T16:19:00.386 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-02-28T16:19:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-02-28T16:19:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0331678 s, 316 MB/s 2024-02-28T16:19:00.386 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 2024-02-28T16:19:00.386 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-02-28T16:19:00.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:00 smithi148 ceph-mon[28767]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T16:19:00.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:00.626 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64548]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:19:00.626 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64548]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:00.626 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64548]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:00.626 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64548]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:00.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:00 smithi157 ceph-mon[38346]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T16:19:00.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:01.122 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64566]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:19:01.122 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64566]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:01.122 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64566]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:01.122 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:19:00 smithi148 sudo[64566]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:01.314 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi157:vg_nvme/lv_4 2024-02-28T16:19:01.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:01 smithi148 ceph-mon[28767]: pgmap v117: 1 pgs: 1 active+clean; 449 KiB data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:01.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:01 smithi148 ceph-mon[28767]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-28T16:19:01.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:01 smithi148 ceph-mon[28767]: Cluster is now healthy 2024-02-28T16:19:01.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:01 smithi148 ceph-mon[28767]: mgrmap e19: smithi148.gelspy(active, since 3m), standbys: smithi157.cmcxzj 2024-02-28T16:19:01.376 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64572]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:19:01.376 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64572]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:01.376 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64572]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:01.376 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64572]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:01.391 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:01 smithi157 ceph-mon[38346]: pgmap v117: 1 pgs: 1 active+clean; 449 KiB data, 871 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:01.391 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:01 smithi157 ceph-mon[38346]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-28T16:19:01.391 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:01 smithi157 ceph-mon[38346]: Cluster is now healthy 2024-02-28T16:19:01.391 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:01 smithi157 ceph-mon[38346]: mgrmap e19: smithi148.gelspy(active, since 3m), standbys: smithi157.cmcxzj 2024-02-28T16:19:01.760 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:19:02.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64600]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:19:02.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64600]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:02.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64600]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:02.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:19:01 smithi148 sudo[64600]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:02.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[64619]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:19:02.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[64619]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:02.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[64619]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:02.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[64619]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:03.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[65811]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:19:03.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[65811]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:03.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[65811]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:03.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:02 smithi148 sudo[65811]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:03.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.743+0000 7f860b400700 1 -- 172.21.15.157:0/684317245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 msgr2=0x7f8604102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:03.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.743+0000 7f860b400700 1 --2- 172.21.15.157:0/684317245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 0x7f8604102780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f85f0004940 tx=0x7f85f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:19:03.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.743+0000 7f860b400700 1 -- 172.21.15.157:0/684317245 shutdown_connections 2024-02-28T16:19:03.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.744+0000 7f860b400700 1 --2- 172.21.15.157:0/684317245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 0x7f8604102780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:03.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.744+0000 7f860b400700 1 --2- 172.21.15.157:0/684317245 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 0x7f86040ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:03.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.744+0000 7f860b400700 1 -- 172.21.15.157:0/684317245 >> 172.21.15.157:0/684317245 conn(0x7f86040f7520 msgr2=0x7f86040f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:03.735 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.744+0000 7f860b400700 1 -- 172.21.15.157:0/684317245 shutdown_connections 2024-02-28T16:19:03.736 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.744+0000 7f860b400700 1 -- 172.21.15.157:0/684317245 wait complete. 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.745+0000 7f860b400700 1 Processor -- start 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.745+0000 7f860b400700 1 -- start start 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.745+0000 7f860b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 0x7f860410fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.745+0000 7f860b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 0x7f8604110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.745+0000 7f860b400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604110600 con 0x7f86041003a0 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.745+0000 7f860b400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604110ea0 con 0x7f86040fda80 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.745+0000 7f8608a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 0x7f860410fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:03.737 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.746+0000 7f8608a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 0x7f860410fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:34432/0 (socket says 172.21.15.157:34432) 2024-02-28T16:19:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.746+0000 7f8608a00700 1 -- 172.21.15.157:0/1794843802 learned_addr learned my addr 172.21.15.157:0/1794843802 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:19:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.746+0000 7f8603e00700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 0x7f8604110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.746+0000 7f8608a00700 1 -- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 msgr2=0x7f8604110000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.746+0000 7f8608a00700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 0x7f8604110000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.746+0000 7f8608a00700 1 -- 172.21.15.157:0/1794843802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0005040 con 0x7f86040fda80 2024-02-28T16:19:03.738 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:03.746+0000 7f8608a00700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 0x7f860410fac0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f85f800eb40 tx=0x7f85f800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:03.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:03 smithi157 sudo[41423]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T16:19:03.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:03 smithi157 sudo[41423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:03.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:03 smithi157 sudo[41423]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:03.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:03 smithi157 sudo[41423]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:04.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.128+0000 7f8600c00700 1 -- 172.21.15.157:0/1794843802 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f8007cc0 con 0x7f86040fda80 2024-02-28T16:19:04.120 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.129+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604111120 con 0x7f86040fda80 2024-02-28T16:19:04.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.129+0000 7f8600c00700 1 -- 172.21.15.157:0/1794843802 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85f800f040 con 0x7f86040fda80 2024-02-28T16:19:04.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.129+0000 7f8600c00700 1 -- 172.21.15.157:0/1794843802 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f8009620 con 0x7f86040fda80 2024-02-28T16:19:04.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.129+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8604111660 con 0x7f86040fda80 2024-02-28T16:19:04.121 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.130+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860404bed0 con 0x7f86040fda80 2024-02-28T16:19:04.125 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.134+0000 7f8600c00700 1 -- 172.21.15.157:0/1794843802 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f85f8009780 con 0x7f86040fda80 2024-02-28T16:19:04.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.135+0000 7f8600c00700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f85ec0692a0 0x7f85ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:04.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.135+0000 7f8600c00700 1 -- 172.21.15.157:0/1794843802 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f85f8086440 con 0x7f86040fda80 2024-02-28T16:19:04.126 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.136+0000 7f8603e00700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f85ec0692a0 0x7f85ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:04.128 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.137+0000 7f8603e00700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f85ec0692a0 0x7f85ec06b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b0d0 tx=0x7f85f0009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:04.133 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.143+0000 7f8600c00700 1 -- 172.21.15.157:0/1794843802 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f85f804dbd0 con 0x7f86040fda80 2024-02-28T16:19:04.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:04.345+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f86040fbf80 con 0x7f85ec0692a0 2024-02-28T16:19:04.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:04 smithi148 ceph-mon[28767]: pgmap v118: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:04.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:04 smithi148 ceph-mon[28767]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:19:04.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:04 smithi148 ceph-mon[28767]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:19:04.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:19:04.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:19:04.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:19:04.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:19:04.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 sudo[41446]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T16:19:04.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 sudo[41446]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T16:19:04.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 sudo[41446]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 sudo[41446]: pam_unix(sudo:session): session closed for user root 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 ceph-mon[38346]: pgmap v118: 1 pgs: 1 active+clean; 449 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 ceph-mon[38346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 ceph-mon[38346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:19:04.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.0 KiB/s rd, 114 KiB/s wr, 7 op/s 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi148 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:05.368 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi148 to 4289M 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:05.369 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.0 KiB/s rd, 114 KiB/s wr, 7 op/s 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: Detected new or changed devices on smithi148 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi148 to 4289M 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:05.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:07.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:07 smithi157 ceph-mon[38346]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.4 KiB/s rd, 79 KiB/s wr, 5 op/s 2024-02-28T16:19:07.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:07 smithi148 ceph-mon[28767]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.4 KiB/s rd, 79 KiB/s wr, 5 op/s 2024-02-28T16:19:08.459 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:08 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2450487373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "387e95f1-fb7d-493e-a953-e3a0480bab84"}]: dispatch 2024-02-28T16:19:08.460 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:08 smithi148 ceph-mon[28767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "387e95f1-fb7d-493e-a953-e3a0480bab84"}]: dispatch 2024-02-28T16:19:08.460 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:08 smithi148 ceph-mon[28767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "387e95f1-fb7d-493e-a953-e3a0480bab84"}]': finished 2024-02-28T16:19:08.460 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:08 smithi148 ceph-mon[28767]: osdmap e23: 4 total, 3 up, 4 in 2024-02-28T16:19:08.460 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:08 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:08.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:08 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/2450487373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "387e95f1-fb7d-493e-a953-e3a0480bab84"}]: dispatch 2024-02-28T16:19:08.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:08 smithi157 ceph-mon[38346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "387e95f1-fb7d-493e-a953-e3a0480bab84"}]: dispatch 2024-02-28T16:19:08.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:08 smithi157 ceph-mon[38346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "387e95f1-fb7d-493e-a953-e3a0480bab84"}]': finished 2024-02-28T16:19:08.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:08 smithi157 ceph-mon[38346]: osdmap e23: 4 total, 3 up, 4 in 2024-02-28T16:19:08.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:08 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:09.470 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:09 smithi148 ceph-mon[28767]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.0 KiB/s rd, 61 KiB/s wr, 3 op/s 2024-02-28T16:19:09.470 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:09 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2815065949' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:19:09.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:09 smithi157 ceph-mon[38346]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 1.0 KiB/s rd, 61 KiB/s wr, 3 op/s 2024-02-28T16:19:09.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:09 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/2815065949' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:19:11.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:11 smithi148 ceph-mon[28767]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T16:19:11.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:11.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:11.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:11.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:11.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:11.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:11.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:11 smithi157 ceph-mon[38346]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T16:19:11.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:11.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:11.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:11.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:11.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:11.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:13.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:13 smithi157 ceph-mon[38346]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T16:19:13.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:13 smithi148 ceph-mon[28767]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T16:19:15.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:15 smithi157 ceph-mon[38346]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:19:16.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:15 smithi148 ceph-mon[28767]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:19:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:17 smithi157 ceph-mon[38346]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:19:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:19:17.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:18.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:17 smithi148 ceph-mon[28767]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:19:18.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:19:18.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:18.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:18 smithi157 ceph-mon[38346]: Deploying daemon osd.3 on smithi157 2024-02-28T16:19:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:18 smithi148 ceph-mon[28767]: Deploying daemon osd.3 on smithi157 2024-02-28T16:19:19.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:19 smithi157 ceph-mon[38346]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:19:20.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:19 smithi148 ceph-mon[28767]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T16:19:21.894 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:21 smithi157 ceph-mon[38346]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 67 KiB/s wr, 4 op/s 2024-02-28T16:19:22.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:21 smithi148 ceph-mon[28767]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 67 KiB/s wr, 4 op/s 2024-02-28T16:19:23.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:23 smithi157 ceph-mon[38346]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:24.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:23 smithi148 ceph-mon[28767]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:25.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:25 smithi148 ceph-mon[28767]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:25.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:25.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:25.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:25 smithi157 ceph-mon[38346]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:25.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:25.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:25.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:26.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:26.907 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:27.866 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:27 smithi148 ceph-mon[28767]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:27.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:27 smithi157 ceph-mon[38346]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:28.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:28 smithi148 ceph-mon[28767]: from='osd.3 [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:19:28.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:28 smithi148 ceph-mon[28767]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:19:28.951 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:28 smithi157 ceph-mon[38346]: from='osd.3 [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:19:28.951 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:28 smithi157 ceph-mon[38346]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:19:29.494 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.503+0000 7f8600c00700 1 -- 172.21.15.157:0/1794843802 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f86040fbf80 con 0x7f85ec0692a0 2024-02-28T16:19:29.494 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 3 on host 'smithi157' 2024-02-28T16:19:29.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f85ec0692a0 msgr2=0x7f85ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:29.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f85ec0692a0 0x7f85ec06b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b0d0 tx=0x7f85f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:19:29.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 msgr2=0x7f860410fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:29.497 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 0x7f860410fac0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f85f800eb40 tx=0x7f85f800b040 comp rx=0 tx=0).stop 2024-02-28T16:19:29.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 shutdown_connections 2024-02-28T16:19:29.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f85ec0692a0 0x7f85ec06b750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:29.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f86040fda80 0x7f860410fac0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:29.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 --2- 172.21.15.157:0/1794843802 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86041003a0 0x7f8604110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:29.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.507+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 >> 172.21.15.157:0/1794843802 conn(0x7f86040f7520 msgr2=0x7f86040fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:29.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.508+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 shutdown_connections 2024-02-28T16:19:29.498 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:29.508+0000 7f860b400700 1 -- 172.21.15.157:0/1794843802 wait complete. 2024-02-28T16:19:29.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:29.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:19:29.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T16:19:29.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:29.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='osd.3 [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:19:29.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:19:29.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:29.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:29.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:29.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:29 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:30.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:30.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='osd.3 [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:30.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:29 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:30.296 DEBUG:teuthology.orchestra.run.smithi157:osd.3> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.3.service 2024-02-28T16:19:30.301 INFO:tasks.cephadm:Deploying osd.4 on smithi157 with /dev/vg_nvme/lv_3... 2024-02-28T16:19:30.301 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T16:19:30.891 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:30 smithi157 ceph-mon[38346]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-28T16:19:30.891 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:30 smithi157 ceph-mon[38346]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T16:19:30.891 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:30.891 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:30.892 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:30 smithi157 ceph-mon[38346]: osd.3 [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] boot 2024-02-28T16:19:30.892 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:30 smithi157 ceph-mon[38346]: osdmap e26: 4 total, 4 up, 4 in 2024-02-28T16:19:30.892 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:30 smithi148 ceph-mon[28767]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-28T16:19:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:30 smithi148 ceph-mon[28767]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T16:19:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:30 smithi148 ceph-mon[28767]: osd.3 [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] boot 2024-02-28T16:19:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:30 smithi148 ceph-mon[28767]: osdmap e26: 4 total, 4 up, 4 in 2024-02-28T16:19:31.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:19:31.878 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:31 smithi157 ceph-mon[38346]: purged_snaps scrub starts 2024-02-28T16:19:31.878 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:31 smithi157 ceph-mon[38346]: purged_snaps scrub ok 2024-02-28T16:19:31.878 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:31 smithi157 ceph-mon[38346]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:31.878 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:31 smithi157 ceph-mon[38346]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T16:19:31.981 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:19:32.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:31 smithi148 ceph-mon[28767]: purged_snaps scrub starts 2024-02-28T16:19:32.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:31 smithi148 ceph-mon[28767]: purged_snaps scrub ok 2024-02-28T16:19:32.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:31 smithi148 ceph-mon[28767]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-02-28T16:19:32.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:31 smithi148 ceph-mon[28767]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T16:19:32.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:32 smithi157 ceph-mon[38346]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T16:19:32.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:32 smithi157 ceph-mon[38346]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:33.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:32 smithi148 ceph-mon[28767]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T16:19:33.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:32 smithi148 ceph-mon[28767]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:34.118 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:33 smithi157 ceph-mon[38346]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T16:19:34.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:33 smithi148 ceph-mon[28767]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T16:19:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:34 smithi157 ceph-mon[38346]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T16:19:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:34 smithi157 ceph-mon[38346]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-28T16:19:35.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:34 smithi148 ceph-mon[28767]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T16:19:35.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:34 smithi148 ceph-mon[28767]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-28T16:19:35.565 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T16:19:35.565 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T16:19:35.565 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-02-28T16:19:35.565 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-02-28T16:19:35.565 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0345854 s, 303 MB/s 2024-02-28T16:19:35.565 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi157 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi157 to 15939M 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:36.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:36.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:36.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:36.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:36.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:36 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: Detected new or changed devices on smithi157 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi157 to 15939M 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:36.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:19:36.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:36 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:19:36.643 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi157:vg_nvme/lv_3 2024-02-28T16:19:37.108 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:19:37.612 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:37 smithi157 ceph-mon[38346]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-02-28T16:19:37.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:37 smithi148 ceph-mon[28767]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.286+0000 7effec800700 1 -- 172.21.15.157:0/3501412269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe40fda80 msgr2=0x7effe40ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.286+0000 7effec800700 1 --2- 172.21.15.157:0/3501412269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe40fda80 0x7effe40ffe60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7effd8004940 tx=0x7effd8009e30 comp rx=0 tx=0).stop 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.286+0000 7effec800700 1 -- 172.21.15.157:0/3501412269 shutdown_connections 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.286+0000 7effec800700 1 --2- 172.21.15.157:0/3501412269 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effe41003a0 0x7effe4102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.286+0000 7effec800700 1 --2- 172.21.15.157:0/3501412269 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe40fda80 0x7effe40ffe60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.286+0000 7effec800700 1 -- 172.21.15.157:0/3501412269 >> 172.21.15.157:0/3501412269 conn(0x7effe40f74e0 msgr2=0x7effe40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.287+0000 7effec800700 1 -- 172.21.15.157:0/3501412269 shutdown_connections 2024-02-28T16:19:39.277 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.287+0000 7effec800700 1 -- 172.21.15.157:0/3501412269 wait complete. 2024-02-28T16:19:39.278 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.288+0000 7effec800700 1 Processor -- start 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.288+0000 7effec800700 1 -- start start 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.288+0000 7effec800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effe40fda80 0x7effe410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.288+0000 7effec800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe41003a0 0x7effe41100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.288+0000 7effec800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe41106b0 con 0x7effe40fda80 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.288+0000 7effec800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe4110f50 con 0x7effe41003a0 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe41003a0 0x7effe41100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe41003a0 0x7effe41100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:33786/0 (socket says 172.21.15.157:33786) 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9400700 1 -- 172.21.15.157:0/3362319873 learned_addr learned my addr 172.21.15.157:0/3362319873 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:19:39.279 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9e00700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effe40fda80 0x7effe410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9400700 1 -- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effe40fda80 msgr2=0x7effe410fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9400700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effe40fda80 0x7effe410fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9400700 1 -- 172.21.15.157:0/3362319873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8005040 con 0x7effe41003a0 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.289+0000 7effe9400700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe41003a0 0x7effe41100b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7effd4002a50 tx=0x7effd40046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.290+0000 7effde000700 1 -- 172.21.15.157:0/3362319873 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd4007cc0 con 0x7effe41003a0 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.290+0000 7effde000700 1 -- 172.21.15.157:0/3362319873 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effd400f040 con 0x7effe41003a0 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.290+0000 7effde000700 1 -- 172.21.15.157:0/3362319873 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd400db70 con 0x7effe41003a0 2024-02-28T16:19:39.280 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.290+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe4111230 con 0x7effe41003a0 2024-02-28T16:19:39.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.290+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe4111770 con 0x7effe41003a0 2024-02-28T16:19:39.281 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.291+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe40f9080 con 0x7effe41003a0 2024-02-28T16:19:39.282 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.292+0000 7effde000700 1 -- 172.21.15.157:0/3362319873 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7effd400dd10 con 0x7effe41003a0 2024-02-28T16:19:39.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.293+0000 7effde000700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effcc0692a0 0x7effcc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:19:39.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.293+0000 7effde000700 1 -- 172.21.15.157:0/3362319873 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7effd40861f0 con 0x7effe41003a0 2024-02-28T16:19:39.283 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.294+0000 7effe9e00700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effcc0692a0 0x7effcc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:19:39.284 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.295+0000 7effe9e00700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effcc0692a0 0x7effcc06b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7effd8004f90 tx=0x7effd8009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:19:39.287 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.298+0000 7effde000700 1 -- 172.21.15.157:0/3362319873 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7effd40565b0 con 0x7effe41003a0 2024-02-28T16:19:39.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:19:39.514+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7effe4111af0 con 0x7effcc0692a0 2024-02-28T16:19:39.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:39 smithi157 ceph-mon[38346]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-02-28T16:19:39.826 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:19:39.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:39 smithi148 ceph-mon[28767]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-02-28T16:19:39.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:19:40.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:40 smithi148 ceph-mon[28767]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:40.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:19:40.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:40 smithi157 ceph-mon[38346]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:19:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:19:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:41.868 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:41 smithi157 ceph-mon[38346]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-28T16:19:41.868 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:41 smithi148 ceph-mon[28767]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-28T16:19:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:43 smithi157 ceph-mon[38346]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-02-28T16:19:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:43 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/3807972287' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "687be313-3bfd-461c-97bd-1286d0df4890"}]: dispatch 2024-02-28T16:19:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:43 smithi157 ceph-mon[38346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "687be313-3bfd-461c-97bd-1286d0df4890"}]: dispatch 2024-02-28T16:19:43.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:43 smithi157 ceph-mon[38346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "687be313-3bfd-461c-97bd-1286d0df4890"}]': finished 2024-02-28T16:19:43.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:43 smithi157 ceph-mon[38346]: osdmap e31: 5 total, 4 up, 5 in 2024-02-28T16:19:43.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:19:44.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:43 smithi148 ceph-mon[28767]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-02-28T16:19:44.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:43 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/3807972287' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "687be313-3bfd-461c-97bd-1286d0df4890"}]: dispatch 2024-02-28T16:19:44.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:43 smithi148 ceph-mon[28767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "687be313-3bfd-461c-97bd-1286d0df4890"}]: dispatch 2024-02-28T16:19:44.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:43 smithi148 ceph-mon[28767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "687be313-3bfd-461c-97bd-1286d0df4890"}]': finished 2024-02-28T16:19:44.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:43 smithi148 ceph-mon[28767]: osdmap e31: 5 total, 4 up, 5 in 2024-02-28T16:19:44.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:19:44.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:44 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/3064285264' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:19:45.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:44 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/3064285264' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:19:45.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:45 smithi157 ceph-mon[38346]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:46.027 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:45 smithi148 ceph-mon[28767]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:47.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:46 smithi148 ceph-mon[28767]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:47.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:46 smithi157 ceph-mon[38346]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:48 smithi157 ceph-mon[38346]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:49.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:48 smithi148 ceph-mon[28767]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:51.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:51 smithi157 ceph-mon[38346]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:52.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:51 smithi148 ceph-mon[28767]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:52.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:52 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:19:52.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:52 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:53.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:52 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:19:53.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:52 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:19:53.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:53 smithi157 ceph-mon[38346]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:53.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:53 smithi157 ceph-mon[38346]: Deploying daemon osd.4 on smithi157 2024-02-28T16:19:54.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:53 smithi148 ceph-mon[28767]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:54.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:53 smithi148 ceph-mon[28767]: Deploying daemon osd.4 on smithi157 2024-02-28T16:19:55.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:55 smithi157 ceph-mon[38346]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:56.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:55 smithi148 ceph-mon[28767]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:56.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:57.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:19:57.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:57 smithi157 ceph-mon[38346]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:58.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:57 smithi148 ceph-mon[28767]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:59.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:19:58 smithi148 ceph-mon[28767]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:19:59.220 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:19:58 smithi157 ceph-mon[38346]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:00 smithi157 ceph-mon[38346]: overall HEALTH_OK 2024-02-28T16:20:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:00 smithi148 ceph-mon[28767]: overall HEALTH_OK 2024-02-28T16:20:01.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:01.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:01.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:01.779 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:01 smithi157 ceph-mon[38346]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:02.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:01 smithi148 ceph-mon[28767]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:03.981 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:03 smithi157 ceph-mon[38346]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:04.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:03 smithi148 ceph-mon[28767]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:04 smithi157 ceph-mon[38346]: from='osd.4 [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:20:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:04 smithi157 ceph-mon[38346]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:20:05.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:04 smithi148 ceph-mon[28767]: from='osd.4 [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:20:05.170 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:04 smithi148 ceph-mon[28767]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:20:05.581 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 4 on host 'smithi157' 2024-02-28T16:20:05.581 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.590+0000 7effde000700 1 -- 172.21.15.157:0/3362319873 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7effe4111af0 con 0x7effcc0692a0 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.592+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effcc0692a0 msgr2=0x7effcc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.592+0000 7effec800700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effcc0692a0 0x7effcc06b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7effd8004f90 tx=0x7effd8009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe41003a0 msgr2=0x7effe41100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe41003a0 0x7effe41100b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7effd4002a50 tx=0x7effd40046b0 comp rx=0 tx=0).stop 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 shutdown_connections 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effe40fda80 0x7effe410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7effcc0692a0 0x7effcc06b750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 --2- 172.21.15.157:0/3362319873 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effe41003a0 0x7effe41100b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 >> 172.21.15.157:0/3362319873 conn(0x7effe40f74e0 msgr2=0x7effe4101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:05.584 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 shutdown_connections 2024-02-28T16:20:05.585 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:05.593+0000 7effec800700 1 -- 172.21.15.157:0/3362319873 wait complete. 2024-02-28T16:20:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:20:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T16:20:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: from='osd.4 [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:06.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:05 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:20:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T16:20:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: from='osd.4 [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:06.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:06.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:06.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:05 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:06.381 DEBUG:teuthology.orchestra.run.smithi157:osd.4> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.4.service 2024-02-28T16:20:06.386 INFO:tasks.cephadm:Deploying osd.5 on smithi157 with /dev/vg_nvme/lv_2... 2024-02-28T16:20:06.387 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T16:20:06.863 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:20:07.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:06 smithi157 ceph-mon[38346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-28T16:20:07.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:06 smithi157 ceph-mon[38346]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T16:20:07.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:06 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:07.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:06 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:07.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:06 smithi157 ceph-mon[38346]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:07.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:06 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:07.055 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:06 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:07.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:06 smithi148 ceph-mon[28767]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-28T16:20:07.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:06 smithi148 ceph-mon[28767]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T16:20:07.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:06 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:07.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:06 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:07.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:06 smithi148 ceph-mon[28767]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-02-28T16:20:07.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:06 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:07.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:06 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:08.063 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:07 smithi157 ceph-mon[38346]: purged_snaps scrub starts 2024-02-28T16:20:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:07 smithi157 ceph-mon[38346]: purged_snaps scrub ok 2024-02-28T16:20:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:07 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:07 smithi157 ceph-mon[38346]: osd.4 [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] boot 2024-02-28T16:20:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:07 smithi157 ceph-mon[38346]: osdmap e34: 5 total, 5 up, 5 in 2024-02-28T16:20:08.064 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:07 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:08.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:07 smithi148 ceph-mon[28767]: purged_snaps scrub starts 2024-02-28T16:20:08.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:07 smithi148 ceph-mon[28767]: purged_snaps scrub ok 2024-02-28T16:20:08.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:07 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:08.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:07 smithi148 ceph-mon[28767]: osd.4 [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] boot 2024-02-28T16:20:08.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:07 smithi148 ceph-mon[28767]: osdmap e34: 5 total, 5 up, 5 in 2024-02-28T16:20:08.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:07 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:20:08.948 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:08 smithi157 ceph-mon[38346]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T16:20:08.948 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:08 smithi157 ceph-mon[38346]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:09.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:08 smithi148 ceph-mon[28767]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T16:20:09.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:08 smithi148 ceph-mon[28767]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:10.050 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T16:20:10.050 INFO:teuthology.orchestra.run.smithi157.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T16:20:10.050 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10+0 records in 2024-02-28T16:20:10.050 INFO:teuthology.orchestra.run.smithi157.stderr:10+0 records out 2024-02-28T16:20:10.050 INFO:teuthology.orchestra.run.smithi157.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0366358 s, 286 MB/s 2024-02-28T16:20:10.050 INFO:teuthology.orchestra.run.smithi157.stderr:--> Zapping successful for: 2024-02-28T16:20:11.705 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi157:vg_nvme/lv_2 2024-02-28T16:20:11.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:11 smithi157 ceph-mon[38346]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:11.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:12.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:11 smithi148 ceph-mon[28767]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:12.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:12.162 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:20:13.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:13 smithi157 ceph-mon[38346]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:14.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:13 smithi148 ceph-mon[28767]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:14.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 -- 172.21.15.157:0/274402237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fc1c0 msgr2=0x7fd6f40fc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:14.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/274402237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fc1c0 0x7fd6f40fc630 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0004940 tx=0x7fd6e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:14.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 -- 172.21.15.157:0/274402237 shutdown_connections 2024-02-28T16:20:14.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/274402237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fc1c0 0x7fd6f40fc630 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:14.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/274402237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6f40fb870 0x7fd6f40fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:14.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 -- 172.21.15.157:0/274402237 >> 172.21.15.157:0/274402237 conn(0x7fd6f40f74e0 msgr2=0x7fd6f40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:14.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 -- 172.21.15.157:0/274402237 shutdown_connections 2024-02-28T16:20:14.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.906+0000 7fd6f9c00700 1 -- 172.21.15.157:0/274402237 wait complete. 2024-02-28T16:20:14.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.907+0000 7fd6f9c00700 1 Processor -- start 2024-02-28T16:20:14.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.907+0000 7fd6f9c00700 1 -- start start 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.907+0000 7fd6f9c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fb870 0x7fd6f410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.907+0000 7fd6f9c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6f40fc1c0 0x7fd6f4110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.907+0000 7fd6f9c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f4110710 con 0x7fd6f40fc1c0 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.907+0000 7fd6f9c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f4110f50 con 0x7fd6f40fb870 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.908+0000 7fd6f2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fb870 0x7fd6f410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.908+0000 7fd6f2a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fb870 0x7fd6f410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:36936/0 (socket says 172.21.15.157:36936) 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.908+0000 7fd6f2a00700 1 -- 172.21.15.157:0/4078017698 learned_addr learned my addr 172.21.15.157:0/4078017698 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:20:14.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.908+0000 7fd6f2000700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6f40fc1c0 0x7fd6f4110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.908+0000 7fd6f2a00700 1 -- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6f40fc1c0 msgr2=0x7fd6f4110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.908+0000 7fd6f2a00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6f40fc1c0 0x7fd6f4110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.908+0000 7fd6f2a00700 1 -- 172.21.15.157:0/4078017698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0005040 con 0x7fd6f40fb870 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.909+0000 7fd6f2a00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fb870 0x7fd6f410fb40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b790 tx=0x7fd6e4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.909+0000 7fd6eaa00700 1 -- 172.21.15.157:0/4078017698 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e400f770 con 0x7fd6f40fb870 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.909+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f4111230 con 0x7fd6f40fb870 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.909+0000 7fd6eaa00700 1 -- 172.21.15.157:0/4078017698 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6e400fda0 con 0x7fd6f40fb870 2024-02-28T16:20:14.900 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.909+0000 7fd6eaa00700 1 -- 172.21.15.157:0/4078017698 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e400d310 con 0x7fd6f40fb870 2024-02-28T16:20:14.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.909+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f4111770 con 0x7fd6f40fb870 2024-02-28T16:20:14.901 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.910+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f404bed0 con 0x7fd6f40fb870 2024-02-28T16:20:14.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.911+0000 7fd6eaa00700 1 -- 172.21.15.157:0/4078017698 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd6e4010420 con 0x7fd6f40fb870 2024-02-28T16:20:14.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.912+0000 7fd6eaa00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6d80692b0 0x7fd6d806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:14.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.912+0000 7fd6eaa00700 1 -- 172.21.15.157:0/4078017698 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fd6e4086cc0 con 0x7fd6f40fb870 2024-02-28T16:20:14.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.913+0000 7fd6f2000700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6d80692b0 0x7fd6d806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:14.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.914+0000 7fd6f2000700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6d80692b0 0x7fd6d806b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000b020 tx=0x7fd6e0009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:14.908 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:14.917+0000 7fd6eaa00700 1 -- 172.21.15.157:0/4078017698 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd6e4056f70 con 0x7fd6f40fb870 2024-02-28T16:20:15.124 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:15.133+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6f41055c0 con 0x7fd6d80692b0 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: Detected new or changed devices on smithi157 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi157 to 7969M 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:20:15.627 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi157 2024-02-28T16:20:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi157 to 7969M 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T16:20:15.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:16.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:16 smithi157 ceph-mon[38346]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:16.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:16 smithi148 ceph-mon[28767]: from='client.24167 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi157:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:20:17.404 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:17 smithi157 ceph-mon[38346]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:17.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:17 smithi148 ceph-mon[28767]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:19.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:19 smithi148 ceph-mon[28767]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:19.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:19 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/2847809365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30cd920d-07ad-4006-b70d-801862f0301a"}]: dispatch 2024-02-28T16:20:19.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:19 smithi148 ceph-mon[28767]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30cd920d-07ad-4006-b70d-801862f0301a"}]: dispatch 2024-02-28T16:20:19.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:19 smithi148 ceph-mon[28767]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30cd920d-07ad-4006-b70d-801862f0301a"}]': finished 2024-02-28T16:20:19.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:19 smithi148 ceph-mon[28767]: osdmap e36: 6 total, 5 up, 6 in 2024-02-28T16:20:19.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:19 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:19.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:19 smithi157 ceph-mon[38346]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:19.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:19 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/2847809365' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30cd920d-07ad-4006-b70d-801862f0301a"}]: dispatch 2024-02-28T16:20:19.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:19 smithi157 ceph-mon[38346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "30cd920d-07ad-4006-b70d-801862f0301a"}]: dispatch 2024-02-28T16:20:19.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:19 smithi157 ceph-mon[38346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "30cd920d-07ad-4006-b70d-801862f0301a"}]': finished 2024-02-28T16:20:19.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:19 smithi157 ceph-mon[38346]: osdmap e36: 6 total, 5 up, 6 in 2024-02-28T16:20:19.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:19 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:20.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:20 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/3617141792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:20:21.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:20 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/3617141792' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T16:20:22.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:21 smithi148 ceph-mon[28767]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:22.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:21 smithi157 ceph-mon[38346]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:24.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:23 smithi148 ceph-mon[28767]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:24.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:23 smithi157 ceph-mon[38346]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:25 smithi157 ceph-mon[38346]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:26.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:25 smithi148 ceph-mon[28767]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:28.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:27 smithi148 ceph-mon[28767]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:28.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:27 smithi157 ceph-mon[38346]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:28.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:20:28.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:28 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:29.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:20:29.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:28 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:29.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:29 smithi157 ceph-mon[38346]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:29.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:29 smithi157 ceph-mon[38346]: Deploying daemon osd.5 on smithi157 2024-02-28T16:20:30.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:29 smithi148 ceph-mon[28767]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:30.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:29 smithi148 ceph-mon[28767]: Deploying daemon osd.5 on smithi157 2024-02-28T16:20:30.872 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:30 smithi157 ceph-mon[38346]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:31.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:30 smithi148 ceph-mon[28767]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:33.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:32 smithi157 ceph-mon[38346]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:33.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:32 smithi148 ceph-mon[28767]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:35.887 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:35 smithi157 ceph-mon[38346]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:36.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:35 smithi148 ceph-mon[28767]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:37.157 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:37 smithi157 ceph-mon[38346]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:37.157 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:37 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:37.157 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:37 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:37.157 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:37 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:37.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:37 smithi148 ceph-mon[28767]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:37.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:37 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:37.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:37 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:37.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:37 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:39.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:39 smithi157 ceph-mon[38346]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:39.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:39 smithi148 ceph-mon[28767]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:40.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:40 smithi157 ceph-mon[38346]: from='osd.5 [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:20:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:40 smithi157 ceph-mon[38346]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:20:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:40 smithi148 ceph-mon[28767]: from='osd.5 [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:20:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:40 smithi148 ceph-mon[28767]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:20:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:41.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:41.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.596+0000 7fd6eaa00700 1 -- 172.21.15.157:0/4078017698 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd6f41055c0 con 0x7fd6d80692b0 2024-02-28T16:20:41.587 INFO:teuthology.orchestra.run.smithi157.stdout:Created osd(s) 5 on host 'smithi157' 2024-02-28T16:20:41.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.599+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6d80692b0 msgr2=0x7fd6d806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:41.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.599+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6d80692b0 0x7fd6d806b760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000b020 tx=0x7fd6e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:41.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fb870 msgr2=0x7fd6f410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:41.589 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fb870 0x7fd6f410fb40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b790 tx=0x7fd6e4009250 comp rx=0 tx=0).stop 2024-02-28T16:20:41.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 shutdown_connections 2024-02-28T16:20:41.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6d80692b0 0x7fd6d806b760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:41.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6f40fb870 0x7fd6f410fb40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:41.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 --2- 172.21.15.157:0/4078017698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6f40fc1c0 0x7fd6f4110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:41.590 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 >> 172.21.15.157:0/4078017698 conn(0x7fd6f40f74e0 msgr2=0x7fd6f4103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:41.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 shutdown_connections 2024-02-28T16:20:41.591 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:20:41.600+0000 7fd6f9c00700 1 -- 172.21.15.157:0/4078017698 wait complete. 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='osd.5 [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:42.029 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:20:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T16:20:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='osd.5 [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:20:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:20:42.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:42.503 DEBUG:teuthology.orchestra.run.smithi157:osd.5> sudo journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.5.service 2024-02-28T16:20:42.509 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-28T16:20:42.510 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd stat -f json 2024-02-28T16:20:42.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:42 smithi148 ceph-mon[28767]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-28T16:20:42.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:42 smithi148 ceph-mon[28767]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T16:20:42.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:42 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:42.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:42 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:42.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:42 smithi148 ceph-mon[28767]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:42.966 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:42 smithi157 ceph-mon[38346]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]': finished 2024-02-28T16:20:42.966 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:42 smithi157 ceph-mon[38346]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T16:20:42.966 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:42 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:42.966 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:42 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:42.966 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:42 smithi157 ceph-mon[38346]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-02-28T16:20:43.002 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:20:43.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:43 smithi148 ceph-mon[28767]: purged_snaps scrub starts 2024-02-28T16:20:43.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:43 smithi148 ceph-mon[28767]: purged_snaps scrub ok 2024-02-28T16:20:43.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:43 smithi148 ceph-mon[28767]: osd.5 [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] boot 2024-02-28T16:20:43.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:43 smithi148 ceph-mon[28767]: osdmap e39: 6 total, 6 up, 6 in 2024-02-28T16:20:43.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:43.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:43 smithi157 ceph-mon[38346]: purged_snaps scrub starts 2024-02-28T16:20:43.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:43 smithi157 ceph-mon[38346]: purged_snaps scrub ok 2024-02-28T16:20:43.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:43 smithi157 ceph-mon[38346]: osd.5 [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] boot 2024-02-28T16:20:43.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:43 smithi157 ceph-mon[38346]: osdmap e39: 6 total, 6 up, 6 in 2024-02-28T16:20:43.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:20:45.077 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:44 smithi148 ceph-mon[28767]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T16:20:45.077 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:44 smithi148 ceph-mon[28767]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:45.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:44 smithi157 ceph-mon[38346]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T16:20:45.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:44 smithi157 ceph-mon[38346]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 -- 172.21.15.148:0/579419868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 msgr2=0x7f5fe00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/579419868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe00fe550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc004940 tx=0x7f5fcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 -- 172.21.15.148:0/579419868 shutdown_connections 2024-02-28T16:20:45.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/579419868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe00fe550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/579419868 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fe00fcef0 0x7f5fe00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 -- 172.21.15.148:0/579419868 >> 172.21.15.148:0/579419868 conn(0x7f5fe00f8620 msgr2=0x7f5fe00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 -- 172.21.15.148:0/579419868 shutdown_connections 2024-02-28T16:20:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.502+0000 7f5fe7a00700 1 -- 172.21.15.148:0/579419868 wait complete. 2024-02-28T16:20:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.503+0000 7f5fe7a00700 1 Processor -- start 2024-02-28T16:20:45.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.503+0000 7f5fe7a00700 1 -- start start 2024-02-28T16:20:45.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.503+0000 7f5fe7a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fe00fcef0 0x7f5fe010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.503+0000 7f5fe7a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe01100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.503+0000 7f5fe7a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe01106a0 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.503+0000 7f5fe7a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0110f40 con 0x7f5fe00fcef0 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fdfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe01100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fdfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe01100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53618/0 (socket says 172.21.15.148:53618) 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fdfe00700 1 -- 172.21.15.148:0/528057057 learned_addr learned my addr 172.21.15.148:0/528057057 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fe5000700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fe00fcef0 0x7f5fe010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fdfe00700 1 -- 172.21.15.148:0/528057057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fe00fcef0 msgr2=0x7f5fe010fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fdfe00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fe00fcef0 0x7f5fe010fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fdfe00700 1 -- 172.21.15.148:0/528057057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc005040 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.504+0000 7f5fdfe00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe01100a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b3b0 tx=0x7f5fcc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.505+0000 7f5fdcc00700 1 -- 172.21.15.148:0/528057057 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fcc00e040 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.505+0000 7f5fdcc00700 1 -- 172.21.15.148:0/528057057 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fcc00bd90 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.505+0000 7f5fdcc00700 1 -- 172.21.15.148:0/528057057 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fcc01c630 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.505+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe01111c0 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.505+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe0111700 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.506+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0102210 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.507+0000 7f5fdcc00700 1 -- 172.21.15.148:0/528057057 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5fcc013980 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.508+0000 7f5fdcc00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5fc80692b0 0x7f5fc806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.509+0000 7f5fdcc00700 1 -- 172.21.15.148:0/528057057 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5fcc0882a0 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.509+0000 7f5fe5000700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5fc80692b0 0x7f5fc806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:45.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.509+0000 7f5fe5000700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5fc80692b0 0x7f5fc806b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00fcc30 tx=0x7f5fd4009040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:45.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.513+0000 7f5fdcc00700 1 -- 172.21.15.148:0/528057057 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5fcc058380 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.721+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5fe004bed0 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.722+0000 7f5fdcc00700 1 -- 172.21.15.148:0/528057057 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f5fcc057f10 con 0x7f5fe00fe0e0 2024-02-28T16:20:45.713 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:20:45.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5fc80692b0 msgr2=0x7f5fc806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5fc80692b0 0x7f5fc806b760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00fcc30 tx=0x7f5fd4009040 comp rx=0 tx=0).stop 2024-02-28T16:20:45.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 msgr2=0x7f5fe01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:45.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe01100a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b3b0 tx=0x7f5fcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 shutdown_connections 2024-02-28T16:20:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5fc80692b0 0x7f5fc806b760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fe00fcef0 0x7f5fe010fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 --2- 172.21.15.148:0/528057057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fe00fe0e0 0x7f5fe01100a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.725+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 >> 172.21.15.148:0/528057057 conn(0x7f5fe00f8620 msgr2=0x7f5fe00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.726+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 shutdown_connections 2024-02-28T16:20:45.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:45.726+0000 7f5fe7a00700 1 -- 172.21.15.148:0/528057057 wait complete. 2024-02-28T16:20:46.072 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:45 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/528057057' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T16:20:46.087 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:45 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/528057057' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T16:20:46.543 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1709137242,"num_in_osds":6,"osd_in_since":1709137218,"num_remapped_pgs":0} 2024-02-28T16:20:46.544 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T16:20:47.024 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:20:47.083 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:46 smithi148 ceph-mon[28767]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:47.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:46 smithi157 ceph-mon[38346]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: Detected new or changed devices on smithi157 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi157 to 5313M 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi157 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi157 to 5313M 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:20:48.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:20:49.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.256+0000 7f1a91a00700 1 -- 172.21.15.148:0/1206370450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 msgr2=0x7f1a8c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:49.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.256+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1206370450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c104210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a74004940 tx=0x7f1a74009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:49.248 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:49 smithi148 ceph-mon[28767]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:49.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.257+0000 7f1a91a00700 1 -- 172.21.15.148:0/1206370450 shutdown_connections 2024-02-28T16:20:49.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.257+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1206370450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c104210 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.257+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1206370450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a8c1095f0 0x7f1a8c1099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.257+0000 7f1a91a00700 1 -- 172.21.15.148:0/1206370450 >> 172.21.15.148:0/1206370450 conn(0x7f1a8c072d50 msgr2=0x7f1a8c075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:49.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.257+0000 7f1a91a00700 1 -- 172.21.15.148:0/1206370450 shutdown_connections 2024-02-28T16:20:49.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.257+0000 7f1a91a00700 1 -- 172.21.15.148:0/1206370450 wait complete. 2024-02-28T16:20:49.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.257+0000 7f1a91a00700 1 Processor -- start 2024-02-28T16:20:49.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.258+0000 7f1a91a00700 1 -- start start 2024-02-28T16:20:49.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.258+0000 7f1a91a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c11a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:49.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.258+0000 7f1a91a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a8c1095f0 0x7f1a8c11a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:49.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.258+0000 7f1a91a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c11ac30 con 0x7f1a8c103dc0 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.258+0000 7f1a91a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c113f40 con 0x7f1a8c1095f0 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.258+0000 7f1a8aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c11a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.258+0000 7f1a8aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c11a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53646/0 (socket says 172.21.15.148:53646) 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.259+0000 7f1a8aa00700 1 -- 172.21.15.148:0/1724884423 learned_addr learned my addr 172.21.15.148:0/1724884423 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.259+0000 7f1a82000700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a8c1095f0 0x7f1a8c11a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.259+0000 7f1a8aa00700 1 -- 172.21.15.148:0/1724884423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a8c1095f0 msgr2=0x7f1a8c11a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.259+0000 7f1a8aa00700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a8c1095f0 0x7f1a8c11a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.259+0000 7f1a8aa00700 1 -- 172.21.15.148:0/1724884423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74005040 con 0x7f1a8c103dc0 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.259+0000 7f1a82000700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a8c1095f0 0x7f1a8c11a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.259+0000 7f1a8aa00700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c11a0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c830 tx=0x7f1a7c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:49.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.260+0000 7f1a83400700 1 -- 172.21.15.148:0/1724884423 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c00a760 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.260+0000 7f1a83400700 1 -- 172.21.15.148:0/1724884423 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a7c00ad90 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.260+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c114220 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.260+0000 7f1a83400700 1 -- 172.21.15.148:0/1724884423 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7c0113a0 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.260+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c114760 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.261+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c10b9c0 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.262+0000 7f1a83400700 1 -- 172.21.15.148:0/1724884423 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1a7c012400 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.263+0000 7f1a83400700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1a700692a0 0x7f1a7006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.263+0000 7f1a83400700 1 -- 172.21.15.148:0/1724884423 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1a7c086ec0 con 0x7f1a8c103dc0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.263+0000 7f1a82000700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1a700692a0 0x7f1a7006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:49.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.264+0000 7f1a82000700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1a700692a0 0x7f1a7006b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a74004560 tx=0x7f1a74009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:49.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.267+0000 7f1a83400700 1 -- 172.21.15.148:0/1724884423 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1a7c056fa0 con 0x7f1a8c103dc0 2024-02-28T16:20:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.458+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a8c075870 con 0x7f1a8c103dc0 2024-02-28T16:20:49.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.459+0000 7f1a83400700 1 -- 172.21.15.148:0/1724884423 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11135 (secure 0 0 0) 0x7f1a7c056b30 con 0x7f1a8c103dc0 2024-02-28T16:20:49.450 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:20:49.450 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":40,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","created":"2024-02-28T16:12:27.413792+0000","modified":"2024-02-28T16:20:43.784294+0000","last_up_change":"2024-02-28T16:20:42.771456+0000","last_in_change":"2024-02-28T16:20:18.870154+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:18:56.502433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14a7fb44-646e-4c79-82b1-a6911b120a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6803","nonce":2340247336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6805","nonce":2340247336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6809","nonce":2340247336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6807","nonce":2340247336}]},"public_addr":"172.21.15.148:6803/2340247336","cluster_addr":"172.21.15.148:6805/2340247336","heartbeat_back_addr":"172.21.15.148:6809/2340247336","heartbeat_front_addr":"172.21.15.148:6807/2340247336","state":["exists","up"]},{"osd":1,"uuid":"86d4be70-889a-48bb-8354-5c1191cd11d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6811","nonce":1397774077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6813","nonce":1397774077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6817","nonce":1397774077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6815","nonce":1397774077}]},"public_addr":"172.21.15.148:6811/1397774077","cluster_addr":"172.21.15.148:6813/1397774077","heartbeat_back_addr":"172.21.15.148:6817/1397774077","heartbeat_front_addr":"172.21.15.148:6815/1397774077","state":["exists","up"]},{"osd":2,"uuid":"fb9f2df8-5f7c-4a5d-897b-7816093d2f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6819","nonce":408082720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6821","nonce":408082720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6825","nonce":408082720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6823","nonce":408082720}]},"public_addr":"172.21.15.148:6819/408082720","cluster_addr":"172.21.15.148:6821/408082720","heartbeat_back_addr":"172.21.15.148:6825/408082720","heartbeat_front_addr":"172.21.15.148:6823/408082720","state":["exists","up"]},{"osd":3,"uuid":"387e95f1-fb7d-493e-a953-e3a0480bab84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6801","nonce":3186455722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6803","nonce":3186455722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6807","nonce":3186455722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6805","nonce":3186455722}]},"public_addr":"172.21.15.157:6801/3186455722","cluster_addr":"172.21.15.157:6803/3186455722","heartbeat_back_addr":"172.21.15.157:6807/3186455722","heartbeat_front_addr":"172.21.15.157:6805/3186455722","state":["exists","up"]},{"osd":4,"uuid":"687be313-3bfd-461c-97bd-1286d0df4890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6809","nonce":1983160877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6811","nonce":1983160877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6815","nonce":1983160877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6813","nonce":1983160877}]},"public_addr":"172.21.15.157:6809/1983160877","cluster_addr":"172.21.15.157:6811/1983160877","heartbeat_back_addr":"172.21.15.157:6815/1983160877","heartbeat_front_addr":"172.21.15.157:6813/1983160877","state":["exists","up"]},{"osd":5,"uuid":"30cd920d-07ad-4006-b70d-801862f0301a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6817","nonce":1546679359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6819","nonce":1546679359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6823","nonce":1546679359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6821","nonce":1546679359}]},"public_addr":"172.21.15.157:6817/1546679359","cluster_addr":"172.21.15.157:6819/1546679359","heartbeat_back_addr":"172.21.15.157:6823/1546679359","heartbeat_front_addr":"172.21.15.157:6821/1546679359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:37.865181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:15.892468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:54.360175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:19:29.555324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:05.461264+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:41.106302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3379725707":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6801/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1885326731":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6800/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6801/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/2468996293":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6800/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/2841519785":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3872489504":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/1252596380":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/941593238":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/4201431226":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/3440184585":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6801/3589982370":"2024-02-29T16:13:08.852987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:20:49.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1a700692a0 msgr2=0x7f1a7006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:49.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1a700692a0 0x7f1a7006b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a74004560 tx=0x7f1a74009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:49.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 msgr2=0x7f1a8c11a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c11a0a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00c830 tx=0x7f1a7c004470 comp rx=0 tx=0).stop 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 shutdown_connections 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a8c103dc0 0x7f1a8c11a0a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1a700692a0 0x7f1a7006b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 --2- 172.21.15.148:0/1724884423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1a8c1095f0 0x7f1a8c11a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 >> 172.21.15.148:0/1724884423 conn(0x7f1a8c072d50 msgr2=0x7f1a8c074890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 shutdown_connections 2024-02-28T16:20:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:49.462+0000 7f1a91a00700 1 -- 172.21.15.148:0/1724884423 wait complete. 2024-02-28T16:20:49.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:49 smithi157 ceph-mon[38346]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:50.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:50 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1724884423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:20:50.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:50 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1724884423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:20:50.263 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:18:56.502433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-02-28T16:20:50.263 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-28T16:20:50.738 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:20:52.078 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:51 smithi148 ceph-mon[28767]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:52.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:51 smithi157 ceph-mon[38346]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 -- 172.21.15.148:0/4069727263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb210070be0 msgr2=0x7fb2101092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 --2- 172.21.15.148:0/4069727263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb210070be0 0x7fb2101092c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc004970 tx=0x7fb1fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 -- 172.21.15.148:0/4069727263 shutdown_connections 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 --2- 172.21.15.148:0/4069727263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb210070be0 0x7fb2101092c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 --2- 172.21.15.148:0/4069727263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2100702d0 0x7fb2100706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 -- 172.21.15.148:0/4069727263 >> 172.21.15.148:0/4069727263 conn(0x7fb2100f8ae0 msgr2=0x7fb2100faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 -- 172.21.15.148:0/4069727263 shutdown_connections 2024-02-28T16:20:52.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.947+0000 7fb218600700 1 -- 172.21.15.148:0/4069727263 wait complete. 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.948+0000 7fb218600700 1 Processor -- start 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.948+0000 7fb218600700 1 -- start start 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb218600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2100702d0 0x7fb210115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb218600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb210070be0 0x7fb210116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb218600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2101167a0 con 0x7fb2100702d0 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb218600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21010faf0 con 0x7fb210070be0 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb215c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2100702d0 0x7fb210115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb215c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2100702d0 0x7fb210115c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54300/0 (socket says 172.21.15.148:54300) 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb215c00700 1 -- 172.21.15.148:0/1584331535 learned_addr learned my addr 172.21.15.148:0/1584331535 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb215200700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb210070be0 0x7fb210116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb215c00700 1 -- 172.21.15.148:0/1584331535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb210070be0 msgr2=0x7fb210116150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb215c00700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb210070be0 0x7fb210116150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:52.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.949+0000 7fb215c00700 1 -- 172.21.15.148:0/1584331535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc005040 con 0x7fb2100702d0 2024-02-28T16:20:52.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.950+0000 7fb215c00700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2100702d0 0x7fb210115c10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb204002a50 tx=0x7fb2040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:52.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.950+0000 7fb20d600700 1 -- 172.21.15.148:0/1584331535 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb204007cc0 con 0x7fb2100702d0 2024-02-28T16:20:52.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.950+0000 7fb20d600700 1 -- 172.21.15.148:0/1584331535 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb20400f040 con 0x7fb2100702d0 2024-02-28T16:20:52.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.950+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21010fdd0 con 0x7fb2100702d0 2024-02-28T16:20:52.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.950+0000 7fb20d600700 1 -- 172.21.15.148:0/1584331535 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb204009640 con 0x7fb2100702d0 2024-02-28T16:20:52.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.950+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb210110310 con 0x7fb2100702d0 2024-02-28T16:20:52.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.951+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb210106980 con 0x7fb2100702d0 2024-02-28T16:20:52.942 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.952+0000 7fb20d600700 1 -- 172.21.15.148:0/1584331535 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb2040097a0 con 0x7fb2100702d0 2024-02-28T16:20:52.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.953+0000 7fb20d600700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb1f80692b0 0x7fb1f806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:52.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.953+0000 7fb20d600700 1 -- 172.21.15.148:0/1584331535 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb204086d20 con 0x7fb2100702d0 2024-02-28T16:20:52.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.953+0000 7fb215200700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb1f80692b0 0x7fb1f806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:52.944 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.954+0000 7fb215200700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb1f80692b0 0x7fb1f806b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc000c00 tx=0x7fb1fc009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:52.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:52.958+0000 7fb20d600700 1 -- 172.21.15.148:0/1584331535 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb204053270 con 0x7fb2100702d0 2024-02-28T16:20:53.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.164+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2100fc6e0 con 0x7fb2100702d0 2024-02-28T16:20:53.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.164+0000 7fb20d600700 1 -- 172.21.15.148:0/1584331535 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb204056890 con 0x7fb2100702d0 2024-02-28T16:20:53.155 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-02-28T16:20:53.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb1f80692b0 msgr2=0x7fb1f806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb1f80692b0 0x7fb1f806b760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc000c00 tx=0x7fb1fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2100702d0 msgr2=0x7fb210115c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2100702d0 0x7fb210115c10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb204002a50 tx=0x7fb2040046b0 comp rx=0 tx=0).stop 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 shutdown_connections 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2100702d0 0x7fb210115c10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb1f80692b0 0x7fb1f806b760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 --2- 172.21.15.148:0/1584331535 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb210070be0 0x7fb210116150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 >> 172.21.15.148:0/1584331535 conn(0x7fb2100f8ae0 msgr2=0x7fb210103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 shutdown_connections 2024-02-28T16:20:53.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:53.167+0000 7fb218600700 1 -- 172.21.15.148:0/1584331535 wait complete. 2024-02-28T16:20:53.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:53 smithi148 ceph-mon[28767]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:53.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:53 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1584331535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:20:53.948 INFO:tasks.cephadm:Setting up client nodes... 2024-02-28T16:20:53.948 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T16:20:54.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:53 smithi157 ceph-mon[38346]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:54.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:53 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1584331535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:20:54.421 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:20:55.850 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:55 smithi148 ceph-mon[28767]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:56.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:55 smithi157 ceph-mon[38346]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:56.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 -- 172.21.15.148:0/375232237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 msgr2=0x7f6940100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 --2- 172.21.15.148:0/375232237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f6940100650 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f692c004940 tx=0x7f692c009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 -- 172.21.15.148:0/375232237 shutdown_connections 2024-02-28T16:20:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 --2- 172.21.15.148:0/375232237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f6940100650 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 --2- 172.21.15.148:0/375232237 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69400fb870 0x7f69400fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 -- 172.21.15.148:0/375232237 >> 172.21.15.148:0/375232237 conn(0x7f69400f7500 msgr2=0x7f69400f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 -- 172.21.15.148:0/375232237 shutdown_connections 2024-02-28T16:20:56.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.631+0000 7f6947200700 1 -- 172.21.15.148:0/375232237 wait complete. 2024-02-28T16:20:56.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.632+0000 7f6947200700 1 Processor -- start 2024-02-28T16:20:56.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.632+0000 7f6947200700 1 -- start start 2024-02-28T16:20:56.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.633+0000 7f6947200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69400fb870 0x7f6940113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:56.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.633+0000 7f6947200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f69401144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:56.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.633+0000 7f6947200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6940114ac0 con 0x7f69400fe1d0 2024-02-28T16:20:56.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.633+0000 7f6947200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6940115360 con 0x7f69400fb870 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.633+0000 7f693f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f69401144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.633+0000 7f693f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f69401144c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54328/0 (socket says 172.21.15.148:54328) 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.633+0000 7f693f400700 1 -- 172.21.15.148:0/932091091 learned_addr learned my addr 172.21.15.148:0/932091091 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f693fe00700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69400fb870 0x7f6940113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f693f400700 1 -- 172.21.15.148:0/932091091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69400fb870 msgr2=0x7f6940113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f693f400700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69400fb870 0x7f6940113f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f693f400700 1 -- 172.21.15.148:0/932091091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c005040 con 0x7f69400fe1d0 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f693f400700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f69401144c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f692c0093b0 tx=0x7f692c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f6937e00700 1 -- 172.21.15.148:0/932091091 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f692c00e040 con 0x7f69400fe1d0 2024-02-28T16:20:56.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f6937e00700 1 -- 172.21.15.148:0/932091091 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f692c00bcc0 con 0x7f69400fe1d0 2024-02-28T16:20:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69401155e0 con 0x7f69400fe1d0 2024-02-28T16:20:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.634+0000 7f6937e00700 1 -- 172.21.15.148:0/932091091 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f692c01c630 con 0x7f69400fe1d0 2024-02-28T16:20:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.635+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6940115b20 con 0x7f69400fe1d0 2024-02-28T16:20:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.636+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694010e050 con 0x7f69400fe1d0 2024-02-28T16:20:56.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.637+0000 7f6937e00700 1 -- 172.21.15.148:0/932091091 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f692c0139f0 con 0x7f69400fe1d0 2024-02-28T16:20:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.637+0000 7f6937e00700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f69240692a0 0x7f692406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:20:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.638+0000 7f6937e00700 1 -- 172.21.15.148:0/932091091 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f692c088240 con 0x7f69400fe1d0 2024-02-28T16:20:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.638+0000 7f693fe00700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f69240692a0 0x7f692406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:20:56.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.638+0000 7f693fe00700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f69240692a0 0x7f692406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6930004990 tx=0x7f6930009ee0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:20:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.642+0000 7f6937e00700 1 -- 172.21.15.148:0/932091091 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f692c058320 con 0x7f69400fe1d0 2024-02-28T16:20:56.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.928+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f694010c010 con 0x7f69400fe1d0 2024-02-28T16:20:56.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.936+0000 7f6937e00700 1 -- 172.21.15.148:0/932091091 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f692c057eb0 con 0x7f69400fe1d0 2024-02-28T16:20:56.927 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2024-02-28T16:20:56.927 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQBoXd9l+Bh3NxAANTKofCWefdiTqngrdG5irA== 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f69240692a0 msgr2=0x7f692406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f69240692a0 0x7f692406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6930004990 tx=0x7f6930009ee0 comp rx=0 tx=0).stop 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 msgr2=0x7f69401144c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f69401144c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f692c0093b0 tx=0x7f692c009e30 comp rx=0 tx=0).stop 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 shutdown_connections 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f69240692a0 0x7f692406b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69400fb870 0x7f6940113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 --2- 172.21.15.148:0/932091091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69400fe1d0 0x7f69401144c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.939+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 >> 172.21.15.148:0/932091091 conn(0x7f69400f7500 msgr2=0x7f69400f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:20:56.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.940+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 shutdown_connections 2024-02-28T16:20:56.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:20:56.940+0000 7f6947200700 1 -- 172.21.15.148:0/932091091 wait complete. 2024-02-28T16:20:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:57.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:20:57.712 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:20:57.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-28T16:20:57.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-28T16:20:57.865 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T16:20:58.072 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:57 smithi148 ceph-mon[28767]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:58.073 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:57 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/932091091' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:20:58.073 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:57 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/932091091' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:20:58.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:57 smithi157 ceph-mon[38346]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:58.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:57 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/932091091' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:20:58.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:57 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/932091091' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:20:58.343 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi157/config 2024-02-28T16:20:59.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:20:58 smithi148 ceph-mon[28767]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:20:59.211 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:20:58 smithi157 ceph-mon[38346]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:00.408 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 -- 172.21.15.157:0/664754278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 msgr2=0x7f84880fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 --2- 172.21.15.157:0/664754278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f84880fd320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8478004970 tx=0x7f8478009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 -- 172.21.15.157:0/664754278 shutdown_connections 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 --2- 172.21.15.157:0/664754278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84880fe0e0 0x7f84880fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 --2- 172.21.15.157:0/664754278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f84880fd320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 -- 172.21.15.157:0/664754278 >> 172.21.15.157:0/664754278 conn(0x7f84880f8620 msgr2=0x7f84880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 -- 172.21.15.157:0/664754278 shutdown_connections 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.416+0000 7f848e000700 1 -- 172.21.15.157:0/664754278 wait complete. 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.417+0000 7f848e000700 1 Processor -- start 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.417+0000 7f848e000700 1 -- start start 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.417+0000 7f848e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f848810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.417+0000 7f848e000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84880fe0e0 0x7f84881100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:00.409 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.417+0000 7f848e000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488110760 con 0x7f84880fe0e0 2024-02-28T16:21:00.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.417+0000 7f848e000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488110fa0 con 0x7f84880fcef0 2024-02-28T16:21:00.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8487400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f848810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:00.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8487400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f848810fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:41256/0 (socket says 172.21.15.157:41256) 2024-02-28T16:21:00.410 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8487400700 1 -- 172.21.15.157:0/110332806 learned_addr learned my addr 172.21.15.157:0/110332806 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-02-28T16:21:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8487400700 1 -- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84880fe0e0 msgr2=0x7f84881100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8486a00700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84880fe0e0 0x7f84881100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8487400700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84880fe0e0 0x7f84881100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8487400700 1 -- 172.21.15.157:0/110332806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8478005040 con 0x7f84880fcef0 2024-02-28T16:21:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.418+0000 7f8486a00700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84880fe0e0 0x7f84881100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:21:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.419+0000 7f8487400700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f848810fb90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8478000c00 tx=0x7f8478009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:00.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.419+0000 7f847f400700 1 -- 172.21.15.157:0/110332806 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847800e040 con 0x7f84880fcef0 2024-02-28T16:21:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.419+0000 7f847f400700 1 -- 172.21.15.157:0/110332806 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f847800bce0 con 0x7f84880fcef0 2024-02-28T16:21:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.419+0000 7f847f400700 1 -- 172.21.15.157:0/110332806 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f847801c630 con 0x7f84880fcef0 2024-02-28T16:21:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.419+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8488111220 con 0x7f84880fcef0 2024-02-28T16:21:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.419+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8488111760 con 0x7f84880fcef0 2024-02-28T16:21:00.412 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.420+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8488102210 con 0x7f84880fcef0 2024-02-28T16:21:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.421+0000 7f847f400700 1 -- 172.21.15.157:0/110332806 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f8478013a80 con 0x7f84880fcef0 2024-02-28T16:21:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.422+0000 7f847f400700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f846c0692b0 0x7f846c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.422+0000 7f847f400700 1 -- 172.21.15.157:0/110332806 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f84780881e0 con 0x7f84880fcef0 2024-02-28T16:21:00.413 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.423+0000 7f8486a00700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f846c0692b0 0x7f846c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:00.414 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.424+0000 7f8486a00700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f846c0692b0 0x7f846c06b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8474006fd0 tx=0x7f8474008040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:00.418 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.427+0000 7f847f400700 1 -- 172.21.15.157:0/110332806 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f84780582c0 con 0x7f84880fcef0 2024-02-28T16:21:00.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.713+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f8488105ab0 con 0x7f84880fcef0 2024-02-28T16:21:00.714 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.723+0000 7f847f400700 1 -- 172.21.15.157:0/110332806 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f8478057e50 con 0x7f84880fcef0 2024-02-28T16:21:00.714 INFO:teuthology.orchestra.run.smithi157.stdout:[client.1] 2024-02-28T16:21:00.715 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBsXd9lwcG7KhAA827aVQvEHzhRRhDqydpxgQ== 2024-02-28T16:21:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f846c0692b0 msgr2=0x7f846c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f846c0692b0 0x7f846c06b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8474006fd0 tx=0x7f8474008040 comp rx=0 tx=0).stop 2024-02-28T16:21:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 msgr2=0x7f848810fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:00.717 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f848810fb90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8478000c00 tx=0x7f8478009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:00.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 shutdown_connections 2024-02-28T16:21:00.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f846c0692b0 0x7f846c06b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:00.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f84880fcef0 0x7f848810fb90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:00.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 --2- 172.21.15.157:0/110332806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f84880fe0e0 0x7f84881100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:00.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.726+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 >> 172.21.15.157:0/110332806 conn(0x7f84880f8620 msgr2=0x7f84880ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:00.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.727+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 shutdown_connections 2024-02-28T16:21:00.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:21:00.727+0000 7f848e000700 1 -- 172.21.15.157:0/110332806 wait complete. 2024-02-28T16:21:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:00 smithi157 ceph-mon[38346]: from='client.? 172.21.15.157:0/110332806' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:21:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:00 smithi157 ceph-mon[38346]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:21:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:00 smithi157 ceph-mon[38346]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:21:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:00 smithi148 ceph-mon[28767]: from='client.? 172.21.15.157:0/110332806' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:21:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:00 smithi148 ceph-mon[28767]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T16:21:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:00 smithi148 ceph-mon[28767]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T16:21:01.711 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:21:01.711 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-28T16:21:01.712 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-28T16:21:01.864 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-28T16:21:01.864 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-28T16:21:01.865 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph mgr dump --format=json 2024-02-28T16:21:02.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:01 smithi148 ceph-mon[28767]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:02.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:01 smithi157 ceph-mon[38346]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:02.347 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:03.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:02 smithi148 ceph-mon[28767]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:03.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:02 smithi157 ceph-mon[38346]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:04.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 -- 172.21.15.148:0/2861577626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 msgr2=0x7f97381093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:04.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 --2- 172.21.15.148:0/2861577626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f97381093b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9724004940 tx=0x7f9724009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 -- 172.21.15.148:0/2861577626 shutdown_connections 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 --2- 172.21.15.148:0/2861577626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f97381093b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 --2- 172.21.15.148:0/2861577626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97380fbd40 0x7f97380fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 -- 172.21.15.148:0/2861577626 >> 172.21.15.148:0/2861577626 conn(0x7f97380f7a10 msgr2=0x7f97380f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 -- 172.21.15.148:0/2861577626 shutdown_connections 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.522+0000 7f9740000700 1 -- 172.21.15.148:0/2861577626 wait complete. 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.523+0000 7f9740000700 1 Processor -- start 2024-02-28T16:21:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.523+0000 7f9740000700 1 -- start start 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f9740000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97380fbd40 0x7f9738115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f9740000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f9738116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f9740000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9738116860 con 0x7f97380fc650 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f9740000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973810fb70 con 0x7f97380fbd40 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f973cc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f9738116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f973cc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f9738116210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34108/0 (socket says 172.21.15.148:34108) 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f973cc00700 1 -- 172.21.15.148:0/4264370517 learned_addr learned my addr 172.21.15.148:0/4264370517 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f973d600700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97380fbd40 0x7f9738115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f973cc00700 1 -- 172.21.15.148:0/4264370517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97380fbd40 msgr2=0x7f9738115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f973cc00700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97380fbd40 0x7f9738115cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.524+0000 7f973cc00700 1 -- 172.21.15.148:0/4264370517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9724005040 con 0x7f97380fc650 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.525+0000 7f973cc00700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f9738116210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9724009040 tx=0x7f9724009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:04.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.525+0000 7f9735600700 1 -- 172.21.15.148:0/4264370517 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f972400e040 con 0x7f97380fc650 2024-02-28T16:21:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.525+0000 7f9735600700 1 -- 172.21.15.148:0/4264370517 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f972400bb90 con 0x7f97380fc650 2024-02-28T16:21:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.525+0000 7f9735600700 1 -- 172.21.15.148:0/4264370517 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f972401c3f0 con 0x7f97380fc650 2024-02-28T16:21:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.525+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973810fdf0 con 0x7f97380fc650 2024-02-28T16:21:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.525+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9738110330 con 0x7f97380fc650 2024-02-28T16:21:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.527+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9738106ae0 con 0x7f97380fc650 2024-02-28T16:21:04.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.527+0000 7f9735600700 1 -- 172.21.15.148:0/4264370517 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f972400bd00 con 0x7f97380fc650 2024-02-28T16:21:04.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.529+0000 7f9735600700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f97200692b0 0x7f972006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:04.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.529+0000 7f9735600700 1 -- 172.21.15.148:0/4264370517 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f9724088210 con 0x7f97380fc650 2024-02-28T16:21:04.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.529+0000 7f973d600700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f97200692b0 0x7f972006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:04.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.530+0000 7f973d600700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f97200692b0 0x7f972006b760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f972c007fd0 tx=0x7f972c009040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:04.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.533+0000 7f9735600700 1 -- 172.21.15.148:0/4264370517 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f9724058270 con 0x7f97380fc650 2024-02-28T16:21:04.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.798+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f97380fb610 con 0x7f97380fc650 2024-02-28T16:21:04.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.802+0000 7f9735600700 1 -- 172.21.15.148:0/4264370517 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167180 (secure 0 0 0) 0x7f9724057e00 con 0x7f97380fc650 2024-02-28T16:21:04.796 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:21:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f97200692b0 msgr2=0x7f972006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f97200692b0 0x7f972006b760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f972c007fd0 tx=0x7f972c009040 comp rx=0 tx=0).stop 2024-02-28T16:21:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 msgr2=0x7f9738116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f9738116210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9724009040 tx=0x7f9724009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 shutdown_connections 2024-02-28T16:21:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f97200692b0 0x7f972006b760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:04.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f97380fbd40 0x7f9738115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:04.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 --2- 172.21.15.148:0/4264370517 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f97380fc650 0x7f9738116210 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:04.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 >> 172.21.15.148:0/4264370517 conn(0x7f97380f7a10 msgr2=0x7f97380f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:04.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.806+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 shutdown_connections 2024-02-28T16:21:04.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:04.807+0000 7f9740000700 1 -- 172.21.15.148:0/4264370517 wait complete. 2024-02-28T16:21:05.662 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"active_gid":14216,"active_name":"smithi148.gelspy","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":3437363100},{"type":"v1","addr":"172.21.15.148:6801","nonce":3437363100}]},"active_addr":"172.21.15.148:6801/3437363100","active_change":"2024-02-28T16:15:25.792368+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14252,"name":"smithi157.cmcxzj","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.148:8443/","prometheus":"http://172.21.15.148:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2298274885}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3059678121}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1142907915}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3934075057}]}]} 2024-02-28T16:21:05.667 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-28T16:21:05.667 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-28T16:21:05.667 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T16:21:05.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:05 smithi148 ceph-mon[28767]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:05.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:05 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/4264370517' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T16:21:06.150 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:05 smithi157 ceph-mon[38346]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:06.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:05 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/4264370517' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T16:21:07.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:07 smithi148 ceph-mon[28767]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:08.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:07 smithi157 ceph-mon[38346]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:08.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 -- 172.21.15.148:0/2823552854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd680103dc0 msgr2=0x7fd680104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:08.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 --2- 172.21.15.148:0/2823552854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd680103dc0 0x7fd680104210 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd66c004940 tx=0x7fd66c009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:08.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 -- 172.21.15.148:0/2823552854 shutdown_connections 2024-02-28T16:21:08.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 --2- 172.21.15.148:0/2823552854 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd680103dc0 0x7fd680104210 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:08.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 --2- 172.21.15.148:0/2823552854 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6801095f0 0x7fd6801099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:08.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 -- 172.21.15.148:0/2823552854 >> 172.21.15.148:0/2823552854 conn(0x7fd680072d50 msgr2=0x7fd680075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:08.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 -- 172.21.15.148:0/2823552854 shutdown_connections 2024-02-28T16:21:08.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.460+0000 7fd687c00700 1 -- 172.21.15.148:0/2823552854 wait complete. 2024-02-28T16:21:08.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.461+0000 7fd687c00700 1 Processor -- start 2024-02-28T16:21:08.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.461+0000 7fd687c00700 1 -- start start 2024-02-28T16:21:08.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd687c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd680103dc0 0x7fd68011a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:08.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd687c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6801095f0 0x7fd68011a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd687c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68011abd0 con 0x7fd6801095f0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd687c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680113ee0 con 0x7fd680103dc0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd67fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6801095f0 0x7fd68011a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd67fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6801095f0 0x7fd68011a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34124/0 (socket says 172.21.15.148:34124) 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd67fe00700 1 -- 172.21.15.148:0/913372893 learned_addr learned my addr 172.21.15.148:0/913372893 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd685200700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd680103dc0 0x7fd68011a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd67fe00700 1 -- 172.21.15.148:0/913372893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd680103dc0 msgr2=0x7fd68011a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd67fe00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd680103dc0 0x7fd68011a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.462+0000 7fd67fe00700 1 -- 172.21.15.148:0/913372893 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c005040 con 0x7fd6801095f0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.463+0000 7fd67fe00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6801095f0 0x7fd68011a580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009fd0 tx=0x7fd66c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.463+0000 7fd67cc00700 1 -- 172.21.15.148:0/913372893 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66c00e040 con 0x7fd6801095f0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.463+0000 7fd67cc00700 1 -- 172.21.15.148:0/913372893 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd66c00bbf0 con 0x7fd6801095f0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.463+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd680114160 con 0x7fd6801095f0 2024-02-28T16:21:08.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.463+0000 7fd67cc00700 1 -- 172.21.15.148:0/913372893 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66c01c3f0 con 0x7fd6801095f0 2024-02-28T16:21:08.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.463+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6801146a0 con 0x7fd6801095f0 2024-02-28T16:21:08.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.464+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68010b9c0 con 0x7fd6801095f0 2024-02-28T16:21:08.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.465+0000 7fd67cc00700 1 -- 172.21.15.148:0/913372893 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd66c00bd60 con 0x7fd6801095f0 2024-02-28T16:21:08.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.466+0000 7fd67cc00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6680692b0 0x7fd66806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:08.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.466+0000 7fd67cc00700 1 -- 172.21.15.148:0/913372893 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd66c088230 con 0x7fd6801095f0 2024-02-28T16:21:08.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.466+0000 7fd685200700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6680692b0 0x7fd66806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:08.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.467+0000 7fd685200700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6680692b0 0x7fd66806b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd674004c40 tx=0x7fd674009040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:08.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.471+0000 7fd67cc00700 1 -- 172.21.15.148:0/913372893 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd66c058290 con 0x7fd6801095f0 2024-02-28T16:21:08.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.678+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd68004bed0 con 0x7fd6801095f0 2024-02-28T16:21:08.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.679+0000 7fd67cc00700 1 -- 172.21.15.148:0/913372893 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11135 (secure 0 0 0) 0x7fd66c057e20 con 0x7fd6801095f0 2024-02-28T16:21:08.670 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:21:08.671 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":40,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","created":"2024-02-28T16:12:27.413792+0000","modified":"2024-02-28T16:20:43.784294+0000","last_up_change":"2024-02-28T16:20:42.771456+0000","last_in_change":"2024-02-28T16:20:18.870154+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:18:56.502433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14a7fb44-646e-4c79-82b1-a6911b120a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6803","nonce":2340247336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6805","nonce":2340247336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6809","nonce":2340247336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6807","nonce":2340247336}]},"public_addr":"172.21.15.148:6803/2340247336","cluster_addr":"172.21.15.148:6805/2340247336","heartbeat_back_addr":"172.21.15.148:6809/2340247336","heartbeat_front_addr":"172.21.15.148:6807/2340247336","state":["exists","up"]},{"osd":1,"uuid":"86d4be70-889a-48bb-8354-5c1191cd11d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6811","nonce":1397774077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6813","nonce":1397774077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6817","nonce":1397774077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6815","nonce":1397774077}]},"public_addr":"172.21.15.148:6811/1397774077","cluster_addr":"172.21.15.148:6813/1397774077","heartbeat_back_addr":"172.21.15.148:6817/1397774077","heartbeat_front_addr":"172.21.15.148:6815/1397774077","state":["exists","up"]},{"osd":2,"uuid":"fb9f2df8-5f7c-4a5d-897b-7816093d2f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6819","nonce":408082720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6821","nonce":408082720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6825","nonce":408082720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6823","nonce":408082720}]},"public_addr":"172.21.15.148:6819/408082720","cluster_addr":"172.21.15.148:6821/408082720","heartbeat_back_addr":"172.21.15.148:6825/408082720","heartbeat_front_addr":"172.21.15.148:6823/408082720","state":["exists","up"]},{"osd":3,"uuid":"387e95f1-fb7d-493e-a953-e3a0480bab84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6801","nonce":3186455722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6803","nonce":3186455722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6807","nonce":3186455722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6805","nonce":3186455722}]},"public_addr":"172.21.15.157:6801/3186455722","cluster_addr":"172.21.15.157:6803/3186455722","heartbeat_back_addr":"172.21.15.157:6807/3186455722","heartbeat_front_addr":"172.21.15.157:6805/3186455722","state":["exists","up"]},{"osd":4,"uuid":"687be313-3bfd-461c-97bd-1286d0df4890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6809","nonce":1983160877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6811","nonce":1983160877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6815","nonce":1983160877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6813","nonce":1983160877}]},"public_addr":"172.21.15.157:6809/1983160877","cluster_addr":"172.21.15.157:6811/1983160877","heartbeat_back_addr":"172.21.15.157:6815/1983160877","heartbeat_front_addr":"172.21.15.157:6813/1983160877","state":["exists","up"]},{"osd":5,"uuid":"30cd920d-07ad-4006-b70d-801862f0301a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6817","nonce":1546679359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6819","nonce":1546679359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6823","nonce":1546679359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6821","nonce":1546679359}]},"public_addr":"172.21.15.157:6817/1546679359","cluster_addr":"172.21.15.157:6819/1546679359","heartbeat_back_addr":"172.21.15.157:6823/1546679359","heartbeat_front_addr":"172.21.15.157:6821/1546679359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:37.865181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:15.892468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:54.360175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:19:29.555324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:05.461264+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:41.106302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3379725707":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6801/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1885326731":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6800/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6801/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/2468996293":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6800/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/2841519785":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3872489504":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/1252596380":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/941593238":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/4201431226":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/3440184585":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6801/3589982370":"2024-02-29T16:13:08.852987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:21:08.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6680692b0 msgr2=0x7fd66806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:08.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6680692b0 0x7fd66806b760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd674004c40 tx=0x7fd674009040 comp rx=0 tx=0).stop 2024-02-28T16:21:08.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6801095f0 msgr2=0x7fd68011a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6801095f0 0x7fd68011a580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009fd0 tx=0x7fd66c009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 shutdown_connections 2024-02-28T16:21:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd6680692b0 0x7fd66806b760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd680103dc0 0x7fd68011a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 --2- 172.21.15.148:0/913372893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6801095f0 0x7fd68011a580 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:08.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.682+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 >> 172.21.15.148:0/913372893 conn(0x7fd680072d50 msgr2=0x7fd680074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:08.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.683+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 shutdown_connections 2024-02-28T16:21:08.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:08.683+0000 7fd687c00700 1 -- 172.21.15.148:0/913372893 wait complete. 2024-02-28T16:21:09.030 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:08 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/913372893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:21:09.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:08 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/913372893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:21:09.442 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-28T16:21:09.442 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T16:21:09.914 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:10.065 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:09 smithi148 ceph-mon[28767]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:10.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:09 smithi157 ceph-mon[38346]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:11.109 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:10 smithi148 ceph-mon[28767]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:11.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:10 smithi157 ceph-mon[38346]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:11.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.128+0000 7f1d8d200700 1 -- 172.21.15.148:0/1827083709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109d20 msgr2=0x7f1d881033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.128+0000 7f1d8d200700 1 --2- 172.21.15.148:0/1827083709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109d20 0x7f1d881033a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d74004940 tx=0x7f1d74009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.129+0000 7f1d8d200700 1 -- 172.21.15.148:0/1827083709 shutdown_connections 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.129+0000 7f1d8d200700 1 --2- 172.21.15.148:0/1827083709 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109d20 0x7f1d881033a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.129+0000 7f1d8d200700 1 --2- 172.21.15.148:0/1827083709 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d88109380 0x7f1d88109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.129+0000 7f1d8d200700 1 -- 172.21.15.148:0/1827083709 >> 172.21.15.148:0/1827083709 conn(0x7f1d88072b50 msgr2=0x7f1d88074f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.129+0000 7f1d8d200700 1 -- 172.21.15.148:0/1827083709 shutdown_connections 2024-02-28T16:21:12.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.129+0000 7f1d8d200700 1 -- 172.21.15.148:0/1827083709 wait complete. 2024-02-28T16:21:12.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.129+0000 7f1d8d200700 1 Processor -- start 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d8d200700 1 -- start start 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d8d200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109380 0x7f1d88119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d8d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d88109d20 0x7f1d8811a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d8d200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8811a940 con 0x7f1d88109380 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d8d200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88113c90 con 0x7f1d88109d20 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d87400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109380 0x7f1d88119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d87400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109380 0x7f1d88119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48236/0 (socket says 172.21.15.148:48236) 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.130+0000 7f1d87400700 1 -- 172.21.15.148:0/3434636285 learned_addr learned my addr 172.21.15.148:0/3434636285 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d86a00700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d88109d20 0x7f1d8811a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d87400700 1 -- 172.21.15.148:0/3434636285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d88109d20 msgr2=0x7f1d8811a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d87400700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d88109d20 0x7f1d8811a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:12.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d87400700 1 -- 172.21.15.148:0/3434636285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74005040 con 0x7f1d88109380 2024-02-28T16:21:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d87400700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109380 0x7f1d88119db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c830 tx=0x7f1d78004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d7f400700 1 -- 172.21.15.148:0/3434636285 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7800a760 con 0x7f1d88109380 2024-02-28T16:21:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d7f400700 1 -- 172.21.15.148:0/3434636285 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d7800ad90 con 0x7f1d88109380 2024-02-28T16:21:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d7f400700 1 -- 172.21.15.148:0/3434636285 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d780113a0 con 0x7f1d88109380 2024-02-28T16:21:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88113f70 con 0x7f1d88109380 2024-02-28T16:21:12.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.131+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d88114530 con 0x7f1d88109380 2024-02-28T16:21:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.132+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8805f5c0 con 0x7f1d88109380 2024-02-28T16:21:12.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.133+0000 7f1d7f400700 1 -- 172.21.15.148:0/3434636285 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1d78012400 con 0x7f1d88109380 2024-02-28T16:21:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.134+0000 7f1d7f400700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1d6c0692b0 0x7f1d6c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.134+0000 7f1d7f400700 1 -- 172.21.15.148:0/3434636285 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1d78086ec0 con 0x7f1d88109380 2024-02-28T16:21:12.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.134+0000 7f1d86a00700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1d6c0692b0 0x7f1d6c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:12.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.135+0000 7f1d86a00700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1d6c0692b0 0x7f1d6c06b760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d88115690 tx=0x7f1d74009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:12.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.139+0000 7f1d7f400700 1 -- 172.21.15.148:0/3434636285 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1d78053510 con 0x7f1d88109380 2024-02-28T16:21:12.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:12.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.349+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d88115470 con 0x7f1d88109380 2024-02-28T16:21:12.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.351+0000 7f1d7f400700 1 -- 172.21.15.148:0/3434636285 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11135 (secure 0 0 0) 0x7f1d78056b30 con 0x7f1d88109380 2024-02-28T16:21:12.342 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:21:12.342 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":40,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","created":"2024-02-28T16:12:27.413792+0000","modified":"2024-02-28T16:20:43.784294+0000","last_up_change":"2024-02-28T16:20:42.771456+0000","last_in_change":"2024-02-28T16:20:18.870154+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:18:56.502433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"14a7fb44-646e-4c79-82b1-a6911b120a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6803","nonce":2340247336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6805","nonce":2340247336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6809","nonce":2340247336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6807","nonce":2340247336}]},"public_addr":"172.21.15.148:6803/2340247336","cluster_addr":"172.21.15.148:6805/2340247336","heartbeat_back_addr":"172.21.15.148:6809/2340247336","heartbeat_front_addr":"172.21.15.148:6807/2340247336","state":["exists","up"]},{"osd":1,"uuid":"86d4be70-889a-48bb-8354-5c1191cd11d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6811","nonce":1397774077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6813","nonce":1397774077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6817","nonce":1397774077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6815","nonce":1397774077}]},"public_addr":"172.21.15.148:6811/1397774077","cluster_addr":"172.21.15.148:6813/1397774077","heartbeat_back_addr":"172.21.15.148:6817/1397774077","heartbeat_front_addr":"172.21.15.148:6815/1397774077","state":["exists","up"]},{"osd":2,"uuid":"fb9f2df8-5f7c-4a5d-897b-7816093d2f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6819","nonce":408082720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6821","nonce":408082720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6825","nonce":408082720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6823","nonce":408082720}]},"public_addr":"172.21.15.148:6819/408082720","cluster_addr":"172.21.15.148:6821/408082720","heartbeat_back_addr":"172.21.15.148:6825/408082720","heartbeat_front_addr":"172.21.15.148:6823/408082720","state":["exists","up"]},{"osd":3,"uuid":"387e95f1-fb7d-493e-a953-e3a0480bab84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6801","nonce":3186455722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6803","nonce":3186455722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6807","nonce":3186455722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6805","nonce":3186455722}]},"public_addr":"172.21.15.157:6801/3186455722","cluster_addr":"172.21.15.157:6803/3186455722","heartbeat_back_addr":"172.21.15.157:6807/3186455722","heartbeat_front_addr":"172.21.15.157:6805/3186455722","state":["exists","up"]},{"osd":4,"uuid":"687be313-3bfd-461c-97bd-1286d0df4890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6809","nonce":1983160877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6811","nonce":1983160877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6815","nonce":1983160877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6813","nonce":1983160877}]},"public_addr":"172.21.15.157:6809/1983160877","cluster_addr":"172.21.15.157:6811/1983160877","heartbeat_back_addr":"172.21.15.157:6815/1983160877","heartbeat_front_addr":"172.21.15.157:6813/1983160877","state":["exists","up"]},{"osd":5,"uuid":"30cd920d-07ad-4006-b70d-801862f0301a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6817","nonce":1546679359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6819","nonce":1546679359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6823","nonce":1546679359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6821","nonce":1546679359}]},"public_addr":"172.21.15.157:6817/1546679359","cluster_addr":"172.21.15.157:6819/1546679359","heartbeat_back_addr":"172.21.15.157:6823/1546679359","heartbeat_front_addr":"172.21.15.157:6821/1546679359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:37.865181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:15.892468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:54.360175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:19:29.555324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:05.461264+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:41.106302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:0/3379725707":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6801/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1885326731":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6800/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6801/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/2468996293":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6800/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/2841519785":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3872489504":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/1252596380":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/941593238":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/4201431226":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/3440184585":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6801/3589982370":"2024-02-29T16:13:08.852987+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:21:12.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1d6c0692b0 msgr2=0x7f1d6c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1d6c0692b0 0x7f1d6c06b760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d88115690 tx=0x7f1d74009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109380 msgr2=0x7f1d88119db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109380 0x7f1d88119db0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c830 tx=0x7f1d78004470 comp rx=0 tx=0).stop 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 shutdown_connections 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d88109380 0x7f1d88119db0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1d6c0692b0 0x7f1d6c06b760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 --2- 172.21.15.148:0/3434636285 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d88109d20 0x7f1d8811a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 >> 172.21.15.148:0/3434636285 conn(0x7f1d88072b50 msgr2=0x7f1d88075600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.355+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 shutdown_connections 2024-02-28T16:21:12.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:12.356+0000 7f1d8d200700 1 -- 172.21.15.148:0/3434636285 wait complete. 2024-02-28T16:21:13.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:12 smithi148 ceph-mon[28767]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:13.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:12 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3434636285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:21:13.235 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-28T16:21:13.235 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-28T16:21:13.236 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-28T16:21:13.236 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-28T16:21:13.237 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-28T16:21:13.237 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-28T16:21:13.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:12 smithi157 ceph-mon[38346]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:13.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:12 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3434636285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:21:13.761 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:13.777 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:14.601 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:14.612 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:14.614 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:14.615 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:16.069 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:15 smithi148 ceph-mon[28767]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:16.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:15 smithi157 ceph-mon[38346]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:17.968 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:17 smithi148 ceph-mon[28767]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:18.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:17 smithi157 ceph-mon[38346]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:18.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:18 smithi148 ceph-mon[28767]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:18 smithi157 ceph-mon[38346]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:20.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.748+0000 7ff948600700 1 -- 172.21.15.148:0/3118781442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105b10 msgr2=0x7ff9400ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:20.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.748+0000 7ff948600700 1 --2- 172.21.15.148:0/3118781442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105b10 0x7ff9400ff180 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff92c004940 tx=0x7ff92c009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:20.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.749+0000 7ff948600700 1 -- 172.21.15.148:0/3118781442 shutdown_connections 2024-02-28T16:21:20.739 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.749+0000 7ff948600700 1 --2- 172.21.15.148:0/3118781442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105b10 0x7ff9400ff180 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.749+0000 7ff948600700 1 --2- 172.21.15.148:0/3118781442 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff940105170 0x7ff940105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.749+0000 7ff948600700 1 -- 172.21.15.148:0/3118781442 >> 172.21.15.148:0/3118781442 conn(0x7ff9400face0 msgr2=0x7ff9400fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.749+0000 7ff948600700 1 -- 172.21.15.148:0/3118781442 shutdown_connections 2024-02-28T16:21:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.749+0000 7ff948600700 1 -- 172.21.15.148:0/3118781442 wait complete. 2024-02-28T16:21:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.750+0000 7ff948600700 1 Processor -- start 2024-02-28T16:21:20.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.750+0000 7ff948600700 1 -- start start 2024-02-28T16:21:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.751+0000 7ff948600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105170 0x7ff940115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.751+0000 7ff948600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff940105b10 0x7ff940116220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.751+0000 7ff948600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff940116870 con 0x7ff940105170 2024-02-28T16:21:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.751+0000 7ff948600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94010fb80 con 0x7ff940105b10 2024-02-28T16:21:20.741 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.751+0000 7ff945c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105170 0x7ff940115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.751+0000 7ff945c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105170 0x7ff940115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48254/0 (socket says 172.21.15.148:48254) 2024-02-28T16:21:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.751+0000 7ff945c00700 1 -- 172.21.15.148:0/2825828732 learned_addr learned my addr 172.21.15.148:0/2825828732 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff945200700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff940105b10 0x7ff940116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:20.742 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff945c00700 1 -- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff940105b10 msgr2=0x7ff940116220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff945c00700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff940105b10 0x7ff940116220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff945c00700 1 -- 172.21.15.148:0/2825828732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c005040 con 0x7ff940105170 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff945c00700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105170 0x7ff940115ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c8c0 tx=0x7ff9340044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93400a980 con 0x7ff940105170 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff93400ce60 con 0x7ff940105170 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9340115e0 con 0x7ff940105170 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.752+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94010fe60 con 0x7ff940105170 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.753+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9401103a0 con 0x7ff940105170 2024-02-28T16:21:20.743 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.754+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff940110930 con 0x7ff940105170 2024-02-28T16:21:20.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.755+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff934012400 con 0x7ff940105170 2024-02-28T16:21:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.756+0000 7ff93d600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff9280692b0 0x7ff92806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.756+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff934087b30 con 0x7ff940105170 2024-02-28T16:21:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.756+0000 7ff945200700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff9280692b0 0x7ff92806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.756+0000 7ff93d600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] conn(0x7ff92806ef80 0x7ff928071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.756+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 --> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff928071a40 con 0x7ff92806ef80 2024-02-28T16:21:20.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.756+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff934087e70 con 0x7ff940105170 2024-02-28T16:21:20.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.757+0000 7ff945200700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff9280692b0 0x7ff92806b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00b020 tx=0x7ff92c009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:20.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.757+0000 7ff946600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] conn(0x7ff92806ef80 0x7ff928071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:20.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.758+0000 7ff946600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] conn(0x7ff92806ef80 0x7ff928071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:20.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.760+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== osd.4 v2:172.21.15.157:6808/1983160877 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff928071a40 con 0x7ff92806ef80 2024-02-28T16:21:20.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.777+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 --> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff94005e640 con 0x7ff92806ef80 2024-02-28T16:21:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.778+0000 7ff93d600700 1 -- 172.21.15.148:0/2825828732 <== osd.4 v2:172.21.15.157:6808/1983160877 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff94005e640 con 0x7ff92806ef80 2024-02-28T16:21:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.778+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] conn(0x7ff92806ef80 msgr2=0x7ff928071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:20.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.778+0000 7ff948600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] conn(0x7ff92806ef80 0x7ff928071390 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff9280692b0 msgr2=0x7ff92806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff9280692b0 0x7ff92806b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00b020 tx=0x7ff92c009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105170 msgr2=0x7ff940115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105170 0x7ff940115ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c8c0 tx=0x7ff9340044c0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 shutdown_connections 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff940105170 0x7ff940115ce0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:6808/1983160877,v1:172.21.15.157:6809/1983160877] conn(0x7ff92806ef80 0x7ff928071390 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff9280692b0 0x7ff92806b760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 --2- 172.21.15.148:0/2825828732 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff940105b10 0x7ff940116220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 >> 172.21.15.148:0/2825828732 conn(0x7ff9400face0 msgr2=0x7ff9400fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:20.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 shutdown_connections 2024-02-28T16:21:20.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:20.779+0000 7ff948600700 1 -- 172.21.15.148:0/2825828732 wait complete. 2024-02-28T16:21:21.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:21 smithi148 ceph-mon[28767]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:22.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:21 smithi157 ceph-mon[38346]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:22.639 INFO:teuthology.orchestra.run.smithi148.stdout:146028888082 2024-02-28T16:21:22.640 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-28T16:21:22.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.198+0000 7f3b26000700 1 -- 172.21.15.148:0/2826538511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070c40 msgr2=0x7f3b20109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:22.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.198+0000 7f3b26000700 1 --2- 172.21.15.148:0/2826538511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070c40 0x7f3b20109260 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3b08004970 tx=0x7f3b08009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:22.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.198+0000 7f3b26000700 1 -- 172.21.15.148:0/2826538511 shutdown_connections 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.198+0000 7f3b26000700 1 --2- 172.21.15.148:0/2826538511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070c40 0x7f3b20109260 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.198+0000 7f3b26000700 1 --2- 172.21.15.148:0/2826538511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b20070330 0x7f3b20070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.198+0000 7f3b26000700 1 -- 172.21.15.148:0/2826538511 >> 172.21.15.148:0/2826538511 conn(0x7f3b200f8ae0 msgr2=0x7f3b200faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.199+0000 7f3b26000700 1 -- 172.21.15.148:0/2826538511 shutdown_connections 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.199+0000 7f3b26000700 1 -- 172.21.15.148:0/2826538511 wait complete. 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.199+0000 7f3b26000700 1 Processor -- start 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.199+0000 7f3b26000700 1 -- start start 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b26000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070330 0x7f3b20115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b26000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b20070c40 0x7f3b20116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b26000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20116790 con 0x7f3b20070330 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b26000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2010fae0 con 0x7f3b20070c40 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b1f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070330 0x7f3b20115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b1f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070330 0x7f3b20115c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42700/0 (socket says 172.21.15.148:42700) 2024-02-28T16:21:22.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b1f400700 1 -- 172.21.15.148:0/902588425 learned_addr learned my addr 172.21.15.148:0/902588425 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.200+0000 7f3b16a00700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b20070c40 0x7f3b20116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b1f400700 1 -- 172.21.15.148:0/902588425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b20070c40 msgr2=0x7f3b20116140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b1f400700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b20070c40 0x7f3b20116140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b1f400700 1 -- 172.21.15.148:0/902588425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b08005040 con 0x7f3b20070330 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b1f400700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070330 0x7f3b20115c00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b10001d80 tx=0x7f3b10009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b10007d10 con 0x7f3b20070330 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b10007e70 con 0x7f3b20070330 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2010fdc0 con 0x7f3b20070330 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b10014640 con 0x7f3b20070330 2024-02-28T16:21:22.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.201+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b20110300 con 0x7f3b20070330 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.202+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b20110800 con 0x7f3b20070330 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.203+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3b1000e960 con 0x7f3b20070330 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.204+0000 7f3b17e00700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3b040692b0 0x7f3b0406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.204+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3b10086cd0 con 0x7f3b20070330 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.204+0000 7f3b16a00700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3b040692b0 0x7f3b0406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.204+0000 7f3b17e00700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] conn(0x7f3b0406ef80 0x7f3b04071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.204+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 --> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b04071a40 con 0x7f3b0406ef80 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.204+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b10089220 con 0x7f3b20070330 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.205+0000 7f3b1fe00700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] conn(0x7f3b0406ef80 0x7f3b04071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.205+0000 7f3b16a00700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3b040692b0 0x7f3b0406b760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b08000c00 tx=0x7f3b08009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.205+0000 7f3b1fe00700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] conn(0x7f3b0406ef80 0x7f3b04071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:22.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.206+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== osd.1 v2:172.21.15.148:6810/1397774077 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3b04071a40 con 0x7f3b0406ef80 2024-02-28T16:21:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.223+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 --> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b2005e690 con 0x7f3b0406ef80 2024-02-28T16:21:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.223+0000 7f3b17e00700 1 -- 172.21.15.148:0/902588425 <== osd.1 v2:172.21.15.148:6810/1397774077 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b2005e690 con 0x7f3b0406ef80 2024-02-28T16:21:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] conn(0x7f3b0406ef80 msgr2=0x7f3b04071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] conn(0x7f3b0406ef80 0x7f3b04071390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3b040692b0 msgr2=0x7f3b0406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3b040692b0 0x7f3b0406b760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3b08000c00 tx=0x7f3b08009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070330 msgr2=0x7f3b20115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070330 0x7f3b20115c00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b10001d80 tx=0x7f3b10009ec0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 shutdown_connections 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6810/1397774077,v1:172.21.15.148:6811/1397774077] conn(0x7f3b0406ef80 0x7f3b04071390 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b20070330 0x7f3b20115c00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3b040692b0 0x7f3b0406b760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 --2- 172.21.15.148:0/902588425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b20070c40 0x7f3b20116140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 >> 172.21.15.148:0/902588425 conn(0x7f3b200f8ae0 msgr2=0x7f3b20103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 shutdown_connections 2024-02-28T16:21:22.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:22.224+0000 7f3b26000700 1 -- 172.21.15.148:0/902588425 wait complete. 2024-02-28T16:21:23.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:22 smithi148 ceph-mon[28767]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:23.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.110+0000 7fe07ba00700 1 -- 172.21.15.148:0/3761362675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 msgr2=0x7fe0740fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:23.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.110+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3761362675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 0x7fe0740fcf60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe060004940 tx=0x7fe060009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:23.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.110+0000 7fe07ba00700 1 -- 172.21.15.148:0/3761362675 shutdown_connections 2024-02-28T16:21:23.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.110+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3761362675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 0x7fe0740fcf60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.110+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3761362675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 0x7fe074103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.110+0000 7fe07ba00700 1 -- 172.21.15.148:0/3761362675 >> 172.21.15.148:0/3761362675 conn(0x7fe0740f8ae0 msgr2=0x7fe0740faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:23.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.111+0000 7fe07ba00700 1 -- 172.21.15.148:0/3761362675 shutdown_connections 2024-02-28T16:21:23.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.111+0000 7fe07ba00700 1 -- 172.21.15.148:0/3761362675 wait complete. 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.111+0000 7fe07ba00700 1 Processor -- start 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.112+0000 7fe07ba00700 1 -- start start 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.112+0000 7fe07ba00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 0x7fe0741107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.112+0000 7fe07ba00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 0x7fe074110d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.112+0000 7fe07ba00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe074111390 con 0x7fe0741038f0 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.112+0000 7fe07ba00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0741165f0 con 0x7fe074102f50 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.112+0000 7fe073e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 0x7fe074110d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.113+0000 7fe079000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 0x7fe0741107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.113+0000 7fe079000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 0x7fe0741107c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:59034/0 (socket says 172.21.15.148:59034) 2024-02-28T16:21:23.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.113+0000 7fe079000700 1 -- 172.21.15.148:0/3059168644 learned_addr learned my addr 172.21.15.148:0/3059168644 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:23.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe073e00700 1 -- 172.21.15.148:0/3059168644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 msgr2=0x7fe0741107c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:23.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe073e00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 0x7fe0741107c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe073e00700 1 -- 172.21.15.148:0/3059168644 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060005040 con 0x7fe0741038f0 2024-02-28T16:21:23.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe079000700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 0x7fe0741107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:21:23.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe073e00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 0x7fe074110d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0740672c0 tx=0x7fe060009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:23.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06000e040 con 0x7fe0741038f0 2024-02-28T16:21:23.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe074116840 con 0x7fe0741038f0 2024-02-28T16:21:23.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe060004290 con 0x7fe0741038f0 2024-02-28T16:21:23.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.114+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06001c3f0 con 0x7fe0741038f0 2024-02-28T16:21:23.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.115+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe074116d80 con 0x7fe0741038f0 2024-02-28T16:21:23.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.116+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0741171e0 con 0x7fe0741038f0 2024-02-28T16:21:23.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.117+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fe060013420 con 0x7fe0741038f0 2024-02-28T16:21:23.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.118+0000 7fe070c00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe05c0692b0 0x7fe05c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:23.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.118+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe060088100 con 0x7fe0741038f0 2024-02-28T16:21:23.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.118+0000 7fe079000700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe05c0692b0 0x7fe05c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:23.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.118+0000 7fe070c00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] conn(0x7fe05c06ef80 0x7fe05c071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:23.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.118+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 --> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe05c071a40 con 0x7fe05c06ef80 2024-02-28T16:21:23.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.119+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe06008a650 con 0x7fe0741038f0 2024-02-28T16:21:23.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.119+0000 7fe079a00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] conn(0x7fe05c06ef80 0x7fe05c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:23.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.119+0000 7fe079000700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe05c0692b0 0x7fe05c06b760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0680041d0 tx=0x7fe06800b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:23.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.120+0000 7fe079a00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] conn(0x7fe05c06ef80 0x7fe05c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:23.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.121+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== osd.0 v2:172.21.15.148:6802/2340247336 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe05c071a40 con 0x7fe05c06ef80 2024-02-28T16:21:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.139+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 --> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe0740fadb0 con 0x7fe05c06ef80 2024-02-28T16:21:23.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.139+0000 7fe070c00700 1 -- 172.21.15.148:0/3059168644 <== osd.0 v2:172.21.15.148:6802/2340247336 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe0740fadb0 con 0x7fe05c06ef80 2024-02-28T16:21:23.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] conn(0x7fe05c06ef80 msgr2=0x7fe05c071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] conn(0x7fe05c06ef80 0x7fe05c071390 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe05c0692b0 msgr2=0x7fe05c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe05c0692b0 0x7fe05c06b760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0680041d0 tx=0x7fe06800b040 comp rx=0 tx=0).stop 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 msgr2=0x7fe074110d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 0x7fe074110d40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe0740672c0 tx=0x7fe060009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 shutdown_connections 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6802/2340247336,v1:172.21.15.148:6803/2340247336] conn(0x7fe05c06ef80 0x7fe05c071390 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fe05c0692b0 0x7fe05c06b760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe074102f50 0x7fe0741107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 --2- 172.21.15.148:0/3059168644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0741038f0 0x7fe074110d40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 >> 172.21.15.148:0/3059168644 conn(0x7fe0740f8ae0 msgr2=0x7fe0740fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:23.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.140+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 shutdown_connections 2024-02-28T16:21:23.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:23.141+0000 7fe07ba00700 1 -- 172.21.15.148:0/3059168644 wait complete. 2024-02-28T16:21:23.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:22 smithi157 ceph-mon[38346]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:24.370 INFO:teuthology.orchestra.run.smithi148.stdout:38654705711 2024-02-28T16:21:24.371 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-28T16:21:25.831 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:25 smithi148 ceph-mon[28767]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:25.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.840+0000 7f4bc3200700 1 -- 172.21.15.148:0/1934192819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc102f50 msgr2=0x7f4bbc103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.840+0000 7f4bc3200700 1 --2- 172.21.15.148:0/1934192819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc102f50 0x7f4bbc103320 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4bac004940 tx=0x7f4bac009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.840+0000 7f4bc3200700 1 -- 172.21.15.148:0/1934192819 shutdown_connections 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.840+0000 7f4bc3200700 1 --2- 172.21.15.148:0/1934192819 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bbc1038f0 0x7f4bbc0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.840+0000 7f4bc3200700 1 --2- 172.21.15.148:0/1934192819 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc102f50 0x7f4bbc103320 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.840+0000 7f4bc3200700 1 -- 172.21.15.148:0/1934192819 >> 172.21.15.148:0/1934192819 conn(0x7f4bbc0f8ae0 msgr2=0x7f4bbc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.841+0000 7f4bc3200700 1 -- 172.21.15.148:0/1934192819 shutdown_connections 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.841+0000 7f4bc3200700 1 -- 172.21.15.148:0/1934192819 wait complete. 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.842+0000 7f4bc3200700 1 Processor -- start 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.842+0000 7f4bc3200700 1 -- start start 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.842+0000 7f4bc3200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bbc102f50 0x7f4bbc115c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.842+0000 7f4bc3200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc1038f0 0x7f4bbc1161d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.842+0000 7f4bc3200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc116820 con 0x7f4bbc1038f0 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.842+0000 7f4bc3200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc10fb50 con 0x7f4bbc102f50 2024-02-28T16:21:25.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.843+0000 7f4bbb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc1038f0 0x7f4bbc1161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.843+0000 7f4bbb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc1038f0 0x7f4bbc1161d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42742/0 (socket says 172.21.15.148:42742) 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.843+0000 7f4bbb400700 1 -- 172.21.15.148:0/3980865083 learned_addr learned my addr 172.21.15.148:0/3980865083 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.843+0000 7f4bbbe00700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bbc102f50 0x7f4bbc115c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.843+0000 7f4bbb400700 1 -- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bbc102f50 msgr2=0x7f4bbc115c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.843+0000 7f4bbb400700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bbc102f50 0x7f4bbc115c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.843+0000 7f4bbb400700 1 -- 172.21.15.148:0/3980865083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac005040 con 0x7f4bbc1038f0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.844+0000 7f4bbb400700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc1038f0 0x7f4bbc1161d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8002a80 tx=0x7f4ba8004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.844+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba8007cc0 con 0x7f4bbc1038f0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.844+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc10fe30 con 0x7f4bbc1038f0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.844+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ba800f040 con 0x7f4bbc1038f0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.844+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ba800daf0 con 0x7f4bbc1038f0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.844+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc110370 con 0x7f4bbc1038f0 2024-02-28T16:21:25.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.845+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4bbc1108a0 con 0x7f4bbc1038f0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.847+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4ba800dc90 con 0x7f4bbc1038f0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.847+0000 7f4bb3e00700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ba00692a0 0x7f4ba006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.847+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4ba8086550 con 0x7f4bbc1038f0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.848+0000 7f4bbbe00700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ba00692a0 0x7f4ba006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.848+0000 7f4bb3e00700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] conn(0x7f4ba006ef70 0x7f4ba0071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.848+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 --> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ba0071a30 con 0x7f4ba006ef70 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.848+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ba8088aa0 con 0x7f4bbc1038f0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.848+0000 7f4bbbe00700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ba00692a0 0x7f4ba006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bac004f90 tx=0x7f4bac009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.848+0000 7f4bc1200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] conn(0x7f4ba006ef70 0x7f4ba0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.849+0000 7f4bc1200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] conn(0x7f4ba006ef70 0x7f4ba0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:25.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.851+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== osd.5 v2:172.21.15.157:6816/1546679359 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4ba0071a30 con 0x7f4ba006ef70 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.868+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 --> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4bbc0fadd0 con 0x7f4ba006ef70 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.869+0000 7f4bb3e00700 1 -- 172.21.15.148:0/3980865083 <== osd.5 v2:172.21.15.157:6816/1546679359 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4bbc0fadd0 con 0x7f4ba006ef70 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.869+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] conn(0x7f4ba006ef70 msgr2=0x7f4ba0071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.869+0000 7f4bc3200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] conn(0x7f4ba006ef70 0x7f4ba0071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.869+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ba00692a0 msgr2=0x7f4ba006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.869+0000 7f4bc3200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ba00692a0 0x7f4ba006b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bac004f90 tx=0x7f4bac009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.869+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc1038f0 msgr2=0x7f4bbc1161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:25.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.869+0000 7f4bc3200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc1038f0 0x7f4bbc1161d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8002a80 tx=0x7f4ba8004630 comp rx=0 tx=0).stop 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 shutdown_connections 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:6816/1546679359,v1:172.21.15.157:6817/1546679359] conn(0x7f4ba006ef70 0x7f4ba0071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ba00692a0 0x7f4ba006b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bbc102f50 0x7f4bbc115c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 --2- 172.21.15.148:0/3980865083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bbc1038f0 0x7f4bbc1161d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 >> 172.21.15.148:0/3980865083 conn(0x7f4bbc0f8ae0 msgr2=0x7f4bbc0fa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 shutdown_connections 2024-02-28T16:21:25.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.870+0000 7f4bc3200700 1 -- 172.21.15.148:0/3980865083 wait complete. 2024-02-28T16:21:26.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:25 smithi157 ceph-mon[38346]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:26.668 INFO:teuthology.orchestra.run.smithi148.stdout:60129542183 2024-02-28T16:21:26.668 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-28T16:21:26.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.933+0000 7f38f6200700 1 -- 172.21.15.148:0/358018495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105240 msgr2=0x7f38f0105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.933+0000 7f38f6200700 1 --2- 172.21.15.148:0/358018495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105240 0x7f38f0105610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f38e0004940 tx=0x7f38e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.934+0000 7f38f6200700 1 -- 172.21.15.148:0/358018495 shutdown_connections 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.934+0000 7f38f6200700 1 --2- 172.21.15.148:0/358018495 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38f0105be0 0x7f38f00ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.934+0000 7f38f6200700 1 --2- 172.21.15.148:0/358018495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105240 0x7f38f0105610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.934+0000 7f38f6200700 1 -- 172.21.15.148:0/358018495 >> 172.21.15.148:0/358018495 conn(0x7f38f00fadf0 msgr2=0x7f38f00fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.934+0000 7f38f6200700 1 -- 172.21.15.148:0/358018495 shutdown_connections 2024-02-28T16:21:26.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.934+0000 7f38f6200700 1 -- 172.21.15.148:0/358018495 wait complete. 2024-02-28T16:21:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.935+0000 7f38f6200700 1 Processor -- start 2024-02-28T16:21:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.935+0000 7f38f6200700 1 -- start start 2024-02-28T16:21:26.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.935+0000 7f38f6200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38f0105240 0x7f38f0115cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38f6200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105be0 0x7f38f0116230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38f6200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0116880 con 0x7f38f0105be0 2024-02-28T16:21:26.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38f6200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f010fb90 con 0x7f38f0105240 2024-02-28T16:21:26.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38eea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105be0 0x7f38f0116230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38eea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105be0 0x7f38f0116230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42766/0 (socket says 172.21.15.148:42766) 2024-02-28T16:21:26.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38eea00700 1 -- 172.21.15.148:0/952165706 learned_addr learned my addr 172.21.15.148:0/952165706 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:26.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38ef400700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38f0105240 0x7f38f0115cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38eea00700 1 -- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38f0105240 msgr2=0x7f38f0115cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.936+0000 7f38eea00700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38f0105240 0x7f38f0115cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.937+0000 7f38eea00700 1 -- 172.21.15.148:0/952165706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0005040 con 0x7f38f0105be0 2024-02-28T16:21:26.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.937+0000 7f38eea00700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105be0 0x7f38f0116230 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00eb40 tx=0x7f38dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:26.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.938+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38dc007cc0 con 0x7f38f0105be0 2024-02-28T16:21:26.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.938+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f010fe10 con 0x7f38f0105be0 2024-02-28T16:21:26.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.938+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38dc00f040 con 0x7f38f0105be0 2024-02-28T16:21:26.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.938+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38dc0095e0 con 0x7f38f0105be0 2024-02-28T16:21:26.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.938+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f0110350 con 0x7f38f0105be0 2024-02-28T16:21:26.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.939+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38f01108c0 con 0x7f38f0105be0 2024-02-28T16:21:26.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.940+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f38dc009740 con 0x7f38f0105be0 2024-02-28T16:21:26.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.941+0000 7f38e7400700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f38d40692b0 0x7f38d406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.941+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f38dc086890 con 0x7f38f0105be0 2024-02-28T16:21:26.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.942+0000 7f38ef400700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f38d40692b0 0x7f38d406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.942+0000 7f38e7400700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] conn(0x7f38d406ef80 0x7f38d4071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:26.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.942+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 --> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38d4071a40 con 0x7f38d406ef80 2024-02-28T16:21:26.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.942+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38dc08b220 con 0x7f38f0105be0 2024-02-28T16:21:26.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.943+0000 7f38efe00700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] conn(0x7f38d406ef80 0x7f38d4071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:26.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.943+0000 7f38ef400700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f38d40692b0 0x7f38d406b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38e0008fe0 tx=0x7f38e0009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:26.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.943+0000 7f38efe00700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] conn(0x7f38d406ef80 0x7f38d4071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:26.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.946+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== osd.3 v2:172.21.15.157:6800/3186455722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f38d4071a40 con 0x7f38d406ef80 2024-02-28T16:21:26.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.964+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 --> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38f005e650 con 0x7f38d406ef80 2024-02-28T16:21:26.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.965+0000 7f38e7400700 1 -- 172.21.15.148:0/952165706 <== osd.3 v2:172.21.15.157:6800/3186455722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f38f005e650 con 0x7f38d406ef80 2024-02-28T16:21:26.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] conn(0x7f38d406ef80 msgr2=0x7f38d4071390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] conn(0x7f38d406ef80 0x7f38d4071390 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f38d40692b0 msgr2=0x7f38d406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f38d40692b0 0x7f38d406b760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f38e0008fe0 tx=0x7f38e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:26.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105be0 msgr2=0x7f38f0116230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:26.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105be0 0x7f38f0116230 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00eb40 tx=0x7f38dc00b040 comp rx=0 tx=0).stop 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 shutdown_connections 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:6800/3186455722,v1:172.21.15.157:6801/3186455722] conn(0x7f38d406ef80 0x7f38d4071390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f38d40692b0 0x7f38d406b760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f38f0105240 0x7f38f0115cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 --2- 172.21.15.148:0/952165706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f38f0105be0 0x7f38f0116230 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.966+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 >> 172.21.15.148:0/952165706 conn(0x7f38f00fadf0 msgr2=0x7f38f00fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.967+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 shutdown_connections 2024-02-28T16:21:26.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:26.967+0000 7f38f6200700 1 -- 172.21.15.148:0/952165706 wait complete. 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.971+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4123675527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 msgr2=0x7fbf380fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.971+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4123675527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf380fcf60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbf24004940 tx=0x7fbf24009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.972+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4123675527 shutdown_connections 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.972+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4123675527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf380fcf60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.972+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4123675527 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf38102f50 0x7fbf38103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.972+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4123675527 >> 172.21.15.148:0/4123675527 conn(0x7fbf380f8ae0 msgr2=0x7fbf380faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.972+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4123675527 shutdown_connections 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.972+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4123675527 wait complete. 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.972+0000 7fbf3dc00700 1 Processor -- start 2024-02-28T16:21:27.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf3dc00700 1 -- start start 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf3dc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf38102f50 0x7fbf38115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf3dc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf38116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf3dc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381168f0 con 0x7fbf381038f0 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf3dc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3810fb70 con 0x7fbf38102f50 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf36000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf38116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf36000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf38116210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42760/0 (socket says 172.21.15.148:42760) 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.973+0000 7fbf36000700 1 -- 172.21.15.148:0/4117523271 learned_addr learned my addr 172.21.15.148:0/4117523271 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf36000700 1 -- 172.21.15.148:0/4117523271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf38102f50 msgr2=0x7fbf38115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf36a00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf38102f50 0x7fbf38115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf36000700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf38102f50 0x7fbf38115cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf36000700 1 -- 172.21.15.148:0/4117523271 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf24005040 con 0x7fbf381038f0 2024-02-28T16:21:27.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf36000700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf38116210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009150 tx=0x7fbf24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf2400e040 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf2400bbf0 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf2401c630 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3810fd90 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.974+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf381102d0 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.975+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf381108c0 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.976+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fbf2400bd60 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.977+0000 7fbf2ea00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbf1c0692a0 0x7fbf1c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.977+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbf24088c70 con 0x7fbf381038f0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.978+0000 7fbf36a00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbf1c0692a0 0x7fbf1c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.978+0000 7fbf2ea00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] conn(0x7fbf1c06ef70 0x7fbf1c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.978+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 --> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf1c071a30 con 0x7fbf1c06ef70 2024-02-28T16:21:27.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.978+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf24088fb0 con 0x7fbf381038f0 2024-02-28T16:21:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.978+0000 7fbf37400700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] conn(0x7fbf1c06ef70 0x7fbf1c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.978+0000 7fbf36a00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbf1c0692a0 0x7fbf1c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf28006fd0 tx=0x7fbf28008040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.979+0000 7fbf37400700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] conn(0x7fbf1c06ef70 0x7fbf1c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:27.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.979+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== osd.2 v2:172.21.15.148:6818/408082720 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fbf1c071a30 con 0x7fbf1c06ef70 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.996+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 --> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf380facf0 con 0x7fbf1c06ef70 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.996+0000 7fbf2ea00700 1 -- 172.21.15.148:0/4117523271 <== osd.2 v2:172.21.15.148:6818/408082720 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf380facf0 con 0x7fbf1c06ef70 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] conn(0x7fbf1c06ef70 msgr2=0x7fbf1c071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] conn(0x7fbf1c06ef70 0x7fbf1c071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbf1c0692a0 msgr2=0x7fbf1c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbf1c0692a0 0x7fbf1c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf28006fd0 tx=0x7fbf28008040 comp rx=0 tx=0).stop 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 msgr2=0x7fbf38116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf38116210 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf24009150 tx=0x7fbf24009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 shutdown_connections 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6818/408082720,v1:172.21.15.148:6819/408082720] conn(0x7fbf1c06ef70 0x7fbf1c071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbf1c0692a0 0x7fbf1c06b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbf38102f50 0x7fbf38115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 --2- 172.21.15.148:0/4117523271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf381038f0 0x7fbf38116210 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 >> 172.21.15.148:0/4117523271 conn(0x7fbf380f8ae0 msgr2=0x7fbf380fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 shutdown_connections 2024-02-28T16:21:27.054 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:25.997+0000 7fbf3dc00700 1 -- 172.21.15.148:0/4117523271 wait complete. 2024-02-28T16:21:27.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:28.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:27 smithi148 ceph-mon[28767]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:28.196 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:28.197 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:28.225 INFO:teuthology.orchestra.run.smithi148.stdout:81604378657 2024-02-28T16:21:28.225 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-28T16:21:28.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:27 smithi157 ceph-mon[38346]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:28.930 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:28 smithi148 ceph-mon[28767]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:29.102 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:29.112 INFO:teuthology.orchestra.run.smithi148.stdout:111669149722 2024-02-28T16:21:29.112 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-28T16:21:29.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:28 smithi157 ceph-mon[38346]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:30.677 INFO:teuthology.orchestra.run.smithi148.stdout:167503724555 2024-02-28T16:21:30.677 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-28T16:21:31.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:31 smithi148 ceph-mon[28767]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:32.041 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:31 smithi157 ceph-mon[38346]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:32.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:32 smithi157 ceph-mon[38346]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:33.072 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:32 smithi148 ceph-mon[28767]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:33.246 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.879+0000 7fa2d2200700 1 -- 172.21.15.148:0/2308191692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc0702b0 msgr2=0x7fa2cc070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.879+0000 7fa2d2200700 1 --2- 172.21.15.148:0/2308191692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc0702b0 0x7fa2cc070680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc004940 tx=0x7fa2bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.880+0000 7fa2d2200700 1 -- 172.21.15.148:0/2308191692 shutdown_connections 2024-02-28T16:21:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.880+0000 7fa2d2200700 1 --2- 172.21.15.148:0/2308191692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2cc070bc0 0x7fa2cc1092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.880+0000 7fa2d2200700 1 --2- 172.21.15.148:0/2308191692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc0702b0 0x7fa2cc070680 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:33.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.880+0000 7fa2d2200700 1 -- 172.21.15.148:0/2308191692 >> 172.21.15.148:0/2308191692 conn(0x7fa2cc0f8ae0 msgr2=0x7fa2cc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:33.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.880+0000 7fa2d2200700 1 -- 172.21.15.148:0/2308191692 shutdown_connections 2024-02-28T16:21:33.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.880+0000 7fa2d2200700 1 -- 172.21.15.148:0/2308191692 wait complete. 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.881+0000 7fa2d2200700 1 Processor -- start 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.881+0000 7fa2d2200700 1 -- start start 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.881+0000 7fa2d2200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2cc0702b0 0x7fa2cc115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.881+0000 7fa2d2200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc070bc0 0x7fa2cc1161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2d2200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc116840 con 0x7fa2cc070bc0 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2d2200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc10fb50 con 0x7fa2cc0702b0 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2c3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc070bc0 0x7fa2cc1161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2c3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc070bc0 0x7fa2cc1161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52152/0 (socket says 172.21.15.148:52152) 2024-02-28T16:21:33.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2c3e00700 1 -- 172.21.15.148:0/3934880777 learned_addr learned my addr 172.21.15.148:0/3934880777 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2cb400700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2cc0702b0 0x7fa2cc115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2c3e00700 1 -- 172.21.15.148:0/3934880777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2cc0702b0 msgr2=0x7fa2cc115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2c3e00700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2cc0702b0 0x7fa2cc115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:33.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.882+0000 7fa2c3e00700 1 -- 172.21.15.148:0/3934880777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc005040 con 0x7fa2cc070bc0 2024-02-28T16:21:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.883+0000 7fa2c3e00700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc070bc0 0x7fa2cc1161f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4002a50 tx=0x7fa2b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.883+0000 7fa2c3400700 1 -- 172.21.15.148:0/3934880777 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b4007cc0 con 0x7fa2cc070bc0 2024-02-28T16:21:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.883+0000 7fa2c3400700 1 -- 172.21.15.148:0/3934880777 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2b400f040 con 0x7fa2cc070bc0 2024-02-28T16:21:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.883+0000 7fa2c3400700 1 -- 172.21.15.148:0/3934880777 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2b4009640 con 0x7fa2cc070bc0 2024-02-28T16:21:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.883+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc10fe30 con 0x7fa2cc070bc0 2024-02-28T16:21:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.883+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc110370 con 0x7fa2cc070bc0 2024-02-28T16:21:33.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.884+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc1069a0 con 0x7fa2cc070bc0 2024-02-28T16:21:33.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.885+0000 7fa2c3400700 1 -- 172.21.15.148:0/3934880777 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa2b40097a0 con 0x7fa2cc070bc0 2024-02-28T16:21:33.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.886+0000 7fa2c3400700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2ac0692b0 0x7fa2ac06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:33.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.886+0000 7fa2c3400700 1 -- 172.21.15.148:0/3934880777 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa2b4086c10 con 0x7fa2cc070bc0 2024-02-28T16:21:33.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.887+0000 7fa2cb400700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2ac0692b0 0x7fa2ac06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:33.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.887+0000 7fa2cb400700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2ac0692b0 0x7fa2ac06b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b020 tx=0x7fa2bc009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:33.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.891+0000 7fa2c3400700 1 -- 172.21.15.148:0/3934880777 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa2b4056c70 con 0x7fa2cc070bc0 2024-02-28T16:21:34.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.109+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2cc0fc6e0 con 0x7fa2cc070bc0 2024-02-28T16:21:34.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.109+0000 7fa2c3400700 1 -- 172.21.15.148:0/3934880777 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2b4056800 con 0x7fa2cc070bc0 2024-02-28T16:21:34.100 INFO:teuthology.orchestra.run.smithi148.stdout:60129542186 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2ac0692b0 msgr2=0x7fa2ac06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2ac0692b0 0x7fa2ac06b760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00b020 tx=0x7fa2bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc070bc0 msgr2=0x7fa2cc1161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc070bc0 0x7fa2cc1161f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4002a50 tx=0x7fa2b40046b0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 shutdown_connections 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2ac0692b0 0x7fa2ac06b760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2cc0702b0 0x7fa2cc115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 --2- 172.21.15.148:0/3934880777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2cc070bc0 0x7fa2cc1161f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.112+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 >> 172.21.15.148:0/3934880777 conn(0x7fa2cc0f8ae0 msgr2=0x7fa2cc103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.113+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 shutdown_connections 2024-02-28T16:21:34.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.113+0000 7fa2d2200700 1 -- 172.21.15.148:0/3934880777 wait complete. 2024-02-28T16:21:34.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.756+0000 7f1bfc200700 1 -- 172.21.15.148:0/1127490051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105170 msgr2=0x7f1bf4105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:34.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.756+0000 7f1bfc200700 1 --2- 172.21.15.148:0/1127490051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105170 0x7f1bf4105540 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009ce0 tx=0x7f1be8004d10 comp rx=0 tx=0).stop 2024-02-28T16:21:34.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.757+0000 7f1bfc200700 1 -- 172.21.15.148:0/1127490051 shutdown_connections 2024-02-28T16:21:34.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.757+0000 7f1bfc200700 1 --2- 172.21.15.148:0/1127490051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf4105b10 0x7f1bf40ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.757+0000 7f1bfc200700 1 --2- 172.21.15.148:0/1127490051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105170 0x7f1bf4105540 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.757+0000 7f1bfc200700 1 -- 172.21.15.148:0/1127490051 >> 172.21.15.148:0/1127490051 conn(0x7f1bf40face0 msgr2=0x7f1bf40fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.757+0000 7f1bfc200700 1 -- 172.21.15.148:0/1127490051 shutdown_connections 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.757+0000 7f1bfc200700 1 -- 172.21.15.148:0/1127490051 wait complete. 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.758+0000 7f1bfc200700 1 Processor -- start 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.758+0000 7f1bfc200700 1 -- start start 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.758+0000 7f1bfc200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf4105170 0x7f1bf4115e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.758+0000 7f1bfc200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105b10 0x7f1bf41163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.758+0000 7f1bfc200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf4116a00 con 0x7f1bf4105b10 2024-02-28T16:21:34.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.758+0000 7f1bfc200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf410fd50 con 0x7f1bf4105170 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.759+0000 7f1bf8e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105b10 0x7f1bf41163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.759+0000 7f1bf8e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105b10 0x7f1bf41163b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52134/0 (socket says 172.21.15.148:52134) 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.759+0000 7f1bf8e00700 1 -- 172.21.15.148:0/177541215 learned_addr learned my addr 172.21.15.148:0/177541215 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.759+0000 7f1bf9800700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf4105170 0x7f1bf4115e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.759+0000 7f1bf8e00700 1 -- 172.21.15.148:0/177541215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf4105170 msgr2=0x7f1bf4115e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.759+0000 7f1bf8e00700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf4105170 0x7f1bf4115e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.759+0000 7f1bf8e00700 1 -- 172.21.15.148:0/177541215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be8009940 con 0x7f1bf4105b10 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.760+0000 7f1bf8e00700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105b10 0x7f1bf41163b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c800 tx=0x7f1be0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:34.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.760+0000 7f1bf1600700 1 -- 172.21.15.148:0/177541215 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1be00106f0 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.760+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf4110030 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.760+0000 7f1bf1600700 1 -- 172.21.15.148:0/177541215 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1be0010d20 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.760+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf4110570 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.760+0000 7f1bf1600700 1 -- 172.21.15.148:0/177541215 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1be00113a0 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.762+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf4102480 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.763+0000 7f1bf1600700 1 -- 172.21.15.148:0/177541215 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1be0012400 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.765+0000 7f1bf1600700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1bdc0692b0 0x7f1bdc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.765+0000 7f1bf1600700 1 -- 172.21.15.148:0/177541215 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1be0086d90 con 0x7f1bf4105b10 2024-02-28T16:21:34.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.765+0000 7f1bf9800700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1bdc0692b0 0x7f1bdc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:34.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.766+0000 7f1bf9800700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1bdc0692b0 0x7f1bdc06b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1be8005010 tx=0x7f1be8004d10 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:34.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.769+0000 7f1bf1600700 1 -- 172.21.15.148:0/177541215 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1be00533e0 con 0x7f1bf4105b10 2024-02-28T16:21:34.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.995+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1bf404bed0 con 0x7f1bf4105b10 2024-02-28T16:21:34.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.996+0000 7f1bf1600700 1 -- 172.21.15.148:0/177541215 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1be0056a00 con 0x7f1bf4105b10 2024-02-28T16:21:34.865 INFO:teuthology.orchestra.run.smithi148.stdout:38654705713 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1bdc0692b0 msgr2=0x7f1bdc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1bdc0692b0 0x7f1bdc06b760 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1be8005010 tx=0x7f1be8004d10 comp rx=0 tx=0).stop 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105b10 msgr2=0x7f1bf41163b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105b10 0x7f1bf41163b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c800 tx=0x7f1be0004470 comp rx=0 tx=0).stop 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 shutdown_connections 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1bdc0692b0 0x7f1bdc06b760 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1bf4105170 0x7f1bf4115e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 --2- 172.21.15.148:0/177541215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bf4105b10 0x7f1bf41163b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 >> 172.21.15.148:0/177541215 conn(0x7f1bf40face0 msgr2=0x7f1bf40fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:34.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 shutdown_connections 2024-02-28T16:21:34.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:33.999+0000 7f1bfc200700 1 -- 172.21.15.148:0/177541215 wait complete. 2024-02-28T16:21:35.013 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:35.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:34 smithi148 ceph-mon[28767]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:35.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:34 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/177541215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T16:21:35.110 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:34 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3934880777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T16:21:35.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:34 smithi157 ceph-mon[38346]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:35.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/177541215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T16:21:35.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3934880777' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T16:21:35.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705711 got 38654705713 for osd.0 2024-02-28T16:21:35.746 DEBUG:teuthology.parallel:result is None 2024-02-28T16:21:36.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 -- 172.21.15.148:0/462823545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 msgr2=0x7fcab80fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 --2- 172.21.15.148:0/462823545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab80fcd70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4004940 tx=0x7fcaa4009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 -- 172.21.15.148:0/462823545 shutdown_connections 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 --2- 172.21.15.148:0/462823545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab80fcd70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 --2- 172.21.15.148:0/462823545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcab8102d60 0x7fcab8103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 -- 172.21.15.148:0/462823545 >> 172.21.15.148:0/462823545 conn(0x7fcab80f8910 msgr2=0x7fcab80fad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 -- 172.21.15.148:0/462823545 shutdown_connections 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.890+0000 7fcab7200700 1 -- 172.21.15.148:0/462823545 wait complete. 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.891+0000 7fcab7200700 1 Processor -- start 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.891+0000 7fcab7200700 1 -- start start 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.891+0000 7fcab7200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcab8102d60 0x7fcab8115ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.891+0000 7fcab7200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab8116000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab7200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab8116650 con 0x7fcab8103700 2024-02-28T16:21:36.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab7200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab810f980 con 0x7fcab8102d60 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab5400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab8116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab5400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab8116000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52164/0 (socket says 172.21.15.148:52164) 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab5400700 1 -- 172.21.15.148:0/2707328240 learned_addr learned my addr 172.21.15.148:0/2707328240 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab5400700 1 -- 172.21.15.148:0/2707328240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcab8102d60 msgr2=0x7fcab8115ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab5400700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcab8102d60 0x7fcab8115ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab5400700 1 -- 172.21.15.148:0/2707328240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa4005040 con 0x7fcab8103700 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.892+0000 7fcab5400700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab8116000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009030 tx=0x7fcaa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.893+0000 7fcaae000700 1 -- 172.21.15.148:0/2707328240 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa400e040 con 0x7fcab8103700 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.893+0000 7fcaae000700 1 -- 172.21.15.148:0/2707328240 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcaa400bbf0 con 0x7fcab8103700 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.893+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab810fc00 con 0x7fcab8103700 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.893+0000 7fcaae000700 1 -- 172.21.15.148:0/2707328240 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcaa401c630 con 0x7fcab8103700 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.893+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab8110140 con 0x7fcab8103700 2024-02-28T16:21:36.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.894+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab805f5c0 con 0x7fcab8103700 2024-02-28T16:21:36.011 INFO:teuthology.orchestra.run.smithi148.stdout:146028888085 2024-02-28T16:21:36.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.895+0000 7fcaae000700 1 -- 172.21.15.148:0/2707328240 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcaa400bd60 con 0x7fcab8103700 2024-02-28T16:21:36.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.896+0000 7fcaae000700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fca9c0692b0 0x7fca9c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:36.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.896+0000 7fcaae000700 1 -- 172.21.15.148:0/2707328240 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fcaa4088190 con 0x7fcab8103700 2024-02-28T16:21:36.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.896+0000 7fcab5e00700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fca9c0692b0 0x7fca9c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:36.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.897+0000 7fcab5e00700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fca9c0692b0 0x7fca9c06b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8004ad0 tx=0x7fcaa8007d40 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:36.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:34.901+0000 7fcaae000700 1 -- 172.21.15.148:0/2707328240 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcaa4058270 con 0x7fcab8103700 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.120+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcab804bed0 con 0x7fcab8103700 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.120+0000 7fcaae000700 1 -- 172.21.15.148:0/2707328240 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaa4057e00 con 0x7fcab8103700 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.123+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fca9c0692b0 msgr2=0x7fca9c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.123+0000 7fcab7200700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fca9c0692b0 0x7fca9c06b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8004ad0 tx=0x7fcaa8007d40 comp rx=0 tx=0).stop 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.123+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 msgr2=0x7fcab8116000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.123+0000 7fcab7200700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab8116000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009030 tx=0x7fcaa4009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.124+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 shutdown_connections 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.124+0000 7fcab7200700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fca9c0692b0 0x7fca9c06b760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.124+0000 7fcab7200700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcab8102d60 0x7fcab8115ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.124+0000 7fcab7200700 1 --2- 172.21.15.148:0/2707328240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8103700 0x7fcab8116000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.124+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 >> 172.21.15.148:0/2707328240 conn(0x7fcab80f8910 msgr2=0x7fcab80fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.124+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 shutdown_connections 2024-02-28T16:21:36.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:35.124+0000 7fcab7200700 1 -- 172.21.15.148:0/2707328240 wait complete. 2024-02-28T16:21:36.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:35 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2707328240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T16:21:36.283 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:35 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2707328240' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T16:21:36.989 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542183 got 60129542186 for osd.1 2024-02-28T16:21:36.989 DEBUG:teuthology.parallel:result is None 2024-02-28T16:21:37.214 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:36 smithi148 ceph-mon[28767]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:37.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:36 smithi157 ceph-mon[38346]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:38.484 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888082 got 146028888085 for osd.4 2024-02-28T16:21:38.484 DEBUG:teuthology.parallel:result is None 2024-02-28T16:21:39.217 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:38 smithi148 ceph-mon[28767]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:39.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:38 smithi157 ceph-mon[38346]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.835+0000 7f097dc00700 1 -- 172.21.15.148:0/2170431351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 msgr2=0x7f09780fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.835+0000 7f097dc00700 1 --2- 172.21.15.148:0/2170431351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f09780fe330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0968004940 tx=0x7f0968009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.835+0000 7f097dc00700 1 -- 172.21.15.148:0/2170431351 shutdown_connections 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.835+0000 7f097dc00700 1 --2- 172.21.15.148:0/2170431351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09780fe900 0x7f0978106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.835+0000 7f097dc00700 1 --2- 172.21.15.148:0/2170431351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f09780fe330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.835+0000 7f097dc00700 1 -- 172.21.15.148:0/2170431351 >> 172.21.15.148:0/2170431351 conn(0x7f09780f7a10 msgr2=0x7f09780f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.836+0000 7f097dc00700 1 -- 172.21.15.148:0/2170431351 shutdown_connections 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.836+0000 7f097dc00700 1 -- 172.21.15.148:0/2170431351 wait complete. 2024-02-28T16:21:40.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.836+0000 7f097dc00700 1 Processor -- start 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.836+0000 7f097dc00700 1 -- start start 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f097dc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f0978115d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f097dc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09780fe900 0x7f0978116290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f097dc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781168e0 con 0x7f09780fdf60 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f097dc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097810fbf0 con 0x7f09780fe900 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f0976a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f0978115d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f0976a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f0978115d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52178/0 (socket says 172.21.15.148:52178) 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f0976a00700 1 -- 172.21.15.148:0/1591122866 learned_addr learned my addr 172.21.15.148:0/1591122866 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f0976a00700 1 -- 172.21.15.148:0/1591122866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09780fe900 msgr2=0x7f0978116290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f0976a00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09780fe900 0x7f0978116290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.837+0000 7f0976a00700 1 -- 172.21.15.148:0/1591122866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968005040 con 0x7f09780fdf60 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.838+0000 7f0976a00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f0978115d50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0968000c00 tx=0x7f0968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.838+0000 7f096ea00700 1 -- 172.21.15.148:0/1591122866 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f096800e040 con 0x7f09780fdf60 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.838+0000 7f096ea00700 1 -- 172.21.15.148:0/1591122866 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0968009af0 con 0x7f09780fdf60 2024-02-28T16:21:40.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.838+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097810fe70 con 0x7f09780fdf60 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.838+0000 7f096ea00700 1 -- 172.21.15.148:0/1591122866 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f096801c630 con 0x7f09780fdf60 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stdout:81604378660 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.838+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09781103b0 con 0x7f09780fdf60 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.839+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0978106950 con 0x7f09780fdf60 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.840+0000 7f096ea00700 1 -- 172.21.15.148:0/1591122866 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f096800bbf0 con 0x7f09780fdf60 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.841+0000 7f096ea00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f095c0692a0 0x7f095c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.841+0000 7f096ea00700 1 -- 172.21.15.148:0/1591122866 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f09680882e0 con 0x7f09780fdf60 2024-02-28T16:21:40.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.841+0000 7f0976000700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f095c0692a0 0x7f095c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.842+0000 7f0976000700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f095c0692a0 0x7f095c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f09781115f0 tx=0x7f0964009ce0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:39.847+0000 7f096ea00700 1 -- 172.21.15.148:0/1591122866 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f0968058340 con 0x7f09780fdf60 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.056+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f097810a040 con 0x7f09780fdf60 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.057+0000 7f096ea00700 1 -- 172.21.15.148:0/1591122866 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0968057ed0 con 0x7f09780fdf60 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f095c0692a0 msgr2=0x7f095c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f095c0692a0 0x7f095c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f09781115f0 tx=0x7f0964009ce0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 msgr2=0x7f0978115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f0978115d50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0968000c00 tx=0x7f0968009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 shutdown_connections 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f09780fdf60 0x7f0978115d50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f095c0692a0 0x7f095c06b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 --2- 172.21.15.148:0/1591122866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f09780fe900 0x7f0978116290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 >> 172.21.15.148:0/1591122866 conn(0x7f09780f7a10 msgr2=0x7f0978103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:40.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 shutdown_connections 2024-02-28T16:21:40.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.060+0000 7f097dc00700 1 -- 172.21.15.148:0/1591122866 wait complete. 2024-02-28T16:21:40.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 -- 172.21.15.148:0/950318953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 msgr2=0x7f92dc0fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 --2- 172.21.15.148:0/950318953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc0fc1a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f92cc004940 tx=0x7f92cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:40.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 -- 172.21.15.148:0/950318953 shutdown_connections 2024-02-28T16:21:40.797 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 --2- 172.21.15.148:0/950318953 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92dc0fc6e0 0x7f92dc109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 --2- 172.21.15.148:0/950318953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc0fc1a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 -- 172.21.15.148:0/950318953 >> 172.21.15.148:0/950318953 conn(0x7f92dc071d90 msgr2=0x7f92dc072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 -- 172.21.15.148:0/950318953 shutdown_connections 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.748+0000 7f92e1000700 1 -- 172.21.15.148:0/950318953 wait complete. 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92e1000700 1 Processor -- start 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92e1000700 1 -- start start 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92e1000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92e1000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92dc0fc6e0 0x7f92dc116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92e1000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc116860 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92e1000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc10fb70 con 0x7f92dc0fc6e0 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92d9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92d9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc115cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52198/0 (socket says 172.21.15.148:52198) 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.749+0000 7f92d9e00700 1 -- 172.21.15.148:0/4096854427 learned_addr learned my addr 172.21.15.148:0/4096854427 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:40.798 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d9e00700 1 -- 172.21.15.148:0/4096854427 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92dc0fc6e0 msgr2=0x7f92dc116210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d9400700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92dc0fc6e0 0x7f92dc116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d9e00700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92dc0fc6e0 0x7f92dc116210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d9e00700 1 -- 172.21.15.148:0/4096854427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc005040 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d9400700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92dc0fc6e0 0x7f92dc116210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d9e00700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc115cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f92cc000c00 tx=0x7f92cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d2000700 1 -- 172.21.15.148:0/4096854427 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92cc00e040 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92d2000700 1 -- 172.21.15.148:0/4096854427 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92cc00bb90 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.750+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc10fdf0 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.751+0000 7f92d2000700 1 -- 172.21.15.148:0/4096854427 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92cc01c630 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.751+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc110330 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.752+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc106b70 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.753+0000 7f92d2000700 1 -- 172.21.15.148:0/4096854427 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f92cc00bd00 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.753+0000 7f92d2000700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f92c00692b0 0x7f92c006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.753+0000 7f92d2000700 1 -- 172.21.15.148:0/4096854427 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f92cc088110 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.754+0000 7f92d9400700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f92c00692b0 0x7f92c006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:40.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.754+0000 7f92d9400700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f92c00692b0 0x7f92c006b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007fd0 tx=0x7f92c8009040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:40.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.758+0000 7f92d2000700 1 -- 172.21.15.148:0/4096854427 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f92cc058210 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:40 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1591122866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T16:21:40.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.972+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92dc04bed0 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.973+0000 7f92d2000700 1 -- 172.21.15.148:0/4096854427 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92cc057da0 con 0x7f92dc0fbdd0 2024-02-28T16:21:40.963 INFO:teuthology.orchestra.run.smithi148.stdout:111669149724 2024-02-28T16:21:40.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f92c00692b0 msgr2=0x7f92c006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f92c00692b0 0x7f92c006b760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007fd0 tx=0x7f92c8009040 comp rx=0 tx=0).stop 2024-02-28T16:21:40.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 msgr2=0x7f92dc115cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:40.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc115cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f92cc000c00 tx=0x7f92cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:40.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 shutdown_connections 2024-02-28T16:21:40.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92dc0fbdd0 0x7f92dc115cd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f92c00692b0 0x7f92c006b760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 --2- 172.21.15.148:0/4096854427 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92dc0fc6e0 0x7f92dc116210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:40.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 >> 172.21.15.148:0/4096854427 conn(0x7f92dc071d90 msgr2=0x7f92dc0faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:40.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 shutdown_connections 2024-02-28T16:21:40.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:40.976+0000 7f92e1000700 1 -- 172.21.15.148:0/4096854427 wait complete. 2024-02-28T16:21:41.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378657 got 81604378660 for osd.2 2024-02-28T16:21:41.211 DEBUG:teuthology.parallel:result is None 2024-02-28T16:21:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:40 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1591122866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T16:21:41.818 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:41 smithi148 ceph-mon[28767]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:41.819 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:41.819 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:41 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/4096854427' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T16:21:41.867 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149722 got 111669149724 for osd.3 2024-02-28T16:21:41.867 DEBUG:teuthology.parallel:result is None 2024-02-28T16:21:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:41 smithi157 ceph-mon[38346]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:41 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/4096854427' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T16:21:42.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:42 smithi148 ceph-mon[28767]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:43.056 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:42 smithi157 ceph-mon[38346]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 -- 172.21.15.148:0/3861673112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc80702d0 msgr2=0x7f3cc80706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 --2- 172.21.15.148:0/3861673112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc80702d0 0x7f3cc80706a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8009d10 tx=0x7f3cb8004d10 comp rx=0 tx=0).stop 2024-02-28T16:21:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 -- 172.21.15.148:0/3861673112 shutdown_connections 2024-02-28T16:21:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 --2- 172.21.15.148:0/3861673112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc8070be0 0x7f3cc81090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 --2- 172.21.15.148:0/3861673112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc80702d0 0x7f3cc80706a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 -- 172.21.15.148:0/3861673112 >> 172.21.15.148:0/3861673112 conn(0x7f3cc80f88e0 msgr2=0x7f3cc80facf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 -- 172.21.15.148:0/3861673112 shutdown_connections 2024-02-28T16:21:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.167+0000 7f3ccd800700 1 -- 172.21.15.148:0/3861673112 wait complete. 2024-02-28T16:21:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.168+0000 7f3ccd800700 1 Processor -- start 2024-02-28T16:21:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.168+0000 7f3ccd800700 1 -- start start 2024-02-28T16:21:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3ccd800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80702d0 0x7f3cc8115be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3ccd800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc8070be0 0x7f3cc8116120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3ccd800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8116770 con 0x7f3cc8070be0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3ccd800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc810faa0 con 0x7f3cc80702d0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3cbf400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc8070be0 0x7f3cc8116120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3cbf400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc8070be0 0x7f3cc8116120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33158/0 (socket says 172.21.15.148:33158) 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3cbf400700 1 -- 172.21.15.148:0/1584500781 learned_addr learned my addr 172.21.15.148:0/1584500781 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.169+0000 7f3cc7e00700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80702d0 0x7f3cc8115be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3cbf400700 1 -- 172.21.15.148:0/1584500781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80702d0 msgr2=0x7f3cc8115be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3cbf400700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80702d0 0x7f3cc8115be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3cbf400700 1 -- 172.21.15.148:0/1584500781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb8009940 con 0x7f3cc8070be0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3cbf400700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc8070be0 0x7f3cc8116120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0002a50 tx=0x7f3cb00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3cc4c00700 1 -- 172.21.15.148:0/1584500781 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb0007cc0 con 0x7f3cc8070be0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3cc4c00700 1 -- 172.21.15.148:0/1584500781 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3cb000f040 con 0x7f3cc8070be0 2024-02-28T16:21:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3cc4c00700 1 -- 172.21.15.148:0/1584500781 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cb0009640 con 0x7f3cc8070be0 2024-02-28T16:21:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc810fd80 con 0x7f3cc8070be0 2024-02-28T16:21:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.170+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc81102c0 con 0x7f3cc8070be0 2024-02-28T16:21:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.171+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc81067a0 con 0x7f3cc8070be0 2024-02-28T16:21:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.172+0000 7f3cc4c00700 1 -- 172.21.15.148:0/1584500781 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3cb00097a0 con 0x7f3cc8070be0 2024-02-28T16:21:43.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.173+0000 7f3cc4c00700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3cac0692a0 0x7f3cac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:43.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.173+0000 7f3cc4c00700 1 -- 172.21.15.148:0/1584500781 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3cb0086c10 con 0x7f3cc8070be0 2024-02-28T16:21:43.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.173+0000 7f3cc7e00700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3cac0692a0 0x7f3cac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:43.164 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.174+0000 7f3cc7e00700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3cac0692a0 0x7f3cac06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8003400 tx=0x7f3cb8004d10 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:43.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.178+0000 7f3cc4c00700 1 -- 172.21.15.148:0/1584500781 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3cb0056c70 con 0x7f3cc8070be0 2024-02-28T16:21:43.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.388+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3cc805f5c0 con 0x7f3cc8070be0 2024-02-28T16:21:43.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.388+0000 7f3cc4c00700 1 -- 172.21.15.148:0/1584500781 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3cb0056800 con 0x7f3cc8070be0 2024-02-28T16:21:43.379 INFO:teuthology.orchestra.run.smithi148.stdout:167503724558 2024-02-28T16:21:43.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3cac0692a0 msgr2=0x7f3cac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:43.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3cac0692a0 0x7f3cac06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8003400 tx=0x7f3cb8004d10 comp rx=0 tx=0).stop 2024-02-28T16:21:43.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc8070be0 msgr2=0x7f3cc8116120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:43.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc8070be0 0x7f3cc8116120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0002a50 tx=0x7f3cb00046b0 comp rx=0 tx=0).stop 2024-02-28T16:21:43.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 shutdown_connections 2024-02-28T16:21:43.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3cac0692a0 0x7f3cac06b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:43.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3cc80702d0 0x7f3cc8115be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:43.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 --2- 172.21.15.148:0/1584500781 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3cc8070be0 0x7f3cc8116120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:43.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.391+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 >> 172.21.15.148:0/1584500781 conn(0x7f3cc80f88e0 msgr2=0x7f3cc8103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:43.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.392+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 shutdown_connections 2024-02-28T16:21:43.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:43.392+0000 7f3ccd800700 1 -- 172.21.15.148:0/1584500781 wait complete. 2024-02-28T16:21:43.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:43 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1584500781' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T16:21:44.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:43 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1584500781' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T16:21:44.302 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724555 got 167503724558 for osd.5 2024-02-28T16:21:44.303 DEBUG:teuthology.parallel:result is None 2024-02-28T16:21:44.303 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-28T16:21:44.303 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T16:21:44.782 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:45 smithi148 ceph-mon[28767]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:45 smithi157 ceph-mon[38346]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:46.923 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:46 smithi148 ceph-mon[28767]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.092+0000 7f40c2800700 1 -- 172.21.15.148:0/3178059190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc070bc0 msgr2=0x7f40bc1092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.092+0000 7f40c2800700 1 --2- 172.21.15.148:0/3178059190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc070bc0 0x7f40bc1092e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f40a8004940 tx=0x7f40a8009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.092+0000 7f40c2800700 1 -- 172.21.15.148:0/3178059190 shutdown_connections 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.092+0000 7f40c2800700 1 --2- 172.21.15.148:0/3178059190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc070bc0 0x7f40bc1092e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.092+0000 7f40c2800700 1 --2- 172.21.15.148:0/3178059190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc0702b0 0x7f40bc070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.092+0000 7f40c2800700 1 -- 172.21.15.148:0/3178059190 >> 172.21.15.148:0/3178059190 conn(0x7f40bc0f8ae0 msgr2=0x7f40bc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.092+0000 7f40c2800700 1 -- 172.21.15.148:0/3178059190 shutdown_connections 2024-02-28T16:21:47.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.093+0000 7f40c2800700 1 -- 172.21.15.148:0/3178059190 wait complete. 2024-02-28T16:21:47.084 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.093+0000 7f40c2800700 1 Processor -- start 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.093+0000 7f40c2800700 1 -- start start 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40c2800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc0702b0 0x7f40bc115e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40c2800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc1163d0 0x7f40bc10fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40c2800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc116950 con 0x7f40bc1163d0 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40c2800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc116ac0 con 0x7f40bc0702b0 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40baa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc1163d0 0x7f40bc10fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40baa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc1163d0 0x7f40bc10fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33178/0 (socket says 172.21.15.148:33178) 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40baa00700 1 -- 172.21.15.148:0/4087043166 learned_addr learned my addr 172.21.15.148:0/4087043166 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.094+0000 7f40bb400700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc0702b0 0x7f40bc115e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40baa00700 1 -- 172.21.15.148:0/4087043166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc0702b0 msgr2=0x7f40bc115e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40baa00700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc0702b0 0x7f40bc115e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40baa00700 1 -- 172.21.15.148:0/4087043166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a8005040 con 0x7f40bc1163d0 2024-02-28T16:21:47.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40baa00700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc1163d0 0x7f40bc10fd30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009fd0 tx=0x7f40a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:47.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40b3400700 1 -- 172.21.15.148:0/4087043166 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a800e040 con 0x7f40bc1163d0 2024-02-28T16:21:47.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40b3400700 1 -- 172.21.15.148:0/4087043166 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40a8004290 con 0x7f40bc1163d0 2024-02-28T16:21:47.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc110330 con 0x7f40bc1163d0 2024-02-28T16:21:47.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40b3400700 1 -- 172.21.15.148:0/4087043166 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40a801c3f0 con 0x7f40bc1163d0 2024-02-28T16:21:47.086 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.095+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc110870 con 0x7f40bc1163d0 2024-02-28T16:21:47.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.097+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc1069a0 con 0x7f40bc1163d0 2024-02-28T16:21:47.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.097+0000 7f40b3400700 1 -- 172.21.15.148:0/4087043166 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f40a8013420 con 0x7f40bc1163d0 2024-02-28T16:21:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.098+0000 7f40b3400700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f40a00692b0 0x7f40a006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:47.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.098+0000 7f40b3400700 1 -- 172.21.15.148:0/4087043166 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f40a80881f0 con 0x7f40bc1163d0 2024-02-28T16:21:47.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.099+0000 7f40bb400700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f40a00692b0 0x7f40a006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:47.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.099+0000 7f40bb400700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f40a00692b0 0x7f40a006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f40ac004990 tx=0x7f40ac009ee0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:47.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.103+0000 7f40b3400700 1 -- 172.21.15.148:0/4087043166 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f40a8058250 con 0x7f40bc1163d0 2024-02-28T16:21:47.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:46 smithi157 ceph-mon[38346]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:47.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.306+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40bc04bed0 con 0x7f40a00692b0 2024-02-28T16:21:47.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.311+0000 7f40b3400700 1 -- 172.21.15.148:0/4087043166 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27293 (secure 0 0 0) 0x7f40bc04bed0 con 0x7f40a00692b0 2024-02-28T16:21:47.302 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f40a00692b0 msgr2=0x7f40a006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f40a00692b0 0x7f40a006b760 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f40ac004990 tx=0x7f40ac009ee0 comp rx=0 tx=0).stop 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc1163d0 msgr2=0x7f40bc10fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc1163d0 0x7f40bc10fd30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009fd0 tx=0x7f40a8009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 shutdown_connections 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f40a00692b0 0x7f40a006b760 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f40bc0702b0 0x7f40bc115e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 --2- 172.21.15.148:0/4087043166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f40bc1163d0 0x7f40bc10fd30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:47.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 >> 172.21.15.148:0/4087043166 conn(0x7f40bc0f8ae0 msgr2=0x7f40bc103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:47.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 shutdown_connections 2024-02-28T16:21:47.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:47.314+0000 7f40c2800700 1 -- 172.21.15.148:0/4087043166 wait complete. 2024-02-28T16:21:47.305 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-02-28T16:21:47.983 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:47 smithi148 ceph-mon[28767]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:21:47.983 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:47 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:48.238 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-02-28T16:21:45.905097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003224"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-28T16:20:42.780424+0000","last_change":"2024-02-28T16:20:06.785650+0000","last_active":"2024-02-28T16:20:42.780424+0000","last_peered":"2024-02-28T16:20:42.780424+0000","last_clean":"2024-02-28T16:20:42.780424+0000","last_became_active":"2024-02-28T16:20:06.785232+0000","last_became_peered":"2024-02-28T16:20:06.785232+0000","last_unstale":"2024-02-28T16:20:42.780424+0000","last_undegraded":"2024-02-28T16:20:42.780424+0000","last_fullsized":"2024-02-28T16:20:42.780424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T16:18:56.936492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T16:18:56.936492+0000","last_clean_scrub_stamp":"2024-02-28T16:18:56.936492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-29T19:29:48.413933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":4,"up_from":34,"seq":146028888087,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.246}]},{"osd":1,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.3129999999999999}]},{"osd":2,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":1.03},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.0900000000000001}]},{"osd":3,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":3,"up_from":26,"seq":111669149726,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.97399999999999998,"15min":0.96599999999999997},"min":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2969999999999999,"5min":1.339,"15min":1.339},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0329999999999999,"15min":1.0229999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3919999999999999,"5min":1.417,"15min":1.417},"last":1.0169999999999999}]},{"osd":1,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.056,"15min":1.044},"min":{"1min":0.72999999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.179},{"interface":"front","average":{"1min":1.103,"5min":1.089,"15min":1.087},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.97799999999999998}]},{"osd":2,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0209999999999999,"15min":1.0069999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.1399999999999999,"15min":1.1299999999999999},"min":{"1min":0.80400000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Feb 28 16:21:10 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.54700000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2170000000000001,"5min":1.607,"15min":1.607},"last":1.196}]},{"osd":1,"last update":"Wed Feb 28 16:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93000000000000005,"15min":0.92600000000000005},"min":{"1min":0.63500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":0.98699999999999999},"min":{"1min":0.59399999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":1.073}]},{"osd":3,"last update":"Wed Feb 28 16:21:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1060000000000001,"15min":1.091},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.782,"5min":3.782,"15min":3.782},"last":1.472},{"interface":"front","average":{"1min":1.296,"5min":1.177,"15min":1.157},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.145}]},{"osd":4,"last update":"Wed Feb 28 16:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.3360000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]}]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 16:21:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.71299999999999997,"15min":0.65300000000000002},"min":{"1min":0.69599999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.78300000000000003,"15min":0.71699999999999997},"min":{"1min":0.59499999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1739999999999999,"5min":1.522,"15min":1.522},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Feb 28 16:21:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.96099999999999997,"15min":0.94699999999999995},"min":{"1min":0.78700000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.425,"5min":1.462,"15min":1.462},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.91900000000000004,"15min":0.90700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.036}]},{"osd":3,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1859999999999999,"15min":1.196},"min":{"1min":0.82799999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.407,"5min":3.379,"15min":3.379},"last":1.196},{"interface":"front","average":{"1min":1.131,"5min":1.083,"15min":1.075},"min":{"1min":0.89500000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.446}]},{"osd":4,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":1.236}]},{"osd":5,"last update":"Wed Feb 28 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.254},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.159}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:21:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.77000000000000002,"15min":0.69799999999999995},"min":{"1min":0.57299999999999995,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2250000000000001,"5min":3.7770000000000001,"15min":3.7770000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83199999999999996,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.375,"15min":0.375},"max":{"1min":1.609,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.94599999999999995}]},{"osd":2,"last update":"Wed Feb 28 16:21:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.052,"15min":1.05},"min":{"1min":0.749,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.802,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.9359999999999999,"5min":3.827,"15min":3.827},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Feb 28 16:21:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1839999999999999,"15min":1.1870000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.647,"5min":3.629,"15min":3.629},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7310000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.123}]},{"osd":4,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.244},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T16:21:48.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T16:21:48.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:47 smithi157 ceph-mon[38346]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:21:48.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:47 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:21:48.685 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:49.049 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:48 smithi148 ceph-mon[28767]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:49.049 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:49.049 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:49.049 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:48 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:21:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:48 smithi157 ceph-mon[38346]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:49.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:21:49.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:21:49.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:48 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:21:50.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:50 smithi148 ceph-mon[28767]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 -- 172.21.15.148:0/3799392168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fe900 msgr2=0x7f217c106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 --2- 172.21.15.148:0/3799392168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fe900 0x7f217c106f40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2168004940 tx=0x7f2168009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 -- 172.21.15.148:0/3799392168 shutdown_connections 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 --2- 172.21.15.148:0/3799392168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fe900 0x7f217c106f40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 --2- 172.21.15.148:0/3799392168 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217c0fdf60 0x7f217c0fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 -- 172.21.15.148:0/3799392168 >> 172.21.15.148:0/3799392168 conn(0x7f217c0f7a10 msgr2=0x7f217c0f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 -- 172.21.15.148:0/3799392168 shutdown_connections 2024-02-28T16:21:51.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.151+0000 7f2181200700 1 -- 172.21.15.148:0/3799392168 wait complete. 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.153+0000 7f2181200700 1 Processor -- start 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.153+0000 7f2181200700 1 -- start start 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.153+0000 7f2181200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fdf60 0x7f217c115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.153+0000 7f2181200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217c0fe900 0x7f217c1161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.153+0000 7f2181200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c116810 con 0x7f217c0fdf60 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.153+0000 7f2181200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c10fb40 con 0x7f217c0fe900 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.154+0000 7f2179e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fdf60 0x7f217c115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:51.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.154+0000 7f2179e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fdf60 0x7f217c115c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33192/0 (socket says 172.21.15.148:33192) 2024-02-28T16:21:51.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.154+0000 7f2179e00700 1 -- 172.21.15.148:0/4155954825 learned_addr learned my addr 172.21.15.148:0/4155954825 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:51.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.154+0000 7f2179400700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217c0fe900 0x7f217c1161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:51.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.154+0000 7f2179e00700 1 -- 172.21.15.148:0/4155954825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217c0fe900 msgr2=0x7f217c1161c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:51.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.154+0000 7f2179e00700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217c0fe900 0x7f217c1161c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:51.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.154+0000 7f2179e00700 1 -- 172.21.15.148:0/4155954825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168005040 con 0x7f217c0fdf60 2024-02-28T16:21:51.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.155+0000 7f2179e00700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fdf60 0x7f217c115c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c830 tx=0x7f216c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:51.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.155+0000 7f2172000700 1 -- 172.21.15.148:0/4155954825 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f216c00a760 con 0x7f217c0fdf60 2024-02-28T16:21:51.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.155+0000 7f2172000700 1 -- 172.21.15.148:0/4155954825 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f216c00ad90 con 0x7f217c0fdf60 2024-02-28T16:21:51.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.155+0000 7f2172000700 1 -- 172.21.15.148:0/4155954825 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f216c0113a0 con 0x7f217c0fdf60 2024-02-28T16:21:51.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.155+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c10fe20 con 0x7f217c0fdf60 2024-02-28T16:21:51.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.155+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c110360 con 0x7f217c0fdf60 2024-02-28T16:21:51.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.156+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c1069b0 con 0x7f217c0fdf60 2024-02-28T16:21:51.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.157+0000 7f2172000700 1 -- 172.21.15.148:0/4155954825 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f216c012400 con 0x7f217c0fdf60 2024-02-28T16:21:51.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.158+0000 7f2172000700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f21600692b0 0x7f216006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:51.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.158+0000 7f2172000700 1 -- 172.21.15.148:0/4155954825 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f216c086ec0 con 0x7f217c0fdf60 2024-02-28T16:21:51.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.158+0000 7f2179400700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f21600692b0 0x7f216006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:51.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.159+0000 7f2179400700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f21600692b0 0x7f216006b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f217c1114b0 tx=0x7f2168009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:51.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.163+0000 7f2172000700 1 -- 172.21.15.148:0/4155954825 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f216c056fa0 con 0x7f217c0fdf60 2024-02-28T16:21:51.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:50 smithi157 ceph-mon[38346]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:51.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.367+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f217c04bf40 con 0x7f21600692b0 2024-02-28T16:21:51.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.370+0000 7f2172000700 1 -- 172.21.15.148:0/4155954825 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30111 (secure 0 0 0) 0x7f217c04bf40 con 0x7f21600692b0 2024-02-28T16:21:51.361 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:21:51.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f21600692b0 msgr2=0x7f216006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:51.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f21600692b0 0x7f216006b760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f217c1114b0 tx=0x7f2168009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fdf60 msgr2=0x7f217c115c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fdf60 0x7f217c115c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c830 tx=0x7f216c004470 comp rx=0 tx=0).stop 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 shutdown_connections 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f217c0fdf60 0x7f217c115c80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f21600692b0 0x7f216006b760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 --2- 172.21.15.148:0/4155954825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f217c0fe900 0x7f217c1161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 >> 172.21.15.148:0/4155954825 conn(0x7f217c0f7a10 msgr2=0x7f217c0fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 shutdown_connections 2024-02-28T16:21:51.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:51.373+0000 7f2181200700 1 -- 172.21.15.148:0/4155954825 wait complete. 2024-02-28T16:21:51.365 INFO:teuthology.orchestra.run.smithi148.stderr:dumped all 2024-02-28T16:21:52.099 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:51 smithi148 ceph-mon[28767]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:21:52.177 INFO:teuthology.orchestra.run.smithi148.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-02-28T16:21:49.906329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787604,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":1783680,"kb_avail":560683308,"statfs":{"total":575970213888,"available":574139707392,"internally_reserved":0,"allocated":3969024,"data_stored":2606262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1826488320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003571"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-28T16:20:42.780424+0000","last_change":"2024-02-28T16:20:06.785650+0000","last_active":"2024-02-28T16:20:42.780424+0000","last_peered":"2024-02-28T16:20:42.780424+0000","last_clean":"2024-02-28T16:20:42.780424+0000","last_became_active":"2024-02-28T16:20:06.785232+0000","last_became_peered":"2024-02-28T16:20:06.785232+0000","last_unstale":"2024-02-28T16:20:42.780424+0000","last_undegraded":"2024-02-28T16:20:42.780424+0000","last_fullsized":"2024-02-28T16:20:42.780424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T16:18:56.936492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T16:18:56.936492+0000","last_clean_scrub_stamp":"2024-02-28T16:18:56.936492+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-29T19:29:48.413933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:21:46 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.745},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.0189999999999999}]},{"osd":1,"last update":"Wed Feb 28 16:21:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.0940000000000001}]},{"osd":2,"last update":"Wed Feb 28 16:21:46 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.954,"5min":1.954,"15min":1.954},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.266}]},{"osd":3,"last update":"Wed Feb 28 16:21:46 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.1359999999999999}]},{"osd":4,"last update":"Wed Feb 28 16:21:46 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.87},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.94199999999999995}]}]},{"osd":4,"up_from":34,"seq":146028888088,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.244},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.21}]},{"osd":1,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"last":1.091}]},{"osd":2,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.91800000000000004}]},{"osd":3,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.155},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.3540000000000001}]},{"osd":5,"last update":"Wed Feb 28 16:21:44 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":1.286},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":1.704,"5min":1.704,"15min":1.704},"last":1.46}]}]},{"osd":3,"up_from":26,"seq":111669149726,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.97399999999999998,"15min":0.96599999999999997},"min":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.2969999999999999,"5min":1.339,"15min":1.339},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0329999999999999,"15min":1.0229999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3919999999999999,"5min":1.417,"15min":1.417},"last":1.0169999999999999}]},{"osd":1,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.056,"15min":1.044},"min":{"1min":0.72999999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.179},{"interface":"front","average":{"1min":1.103,"5min":1.089,"15min":1.087},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.97799999999999998}]},{"osd":2,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.0209999999999999,"15min":1.0069999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.1399999999999999,"15min":1.1299999999999999},"min":{"1min":0.80400000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":1.071}]},{"osd":4,"last update":"Wed Feb 28 16:21:10 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93447508,"statfs":{"total":95995035648,"available":95690248192,"internally_reserved":0,"allocated":364544,"data_stored":139193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.54700000000000004,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.2170000000000001,"5min":1.607,"15min":1.607},"last":0.98799999999999999}]},{"osd":1,"last update":"Wed Feb 28 16:20:56 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93000000000000005,"15min":0.92600000000000005},"min":{"1min":0.63500000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97799999999999998,"15min":0.98699999999999999},"min":{"1min":0.59399999999999997,"5min":0.377,"15min":0.377},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.92400000000000004}]},{"osd":3,"last update":"Wed Feb 28 16:21:31 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1060000000000001,"15min":1.091},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.782,"5min":3.782,"15min":3.782},"last":1.115},{"interface":"front","average":{"1min":1.296,"5min":1.177,"15min":1.157},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.8439999999999999,"5min":3.8439999999999999,"15min":3.8439999999999999},"last":1.052}]},{"osd":4,"last update":"Wed Feb 28 16:21:09 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.1579999999999999}]},{"osd":5,"last update":"Wed Feb 28 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":5.3970000000000002,"5min":5.3970000000000002,"15min":5.3970000000000002},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":1.208}]}]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 16:21:21 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.71299999999999997,"15min":0.65300000000000002},"min":{"1min":0.69599999999999995,"5min":0.377,"15min":0.377},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.78300000000000003,"15min":0.71699999999999997},"min":{"1min":0.59499999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1739999999999999,"5min":1.522,"15min":1.522},"last":0.89800000000000002}]},{"osd":2,"last update":"Wed Feb 28 16:21:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":0.96099999999999997,"15min":0.94699999999999995},"min":{"1min":0.78700000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.425,"5min":1.462,"15min":1.462},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.91900000000000004,"15min":0.90700000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.036}]},{"osd":3,"last update":"Wed Feb 28 16:21:35 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1859999999999999,"15min":1.196},"min":{"1min":0.82799999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.407,"5min":3.379,"15min":3.379},"last":1.196},{"interface":"front","average":{"1min":1.131,"5min":1.083,"15min":1.075},"min":{"1min":0.89500000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.446}]},{"osd":4,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"last":1.236}]},{"osd":5,"last update":"Wed Feb 28 16:21:45 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.254},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.159}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":93446928,"statfs":{"total":95995035648,"available":95689654272,"internally_reserved":0,"allocated":958464,"data_stored":729561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 16:21:23 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.77000000000000002,"15min":0.69799999999999995},"min":{"1min":0.57299999999999995,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2250000000000001,"5min":3.7770000000000001,"15min":3.7770000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.83199999999999996,"15min":0.76000000000000001},"min":{"1min":0.622,"5min":0.375,"15min":0.375},"max":{"1min":1.609,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.94599999999999995}]},{"osd":2,"last update":"Wed Feb 28 16:21:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.052,"15min":1.05},"min":{"1min":0.749,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.802,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.101,"5min":1.0760000000000001,"15min":1.0720000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.9359999999999999,"5min":3.827,"15min":3.827},"last":0.59699999999999998}]},{"osd":3,"last update":"Wed Feb 28 16:21:32 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1839999999999999,"15min":1.1870000000000001},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.647,"5min":3.629,"15min":3.629},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7310000000000001,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.123}]},{"osd":4,"last update":"Wed Feb 28 16:21:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.244},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T16:21:52.178 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-28T16:21:52.178 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-28T16:21:52.178 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-28T16:21:52.178 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph health --format=json 2024-02-28T16:21:52.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:51 smithi157 ceph-mon[38346]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T16:21:52.648 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:53.043 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:52 smithi148 ceph-mon[28767]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:53.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:52 smithi157 ceph-mon[38346]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:54.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 -- 172.21.15.148:0/4101767565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc0fb5b0 msgr2=0x7faebc0fba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:54.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 --2- 172.21.15.148:0/4101767565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc0fb5b0 0x7faebc0fba20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faea8004940 tx=0x7faea8009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:54.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 -- 172.21.15.148:0/4101767565 shutdown_connections 2024-02-28T16:21:54.862 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 --2- 172.21.15.148:0/4101767565 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc0fb5b0 0x7faebc0fba20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:54.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 --2- 172.21.15.148:0/4101767565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc103050 0x7faebc103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:54.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 -- 172.21.15.148:0/4101767565 >> 172.21.15.148:0/4101767565 conn(0x7faebc071560 msgr2=0x7faebc071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:54.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 -- 172.21.15.148:0/4101767565 shutdown_connections 2024-02-28T16:21:54.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.871+0000 7faec1e00700 1 -- 172.21.15.148:0/4101767565 wait complete. 2024-02-28T16:21:54.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.872+0000 7faec1e00700 1 Processor -- start 2024-02-28T16:21:54.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.872+0000 7faec1e00700 1 -- start start 2024-02-28T16:21:54.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.873+0000 7faec1e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fb5b0 0x7faebc0fc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.873+0000 7faec1e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc103050 0x7faebc0fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.873+0000 7faec1e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0fd2d0 con 0x7faebc103050 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.873+0000 7faec1e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc0fd440 con 0x7faebc0fb5b0 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.873+0000 7faeba000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc103050 0x7faebc0fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.873+0000 7faeba000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc103050 0x7faebc0fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50058/0 (socket says 172.21.15.148:50058) 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.873+0000 7faeba000700 1 -- 172.21.15.148:0/813813618 learned_addr learned my addr 172.21.15.148:0/813813618 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faebaa00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fb5b0 0x7faebc0fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faeba000700 1 -- 172.21.15.148:0/813813618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fb5b0 msgr2=0x7faebc0fc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faeba000700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fb5b0 0x7faebc0fc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faeba000700 1 -- 172.21.15.148:0/813813618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8005040 con 0x7faebc103050 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faeba000700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc103050 0x7faebc0fccd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faea8009fd0 tx=0x7faea8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:54.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faeb2a00700 1 -- 172.21.15.148:0/813813618 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea800e040 con 0x7faebc103050 2024-02-28T16:21:54.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faeb2a00700 1 -- 172.21.15.148:0/813813618 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faea800bbf0 con 0x7faebc103050 2024-02-28T16:21:54.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.874+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc119d10 con 0x7faebc103050 2024-02-28T16:21:54.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.875+0000 7faeb2a00700 1 -- 172.21.15.148:0/813813618 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea801c3f0 con 0x7faebc103050 2024-02-28T16:21:54.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.875+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc11a170 con 0x7faebc103050 2024-02-28T16:21:54.866 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.876+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc100350 con 0x7faebc103050 2024-02-28T16:21:54.867 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.877+0000 7faeb2a00700 1 -- 172.21.15.148:0/813813618 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7faea800bd60 con 0x7faebc103050 2024-02-28T16:21:54.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.878+0000 7faeb2a00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7faea00692b0 0x7faea006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:54.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.878+0000 7faeb2a00700 1 -- 172.21.15.148:0/813813618 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7faea8088160 con 0x7faebc103050 2024-02-28T16:21:54.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.878+0000 7faebaa00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7faea00692b0 0x7faea006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:54.869 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.879+0000 7faebaa00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7faea00692b0 0x7faea006b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faeac007fd0 tx=0x7faeac009040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:54.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:54.883+0000 7faeb2a00700 1 -- 172.21.15.148:0/813813618 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7faea80547b0 con 0x7faebc103050 2024-02-28T16:21:55.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.134+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faebc073080 con 0x7faebc103050 2024-02-28T16:21:55.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.135+0000 7faeb2a00700 1 -- 172.21.15.148:0/813813618 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7faea8057dd0 con 0x7faebc103050 2024-02-28T16:21:55.125 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:21:55.125 INFO:teuthology.orchestra.run.smithi148.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-28T16:21:55.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.137+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7faea00692b0 msgr2=0x7faea006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:55.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.137+0000 7faec1e00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7faea00692b0 0x7faea006b760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faeac007fd0 tx=0x7faeac009040 comp rx=0 tx=0).stop 2024-02-28T16:21:55.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.137+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc103050 msgr2=0x7faebc0fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:55.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.137+0000 7faec1e00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc103050 0x7faebc0fccd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faea8009fd0 tx=0x7faea8009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:55.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.138+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 shutdown_connections 2024-02-28T16:21:55.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.138+0000 7faec1e00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7faea00692b0 0x7faea006b760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:55.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.138+0000 7faec1e00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faebc0fb5b0 0x7faebc0fc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:55.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.138+0000 7faec1e00700 1 --2- 172.21.15.148:0/813813618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faebc103050 0x7faebc0fccd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:55.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.138+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 >> 172.21.15.148:0/813813618 conn(0x7faebc071560 msgr2=0x7faebc0fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:55.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.138+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 shutdown_connections 2024-02-28T16:21:55.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:55.138+0000 7faec1e00700 1 -- 172.21.15.148:0/813813618 wait complete. 2024-02-28T16:21:55.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:54 smithi157 ceph-mon[38346]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:55.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:54 smithi148 ceph-mon[28767]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:56.051 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-28T16:21:56.052 INFO:tasks.cephadm:Setup complete, yielding 2024-02-28T16:21:56.052 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:21:56.061 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-02-28T16:21:56.061 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:21:56.111 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:21:56.112 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-28T16:21:56.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:55 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/813813618' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T16:21:56.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:56.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:55 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/813813618' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T16:21:56.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:21:56.585 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:21:57.087 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:56 smithi148 ceph-mon[28767]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:57.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:56 smithi157 ceph-mon[38346]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 -- 172.21.15.148:0/680028980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 msgr2=0x7f18780fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 --2- 172.21.15.148:0/680028980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18780fe550 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1864004940 tx=0x7f1864009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 -- 172.21.15.148:0/680028980 shutdown_connections 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 --2- 172.21.15.148:0/680028980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18780fe550 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 --2- 172.21.15.148:0/680028980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18780fcef0 0x7f18780fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 -- 172.21.15.148:0/680028980 >> 172.21.15.148:0/680028980 conn(0x7f18780f8620 msgr2=0x7f18780faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 -- 172.21.15.148:0/680028980 shutdown_connections 2024-02-28T16:21:59.104 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.113+0000 7f187fa00700 1 -- 172.21.15.148:0/680028980 wait complete. 2024-02-28T16:21:59.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.114+0000 7f187fa00700 1 Processor -- start 2024-02-28T16:21:59.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.114+0000 7f187fa00700 1 -- start start 2024-02-28T16:21:59.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f187fa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18780fcef0 0x7f187810fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:59.105 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f187fa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18781100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:59.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f187fa00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18781106a0 con 0x7f18780fe0e0 2024-02-28T16:21:59.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f187fa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1878110f40 con 0x7f18780fcef0 2024-02-28T16:21:59.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f1877e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18781100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:59.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f1877e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18781100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50076/0 (socket says 172.21.15.148:50076) 2024-02-28T16:21:59.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f1877e00700 1 -- 172.21.15.148:0/3772770566 learned_addr learned my addr 172.21.15.148:0/3772770566 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:21:59.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f187d000700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18780fcef0 0x7f187810fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f1877e00700 1 -- 172.21.15.148:0/3772770566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18780fcef0 msgr2=0x7f187810fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.115+0000 7f1877e00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18780fcef0 0x7f187810fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.116+0000 7f1877e00700 1 -- 172.21.15.148:0/3772770566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864005040 con 0x7f18780fe0e0 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.116+0000 7f1877e00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18781100a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f186400b3b0 tx=0x7f1864009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.116+0000 7f1874c00700 1 -- 172.21.15.148:0/3772770566 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f186400e040 con 0x7f18780fe0e0 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.116+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18781111c0 con 0x7f18780fe0e0 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.116+0000 7f1874c00700 1 -- 172.21.15.148:0/3772770566 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f186400bd90 con 0x7f18780fe0e0 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.116+0000 7f1874c00700 1 -- 172.21.15.148:0/3772770566 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f186401c630 con 0x7f18780fe0e0 2024-02-28T16:21:59.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.116+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878111700 con 0x7f18780fe0e0 2024-02-28T16:21:59.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.117+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1878102210 con 0x7f18780fe0e0 2024-02-28T16:21:59.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.118+0000 7f1874c00700 1 -- 172.21.15.148:0/3772770566 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f18640139f0 con 0x7f18780fe0e0 2024-02-28T16:21:59.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.120+0000 7f1874c00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18600692b0 0x7f186006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:21:59.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.120+0000 7f1874c00700 1 -- 172.21.15.148:0/3772770566 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1864088390 con 0x7f18780fe0e0 2024-02-28T16:21:59.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.120+0000 7f187d000700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18600692b0 0x7f186006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:21:59.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.121+0000 7f187d000700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18600692b0 0x7f186006b760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f186c007fd0 tx=0x7f186c009040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:21:59.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.124+0000 7f1874c00700 1 -- 172.21.15.148:0/3772770566 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1864058520 con 0x7f18780fe0e0 2024-02-28T16:21:59.204 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:21:58 smithi148 ceph-mon[28767]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:59.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:21:58 smithi157 ceph-mon[38346]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:21:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.335+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f187804bed0 con 0x7f18780fe0e0 2024-02-28T16:21:59.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.348+0000 7f1874c00700 1 -- 172.21.15.148:0/3772770566 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f18640580b0 con 0x7f18780fe0e0 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.350+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18600692b0 msgr2=0x7f186006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.350+0000 7f187fa00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18600692b0 0x7f186006b760 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f186c007fd0 tx=0x7f186c009040 comp rx=0 tx=0).stop 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.350+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 msgr2=0x7f18781100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.350+0000 7f187fa00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18781100a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f186400b3b0 tx=0x7f1864009e30 comp rx=0 tx=0).stop 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.351+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 shutdown_connections 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.351+0000 7f187fa00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18600692b0 0x7f186006b760 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.351+0000 7f187fa00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18780fcef0 0x7f187810fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.351+0000 7f187fa00700 1 --2- 172.21.15.148:0/3772770566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18780fe0e0 0x7f18781100a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.351+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 >> 172.21.15.148:0/3772770566 conn(0x7f18780f8620 msgr2=0x7f18780ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.351+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 shutdown_connections 2024-02-28T16:21:59.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:21:59.351+0000 7f187fa00700 1 -- 172.21.15.148:0/3772770566 wait complete. 2024-02-28T16:22:00.425 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:22:00.435 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-28T16:22:00.435 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:22:00.494 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:22:00.494 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph orch status' 2024-02-28T16:22:00.588 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:00 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3772770566' entity='client.admin' 2024-02-28T16:22:00.588 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:00.588 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:00.588 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:22:00.588 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:00 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:00.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:00 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3772770566' entity='client.admin' 2024-02-28T16:22:00.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:00.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:00.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:22:00.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:00 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:00.975 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:01.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:01 smithi148 ceph-mon[28767]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:01.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:01 smithi157 ceph-mon[38346]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 -- 172.21.15.148:0/2668703044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 msgr2=0x7f98d00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 --2- 172.21.15.148:0/2668703044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d00fe550 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f98b8004940 tx=0x7f98b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 -- 172.21.15.148:0/2668703044 shutdown_connections 2024-02-28T16:22:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 --2- 172.21.15.148:0/2668703044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d00fe550 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:03.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 --2- 172.21.15.148:0/2668703044 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98d00fcef0 0x7f98d00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 -- 172.21.15.148:0/2668703044 >> 172.21.15.148:0/2668703044 conn(0x7f98d00f8620 msgr2=0x7f98d00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 -- 172.21.15.148:0/2668703044 shutdown_connections 2024-02-28T16:22:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.302+0000 7f98d6600700 1 -- 172.21.15.148:0/2668703044 wait complete. 2024-02-28T16:22:03.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.304+0000 7f98d6600700 1 Processor -- start 2024-02-28T16:22:03.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.304+0000 7f98d6600700 1 -- start start 2024-02-28T16:22:03.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98d6600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98d00fcef0 0x7f98d010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:03.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98d6600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:03.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98d6600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d010e540 con 0x7f98d00fe0e0 2024-02-28T16:22:03.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98d6600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d010ed80 con 0x7f98d00fcef0 2024-02-28T16:22:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98c6a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98c6a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d010deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54314/0 (socket says 172.21.15.148:54314) 2024-02-28T16:22:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98c6a00700 1 -- 172.21.15.148:0/3494009530 learned_addr learned my addr 172.21.15.148:0/3494009530 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98cf400700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98d00fcef0 0x7f98d010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98c6a00700 1 -- 172.21.15.148:0/3494009530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98d00fcef0 msgr2=0x7f98d010d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98c6a00700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98d00fcef0 0x7f98d010d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:03.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98c6a00700 1 -- 172.21.15.148:0/3494009530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8005040 con 0x7f98d00fe0e0 2024-02-28T16:22:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.305+0000 7f98cf400700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98d00fcef0 0x7f98d010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:22:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.306+0000 7f98c6a00700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d010deb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f98b800b3b0 tx=0x7f98b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.306+0000 7f98c7e00700 1 -- 172.21.15.148:0/3494009530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b800e040 con 0x7f98d00fe0e0 2024-02-28T16:22:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.306+0000 7f98c7e00700 1 -- 172.21.15.148:0/3494009530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98b800bd90 con 0x7f98d00fe0e0 2024-02-28T16:22:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.306+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d010f000 con 0x7f98d00fe0e0 2024-02-28T16:22:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.306+0000 7f98c7e00700 1 -- 172.21.15.148:0/3494009530 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b801c630 con 0x7f98d00fe0e0 2024-02-28T16:22:03.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.306+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d010f540 con 0x7f98d00fe0e0 2024-02-28T16:22:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.308+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d004bed0 con 0x7f98d00fe0e0 2024-02-28T16:22:03.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.308+0000 7f98c7e00700 1 -- 172.21.15.148:0/3494009530 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f98b80139f0 con 0x7f98d00fe0e0 2024-02-28T16:22:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.309+0000 7f98c7e00700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f98b40692b0 0x7f98b406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.309+0000 7f98c7e00700 1 -- 172.21.15.148:0/3494009530 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f98b8088390 con 0x7f98d00fe0e0 2024-02-28T16:22:03.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.310+0000 7f98cf400700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f98b40692b0 0x7f98b406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:03.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.310+0000 7f98cf400700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f98b40692b0 0x7f98b406b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f98d00fcc30 tx=0x7f98c00074f0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:03.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.314+0000 7f98c7e00700 1 -- 172.21.15.148:0/3494009530 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f98b8058520 con 0x7f98d00fe0e0 2024-02-28T16:22:03.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.541+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98d010fa70 con 0x7f98b40692b0 2024-02-28T16:22:03.531 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:03 smithi148 ceph-mon[28767]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:03.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.543+0000 7f98c7e00700 1 -- 172.21.15.148:0/3494009530 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f98d010fa70 con 0x7f98b40692b0 2024-02-28T16:22:03.534 INFO:teuthology.orchestra.run.smithi148.stdout:Backend: cephadm 2024-02-28T16:22:03.534 INFO:teuthology.orchestra.run.smithi148.stdout:Available: Yes 2024-02-28T16:22:03.534 INFO:teuthology.orchestra.run.smithi148.stdout:Paused: No 2024-02-28T16:22:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f98b40692b0 msgr2=0x7f98b406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f98b40692b0 0x7f98b406b760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f98d00fcc30 tx=0x7f98c00074f0 comp rx=0 tx=0).stop 2024-02-28T16:22:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 msgr2=0x7f98d010deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d010deb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f98b800b3b0 tx=0x7f98b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 shutdown_connections 2024-02-28T16:22:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f98b40692b0 0x7f98b406b760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:03.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f98d00fcef0 0x7f98d010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:03.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 --2- 172.21.15.148:0/3494009530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f98d00fe0e0 0x7f98d010deb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:03.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 >> 172.21.15.148:0/3494009530 conn(0x7f98d00f8620 msgr2=0x7f98d01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:03.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 shutdown_connections 2024-02-28T16:22:03.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:03.546+0000 7f98d6600700 1 -- 172.21.15.148:0/3494009530 wait complete. 2024-02-28T16:22:03.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:03 smithi157 ceph-mon[38346]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:04.348 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-28T16:22:04.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:04 smithi148 ceph-mon[28767]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:04.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:04 smithi157 ceph-mon[38346]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:04.811 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:05.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:05 smithi148 ceph-mon[28767]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:05.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:05 smithi157 ceph-mon[38346]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:06.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.918+0000 7fea55e00700 1 -- 172.21.15.148:0/2803952041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 msgr2=0x7fea500ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.918+0000 7fea55e00700 1 --2- 172.21.15.148:0/2803952041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea500ff560 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea40004940 tx=0x7fea40009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.918+0000 7fea55e00700 1 -- 172.21.15.148:0/2803952041 shutdown_connections 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.918+0000 7fea55e00700 1 --2- 172.21.15.148:0/2803952041 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea50100360 0x7fea501007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.918+0000 7fea55e00700 1 --2- 172.21.15.148:0/2803952041 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea500ff560 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.918+0000 7fea55e00700 1 -- 172.21.15.148:0/2803952041 >> 172.21.15.148:0/2803952041 conn(0x7fea500fa920 msgr2=0x7fea500fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.919+0000 7fea55e00700 1 -- 172.21.15.148:0/2803952041 shutdown_connections 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.919+0000 7fea55e00700 1 -- 172.21.15.148:0/2803952041 wait complete. 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.919+0000 7fea55e00700 1 Processor -- start 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.919+0000 7fea55e00700 1 -- start start 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea55e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea5010fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea55e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea50100360 0x7fea50110200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:06.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea55e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea50110800 con 0x7fea500ff150 2024-02-28T16:22:06.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea55e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea50110f90 con 0x7fea50100360 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea4ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea5010fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea4ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea5010fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54322/0 (socket says 172.21.15.148:54322) 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea4ea00700 1 -- 172.21.15.148:0/982786330 learned_addr learned my addr 172.21.15.148:0/982786330 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.920+0000 7fea4e000700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea50100360 0x7fea50110200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea4ea00700 1 -- 172.21.15.148:0/982786330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea50100360 msgr2=0x7fea50110200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea4ea00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea50100360 0x7fea50110200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea4ea00700 1 -- 172.21.15.148:0/982786330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea40005040 con 0x7fea500ff150 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea4ea00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea5010fcc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea40009390 tx=0x7fea40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea46a00700 1 -- 172.21.15.148:0/982786330 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4000e040 con 0x7fea500ff150 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea46a00700 1 -- 172.21.15.148:0/982786330 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea4000bbf0 con 0x7fea500ff150 2024-02-28T16:22:06.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea50111210 con 0x7fea500ff150 2024-02-28T16:22:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea46a00700 1 -- 172.21.15.148:0/982786330 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4001c630 con 0x7fea500ff150 2024-02-28T16:22:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.921+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea50111750 con 0x7fea500ff150 2024-02-28T16:22:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.923+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5004bed0 con 0x7fea500ff150 2024-02-28T16:22:06.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.923+0000 7fea46a00700 1 -- 172.21.15.148:0/982786330 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fea400139f0 con 0x7fea500ff150 2024-02-28T16:22:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.924+0000 7fea46a00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fea340692b0 0x7fea3406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.924+0000 7fea46a00700 1 -- 172.21.15.148:0/982786330 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fea40088370 con 0x7fea500ff150 2024-02-28T16:22:06.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.925+0000 7fea4e000700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fea340692b0 0x7fea3406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:06.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.925+0000 7fea4e000700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fea340692b0 0x7fea3406b760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0049b0 tx=0x7fea3c009ee0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:06.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:06.930+0000 7fea46a00700 1 -- 172.21.15.148:0/982786330 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fea40058480 con 0x7fea500ff150 2024-02-28T16:22:07.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.147+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea50111c50 con 0x7fea340692b0 2024-02-28T16:22:07.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.172+0000 7fea46a00700 1 -- 172.21.15.148:0/982786330 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7fea50111c50 con 0x7fea340692b0 2024-02-28T16:22:07.162 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:22:07.162 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (5m) 2m ago 7m 13.9M - 0.25.0 c8568f914cd2 1a028b2bba8f 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (7m) 2m ago 7m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (6m) 86s ago 6m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (4m) 2m ago 7m 74.0M - 9.4.7 954c08fa6188 9cb307a9b404 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:9283 running (9m) 2m ago 9m 473M - 17.2.7-535-gc0f02e60 1c37ed371348 0efadaac859c 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (5m) 86s ago 5m 431M - 17.2.7-535-gc0f02e60 1c37ed371348 54778550d5fd 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (9m) 2m ago 9m 41.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (5m) 86s ago 5m 32.7M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (7m) 2m ago 7m 7982k - 1.5.0 0da6a335fe13 1cc6d69049e3 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (5m) 86s ago 5m 7465k - 1.5.0 0da6a335fe13 e10955ca2cb2 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (4m) 2m ago 4m 38.0M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (3m) 2m ago 3m 39.4M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (3m) 2m ago 3m 36.2M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (2m) 86s ago 2m 39.0M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:22:07.163 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (2m) 86s ago 2m 35.8M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:22:07.164 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (91s) 86s ago 91s 10.5M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:22:07.164 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (4m) 2m ago 6m 38.4M - 2.43.0 a07b618ecd1d 92209c2989e2 2024-02-28T16:22:07.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fea340692b0 msgr2=0x7fea3406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:07.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fea340692b0 0x7fea3406b760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0049b0 tx=0x7fea3c009ee0 comp rx=0 tx=0).stop 2024-02-28T16:22:07.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 msgr2=0x7fea5010fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:07.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea5010fcc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea40009390 tx=0x7fea40009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:07.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 shutdown_connections 2024-02-28T16:22:07.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea500ff150 0x7fea5010fcc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:07.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fea340692b0 0x7fea3406b760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:07.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 --2- 172.21.15.148:0/982786330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea50100360 0x7fea50110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:07.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 >> 172.21.15.148:0/982786330 conn(0x7fea500fa920 msgr2=0x7fea50103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:07.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 shutdown_connections 2024-02-28T16:22:07.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:07.175+0000 7fea55e00700 1 -- 172.21.15.148:0/982786330 wait complete. 2024-02-28T16:22:07.578 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:07 smithi148 ceph-mon[28767]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:07.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:07 smithi157 ceph-mon[38346]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:08.000 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-28T16:22:08.495 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:08.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:08 smithi148 ceph-mon[28767]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:08.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:08 smithi157 ceph-mon[38346]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:09.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:09 smithi148 ceph-mon[28767]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:09.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:09 smithi157 ceph-mon[38346]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 -- 172.21.15.148:0/3678374598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 msgr2=0x7fa0fc0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 --2- 172.21.15.148:0/3678374598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc0ff560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec004940 tx=0x7fa0ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 -- 172.21.15.148:0/3678374598 shutdown_connections 2024-02-28T16:22:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 --2- 172.21.15.148:0/3678374598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0fc100360 0x7fa0fc1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 --2- 172.21.15.148:0/3678374598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc0ff560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 -- 172.21.15.148:0/3678374598 >> 172.21.15.148:0/3678374598 conn(0x7fa0fc0fa920 msgr2=0x7fa0fc0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:10.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 -- 172.21.15.148:0/3678374598 shutdown_connections 2024-02-28T16:22:10.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.793+0000 7fa102400700 1 -- 172.21.15.148:0/3678374598 wait complete. 2024-02-28T16:22:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.794+0000 7fa102400700 1 Processor -- start 2024-02-28T16:22:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.794+0000 7fa102400700 1 -- start start 2024-02-28T16:22:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa102400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc10fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:10.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa102400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0fc100360 0x7fa0fc1100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa102400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc1106f0 con 0x7fa0fc0ff150 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa102400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc110f90 con 0x7fa0fc100360 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa0fb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc10fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa0fb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc10fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54340/0 (socket says 172.21.15.148:54340) 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa0fb400700 1 -- 172.21.15.148:0/2595345574 learned_addr learned my addr 172.21.15.148:0/2595345574 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa0f2a00700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0fc100360 0x7fa0fc1100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa0fb400700 1 -- 172.21.15.148:0/2595345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0fc100360 msgr2=0x7fa0fc1100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa0fb400700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0fc100360 0x7fa0fc1100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.795+0000 7fa0fb400700 1 -- 172.21.15.148:0/2595345574 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec005040 con 0x7fa0fc0ff150 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.796+0000 7fa0fb400700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc10fbb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009360 tx=0x7fa0ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.796+0000 7fa0f3e00700 1 -- 172.21.15.148:0/2595345574 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0ec00e040 con 0x7fa0fc0ff150 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.796+0000 7fa0f3e00700 1 -- 172.21.15.148:0/2595345574 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0ec004290 con 0x7fa0fc0ff150 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.796+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc111210 con 0x7fa0fc0ff150 2024-02-28T16:22:10.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.796+0000 7fa0f3e00700 1 -- 172.21.15.148:0/2595345574 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0ec01c630 con 0x7fa0fc0ff150 2024-02-28T16:22:10.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.796+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc111750 con 0x7fa0fc0ff150 2024-02-28T16:22:10.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.797+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0fc04bed0 con 0x7fa0fc0ff150 2024-02-28T16:22:10.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.798+0000 7fa0f3e00700 1 -- 172.21.15.148:0/2595345574 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa0ec00bcc0 con 0x7fa0fc0ff150 2024-02-28T16:22:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.800+0000 7fa0f3e00700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa0e00692b0 0x7fa0e006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.800+0000 7fa0f3e00700 1 -- 172.21.15.148:0/2595345574 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa0ec088290 con 0x7fa0fc0ff150 2024-02-28T16:22:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.800+0000 7fa0f2a00700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa0e00692b0 0x7fa0e006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:10.790 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.801+0000 7fa0f2a00700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa0e00692b0 0x7fa0e006b760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009fd0 tx=0x7fa0e4009f20 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:10.794 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:10.805+0000 7fa0f3e00700 1 -- 172.21.15.148:0/2595345574 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa0ec058370 con 0x7fa0fc0ff150 2024-02-28T16:22:10.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:10 smithi148 ceph-mon[28767]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:11.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.023+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0fc111bb0 con 0x7fa0e00692b0 2024-02-28T16:22:11.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.034+0000 7fa0f3e00700 1 -- 172.21.15.148:0/2595345574 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1179 (secure 0 0 0) 0x7fa0fc111bb0 con 0x7fa0e00692b0 2024-02-28T16:22:11.024 INFO:teuthology.orchestra.run.smithi148.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-28T16:22:11.024 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager ?:9093,9094 1/1 3m ago 8m count:1 2024-02-28T16:22:11.024 INFO:teuthology.orchestra.run.smithi148.stdout:crash 2/2 3m ago 8m * 2024-02-28T16:22:11.024 INFO:teuthology.orchestra.run.smithi148.stdout:grafana ?:3000 1/1 3m ago 8m count:1 2024-02-28T16:22:11.024 INFO:teuthology.orchestra.run.smithi148.stdout:mgr 2/2 3m ago 8m count:2 2024-02-28T16:22:11.024 INFO:teuthology.orchestra.run.smithi148.stdout:mon 2/2 3m ago 7m smithi148:172.21.15.148=smithi148;smithi157:172.21.15.157=smithi157;count:2 2024-02-28T16:22:11.025 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter ?:9100 2/2 3m ago 8m * 2024-02-28T16:22:11.025 INFO:teuthology.orchestra.run.smithi148.stdout:osd 6 3m ago - 2024-02-28T16:22:11.025 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus ?:9095 1/1 3m ago 8m count:1 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa0e00692b0 msgr2=0x7fa0e006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa0e00692b0 0x7fa0e006b760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4009fd0 tx=0x7fa0e4009f20 comp rx=0 tx=0).stop 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 msgr2=0x7fa0fc10fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc10fbb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009360 tx=0x7fa0ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 shutdown_connections 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0fc0ff150 0x7fa0fc10fbb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa0e00692b0 0x7fa0e006b760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:11.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 --2- 172.21.15.148:0/2595345574 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0fc100360 0x7fa0fc1100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 >> 172.21.15.148:0/2595345574 conn(0x7fa0fc0fa920 msgr2=0x7fa0fc103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 shutdown_connections 2024-02-28T16:22:11.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:11.037+0000 7fa102400700 1 -- 172.21.15.148:0/2595345574 wait complete. 2024-02-28T16:22:11.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:10 smithi157 ceph-mon[38346]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:11.912 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-28T16:22:12.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:12.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:11 smithi148 ceph-mon[28767]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:12.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:12.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:11 smithi157 ceph-mon[38346]: from='client.14456 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:12.388 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:13.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:12 smithi148 ceph-mon[28767]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:13.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:12 smithi157 ceph-mon[38346]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 -- 172.21.15.148:0/3409346634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394104750 msgr2=0x7f1394104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 --2- 172.21.15.148:0/3409346634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394104750 0x7f1394104ba0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1380004940 tx=0x7f1380009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 -- 172.21.15.148:0/3409346634 shutdown_connections 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 --2- 172.21.15.148:0/3409346634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394104750 0x7f1394104ba0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 --2- 172.21.15.148:0/3409346634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1394103540 0x7f1394103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 -- 172.21.15.148:0/3409346634 >> 172.21.15.148:0/3409346634 conn(0x7f13940727d0 msgr2=0x7f1394074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 -- 172.21.15.148:0/3409346634 shutdown_connections 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.686+0000 7f139a400700 1 -- 172.21.15.148:0/3409346634 wait complete. 2024-02-28T16:22:14.677 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.687+0000 7f139a400700 1 Processor -- start 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.687+0000 7f139a400700 1 -- start start 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f139a400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394103540 0x7f1394113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f139a400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1394104750 0x7f13941144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f139a400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394114aa0 con 0x7f1394103540 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f139a400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1394115340 con 0x7f1394104750 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f1393400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394103540 0x7f1394113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f1393400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394103540 0x7f1394113f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51130/0 (socket says 172.21.15.148:51130) 2024-02-28T16:22:14.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f1393400700 1 -- 172.21.15.148:0/1794653675 learned_addr learned my addr 172.21.15.148:0/1794653675 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f1392a00700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1394104750 0x7f13941144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f1393400700 1 -- 172.21.15.148:0/1794653675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1394104750 msgr2=0x7f13941144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f1393400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1394104750 0x7f13941144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.688+0000 7f1393400700 1 -- 172.21.15.148:0/1794653675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380005040 con 0x7f1394103540 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.689+0000 7f1393400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394103540 0x7f1394113f60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f138400c8e0 tx=0x7f13840044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.689+0000 7f138b400700 1 -- 172.21.15.148:0/1794653675 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138400a940 con 0x7f1394103540 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.689+0000 7f138b400700 1 -- 172.21.15.148:0/1794653675 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f138400ce80 con 0x7f1394103540 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.689+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1394115620 con 0x7f1394103540 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.689+0000 7f138b400700 1 -- 172.21.15.148:0/1794653675 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13840113a0 con 0x7f1394103540 2024-02-28T16:22:14.680 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.689+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1394115b60 con 0x7f1394103540 2024-02-28T16:22:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.690+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139404bed0 con 0x7f1394103540 2024-02-28T16:22:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.691+0000 7f138b400700 1 -- 172.21.15.148:0/1794653675 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1384012400 con 0x7f1394103540 2024-02-28T16:22:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.692+0000 7f138b400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f13780692b0 0x7f137806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.692+0000 7f138b400700 1 -- 172.21.15.148:0/1794653675 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1384086f30 con 0x7f1394103540 2024-02-28T16:22:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.692+0000 7f1392a00700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f13780692b0 0x7f137806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:14.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.693+0000 7f1392a00700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f13780692b0 0x7f137806b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f138000b020 tx=0x7f1380009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.696+0000 7f138b400700 1 -- 172.21.15.148:0/1794653675 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1384057010 con 0x7f1394103540 2024-02-28T16:22:14.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.913+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f13941090a0 con 0x7f13780692b0 2024-02-28T16:22:14.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.916+0000 7f138b400700 1 -- 172.21.15.148:0/1794653675 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f13941090a0 con 0x7f13780692b0 2024-02-28T16:22:14.906 INFO:teuthology.orchestra.run.smithi148.stdout:HOST ADDR LABELS STATUS 2024-02-28T16:22:14.906 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 172.21.15.148 2024-02-28T16:22:14.906 INFO:teuthology.orchestra.run.smithi148.stdout:smithi157 172.21.15.157 2024-02-28T16:22:14.906 INFO:teuthology.orchestra.run.smithi148.stdout:2 hosts in cluster 2024-02-28T16:22:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f13780692b0 msgr2=0x7f137806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f13780692b0 0x7f137806b760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f138000b020 tx=0x7f1380009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:14.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394103540 msgr2=0x7f1394113f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394103540 0x7f1394113f60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f138400c8e0 tx=0x7f13840044c0 comp rx=0 tx=0).stop 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 shutdown_connections 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1394103540 0x7f1394113f60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f13780692b0 0x7f137806b760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 --2- 172.21.15.148:0/1794653675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1394104750 0x7f13941144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 >> 172.21.15.148:0/1794653675 conn(0x7f13940727d0 msgr2=0x7f1394107980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.919+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 shutdown_connections 2024-02-28T16:22:14.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:14.920+0000 7f139a400700 1 -- 172.21.15.148:0/1794653675 wait complete. 2024-02-28T16:22:15.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:14 smithi157 ceph-mon[38346]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:15.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:14 smithi148 ceph-mon[28767]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:15.912 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-28T16:22:16.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:15 smithi148 ceph-mon[28767]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:16.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:15 smithi157 ceph-mon[38346]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:16.386 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:17.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:16 smithi148 ceph-mon[28767]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:17.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:16 smithi157 ceph-mon[38346]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:18.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 -- 172.21.15.148:0/235920776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c100ff150 msgr2=0x7f5c100ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:18.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 --2- 172.21.15.148:0/235920776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c100ff150 0x7f5c100ff560 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c04004940 tx=0x7f5c04009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:18.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 -- 172.21.15.148:0/235920776 shutdown_connections 2024-02-28T16:22:18.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 --2- 172.21.15.148:0/235920776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c10100360 0x7f5c101007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:18.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 --2- 172.21.15.148:0/235920776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c100ff150 0x7f5c100ff560 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:18.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 -- 172.21.15.148:0/235920776 >> 172.21.15.148:0/235920776 conn(0x7f5c100fa920 msgr2=0x7f5c100fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:18.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 -- 172.21.15.148:0/235920776 shutdown_connections 2024-02-28T16:22:18.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.895+0000 7f5c17600700 1 -- 172.21.15.148:0/235920776 wait complete. 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.896+0000 7f5c17600700 1 Processor -- start 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.896+0000 7f5c17600700 1 -- start start 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c17600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c100ff150 0x7f5c1010fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c17600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c10100360 0x7f5c101100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c17600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10110780 con 0x7f5c10100360 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c17600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c10110fc0 con 0x7f5c100ff150 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c0fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c10100360 0x7f5c101100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c0fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c10100360 0x7f5c101100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51144/0 (socket says 172.21.15.148:51144) 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c0fe00700 1 -- 172.21.15.148:0/1444708911 learned_addr learned my addr 172.21.15.148:0/1444708911 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c14c00700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c100ff150 0x7f5c1010fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c0fe00700 1 -- 172.21.15.148:0/1444708911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c100ff150 msgr2=0x7f5c1010fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c0fe00700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c100ff150 0x7f5c1010fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.897+0000 7f5c0fe00700 1 -- 172.21.15.148:0/1444708911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04005040 con 0x7f5c10100360 2024-02-28T16:22:18.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.898+0000 7f5c0fe00700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c10100360 0x7f5c101100f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00b790 tx=0x7f5bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:18.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.898+0000 7f5c0cc00700 1 -- 172.21.15.148:0/1444708911 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bfc00f770 con 0x7f5c10100360 2024-02-28T16:22:18.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.898+0000 7f5c0cc00700 1 -- 172.21.15.148:0/1444708911 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bfc00fda0 con 0x7f5c10100360 2024-02-28T16:22:18.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.898+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c101112a0 con 0x7f5c10100360 2024-02-28T16:22:18.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.898+0000 7f5c0cc00700 1 -- 172.21.15.148:0/1444708911 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bfc00d310 con 0x7f5c10100360 2024-02-28T16:22:18.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.898+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c101117e0 con 0x7f5c10100360 2024-02-28T16:22:18.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.899+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1004bed0 con 0x7f5c10100360 2024-02-28T16:22:18.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.900+0000 7f5c0cc00700 1 -- 172.21.15.148:0/1444708911 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5bfc010420 con 0x7f5c10100360 2024-02-28T16:22:18.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.902+0000 7f5c0cc00700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5bf80692b0 0x7f5bf806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:18.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.902+0000 7f5c0cc00700 1 -- 172.21.15.148:0/1444708911 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5bfc086da0 con 0x7f5c10100360 2024-02-28T16:22:18.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.902+0000 7f5c14c00700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5bf80692b0 0x7f5bf806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:18.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.903+0000 7f5c14c00700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5bf80692b0 0x7f5bf806b760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400b3b0 tx=0x7f5c04009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:18.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:18.907+0000 7f5c0cc00700 1 -- 172.21.15.148:0/1444708911 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5bfc056f40 con 0x7f5c10100360 2024-02-28T16:22:19.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.122+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c10111df0 con 0x7f5bf80692b0 2024-02-28T16:22:19.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.126+0000 7f5c0cc00700 1 -- 172.21.15.148:0/1444708911 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f5c10111df0 con 0x7f5bf80692b0 2024-02-28T16:22:19.116 INFO:teuthology.orchestra.run.smithi148.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-28T16:22:19.116 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-02-28T16:22:19.117 INFO:teuthology.orchestra.run.smithi148.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 92s ago Has a FileSystem, LVM detected 2024-02-28T16:22:19.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5bf80692b0 msgr2=0x7f5bf806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5bf80692b0 0x7f5bf806b760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400b3b0 tx=0x7f5c04009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c10100360 msgr2=0x7f5c101100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c10100360 0x7f5c101100f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00b790 tx=0x7f5bfc009250 comp rx=0 tx=0).stop 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 shutdown_connections 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5bf80692b0 0x7f5bf806b760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5c100ff150 0x7f5c1010fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 --2- 172.21.15.148:0/1444708911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5c10100360 0x7f5c101100f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.129+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 >> 172.21.15.148:0/1444708911 conn(0x7f5c100fa920 msgr2=0x7f5c10103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.130+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 shutdown_connections 2024-02-28T16:22:19.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:19.130+0000 7f5c17600700 1 -- 172.21.15.148:0/1444708911 wait complete. 2024-02-28T16:22:19.137 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:18 smithi148 ceph-mon[28767]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:18 smithi157 ceph-mon[38346]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:20.062 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:22:20.072 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:22:20.073 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-28T16:22:20.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:19 smithi157 ceph-mon[38346]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:19 smithi148 ceph-mon[28767]: from='client.14464 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:20.560 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:21.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:20 smithi157 ceph-mon[38346]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:21.250 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:20 smithi148 ceph-mon[28767]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 -- 172.21.15.148:0/1569546715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 msgr2=0x7f5f181049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1569546715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181049d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5f04004940 tx=0x7f5f04009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 -- 172.21.15.148:0/1569546715 shutdown_connections 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1569546715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181049d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1569546715 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f18103370 0x7f5f18103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 -- 172.21.15.148:0/1569546715 >> 172.21.15.148:0/1569546715 conn(0x7f5f18072500 msgr2=0x7f5f18074950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 -- 172.21.15.148:0/1569546715 shutdown_connections 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.920+0000 7f5f1da00700 1 -- 172.21.15.148:0/1569546715 wait complete. 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.921+0000 7f5f1da00700 1 Processor -- start 2024-02-28T16:22:22.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.921+0000 7f5f1da00700 1 -- start start 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.921+0000 7f5f1da00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f18103370 0x7f5f18113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.921+0000 7f5f1da00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181142f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.921+0000 7f5f1da00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181150e0 con 0x7f5f18104580 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.921+0000 7f5f1da00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18115250 con 0x7f5f18103370 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181142f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181142f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55118/0 (socket says 172.21.15.148:55118) 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17400700 1 -- 172.21.15.148:0/1667564748 learned_addr learned my addr 172.21.15.148:0/1667564748 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17e00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f18103370 0x7f5f18113db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17400700 1 -- 172.21.15.148:0/1667564748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f18103370 msgr2=0x7f5f18113db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17400700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f18103370 0x7f5f18113db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:22.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17400700 1 -- 172.21.15.148:0/1667564748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04005040 con 0x7f5f18104580 2024-02-28T16:22:22.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.922+0000 7f5f17400700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181142f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400b3b0 tx=0x7f5f04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:22.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.923+0000 7f5f0fe00700 1 -- 172.21.15.148:0/1667564748 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0400e040 con 0x7f5f18104580 2024-02-28T16:22:22.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.923+0000 7f5f0fe00700 1 -- 172.21.15.148:0/1667564748 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f0400bd90 con 0x7f5f18104580 2024-02-28T16:22:22.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.923+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f181154d0 con 0x7f5f18104580 2024-02-28T16:22:22.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.923+0000 7f5f0fe00700 1 -- 172.21.15.148:0/1667564748 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f0401c630 con 0x7f5f18104580 2024-02-28T16:22:22.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.923+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f18115a90 con 0x7f5f18104580 2024-02-28T16:22:22.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.924+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1805f5c0 con 0x7f5f18104580 2024-02-28T16:22:22.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.925+0000 7f5f0fe00700 1 -- 172.21.15.148:0/1667564748 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f5f040139f0 con 0x7f5f18104580 2024-02-28T16:22:22.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.926+0000 7f5f0fe00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5efc0692b0 0x7f5efc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:22.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.926+0000 7f5f0fe00700 1 -- 172.21.15.148:0/1667564748 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5f04088390 con 0x7f5f18104580 2024-02-28T16:22:22.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.927+0000 7f5f17e00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5efc0692b0 0x7f5efc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:22.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.927+0000 7f5f17e00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5efc0692b0 0x7f5efc06b760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5f08007fd0 tx=0x7f5f08009040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:22.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:22.931+0000 7f5f0fe00700 1 -- 172.21.15.148:0/1667564748 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f5f04054a90 con 0x7f5f18104580 2024-02-28T16:22:23.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:22 smithi148 ceph-mon[28767]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:23.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:23.167+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f18115ec0 con 0x7f5efc0692b0 2024-02-28T16:22:23.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:22 smithi157 ceph-mon[38346]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:24.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:24 smithi148 ceph-mon[28767]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:24.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:24 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T16:22:24.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:24 smithi157 ceph-mon[38346]: from='client.14468 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:22:24.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:24 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T16:22:25.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.077+0000 7f5f0fe00700 1 -- 172.21.15.148:0/1667564748 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5f18115ec0 con 0x7f5efc0692b0 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5efc0692b0 msgr2=0x7f5efc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5efc0692b0 0x7f5efc06b760 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5f08007fd0 tx=0x7f5f08009040 comp rx=0 tx=0).stop 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 msgr2=0x7f5f181142f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181142f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400b3b0 tx=0x7f5f04009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 shutdown_connections 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f5efc0692b0 0x7f5efc06b760 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5f18103370 0x7f5f18113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 --2- 172.21.15.148:0/1667564748 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f18104580 0x7f5f181142f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 >> 172.21.15.148:0/1667564748 conn(0x7f5f18072500 msgr2=0x7f5f181077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:25.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 shutdown_connections 2024-02-28T16:22:25.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:25.081+0000 7f5f1da00700 1 -- 172.21.15.148:0/1667564748 wait complete. 2024-02-28T16:22:25.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:25 smithi148 ceph-mon[28767]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:25.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T16:22:25.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:25 smithi148 ceph-mon[28767]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T16:22:25.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:25 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:22:25.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:25 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[28763]: 2024-02-28T16:22:25.044+0000 7fc6f0200700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:22:25.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:25 smithi157 ceph-mon[38346]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:25.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T16:22:25.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:25 smithi157 ceph-mon[38346]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T16:22:25.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:25 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:22:26.038 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T16:22:26.363 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: fsmap cephfs:0 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: Saving service mds.cephfs spec with placement count:4 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: Deploying daemon mds.cephfs.smithi148.mgdxsi on smithi148 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:26.364 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: fsmap cephfs:0 2024-02-28T16:22:26.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: Saving service mds.cephfs spec with placement count:4 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: Deploying daemon mds.cephfs.smithi148.mgdxsi on smithi148 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:26.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:27.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:27 smithi148 ceph-mon[28767]: pgmap v241: 65 pgs: 12 creating+peering, 40 unknown, 13 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:27.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:27 smithi148 ceph-mon[28767]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T16:22:27.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:27 smithi157 ceph-mon[38346]: pgmap v241: 65 pgs: 12 creating+peering, 40 unknown, 13 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:27.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:27 smithi157 ceph-mon[38346]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T16:22:27.588 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:28.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:28 smithi148 ceph-mon[28767]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T16:22:28.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:28 smithi157 ceph-mon[38346]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T16:22:29.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:29 smithi148 ceph-mon[28767]: pgmap v244: 65 pgs: 12 creating+peering, 25 unknown, 28 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:29.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:29 smithi157 ceph-mon[38346]: pgmap v244: 65 pgs: 12 creating+peering, 25 unknown, 28 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.820+0000 7ff6d5000700 1 -- 172.21.15.148:0/3809582518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 msgr2=0x7ff6d00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.820+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3809582518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d00fe550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0004940 tx=0x7ff6c0009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.820+0000 7ff6d5000700 1 -- 172.21.15.148:0/3809582518 shutdown_connections 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.820+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3809582518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d00fe550 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.820+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3809582518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d00fcef0 0x7ff6d00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.820+0000 7ff6d5000700 1 -- 172.21.15.148:0/3809582518 >> 172.21.15.148:0/3809582518 conn(0x7ff6d00f8620 msgr2=0x7ff6d00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.820+0000 7ff6d5000700 1 -- 172.21.15.148:0/3809582518 shutdown_connections 2024-02-28T16:22:29.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.821+0000 7ff6d5000700 1 -- 172.21.15.148:0/3809582518 wait complete. 2024-02-28T16:22:29.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.822+0000 7ff6d5000700 1 Processor -- start 2024-02-28T16:22:29.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.822+0000 7ff6d5000700 1 -- start start 2024-02-28T16:22:29.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.822+0000 7ff6d5000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d00fcef0 0x7ff6d010fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:29.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.822+0000 7ff6d5000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d01100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:29.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.822+0000 7ff6d5000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d0110750 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.822+0000 7ff6d5000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d0110f90 con 0x7ff6d00fcef0 2024-02-28T16:22:29.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.823+0000 7ff6cd400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d01100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:29.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.823+0000 7ff6cd400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d01100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55156/0 (socket says 172.21.15.148:55156) 2024-02-28T16:22:29.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.823+0000 7ff6cd400700 1 -- 172.21.15.148:0/3597335768 learned_addr learned my addr 172.21.15.148:0/3597335768 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:29.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.823+0000 7ff6cd400700 1 -- 172.21.15.148:0/3597335768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d00fcef0 msgr2=0x7ff6d010fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:29.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.823+0000 7ff6cd400700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d00fcef0 0x7ff6d010fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:29.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.823+0000 7ff6cd400700 1 -- 172.21.15.148:0/3597335768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0005040 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.824+0000 7ff6cd400700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d01100c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009fd0 tx=0x7ff6c0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:29.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.824+0000 7ff6c6000700 1 -- 172.21.15.148:0/3597335768 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c000e040 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.824+0000 7ff6c6000700 1 -- 172.21.15.148:0/3597335768 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6c000bcc0 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.824+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d0111210 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.824+0000 7ff6c6000700 1 -- 172.21.15.148:0/3597335768 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c001c630 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.824+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d0111750 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.825+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d0102210 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.827+0000 7ff6c6000700 1 -- 172.21.15.148:0/3597335768 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff6c0013980 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.828+0000 7ff6c6000700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff6b40692b0 0x7ff6b406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:29.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.828+0000 7ff6c6000700 1 -- 172.21.15.148:0/3597335768 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff6c0088640 con 0x7ff6d00fe0e0 2024-02-28T16:22:29.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.828+0000 7ff6cde00700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff6b40692b0 0x7ff6b406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:29.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.829+0000 7ff6cde00700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff6b40692b0 0x7ff6b406b760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8006fd0 tx=0x7ff6b8006db0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:29.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:29.833+0000 7ff6c6000700 1 -- 172.21.15.148:0/3597335768 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff6c00583e0 con 0x7ff6d00fe0e0 2024-02-28T16:22:30.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.131+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff6d004bed0 con 0x7ff6d00fe0e0 2024-02-28T16:22:30.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.132+0000 7ff6c6000700 1 -- 172.21.15.148:0/3597335768 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 3 v3) v1 ==== 75+0+1249 (secure 0 0 0) 0x7ff6c0057f70 con 0x7ff6d00fe0e0 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:e3 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 3 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:29.787181+0000 2024-02-28T16:22:30.123 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 0 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14472} 2024-02-28T16:22:30.124 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data disabled 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 0 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{0:14472} state up:creating seq 1 addr [v2:172.21.15.148:6826/1588947397,v1:172.21.15.148:6827/1588947397] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:22:30.125 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:22:30.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff6b40692b0 msgr2=0x7ff6b406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:30.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff6b40692b0 0x7ff6b406b760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8006fd0 tx=0x7ff6b8006db0 comp rx=0 tx=0).stop 2024-02-28T16:22:30.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 msgr2=0x7ff6d01100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:30.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d01100c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009fd0 tx=0x7ff6c0009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:30.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 shutdown_connections 2024-02-28T16:22:30.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff6b40692b0 0x7ff6b406b760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6d00fcef0 0x7ff6d010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 --2- 172.21.15.148:0/3597335768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6d00fe0e0 0x7ff6d01100c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.135+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 >> 172.21.15.148:0/3597335768 conn(0x7ff6d00f8620 msgr2=0x7ff6d00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.136+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 shutdown_connections 2024-02-28T16:22:30.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:30.136+0000 7ff6d5000700 1 -- 172.21.15.148:0/3597335768 wait complete. 2024-02-28T16:22:30.128 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 3 2024-02-28T16:22:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: daemon mds.cephfs.smithi148.mgdxsi assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T16:22:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:22:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T16:22:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: Cluster is now healthy 2024-02-28T16:22:30.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6826/1588947397,v1:172.21.15.148:6827/1588947397] up:boot 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:creating} 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: daemon mds.cephfs.smithi148.mgdxsi is now active in filesystem cephfs as rank 0 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:30 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:30.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: daemon mds.cephfs.smithi148.mgdxsi assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T16:22:30.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: Cluster is now healthy 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6826/1588947397,v1:172.21.15.148:6827/1588947397] up:boot 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:creating} 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: daemon mds.cephfs.smithi148.mgdxsi is now active in filesystem cephfs as rank 0 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:30.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:30 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:30.899 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:22:30.910 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:22:30.910 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-02-28T16:22:31.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:31 smithi148 ceph-mon[28767]: pgmap v245: 65 pgs: 12 creating+peering, 53 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:31.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:31 smithi148 ceph-mon[28767]: Deploying daemon mds.cephfs.smithi157.hinycn on smithi157 2024-02-28T16:22:31.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:31 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3597335768' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:31.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:31 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6826/1588947397,v1:172.21.15.148:6827/1588947397] up:active 2024-02-28T16:22:31.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:31 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 2024-02-28T16:22:31.378 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:31.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:31 smithi157 ceph-mon[38346]: pgmap v245: 65 pgs: 12 creating+peering, 53 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:22:31.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:31 smithi157 ceph-mon[38346]: Deploying daemon mds.cephfs.smithi157.hinycn on smithi157 2024-02-28T16:22:31.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:31 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3597335768' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:31.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:31 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6826/1588947397,v1:172.21.15.148:6827/1588947397] up:active 2024-02-28T16:22:31.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:31 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 2024-02-28T16:22:33.202 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:33 smithi148 ceph-mon[28767]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 2 op/s 2024-02-28T16:22:33.389 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:33 smithi157 ceph-mon[38346]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s wr, 2 op/s 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.733+0000 7f4b8fa00700 1 -- 172.21.15.148:0/3593630372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880708c0 msgr2=0x7f4b88070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.733+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/3593630372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880708c0 0x7f4b88070d10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4b74004940 tx=0x7f4b74009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.734+0000 7f4b8fa00700 1 -- 172.21.15.148:0/3593630372 shutdown_connections 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.734+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/3593630372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b880708c0 0x7f4b88070d10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.734+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/3593630372 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b88071f10 0x7f4b88070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.734+0000 7f4b8fa00700 1 -- 172.21.15.148:0/3593630372 >> 172.21.15.148:0/3593630372 conn(0x7f4b880f8620 msgr2=0x7f4b880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.734+0000 7f4b8fa00700 1 -- 172.21.15.148:0/3593630372 shutdown_connections 2024-02-28T16:22:33.724 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.734+0000 7f4b8fa00700 1 -- 172.21.15.148:0/3593630372 wait complete. 2024-02-28T16:22:33.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b8fa00700 1 Processor -- start 2024-02-28T16:22:33.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b8fa00700 1 -- start start 2024-02-28T16:22:33.725 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b8fa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880708c0 0x7f4b8810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b8fa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88071f10 0x7f4b881100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b8fa00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b881106b0 con 0x7f4b88071f10 2024-02-28T16:22:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b8fa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88110f50 con 0x7f4b880708c0 2024-02-28T16:22:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b87e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88071f10 0x7f4b881100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b87e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88071f10 0x7f4b881100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53212/0 (socket says 172.21.15.148:53212) 2024-02-28T16:22:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.735+0000 7f4b87e00700 1 -- 172.21.15.148:0/4284728012 learned_addr learned my addr 172.21.15.148:0/4284728012 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:33.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.736+0000 7f4b8d000700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880708c0 0x7f4b8810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.736+0000 7f4b87e00700 1 -- 172.21.15.148:0/4284728012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880708c0 msgr2=0x7f4b8810fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.736+0000 7f4b87e00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880708c0 0x7f4b8810fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.736+0000 7f4b87e00700 1 -- 172.21.15.148:0/4284728012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74005040 con 0x7f4b88071f10 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.736+0000 7f4b8d000700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880708c0 0x7f4b8810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.736+0000 7f4b87e00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88071f10 0x7f4b881100b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009fd0 tx=0x7f4b74009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.737+0000 7f4b84c00700 1 -- 172.21.15.148:0/4284728012 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7400e040 con 0x7f4b88071f10 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.737+0000 7f4b84c00700 1 -- 172.21.15.148:0/4284728012 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4b74004290 con 0x7f4b88071f10 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.737+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b881111d0 con 0x7f4b88071f10 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.737+0000 7f4b84c00700 1 -- 172.21.15.148:0/4284728012 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b7401c630 con 0x7f4b88071f10 2024-02-28T16:22:33.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.737+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b88111710 con 0x7f4b88071f10 2024-02-28T16:22:33.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.738+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b8804bed0 con 0x7f4b88071f10 2024-02-28T16:22:33.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.739+0000 7f4b84c00700 1 -- 172.21.15.148:0/4284728012 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4b7400bc60 con 0x7f4b88071f10 2024-02-28T16:22:33.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.740+0000 7f4b84c00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4b700692b0 0x7f4b7006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:33.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.740+0000 7f4b84c00700 1 -- 172.21.15.148:0/4284728012 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f4b740886c0 con 0x7f4b88071f10 2024-02-28T16:22:33.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.740+0000 7f4b8d000700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4b700692b0 0x7f4b7006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:33.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.741+0000 7f4b8d000700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4b700692b0 0x7f4b7006b760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009fd0 tx=0x7f4b7c009ee0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:33.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:33.745+0000 7f4b84c00700 1 -- 172.21.15.148:0/4284728012 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4b74058360 con 0x7f4b88071f10 2024-02-28T16:22:33.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.009+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f4b88111ab0 con 0x7f4b88071f10 2024-02-28T16:22:34.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.097+0000 7f4b84c00700 1 -- 172.21.15.148:0/4284728012 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4b74057ef0 con 0x7f4b88071f10 2024-02-28T16:22:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4b700692b0 msgr2=0x7f4b7006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4b700692b0 0x7f4b7006b760 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009fd0 tx=0x7f4b7c009ee0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88071f10 msgr2=0x7f4b881100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88071f10 0x7f4b881100b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009fd0 tx=0x7f4b74009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 shutdown_connections 2024-02-28T16:22:34.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4b700692b0 0x7f4b7006b760 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4b880708c0 0x7f4b8810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 --2- 172.21.15.148:0/4284728012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b88071f10 0x7f4b881100b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:34.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.100+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 >> 172.21.15.148:0/4284728012 conn(0x7f4b880f8620 msgr2=0x7f4b88102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:34.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.101+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 shutdown_connections 2024-02-28T16:22:34.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:34.103+0000 7f4b8fa00700 1 -- 172.21.15.148:0/4284728012 wait complete. 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: Deploying daemon mds.cephfs.smithi148.nqnotw on smithi148 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/4284728012' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T16:22:34.800 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:boot 2024-02-28T16:22:34.801 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/4284728012' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T16:22:34.801 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 1 up:standby 2024-02-28T16:22:34.801 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:22:34.801 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:34 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 1 up:standby 2024-02-28T16:22:34.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: Deploying daemon mds.cephfs.smithi148.nqnotw on smithi148 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/4284728012' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:boot 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/4284728012' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 1 up:standby 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:22:34.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:34 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 1 up:standby 2024-02-28T16:22:34.995 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:22:35.005 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:22:35.006 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-02-28T16:22:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:35 smithi148 ceph-mon[28767]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-02-28T16:22:35.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:35 smithi157 ceph-mon[38346]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-02-28T16:22:36.454 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:37 smithi157 ceph-mon[38346]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-28T16:22:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:37 smithi148 ceph-mon[28767]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-28T16:22:39.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.583+0000 7f2030000700 1 -- 172.21.15.148:0/1462693235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fcef0 msgr2=0x7f20280fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:39.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.583+0000 7f2030000700 1 --2- 172.21.15.148:0/1462693235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fcef0 0x7f20280fd320 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f201c004940 tx=0x7f201c009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:39.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.583+0000 7f2030000700 1 -- 172.21.15.148:0/1462693235 shutdown_connections 2024-02-28T16:22:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.584+0000 7f2030000700 1 --2- 172.21.15.148:0/1462693235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20280fe0e0 0x7f20280fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.584+0000 7f2030000700 1 --2- 172.21.15.148:0/1462693235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fcef0 0x7f20280fd320 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.584+0000 7f2030000700 1 -- 172.21.15.148:0/1462693235 >> 172.21.15.148:0/1462693235 conn(0x7f20280f8620 msgr2=0x7f20280faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.584+0000 7f2030000700 1 -- 172.21.15.148:0/1462693235 shutdown_connections 2024-02-28T16:22:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.584+0000 7f2030000700 1 -- 172.21.15.148:0/1462693235 wait complete. 2024-02-28T16:22:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.584+0000 7f2030000700 1 Processor -- start 2024-02-28T16:22:39.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f2030000700 1 -- start start 2024-02-28T16:22:39.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f2030000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20280fcef0 0x7f202810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:39.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f2030000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fe0e0 0x7f202810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:39.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f2030000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202810e4b0 con 0x7f20280fe0e0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f2030000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202810ed50 con 0x7f20280fcef0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f202cc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fe0e0 0x7f202810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f202cc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fe0e0 0x7f202810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53252/0 (socket says 172.21.15.148:53252) 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f202cc00700 1 -- 172.21.15.148:0/1942971656 learned_addr learned my addr 172.21.15.148:0/1942971656 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.585+0000 7f202d600700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20280fcef0 0x7f202810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f202cc00700 1 -- 172.21.15.148:0/1942971656 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20280fcef0 msgr2=0x7f202810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f202cc00700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20280fcef0 0x7f202810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f202cc00700 1 -- 172.21.15.148:0/1942971656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c005040 con 0x7f20280fe0e0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f202d600700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20280fcef0 0x7f202810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f202cc00700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fe0e0 0x7f202810deb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f201400c830 tx=0x7f2014004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f2025600700 1 -- 172.21.15.148:0/1942971656 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f201400a760 con 0x7f20280fe0e0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f2025600700 1 -- 172.21.15.148:0/1942971656 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f201400ad90 con 0x7f20280fe0e0 2024-02-28T16:22:39.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f2025600700 1 -- 172.21.15.148:0/1942971656 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20140113a0 con 0x7f20280fe0e0 2024-02-28T16:22:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.586+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202810f030 con 0x7f20280fe0e0 2024-02-28T16:22:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.587+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202810f570 con 0x7f20280fe0e0 2024-02-28T16:22:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.588+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202804bed0 con 0x7f20280fe0e0 2024-02-28T16:22:39.579 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.589+0000 7f2025600700 1 -- 172.21.15.148:0/1942971656 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2014012400 con 0x7f20280fe0e0 2024-02-28T16:22:39.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.590+0000 7f2025600700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20100692b0 0x7f201006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:39.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.590+0000 7f2025600700 1 -- 172.21.15.148:0/1942971656 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2014087140 con 0x7f20280fe0e0 2024-02-28T16:22:39.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.590+0000 7f202d600700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20100692b0 0x7f201006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:39.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.591+0000 7f202d600700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20100692b0 0x7f201006b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f201c00b840 tx=0x7f201c009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:39.585 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.595+0000 7f2025600700 1 -- 172.21.15.148:0/1942971656 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2014056fa0 con 0x7f20280fe0e0 2024-02-28T16:22:39.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:39.851+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2028105a30 con 0x7f20280fe0e0 2024-02-28T16:22:39.843 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:39 smithi148 ceph-mon[28767]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-02-28T16:22:39.843 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:39.843 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:39.843 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:39.843 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:39.843 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:39.843 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:39 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:39 smithi157 ceph-mon[38346]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 4 op/s 2024-02-28T16:22:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:22:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T16:22:39.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:39 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:40.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.809+0000 7f2025600700 1 -- 172.21.15.148:0/1942971656 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2014056b30 con 0x7f20280fe0e0 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.812+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20100692b0 msgr2=0x7f201006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.812+0000 7f2030000700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20100692b0 0x7f201006b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f201c00b840 tx=0x7f201c009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.812+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fe0e0 msgr2=0x7f202810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.812+0000 7f2030000700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fe0e0 0x7f202810deb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f201400c830 tx=0x7f2014004470 comp rx=0 tx=0).stop 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.813+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 shutdown_connections 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.813+0000 7f2030000700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f20100692b0 0x7f201006b760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.813+0000 7f2030000700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20280fcef0 0x7f202810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:40.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.813+0000 7f2030000700 1 --2- 172.21.15.148:0/1942971656 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20280fe0e0 0x7f202810deb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:40.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.813+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 >> 172.21.15.148:0/1942971656 conn(0x7f20280f8620 msgr2=0x7f20281013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:40.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.813+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 shutdown_connections 2024-02-28T16:22:40.804 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:40.813+0000 7f2030000700 1 -- 172.21.15.148:0/1942971656 wait complete. 2024-02-28T16:22:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:40 smithi157 ceph-mon[38346]: Deploying daemon mds.cephfs.smithi157.dreayg on smithi157 2024-02-28T16:22:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:40 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:boot 2024-02-28T16:22:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:40 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 2 up:standby 2024-02-28T16:22:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:40 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:22:40.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:40 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1942971656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-28T16:22:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:40 smithi148 ceph-mon[28767]: Deploying daemon mds.cephfs.smithi157.dreayg on smithi157 2024-02-28T16:22:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:40 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:boot 2024-02-28T16:22:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:40 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 2 up:standby 2024-02-28T16:22:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:40 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:22:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:40 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1942971656' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-02-28T16:22:41.698 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:22:41.711 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:22:41.711 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-02-28T16:22:41.938 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:41 smithi157 ceph-mon[38346]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-28T16:22:41.938 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:41 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1942971656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-28T16:22:41.938 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:41 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 2 up:standby 2024-02-28T16:22:41.938 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:41.939 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:41.939 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:41 smithi148 ceph-mon[28767]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-28T16:22:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:41 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1942971656' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-02-28T16:22:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:41 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 2 up:standby 2024-02-28T16:22:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:42.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:42.198 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: pgmap v251: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:boot 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.988 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:43 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: pgmap v251: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:boot 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:43.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:43 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:44.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 -- 172.21.15.148:0/2649554284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fe0e0 msgr2=0x7fc7f80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/2649554284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fe0e0 0x7fc7f80fe550 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0004940 tx=0x7fc7e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 -- 172.21.15.148:0/2649554284 shutdown_connections 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/2649554284 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fe0e0 0x7fc7f80fe550 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/2649554284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f80fcef0 0x7fc7f80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 -- 172.21.15.148:0/2649554284 >> 172.21.15.148:0/2649554284 conn(0x7fc7f80f8620 msgr2=0x7fc7f80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 -- 172.21.15.148:0/2649554284 shutdown_connections 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.500+0000 7fc7ffc00700 1 -- 172.21.15.148:0/2649554284 wait complete. 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.501+0000 7fc7ffc00700 1 Processor -- start 2024-02-28T16:22:44.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.501+0000 7fc7ffc00700 1 -- start start 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.501+0000 7fc7ffc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fcef0 0x7fc7f810d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.501+0000 7fc7ffc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f80fe0e0 0x7fc7f810ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.501+0000 7fc7ffc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f810e560 con 0x7fc7f80fcef0 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.501+0000 7fc7ffc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f810eda0 con 0x7fc7f80fe0e0 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7fd200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fcef0 0x7fc7f810d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7fd200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fcef0 0x7fc7f810d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46756/0 (socket says 172.21.15.148:46756) 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7fd200700 1 -- 172.21.15.148:0/216833009 learned_addr learned my addr 172.21.15.148:0/216833009 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:44.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7efe00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f80fe0e0 0x7fc7f810ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7fd200700 1 -- 172.21.15.148:0/216833009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f80fe0e0 msgr2=0x7fc7f810ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7fd200700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f80fe0e0 0x7fc7f810ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7fd200700 1 -- 172.21.15.148:0/216833009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0005040 con 0x7fc7f80fcef0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.502+0000 7fc7fd200700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fcef0 0x7fc7f810d990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b790 tx=0x7fc7e8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.503+0000 7fc7f5600700 1 -- 172.21.15.148:0/216833009 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e800f6f0 con 0x7fc7f80fcef0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.503+0000 7fc7f5600700 1 -- 172.21.15.148:0/216833009 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7e800fd20 con 0x7fc7f80fcef0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.503+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f810f080 con 0x7fc7f80fcef0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.503+0000 7fc7f5600700 1 -- 172.21.15.148:0/216833009 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e80103a0 con 0x7fc7f80fcef0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.503+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f810f5c0 con 0x7fc7f80fcef0 2024-02-28T16:22:44.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.504+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f804bed0 con 0x7fc7f80fcef0 2024-02-28T16:22:44.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.505+0000 7fc7f5600700 1 -- 172.21.15.148:0/216833009 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fc7e8011400 con 0x7fc7f80fcef0 2024-02-28T16:22:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.506+0000 7fc7f5600700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fc7d80692a0 0x7fc7d806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.506+0000 7fc7f5600700 1 -- 172.21.15.148:0/216833009 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fc7e8086fa0 con 0x7fc7f80fcef0 2024-02-28T16:22:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.506+0000 7fc7efe00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fc7d80692a0 0x7fc7d806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:44.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.507+0000 7fc7efe00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fc7d80692a0 0x7fc7d806b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0004f90 tx=0x7fc7e0009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:44.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.511+0000 7fc7f5600700 1 -- 172.21.15.148:0/216833009 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fc7e8056d10 con 0x7fc7f80fcef0 2024-02-28T16:22:44.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.771+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7f810f9d0 con 0x7fc7f80fcef0 2024-02-28T16:22:44.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.962+0000 7fc7f5600700 1 -- 172.21.15.148:0/216833009 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v12) v1 ==== 168+0+0 (secure 0 0 0) 0x7fc7e80568a0 con 0x7fc7f80fcef0 2024-02-28T16:22:44.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fc7d80692a0 msgr2=0x7fc7d806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fc7d80692a0 0x7fc7d806b750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0004f90 tx=0x7fc7e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fcef0 msgr2=0x7fc7f810d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fcef0 0x7fc7f810d990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b790 tx=0x7fc7e8009220 comp rx=0 tx=0).stop 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 shutdown_connections 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f80fcef0 0x7fc7f810d990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fc7d80692a0 0x7fc7d806b750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 --2- 172.21.15.148:0/216833009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f80fe0e0 0x7fc7f810ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:44.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 >> 172.21.15.148:0/216833009 conn(0x7fc7f80f8620 msgr2=0x7fc7f81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 shutdown_connections 2024-02-28T16:22:44.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:44.967+0000 7fc7ffc00700 1 -- 172.21.15.148:0/216833009 wait complete. 2024-02-28T16:22:44.959 INFO:teuthology.orchestra.run.smithi148.stderr:inline data enabled 2024-02-28T16:22:45.157 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: pgmap v252: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-02-28T16:22:45.157 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:standby 2024-02-28T16:22:45.157 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: Dropping low affinity active daemon mds.cephfs.smithi148.mgdxsi in favor of higher affinity standby. 2024-02-28T16:22:45.157 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: Replacing daemon mds.cephfs.smithi148.mgdxsi as rank 0 with standby daemon mds.cephfs.smithi148.nqnotw 2024-02-28T16:22:45.158 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:22:45.158 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:22:45.158 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T16:22:45.158 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: fsmap cephfs:1/1 {0=cephfs.smithi148.nqnotw=up:replay} 2 up:standby 2024-02-28T16:22:45.158 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:44 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/216833009' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-28T16:22:45.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: pgmap v252: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-02-28T16:22:45.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:standby 2024-02-28T16:22:45.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: Dropping low affinity active daemon mds.cephfs.smithi148.mgdxsi in favor of higher affinity standby. 2024-02-28T16:22:45.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: Replacing daemon mds.cephfs.smithi148.mgdxsi as rank 0 with standby daemon mds.cephfs.smithi148.nqnotw 2024-02-28T16:22:45.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:22:45.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:22:45.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T16:22:45.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: fsmap cephfs:1/1 {0=cephfs.smithi148.nqnotw=up:replay} 2 up:standby 2024-02-28T16:22:45.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:44 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/216833009' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-28T16:22:45.891 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:22:45.902 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:22:45.902 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T16:22:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:45 smithi148 ceph-mon[28767]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-28T16:22:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:45 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:reconnect 2024-02-28T16:22:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:45 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] up:boot 2024-02-28T16:22:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:45 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/216833009' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-28T16:22:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:45 smithi148 ceph-mon[28767]: fsmap cephfs:1/1 {0=cephfs.smithi148.nqnotw=up:reconnect} 3 up:standby 2024-02-28T16:22:46.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:45 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:22:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:45 smithi157 ceph-mon[38346]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-28T16:22:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:45 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:reconnect 2024-02-28T16:22:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:45 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] up:boot 2024-02-28T16:22:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:45 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/216833009' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-28T16:22:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:45 smithi157 ceph-mon[38346]: fsmap cephfs:1/1 {0=cephfs.smithi148.nqnotw=up:reconnect} 3 up:standby 2024-02-28T16:22:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:45 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:22:47.003 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:47.221 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: pgmap v254: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 0 B/s wr, 0 op/s 2024-02-28T16:22:47.221 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:rejoin 2024-02-28T16:22:47.221 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:standby 2024-02-28T16:22:47.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: fsmap cephfs:1/1 {0=cephfs.smithi148.nqnotw=up:rejoin} 3 up:standby 2024-02-28T16:22:47.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: daemon mds.cephfs.smithi148.nqnotw is now active in filesystem cephfs as rank 0 2024-02-28T16:22:47.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:47.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:47.222 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:46 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: pgmap v254: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 0 B/s wr, 0 op/s 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:rejoin 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:standby 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: fsmap cephfs:1/1 {0=cephfs.smithi148.nqnotw=up:rejoin} 3 up:standby 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: daemon mds.cephfs.smithi148.nqnotw is now active in filesystem cephfs as rank 0 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:47.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:46 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:48.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:47 smithi148 ceph-mon[28767]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:22:48.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:47 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:active 2024-02-28T16:22:48.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:47 smithi148 ceph-mon[28767]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:standby 2024-02-28T16:22:48.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:47 smithi148 ceph-mon[28767]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:22:48.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:47 smithi157 ceph-mon[38346]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:22:48.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:47 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] up:active 2024-02-28T16:22:48.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:47 smithi157 ceph-mon[38346]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:standby 2024-02-28T16:22:48.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:47 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:22:49.032 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:48 smithi148 ceph-mon[28767]: pgmap v255: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-28T16:22:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:48 smithi157 ceph-mon[38346]: pgmap v255: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-28T16:22:49.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.913+0000 7efc42600700 1 -- 172.21.15.148:0/2132872916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0663c0 msgr2=0x7efc3c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:49.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.913+0000 7efc42600700 1 --2- 172.21.15.148:0/2132872916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0663c0 0x7efc3c0ffb10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efc2c004940 tx=0x7efc2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:49.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.914+0000 7efc42600700 1 -- 172.21.15.148:0/2132872916 shutdown_connections 2024-02-28T16:22:49.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.914+0000 7efc42600700 1 --2- 172.21.15.148:0/2132872916 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c1000e0 0x7efc3c102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:49.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.914+0000 7efc42600700 1 --2- 172.21.15.148:0/2132872916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c0663c0 0x7efc3c0ffb10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:49.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.914+0000 7efc42600700 1 -- 172.21.15.148:0/2132872916 >> 172.21.15.148:0/2132872916 conn(0x7efc3c0f74e0 msgr2=0x7efc3c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:49.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.914+0000 7efc42600700 1 -- 172.21.15.148:0/2132872916 shutdown_connections 2024-02-28T16:22:49.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.914+0000 7efc42600700 1 -- 172.21.15.148:0/2132872916 wait complete. 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.915+0000 7efc42600700 1 Processor -- start 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.915+0000 7efc42600700 1 -- start start 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.915+0000 7efc42600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0663c0 0x7efc3c10d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.915+0000 7efc42600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c1000e0 0x7efc3c10dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.915+0000 7efc42600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c10e550 con 0x7efc3c1000e0 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.915+0000 7efc42600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c10ed90 con 0x7efc3c0663c0 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.916+0000 7efc3aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c1000e0 0x7efc3c10dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.916+0000 7efc3aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c1000e0 0x7efc3c10dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46770/0 (socket says 172.21.15.148:46770) 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.916+0000 7efc3aa00700 1 -- 172.21.15.148:0/4039170408 learned_addr learned my addr 172.21.15.148:0/4039170408 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.916+0000 7efc3b400700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0663c0 0x7efc3c10d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:49.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.916+0000 7efc3aa00700 1 -- 172.21.15.148:0/4039170408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0663c0 msgr2=0x7efc3c10d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.916+0000 7efc3aa00700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0663c0 0x7efc3c10d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.916+0000 7efc3aa00700 1 -- 172.21.15.148:0/4039170408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c005040 con 0x7efc3c1000e0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.917+0000 7efc3aa00700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c1000e0 0x7efc3c10dec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b790 tx=0x7efc28009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.917+0000 7efc33400700 1 -- 172.21.15.148:0/4039170408 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc2800f6f0 con 0x7efc3c1000e0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.917+0000 7efc33400700 1 -- 172.21.15.148:0/4039170408 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc2800fd20 con 0x7efc3c1000e0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.917+0000 7efc33400700 1 -- 172.21.15.148:0/4039170408 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc280103a0 con 0x7efc3c1000e0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.917+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c10f070 con 0x7efc3c1000e0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.917+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c10f5b0 con 0x7efc3c1000e0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.919+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c107af0 con 0x7efc3c1000e0 2024-02-28T16:22:49.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.920+0000 7efc33400700 1 -- 172.21.15.148:0/4039170408 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7efc28011400 con 0x7efc3c1000e0 2024-02-28T16:22:49.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.921+0000 7efc33400700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7efc200692b0 0x7efc2006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:49.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.921+0000 7efc33400700 1 -- 172.21.15.148:0/4039170408 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efc28087140 con 0x7efc3c1000e0 2024-02-28T16:22:49.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.922+0000 7efc3b400700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7efc200692b0 0x7efc2006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:49.912 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.922+0000 7efc3b400700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7efc200692b0 0x7efc2006b760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00b020 tx=0x7efc2c009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:49.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:49.926+0000 7efc33400700 1 -- 172.21.15.148:0/4039170408 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7efc28056d90 con 0x7efc3c1000e0 2024-02-28T16:22:50.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.180+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efc3c04bed0 con 0x7efc3c1000e0 2024-02-28T16:22:50.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.181+0000 7efc33400700 1 -- 172.21.15.148:0/4039170408 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1811 (secure 0 0 0) 0x7efc28056920 con 0x7efc3c1000e0 2024-02-28T16:22:50.171 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:22:50.171 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:22:50.171 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:50.171 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:22:50.171 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:22:50.171 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:22:50.171 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:22:50.172 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:22:50.173 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:22:50.174 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:50.174 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:50.174 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:22:50.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7efc200692b0 msgr2=0x7efc2006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7efc200692b0 0x7efc2006b760 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00b020 tx=0x7efc2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c1000e0 msgr2=0x7efc3c10dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c1000e0 0x7efc3c10dec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7efc2800b790 tx=0x7efc28009220 comp rx=0 tx=0).stop 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 shutdown_connections 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7efc200692b0 0x7efc2006b760 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efc3c0663c0 0x7efc3c10d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 --2- 172.21.15.148:0/4039170408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efc3c1000e0 0x7efc3c10dec0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.184+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 >> 172.21.15.148:0/4039170408 conn(0x7efc3c0f74e0 msgr2=0x7efc3c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.185+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 shutdown_connections 2024-02-28T16:22:50.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:50.185+0000 7efc42600700 1 -- 172.21.15.148:0/4039170408 wait complete. 2024-02-28T16:22:50.176 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:22:51.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:50 smithi148 ceph-mon[28767]: pgmap v256: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-02-28T16:22:51.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:50 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/4039170408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:51.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:50 smithi157 ceph-mon[38346]: pgmap v256: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-02-28T16:22:51.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:50 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/4039170408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:22:51.644 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-28T16:22:52.511 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:53.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:52 smithi157 ceph-mon[38346]: pgmap v257: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-02-28T16:22:53.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:52 smithi148 ceph-mon[28767]: pgmap v257: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 -- 172.21.15.148:0/3966218217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fe0e0 msgr2=0x7fb0c00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/3966218217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fe0e0 0x7fb0c00fe550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac004940 tx=0x7fb0ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 -- 172.21.15.148:0/3966218217 shutdown_connections 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/3966218217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fe0e0 0x7fb0c00fe550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/3966218217 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0c00fcef0 0x7fb0c00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 -- 172.21.15.148:0/3966218217 >> 172.21.15.148:0/3966218217 conn(0x7fb0c00f8620 msgr2=0x7fb0c00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 -- 172.21.15.148:0/3966218217 shutdown_connections 2024-02-28T16:22:54.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.640+0000 7fb0c7e00700 1 -- 172.21.15.148:0/3966218217 wait complete. 2024-02-28T16:22:54.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.641+0000 7fb0c7e00700 1 Processor -- start 2024-02-28T16:22:54.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.641+0000 7fb0c7e00700 1 -- start start 2024-02-28T16:22:54.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c7e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fcef0 0x7fb0c010fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:54.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0c00fe0e0 0x7fb0c01100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:54.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c7e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c01106a0 con 0x7fb0c00fcef0 2024-02-28T16:22:54.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c7e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c0110f40 con 0x7fb0c00fe0e0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c5400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fcef0 0x7fb0c010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c5400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fcef0 0x7fb0c010fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58168/0 (socket says 172.21.15.148:58168) 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c5400700 1 -- 172.21.15.148:0/1042129259 learned_addr learned my addr 172.21.15.148:0/1042129259 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c4a00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0c00fe0e0 0x7fb0c01100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c5400700 1 -- 172.21.15.148:0/1042129259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0c00fe0e0 msgr2=0x7fb0c01100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c5400700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0c00fe0e0 0x7fb0c01100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.642+0000 7fb0c5400700 1 -- 172.21.15.148:0/1042129259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac005040 con 0x7fb0c00fcef0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.643+0000 7fb0c5400700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fcef0 0x7fb0c010fb60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400c8e0 tx=0x7fb0b40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.643+0000 7fb0bd600700 1 -- 172.21.15.148:0/1042129259 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b400a940 con 0x7fb0c00fcef0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.643+0000 7fb0bd600700 1 -- 172.21.15.148:0/1042129259 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0b400ce80 con 0x7fb0c00fcef0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.643+0000 7fb0bd600700 1 -- 172.21.15.148:0/1042129259 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b40113a0 con 0x7fb0c00fcef0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.643+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c0111220 con 0x7fb0c00fcef0 2024-02-28T16:22:54.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.643+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c0111710 con 0x7fb0c00fcef0 2024-02-28T16:22:54.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.645+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c0102210 con 0x7fb0c00fcef0 2024-02-28T16:22:54.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.647+0000 7fb0bd600700 1 -- 172.21.15.148:0/1042129259 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb0b4012400 con 0x7fb0c00fcef0 2024-02-28T16:22:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.647+0000 7fb0bd600700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb0a80692a0 0x7fb0a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.648+0000 7fb0bd600700 1 -- 172.21.15.148:0/1042129259 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb0b40872e0 con 0x7fb0c00fcef0 2024-02-28T16:22:54.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.648+0000 7fb0c4a00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb0a80692a0 0x7fb0a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:54.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.648+0000 7fb0c4a00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb0a80692a0 0x7fb0a806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac004f90 tx=0x7fb0ac009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:54.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.655+0000 7fb0bd600700 1 -- 172.21.15.148:0/1042129259 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb0b4057050 con 0x7fb0c00fcef0 2024-02-28T16:22:54.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.910+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0c004bed0 con 0x7fb0c00fcef0 2024-02-28T16:22:54.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.912+0000 7fb0bd600700 1 -- 172.21.15.148:0/1042129259 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4694 (secure 0 0 0) 0x7fb0b4056be0 con 0x7fb0c00fcef0 2024-02-28T16:22:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb0a80692a0 msgr2=0x7fb0a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb0a80692a0 0x7fb0a806b750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac004f90 tx=0x7fb0ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fcef0 msgr2=0x7fb0c010fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fcef0 0x7fb0c010fb60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400c8e0 tx=0x7fb0b40044c0 comp rx=0 tx=0).stop 2024-02-28T16:22:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 shutdown_connections 2024-02-28T16:22:54.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0c00fcef0 0x7fb0c010fb60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb0a80692a0 0x7fb0a806b750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 --2- 172.21.15.148:0/1042129259 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0c00fe0e0 0x7fb0c01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 >> 172.21.15.148:0/1042129259 conn(0x7fb0c00f8620 msgr2=0x7fb0c00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 shutdown_connections 2024-02-28T16:22:54.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:54.915+0000 7fb0c7e00700 1 -- 172.21.15.148:0/1042129259 wait complete. 2024-02-28T16:22:54.907 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:22:54.921 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:22:55.304 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:55 smithi148 ceph-mon[28767]: pgmap v258: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T16:22:55.304 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:55.304 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:55.304 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:55 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1042129259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:22:55.304 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:55.304 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:55 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:22:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:55 smithi157 ceph-mon[38346]: pgmap v258: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T16:22:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:55 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1042129259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:22:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:22:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:55 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:22:55.700 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-28T16:22:56.279 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:56.279 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:56.279 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:56.279 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:56.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:56.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:22:56.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:56.301 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:22:56.373 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:22:57.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:57 smithi148 ceph-mon[28767]: pgmap v259: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T16:22:57.360 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:57 smithi157 ceph-mon[38346]: pgmap v259: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.3 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-28T16:22:59.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.126+0000 7fb6f2000700 1 -- 172.21.15.148:0/3349478487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 msgr2=0x7fb6ec070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.126+0000 7fb6f2000700 1 --2- 172.21.15.148:0/3349478487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 0x7fb6ec070380 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc004940 tx=0x7fb6dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.127+0000 7fb6f2000700 1 -- 172.21.15.148:0/3349478487 shutdown_connections 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.127+0000 7fb6f2000700 1 --2- 172.21.15.148:0/3349478487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 0x7fb6ec070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.127+0000 7fb6f2000700 1 --2- 172.21.15.148:0/3349478487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 0x7fb6ec070380 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.127+0000 7fb6f2000700 1 -- 172.21.15.148:0/3349478487 >> 172.21.15.148:0/3349478487 conn(0x7fb6ec0f8620 msgr2=0x7fb6ec0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.127+0000 7fb6f2000700 1 -- 172.21.15.148:0/3349478487 shutdown_connections 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.127+0000 7fb6f2000700 1 -- 172.21.15.148:0/3349478487 wait complete. 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.127+0000 7fb6f2000700 1 Processor -- start 2024-02-28T16:22:59.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6f2000700 1 -- start start 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6f2000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 0x7fb6ec113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6f2000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 0x7fb6ec1144e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6f2000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec114ae0 con 0x7fb6ec071f10 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6f2000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec115380 con 0x7fb6ec0708c0 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6eaa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 0x7fb6ec1144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6eb400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 0x7fb6ec113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6eb400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 0x7fb6ec113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:33594/0 (socket says 172.21.15.148:33594) 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.128+0000 7fb6eb400700 1 -- 172.21.15.148:0/44855749 learned_addr learned my addr 172.21.15.148:0/44855749 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6eb400700 1 -- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 msgr2=0x7fb6ec1144e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6eb400700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 0x7fb6ec1144e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6eb400700 1 -- 172.21.15.148:0/44855749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc005040 con 0x7fb6ec0708c0 2024-02-28T16:22:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6eaa00700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 0x7fb6ec1144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:22:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6eb400700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 0x7fb6ec113fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00b3b0 tx=0x7fb6dc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6e3400700 1 -- 172.21.15.148:0/44855749 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6dc00e040 con 0x7fb6ec0708c0 2024-02-28T16:22:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec115600 con 0x7fb6ec0708c0 2024-02-28T16:22:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.129+0000 7fb6e3400700 1 -- 172.21.15.148:0/44855749 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6dc00bd90 con 0x7fb6ec0708c0 2024-02-28T16:22:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.130+0000 7fb6e3400700 1 -- 172.21.15.148:0/44855749 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6dc01c630 con 0x7fb6ec0708c0 2024-02-28T16:22:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.130+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec115b40 con 0x7fb6ec0708c0 2024-02-28T16:22:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.131+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec04bed0 con 0x7fb6ec0708c0 2024-02-28T16:22:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.132+0000 7fb6e3400700 1 -- 172.21.15.148:0/44855749 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb6dc013980 con 0x7fb6ec0708c0 2024-02-28T16:22:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.132+0000 7fb6e3400700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6d00692b0 0x7fb6d006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:22:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.133+0000 7fb6e3400700 1 -- 172.21.15.148:0/44855749 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb6dc088700 con 0x7fb6ec0708c0 2024-02-28T16:22:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.133+0000 7fb6eaa00700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6d00692b0 0x7fb6d006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:22:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.133+0000 7fb6eaa00700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6d00692b0 0x7fb6d006b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8010520 tx=0x7fb6d800b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:22:59.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.138+0000 7fb6e3400700 1 -- 172.21.15.148:0/44855749 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb6dc0583d0 con 0x7fb6ec0708c0 2024-02-28T16:22:59.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.425+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fb6ec10c000 con 0x7fb6ec0708c0 2024-02-28T16:22:59.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.427+0000 7fb6e3400700 1 -- 172.21.15.148:0/44855749 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) v1 ==== 78+0+99 (secure 0 0 0) 0x7fb6dc057f60 con 0x7fb6ec0708c0 2024-02-28T16:22:59.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.430+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6d00692b0 msgr2=0x7fb6d006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:59.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.430+0000 7fb6f2000700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6d00692b0 0x7fb6d006b760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8010520 tx=0x7fb6d800b040 comp rx=0 tx=0).stop 2024-02-28T16:22:59.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.430+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 msgr2=0x7fb6ec113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:22:59.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.430+0000 7fb6f2000700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 0x7fb6ec113fa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00b3b0 tx=0x7fb6dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:22:59.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.430+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 shutdown_connections 2024-02-28T16:22:59.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.430+0000 7fb6f2000700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6d00692b0 0x7fb6d006b760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:59.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.431+0000 7fb6f2000700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6ec0708c0 0x7fb6ec113fa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:59.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.431+0000 7fb6f2000700 1 --2- 172.21.15.148:0/44855749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6ec071f10 0x7fb6ec1144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:22:59.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.431+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 >> 172.21.15.148:0/44855749 conn(0x7fb6ec0f8620 msgr2=0x7fb6ec0fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:22:59.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.431+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 shutdown_connections 2024-02-28T16:22:59.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:22:59.431+0000 7fb6f2000700 1 -- 172.21.15.148:0/44855749 wait complete. 2024-02-28T16:22:59.437 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:22:59.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:59 smithi157 ceph-mon[38346]: pgmap v260: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T16:22:59.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:59 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:59.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:59 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:59.825 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:22:59 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/44855749' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T16:22:59.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:59 smithi148 ceph-mon[28767]: pgmap v260: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T16:22:59.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:59 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:59.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:59 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:22:59.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:22:59 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/44855749' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T16:23:00.579 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-28T16:23:00.592 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.845+0000 7f4ad7600640 1 -- 172.21.15.148:0/3500445740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00fe4c0 msgr2=0x7f4ad00fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.845+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3500445740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00fe4c0 0x7f4ad00fe8d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40048d0 tx=0x7f4ac4009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.846+0000 7f4ad7600640 1 -- 172.21.15.148:0/3500445740 shutdown_connections 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.846+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3500445740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00ff790 0x7f4ad00ffc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.846+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3500445740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00fe4c0 0x7f4ad00fe8d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.846+0000 7f4ad7600640 1 -- 172.21.15.148:0/3500445740 >> 172.21.15.148:0/3500445740 conn(0x7f4ad00f9c80 msgr2=0x7f4ad00fc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.846+0000 7f4ad7600640 1 -- 172.21.15.148:0/3500445740 shutdown_connections 2024-02-28T16:23:00.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.846+0000 7f4ad7600640 1 -- 172.21.15.148:0/3500445740 wait complete. 2024-02-28T16:23:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4ad7600640 1 Processor -- start 2024-02-28T16:23:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4ad7600640 1 -- start start 2024-02-28T16:23:00.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4ad7600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00fe4c0 0x7f4ad010ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4ad7600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00ff790 0x7f4ad010f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4ad7600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad010f9a0 con 0x7f4ad00ff790 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4ad7600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0114320 con 0x7f4ad00fe4c0 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00ff790 0x7f4ad010f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00ff790 0x7f4ad010f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58200/0 (socket says 172.21.15.148:58200) 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.847+0000 7f4acfe00640 1 -- 172.21.15.148:0/3479904913 learned_addr learned my addr 172.21.15.148:0/3479904913 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4ad4c00640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00fe4c0 0x7f4ad010ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4acfe00640 1 -- 172.21.15.148:0/3479904913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00fe4c0 msgr2=0x7f4ad010ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4acfe00640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00fe4c0 0x7f4ad010ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4acfe00640 1 -- 172.21.15.148:0/3479904913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4005040 con 0x7f4ad00ff790 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4acfe00640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00ff790 0x7f4ad010f2c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b790 tx=0x7f4ac00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4accc00640 1 -- 172.21.15.148:0/3479904913 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac000c700 con 0x7f4ad00ff790 2024-02-28T16:23:00.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4accc00640 1 -- 172.21.15.148:0/3479904913 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ac000cd30 con 0x7f4ad00ff790 2024-02-28T16:23:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0114520 con 0x7f4ad00ff790 2024-02-28T16:23:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4accc00640 1 -- 172.21.15.148:0/3479904913 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac0013370 con 0x7f4ad00ff790 2024-02-28T16:23:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.848+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad0114a40 con 0x7f4ad00ff790 2024-02-28T16:23:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.850+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0107090 con 0x7f4ad00ff790 2024-02-28T16:23:00.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.850+0000 7f4accc00640 1 -- 172.21.15.148:0/3479904913 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4ac0012070 con 0x7f4ad00ff790 2024-02-28T16:23:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.851+0000 7f4accc00640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ab8069210 0x7f4ab806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.851+0000 7f4accc00640 1 -- 172.21.15.148:0/3479904913 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4ac0086d00 con 0x7f4ad00ff790 2024-02-28T16:23:00.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.852+0000 7f4ad4c00640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ab8069210 0x7f4ab806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:00.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.852+0000 7f4ad4c00640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ab8069210 0x7f4ab806b6c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4000c00 tx=0x7f4ac4009da0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:00.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:00.857+0000 7f4accc00640 1 -- 172.21.15.148:0/3479904913 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f4ac008a030 con 0x7f4ad00ff790 2024-02-28T16:23:01.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.046+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad0114d10 con 0x7f4ad00ff790 2024-02-28T16:23:01.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.048+0000 7f4accc00640 1 -- 172.21.15.148:0/3479904913 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14452 (secure 0 0 0) 0x7f4ac0052fe0 con 0x7f4ad00ff790 2024-02-28T16:23:01.038 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:23:01.039 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":46,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","created":"2024-02-28T16:12:27.413792+0000","modified":"2024-02-28T16:22:43.947582+0000","last_up_change":"2024-02-28T16:20:42.771456+0000","last_in_change":"2024-02-28T16:20:18.870154+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:18:56.502433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:22:23.698334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:22:24.552110+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"14a7fb44-646e-4c79-82b1-a6911b120a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6803","nonce":2340247336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6805","nonce":2340247336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6809","nonce":2340247336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2340247336},{"type":"v1","addr":"172.21.15.148:6807","nonce":2340247336}]},"public_addr":"172.21.15.148:6803/2340247336","cluster_addr":"172.21.15.148:6805/2340247336","heartbeat_back_addr":"172.21.15.148:6809/2340247336","heartbeat_front_addr":"172.21.15.148:6807/2340247336","state":["exists","up"]},{"osd":1,"uuid":"86d4be70-889a-48bb-8354-5c1191cd11d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6811","nonce":1397774077}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6813","nonce":1397774077}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6817","nonce":1397774077}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1397774077},{"type":"v1","addr":"172.21.15.148:6815","nonce":1397774077}]},"public_addr":"172.21.15.148:6811/1397774077","cluster_addr":"172.21.15.148:6813/1397774077","heartbeat_back_addr":"172.21.15.148:6817/1397774077","heartbeat_front_addr":"172.21.15.148:6815/1397774077","state":["exists","up"]},{"osd":2,"uuid":"fb9f2df8-5f7c-4a5d-897b-7816093d2f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6819","nonce":408082720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6821","nonce":408082720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6825","nonce":408082720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":408082720},{"type":"v1","addr":"172.21.15.148:6823","nonce":408082720}]},"public_addr":"172.21.15.148:6819/408082720","cluster_addr":"172.21.15.148:6821/408082720","heartbeat_back_addr":"172.21.15.148:6825/408082720","heartbeat_front_addr":"172.21.15.148:6823/408082720","state":["exists","up"]},{"osd":3,"uuid":"387e95f1-fb7d-493e-a953-e3a0480bab84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6801","nonce":3186455722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6803","nonce":3186455722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6807","nonce":3186455722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":3186455722},{"type":"v1","addr":"172.21.15.157:6805","nonce":3186455722}]},"public_addr":"172.21.15.157:6801/3186455722","cluster_addr":"172.21.15.157:6803/3186455722","heartbeat_back_addr":"172.21.15.157:6807/3186455722","heartbeat_front_addr":"172.21.15.157:6805/3186455722","state":["exists","up"]},{"osd":4,"uuid":"687be313-3bfd-461c-97bd-1286d0df4890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6809","nonce":1983160877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6811","nonce":1983160877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6815","nonce":1983160877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1983160877},{"type":"v1","addr":"172.21.15.157:6813","nonce":1983160877}]},"public_addr":"172.21.15.157:6809/1983160877","cluster_addr":"172.21.15.157:6811/1983160877","heartbeat_back_addr":"172.21.15.157:6815/1983160877","heartbeat_front_addr":"172.21.15.157:6813/1983160877","state":["exists","up"]},{"osd":5,"uuid":"30cd920d-07ad-4006-b70d-801862f0301a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6817","nonce":1546679359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6819","nonce":1546679359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6823","nonce":1546679359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":1546679359},{"type":"v1","addr":"172.21.15.157:6821","nonce":1546679359}]},"public_addr":"172.21.15.157:6817/1546679359","cluster_addr":"172.21.15.157:6819/1546679359","heartbeat_back_addr":"172.21.15.157:6823/1546679359","heartbeat_front_addr":"172.21.15.157:6821/1546679359","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:37.865181+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:15.892468+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:54.360175+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:19:29.555324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:05.461264+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:41.106302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.148:6827/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:6801/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/3440184585":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/4201431226":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/941593238":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/1252596380":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/3872489504":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/2841519785":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/2468996293":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6826/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:6801/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6800/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1885326731":"2024-02-29T16:15:25.792039+0000","172.21.15.148:6800/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6801/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/3379725707":"2024-02-29T16:15:25.792039+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:23:01.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ab8069210 msgr2=0x7f4ab806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ab8069210 0x7f4ab806b6c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4000c00 tx=0x7f4ac4009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00ff790 msgr2=0x7f4ad010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00ff790 0x7f4ad010f2c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000b790 tx=0x7f4ac00091d0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 shutdown_connections 2024-02-28T16:23:01.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f4ab8069210 0x7f4ab806b6c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ad00ff790 0x7f4ad010f2c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 --2- 172.21.15.148:0/3479904913 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ad00fe4c0 0x7f4ad010ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.051+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 >> 172.21.15.148:0/3479904913 conn(0x7f4ad00f9c80 msgr2=0x7f4ad01029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:01.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.052+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 shutdown_connections 2024-02-28T16:23:01.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.052+0000 7f4ad7600640 1 -- 172.21.15.148:0/3479904913 wait complete. 2024-02-28T16:23:01.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:18:56.502433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:22:23.698334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:22:24.552110+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-28T16:23:01.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:23:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:00 smithi148 ceph-mon[28767]: pgmap v261: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T16:23:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:00 smithi157 ceph-mon[38346]: pgmap v261: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-28T16:23:01.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.265+0000 7fb2d2a00640 1 -- 172.21.15.148:0/415414545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc0ff3d0 msgr2=0x7fb2cc1017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.265+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/415414545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc0ff3d0 0x7fb2cc1017b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80048d0 tx=0x7fb2b8009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.266+0000 7fb2d2a00640 1 -- 172.21.15.148:0/415414545 shutdown_connections 2024-02-28T16:23:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.266+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/415414545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc0ff3d0 0x7fb2cc1017b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.266+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/415414545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2cc066350 0x7fb2cc0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.266+0000 7fb2d2a00640 1 -- 172.21.15.148:0/415414545 >> 172.21.15.148:0/415414545 conn(0x7fb2cc0f6960 msgr2=0x7fb2cc0f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.266+0000 7fb2d2a00640 1 -- 172.21.15.148:0/415414545 shutdown_connections 2024-02-28T16:23:01.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.266+0000 7fb2d2a00640 1 -- 172.21.15.148:0/415414545 wait complete. 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.266+0000 7fb2d2a00640 1 Processor -- start 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2d2a00640 1 -- start start 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2d2a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc066350 0x7fb2cc10edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2d2a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2cc0ff3d0 0x7fb2cc10f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2d2a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc10f940 con 0x7fb2cc066350 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2d2a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc114390 con 0x7fb2cc0ff3d0 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc066350 0x7fb2cc10edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2cbe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc066350 0x7fb2cc10edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58218/0 (socket says 172.21.15.148:58218) 2024-02-28T16:23:01.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2cbe00640 1 -- 172.21.15.148:0/3833576782 learned_addr learned my addr 172.21.15.148:0/3833576782 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2cb400640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2cc0ff3d0 0x7fb2cc10f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.267+0000 7fb2cbe00640 1 -- 172.21.15.148:0/3833576782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2cc0ff3d0 msgr2=0x7fb2cc10f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2cbe00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2cc0ff3d0 0x7fb2cc10f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2cbe00640 1 -- 172.21.15.148:0/3833576782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8005040 con 0x7fb2cc066350 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2cb400640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2cc0ff3d0 0x7fb2cc10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2cbe00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc066350 0x7fb2cc10edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc002840 tx=0x7fb2bc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2c3e00640 1 -- 172.21.15.148:0/3833576782 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2bc007c30 con 0x7fb2cc066350 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2c3e00640 1 -- 172.21.15.148:0/3833576782 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2bc00f040 con 0x7fb2cc066350 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc114530 con 0x7fb2cc066350 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2c3e00640 1 -- 172.21.15.148:0/3833576782 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2bc009590 con 0x7fb2cc066350 2024-02-28T16:23:01.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.268+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc114a20 con 0x7fb2cc066350 2024-02-28T16:23:01.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.270+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc0f8400 con 0x7fb2cc066350 2024-02-28T16:23:01.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.270+0000 7fb2c3e00640 1 -- 172.21.15.148:0/3833576782 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb2bc00d6b0 con 0x7fb2cc066350 2024-02-28T16:23:01.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.271+0000 7fb2c3e00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb2b0069210 0x7fb2b006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:01.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.271+0000 7fb2c3e00640 1 -- 172.21.15.148:0/3833576782 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb2bc087120 con 0x7fb2cc066350 2024-02-28T16:23:01.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.271+0000 7fb2cb400640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb2b0069210 0x7fb2b006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:01.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.272+0000 7fb2cb400640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb2b0069210 0x7fb2b006b6c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb2b802bda0 tx=0x7fb2b8009da0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:01.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.276+0000 7fb2c3e00640 1 -- 172.21.15.148:0/3833576782 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb2bc053380 con 0x7fb2cc066350 2024-02-28T16:23:01.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.466+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2cc02ab10 con 0x7fb2cc066350 2024-02-28T16:23:01.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.467+0000 7fb2c3e00640 1 -- 172.21.15.148:0/3833576782 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2bc0569a0 con 0x7fb2cc066350 2024-02-28T16:23:01.457 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-02-28T16:23:01.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb2b0069210 msgr2=0x7fb2b006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb2b0069210 0x7fb2b006b6c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb2b802bda0 tx=0x7fb2b8009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc066350 msgr2=0x7fb2cc10edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc066350 0x7fb2cc10edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc002840 tx=0x7fb2bc004570 comp rx=0 tx=0).stop 2024-02-28T16:23:01.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 shutdown_connections 2024-02-28T16:23:01.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb2b0069210 0x7fb2b006b6c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2cc0ff3d0 0x7fb2cc10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 --2- 172.21.15.148:0/3833576782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc066350 0x7fb2cc10edb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 >> 172.21.15.148:0/3833576782 conn(0x7fb2cc0f6960 msgr2=0x7fb2cc100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:01.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 shutdown_connections 2024-02-28T16:23:01.461 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.470+0000 7fb2d2a00640 1 -- 172.21.15.148:0/3833576782 wait complete. 2024-02-28T16:23:01.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 -- 172.21.15.148:0/1346613002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd888071300 msgr2=0x7fd88806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 --2- 172.21.15.148:0/1346613002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd888071300 0x7fd88806f830 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0048d0 tx=0x7fd87c009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 -- 172.21.15.148:0/1346613002 shutdown_connections 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 --2- 172.21.15.148:0/1346613002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd88806fd70 0x7fd8880701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 --2- 172.21.15.148:0/1346613002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd888071300 0x7fd88806f830 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 -- 172.21.15.148:0/1346613002 >> 172.21.15.148:0/1346613002 conn(0x7fd8880f7a60 msgr2=0x7fd8880f9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 -- 172.21.15.148:0/1346613002 shutdown_connections 2024-02-28T16:23:01.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.693+0000 7fd88fc00640 1 -- 172.21.15.148:0/1346613002 wait complete. 2024-02-28T16:23:01.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.694+0000 7fd88fc00640 1 Processor -- start 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.694+0000 7fd88fc00640 1 -- start start 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.694+0000 7fd88fc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88806fd70 0x7fd88810ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.694+0000 7fd88fc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd888071300 0x7fd88810f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.694+0000 7fd88fc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810f8f0 con 0x7fd88806fd70 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.694+0000 7fd88fc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888114300 con 0x7fd888071300 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd88d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88806fd70 0x7fd88810ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd88d200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88806fd70 0x7fd88810ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58238/0 (socket says 172.21.15.148:58238) 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd88d200640 1 -- 172.21.15.148:0/2175129974 learned_addr learned my addr 172.21.15.148:0/2175129974 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd887e00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd888071300 0x7fd88810f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd88d200640 1 -- 172.21.15.148:0/2175129974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd888071300 msgr2=0x7fd88810f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd88d200640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd888071300 0x7fd88810f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd88d200640 1 -- 172.21.15.148:0/2175129974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd87c005040 con 0x7fd88806fd70 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd887e00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd888071300 0x7fd88810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.695+0000 7fd88d200640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88806fd70 0x7fd88810ed60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd87c02bda0 tx=0x7fd87c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:01.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.696+0000 7fd884c00640 1 -- 172.21.15.148:0/2175129974 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87c0094c0 con 0x7fd88806fd70 2024-02-28T16:23:01.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.696+0000 7fd884c00640 1 -- 172.21.15.148:0/2175129974 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd87c009620 con 0x7fd88806fd70 2024-02-28T16:23:01.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.696+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd888114440 con 0x7fd88806fd70 2024-02-28T16:23:01.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.696+0000 7fd884c00640 1 -- 172.21.15.148:0/2175129974 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87c0435f0 con 0x7fd88806fd70 2024-02-28T16:23:01.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.696+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8881148b0 con 0x7fd88806fd70 2024-02-28T16:23:01.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.697+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd888107000 con 0x7fd88806fd70 2024-02-28T16:23:01.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.698+0000 7fd884c00640 1 -- 172.21.15.148:0/2175129974 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fd87c02f070 con 0x7fd88806fd70 2024-02-28T16:23:01.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.699+0000 7fd884c00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd870069220 0x7fd87006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:01.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.700+0000 7fd884c00640 1 -- 172.21.15.148:0/2175129974 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd87c0a91e0 con 0x7fd88806fd70 2024-02-28T16:23:01.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.700+0000 7fd887e00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd870069220 0x7fd87006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:01.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.700+0000 7fd887e00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd870069220 0x7fd87006b6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd874004d80 tx=0x7fd87400b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:01.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.703+0000 7fd884c00640 1 -- 172.21.15.148:0/2175129974 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fd87c075440 con 0x7fd88806fd70 2024-02-28T16:23:01.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.910+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fd888107190 con 0x7fd88806fd70 2024-02-28T16:23:01.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.910+0000 7fd884c00640 1 -- 172.21.15.148:0/2175129974 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd888107190 con 0x7fd88806fd70 2024-02-28T16:23:01.900 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd870069220 msgr2=0x7fd87006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd870069220 0x7fd87006b6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd874004d80 tx=0x7fd87400b040 comp rx=0 tx=0).stop 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88806fd70 msgr2=0x7fd88810ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88806fd70 0x7fd88810ed60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd87c02bda0 tx=0x7fd87c009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 shutdown_connections 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fd870069220 0x7fd87006b6d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd888071300 0x7fd88810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 --2- 172.21.15.148:0/2175129974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd88806fd70 0x7fd88810ed60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:01.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 >> 172.21.15.148:0/2175129974 conn(0x7fd8880f7a60 msgr2=0x7fd888102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 shutdown_connections 2024-02-28T16:23:01.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:01.913+0000 7fd88fc00640 1 -- 172.21.15.148:0/2175129974 wait complete. 2024-02-28T16:23:01.920 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:23:02.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:01 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3479904913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:23:02.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:01 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3833576782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:23:02.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.141+0000 7fcd50a00640 1 -- 172.21.15.148:0/393421091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c065d20 msgr2=0x7fcd4c0fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.141+0000 7fcd50a00640 1 --2- 172.21.15.148:0/393421091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c065d20 0x7fcd4c0fef10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0048d0 tx=0x7fcd3c009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 -- 172.21.15.148:0/393421091 shutdown_connections 2024-02-28T16:23:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 --2- 172.21.15.148:0/393421091 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd4c0ff4e0 0x7fcd4c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 --2- 172.21.15.148:0/393421091 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c065d20 0x7fcd4c0fef10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 -- 172.21.15.148:0/393421091 >> 172.21.15.148:0/393421091 conn(0x7fcd4c0f6900 msgr2=0x7fcd4c0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 -- 172.21.15.148:0/393421091 shutdown_connections 2024-02-28T16:23:02.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 -- 172.21.15.148:0/393421091 wait complete. 2024-02-28T16:23:02.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 Processor -- start 2024-02-28T16:23:02.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.142+0000 7fcd50a00640 1 -- start start 2024-02-28T16:23:02.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd50a00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd4c065d20 0x7fcd4c10cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd50a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c0ff4e0 0x7fcd4c10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd50a00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c10d770 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd50a00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c112180 con 0x7fcd4c065d20 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd49400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c0ff4e0 0x7fcd4c10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd49400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c0ff4e0 0x7fcd4c10d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50022/0 (socket says 172.21.15.148:50022) 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd49400640 1 -- 172.21.15.148:0/3532400111 learned_addr learned my addr 172.21.15.148:0/3532400111 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd49e00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd4c065d20 0x7fcd4c10cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.143+0000 7fcd49400640 1 -- 172.21.15.148:0/3532400111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd4c065d20 msgr2=0x7fcd4c10cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd49400640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd4c065d20 0x7fcd4c10cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd49400640 1 -- 172.21.15.148:0/3532400111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c005040 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd49400640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c0ff4e0 0x7fcd4c10d120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c760 tx=0x7fcd380043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd42000640 1 -- 172.21.15.148:0/3532400111 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3800a710 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd42000640 1 -- 172.21.15.148:0/3532400111 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd3800ad40 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c112320 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd42000640 1 -- 172.21.15.148:0/3532400111 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd380113a0 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.144+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c1127c0 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.146+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c104e60 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.146+0000 7fcd42000640 1 -- 172.21.15.148:0/3532400111 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fcd38012400 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.147+0000 7fcd42000640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fcd30069220 0x7fcd3006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:02.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.147+0000 7fcd42000640 1 -- 172.21.15.148:0/3532400111 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcd38087300 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.147+0000 7fcd49e00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fcd30069220 0x7fcd3006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:02.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.148+0000 7fcd49e00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fcd30069220 0x7fcd3006b6d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c034040 tx=0x7fcd3c009da0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:02.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.155+0000 7fcd42000640 1 -- 172.21.15.148:0/3532400111 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fcd380535c0 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:01 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3479904913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:23:02.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:01 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3833576782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:23:02.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.349+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fcd4c112a90 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.350+0000 7fcd42000640 1 -- 172.21.15.148:0/3532400111 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fcd38056be0 con 0x7fcd4c0ff4e0 2024-02-28T16:23:02.340 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:23:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.352+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fcd30069220 msgr2=0x7fcd3006b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.352+0000 7fcd50a00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fcd30069220 0x7fcd3006b6d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c034040 tx=0x7fcd3c009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.352+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c0ff4e0 msgr2=0x7fcd4c10d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.352+0000 7fcd50a00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c0ff4e0 0x7fcd4c10d120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c760 tx=0x7fcd380043c0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.353+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 shutdown_connections 2024-02-28T16:23:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.353+0000 7fcd50a00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fcd30069220 0x7fcd3006b6d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.353+0000 7fcd50a00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcd4c0ff4e0 0x7fcd4c10d120 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.353+0000 7fcd50a00640 1 --2- 172.21.15.148:0/3532400111 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcd4c065d20 0x7fcd4c10cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.353+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 >> 172.21.15.148:0/3532400111 conn(0x7fcd4c0f6900 msgr2=0x7fcd4c0f8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.353+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 shutdown_connections 2024-02-28T16:23:02.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.353+0000 7fcd50a00640 1 -- 172.21.15.148:0/3532400111 wait complete. 2024-02-28T16:23:02.360 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 -- 172.21.15.148:0/3424423195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 msgr2=0x7fdee40ff030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 --2- 172.21.15.148:0/3424423195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee40ff030 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fded40048d0 tx=0x7fded4009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 -- 172.21.15.148:0/3424423195 shutdown_connections 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 --2- 172.21.15.148:0/3424423195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee40ff570 0x7fdee4101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 --2- 172.21.15.148:0/3424423195 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee40ff030 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 -- 172.21.15.148:0/3424423195 >> 172.21.15.148:0/3424423195 conn(0x7fdee40f66d0 msgr2=0x7fdee40f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 -- 172.21.15.148:0/3424423195 shutdown_connections 2024-02-28T16:23:02.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.578+0000 7fdee9600640 1 -- 172.21.15.148:0/3424423195 wait complete. 2024-02-28T16:23:02.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee9600640 1 Processor -- start 2024-02-28T16:23:02.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee9600640 1 -- start start 2024-02-28T16:23:02.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee9600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee410ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:02.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee9600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee40ff570 0x7fdee410cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee9600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee410d590 con 0x7fdee40fcc50 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee9600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4111fe0 con 0x7fdee40ff570 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee410ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee3e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee410ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50036/0 (socket says 172.21.15.148:50036) 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.579+0000 7fdee3e00640 1 -- 172.21.15.148:0/1219123914 learned_addr learned my addr 172.21.15.148:0/1219123914 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.580+0000 7fdee3400640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee40ff570 0x7fdee410cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.580+0000 7fdee3e00640 1 -- 172.21.15.148:0/1219123914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee40ff570 msgr2=0x7fdee410cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.580+0000 7fdee3e00640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee40ff570 0x7fdee410cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.580+0000 7fdee3e00640 1 -- 172.21.15.148:0/1219123914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4005040 con 0x7fdee40fcc50 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.580+0000 7fdee3e00640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee410ca00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fded402bda0 tx=0x7fded4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.580+0000 7fdedbe00640 1 -- 172.21.15.148:0/1219123914 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fded40094c0 con 0x7fdee40fcc50 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.581+0000 7fdedbe00640 1 -- 172.21.15.148:0/1219123914 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fded4009620 con 0x7fdee40fcc50 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.581+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee4112120 con 0x7fdee40fcc50 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.581+0000 7fdedbe00640 1 -- 172.21.15.148:0/1219123914 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fded40435f0 con 0x7fdee40fcc50 2024-02-28T16:23:02.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.581+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee41125b0 con 0x7fdee40fcc50 2024-02-28T16:23:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.582+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee4104c70 con 0x7fdee40fcc50 2024-02-28T16:23:02.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.583+0000 7fdedbe00640 1 -- 172.21.15.148:0/1219123914 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fded402f070 con 0x7fdee40fcc50 2024-02-28T16:23:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.583+0000 7fdedbe00640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdec8069220 0x7fdec806b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.584+0000 7fdedbe00640 1 -- 172.21.15.148:0/1219123914 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fded40a9110 con 0x7fdee40fcc50 2024-02-28T16:23:02.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.584+0000 7fdee3400640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdec8069220 0x7fdec806b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:02.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.584+0000 7fdee3400640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdec8069220 0x7fdec806b6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fd0 tx=0x7fded0009e90 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:02.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.588+0000 7fdedbe00640 1 -- 172.21.15.148:0/1219123914 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fded4075370 con 0x7fdee40fcc50 2024-02-28T16:23:02.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.817+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdee4112a50 con 0x7fdee40fcc50 2024-02-28T16:23:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.818+0000 7fdedbe00640 1 -- 172.21.15.148:0/1219123914 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4694 (secure 0 0 0) 0x7fded4078990 con 0x7fdee40fcc50 2024-02-28T16:23:02.808 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:23:02.808 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/143165648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":143165648},{"type":"v1","addr":"172.21.15.148:6827","nonce":143165648}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:22:46.964332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi148.nqnotw","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.148:6829/2703268165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2703268165},{"type":"v1","addr":"172.21.15.148:6829","nonce":2703268165}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-02-28T16:23:02.808 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:23:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdec8069220 msgr2=0x7fdec806b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdec8069220 0x7fdec806b6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fd0 tx=0x7fded0009e90 comp rx=0 tx=0).stop 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 msgr2=0x7fdee410ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee410ca00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fded402bda0 tx=0x7fded4009da0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 shutdown_connections 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fdec8069220 0x7fdec806b6d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee40ff570 0x7fdee410cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 --2- 172.21.15.148:0/1219123914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee40fcc50 0x7fdee410ca00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 >> 172.21.15.148:0/1219123914 conn(0x7fdee40f66d0 msgr2=0x7fdee40f8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 shutdown_connections 2024-02-28T16:23:02.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:02.821+0000 7fdee9600640 1 -- 172.21.15.148:0/1219123914 wait complete. 2024-02-28T16:23:02.829 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-02-28T16:23:02.829 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-28T16:23:02.854 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-28T16:23:02.854 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-02-28T16:23:02.854 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-28T16:23:02.854 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T16:23:02.854 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:02.855 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-28T16:23:02.855 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T16:23:02.855 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:02.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:02.855 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-02-28T16:23:02.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:02.909 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link delete ceph-brx 2024-02-28T16:23:02.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:02 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2175129974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:23:02.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:02 smithi148 ceph-mon[28767]: pgmap v262: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-28T16:23:02.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:02 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3532400111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:23:02.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:02 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1219123914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:23:02.995 INFO:teuthology.orchestra.run.smithi148.stderr:Cannot find device "ceph-brx" 2024-02-28T16:23:02.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:23:02.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:03.000 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-02-28T16:23:03.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:03.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link delete ceph-brx 2024-02-28T16:23:03.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:02 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2175129974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:23:03.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:02 smithi157 ceph-mon[38346]: pgmap v262: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-28T16:23:03.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:02 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3532400111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:23:03.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:02 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1219123914' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:23:03.159 INFO:teuthology.orchestra.run.smithi157.stderr:Cannot find device "ceph-brx" 2024-02-28T16:23:03.163 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:23:03.163 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-28T16:23:03.163 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T16:23:03.650 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:23:04.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:23:04.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:23:04.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:04.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:23:04.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:23:04.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:23:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:23:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:23:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:23:04.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:23:05.829 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:05 smithi148 ceph-mon[28767]: pgmap v263: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-28T16:23:05.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:05 smithi157 ceph-mon[38346]: pgmap v263: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.002+0000 7fb5a5e00700 1 -- 172.21.15.148:0/3421369645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 msgr2=0x7fb5a0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.002+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/3421369645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0103320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb590004940 tx=0x7fb590009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.002+0000 7fb5a5e00700 1 -- 172.21.15.148:0/3421369645 shutdown_connections 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.002+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/3421369645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a01038f0 0x7fb5a00fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.002+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/3421369645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0103320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.002+0000 7fb5a5e00700 1 -- 172.21.15.148:0/3421369645 >> 172.21.15.148:0/3421369645 conn(0x7fb5a00f8ae0 msgr2=0x7fb5a00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.002+0000 7fb5a5e00700 1 -- 172.21.15.148:0/3421369645 shutdown_connections 2024-02-28T16:23:05.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.003+0000 7fb5a5e00700 1 -- 172.21.15.148:0/3421369645 wait complete. 2024-02-28T16:23:05.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.003+0000 7fb5a5e00700 1 Processor -- start 2024-02-28T16:23:05.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.004+0000 7fb5a5e00700 1 -- start start 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.004+0000 7fb5a5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.004+0000 7fb5a5e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a01038f0 0x7fb5a0113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.004+0000 7fb5a5e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a01145e0 con 0x7fb5a0102f50 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.004+0000 7fb5a5e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a010d910 con 0x7fb5a01038f0 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.004+0000 7fb59ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.005+0000 7fb59ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50060/0 (socket says 172.21.15.148:50060) 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.005+0000 7fb59ea00700 1 -- 172.21.15.148:0/1437298350 learned_addr learned my addr 172.21.15.148:0/1437298350 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.005+0000 7fb59e000700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a01038f0 0x7fb5a0113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.005+0000 7fb59ea00700 1 -- 172.21.15.148:0/1437298350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a01038f0 msgr2=0x7fb5a0113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.005+0000 7fb59ea00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a01038f0 0x7fb5a0113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:05.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.005+0000 7fb59ea00700 1 -- 172.21.15.148:0/1437298350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590005040 con 0x7fb5a0102f50 2024-02-28T16:23:05.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.005+0000 7fb59ea00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0113a50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb590009150 tx=0x7fb590009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:05.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.006+0000 7fb596a00700 1 -- 172.21.15.148:0/1437298350 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb59000e040 con 0x7fb5a0102f50 2024-02-28T16:23:05.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.006+0000 7fb596a00700 1 -- 172.21.15.148:0/1437298350 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb59000bbf0 con 0x7fb5a0102f50 2024-02-28T16:23:05.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.006+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a010db90 con 0x7fb5a0102f50 2024-02-28T16:23:05.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.006+0000 7fb596a00700 1 -- 172.21.15.148:0/1437298350 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb59001c630 con 0x7fb5a0102f50 2024-02-28T16:23:05.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.006+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a010e0d0 con 0x7fb5a0102f50 2024-02-28T16:23:05.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.007+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a00fc6e0 con 0x7fb5a0102f50 2024-02-28T16:23:05.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.008+0000 7fb596a00700 1 -- 172.21.15.148:0/1437298350 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb59000bd60 con 0x7fb5a0102f50 2024-02-28T16:23:05.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.009+0000 7fb596a00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb5840692b0 0x7fb58406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:05.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.009+0000 7fb596a00700 1 -- 172.21.15.148:0/1437298350 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb590088690 con 0x7fb5a0102f50 2024-02-28T16:23:05.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.009+0000 7fb59e000700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb5840692b0 0x7fb58406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:05.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.010+0000 7fb59e000700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb5840692b0 0x7fb58406b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5a010f280 tx=0x7fb58c009ee0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:06.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.013+0000 7fb596a00700 1 -- 172.21.15.148:0/1437298350 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb590058360 con 0x7fb5a0102f50 2024-02-28T16:23:06.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.272+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5a010f030 con 0x7fb5a0102f50 2024-02-28T16:23:06.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.273+0000 7fb596a00700 1 -- 172.21.15.148:0/1437298350 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7fb590057ef0 con 0x7fb5a0102f50 2024-02-28T16:23:06.263 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T16:23:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb5840692b0 msgr2=0x7fb58406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb5840692b0 0x7fb58406b760 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb5a010f280 tx=0x7fb58c009ee0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 msgr2=0x7fb5a0113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0113a50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb590009150 tx=0x7fb590009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 shutdown_connections 2024-02-28T16:23:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a0102f50 0x7fb5a0113a50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb5840692b0 0x7fb58406b760 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 --2- 172.21.15.148:0/1437298350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5a01038f0 0x7fb5a0113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:06.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 >> 172.21.15.148:0/1437298350 conn(0x7fb5a00f8ae0 msgr2=0x7fb5a00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:06.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 shutdown_connections 2024-02-28T16:23:06.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:06.276+0000 7fb5a5e00700 1 -- 172.21.15.148:0/1437298350 wait complete. 2024-02-28T16:23:06.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:06 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1437298350' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:23:06.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:06 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1437298350' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:23:07.137 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T16:23:07.137 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T16:23:07.137 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi148.front.sepia.ceph.com 2024-02-28T16:23:07.137 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-28T16:23:07.137 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:07.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T16:23:07.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T16:23:07.138 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T16:23:07.138 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-28T16:23:07.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:07.138 DEBUG:teuthology.orchestra.run.smithi148:> ip addr 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 ::1/128 scope host 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:23:07.194 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a4 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f0 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:da:6a:a5 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: altname enp7s0f1 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:56 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: link/ether 0c:c4:7a:88:72:57 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: inet 172.21.15.148/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft 41867sec preferred_lft 41867sec 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: inet6 fe80::ec4:7aff:fe88:7257/64 scope link 2024-02-28T16:23:07.195 INFO:teuthology.orchestra.run.smithi148.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:23:07.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T16:23:07.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:07.197 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-02-28T16:23:07.197 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-02-28T16:23:07.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add name ceph-brx type bridge 2024-02-28T16:23:07.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr flush dev ceph-brx 2024-02-28T16:23:07.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set ceph-brx up 2024-02-28T16:23:07.197 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T16:23:07.197 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-02-28T16:23:07.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:07.667 DEBUG:teuthology.orchestra.run.smithi148:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T16:23:07.744 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-02-28T16:23:07.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:07.747 DEBUG:teuthology.orchestra.run.smithi148:> route 2024-02-28T16:23:07.812 INFO:teuthology.orchestra.run.smithi148.stdout:Kernel IP routing table 2024-02-28T16:23:07.812 INFO:teuthology.orchestra.run.smithi148.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T16:23:07.812 INFO:teuthology.orchestra.run.smithi148.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-28T16:23:07.812 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-28T16:23:07.812 INFO:teuthology.orchestra.run.smithi148.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T16:23:07.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:07.813 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-02-28T16:23:07.813 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-02-28T16:23:07.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-28T16:23:07.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-28T16:23:07.813 DEBUG:teuthology.orchestra.run.smithi148:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-28T16:23:07.813 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-02-28T16:23:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:07 smithi148 ceph-mon[28767]: pgmap v264: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:07.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:07 smithi157 ceph-mon[38346]: pgmap v264: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:08.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:08.505 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list 2024-02-28T16:23:08.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:08.560 DEBUG:teuthology.orchestra.run.smithi148:> ip netns list-id 2024-02-28T16:23:08.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:08.617 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-02-28T16:23:08.617 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-02-28T16:23:08.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:23:08.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-28T16:23:08.617 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-02-28T16:23:08.761 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-28T16:23:08.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-28T16:23:08.762 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-02-28T16:23:09.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:09.036 DEBUG:teuthology.orchestra.run.smithi148:> (cd / && exec bash -c ' 2024-02-28T16:23:09.037 DEBUG:teuthology.orchestra.run.smithi148:> set -e 2024-02-28T16:23:09.037 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set brx.0 up 2024-02-28T16:23:09.037 DEBUG:teuthology.orchestra.run.smithi148:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T16:23:09.037 DEBUG:teuthology.orchestra.run.smithi148:> ') 2024-02-28T16:23:09.202 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-28T16:23:09.203 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:23:09.203 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:09.246 INFO:teuthology.orchestra.run.smithi148.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-28T16:23:09.246 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:23:09.247 DEBUG:teuthology.orchestra.run.smithi148:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:09.342 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-02-28T16:23:09.431 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:23:09.485 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-02-28T16:23:09.485 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-02-28T16:23:09.485 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-02-28T16:23:09.485 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-02-28T16:23:09.485 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-02-28T16:23:09.485 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/selinux 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-02-28T16:23:09.486 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/0f288b32dd20540d41d10eb818e586ffa4bb7a64dbeafff62e73032a15eedaf9/merged 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/c6509799a111855411e2c90436efd907473aef0e72bffc46560ebb149febe8e5/merged 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/0 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/13ca61dac9a343f417d07122aa5242ba3b71549a21b219c3c71de8dc6cc65568/merged 2024-02-28T16:23:09.487 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/463b6c9359df9c00fb05f0ba783ff32aca86baef7692f17f58392fe3a807f94b/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/7362a8e04b8d58c7021fe26aac943dae2cf1a32e365f65e2af233a72b0f78dd2/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/05475802f4858c7f70f53d87ff76ff4fc8d16b55a8965054a667ac450c8c6dae/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/3d14a6381d9da56bd7eedf7838a8ac95151f79d08e91dc0aa5d1a1c4a4c090d3/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4826a1a9ca2b6d1d6cd5821862024712d586cf70b88b3bc934edc24fa99efe9c/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/a718279958713ee69de1b90ca9b67dadce9f4bd64cf90a61a3bb23298e5ce7d0/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4d50327ac0d616bbd2ac931b29ab6a6274f2bd75b9662379090648114d554b87/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4f2970d94c1661be0b714bf9d582fea49982bfb7465087c493b77ec85f14bff2/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/1524a040043341d989990f35a644782269407426e026ffd18fec43b0a6e75d03/merged 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:23:09.488 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:23:09.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:09.489 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-02-28T16:23:09.535 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T16:23:09.535 DEBUG:teuthology.orchestra.run.smithi148:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-28T16:23:09.581 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-02-28T16:23:09.653 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:23:09.685 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:09 smithi148 ceph-mon[28767]: pgmap v265: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:09.693 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-02-28T16:23:09.693 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-02-28T16:23:09.693 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-02-28T16:23:09.693 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-02-28T16:23:09.693 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-02-28T16:23:09.693 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/selinux 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:23:09.694 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/0f288b32dd20540d41d10eb818e586ffa4bb7a64dbeafff62e73032a15eedaf9/merged 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/c6509799a111855411e2c90436efd907473aef0e72bffc46560ebb149febe8e5/merged 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/0 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/13ca61dac9a343f417d07122aa5242ba3b71549a21b219c3c71de8dc6cc65568/merged 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/463b6c9359df9c00fb05f0ba783ff32aca86baef7692f17f58392fe3a807f94b/merged 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/7362a8e04b8d58c7021fe26aac943dae2cf1a32e365f65e2af233a72b0f78dd2/merged 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/05475802f4858c7f70f53d87ff76ff4fc8d16b55a8965054a667ac450c8c6dae/merged 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/3d14a6381d9da56bd7eedf7838a8ac95151f79d08e91dc0aa5d1a1c4a4c090d3/merged 2024-02-28T16:23:09.695 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4826a1a9ca2b6d1d6cd5821862024712d586cf70b88b3bc934edc24fa99efe9c/merged 2024-02-28T16:23:09.696 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/a718279958713ee69de1b90ca9b67dadce9f4bd64cf90a61a3bb23298e5ce7d0/merged 2024-02-28T16:23:09.696 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4d50327ac0d616bbd2ac931b29ab6a6274f2bd75b9662379090648114d554b87/merged 2024-02-28T16:23:09.696 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4f2970d94c1661be0b714bf9d582fea49982bfb7465087c493b77ec85f14bff2/merged 2024-02-28T16:23:09.696 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/1524a040043341d989990f35a644782269407426e026ffd18fec43b0a6e75d03/merged 2024-02-28T16:23:09.696 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-02-28T16:23:09.696 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:23:09.696 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:23:09.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:09.697 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-02-28T16:23:09.779 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:2024-02-28T16:23:09.790+0000 7ff0fa0c0300 -1 init, newargv = 0x56468e23b240 newargc=15 2024-02-28T16:23:09.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:ceph-fuse[76602]: starting ceph client 2024-02-28T16:23:09.793 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:ceph-fuse[76602]: starting fuse 2024-02-28T16:23:09.824 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:09 smithi157 ceph-mon[38346]: pgmap v265: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:10.886 DEBUG:teuthology.orchestra.run.smithi148:> sudo modprobe fuse 2024-02-28T16:23:10.979 DEBUG:teuthology.orchestra.run.smithi148:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/proc 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/sys 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/dev 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/security 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/shm 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/pts 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/run 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/cgroup 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/pstore 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/bpf 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/ 2024-02-28T16:23:11.029 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/selinux 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/hugepages 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/dev/mqueue 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/debug 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/tracing 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/fs/fuse/connections 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/sys/kernel/config 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/1000 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/ceph 2024-02-28T16:23:11.030 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/0f288b32dd20540d41d10eb818e586ffa4bb7a64dbeafff62e73032a15eedaf9/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/c6509799a111855411e2c90436efd907473aef0e72bffc46560ebb149febe8e5/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/run/user/0 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/13ca61dac9a343f417d07122aa5242ba3b71549a21b219c3c71de8dc6cc65568/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/463b6c9359df9c00fb05f0ba783ff32aca86baef7692f17f58392fe3a807f94b/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/7362a8e04b8d58c7021fe26aac943dae2cf1a32e365f65e2af233a72b0f78dd2/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/05475802f4858c7f70f53d87ff76ff4fc8d16b55a8965054a667ac450c8c6dae/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/3d14a6381d9da56bd7eedf7838a8ac95151f79d08e91dc0aa5d1a1c4a4c090d3/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4826a1a9ca2b6d1d6cd5821862024712d586cf70b88b3bc934edc24fa99efe9c/merged 2024-02-28T16:23:11.031 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/a718279958713ee69de1b90ca9b67dadce9f4bd64cf90a61a3bb23298e5ce7d0/merged 2024-02-28T16:23:11.032 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4d50327ac0d616bbd2ac931b29ab6a6274f2bd75b9662379090648114d554b87/merged 2024-02-28T16:23:11.032 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/4f2970d94c1661be0b714bf9d582fea49982bfb7465087c493b77ec85f14bff2/merged 2024-02-28T16:23:11.032 INFO:teuthology.orchestra.run.smithi148.stdout:/var/lib/containers/storage/overlay/1524a040043341d989990f35a644782269407426e026ffd18fec43b0a6e75d03/merged 2024-02-28T16:23:11.032 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns 2024-02-28T16:23:11.032 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:23:11.032 INFO:teuthology.orchestra.run.smithi148.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T16:23:11.032 INFO:teuthology.orchestra.run.smithi148.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:11.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:11.033 DEBUG:teuthology.orchestra.run.smithi148:> ls /sys/fs/fuse/connections 2024-02-28T16:23:11.078 INFO:teuthology.orchestra.run.smithi148.stdout:147 2024-02-28T16:23:11.078 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [147] 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> sudo stdin-killer -- python3 -c ' 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> import glob 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> import re 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> import os 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> import subprocess 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> def _find_admin_socket(client_name): 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> files = glob.glob(asok_path) 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> # Given a non-glob path, it better be there 2024-02-28T16:23:11.079 DEBUG:teuthology.orchestra.run.smithi148:> if "*" not in asok_path: 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> assert(len(files) == 1) 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> return files[0] 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> for f in files: 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> contents = proc_f.read() 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> if mountpoint in contents: 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> return f 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> print(_find_admin_socket("client.0")) 2024-02-28T16:23:11.080 DEBUG:teuthology.orchestra.run.smithi148:> ' 2024-02-28T16:23:11.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:10 smithi148 ceph-mon[28767]: pgmap v266: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:11.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:10 smithi157 ceph-mon[38346]: pgmap v266: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:11.297 INFO:teuthology.orchestra.run.smithi148.stdout:/var/run/ceph/ceph-client.0.76602.asok 2024-02-28T16:23:11.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T16:23:11.312 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76602.asok 2024-02-28T16:23:11.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:11.312 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76602.asok status 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: "metadata": { 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_sha1": "c0f02e608ed955f887728ffa27c686f52f9fd400", 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: "entity_id": "0", 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: "hostname": "smithi148", 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-28T16:23:11.541 INFO:teuthology.orchestra.run.smithi148.stdout: "pid": "76602", 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "root": "/" 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_count": 0, 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "dentry_pinned_count": 0, 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "id": 14540, 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "inst": { 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "name": { 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "client", 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "num": 14540 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-02-28T16:23:11.542 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1904265939 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": { 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "type": "v1", 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "nonce": 1904265939 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "inst_str": "client.14540 192.168.0.1:0/1904265939", 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "addr_str": "192.168.0.1:0/1904265939", 2024-02-28T16:23:11.543 INFO:teuthology.orchestra.run.smithi148.stdout: "inode_count": 1, 2024-02-28T16:23:11.544 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_epoch": 14, 2024-02-28T16:23:11.544 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch": 46, 2024-02-28T16:23:11.544 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_epoch_barrier": 0, 2024-02-28T16:23:11.544 INFO:teuthology.orchestra.run.smithi148.stdout: "blocklisted": false, 2024-02-28T16:23:11.544 INFO:teuthology.orchestra.run.smithi148.stdout: "fs_name": "cephfs" 2024-02-28T16:23:11.544 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:23:11.556 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T16:23:12.029 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:23:12.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:12.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:13.114 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:12 smithi148 ceph-mon[28767]: pgmap v267: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:13.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:12 smithi157 ceph-mon[38346]: pgmap v267: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:14.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 -- 172.21.15.148:0/3170316629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 msgr2=0x7f4910109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:14.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 --2- 172.21.15.148:0/3170316629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910109050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f48f8004970 tx=0x7f48f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:14.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 -- 172.21.15.148:0/3170316629 shutdown_connections 2024-02-28T16:23:14.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 --2- 172.21.15.148:0/3170316629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910109050 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:14.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 --2- 172.21.15.148:0/3170316629 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4910070330 0x7f4910070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:14.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 -- 172.21.15.148:0/3170316629 >> 172.21.15.148:0/3170316629 conn(0x7f49100f88b0 msgr2=0x7f49100facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:14.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 -- 172.21.15.148:0/3170316629 shutdown_connections 2024-02-28T16:23:14.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.440+0000 7f490f200700 1 -- 172.21.15.148:0/3170316629 wait complete. 2024-02-28T16:23:14.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.441+0000 7f490f200700 1 Processor -- start 2024-02-28T16:23:14.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.441+0000 7f490f200700 1 -- start start 2024-02-28T16:23:14.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490f200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4910070330 0x7f49101159f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:14.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490f200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910115f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:14.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490f200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4910116580 con 0x7f4910070c40 2024-02-28T16:23:14.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490f200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491010f8b0 con 0x7f4910070330 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910115f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910115f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44982/0 (socket says 172.21.15.148:44982) 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490d400700 1 -- 172.21.15.148:0/2920069671 learned_addr learned my addr 172.21.15.148:0/2920069671 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490de00700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4910070330 0x7f49101159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490d400700 1 -- 172.21.15.148:0/2920069671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4910070330 msgr2=0x7f49101159f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.442+0000 7f490d400700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4910070330 0x7f49101159f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.443+0000 7f490d400700 1 -- 172.21.15.148:0/2920069671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f8005040 con 0x7f4910070c40 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.443+0000 7f490d400700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910115f30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f48f8004f50 tx=0x7f48f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.443+0000 7f4906000700 1 -- 172.21.15.148:0/2920069671 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48f800e040 con 0x7f4910070c40 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.443+0000 7f4906000700 1 -- 172.21.15.148:0/2920069671 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48f8004290 con 0x7f4910070c40 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.443+0000 7f4906000700 1 -- 172.21.15.148:0/2920069671 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48f801c630 con 0x7f4910070c40 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.443+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491010fb30 con 0x7f4910070c40 2024-02-28T16:23:14.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.443+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4910110070 con 0x7f4910070c40 2024-02-28T16:23:14.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.444+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910106710 con 0x7f4910070c40 2024-02-28T16:23:14.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.445+0000 7f4906000700 1 -- 172.21.15.148:0/2920069671 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f48f800bc10 con 0x7f4910070c40 2024-02-28T16:23:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.446+0000 7f4906000700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f48f40692b0 0x7f48f406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.446+0000 7f4906000700 1 -- 172.21.15.148:0/2920069671 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f48f8088590 con 0x7f4910070c40 2024-02-28T16:23:14.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.447+0000 7f490de00700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f48f40692b0 0x7f48f406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:14.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.447+0000 7f490de00700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f48f40692b0 0x7f48f406b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49000049b0 tx=0x7f4900009ee0 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:14.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.451+0000 7f4906000700 1 -- 172.21.15.148:0/2920069671 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f48f8058390 con 0x7f4910070c40 2024-02-28T16:23:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.707+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f491010c030 con 0x7f4910070c40 2024-02-28T16:23:14.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.708+0000 7f4906000700 1 -- 172.21.15.148:0/2920069671 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+83 (secure 0 0 0) 0x7f48f8013e60 con 0x7f4910070c40 2024-02-28T16:23:14.698 INFO:teuthology.orchestra.run.smithi148.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.710+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f48f40692b0 msgr2=0x7f48f406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.710+0000 7f490f200700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f48f40692b0 0x7f48f406b760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49000049b0 tx=0x7f4900009ee0 comp rx=0 tx=0).stop 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.710+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 msgr2=0x7f4910115f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.710+0000 7f490f200700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910115f30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f48f8004f50 tx=0x7f48f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.711+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 shutdown_connections 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.711+0000 7f490f200700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f48f40692b0 0x7f48f406b760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.711+0000 7f490f200700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4910070330 0x7f49101159f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.711+0000 7f490f200700 1 --2- 172.21.15.148:0/2920069671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4910070c40 0x7f4910115f30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.711+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 >> 172.21.15.148:0/2920069671 conn(0x7f49100f88b0 msgr2=0x7f4910103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.711+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 shutdown_connections 2024-02-28T16:23:14.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:14.711+0000 7f490f200700 1 -- 172.21.15.148:0/2920069671 wait complete. 2024-02-28T16:23:15.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:14 smithi157 ceph-mon[38346]: pgmap v268: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:15.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:14 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2920069671' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:23:15.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:14 smithi148 ceph-mon[28767]: pgmap v268: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:15.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:14 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2920069671' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi157.front.sepia.ceph.com 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T16:23:15.533 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T16:23:15.534 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-28T16:23:15.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:15.534 DEBUG:teuthology.orchestra.run.smithi157:> ip addr 2024-02-28T16:23:15.592 INFO:teuthology.orchestra.run.smithi157.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T16:23:15.592 INFO:teuthology.orchestra.run.smithi157.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 ::1/128 scope host 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:98 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f0 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:d9:37:99 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: altname enp7s0f1 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a0 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T16:23:15.593 INFO:teuthology.orchestra.run.smithi157.stdout: link/ether 0c:c4:7a:88:7e:a1 brd ff:ff:ff:ff:ff:ff 2024-02-28T16:23:15.594 INFO:teuthology.orchestra.run.smithi157.stdout: inet 172.21.15.157/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-28T16:23:15.594 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft 41885sec preferred_lft 41885sec 2024-02-28T16:23:15.594 INFO:teuthology.orchestra.run.smithi157.stdout: inet6 fe80::ec4:7aff:fe88:7ea1/64 scope link 2024-02-28T16:23:15.594 INFO:teuthology.orchestra.run.smithi157.stdout: valid_lft forever preferred_lft forever 2024-02-28T16:23:15.595 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T16:23:15.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:15.595 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-02-28T16:23:15.595 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-02-28T16:23:15.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add name ceph-brx type bridge 2024-02-28T16:23:15.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr flush dev ceph-brx 2024-02-28T16:23:15.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set ceph-brx up 2024-02-28T16:23:15.595 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T16:23:15.596 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-02-28T16:23:16.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:16.043 DEBUG:teuthology.orchestra.run.smithi157:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T16:23:16.127 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-02-28T16:23:16.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:16.132 DEBUG:teuthology.orchestra.run.smithi157:> route 2024-02-28T16:23:16.202 INFO:teuthology.orchestra.run.smithi157.stdout:Kernel IP routing table 2024-02-28T16:23:16.202 INFO:teuthology.orchestra.run.smithi157.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T16:23:16.202 INFO:teuthology.orchestra.run.smithi157.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-28T16:23:16.202 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-28T16:23:16.202 INFO:teuthology.orchestra.run.smithi157.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T16:23:16.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:16.203 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-02-28T16:23:16.203 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-02-28T16:23:16.203 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-28T16:23:16.203 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-28T16:23:16.203 DEBUG:teuthology.orchestra.run.smithi157:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-28T16:23:16.203 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-02-28T16:23:16.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:16.923 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list 2024-02-28T16:23:16.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:16.978 DEBUG:teuthology.orchestra.run.smithi157:> ip netns list-id 2024-02-28T16:23:17.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:17.024 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-02-28T16:23:17.024 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-02-28T16:23:17.024 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:23:17.025 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-28T16:23:17.025 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-02-28T16:23:17.194 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:16 smithi157 ceph-mon[38346]: pgmap v269: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:17.209 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-28T16:23:17.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:17.209 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-02-28T16:23:17.209 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-02-28T16:23:17.209 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-28T16:23:17.209 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T16:23:17.209 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-28T16:23:17.209 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-28T16:23:17.210 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-28T16:23:17.210 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-02-28T16:23:17.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:16 smithi148 ceph-mon[28767]: pgmap v269: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:17.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:17.506 DEBUG:teuthology.orchestra.run.smithi157:> (cd / && exec bash -c ' 2024-02-28T16:23:17.506 DEBUG:teuthology.orchestra.run.smithi157:> set -e 2024-02-28T16:23:17.506 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set brx.0 up 2024-02-28T16:23:17.506 DEBUG:teuthology.orchestra.run.smithi157:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T16:23:17.506 DEBUG:teuthology.orchestra.run.smithi157:> ') 2024-02-28T16:23:17.666 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-28T16:23:17.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:23:17.666 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:17.712 INFO:teuthology.orchestra.run.smithi157.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-28T16:23:17.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T16:23:17.713 DEBUG:teuthology.orchestra.run.smithi157:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:17.808 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-02-28T16:23:17.904 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2024-02-28T16:23:17.957 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/selinux 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2024-02-28T16:23:17.958 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/0 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/7ab3654e67b2ac4934ca1b4700c29afa1393ccaae7cfc46b22fc74f45ae688d7/merged 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/3850d377eee41e8cfb8069932c40bb768c4b0e9948bb3c31ad83d91e84e21d63/merged 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/ab47e52e3de59c03c64e6f8c049660a35606106e0045f96fc26f84fddf0da90d/merged 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/a7549e4c7485d56627887b6149f12277339dca6577511d52e6b48b520ddab8e0/merged 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/a9f85cea58c2fe26a4b18c7f1b47825dc706e32fb69058d906dcef8ecdd0030f/merged 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/580aac141000a749c89ded0436384c65a8852ba116c59ae7f1d588e2d6adb912/merged 2024-02-28T16:23:17.959 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/cda619f17f5d1e26d5b95af16aecc7d1981ca96dc83a5da800e99b541682c18c/merged 2024-02-28T16:23:17.960 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/55ea7476f35ce0b8c2a5835a704e1a20c2d23730a286b7d02df36052b09dfcab/merged 2024-02-28T16:23:17.960 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/561fe5ca03fac77f38abd8693d04bebbf8a44685dcc5de00b4f55c44831f78e4/merged 2024-02-28T16:23:17.960 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2024-02-28T16:23:17.960 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:23:17.960 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:23:17.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:17.961 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-02-28T16:23:18.009 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T16:23:18.010 DEBUG:teuthology.orchestra.run.smithi157:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-28T16:23:18.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-02-28T16:23:18.087 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:23:18.127 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2024-02-28T16:23:18.127 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/selinux 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2024-02-28T16:23:18.128 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/0 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/7ab3654e67b2ac4934ca1b4700c29afa1393ccaae7cfc46b22fc74f45ae688d7/merged 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/3850d377eee41e8cfb8069932c40bb768c4b0e9948bb3c31ad83d91e84e21d63/merged 2024-02-28T16:23:18.129 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/ab47e52e3de59c03c64e6f8c049660a35606106e0045f96fc26f84fddf0da90d/merged 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/a7549e4c7485d56627887b6149f12277339dca6577511d52e6b48b520ddab8e0/merged 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/a9f85cea58c2fe26a4b18c7f1b47825dc706e32fb69058d906dcef8ecdd0030f/merged 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/580aac141000a749c89ded0436384c65a8852ba116c59ae7f1d588e2d6adb912/merged 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/cda619f17f5d1e26d5b95af16aecc7d1981ca96dc83a5da800e99b541682c18c/merged 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/55ea7476f35ce0b8c2a5835a704e1a20c2d23730a286b7d02df36052b09dfcab/merged 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/561fe5ca03fac77f38abd8693d04bebbf8a44685dcc5de00b4f55c44831f78e4/merged 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:23:18.130 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:23:18.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:18.131 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-02-28T16:23:18.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi157.stderr:2024-02-28T16:23:18.260+0000 7f342a839300 -1 init, newargv = 0x558672dd1060 newargc=15 2024-02-28T16:23:18.250 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi157.stderr:ceph-fuse[63696]: starting ceph client 2024-02-28T16:23:18.260 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi157.stderr:ceph-fuse[63696]: starting fuse 2024-02-28T16:23:19.295 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:19 smithi148 ceph-mon[28767]: pgmap v270: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:19.317 DEBUG:teuthology.orchestra.run.smithi157:> sudo modprobe fuse 2024-02-28T16:23:19.403 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:19 smithi157 ceph-mon[38346]: pgmap v270: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:19.418 DEBUG:teuthology.orchestra.run.smithi157:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/proc 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/sys 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/dev 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/security 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/shm 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/pts 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/run 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/cgroup 2024-02-28T16:23:19.473 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/pstore 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/bpf 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/ 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/selinux 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/mqueue 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/hugepages 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/debug 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/tracing 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/fs/fuse/connections 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/sys/kernel/config 2024-02-28T16:23:19.474 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T16:23:19.475 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T16:23:19.475 INFO:teuthology.orchestra.run.smithi157.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T16:23:19.475 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T16:23:19.475 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/1000 2024-02-28T16:23:19.475 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/ceph 2024-02-28T16:23:19.475 INFO:teuthology.orchestra.run.smithi157.stdout:/run/user/0 2024-02-28T16:23:19.475 INFO:teuthology.orchestra.run.smithi157.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/7ab3654e67b2ac4934ca1b4700c29afa1393ccaae7cfc46b22fc74f45ae688d7/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/3850d377eee41e8cfb8069932c40bb768c4b0e9948bb3c31ad83d91e84e21d63/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/ab47e52e3de59c03c64e6f8c049660a35606106e0045f96fc26f84fddf0da90d/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/a7549e4c7485d56627887b6149f12277339dca6577511d52e6b48b520ddab8e0/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/a9f85cea58c2fe26a4b18c7f1b47825dc706e32fb69058d906dcef8ecdd0030f/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/580aac141000a749c89ded0436384c65a8852ba116c59ae7f1d588e2d6adb912/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/cda619f17f5d1e26d5b95af16aecc7d1981ca96dc83a5da800e99b541682c18c/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/55ea7476f35ce0b8c2a5835a704e1a20c2d23730a286b7d02df36052b09dfcab/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/var/lib/containers/storage/overlay/561fe5ca03fac77f38abd8693d04bebbf8a44685dcc5de00b4f55c44831f78e4/merged 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns 2024-02-28T16:23:19.476 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:23:19.477 INFO:teuthology.orchestra.run.smithi157.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T16:23:19.477 INFO:teuthology.orchestra.run.smithi157.stdout:/home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:19.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:19.478 DEBUG:teuthology.orchestra.run.smithi157:> ls /sys/fs/fuse/connections 2024-02-28T16:23:19.532 INFO:teuthology.orchestra.run.smithi157.stdout:114 2024-02-28T16:23:19.532 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-02-28T16:23:19.532 DEBUG:teuthology.orchestra.run.smithi157:> sudo stdin-killer -- python3 -c ' 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> import glob 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> import re 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> import os 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> import subprocess 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> def _find_admin_socket(client_name): 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-28T16:23:19.533 DEBUG:teuthology.orchestra.run.smithi157:> files = glob.glob(asok_path) 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> # Given a non-glob path, it better be there 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> if "*" not in asok_path: 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> assert(len(files) == 1) 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> return files[0] 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> 2024-02-28T16:23:19.534 DEBUG:teuthology.orchestra.run.smithi157:> for f in files: 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> contents = proc_f.read() 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> if mountpoint in contents: 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> return f 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T16:23:19.535 DEBUG:teuthology.orchestra.run.smithi157:> 2024-02-28T16:23:19.536 DEBUG:teuthology.orchestra.run.smithi157:> print(_find_admin_socket("client.1")) 2024-02-28T16:23:19.536 DEBUG:teuthology.orchestra.run.smithi157:> ' 2024-02-28T16:23:19.706 INFO:teuthology.orchestra.run.smithi157.stdout:/var/run/ceph/ceph-client.1.63696.asok 2024-02-28T16:23:19.711 INFO:teuthology.orchestra.run.smithi157.stderr:2024-02-28T16:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T16:23:19.725 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.63696.asok 2024-02-28T16:23:19.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:19.725 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.63696.asok status 2024-02-28T16:23:19.959 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-02-28T16:23:19.959 INFO:teuthology.orchestra.run.smithi157.stdout: "metadata": { 2024-02-28T16:23:19.959 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_sha1": "c0f02e608ed955f887728ffa27c686f52f9fd400", 2024-02-28T16:23:19.959 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)", 2024-02-28T16:23:19.959 INFO:teuthology.orchestra.run.smithi157.stdout: "entity_id": "1", 2024-02-28T16:23:19.959 INFO:teuthology.orchestra.run.smithi157.stdout: "hostname": "smithi157", 2024-02-28T16:23:19.959 INFO:teuthology.orchestra.run.smithi157.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: "pid": "63696", 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: "root": "/" 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_count": 0, 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: "dentry_pinned_count": 0, 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: "id": 24309, 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: "inst": { 2024-02-28T16:23:19.960 INFO:teuthology.orchestra.run.smithi157.stdout: "name": { 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "client", 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: "num": 24309 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3439599588 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: } 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-28T16:23:19.961 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": { 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "type": "v1", 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "addr": "192.168.0.1:0", 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "nonce": 3439599588 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: }, 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "inst_str": "client.24309 192.168.0.1:0/3439599588", 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "addr_str": "192.168.0.1:0/3439599588", 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "inode_count": 1, 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "mds_epoch": 14, 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch": 46, 2024-02-28T16:23:19.962 INFO:teuthology.orchestra.run.smithi157.stdout: "osd_epoch_barrier": 0, 2024-02-28T16:23:19.963 INFO:teuthology.orchestra.run.smithi157.stdout: "blocklisted": false, 2024-02-28T16:23:19.963 INFO:teuthology.orchestra.run.smithi157.stdout: "fs_name": "cephfs" 2024-02-28T16:23:19.963 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-02-28T16:23:19.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:19.973 DEBUG:teuthology.orchestra.run.smithi148:> stat --file-system '--printf=%T 2024-02-28T16:23:19.974 DEBUG:teuthology.orchestra.run.smithi148:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:20.035 INFO:teuthology.orchestra.run.smithi148.stdout:fuseblk 2024-02-28T16:23:20.035 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:20.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:20.035 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:20.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:20.141 DEBUG:teuthology.orchestra.run.smithi157:> stat --file-system '--printf=%T 2024-02-28T16:23:20.141 DEBUG:teuthology.orchestra.run.smithi157:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:20.200 INFO:teuthology.orchestra.run.smithi157.stdout:fuseblk 2024-02-28T16:23:20.200 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:20.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:23:20.200 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:20.295 INFO:teuthology.run_tasks:Running task print... 2024-02-28T16:23:20.307 INFO:teuthology.task.print:**** done client 2024-02-28T16:23:20.307 INFO:teuthology.run_tasks:Running task parallel... 2024-02-28T16:23:20.368 INFO:teuthology.task.parallel:starting parallel... 2024-02-28T16:23:20.368 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T16:23:20.369 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T16:23:20.369 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:23:20.369 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-28T16:23:20.370 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T16:23:20.370 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-28T16:23:20.373 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:23:20.374 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-28T16:23:20.374 INFO:tasks.workunit:timeout=3h 2024-02-28T16:23:20.374 INFO:tasks.workunit:cleanup=True 2024-02-28T16:23:20.374 DEBUG:teuthology.orchestra.run.smithi148:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:20.434 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T16:23:20.435 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 93h/147d Inode: 1 Links: 2 2024-02-28T16:23:20.435 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:23:20.435 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T16:23:20.435 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T16:23:20.435 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-02-28 16:22:29.794006695 +0000 2024-02-28T16:23:20.435 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-02-28 16:23:20.144800419 +0000 2024-02-28T16:23:20.435 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: - 2024-02-28T16:23:20.435 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-28T16:23:20.435 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-28T16:23:20.580 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:20.637 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T16:23:20.638 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 72h/114d Inode: 1 Links: 3 2024-02-28T16:23:20.638 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T16:23:20.638 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T16:23:20.638 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T16:23:20.638 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-02-28 16:23:20.576141351 +0000 2024-02-28T16:23:20.638 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-02-28 16:23:20.576141351 +0000 2024-02-28T16:23:20.638 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: - 2024-02-28T16:23:20.638 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-28T16:23:20.638 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-28T16:23:20.749 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:23:20.750 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:23:20.791 INFO:tasks.workunit.client.0.smithi148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-28T16:23:20.811 INFO:tasks.workunit.client.1.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-28T16:23:20.844 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:23:20.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:20 smithi157 ceph-mon[38346]: pgmap v271: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:20 smithi148 ceph-mon[28767]: pgmap v271: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-02-28T16:23:23.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:22 smithi157 ceph-mon[38346]: pgmap v272: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:23.278 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:22 smithi148 ceph-mon[28767]: pgmap v272: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 -- 172.21.15.148:0/3967026412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 msgr2=0x7ffaac1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 --2- 172.21.15.148:0/3967026412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1049d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffa98004940 tx=0x7ffa98009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:23.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 -- 172.21.15.148:0/3967026412 shutdown_connections 2024-02-28T16:23:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 --2- 172.21.15.148:0/3967026412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1049d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 --2- 172.21.15.148:0/3967026412 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac103370 0x7ffaac103780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 -- 172.21.15.148:0/3967026412 >> 172.21.15.148:0/3967026412 conn(0x7ffaac0727d0 msgr2=0x7ffaac074c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 -- 172.21.15.148:0/3967026412 shutdown_connections 2024-02-28T16:23:23.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.459+0000 7ffab3000700 1 -- 172.21.15.148:0/3967026412 wait complete. 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.460+0000 7ffab3000700 1 Processor -- start 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.460+0000 7ffab3000700 1 -- start start 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab3000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac103370 0x7ffaac113d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab3000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1142d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab3000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac1150c0 con 0x7ffaac104580 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab3000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac115230 con 0x7ffaac103370 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab1200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab1200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1142d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34374/0 (socket says 172.21.15.148:34374) 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab1200700 1 -- 172.21.15.148:0/2422796982 learned_addr learned my addr 172.21.15.148:0/2422796982 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab1c00700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac103370 0x7ffaac113d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab1200700 1 -- 172.21.15.148:0/2422796982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac103370 msgr2=0x7ffaac113d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:23.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab1200700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac103370 0x7ffaac113d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.461+0000 7ffab1200700 1 -- 172.21.15.148:0/2422796982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98005040 con 0x7ffaac104580 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.462+0000 7ffab1200700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1142d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009fd0 tx=0x7ffa98009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.462+0000 7ffaa9600700 1 -- 172.21.15.148:0/2422796982 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa9800e040 con 0x7ffaac104580 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.462+0000 7ffaa9600700 1 -- 172.21.15.148:0/2422796982 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa9800bcc0 con 0x7ffaac104580 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.462+0000 7ffaa9600700 1 -- 172.21.15.148:0/2422796982 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa9801c630 con 0x7ffaac104580 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.462+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac1154b0 con 0x7ffaac104580 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.462+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac115a70 con 0x7ffaac104580 2024-02-28T16:23:23.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.463+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac05f5c0 con 0x7ffaac104580 2024-02-28T16:23:23.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.464+0000 7ffaa9600700 1 -- 172.21.15.148:0/2422796982 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ffa98013980 con 0x7ffaac104580 2024-02-28T16:23:23.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.465+0000 7ffaa9600700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ffa940692b0 0x7ffa9406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:23.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.465+0000 7ffaa9600700 1 -- 172.21.15.148:0/2422796982 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ffa98088690 con 0x7ffaac104580 2024-02-28T16:23:23.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.466+0000 7ffab1c00700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ffa940692b0 0x7ffa9406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:23.456 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.466+0000 7ffab1c00700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ffa940692b0 0x7ffa9406b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffaac114b50 tx=0x7ffaa000b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:23.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.470+0000 7ffaa9600700 1 -- 172.21.15.148:0/2422796982 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ffa98054950 con 0x7ffaac104580 2024-02-28T16:23:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.680+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7ffaac115da0 con 0x7ffaac104580 2024-02-28T16:23:23.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.681+0000 7ffaa9600700 1 -- 172.21.15.148:0/2422796982 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7ffa98057f70 con 0x7ffaac104580 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ffa940692b0 msgr2=0x7ffa9406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ffa940692b0 0x7ffa9406b760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ffaac114b50 tx=0x7ffaa000b040 comp rx=0 tx=0).stop 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 msgr2=0x7ffaac1142d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1142d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009fd0 tx=0x7ffa98009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 shutdown_connections 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ffa940692b0 0x7ffa9406b760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffaac103370 0x7ffaac113d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 --2- 172.21.15.148:0/2422796982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffaac104580 0x7ffaac1142d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.683+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 >> 172.21.15.148:0/2422796982 conn(0x7ffaac0727d0 msgr2=0x7ffaac1077b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:23.674 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.684+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 shutdown_connections 2024-02-28T16:23:23.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:23.684+0000 7ffab3000700 1 -- 172.21.15.148:0/2422796982 wait complete. 2024-02-28T16:23:24.652 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-28T16:23:25.181 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:23:25.335 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:25 smithi148 ceph-mon[28767]: pgmap v273: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-28T16:23:25.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:25 smithi157 ceph-mon[38346]: pgmap v273: 65 pgs: 65 active+clean; 583 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-02-28T16:23:26.261 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:26.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:27.342 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:27 smithi148 ceph-mon[28767]: pgmap v274: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:27.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:27 smithi157 ceph-mon[38346]: pgmap v274: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 -- 172.21.15.148:0/4229417483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fcf40 msgr2=0x7f1b9c0fd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 --2- 172.21.15.148:0/4229417483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fcf40 0x7f1b9c0fd350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c004940 tx=0x7f1b8c009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 -- 172.21.15.148:0/4229417483 shutdown_connections 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 --2- 172.21.15.148:0/4229417483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c0fe1f0 0x7f1b9c0fe660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 --2- 172.21.15.148:0/4229417483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fcf40 0x7f1b9c0fd350 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 -- 172.21.15.148:0/4229417483 >> 172.21.15.148:0/4229417483 conn(0x7f1b9c0f8680 msgr2=0x7f1b9c0faad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 -- 172.21.15.148:0/4229417483 shutdown_connections 2024-02-28T16:23:27.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.523+0000 7f1ba2800700 1 -- 172.21.15.148:0/4229417483 wait complete. 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.524+0000 7f1ba2800700 1 Processor -- start 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.524+0000 7f1ba2800700 1 -- start start 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.524+0000 7f1ba2800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c0fcf40 0x7f1b9c071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.524+0000 7f1ba2800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fe1f0 0x7f1b9c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.524+0000 7f1ba2800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c070970 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.524+0000 7f1ba2800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c070ae0 con 0x7f1b9c0fcf40 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fe1f0 0x7f1b9c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fe1f0 0x7f1b9c0702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34394/0 (socket says 172.21.15.148:34394) 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9aa00700 1 -- 172.21.15.148:0/1180903832 learned_addr learned my addr 172.21.15.148:0/1180903832 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:27.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9b400700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c0fcf40 0x7f1b9c071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9aa00700 1 -- 172.21.15.148:0/1180903832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c0fcf40 msgr2=0x7f1b9c071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9aa00700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c0fcf40 0x7f1b9c071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9aa00700 1 -- 172.21.15.148:0/1180903832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c005040 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.525+0000 7f1b9aa00700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fe1f0 0x7f1b9c0702e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b790 tx=0x7f1b88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.526+0000 7f1b93400700 1 -- 172.21.15.148:0/1180903832 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b8800f770 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.526+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c070dc0 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.526+0000 7f1b93400700 1 -- 172.21.15.148:0/1180903832 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b8800fda0 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.526+0000 7f1b93400700 1 -- 172.21.15.148:0/1180903832 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b8800d310 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.526+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c071140 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.527+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c04bed0 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.528+0000 7f1b93400700 1 -- 172.21.15.148:0/1180903832 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f1b88010420 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.529+0000 7f1b93400700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1b800692b0 0x7f1b8006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:27.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.529+0000 7f1b93400700 1 -- 172.21.15.148:0/1180903832 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1b880871f0 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.529+0000 7f1b9b400700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1b800692b0 0x7f1b8006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:27.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.530+0000 7f1b9b400700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1b800692b0 0x7f1b8006b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00b840 tx=0x7f1b8c009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:27.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.533+0000 7f1b93400700 1 -- 172.21.15.148:0/1180903832 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1b88056f40 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.744+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f1b9c115ef0 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.744+0000 7f1b93400700 1 -- 172.21.15.148:0/1180903832 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1b88056ad0 con 0x7f1b9c0fe1f0 2024-02-28T16:23:27.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.747+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1b800692b0 msgr2=0x7f1b8006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:27.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.747+0000 7f1ba2800700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1b800692b0 0x7f1b8006b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00b840 tx=0x7f1b8c009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.747+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fe1f0 msgr2=0x7f1b9c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.747+0000 7f1ba2800700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fe1f0 0x7f1b9c0702e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800b790 tx=0x7f1b88009250 comp rx=0 tx=0).stop 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.748+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 shutdown_connections 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.748+0000 7f1ba2800700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f1b800692b0 0x7f1b8006b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.748+0000 7f1ba2800700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b9c0fcf40 0x7f1b9c071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.748+0000 7f1ba2800700 1 --2- 172.21.15.148:0/1180903832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b9c0fe1f0 0x7f1b9c0702e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.748+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 >> 172.21.15.148:0/1180903832 conn(0x7f1b9c0f8680 msgr2=0x7f1b9c101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.748+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 shutdown_connections 2024-02-28T16:23:27.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:27.748+0000 7f1ba2800700 1 -- 172.21.15.148:0/1180903832 wait complete. 2024-02-28T16:23:28.644 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-28T16:23:29.125 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:23:29.270 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:29 smithi148 ceph-mon[28767]: pgmap v275: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:29.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:29 smithi157 ceph-mon[38346]: pgmap v275: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:31.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:30 smithi148 ceph-mon[28767]: pgmap v276: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:23:31.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:30 smithi157 ceph-mon[38346]: pgmap v276: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:23:31.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 -- 172.21.15.148:0/1649157882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e0100360 msgr2=0x7fb6e01007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:31.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 --2- 172.21.15.148:0/1649157882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e0100360 0x7fb6e01007b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc004940 tx=0x7fb6cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:31.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 -- 172.21.15.148:0/1649157882 shutdown_connections 2024-02-28T16:23:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 --2- 172.21.15.148:0/1649157882 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e0100360 0x7fb6e01007b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 --2- 172.21.15.148:0/1649157882 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6e00ff150 0x7fb6e00ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 -- 172.21.15.148:0/1649157882 >> 172.21.15.148:0/1649157882 conn(0x7fb6e00fa920 msgr2=0x7fb6e00fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 -- 172.21.15.148:0/1649157882 shutdown_connections 2024-02-28T16:23:31.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.302+0000 7fb6e5200700 1 -- 172.21.15.148:0/1649157882 wait complete. 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.303+0000 7fb6e5200700 1 Processor -- start 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.303+0000 7fb6e5200700 1 -- start start 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6e5200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e00ff150 0x7fb6e010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6e5200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6e0100360 0x7fb6e01100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6e5200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e01106b0 con 0x7fb6e00ff150 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6e5200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e0110f50 con 0x7fb6e0100360 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6dde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e00ff150 0x7fb6e010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6dde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e00ff150 0x7fb6e010fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34420/0 (socket says 172.21.15.148:34420) 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6dde00700 1 -- 172.21.15.148:0/955649035 learned_addr learned my addr 172.21.15.148:0/955649035 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:31.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.304+0000 7fb6dd400700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6e0100360 0x7fb6e01100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:31.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6dde00700 1 -- 172.21.15.148:0/955649035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6e0100360 msgr2=0x7fb6e01100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:31.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6dde00700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6e0100360 0x7fb6e01100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:31.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6dde00700 1 -- 172.21.15.148:0/955649035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc005040 con 0x7fb6e00ff150 2024-02-28T16:23:31.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6dde00700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e00ff150 0x7fb6e010fb70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c8b0 tx=0x7fb6d0004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:31.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6d6000700 1 -- 172.21.15.148:0/955649035 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d000a760 con 0x7fb6e00ff150 2024-02-28T16:23:31.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6d6000700 1 -- 172.21.15.148:0/955649035 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb6d000ad90 con 0x7fb6e00ff150 2024-02-28T16:23:31.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e0111230 con 0x7fb6e00ff150 2024-02-28T16:23:31.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6d6000700 1 -- 172.21.15.148:0/955649035 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6d00113a0 con 0x7fb6e00ff150 2024-02-28T16:23:31.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.305+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e0111770 con 0x7fb6e00ff150 2024-02-28T16:23:31.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.306+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e004bed0 con 0x7fb6e00ff150 2024-02-28T16:23:31.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.307+0000 7fb6d6000700 1 -- 172.21.15.148:0/955649035 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fb6d0012400 con 0x7fb6e00ff150 2024-02-28T16:23:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.308+0000 7fb6d6000700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6c40692b0 0x7fb6c406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.308+0000 7fb6d6000700 1 -- 172.21.15.148:0/955649035 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb6d0086f50 con 0x7fb6e00ff150 2024-02-28T16:23:31.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.309+0000 7fb6dd400700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6c40692b0 0x7fb6c406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:31.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.309+0000 7fb6dd400700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6c40692b0 0x7fb6c406b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00b020 tx=0x7fb6cc009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:31.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.313+0000 7fb6d6000700 1 -- 172.21.15.148:0/955649035 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fb6d0056cc0 con 0x7fb6e00ff150 2024-02-28T16:23:31.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.522+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fb6e0107c30 con 0x7fb6e00ff150 2024-02-28T16:23:31.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.523+0000 7fb6d6000700 1 -- 172.21.15.148:0/955649035 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fb6e0107c30 con 0x7fb6e00ff150 2024-02-28T16:23:31.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6c40692b0 msgr2=0x7fb6c406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6c40692b0 0x7fb6c406b760 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00b020 tx=0x7fb6cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e00ff150 msgr2=0x7fb6e010fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e00ff150 0x7fb6e010fb70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000c8b0 tx=0x7fb6d0004470 comp rx=0 tx=0).stop 2024-02-28T16:23:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 shutdown_connections 2024-02-28T16:23:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6e00ff150 0x7fb6e010fb70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:31.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fb6c40692b0 0x7fb6c406b760 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 --2- 172.21.15.148:0/955649035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6e0100360 0x7fb6e01100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 >> 172.21.15.148:0/955649035 conn(0x7fb6e00fa920 msgr2=0x7fb6e0103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 shutdown_connections 2024-02-28T16:23:31.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:31.526+0000 7fb6e5200700 1 -- 172.21.15.148:0/955649035 wait complete. 2024-02-28T16:23:32.478 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-28T16:23:32.971 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:23:33.271 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:32 smithi148 ceph-mon[28767]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:23:33.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:33 smithi157 ceph-mon[38346]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-02-28T16:23:35.096 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:35 smithi148 ceph-mon[28767]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-28T16:23:35.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.276+0000 7ff43ee00700 1 -- 172.21.15.148:0/1273924059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4380708c0 msgr2=0x7ff438070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:35.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.276+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1273924059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4380708c0 0x7ff438070d10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff424004940 tx=0x7ff424009e30 comp rx=0 tx=0).stop 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.276+0000 7ff43ee00700 1 -- 172.21.15.148:0/1273924059 shutdown_connections 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.276+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1273924059 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff4380708c0 0x7ff438070d10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.276+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1273924059 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff438071f10 0x7ff438070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.276+0000 7ff43ee00700 1 -- 172.21.15.148:0/1273924059 >> 172.21.15.148:0/1273924059 conn(0x7ff4380f8620 msgr2=0x7ff4380faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.277+0000 7ff43ee00700 1 -- 172.21.15.148:0/1273924059 shutdown_connections 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.277+0000 7ff43ee00700 1 -- 172.21.15.148:0/1273924059 wait complete. 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.277+0000 7ff43ee00700 1 Processor -- start 2024-02-28T16:23:35.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff43ee00700 1 -- start start 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff43ee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4380708c0 0x7ff43810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff43ee00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff438071f10 0x7ff4381100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff43ee00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381106b0 con 0x7ff438071f10 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff43ee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff438110f50 con 0x7ff4380708c0 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff437400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff438071f10 0x7ff4381100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff437400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff438071f10 0x7ff4381100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50648/0 (socket says 172.21.15.148:50648) 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.278+0000 7ff437400700 1 -- 172.21.15.148:0/1018390455 learned_addr learned my addr 172.21.15.148:0/1018390455 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff437e00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4380708c0 0x7ff43810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:35.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff437400700 1 -- 172.21.15.148:0/1018390455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4380708c0 msgr2=0x7ff43810fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff437400700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4380708c0 0x7ff43810fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff437400700 1 -- 172.21.15.148:0/1018390455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424005040 con 0x7ff438071f10 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff437e00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4380708c0 0x7ff43810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff437400700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff438071f10 0x7ff4381100b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff424009fd0 tx=0x7ff424009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff42fe00700 1 -- 172.21.15.148:0/1018390455 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42400e040 con 0x7ff438071f10 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff42fe00700 1 -- 172.21.15.148:0/1018390455 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff424004290 con 0x7ff438071f10 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.279+0000 7ff42fe00700 1 -- 172.21.15.148:0/1018390455 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42401c630 con 0x7ff438071f10 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.280+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4381111d0 con 0x7ff438071f10 2024-02-28T16:23:35.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.280+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff438111710 con 0x7ff438071f10 2024-02-28T16:23:35.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.281+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43804bed0 con 0x7ff438071f10 2024-02-28T16:23:35.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.282+0000 7ff42fe00700 1 -- 172.21.15.148:0/1018390455 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7ff42400bc60 con 0x7ff438071f10 2024-02-28T16:23:35.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.282+0000 7ff42fe00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff41c0692b0 0x7ff41c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:23:35.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.283+0000 7ff42fe00700 1 -- 172.21.15.148:0/1018390455 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff424088620 con 0x7ff438071f10 2024-02-28T16:23:35.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.283+0000 7ff437e00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff41c0692b0 0x7ff41c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:23:35.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.284+0000 7ff437e00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff41c0692b0 0x7ff41c06b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff428009fd0 tx=0x7ff42800b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:23:35.277 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.288+0000 7ff42fe00700 1 -- 172.21.15.148:0/1018390455 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7ff4240582f0 con 0x7ff438071f10 2024-02-28T16:23:35.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:35 smithi157 ceph-mon[38346]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-28T16:23:35.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:23:35.516+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff438111bb0 con 0x7ff41c0692b0 2024-02-28T16:23:36.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:36 smithi148 ceph-mon[28767]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:36.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:36 smithi157 ceph-mon[38346]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:23:37.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:37 smithi148 ceph-mon[28767]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-28T16:23:37.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:37 smithi157 ceph-mon[38346]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-02-28T16:23:39.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:39 smithi148 ceph-mon[28767]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:23:39.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:39 smithi157 ceph-mon[38346]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:23:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:40 smithi148 ceph-mon[28767]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:23:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:40 smithi157 ceph-mon[38346]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-02-28T16:23:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:43.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:42 smithi148 ceph-mon[28767]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:43.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:42 smithi157 ceph-mon[38346]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-02-28T16:23:45.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:45 smithi148 ceph-mon[28767]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-28T16:23:45.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:45 smithi157 ceph-mon[38346]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-02-28T16:23:47.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:47 smithi148 ceph-mon[28767]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:47.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:47 smithi157 ceph-mon[38346]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:49.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:49 smithi148 ceph-mon[28767]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:49.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:49 smithi157 ceph-mon[38346]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:51.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:50 smithi148 ceph-mon[28767]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:51.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:50 smithi157 ceph-mon[38346]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:53.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:53 smithi148 ceph-mon[28767]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:53.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:53 smithi157 ceph-mon[38346]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:55.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:55 smithi148 ceph-mon[28767]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:55 smithi157 ceph-mon[38346]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:56.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:56.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:23:57.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:57 smithi148 ceph-mon[28767]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:57 smithi157 ceph-mon[38346]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:59.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:23:59 smithi148 ceph-mon[28767]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:23:59.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:23:59 smithi157 ceph-mon[38346]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:00 smithi148 ceph-mon[28767]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:00 smithi157 ceph-mon[38346]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:03.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:03 smithi148 ceph-mon[28767]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:03.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:03 smithi157 ceph-mon[38346]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:04.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:04 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:04.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:04 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:05.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:05 smithi148 ceph-mon[28767]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:05.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:05 smithi157 ceph-mon[38346]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:07.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:07 smithi148 ceph-mon[28767]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:07.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:07 smithi157 ceph-mon[38346]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:09.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:09 smithi148 ceph-mon[28767]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:09.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:09 smithi157 ceph-mon[38346]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:11.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:10 smithi148 ceph-mon[28767]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:10 smithi157 ceph-mon[38346]: pgmap v296: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:12.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:12.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:13.191 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:13 smithi148 ceph-mon[28767]: pgmap v297: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:13.191 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:13 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:13.191 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:13 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:13.191 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:13 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:13.192 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:13 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:13.192 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:13 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:13.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:13 smithi157 ceph-mon[38346]: pgmap v297: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:13.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:13 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:13.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:13 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:13.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:13 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:13.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:13 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:13.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:13 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.336+0000 7ff42fe00700 1 -- 172.21.15.148:0/1018390455 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7ff438111bb0 con 0x7ff41c0692b0 2024-02-28T16:24:14.326 INFO:teuthology.orchestra.run.smithi148.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:24:14.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff41c0692b0 msgr2=0x7ff41c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:14.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff41c0692b0 0x7ff41c06b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff428009fd0 tx=0x7ff42800b040 comp rx=0 tx=0).stop 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff438071f10 msgr2=0x7ff4381100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff438071f10 0x7ff4381100b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff424009fd0 tx=0x7ff424009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 shutdown_connections 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7ff41c0692b0 0x7ff41c06b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff4380708c0 0x7ff43810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 --2- 172.21.15.148:0/1018390455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff438071f10 0x7ff4381100b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 >> 172.21.15.148:0/1018390455 conn(0x7ff4380f8620 msgr2=0x7ff438102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 shutdown_connections 2024-02-28T16:24:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:14.339+0000 7ff43ee00700 1 -- 172.21.15.148:0/1018390455 wait complete. 2024-02-28T16:24:15.236 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-28T16:24:15.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: pgmap v298: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:15.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:24:15.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:15.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:15.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:15.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:15.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:15.626 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:15 smithi148 ceph-mon[28767]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: pgmap v298: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:15.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:15 smithi157 ceph-mon[38346]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:24:15.888 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:24:17.356 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:17 smithi148 ceph-mon[28767]: pgmap v299: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:17.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:17 smithi157 ceph-mon[38346]: pgmap v299: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:19.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 -- 172.21.15.148:0/2453117570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d80ff150 msgr2=0x7f49d80ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 --2- 172.21.15.148:0/2453117570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d80ff150 0x7f49d80ff560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f49c8004940 tx=0x7f49c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:19.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 -- 172.21.15.148:0/2453117570 shutdown_connections 2024-02-28T16:24:19.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 --2- 172.21.15.148:0/2453117570 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49d8100360 0x7f49d81007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 --2- 172.21.15.148:0/2453117570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d80ff150 0x7f49d80ff560 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 -- 172.21.15.148:0/2453117570 >> 172.21.15.148:0/2453117570 conn(0x7f49d80fa920 msgr2=0x7f49d80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 -- 172.21.15.148:0/2453117570 shutdown_connections 2024-02-28T16:24:19.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.135+0000 7f49df200700 1 -- 172.21.15.148:0/2453117570 wait complete. 2024-02-28T16:24:19.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.136+0000 7f49df200700 1 Processor -- start 2024-02-28T16:24:19.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.136+0000 7f49df200700 1 -- start start 2024-02-28T16:24:19.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.137+0000 7f49df200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49d80ff150 0x7f49d810fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.137+0000 7f49df200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d8100360 0x7f49d8110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.137+0000 7f49df200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8110670 con 0x7f49d8100360 2024-02-28T16:24:19.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.137+0000 7f49df200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8110f10 con 0x7f49d80ff150 2024-02-28T16:24:19.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.138+0000 7f49d7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d8100360 0x7f49d8110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.138+0000 7f49d7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d8100360 0x7f49d8110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55762/0 (socket says 172.21.15.148:55762) 2024-02-28T16:24:19.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.138+0000 7f49d7400700 1 -- 172.21.15.148:0/3329648557 learned_addr learned my addr 172.21.15.148:0/3329648557 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:19.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.138+0000 7f49d7e00700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49d80ff150 0x7f49d810fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.138+0000 7f49d7400700 1 -- 172.21.15.148:0/3329648557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49d80ff150 msgr2=0x7f49d810fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.138+0000 7f49d7400700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49d80ff150 0x7f49d810fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.138+0000 7f49d7400700 1 -- 172.21.15.148:0/3329648557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c8005040 con 0x7f49d8100360 2024-02-28T16:24:19.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.139+0000 7f49d7400700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d8100360 0x7f49d8110070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f49c400eb70 tx=0x7f49c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.139+0000 7f49cfe00700 1 -- 172.21.15.148:0/3329648557 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c4007cc0 con 0x7f49d8100360 2024-02-28T16:24:19.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.139+0000 7f49cfe00700 1 -- 172.21.15.148:0/3329648557 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49c400f040 con 0x7f49d8100360 2024-02-28T16:24:19.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.139+0000 7f49cfe00700 1 -- 172.21.15.148:0/3329648557 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c4009640 con 0x7f49d8100360 2024-02-28T16:24:19.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.139+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d8111190 con 0x7f49d8100360 2024-02-28T16:24:19.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.139+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d81116d0 con 0x7f49d8100360 2024-02-28T16:24:19.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.141+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d804bed0 con 0x7f49d8100360 2024-02-28T16:24:19.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.143+0000 7f49cfe00700 1 -- 172.21.15.148:0/3329648557 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f49c40097a0 con 0x7f49d8100360 2024-02-28T16:24:19.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.144+0000 7f49cfe00700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f49bc0692b0 0x7f49bc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.145+0000 7f49d7e00700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f49bc0692b0 0x7f49bc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.145+0000 7f49cfe00700 1 -- 172.21.15.148:0/3329648557 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f49c4053400 con 0x7f49d8100360 2024-02-28T16:24:19.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.146+0000 7f49d7e00700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f49bc0692b0 0x7f49bc06b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b0d0 tx=0x7f49c8009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.151+0000 7f49cfe00700 1 -- 172.21.15.148:0/3329648557 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f49c4056ac0 con 0x7f49d8100360 2024-02-28T16:24:19.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.378+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49d8111b60 con 0x7f49bc0692b0 2024-02-28T16:24:19.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.380+0000 7f49cfe00700 1 -- 172.21.15.148:0/3329648557 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f49d8111b60 con 0x7f49bc0692b0 2024-02-28T16:24:19.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.383+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f49bc0692b0 msgr2=0x7f49bc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.383+0000 7f49df200700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f49bc0692b0 0x7f49bc06b760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b0d0 tx=0x7f49c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:19.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.383+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d8100360 msgr2=0x7f49d8110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.383+0000 7f49df200700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d8100360 0x7f49d8110070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f49c400eb70 tx=0x7f49c400b040 comp rx=0 tx=0).stop 2024-02-28T16:24:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.384+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 shutdown_connections 2024-02-28T16:24:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.384+0000 7f49df200700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f49bc0692b0 0x7f49bc06b760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.384+0000 7f49df200700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49d80ff150 0x7f49d810fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.384+0000 7f49df200700 1 --2- 172.21.15.148:0/3329648557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d8100360 0x7f49d8110070 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.384+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 >> 172.21.15.148:0/3329648557 conn(0x7f49d80fa920 msgr2=0x7f49d8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.384+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 shutdown_connections 2024-02-28T16:24:19.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.384+0000 7f49df200700 1 -- 172.21.15.148:0/3329648557 wait complete. 2024-02-28T16:24:19.389 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:24:19.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.562+0000 7f2319e00700 1 -- 172.21.15.148:0/1005276348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 msgr2=0x7f23140fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.562+0000 7f2319e00700 1 --2- 172.21.15.148:0/1005276348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f23140fe550 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2300004940 tx=0x7f2300009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:19.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.562+0000 7f2319e00700 1 -- 172.21.15.148:0/1005276348 shutdown_connections 2024-02-28T16:24:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.562+0000 7f2319e00700 1 --2- 172.21.15.148:0/1005276348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f23140fe550 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.562+0000 7f2319e00700 1 --2- 172.21.15.148:0/1005276348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23140fcef0 0x7f23140fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.562+0000 7f2319e00700 1 -- 172.21.15.148:0/1005276348 >> 172.21.15.148:0/1005276348 conn(0x7f23140f8620 msgr2=0x7f23140faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.563+0000 7f2319e00700 1 -- 172.21.15.148:0/1005276348 shutdown_connections 2024-02-28T16:24:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.563+0000 7f2319e00700 1 -- 172.21.15.148:0/1005276348 wait complete. 2024-02-28T16:24:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.564+0000 7f2319e00700 1 Processor -- start 2024-02-28T16:24:19.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.564+0000 7f2319e00700 1 -- start start 2024-02-28T16:24:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.564+0000 7f2319e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23140fcef0 0x7f231410fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.564+0000 7f2319e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f2314110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.564+0000 7f2319e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2314110600 con 0x7f23140fe0e0 2024-02-28T16:24:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.564+0000 7f2319e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2314110ea0 con 0x7f23140fcef0 2024-02-28T16:24:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.565+0000 7f2312000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f2314110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.565+0000 7f2312000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f2314110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55776/0 (socket says 172.21.15.148:55776) 2024-02-28T16:24:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.565+0000 7f2312000700 1 -- 172.21.15.148:0/3251135205 learned_addr learned my addr 172.21.15.148:0/3251135205 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.565+0000 7f2312a00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23140fcef0 0x7f231410fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.566+0000 7f2312000700 1 -- 172.21.15.148:0/3251135205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23140fcef0 msgr2=0x7f231410fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.566+0000 7f2312000700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23140fcef0 0x7f231410fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.566+0000 7f2312000700 1 -- 172.21.15.148:0/3251135205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300005040 con 0x7f23140fe0e0 2024-02-28T16:24:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.566+0000 7f2312000700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f2314110000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f2300009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.566+0000 7f230aa00700 1 -- 172.21.15.148:0/3251135205 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230000e070 con 0x7f23140fe0e0 2024-02-28T16:24:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.567+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2314111120 con 0x7f23140fe0e0 2024-02-28T16:24:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.567+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2314111600 con 0x7f23140fe0e0 2024-02-28T16:24:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.567+0000 7f230aa00700 1 -- 172.21.15.148:0/3251135205 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2300009430 con 0x7f23140fe0e0 2024-02-28T16:24:19.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.567+0000 7f230aa00700 1 -- 172.21.15.148:0/3251135205 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23000123c0 con 0x7f23140fe0e0 2024-02-28T16:24:19.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.568+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f40052e0 con 0x7f23140fe0e0 2024-02-28T16:24:19.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.569+0000 7f230aa00700 1 -- 172.21.15.148:0/3251135205 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f2300013af0 con 0x7f23140fe0e0 2024-02-28T16:24:19.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.571+0000 7f230aa00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f22f80692b0 0x7f22f806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:19.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.571+0000 7f230aa00700 1 -- 172.21.15.148:0/3251135205 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2300089440 con 0x7f23140fe0e0 2024-02-28T16:24:19.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.572+0000 7f2312a00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f22f80692b0 0x7f22f806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:19.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.573+0000 7f2312a00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f22f80692b0 0x7f22f806b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2304009b80 tx=0x7f230400b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:19.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.580+0000 7f230aa00700 1 -- 172.21.15.148:0/3251135205 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f2300059190 con 0x7f23140fe0e0 2024-02-28T16:24:19.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:19 smithi148 ceph-mon[28767]: pgmap v300: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:19.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:19 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:19.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:19 smithi148 ceph-mon[28767]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T16:24:19.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:19 smithi148 ceph-mon[28767]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T16:24:19.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:19 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:19.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:19 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:19.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:19 smithi148 ceph-mon[28767]: Upgrade: Need to upgrade myself (mgr.smithi148.gelspy) 2024-02-28T16:24:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.976+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22f4000bf0 con 0x7f22f80692b0 2024-02-28T16:24:19.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.978+0000 7f230aa00700 1 -- 172.21.15.148:0/3251135205 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f22f4000bf0 con 0x7f22f80692b0 2024-02-28T16:24:19.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.980+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f22f80692b0 msgr2=0x7f22f806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.980+0000 7f2319e00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f22f80692b0 0x7f22f806b760 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2304009b80 tx=0x7f230400b040 comp rx=0 tx=0).stop 2024-02-28T16:24:19.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.980+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 msgr2=0x7f2314110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:19.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.980+0000 7f2319e00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f2314110000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f2300009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.981+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 shutdown_connections 2024-02-28T16:24:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.981+0000 7f2319e00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f22f80692b0 0x7f22f806b760 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.981+0000 7f2319e00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f23140fcef0 0x7f231410fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.981+0000 7f2319e00700 1 --2- 172.21.15.148:0/3251135205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23140fe0e0 0x7f2314110000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.981+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 >> 172.21.15.148:0/3251135205 conn(0x7f23140f8620 msgr2=0x7f23140ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.981+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 shutdown_connections 2024-02-28T16:24:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:19.981+0000 7f2319e00700 1 -- 172.21.15.148:0/3251135205 wait complete. 2024-02-28T16:24:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:19 smithi157 ceph-mon[38346]: pgmap v300: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:19 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:19 smithi157 ceph-mon[38346]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T16:24:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:19 smithi157 ceph-mon[38346]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T16:24:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:19 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:24:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:19 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:19 smithi157 ceph-mon[38346]: Upgrade: Need to upgrade myself (mgr.smithi148.gelspy) 2024-02-28T16:24:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.122+0000 7f6e66e00700 1 -- 172.21.15.148:0/5789626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 msgr2=0x7f6e600fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.122+0000 7f6e66e00700 1 --2- 172.21.15.148:0/5789626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 0x7f6e600fe550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c004940 tx=0x7f6e4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.122+0000 7f6e66e00700 1 -- 172.21.15.148:0/5789626 shutdown_connections 2024-02-28T16:24:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.122+0000 7f6e66e00700 1 --2- 172.21.15.148:0/5789626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 0x7f6e600fe550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.122+0000 7f6e66e00700 1 --2- 172.21.15.148:0/5789626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 0x7f6e600fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.122+0000 7f6e66e00700 1 -- 172.21.15.148:0/5789626 >> 172.21.15.148:0/5789626 conn(0x7f6e600f8620 msgr2=0x7f6e600faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.123+0000 7f6e66e00700 1 -- 172.21.15.148:0/5789626 shutdown_connections 2024-02-28T16:24:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.123+0000 7f6e66e00700 1 -- 172.21.15.148:0/5789626 wait complete. 2024-02-28T16:24:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.124+0000 7f6e66e00700 1 Processor -- start 2024-02-28T16:24:20.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.124+0000 7f6e66e00700 1 -- start start 2024-02-28T16:24:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e66e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 0x7f6e6010fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e66e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 0x7f6e60110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e66e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60110620 con 0x7f6e600fe0e0 2024-02-28T16:24:20.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e66e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60110ec0 con 0x7f6e600fcef0 2024-02-28T16:24:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e5fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 0x7f6e6010fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e5f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 0x7f6e60110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e5fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 0x7f6e6010fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:36480/0 (socket says 172.21.15.148:36480) 2024-02-28T16:24:20.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.125+0000 7f6e5fe00700 1 -- 172.21.15.148:0/3142871138 learned_addr learned my addr 172.21.15.148:0/3142871138 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.126+0000 7f6e5fe00700 1 -- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 msgr2=0x7f6e60110020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.126+0000 7f6e5fe00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 0x7f6e60110020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.126+0000 7f6e5fe00700 1 -- 172.21.15.148:0/3142871138 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c005040 con 0x7f6e600fcef0 2024-02-28T16:24:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.126+0000 7f6e5fe00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 0x7f6e6010fae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000eb40 tx=0x7f6e5000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.126+0000 7f6e57e00700 1 -- 172.21.15.148:0/3142871138 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e50007cc0 con 0x7f6e600fcef0 2024-02-28T16:24:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.126+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e60111140 con 0x7f6e600fcef0 2024-02-28T16:24:20.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.126+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e60111680 con 0x7f6e600fcef0 2024-02-28T16:24:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.127+0000 7f6e57e00700 1 -- 172.21.15.148:0/3142871138 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e5000f040 con 0x7f6e600fcef0 2024-02-28T16:24:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.127+0000 7f6e57e00700 1 -- 172.21.15.148:0/3142871138 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5000caa0 con 0x7f6e600fcef0 2024-02-28T16:24:20.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.128+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e400052e0 con 0x7f6e600fcef0 2024-02-28T16:24:20.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.130+0000 7f6e57e00700 1 -- 172.21.15.148:0/3142871138 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f6e5000cc00 con 0x7f6e600fcef0 2024-02-28T16:24:20.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.131+0000 7f6e57e00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6e440692b0 0x7f6e4406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.131+0000 7f6e57e00700 1 -- 172.21.15.148:0/3142871138 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6e50086dc0 con 0x7f6e600fcef0 2024-02-28T16:24:20.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.131+0000 7f6e5f400700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6e440692b0 0x7f6e4406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:20.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.132+0000 7f6e5f400700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6e440692b0 0x7f6e4406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0045a0 tx=0x7f6e4c009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:20.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.138+0000 7f6e57e00700 1 -- 172.21.15.148:0/3142871138 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f6e50056b10 con 0x7f6e600fcef0 2024-02-28T16:24:20.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.349+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e40000bf0 con 0x7f6e440692b0 2024-02-28T16:24:20.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.364+0000 7f6e57e00700 1 -- 172.21.15.148:0/3142871138 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6e40000bf0 con 0x7f6e440692b0 2024-02-28T16:24:20.354 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (7m) 76s ago 9m 13.4M - 0.25.0 c8568f914cd2 1a028b2bba8f 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (10m) 76s ago 10m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (8m) 81s ago 8m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (7m) 76s ago 9m 74.6M - 9.4.7 954c08fa6188 9cb307a9b404 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (111s) 76s ago 110s 10.4M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (102s) 76s ago 101s 12.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (98s) 81s ago 97s 10.5M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (107s) 81s ago 106s 10.5M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:9283 running (11m) 76s ago 11m 481M - 17.2.7-535-gc0f02e60 1c37ed371348 0efadaac859c 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (7m) 81s ago 7m 432M - 17.2.7-535-gc0f02e60 1c37ed371348 54778550d5fd 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (11m) 76s ago 11m 42.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (7m) 81s ago 7m 32.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (10m) 76s ago 10m 7968k - 1.5.0 0da6a335fe13 1cc6d69049e3 2024-02-28T16:24:20.355 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (7m) 81s ago 7m 8002k - 1.5.0 0da6a335fe13 e10955ca2cb2 2024-02-28T16:24:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (6m) 76s ago 6m 44.0M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:24:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (6m) 76s ago 6m 45.3M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:24:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (5m) 76s ago 5m 43.6M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:24:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (4m) 81s ago 4m 43.2M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:24:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (4m) 81s ago 4m 40.9M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:24:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (3m) 81s ago 3m 40.8M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:24:20.356 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (6m) 76s ago 9m 46.9M - 2.43.0 a07b618ecd1d 92209c2989e2 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6e440692b0 msgr2=0x7f6e4406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6e440692b0 0x7f6e4406b760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0045a0 tx=0x7f6e4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 msgr2=0x7f6e6010fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 0x7f6e6010fae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000eb40 tx=0x7f6e5000b040 comp rx=0 tx=0).stop 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 shutdown_connections 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f6e440692b0 0x7f6e4406b760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e600fcef0 0x7f6e6010fae0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 --2- 172.21.15.148:0/3142871138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e600fe0e0 0x7f6e60110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 >> 172.21.15.148:0/3142871138 conn(0x7f6e600f8620 msgr2=0x7f6e600ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 shutdown_connections 2024-02-28T16:24:20.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.368+0000 7f6e66e00700 1 -- 172.21.15.148:0/3142871138 wait complete. 2024-02-28T16:24:20.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.502+0000 7fbe61600700 1 -- 172.21.15.148:0/1637492890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fe0e0 msgr2=0x7fbe5c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.502+0000 7fbe61600700 1 --2- 172.21.15.148:0/1637492890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fe0e0 0x7fbe5c0fe550 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe48004940 tx=0x7fbe48009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:20.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.502+0000 7fbe61600700 1 -- 172.21.15.148:0/1637492890 shutdown_connections 2024-02-28T16:24:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.502+0000 7fbe61600700 1 --2- 172.21.15.148:0/1637492890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fe0e0 0x7fbe5c0fe550 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.502+0000 7fbe61600700 1 --2- 172.21.15.148:0/1637492890 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c0fcef0 0x7fbe5c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.502+0000 7fbe61600700 1 -- 172.21.15.148:0/1637492890 >> 172.21.15.148:0/1637492890 conn(0x7fbe5c0f8620 msgr2=0x7fbe5c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.503+0000 7fbe61600700 1 -- 172.21.15.148:0/1637492890 shutdown_connections 2024-02-28T16:24:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.503+0000 7fbe61600700 1 -- 172.21.15.148:0/1637492890 wait complete. 2024-02-28T16:24:20.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.504+0000 7fbe61600700 1 Processor -- start 2024-02-28T16:24:20.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.504+0000 7fbe61600700 1 -- start start 2024-02-28T16:24:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.504+0000 7fbe61600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fcef0 0x7fbe5c10d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.504+0000 7fbe61600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c0fe0e0 0x7fbe5c10de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.504+0000 7fbe61600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c10e410 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.504+0000 7fbe61600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c10ecb0 con 0x7fbe5c0fe0e0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.505+0000 7fbe5aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fcef0 0x7fbe5c10d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.505+0000 7fbe5aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fcef0 0x7fbe5c10d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55818/0 (socket says 172.21.15.148:55818) 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.505+0000 7fbe5aa00700 1 -- 172.21.15.148:0/3345776178 learned_addr learned my addr 172.21.15.148:0/3345776178 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.505+0000 7fbe5aa00700 1 -- 172.21.15.148:0/3345776178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c0fe0e0 msgr2=0x7fbe5c10de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.505+0000 7fbe5aa00700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c0fe0e0 0x7fbe5c10de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.505+0000 7fbe5aa00700 1 -- 172.21.15.148:0/3345776178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48005040 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.505+0000 7fbe5aa00700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fcef0 0x7fbe5c10d8d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00eb70 tx=0x7fbe4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.506+0000 7fbe52a00700 1 -- 172.21.15.148:0/3345776178 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe4c007cc0 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.506+0000 7fbe52a00700 1 -- 172.21.15.148:0/3345776178 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe4c00f040 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.506+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c10ef30 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.506+0000 7fbe52a00700 1 -- 172.21.15.148:0/3345776178 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe4c00cb60 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.506+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c10f470 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.507+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c04bed0 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.510+0000 7fbe52a00700 1 -- 172.21.15.148:0/3345776178 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fbe4c00ccc0 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.511+0000 7fbe52a00700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbe400692a0 0x7fbe4006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.511+0000 7fbe52a00700 1 -- 172.21.15.148:0/3345776178 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbe4c086fe0 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.512+0000 7fbe5a000700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbe400692a0 0x7fbe4006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:20.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.513+0000 7fbe5a000700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbe400692a0 0x7fbe4006b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009fd0 tx=0x7fbe48009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:20.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.514+0000 7fbe52a00700 1 -- 172.21.15.148:0/3345776178 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fbe4c056e20 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.589 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:20 smithi148 ceph-mon[28767]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi157 2024-02-28T16:24:20.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.837+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe5c10fb30 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.828 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.838+0000 7fbe52a00700 1 -- 172.21.15.148:0/3345776178 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fbe4c0569b0 con 0x7fbe5c0fcef0 2024-02-28T16:24:20.828 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:24:20.828 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:24:20.829 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:20.830 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:24:20.830 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 14 2024-02-28T16:24:20.830 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:24:20.830 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:24:20.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.841+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbe400692a0 msgr2=0x7fbe4006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.841+0000 7fbe61600700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbe400692a0 0x7fbe4006b750 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009fd0 tx=0x7fbe48009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:20.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.841+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fcef0 msgr2=0x7fbe5c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.841+0000 7fbe61600700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fcef0 0x7fbe5c10d8d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00eb70 tx=0x7fbe4c00b040 comp rx=0 tx=0).stop 2024-02-28T16:24:20.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.842+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 shutdown_connections 2024-02-28T16:24:20.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.842+0000 7fbe61600700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c0fcef0 0x7fbe5c10d8d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.842+0000 7fbe61600700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fbe400692a0 0x7fbe4006b750 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.842+0000 7fbe61600700 1 --2- 172.21.15.148:0/3345776178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c0fe0e0 0x7fbe5c10de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.842+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 >> 172.21.15.148:0/3345776178 conn(0x7fbe5c0f8620 msgr2=0x7fbe5c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:20.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.842+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 shutdown_connections 2024-02-28T16:24:20.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.842+0000 7fbe61600700 1 -- 172.21.15.148:0/3345776178 wait complete. 2024-02-28T16:24:20.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:20 smithi148 ceph-mon[28767]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 -- 172.21.15.148:0/3875850486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 msgr2=0x7fa2fc070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 --2- 172.21.15.148:0/3875850486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc070380 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0004940 tx=0x7fa2f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 -- 172.21.15.148:0/3875850486 shutdown_connections 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 --2- 172.21.15.148:0/3875850486 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2fc0708c0 0x7fa2fc070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 --2- 172.21.15.148:0/3875850486 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc070380 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 -- 172.21.15.148:0/3875850486 >> 172.21.15.148:0/3875850486 conn(0x7fa2fc0f8620 msgr2=0x7fa2fc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 -- 172.21.15.148:0/3875850486 shutdown_connections 2024-02-28T16:24:20.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.983+0000 7fa304400700 1 -- 172.21.15.148:0/3875850486 wait complete. 2024-02-28T16:24:20.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.984+0000 7fa304400700 1 Processor -- start 2024-02-28T16:24:20.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.984+0000 7fa304400700 1 -- start start 2024-02-28T16:24:20.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.985+0000 7fa304400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2fc0708c0 0x7fa2fc06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.985+0000 7fa304400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc06f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.985+0000 7fa304400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc06fb50 con 0x7fa2fc071f10 2024-02-28T16:24:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.985+0000 7fa304400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc119770 con 0x7fa2fc0708c0 2024-02-28T16:24:20.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.985+0000 7fa301000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc06f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:20.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.985+0000 7fa301000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc06f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55832/0 (socket says 172.21.15.148:55832) 2024-02-28T16:24:20.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.985+0000 7fa301000700 1 -- 172.21.15.148:0/2023246523 learned_addr learned my addr 172.21.15.148:0/2023246523 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:20.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.986+0000 7fa301000700 1 -- 172.21.15.148:0/2023246523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2fc0708c0 msgr2=0x7fa2fc06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:20.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.986+0000 7fa301000700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2fc0708c0 0x7fa2fc06efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:20.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.986+0000 7fa301000700 1 -- 172.21.15.148:0/2023246523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0005040 con 0x7fa2fc071f10 2024-02-28T16:24:20.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.986+0000 7fa301000700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc06f500 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800eb70 tx=0x7fa2e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:20.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.987+0000 7fa2f9600700 1 -- 172.21.15.148:0/2023246523 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e8007cc0 con 0x7fa2fc071f10 2024-02-28T16:24:20.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.987+0000 7fa2f9600700 1 -- 172.21.15.148:0/2023246523 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2e800f040 con 0x7fa2fc071f10 2024-02-28T16:24:20.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.987+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2fc1199f0 con 0x7fa2fc071f10 2024-02-28T16:24:20.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.987+0000 7fa2f9600700 1 -- 172.21.15.148:0/2023246523 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e8009640 con 0x7fa2fc071f10 2024-02-28T16:24:20.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.987+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc119f30 con 0x7fa2fc071f10 2024-02-28T16:24:20.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.989+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2fc04bed0 con 0x7fa2fc071f10 2024-02-28T16:24:20.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.991+0000 7fa2f9600700 1 -- 172.21.15.148:0/2023246523 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7fa2e80097a0 con 0x7fa2fc071f10 2024-02-28T16:24:20.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.993+0000 7fa2f9600700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2e40692a0 0x7fa2e406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.994+0000 7fa2f9600700 1 -- 172.21.15.148:0/2023246523 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa2e8086d50 con 0x7fa2fc071f10 2024-02-28T16:24:20.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.994+0000 7fa301a00700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2e40692a0 0x7fa2e406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:20.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.995+0000 7fa301a00700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2e40692a0 0x7fa2e406b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009fd0 tx=0x7fa2f0009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:20.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:20.997+0000 7fa2f9600700 1 -- 172.21.15.148:0/2023246523 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7fa2e8053030 con 0x7fa2fc071f10 2024-02-28T16:24:20.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:20 smithi157 ceph-mon[38346]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi157 2024-02-28T16:24:20.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:20 smithi157 ceph-mon[38346]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:21.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.218+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2fc1044f0 con 0x7fa2e40692a0 2024-02-28T16:24:21.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.219+0000 7fa2f9600700 1 -- 172.21.15.148:0/2023246523 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa2fc1044f0 con 0x7fa2e40692a0 2024-02-28T16:24:21.209 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:24:21.209 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:24:21.209 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:24:21.209 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:24:21.210 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [], 2024-02-28T16:24:21.210 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "0/2 daemons upgraded", 2024-02-28T16:24:21.210 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc image on host smithi157", 2024-02-28T16:24:21.210 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:24:21.210 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2e40692a0 msgr2=0x7fa2e406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2e40692a0 0x7fa2e406b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009fd0 tx=0x7fa2f0009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 msgr2=0x7fa2fc06f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc06f500 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800eb70 tx=0x7fa2e800b040 comp rx=0 tx=0).stop 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 shutdown_connections 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7fa2e40692a0 0x7fa2e406b750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2fc0708c0 0x7fa2fc06efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 --2- 172.21.15.148:0/2023246523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2fc071f10 0x7fa2fc06f500 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 >> 172.21.15.148:0/2023246523 conn(0x7fa2fc0f8620 msgr2=0x7fa2fc102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.223+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 shutdown_connections 2024-02-28T16:24:21.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:21.224+0000 7fa304400700 1 -- 172.21.15.148:0/2023246523 wait complete. 2024-02-28T16:24:21.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:21 smithi148 ceph-mon[28767]: pgmap v301: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:21.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:21 smithi148 ceph-mon[28767]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:21.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:21 smithi148 ceph-mon[28767]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:21.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:21 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3345776178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:21.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:21 smithi157 ceph-mon[38346]: pgmap v301: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:21.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:21 smithi157 ceph-mon[38346]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:21.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:21 smithi157 ceph-mon[38346]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:21.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:21 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3345776178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:22.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:22 smithi148 ceph-mon[28767]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:22.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:22 smithi157 ceph-mon[38346]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:23.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:23 smithi148 ceph-mon[28767]: pgmap v302: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:23.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:23 smithi157 ceph-mon[38346]: pgmap v302: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:25.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:25 smithi148 ceph-mon[28767]: pgmap v303: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:25.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:25 smithi157 ceph-mon[38346]: pgmap v303: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:26.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:26 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:27.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:26 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:27.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:27 smithi148 ceph-mon[28767]: pgmap v304: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:27.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:27 smithi157 ceph-mon[38346]: pgmap v304: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:29.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:29 smithi148 ceph-mon[28767]: pgmap v305: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:29 smithi157 ceph-mon[38346]: pgmap v305: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:31.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:30 smithi148 ceph-mon[28767]: pgmap v306: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:31.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:30 smithi157 ceph-mon[38346]: pgmap v306: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:33.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:33 smithi148 ceph-mon[28767]: pgmap v307: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:33.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:33 smithi157 ceph-mon[38346]: pgmap v307: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:35.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:35 smithi157 ceph-mon[38346]: pgmap v308: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:35.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:35 smithi148 ceph-mon[28767]: pgmap v308: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:37.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:37 smithi148 ceph-mon[28767]: pgmap v309: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:37.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:37 smithi157 ceph-mon[38346]: pgmap v309: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:39.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:39 smithi148 ceph-mon[28767]: pgmap v310: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:39.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:39 smithi157 ceph-mon[38346]: pgmap v310: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:41.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:40 smithi148 ceph-mon[28767]: pgmap v311: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:40 smithi157 ceph-mon[38346]: pgmap v311: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:41 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:41 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:42.444 INFO:tasks.workunit.client.0.smithi148.stderr:Updating files: 62% (7631/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T16:24:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T16:24:42.815 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-02-28T16:24:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T16:24:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T16:24:42.815 INFO:tasks.workunit.client.0.smithi148.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T16:24:42.815 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr: git switch -c 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:Or undo this operation with: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr: git switch - 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr: 2024-02-28T16:24:42.816 INFO:tasks.workunit.client.0.smithi148.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T16:24:42.818 DEBUG:teuthology.orchestra.run.smithi148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-28T16:24:42.871 INFO:tasks.workunit.client.0.smithi148.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T16:24:42.879 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T16:24:42.879 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T16:24:43.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:42 smithi148 ceph-mon[28767]: pgmap v312: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:43.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:42 smithi157 ceph-mon[38346]: pgmap v312: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:43.872 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T16:24:43.993 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T16:24:44.071 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T16:24:44.078 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T16:24:44.078 INFO:tasks.workunit.client.0.smithi148.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T16:24:44.159 INFO:tasks.workunit.client.0.smithi148.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T16:24:44.167 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:24:44.167 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-28T16:24:44.216 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-28T16:24:44.218 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T16:24:44.219 DEBUG:teuthology.orchestra.run.smithi148:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-28T16:24:44.346 INFO:tasks.workunit.client.0.smithi148.stderr:+ mkdir -p fsstress 2024-02-28T16:24:44.356 INFO:tasks.workunit.client.0.smithi148.stderr:+ pushd fsstress 2024-02-28T16:24:44.361 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:24:44.361 INFO:tasks.workunit.client.0.smithi148.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T16:24:45.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:45 smithi148 ceph-mon[28767]: pgmap v313: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:45.468 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:45 smithi157 ceph-mon[38346]: pgmap v313: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:24:45.915 INFO:tasks.workunit.client.0.smithi148.stderr:+ tar xzf ltp-full.tgz 2024-02-28T16:24:46.171 INFO:tasks.workunit.client.1.smithi157.stderr:Updating files: 52% (6476/12271) Updating files: 53% (6504/12271) Updating files: 54% (6627/12271) Updating files: 55% (6750/12271) Updating files: 56% (6872/12271) Updating files: 57% (6995/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 84% (10389/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T16:24:46.326 INFO:tasks.workunit.client.1.smithi157.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr: 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr: 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr: 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr: git switch -c 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr: 2024-02-28T16:24:46.327 INFO:tasks.workunit.client.1.smithi157.stderr:Or undo this operation with: 2024-02-28T16:24:46.328 INFO:tasks.workunit.client.1.smithi157.stderr: 2024-02-28T16:24:46.328 INFO:tasks.workunit.client.1.smithi157.stderr: git switch - 2024-02-28T16:24:46.328 INFO:tasks.workunit.client.1.smithi157.stderr: 2024-02-28T16:24:46.328 INFO:tasks.workunit.client.1.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T16:24:46.328 INFO:tasks.workunit.client.1.smithi157.stderr: 2024-02-28T16:24:46.328 INFO:tasks.workunit.client.1.smithi157.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T16:24:46.330 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-28T16:24:46.410 INFO:tasks.workunit.client.1.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T16:24:46.416 INFO:tasks.workunit.client.1.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T16:24:46.416 INFO:tasks.workunit.client.1.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T16:24:47.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:47 smithi148 ceph-mon[28767]: pgmap v314: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s wr, 0 op/s 2024-02-28T16:24:47.398 INFO:tasks.workunit.client.1.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T16:24:47.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:47 smithi157 ceph-mon[38346]: pgmap v314: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 343 KiB/s wr, 0 op/s 2024-02-28T16:24:47.567 INFO:tasks.workunit.client.1.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T16:24:47.651 INFO:tasks.workunit.client.1.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T16:24:47.655 INFO:tasks.workunit.client.1.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T16:24:47.656 INFO:tasks.workunit.client.1.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T16:24:47.735 INFO:tasks.workunit.client.1.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T16:24:47.743 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-02-28T16:24:47.743 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-28T16:24:47.791 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-28T16:24:47.792 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T16:24:47.792 DEBUG:teuthology.orchestra.run.smithi157:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-28T16:24:47.911 INFO:tasks.workunit.client.1.smithi157.stderr:+ mkdir -p fsstress 2024-02-28T16:24:47.919 INFO:tasks.workunit.client.1.smithi157.stderr:+ pushd fsstress 2024-02-28T16:24:47.921 INFO:tasks.workunit.client.1.smithi157.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:24:47.921 INFO:tasks.workunit.client.1.smithi157.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T16:24:49.155 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:49 smithi157 ceph-mon[38346]: pgmap v315: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 344 KiB/s wr, 1 op/s 2024-02-28T16:24:49.205 INFO:tasks.workunit.client.1.smithi157.stderr:+ tar xzf ltp-full.tgz 2024-02-28T16:24:49.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:49 smithi148 ceph-mon[28767]: pgmap v315: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 344 KiB/s wr, 1 op/s 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.429+0000 7f63efc00700 1 -- 172.21.15.148:0/1574780723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 msgr2=0x7f63e80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.429+0000 7f63efc00700 1 --2- 172.21.15.148:0/1574780723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e80fd320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f63dc004940 tx=0x7f63dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.430+0000 7f63efc00700 1 -- 172.21.15.148:0/1574780723 shutdown_connections 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.430+0000 7f63efc00700 1 --2- 172.21.15.148:0/1574780723 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e80fe0e0 0x7f63e80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.430+0000 7f63efc00700 1 --2- 172.21.15.148:0/1574780723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e80fd320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.430+0000 7f63efc00700 1 -- 172.21.15.148:0/1574780723 >> 172.21.15.148:0/1574780723 conn(0x7f63e80f8620 msgr2=0x7f63e80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.430+0000 7f63efc00700 1 -- 172.21.15.148:0/1574780723 shutdown_connections 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.430+0000 7f63efc00700 1 -- 172.21.15.148:0/1574780723 wait complete. 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.431+0000 7f63efc00700 1 Processor -- start 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.431+0000 7f63efc00700 1 -- start start 2024-02-28T16:24:51.422 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.431+0000 7f63efc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.431+0000 7f63efc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e80fe0e0 0x7f63e81100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.431+0000 7f63efc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e81106d0 con 0x7f63e80fcef0 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.431+0000 7f63efc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8110f70 con 0x7f63e80fe0e0 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.431+0000 7f63ed200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.432+0000 7f63ed200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e810fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:48266/0 (socket says 172.21.15.148:48266) 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.432+0000 7f63ed200700 1 -- 172.21.15.148:0/3937061345 learned_addr learned my addr 172.21.15.148:0/3937061345 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.432+0000 7f63e7e00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e80fe0e0 0x7f63e81100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.432+0000 7f63ed200700 1 -- 172.21.15.148:0/3937061345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e80fe0e0 msgr2=0x7f63e81100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.432+0000 7f63ed200700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e80fe0e0 0x7f63e81100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.423 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.432+0000 7f63ed200700 1 -- 172.21.15.148:0/3937061345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc005040 con 0x7f63e80fcef0 2024-02-28T16:24:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.432+0000 7f63ed200700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e810fb90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f63dc000c00 tx=0x7f63dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.433+0000 7f63e4c00700 1 -- 172.21.15.148:0/3937061345 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63dc00e040 con 0x7f63e80fcef0 2024-02-28T16:24:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.433+0000 7f63e4c00700 1 -- 172.21.15.148:0/3937061345 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63dc00bbf0 con 0x7f63e80fcef0 2024-02-28T16:24:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.433+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e81111f0 con 0x7f63e80fcef0 2024-02-28T16:24:51.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.433+0000 7f63e4c00700 1 -- 172.21.15.148:0/3937061345 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63dc01c630 con 0x7f63e80fcef0 2024-02-28T16:24:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.433+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e8111730 con 0x7f63e80fcef0 2024-02-28T16:24:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.435+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e8102210 con 0x7f63e80fcef0 2024-02-28T16:24:51.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.436+0000 7f63e4c00700 1 -- 172.21.15.148:0/3937061345 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f63dc00bd60 con 0x7f63e80fcef0 2024-02-28T16:24:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.436+0000 7f63e4c00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f63d00692a0 0x7f63d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.437+0000 7f63e4c00700 1 -- 172.21.15.148:0/3937061345 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f63dc088500 con 0x7f63e80fcef0 2024-02-28T16:24:51.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.440+0000 7f63e7e00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f63d00692a0 0x7f63d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.441+0000 7f63e7e00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f63d00692a0 0x7f63d006b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63d4004f40 tx=0x7f63d400b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.444+0000 7f63e4c00700 1 -- 172.21.15.148:0/3937061345 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f63dc058250 con 0x7f63e80fcef0 2024-02-28T16:24:51.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.709+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63e802b3b0 con 0x7f63d00692a0 2024-02-28T16:24:51.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.711+0000 7f63e4c00700 1 -- 172.21.15.148:0/3937061345 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f63e802b3b0 con 0x7f63d00692a0 2024-02-28T16:24:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f63d00692a0 msgr2=0x7f63d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f63d00692a0 0x7f63d006b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63d4004f40 tx=0x7f63d400b040 comp rx=0 tx=0).stop 2024-02-28T16:24:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 msgr2=0x7f63e810fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e810fb90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f63dc000c00 tx=0x7f63dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:51.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 shutdown_connections 2024-02-28T16:24:51.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e80fcef0 0x7f63e810fb90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f63d00692a0 0x7f63d006b750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 --2- 172.21.15.148:0/3937061345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e80fe0e0 0x7f63e81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.714+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 >> 172.21.15.148:0/3937061345 conn(0x7f63e80f8620 msgr2=0x7f63e80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:51.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.715+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 shutdown_connections 2024-02-28T16:24:51.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.715+0000 7f63efc00700 1 -- 172.21.15.148:0/3937061345 wait complete. 2024-02-28T16:24:51.722 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:24:51.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 -- 172.21.15.148:0/1489547675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 msgr2=0x7f3de8101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 --2- 172.21.15.148:0/1489547675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de8101ef0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8004940 tx=0x7f3dd8009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:51.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 -- 172.21.15.148:0/1489547675 shutdown_connections 2024-02-28T16:24:51.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 --2- 172.21.15.148:0/1489547675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8102430 0x7f3de8104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 --2- 172.21.15.148:0/1489547675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de8101ef0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 -- 172.21.15.148:0/1489547675 >> 172.21.15.148:0/1489547675 conn(0x7f3de80f7520 msgr2=0x7f3de80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:51.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 -- 172.21.15.148:0/1489547675 shutdown_connections 2024-02-28T16:24:51.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.898+0000 7f3ded400700 1 -- 172.21.15.148:0/1489547675 wait complete. 2024-02-28T16:24:51.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.899+0000 7f3ded400700 1 Processor -- start 2024-02-28T16:24:51.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.900+0000 7f3ded400700 1 -- start start 2024-02-28T16:24:51.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.900+0000 7f3ded400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de810fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.900+0000 7f3ded400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8102430 0x7f3de81100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.900+0000 7f3ded400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81106c0 con 0x7f3de8066c70 2024-02-28T16:24:51.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.900+0000 7f3ded400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de8110f60 con 0x7f3de8102430 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de6800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de810fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de5e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8102430 0x7f3de81100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de5e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8102430 0x7f3de81100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:53592/0 (socket says 172.21.15.148:53592) 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de6800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de810fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50362/0 (socket says 172.21.15.148:50362) 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de5e00700 1 -- 172.21.15.148:0/3348265902 learned_addr learned my addr 172.21.15.148:0/3348265902 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de6800700 1 -- 172.21.15.148:0/3348265902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8102430 msgr2=0x7f3de81100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de6800700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8102430 0x7f3de81100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:51.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.901+0000 7f3de6800700 1 -- 172.21.15.148:0/3348265902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8005040 con 0x7f3de8066c70 2024-02-28T16:24:51.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.902+0000 7f3de6800700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de810fb80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009fd0 tx=0x7f3dd8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.902+0000 7f3ddea00700 1 -- 172.21.15.148:0/3348265902 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd800e040 con 0x7f3de8066c70 2024-02-28T16:24:51.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.902+0000 7f3ddea00700 1 -- 172.21.15.148:0/3348265902 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3dd8004290 con 0x7f3de8066c70 2024-02-28T16:24:51.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.902+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de81111e0 con 0x7f3de8066c70 2024-02-28T16:24:51.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.902+0000 7f3ddea00700 1 -- 172.21.15.148:0/3348265902 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3dd801c3f0 con 0x7f3de8066c70 2024-02-28T16:24:51.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.902+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de8111720 con 0x7f3de8066c70 2024-02-28T16:24:51.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.903+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de804bed0 con 0x7f3de8066c70 2024-02-28T16:24:51.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.905+0000 7f3ddea00700 1 -- 172.21.15.148:0/3348265902 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f3dd8013420 con 0x7f3de8066c70 2024-02-28T16:24:51.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.906+0000 7f3ddea00700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3dcc0692b0 0x7f3dcc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:51.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.906+0000 7f3ddea00700 1 -- 172.21.15.148:0/3348265902 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3dd8088290 con 0x7f3de8066c70 2024-02-28T16:24:51.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.907+0000 7f3de5e00700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3dcc0692b0 0x7f3dcc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:51.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.908+0000 7f3de5e00700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3dcc0692b0 0x7f3dcc06b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40101c0 tx=0x7f3dd400b040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:51.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:51.912+0000 7f3ddea00700 1 -- 172.21.15.148:0/3348265902 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f3dd8057f60 con 0x7f3de8066c70 2024-02-28T16:24:51.982 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:51 smithi157 ceph-mon[38346]: pgmap v316: 65 pgs: 65 active+clean; 9.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 733 KiB/s wr, 5 op/s 2024-02-28T16:24:51.982 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:51 smithi157 ceph-mon[38346]: Upgrade: Updating mgr.smithi157.cmcxzj 2024-02-28T16:24:51.982 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:51.982 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:24:51.982 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:24:51.982 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:51 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:51.982 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:51 smithi157 ceph-mon[38346]: Deploying daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:24:52.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:51 smithi148 ceph-mon[28767]: pgmap v316: 65 pgs: 65 active+clean; 9.2 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 733 KiB/s wr, 5 op/s 2024-02-28T16:24:52.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:51 smithi148 ceph-mon[28767]: Upgrade: Updating mgr.smithi157.cmcxzj 2024-02-28T16:24:52.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:24:52.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:24:52.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:24:52.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:51 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:24:52.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:51 smithi148 ceph-mon[28767]: Deploying daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:24:52.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.176+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3de8103090 con 0x7f3dcc0692b0 2024-02-28T16:24:52.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.178+0000 7f3ddea00700 1 -- 172.21.15.148:0/3348265902 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f3de8103090 con 0x7f3dcc0692b0 2024-02-28T16:24:52.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.180+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3dcc0692b0 msgr2=0x7f3dcc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.180+0000 7f3ded400700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3dcc0692b0 0x7f3dcc06b760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40101c0 tx=0x7f3dd400b040 comp rx=0 tx=0).stop 2024-02-28T16:24:52.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.180+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 msgr2=0x7f3de810fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.180+0000 7f3ded400700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de810fb80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009fd0 tx=0x7f3dd8009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:52.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.181+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 shutdown_connections 2024-02-28T16:24:52.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.181+0000 7f3ded400700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3de8066c70 0x7f3de810fb80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.181+0000 7f3ded400700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f3dcc0692b0 0x7f3dcc06b760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.181+0000 7f3ded400700 1 --2- 172.21.15.148:0/3348265902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3de8102430 0x7f3de81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.181+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 >> 172.21.15.148:0/3348265902 conn(0x7f3de80f7520 msgr2=0x7f3de80f9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:52.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.181+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 shutdown_connections 2024-02-28T16:24:52.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.181+0000 7f3ded400700 1 -- 172.21.15.148:0/3348265902 wait complete. 2024-02-28T16:24:52.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 -- 172.21.15.148:0/2555876303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 msgr2=0x7f10540fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 --2- 172.21.15.148:0/2555876303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10540fe550 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1040004940 tx=0x7f1040009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:52.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 -- 172.21.15.148:0/2555876303 shutdown_connections 2024-02-28T16:24:52.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 --2- 172.21.15.148:0/2555876303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10540fe550 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 --2- 172.21.15.148:0/2555876303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10540fcef0 0x7f10540fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 -- 172.21.15.148:0/2555876303 >> 172.21.15.148:0/2555876303 conn(0x7f10540f8620 msgr2=0x7f10540faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 -- 172.21.15.148:0/2555876303 shutdown_connections 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.350+0000 7f105b800700 1 -- 172.21.15.148:0/2555876303 wait complete. 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.351+0000 7f105b800700 1 Processor -- start 2024-02-28T16:24:52.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.352+0000 7f105b800700 1 -- start start 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.352+0000 7f105b800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10540fcef0 0x7f105410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.352+0000 7f105b800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10541100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.352+0000 7f105b800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10541106a0 con 0x7f10540fe0e0 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.352+0000 7f105b800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054110f40 con 0x7f10540fcef0 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.352+0000 7f1053e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10541100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.353+0000 7f1053e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10541100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50384/0 (socket says 172.21.15.148:50384) 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.353+0000 7f1053e00700 1 -- 172.21.15.148:0/4048722739 learned_addr learned my addr 172.21.15.148:0/4048722739 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.353+0000 7f1058e00700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10540fcef0 0x7f105410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.353+0000 7f1053e00700 1 -- 172.21.15.148:0/4048722739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10540fcef0 msgr2=0x7f105410fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.353+0000 7f1053e00700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10540fcef0 0x7f105410fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.353+0000 7f1053e00700 1 -- 172.21.15.148:0/4048722739 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040005040 con 0x7f10540fe0e0 2024-02-28T16:24:52.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.353+0000 7f1053e00700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10541100a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f104000b3b0 tx=0x7f1040009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:52.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.354+0000 7f1050c00700 1 -- 172.21.15.148:0/4048722739 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104000e040 con 0x7f10540fe0e0 2024-02-28T16:24:52.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.354+0000 7f1050c00700 1 -- 172.21.15.148:0/4048722739 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f104000bd90 con 0x7f10540fe0e0 2024-02-28T16:24:52.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.354+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10541111c0 con 0x7f10540fe0e0 2024-02-28T16:24:52.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.354+0000 7f1050c00700 1 -- 172.21.15.148:0/4048722739 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f104001c630 con 0x7f10540fe0e0 2024-02-28T16:24:52.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.354+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1054111700 con 0x7f10540fe0e0 2024-02-28T16:24:52.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.356+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1054102210 con 0x7f10540fe0e0 2024-02-28T16:24:52.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.357+0000 7f1050c00700 1 -- 172.21.15.148:0/4048722739 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f10400139f0 con 0x7f10540fe0e0 2024-02-28T16:24:52.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.358+0000 7f1050c00700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f103c0692b0 0x7f103c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.358+0000 7f1050c00700 1 -- 172.21.15.148:0/4048722739 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1040088730 con 0x7f10540fe0e0 2024-02-28T16:24:52.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.358+0000 7f1058e00700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f103c0692b0 0x7f103c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.359+0000 7f1058e00700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f103c0692b0 0x7f103c06b760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1048009fd0 tx=0x7f1048009f00 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:52.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.364+0000 7f1050c00700 1 -- 172.21.15.148:0/4048722739 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f1040058480 con 0x7f10540fe0e0 2024-02-28T16:24:52.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.633+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f105402b310 con 0x7f103c0692b0 2024-02-28T16:24:52.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.665+0000 7f1050c00700 1 -- 172.21.15.148:0/4048722739 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f105402b310 con 0x7f103c0692b0 2024-02-28T16:24:52.655 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:24:52.655 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (7m) 109s ago 10m 13.4M - 0.25.0 c8568f914cd2 1a028b2bba8f 2024-02-28T16:24:52.655 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (10m) 109s ago 10m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:24:52.655 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (9m) 114s ago 9m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:24:52.655 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (7m) 109s ago 9m 74.6M - 9.4.7 954c08fa6188 9cb307a9b404 2024-02-28T16:24:52.655 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (2m) 109s ago 2m 10.4M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (2m) 109s ago 2m 12.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (2m) 114s ago 2m 10.5M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (2m) 114s ago 2m 10.5M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:9283 running (12m) 109s ago 12m 481M - 17.2.7-535-gc0f02e60 1c37ed371348 0efadaac859c 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (8m) 114s ago 8m 432M - 17.2.7-535-gc0f02e60 1c37ed371348 54778550d5fd 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (12m) 109s ago 12m 42.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (8m) 114s ago 8m 32.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (10m) 109s ago 10m 7968k - 1.5.0 0da6a335fe13 1cc6d69049e3 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (8m) 114s ago 8m 8002k - 1.5.0 0da6a335fe13 e10955ca2cb2 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (7m) 109s ago 7m 44.0M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (6m) 109s ago 6m 45.3M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (6m) 109s ago 6m 43.6M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (5m) 114s ago 5m 43.2M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:24:52.656 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (4m) 114s ago 4m 40.9M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:24:52.657 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (4m) 114s ago 4m 40.8M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:24:52.657 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (7m) 109s ago 9m 46.9M - 2.43.0 a07b618ecd1d 92209c2989e2 2024-02-28T16:24:52.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.668+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f103c0692b0 msgr2=0x7f103c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.668+0000 7f105b800700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f103c0692b0 0x7f103c06b760 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1048009fd0 tx=0x7f1048009f00 comp rx=0 tx=0).stop 2024-02-28T16:24:52.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.668+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 msgr2=0x7f10541100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.668+0000 7f105b800700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10541100a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f104000b3b0 tx=0x7f1040009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:52.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.669+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 shutdown_connections 2024-02-28T16:24:52.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.669+0000 7f105b800700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f103c0692b0 0x7f103c06b760 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.669+0000 7f105b800700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f10540fcef0 0x7f105410fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.669+0000 7f105b800700 1 --2- 172.21.15.148:0/4048722739 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10540fe0e0 0x7f10541100a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.669+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 >> 172.21.15.148:0/4048722739 conn(0x7f10540f8620 msgr2=0x7f10540ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:52.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.669+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 shutdown_connections 2024-02-28T16:24:52.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.669+0000 7f105b800700 1 -- 172.21.15.148:0/4048722739 wait complete. 2024-02-28T16:24:52.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.848+0000 7f18f0e00700 1 -- 172.21.15.148:0/3522338303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 msgr2=0x7f18ec0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.848+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3522338303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 0x7f18ec0ff560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f18dc004940 tx=0x7f18dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.849+0000 7f18f0e00700 1 -- 172.21.15.148:0/3522338303 shutdown_connections 2024-02-28T16:24:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.849+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3522338303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 0x7f18ec1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.849+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3522338303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 0x7f18ec0ff560 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.849+0000 7f18f0e00700 1 -- 172.21.15.148:0/3522338303 >> 172.21.15.148:0/3522338303 conn(0x7f18ec0fa920 msgr2=0x7f18ec0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.849+0000 7f18f0e00700 1 -- 172.21.15.148:0/3522338303 shutdown_connections 2024-02-28T16:24:52.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.849+0000 7f18f0e00700 1 -- 172.21.15.148:0/3522338303 wait complete. 2024-02-28T16:24:52.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.850+0000 7f18f0e00700 1 Processor -- start 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.850+0000 7f18f0e00700 1 -- start start 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.850+0000 7f18f0e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 0x7f18ec118a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.850+0000 7f18f0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 0x7f18ec118fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.850+0000 7f18f0e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec119630 con 0x7f18ec100360 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.850+0000 7f18f0e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec1197a0 con 0x7f18ec0ff150 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.851+0000 7f18e9400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 0x7f18ec118fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.851+0000 7f18e9e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 0x7f18ec118a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.851+0000 7f18e9400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 0x7f18ec118fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50414/0 (socket says 172.21.15.148:50414) 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.851+0000 7f18e9400700 1 -- 172.21.15.148:0/3279575612 learned_addr learned my addr 172.21.15.148:0/3279575612 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:52.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.851+0000 7f18e9400700 1 -- 172.21.15.148:0/3279575612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 msgr2=0x7f18ec118a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:52.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.851+0000 7f18e9400700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 0x7f18ec118a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:52.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.851+0000 7f18e9400700 1 -- 172.21.15.148:0/3279575612 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc005040 con 0x7f18ec100360 2024-02-28T16:24:52.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.852+0000 7f18e9400700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 0x7f18ec118fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b790 tx=0x7f18d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:52.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.852+0000 7f18e2000700 1 -- 172.21.15.148:0/3279575612 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d800f6f0 con 0x7f18ec100360 2024-02-28T16:24:52.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.852+0000 7f18e2000700 1 -- 172.21.15.148:0/3279575612 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18d800fd20 con 0x7f18ec100360 2024-02-28T16:24:52.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.852+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec119a80 con 0x7f18ec100360 2024-02-28T16:24:52.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.852+0000 7f18e2000700 1 -- 172.21.15.148:0/3279575612 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d80103a0 con 0x7f18ec100360 2024-02-28T16:24:52.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.852+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec119fc0 con 0x7f18ec100360 2024-02-28T16:24:52.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.854+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec069e50 con 0x7f18ec100360 2024-02-28T16:24:52.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.855+0000 7f18e2000700 1 -- 172.21.15.148:0/3279575612 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f18d8010500 con 0x7f18ec100360 2024-02-28T16:24:52.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.857+0000 7f18e2000700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18d00692b0 0x7f18d006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:52.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.857+0000 7f18e2000700 1 -- 172.21.15.148:0/3279575612 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f18d8086f20 con 0x7f18ec100360 2024-02-28T16:24:52.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.857+0000 7f18e9e00700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18d00692b0 0x7f18d006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:52.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.858+0000 7f18e9e00700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18d00692b0 0x7f18d006b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00b840 tx=0x7f18dc009e30 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:52.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:52.862+0000 7f18e2000700 1 -- 172.21.15.148:0/3279575612 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f18d8056e80 con 0x7f18ec100360 2024-02-28T16:24:52.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:52 smithi148 ceph-mon[28767]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:52.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:52 smithi157 ceph-mon[38346]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:53.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.212+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f18ec04bed0 con 0x7f18ec100360 2024-02-28T16:24:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.213+0000 7f18e2000700 1 -- 172.21.15.148:0/3279575612 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f18d8056a10 con 0x7f18ec100360 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:24:53.203 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:24:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:24:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:24:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:24:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 14 2024-02-28T16:24:53.204 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:24:53.204 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:24:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18d00692b0 msgr2=0x7f18d006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18d00692b0 0x7f18d006b760 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00b840 tx=0x7f18dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 msgr2=0x7f18ec118fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 0x7f18ec118fa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b790 tx=0x7f18d8009250 comp rx=0 tx=0).stop 2024-02-28T16:24:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 shutdown_connections 2024-02-28T16:24:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f18d00692b0 0x7f18d006b760 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00b840 tx=0x7f18dc009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:53.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f18ec0ff150 0x7f18ec118a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 --2- 172.21.15.148:0/3279575612 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18ec100360 0x7f18ec118fa0 secure :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b790 tx=0x7f18d8009250 comp rx=0 tx=0).stop 2024-02-28T16:24:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.216+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 >> 172.21.15.148:0/3279575612 conn(0x7f18ec0fa920 msgr2=0x7f18ec0fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.217+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 shutdown_connections 2024-02-28T16:24:53.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.217+0000 7f18f0e00700 1 -- 172.21.15.148:0/3279575612 wait complete. 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 -- 172.21.15.148:0/599629611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 msgr2=0x7f45540ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 --2- 172.21.15.148:0/599629611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f45540ff560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4544004940 tx=0x7f4544009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 -- 172.21.15.148:0/599629611 shutdown_connections 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 --2- 172.21.15.148:0/599629611 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4554100360 0x7f45541007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 --2- 172.21.15.148:0/599629611 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f45540ff560 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 -- 172.21.15.148:0/599629611 >> 172.21.15.148:0/599629611 conn(0x7f45540fa920 msgr2=0x7f45540fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 -- 172.21.15.148:0/599629611 shutdown_connections 2024-02-28T16:24:53.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.389+0000 7f455ac00700 1 -- 172.21.15.148:0/599629611 wait complete. 2024-02-28T16:24:53.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.390+0000 7f455ac00700 1 Processor -- start 2024-02-28T16:24:53.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.390+0000 7f455ac00700 1 -- start start 2024-02-28T16:24:53.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f455ac00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f455410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f455ac00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4554100360 0x7f45541100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f455ac00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4554110780 con 0x7f45540ff150 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f455ac00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4554110fc0 con 0x7f4554100360 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f4553e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f455410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f4553e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f455410fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:50428/0 (socket says 172.21.15.148:50428) 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f4553e00700 1 -- 172.21.15.148:0/1849593789 learned_addr learned my addr 172.21.15.148:0/1849593789 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f4553400700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4554100360 0x7f45541100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.391+0000 7f4553e00700 1 -- 172.21.15.148:0/1849593789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4554100360 msgr2=0x7f45541100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f4553e00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4554100360 0x7f45541100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f4553e00700 1 -- 172.21.15.148:0/1849593789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544005040 con 0x7f45540ff150 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f4553400700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4554100360 0x7f45541100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f4553e00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f455410fbb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4544000c00 tx=0x7f4544009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f454be00700 1 -- 172.21.15.148:0/1849593789 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454400e040 con 0x7f45540ff150 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f454be00700 1 -- 172.21.15.148:0/1849593789 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f454400bcc0 con 0x7f45540ff150 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f454be00700 1 -- 172.21.15.148:0/1849593789 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4544013ea0 con 0x7f45540ff150 2024-02-28T16:24:53.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4554111240 con 0x7f45540ff150 2024-02-28T16:24:53.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.392+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4554111780 con 0x7f45540ff150 2024-02-28T16:24:53.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.394+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455404bed0 con 0x7f45540ff150 2024-02-28T16:24:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.395+0000 7f454be00700 1 -- 172.21.15.148:0/1849593789 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) v1 ==== 86623+0+0 (secure 0 0 0) 0x7f4544013420 con 0x7f45540ff150 2024-02-28T16:24:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.396+0000 7f454be00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f45380692b0 0x7f453806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:24:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.396+0000 7f454be00700 1 -- 172.21.15.148:0/1849593789 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4544088520 con 0x7f45540ff150 2024-02-28T16:24:53.386 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.396+0000 7f4553400700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f45380692b0 0x7f453806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:24:53.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.397+0000 7f4553400700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f45380692b0 0x7f453806b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4540006fd0 tx=0x7f4540008040 comp rx=0 tx=0).ready entity=mgr.14216 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:24:53.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.401+0000 7f454be00700 1 -- 172.21.15.148:0/1849593789 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175031 (secure 0 0 0) 0x7f45440581f0 con 0x7f45540ff150 2024-02-28T16:24:53.675 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.685+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 --> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4554104cb0 con 0x7f45380692b0 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [], 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "0/2 daemons upgraded", 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:24:53.678 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:24:53.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.687+0000 7f454be00700 1 -- 172.21.15.148:0/1849593789 <== mgr.14216 v2:172.21.15.148:6800/3437363100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f4554104cb0 con 0x7f45380692b0 2024-02-28T16:24:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.691+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f45380692b0 msgr2=0x7f453806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.691+0000 7f455ac00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f45380692b0 0x7f453806b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4540006fd0 tx=0x7f4540008040 comp rx=0 tx=0).stop 2024-02-28T16:24:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.691+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 msgr2=0x7f455410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:24:53.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.691+0000 7f455ac00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f455410fbb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4544000c00 tx=0x7f4544009e30 comp rx=0 tx=0).stop 2024-02-28T16:24:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.692+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 shutdown_connections 2024-02-28T16:24:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.692+0000 7f455ac00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f45540ff150 0x7f455410fbb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.692+0000 7f455ac00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.148:6800/3437363100,v1:172.21.15.148:6801/3437363100] conn(0x7f45380692b0 0x7f453806b760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.692+0000 7f455ac00700 1 --2- 172.21.15.148:0/1849593789 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4554100360 0x7f45541100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:24:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.692+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 >> 172.21.15.148:0/1849593789 conn(0x7f45540fa920 msgr2=0x7f4554103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:24:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.692+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 shutdown_connections 2024-02-28T16:24:53.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:24:53.693+0000 7f455ac00700 1 -- 172.21.15.148:0/1849593789 wait complete. 2024-02-28T16:24:53.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:53 smithi157 ceph-mon[38346]: pgmap v317: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 16 op/s 2024-02-28T16:24:53.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:53 smithi157 ceph-mon[38346]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:53.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:53 smithi157 ceph-mon[38346]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:53.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:53 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3279575612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:54.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:53 smithi148 ceph-mon[28767]: pgmap v317: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 16 op/s 2024-02-28T16:24:54.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:53 smithi148 ceph-mon[28767]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:54.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:53 smithi148 ceph-mon[28767]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:54.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:53 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3279575612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:24:54.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:54 smithi157 ceph-mon[38346]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:55.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:54 smithi148 ceph-mon[28767]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:24:56.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:55 smithi148 ceph-mon[28767]: pgmap v318: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 40 op/s 2024-02-28T16:24:56.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:55 smithi157 ceph-mon[38346]: pgmap v318: 65 pgs: 65 active+clean; 25 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 40 op/s 2024-02-28T16:24:57.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:56 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:57.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:56 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:24:58.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:57 smithi148 ceph-mon[28767]: pgmap v319: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 55 op/s 2024-02-28T16:24:58.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:57 smithi157 ceph-mon[38346]: pgmap v319: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 55 op/s 2024-02-28T16:25:00.106 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:24:59 smithi157 ceph-mon[38346]: pgmap v320: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 59 op/s 2024-02-28T16:25:00.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:24:59 smithi148 ceph-mon[28767]: pgmap v320: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 59 op/s 2024-02-28T16:25:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:00 smithi148 ceph-mon[28767]: pgmap v321: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 69 op/s 2024-02-28T16:25:01.157 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:00 smithi157 ceph-mon[38346]: pgmap v321: 65 pgs: 65 active+clean; 33 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 69 op/s 2024-02-28T16:25:03.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:03 smithi157 ceph-mon[38346]: pgmap v322: 65 pgs: 65 active+clean; 35 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 77 op/s 2024-02-28T16:25:03.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:03 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:03.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:03 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:03.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:03 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:03.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:03 smithi148 ceph-mon[28767]: pgmap v322: 65 pgs: 65 active+clean; 35 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 77 op/s 2024-02-28T16:25:03.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:03 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:03.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:03 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:03.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:03 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:05.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:05 smithi157 ceph-mon[38346]: pgmap v323: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 80 op/s 2024-02-28T16:25:05.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:05 smithi148 ceph-mon[28767]: pgmap v323: 65 pgs: 65 active+clean; 36 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.9 MiB/s wr, 80 op/s 2024-02-28T16:25:07.466 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:07 smithi157 ceph-mon[38346]: pgmap v324: 65 pgs: 65 active+clean; 41 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 68 op/s 2024-02-28T16:25:07.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:07 smithi148 ceph-mon[28767]: pgmap v324: 65 pgs: 65 active+clean; 41 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 68 op/s 2024-02-28T16:25:09.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:09 smithi157 ceph-mon[38346]: pgmap v325: 65 pgs: 65 active+clean; 41 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 59 op/s 2024-02-28T16:25:09.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:09 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:09.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:09 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:09.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:09 smithi148 ceph-mon[28767]: pgmap v325: 65 pgs: 65 active+clean; 41 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 59 op/s 2024-02-28T16:25:09.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:09 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:09.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:09 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:11.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:11 smithi157 ceph-mon[38346]: pgmap v326: 65 pgs: 65 active+clean; 42 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 67 op/s 2024-02-28T16:25:11.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:11.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:11.179 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:11 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:11.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:11 smithi148 ceph-mon[28767]: pgmap v326: 65 pgs: 65 active+clean; 42 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 67 op/s 2024-02-28T16:25:11.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:11.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:11.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:11 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:13.373 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:13 smithi157 ceph-mon[38346]: pgmap v327: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 81 op/s 2024-02-28T16:25:13.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:13 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj restarted 2024-02-28T16:25:13.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:13 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:25:13.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:13 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:25:13.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:13 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:13.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:13 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:25:13.374 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:13 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:13.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:13 smithi148 ceph-mon[28767]: pgmap v327: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 81 op/s 2024-02-28T16:25:13.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:13 smithi148 ceph-mon[28767]: Standby manager daemon smithi157.cmcxzj restarted 2024-02-28T16:25:13.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:13 smithi148 ceph-mon[28767]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:25:13.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:13 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:25:13.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:13 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:13.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:13 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:25:13.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:13 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:14.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:14 smithi157 ceph-mon[38346]: mgrmap e20: smithi148.gelspy(active, since 9m), standbys: smithi157.cmcxzj 2024-02-28T16:25:14.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:14 smithi148 ceph-mon[28767]: mgrmap e20: smithi148.gelspy(active, since 9m), standbys: smithi157.cmcxzj 2024-02-28T16:25:15.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:15 smithi157 ceph-mon[38346]: pgmap v328: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 81 op/s 2024-02-28T16:25:15.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:15 smithi148 ceph-mon[28767]: pgmap v328: 65 pgs: 65 active+clean; 52 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 81 op/s 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr fail", "who": "smithi148.gelspy"}]: dispatch 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "mgr fail", "who": "smithi148.gelspy"}]': finished 2024-02-28T16:25:17.077 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: mgrmap e21: smithi157.cmcxzj(active, starting, since 0.0201651s) 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:25:17.078 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: Manager daemon smithi157.cmcxzj is now available 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/trash_purge_schedule"}]: dispatch 2024-02-28T16:25:17.079 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:17 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/trash_purge_schedule"}]: dispatch 2024-02-28T16:25:17.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:17.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:17.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr fail", "who": "smithi148.gelspy"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.14216 172.21.15.148:0/859393828' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "mgr fail", "who": "smithi148.gelspy"}]': finished 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: mgrmap e21: smithi157.cmcxzj(active, starting, since 0.0201651s) 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:25:17.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:25:17.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: Manager daemon smithi157.cmcxzj is now available 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/trash_purge_schedule"}]: dispatch 2024-02-28T16:25:17.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:17 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi157.cmcxzj/trash_purge_schedule"}]: dispatch 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: Deploying cephadm binary to smithi157 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: Deploying cephadm binary to smithi148 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: [28/Feb/2024:16:25:17] ENGINE Bus STARTING 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: mgrmap e22: smithi157.cmcxzj(active, since 1.01616s) 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: pgmap v3: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: [28/Feb/2024:16:25:17] ENGINE Serving on https://172.21.15.157:7150 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: [28/Feb/2024:16:25:17] ENGINE Serving on http://172.21.15.157:8765 2024-02-28T16:25:18.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:18 smithi157 ceph-mon[38346]: [28/Feb/2024:16:25:17] ENGINE Bus STARTED 2024-02-28T16:25:18.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:18.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:18.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: Deploying cephadm binary to smithi157 2024-02-28T16:25:18.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: Deploying cephadm binary to smithi148 2024-02-28T16:25:18.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: [28/Feb/2024:16:25:17] ENGINE Bus STARTING 2024-02-28T16:25:18.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: mgrmap e22: smithi157.cmcxzj(active, since 1.01616s) 2024-02-28T16:25:18.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: pgmap v3: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:25:18.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: [28/Feb/2024:16:25:17] ENGINE Serving on https://172.21.15.157:7150 2024-02-28T16:25:18.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: [28/Feb/2024:16:25:17] ENGINE Serving on http://172.21.15.157:8765 2024-02-28T16:25:18.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:18 smithi148 ceph-mon[28767]: [28/Feb/2024:16:25:17] ENGINE Bus STARTED 2024-02-28T16:25:19.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:19 smithi148 ceph-mon[28767]: pgmap v4: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:25:19.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:19 smithi157 ceph-mon[38346]: pgmap v4: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:25:20.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:20 smithi148 ceph-mon[28767]: mgrmap e23: smithi157.cmcxzj(active, since 3s) 2024-02-28T16:25:20.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:20 smithi157 ceph-mon[38346]: mgrmap e23: smithi157.cmcxzj(active, since 3s) 2024-02-28T16:25:22.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:21 smithi148 ceph-mon[28767]: pgmap v5: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:25:22.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:21 smithi148 ceph-mon[28767]: mgrmap e24: smithi157.cmcxzj(active, since 4s) 2024-02-28T16:25:22.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:21 smithi157 ceph-mon[38346]: pgmap v5: 65 pgs: 65 active+clean; 65 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:25:22.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:21 smithi157 ceph-mon[38346]: mgrmap e24: smithi157.cmcxzj(active, since 4s) 2024-02-28T16:25:23.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 -- 172.21.15.148:0/250083696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fe0e0 msgr2=0x7f609c0fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:23.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 --2- 172.21.15.148:0/250083696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fe0e0 0x7f609c0fe550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6088004940 tx=0x7f6088009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:23.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 -- 172.21.15.148:0/250083696 shutdown_connections 2024-02-28T16:25:23.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 --2- 172.21.15.148:0/250083696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fe0e0 0x7f609c0fe550 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:23.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 --2- 172.21.15.148:0/250083696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fcef0 0x7f609c0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:23.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 -- 172.21.15.148:0/250083696 >> 172.21.15.148:0/250083696 conn(0x7f609c0f8620 msgr2=0x7f609c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:23.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 -- 172.21.15.148:0/250083696 shutdown_connections 2024-02-28T16:25:23.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.910+0000 7f60a2c00700 1 -- 172.21.15.148:0/250083696 wait complete. 2024-02-28T16:25:23.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.911+0000 7f60a2c00700 1 Processor -- start 2024-02-28T16:25:23.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.911+0000 7f60a2c00700 1 -- start start 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.912+0000 7f60a2c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fcef0 0x7f609c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.912+0000 7f60a2c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fe0e0 0x7f609c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.912+0000 7f60a2c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c110750 con 0x7f609c0fcef0 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.912+0000 7f60a2c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c110f90 con 0x7f609c0fe0e0 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.912+0000 7f609be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fcef0 0x7f609c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.913+0000 7f609b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fe0e0 0x7f609c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.913+0000 7f609b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fe0e0 0x7f609c1100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:33166/0 (socket says 172.21.15.148:33166) 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.913+0000 7f609b400700 1 -- 172.21.15.148:0/96292355 learned_addr learned my addr 172.21.15.148:0/96292355 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:23.903 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.913+0000 7f609b400700 1 -- 172.21.15.148:0/96292355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fcef0 msgr2=0x7f609c10fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:23.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.913+0000 7f609b400700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fcef0 0x7f609c10fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:23.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.913+0000 7f609b400700 1 -- 172.21.15.148:0/96292355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088005040 con 0x7f609c0fe0e0 2024-02-28T16:25:23.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.913+0000 7f609be00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fcef0 0x7f609c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:25:23.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.914+0000 7f609b400700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fe0e0 0x7f609c1100c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f608800b3b0 tx=0x7f6088009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:23.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.914+0000 7f6093e00700 1 -- 172.21.15.148:0/96292355 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608800e040 con 0x7f609c0fe0e0 2024-02-28T16:25:23.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.914+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c111210 con 0x7f609c0fe0e0 2024-02-28T16:25:23.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.914+0000 7f6093e00700 1 -- 172.21.15.148:0/96292355 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f608800bd90 con 0x7f609c0fe0e0 2024-02-28T16:25:23.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.914+0000 7f6093e00700 1 -- 172.21.15.148:0/96292355 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f608801c630 con 0x7f609c0fe0e0 2024-02-28T16:25:23.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.915+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c111750 con 0x7f609c0fe0e0 2024-02-28T16:25:23.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.916+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c102210 con 0x7f609c0fe0e0 2024-02-28T16:25:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.917+0000 7f6093e00700 1 -- 172.21.15.148:0/96292355 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f60880139f0 con 0x7f609c0fe0e0 2024-02-28T16:25:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.918+0000 7f6093e00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f6080038a70 0x7f608003af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:23.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.918+0000 7f6093e00700 1 -- 172.21.15.148:0/96292355 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6088025400 con 0x7f609c0fe0e0 2024-02-28T16:25:23.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.918+0000 7f609be00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f6080038a70 0x7f608003af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:23.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.920+0000 7f609be00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f6080038a70 0x7f608003af20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f608c006fd0 tx=0x7f608c008040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:23.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:23.925+0000 7f6093e00700 1 -- 172.21.15.148:0/96292355 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6088052060 con 0x7f609c0fe0e0 2024-02-28T16:25:24.130 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:23 smithi148 ceph-mon[28767]: pgmap v6: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 3.9 MiB/s wr, 197 op/s 2024-02-28T16:25:24.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:23 smithi157 ceph-mon[38346]: pgmap v6: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 3.9 MiB/s wr, 197 op/s 2024-02-28T16:25:24.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.317+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f609c111b40 con 0x7f6080038a70 2024-02-28T16:25:24.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.320+0000 7f6093e00700 1 -- 172.21.15.148:0/96292355 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f609c111b40 con 0x7f6080038a70 2024-02-28T16:25:24.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.323+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f6080038a70 msgr2=0x7f608003af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:24.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.323+0000 7f60a2c00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f6080038a70 0x7f608003af20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f608c006fd0 tx=0x7f608c008040 comp rx=0 tx=0).stop 2024-02-28T16:25:24.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.323+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fe0e0 msgr2=0x7f609c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:24.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.323+0000 7f60a2c00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fe0e0 0x7f609c1100c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f608800b3b0 tx=0x7f6088009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:24.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.324+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 shutdown_connections 2024-02-28T16:25:24.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.324+0000 7f60a2c00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f6080038a70 0x7f608003af20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.324+0000 7f60a2c00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f609c0fcef0 0x7f609c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.324+0000 7f60a2c00700 1 --2- 172.21.15.148:0/96292355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f609c0fe0e0 0x7f609c1100c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.324+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 >> 172.21.15.148:0/96292355 conn(0x7f609c0f8620 msgr2=0x7f609c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:24.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.324+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 shutdown_connections 2024-02-28T16:25:24.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.325+0000 7f60a2c00700 1 -- 172.21.15.148:0/96292355 wait complete. 2024-02-28T16:25:24.337 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:25:24.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.525+0000 7f851a200700 1 -- 172.21.15.148:0/2023803321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85141074e0 msgr2=0x7f85141098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:24.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.525+0000 7f851a200700 1 --2- 172.21.15.148:0/2023803321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85141074e0 0x7f85141098c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8500004990 tx=0x7f850000af40 comp rx=0 tx=0).stop 2024-02-28T16:25:24.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.526+0000 7f851a200700 1 -- 172.21.15.148:0/2023803321 shutdown_connections 2024-02-28T16:25:24.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.526+0000 7f851a200700 1 --2- 172.21.15.148:0/2023803321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f85141074e0 0x7f85141098c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.526+0000 7f851a200700 1 --2- 172.21.15.148:0/2023803321 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f851406ec40 0x7f8514106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.526+0000 7f851a200700 1 -- 172.21.15.148:0/2023803321 >> 172.21.15.148:0/2023803321 conn(0x7f8514069e70 msgr2=0x7f851406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:24.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.526+0000 7f851a200700 1 -- 172.21.15.148:0/2023803321 shutdown_connections 2024-02-28T16:25:24.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.526+0000 7f851a200700 1 -- 172.21.15.148:0/2023803321 wait complete. 2024-02-28T16:25:24.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.528+0000 7f851a200700 1 Processor -- start 2024-02-28T16:25:24.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.528+0000 7f851a200700 1 -- start start 2024-02-28T16:25:24.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.528+0000 7f851a200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f851406ec40 0x7f8514118520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:24.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.528+0000 7f851a200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85141074e0 0x7f8514118a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:24.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.528+0000 7f851a200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514119060 con 0x7f851406ec40 2024-02-28T16:25:24.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.528+0000 7f851a200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514119900 con 0x7f85141074e0 2024-02-28T16:25:24.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.529+0000 7f8512a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85141074e0 0x7f8514118a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:24.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.529+0000 7f8512a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85141074e0 0x7f8514118a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:33178/0 (socket says 172.21.15.148:33178) 2024-02-28T16:25:24.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.529+0000 7f8512a00700 1 -- 172.21.15.148:0/1911155921 learned_addr learned my addr 172.21.15.148:0/1911155921 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:24.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.530+0000 7f8512a00700 1 -- 172.21.15.148:0/1911155921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f851406ec40 msgr2=0x7f8514118520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:24.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.530+0000 7f8512a00700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f851406ec40 0x7f8514118520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.530+0000 7f8512a00700 1 -- 172.21.15.148:0/1911155921 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500005040 con 0x7f85141074e0 2024-02-28T16:25:24.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.531+0000 7f8512a00700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85141074e0 0x7f8514118a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85000048e0 tx=0x7f850000af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:24.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.531+0000 7f850b400700 1 -- 172.21.15.148:0/1911155921 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f850000f040 con 0x7f85141074e0 2024-02-28T16:25:24.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.531+0000 7f851a200700 1 -- 172.21.15.148:0/1911155921 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514119b80 con 0x7f85141074e0 2024-02-28T16:25:24.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.531+0000 7f850b400700 1 -- 172.21.15.148:0/1911155921 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8500008050 con 0x7f85141074e0 2024-02-28T16:25:24.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.531+0000 7f850b400700 1 -- 172.21.15.148:0/1911155921 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f850001c600 con 0x7f85141074e0 2024-02-28T16:25:24.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.532+0000 7f851a200700 1 -- 172.21.15.148:0/1911155921 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851411a060 con 0x7f85141074e0 2024-02-28T16:25:24.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.535+0000 7f850b400700 1 -- 172.21.15.148:0/1911155921 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f850001c870 con 0x7f85141074e0 2024-02-28T16:25:24.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.535+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec0052b0 con 0x7f85141074e0 2024-02-28T16:25:24.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.536+0000 7f850b400700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f84f8038b10 0x7f84f803afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:24.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.536+0000 7f850b400700 1 -- 172.21.15.148:0/1911155921 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f850004ed90 con 0x7f85141074e0 2024-02-28T16:25:24.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.537+0000 7f8513400700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f84f8038b10 0x7f84f803afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:24.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.538+0000 7f8513400700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f84f8038b10 0x7f84f803afc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8504009fd0 tx=0x7f850400b040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:24.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.553+0000 7f850b400700 1 -- 172.21.15.148:0/1911155921 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8500004d90 con 0x7f85141074e0 2024-02-28T16:25:24.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.925+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84ec000bc0 con 0x7f84f8038b10 2024-02-28T16:25:24.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.930+0000 7f850b400700 1 -- 172.21.15.148:0/1911155921 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f84ec000bc0 con 0x7f84f8038b10 2024-02-28T16:25:24.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f84f8038b10 msgr2=0x7f84f803afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:24.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f84f8038b10 0x7f84f803afc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8504009fd0 tx=0x7f850400b040 comp rx=0 tx=0).stop 2024-02-28T16:25:24.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85141074e0 msgr2=0x7f8514118a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:24.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85141074e0 0x7f8514118a60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85000048e0 tx=0x7f850000af40 comp rx=0 tx=0).stop 2024-02-28T16:25:24.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 shutdown_connections 2024-02-28T16:25:24.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f84f8038b10 0x7f84f803afc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f851406ec40 0x7f8514118520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 --2- 172.21.15.148:0/1911155921 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f85141074e0 0x7f8514118a60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:24.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 >> 172.21.15.148:0/1911155921 conn(0x7f8514069e70 msgr2=0x7f851406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:24.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 shutdown_connections 2024-02-28T16:25:24.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:24.935+0000 7f8508c00700 1 -- 172.21.15.148:0/1911155921 wait complete. 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.140+0000 7f9140e00700 1 -- 172.21.15.148:0/1089791750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fcef0 msgr2=0x7f913c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.140+0000 7f9140e00700 1 --2- 172.21.15.148:0/1089791750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fcef0 0x7f913c0fd320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f912c004940 tx=0x7f912c009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.140+0000 7f9140e00700 1 -- 172.21.15.148:0/1089791750 shutdown_connections 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.140+0000 7f9140e00700 1 --2- 172.21.15.148:0/1089791750 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f913c0fe0e0 0x7f913c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.140+0000 7f9140e00700 1 --2- 172.21.15.148:0/1089791750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fcef0 0x7f913c0fd320 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f912c004940 tx=0x7f912c009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.140+0000 7f9140e00700 1 -- 172.21.15.148:0/1089791750 >> 172.21.15.148:0/1089791750 conn(0x7f913c0f8620 msgr2=0x7f913c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.141+0000 7f9140e00700 1 -- 172.21.15.148:0/1089791750 shutdown_connections 2024-02-28T16:25:25.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.141+0000 7f9140e00700 1 -- 172.21.15.148:0/1089791750 wait complete. 2024-02-28T16:25:25.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.142+0000 7f9140e00700 1 Processor -- start 2024-02-28T16:25:25.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.142+0000 7f9140e00700 1 -- start start 2024-02-28T16:25:25.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.143+0000 7f9140e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fe0e0 0x7f913c10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.143+0000 7f9140e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f913c110290 0x7f913c111050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.143+0000 7f9140e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c110750 con 0x7f913c0fe0e0 2024-02-28T16:25:25.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.143+0000 7f9140e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1108c0 con 0x7f913c110290 2024-02-28T16:25:25.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.144+0000 7f9139e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fe0e0 0x7f913c10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.144+0000 7f9139e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fe0e0 0x7f913c10fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39156/0 (socket says 172.21.15.148:39156) 2024-02-28T16:25:25.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.144+0000 7f9139e00700 1 -- 172.21.15.148:0/1778515645 learned_addr learned my addr 172.21.15.148:0/1778515645 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:25.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.145+0000 7f9139e00700 1 -- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f913c110290 msgr2=0x7f913c111050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.145+0000 7f9139400700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f913c110290 0x7f913c111050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.146+0000 7f9139e00700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f913c110290 0x7f913c111050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.146+0000 7f9139e00700 1 -- 172.21.15.148:0/1778515645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c005040 con 0x7f913c0fe0e0 2024-02-28T16:25:25.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.146+0000 7f9139400700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f913c110290 0x7f913c111050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:25:25.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.146+0000 7f9139e00700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fe0e0 0x7f913c10fd50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f912c000c00 tx=0x7f912c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.147+0000 7f9132000700 1 -- 172.21.15.148:0/1778515645 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c00e030 con 0x7f913c0fe0e0 2024-02-28T16:25:25.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.147+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c1116d0 con 0x7f913c0fe0e0 2024-02-28T16:25:25.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.147+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c111c10 con 0x7f913c0fe0e0 2024-02-28T16:25:25.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.147+0000 7f9132000700 1 -- 172.21.15.148:0/1778515645 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f912c0093e0 con 0x7f913c0fe0e0 2024-02-28T16:25:25.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.147+0000 7f9132000700 1 -- 172.21.15.148:0/1778515645 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c01cdf0 con 0x7f913c0fe0e0 2024-02-28T16:25:25.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.149+0000 7f9132000700 1 -- 172.21.15.148:0/1778515645 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7f912c01c620 con 0x7f913c0fe0e0 2024-02-28T16:25:25.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.150+0000 7f9132000700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9120038a70 0x7f912003af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.150+0000 7f9132000700 1 -- 172.21.15.148:0/1778515645 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f912c04e060 con 0x7f913c0fe0e0 2024-02-28T16:25:25.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.150+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c0052e0 con 0x7f913c0fe0e0 2024-02-28T16:25:25.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.150+0000 7f9139400700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9120038a70 0x7f912003af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.151+0000 7f9139400700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9120038a70 0x7f912003af20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9128004600 tx=0x7f912800b040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.161+0000 7f9132000700 1 -- 172.21.15.148:0/1778515645 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f912c020020 con 0x7f913c0fe0e0 2024-02-28T16:25:25.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.474+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f911c000bf0 con 0x7f9120038a70 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (8m) 2m ago 10m 13.4M - 0.25.0 c8568f914cd2 1a028b2bba8f 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (11m) 2m ago 11m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (9m) 17s ago 9m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (8m) 2m ago 10m 74.6M - 9.4.7 954c08fa6188 9cb307a9b404 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (2m) 2m ago 2m 10.4M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (2m) 2m ago 2m 12.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (2m) 17s ago 2m 11.2M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (2m) 17s ago 2m 11.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:9283 running (12m) 2m ago 12m 481M - 17.2.7-535-gc0f02e60 1c37ed371348 0efadaac859c 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (24s) 17s ago 8m 57.7M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1ed96a6b633e 2024-02-28T16:25:25.500 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (12m) 2m ago 12m 42.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (8m) 17s ago 8m 33.6M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (11m) 2m ago 11m 7968k - 1.5.0 0da6a335fe13 1cc6d69049e3 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (9m) 17s ago 9m 7910k - 1.5.0 0da6a335fe13 e10955ca2cb2 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (7m) 2m ago 7m 44.0M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (7m) 2m ago 7m 45.3M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (6m) 2m ago 6m 43.6M 4289M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (6m) 17s ago 6m 57.3M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (5m) 17s ago 5m 56.9M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (4m) 17s ago 4m 55.4M 5313M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (8m) 2m ago 10m 46.9M - 2.43.0 a07b618ecd1d 92209c2989e2 2024-02-28T16:25:25.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.509+0000 7f9132000700 1 -- 172.21.15.148:0/1778515645 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f911c000bf0 con 0x7f9120038a70 2024-02-28T16:25:25.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.513+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9120038a70 msgr2=0x7f912003af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.513+0000 7f9140e00700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9120038a70 0x7f912003af20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9128004600 tx=0x7f912800b040 comp rx=0 tx=0).stop 2024-02-28T16:25:25.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.513+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fe0e0 msgr2=0x7f913c10fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.513+0000 7f9140e00700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fe0e0 0x7f913c10fd50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f912c000c00 tx=0x7f912c009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.515+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 shutdown_connections 2024-02-28T16:25:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.515+0000 7f9140e00700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9120038a70 0x7f912003af20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.515+0000 7f9140e00700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f913c0fe0e0 0x7f913c10fd50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.515+0000 7f9140e00700 1 --2- 172.21.15.148:0/1778515645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f913c110290 0x7f913c111050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.515+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 >> 172.21.15.148:0/1778515645 conn(0x7f913c0f8620 msgr2=0x7f913c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.515+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 shutdown_connections 2024-02-28T16:25:25.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.515+0000 7f9140e00700 1 -- 172.21.15.148:0/1778515645 wait complete. 2024-02-28T16:25:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2731610366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fcef0 msgr2=0x7fb8a40fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2731610366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fcef0 0x7fb8a40fd320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb894004940 tx=0x7fb894009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2731610366 shutdown_connections 2024-02-28T16:25:25.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2731610366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8a40fe0e0 0x7fb8a40fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2731610366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fcef0 0x7fb8a40fd320 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2731610366 >> 172.21.15.148:0/2731610366 conn(0x7fb8a40f8620 msgr2=0x7fb8a40faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2731610366 shutdown_connections 2024-02-28T16:25:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.698+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2731610366 wait complete. 2024-02-28T16:25:25.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.699+0000 7fb8a8e00700 1 Processor -- start 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a8e00700 1 -- start start 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a8e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8a40fcef0 0x7fb8a410b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a8e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fe0e0 0x7fb8a410bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a8e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a410c240 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a8e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a410cae0 con 0x7fb8a40fcef0 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fe0e0 0x7fb8a410bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fe0e0 0x7fb8a410bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39172/0 (socket says 172.21.15.148:39172) 2024-02-28T16:25:25.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a1400700 1 -- 172.21.15.148:0/2982330579 learned_addr learned my addr 172.21.15.148:0/2982330579 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.700+0000 7fb8a1e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8a40fcef0 0x7fb8a410b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.701+0000 7fb8a1400700 1 -- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8a40fcef0 msgr2=0x7fb8a410b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.701+0000 7fb8a1400700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8a40fcef0 0x7fb8a410b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.701+0000 7fb8a1400700 1 -- 172.21.15.148:0/2982330579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb894005040 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.702+0000 7fb8a1400700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fe0e0 0x7fb8a410bbf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb89000eb40 tx=0x7fb89000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.702+0000 7fb89a000700 1 -- 172.21.15.148:0/2982330579 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb890007cc0 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.703+0000 7fb89a000700 1 -- 172.21.15.148:0/2982330579 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb89000f040 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.703+0000 7fb89a000700 1 -- 172.21.15.148:0/2982330579 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89000ca10 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.704+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a410cd60 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.704+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a410d270 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.705+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a404bed0 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.706+0000 7fb89a000700 1 -- 172.21.15.148:0/2982330579 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7fb89000cb70 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.706+0000 7fb89a000700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fb888038b00 0x7fb88803afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:25.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.706+0000 7fb89a000700 1 -- 172.21.15.148:0/2982330579 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb89004bca0 con 0x7fb8a40fe0e0 2024-02-28T16:25:25.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.707+0000 7fb8a1e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fb888038b00 0x7fb88803afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:25.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.709+0000 7fb8a1e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fb888038b00 0x7fb88803afb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb894009fd0 tx=0x7fb894009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:25.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:25.716+0000 7fb89a000700 1 -- 172.21.15.148:0/2982330579 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb89001b6e0 con 0x7fb8a40fe0e0 2024-02-28T16:25:26.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.105+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8a4105a30 con 0x7fb8a40fe0e0 2024-02-28T16:25:26.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.106+0000 7fb89a000700 1 -- 172.21.15.148:0/2982330579 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fb89001b2f0 con 0x7fb8a40fe0e0 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:25:26.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:25:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:25:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:25:26.097 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:25:26.097 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:25:26.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.109+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fb888038b00 msgr2=0x7fb88803afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.109+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fb888038b00 0x7fb88803afb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb894009fd0 tx=0x7fb894009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:26.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.109+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fe0e0 msgr2=0x7fb8a410bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.109+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fe0e0 0x7fb8a410bbf0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb89000eb40 tx=0x7fb89000b040 comp rx=0 tx=0).stop 2024-02-28T16:25:26.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.110+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 shutdown_connections 2024-02-28T16:25:26.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.110+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fb888038b00 0x7fb88803afb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.110+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb8a40fcef0 0x7fb8a410b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.110+0000 7fb8a8e00700 1 --2- 172.21.15.148:0/2982330579 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8a40fe0e0 0x7fb8a410bbf0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.110+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 >> 172.21.15.148:0/2982330579 conn(0x7fb8a40f8620 msgr2=0x7fb8a40ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:26.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.110+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 shutdown_connections 2024-02-28T16:25:26.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.110+0000 7fb8a8e00700 1 -- 172.21.15.148:0/2982330579 wait complete. 2024-02-28T16:25:26.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:25 smithi148 ceph-mon[28767]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:26.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:25 smithi148 ceph-mon[28767]: pgmap v7: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.8 MiB/s wr, 140 op/s 2024-02-28T16:25:26.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:25 smithi148 ceph-mon[28767]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:26.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:25 smithi157 ceph-mon[38346]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:26.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:25 smithi157 ceph-mon[38346]: pgmap v7: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 2.8 MiB/s wr, 140 op/s 2024-02-28T16:25:26.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:25 smithi157 ceph-mon[38346]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 -- 172.21.15.148:0/243299875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 msgr2=0x7fe1f0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 --2- 172.21.15.148:0/243299875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f0070d10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0004940 tx=0x7fe1e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 -- 172.21.15.148:0/243299875 shutdown_connections 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 --2- 172.21.15.148:0/243299875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f0070d10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 --2- 172.21.15.148:0/243299875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1f0071f10 0x7fe1f0070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 -- 172.21.15.148:0/243299875 >> 172.21.15.148:0/243299875 conn(0x7fe1f00f8620 msgr2=0x7fe1f00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 -- 172.21.15.148:0/243299875 shutdown_connections 2024-02-28T16:25:26.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.292+0000 7fe1f8800700 1 -- 172.21.15.148:0/243299875 wait complete. 2024-02-28T16:25:26.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.293+0000 7fe1f8800700 1 Processor -- start 2024-02-28T16:25:26.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.293+0000 7fe1f8800700 1 -- start start 2024-02-28T16:25:26.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f8800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f8800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1f0071f10 0x7fe1f01100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f8800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f01106b0 con 0x7fe1f00708c0 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f8800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0110f50 con 0x7fe1f0071f10 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f010fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39192/0 (socket says 172.21.15.148:39192) 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f5e00700 1 -- 172.21.15.148:0/3996277661 learned_addr learned my addr 172.21.15.148:0/3996277661 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f5e00700 1 -- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1f0071f10 msgr2=0x7fe1f01100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f5e00700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1f0071f10 0x7fe1f01100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.294+0000 7fe1f5e00700 1 -- 172.21.15.148:0/3996277661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0005040 con 0x7fe1f00708c0 2024-02-28T16:25:26.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.295+0000 7fe1f5e00700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f010fb70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400c8c0 tx=0x7fe1e40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:26.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.295+0000 7fe1ea000700 1 -- 172.21.15.148:0/3996277661 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e400a980 con 0x7fe1f00708c0 2024-02-28T16:25:26.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.295+0000 7fe1ea000700 1 -- 172.21.15.148:0/3996277661 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1e400ce60 con 0x7fe1f00708c0 2024-02-28T16:25:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.295+0000 7fe1ea000700 1 -- 172.21.15.148:0/3996277661 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1e40115e0 con 0x7fe1f00708c0 2024-02-28T16:25:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.296+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f0111230 con 0x7fe1f00708c0 2024-02-28T16:25:26.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.296+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f0111770 con 0x7fe1f00708c0 2024-02-28T16:25:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.297+0000 7fe1ea000700 1 -- 172.21.15.148:0/3996277661 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) v1 ==== 45930+0+0 (secure 0 0 0) 0x7fe1e4012400 con 0x7fe1f00708c0 2024-02-28T16:25:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.297+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f004bed0 con 0x7fe1f00708c0 2024-02-28T16:25:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.298+0000 7fe1ea000700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe1d8038ab0 0x7fe1d803af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:26.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.298+0000 7fe1ea000700 1 -- 172.21.15.148:0/3996277661 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe1e404c5a0 con 0x7fe1f00708c0 2024-02-28T16:25:26.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.299+0000 7fe1f5400700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe1d8038ab0 0x7fe1d803af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:26.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.301+0000 7fe1f5400700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe1d8038ab0 0x7fe1d803af60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0004f90 tx=0x7fe1e0009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:26.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.306+0000 7fe1ea000700 1 -- 172.21.15.148:0/3996277661 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe1e4011740 con 0x7fe1f00708c0 2024-02-28T16:25:26.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.616+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1f01044f0 con 0x7fe1d8038ab0 2024-02-28T16:25:26.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.620+0000 7fe1ea000700 1 -- 172.21.15.148:0/3996277661 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe1f01044f0 con 0x7fe1d8038ab0 2024-02-28T16:25:26.609 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:25:26.609 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:25:26.610 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:25:26.610 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:25:26.610 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [], 2024-02-28T16:25:26.610 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "1/2 daemons upgraded", 2024-02-28T16:25:26.610 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "", 2024-02-28T16:25:26.610 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:25:26.610 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:25:26.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe1d8038ab0 msgr2=0x7fe1d803af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe1d8038ab0 0x7fe1d803af60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0004f90 tx=0x7fe1e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 msgr2=0x7fe1f010fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f010fb70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1e400c8c0 tx=0x7fe1e40044c0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 shutdown_connections 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe1d8038ab0 0x7fe1d803af60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1f00708c0 0x7fe1f010fb70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 --2- 172.21.15.148:0/3996277661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1f0071f10 0x7fe1f01100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 >> 172.21.15.148:0/3996277661 conn(0x7fe1f00f8620 msgr2=0x7fe1f0102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 shutdown_connections 2024-02-28T16:25:26.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:26.623+0000 7fe1f8800700 1 -- 172.21.15.148:0/3996277661 wait complete. 2024-02-28T16:25:26.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:26 smithi148 ceph-mon[28767]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:26.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:26 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2982330579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:25:27.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:26 smithi157 ceph-mon[38346]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:27.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:26 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2982330579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:25:28.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:27 smithi157 ceph-mon[38346]: pgmap v8: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 109 op/s 2024-02-28T16:25:28.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:27 smithi157 ceph-mon[38346]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:28.261 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:27 smithi148 ceph-mon[28767]: pgmap v8: 65 pgs: 65 active+clean; 84 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 109 op/s 2024-02-28T16:25:28.261 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:27 smithi148 ceph-mon[28767]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:29.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:28 smithi157 ceph-mon[38346]: Standby manager daemon smithi148.gelspy started 2024-02-28T16:25:29.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:28 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/crt"}]: dispatch 2024-02-28T16:25:29.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:28 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:29.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:28 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/key"}]: dispatch 2024-02-28T16:25:29.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:28 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:29.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:28 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:29.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:28 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:29.270 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:28 smithi148 ceph-mon[28767]: Standby manager daemon smithi148.gelspy started 2024-02-28T16:25:29.270 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:28 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/crt"}]: dispatch 2024-02-28T16:25:29.270 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:28 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:25:29.270 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:28 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/key"}]: dispatch 2024-02-28T16:25:29.271 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:28 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/1237461662' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:25:29.271 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:28 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:29.271 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:28 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:30.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:29 smithi157 ceph-mon[38346]: pgmap v9: 65 pgs: 65 active+clean; 98 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 140 op/s 2024-02-28T16:25:30.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:29 smithi157 ceph-mon[38346]: mgrmap e25: smithi157.cmcxzj(active, since 12s), standbys: smithi148.gelspy 2024-02-28T16:25:30.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:29 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:25:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:29 smithi148 ceph-mon[28767]: pgmap v9: 65 pgs: 65 active+clean; 98 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 140 op/s 2024-02-28T16:25:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:29 smithi148 ceph-mon[28767]: mgrmap e25: smithi157.cmcxzj(active, since 12s), standbys: smithi148.gelspy 2024-02-28T16:25:30.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:29 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:25:31.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:31 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:31.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:31 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:31.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:31 smithi148 ceph-mon[28767]: pgmap v10: 65 pgs: 65 active+clean; 98 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 129 op/s 2024-02-28T16:25:31.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:31 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:31.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:31 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:31.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:31 smithi157 ceph-mon[38346]: pgmap v10: 65 pgs: 65 active+clean; 98 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 129 op/s 2024-02-28T16:25:32.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:32 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:32.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:32 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:32.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:32 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:32.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:32 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:32.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:32 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:32.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:32 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:33.665 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:33 smithi157 ceph-mon[38346]: pgmap v11: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 162 op/s 2024-02-28T16:25:33.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:33 smithi148 ceph-mon[28767]: pgmap v11: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 162 op/s 2024-02-28T16:25:35.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:35.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:35.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi148 to 1558M 2024-02-28T16:25:35.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:35.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:35 smithi148 ceph-mon[28767]: pgmap v12: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 79 op/s 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi148 to 1558M 2024-02-28T16:25:35.418 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:35.419 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:35 smithi157 ceph-mon[38346]: pgmap v12: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 79 op/s 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: pgmap v13: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 79 op/s 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:37.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: Adjusting osd_memory_target on smithi157 to 2582M 2024-02-28T16:25:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:25:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:25:37.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:37 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:25:38.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: pgmap v13: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 79 op/s 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: Adjusting osd_memory_target on smithi157 to 2582M 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:25:38.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:25:38.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:37 smithi148 ceph-mon[28767]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:25:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:38 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:25:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:38 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:25:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:38 smithi148 ceph-mon[28767]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:25:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:38 smithi148 ceph-mon[28767]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:25:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:39 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:25:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:39 smithi157 ceph-mon[38346]: pgmap v14: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 110 op/s 2024-02-28T16:25:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:39 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:25:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:39 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:25:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:39 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:39.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:39 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:40.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:39 smithi148 ceph-mon[28767]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:25:40.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:39 smithi148 ceph-mon[28767]: pgmap v14: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 110 op/s 2024-02-28T16:25:40.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:39 smithi148 ceph-mon[28767]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:25:40.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:39 smithi148 ceph-mon[28767]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:25:40.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:39 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:40.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:39 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:25:41.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:40 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:40 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:41 smithi148 ceph-mon[28767]: Reconfiguring node-exporter.smithi148 (dependencies changed)... 2024-02-28T16:25:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:41 smithi148 ceph-mon[28767]: Reconfiguring daemon node-exporter.smithi148 on smithi148 2024-02-28T16:25:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:41 smithi148 ceph-mon[28767]: pgmap v15: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 63 op/s 2024-02-28T16:25:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:41 smithi157 ceph-mon[38346]: Reconfiguring node-exporter.smithi148 (dependencies changed)... 2024-02-28T16:25:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:41 smithi157 ceph-mon[38346]: Reconfiguring daemon node-exporter.smithi148 on smithi148 2024-02-28T16:25:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:41 smithi157 ceph-mon[38346]: pgmap v15: 65 pgs: 65 active+clean; 112 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.2 MiB/s wr, 63 op/s 2024-02-28T16:25:44.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:43 smithi148 ceph-mon[28767]: pgmap v16: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 104 op/s 2024-02-28T16:25:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:43 smithi157 ceph-mon[38346]: pgmap v16: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 104 op/s 2024-02-28T16:25:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:45 smithi148 ceph-mon[28767]: pgmap v17: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 71 op/s 2024-02-28T16:25:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:45 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:45 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:45 smithi157 ceph-mon[38346]: pgmap v17: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 71 op/s 2024-02-28T16:25:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:45 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:46.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:45 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:47.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:46 smithi148 ceph-mon[28767]: Reconfiguring alertmanager.smithi148 (dependencies changed)... 2024-02-28T16:25:47.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:46 smithi148 ceph-mon[28767]: Reconfiguring daemon alertmanager.smithi148 on smithi148 2024-02-28T16:25:47.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:46 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:47.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:46 smithi157 ceph-mon[38346]: Reconfiguring alertmanager.smithi148 (dependencies changed)... 2024-02-28T16:25:47.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:46 smithi157 ceph-mon[38346]: Reconfiguring daemon alertmanager.smithi148 on smithi148 2024-02-28T16:25:47.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:46 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:25:48.137 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:47 smithi148 ceph-mon[28767]: pgmap v18: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 71 op/s 2024-02-28T16:25:48.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:47 smithi157 ceph-mon[38346]: pgmap v18: 65 pgs: 65 active+clean; 121 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 71 op/s 2024-02-28T16:25:50.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:49 smithi157 ceph-mon[38346]: pgmap v19: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 118 op/s 2024-02-28T16:25:50.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:49 smithi148 ceph-mon[28767]: pgmap v19: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 118 op/s 2024-02-28T16:25:52.217 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:51 smithi148 ceph-mon[28767]: pgmap v20: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 88 op/s 2024-02-28T16:25:52.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:51 smithi157 ceph-mon[38346]: pgmap v20: 65 pgs: 65 active+clean; 130 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 88 op/s 2024-02-28T16:25:54.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:53 smithi148 ceph-mon[28767]: pgmap v21: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 143 op/s 2024-02-28T16:25:54.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:53 smithi157 ceph-mon[38346]: pgmap v21: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.6 MiB/s wr, 143 op/s 2024-02-28T16:25:55.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:55 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:55.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:55 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:55.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:55 smithi148 ceph-mon[28767]: Reconfiguring grafana.smithi148 (dependencies changed)... 2024-02-28T16:25:55.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:55 smithi148 ceph-mon[28767]: Reconfiguring daemon grafana.smithi148 on smithi148 2024-02-28T16:25:55.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:55 smithi148 ceph-mon[28767]: pgmap v22: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 102 op/s 2024-02-28T16:25:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:55 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:55 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:25:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:55 smithi157 ceph-mon[38346]: Reconfiguring grafana.smithi148 (dependencies changed)... 2024-02-28T16:25:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:55 smithi157 ceph-mon[38346]: Reconfiguring daemon grafana.smithi148 on smithi148 2024-02-28T16:25:55.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:55 smithi157 ceph-mon[38346]: pgmap v22: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 102 op/s 2024-02-28T16:25:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.830+0000 7f0bc2c00700 1 -- 172.21.15.148:0/1717434085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fcef0 msgr2=0x7f0bbc0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.830+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/1717434085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fcef0 0x7f0bbc0fd320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4004940 tx=0x7f0bb4009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:56.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.831+0000 7f0bc2c00700 1 -- 172.21.15.148:0/1717434085 shutdown_connections 2024-02-28T16:25:56.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.831+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/1717434085 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0fe0e0 0x7f0bbc0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:56.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.831+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/1717434085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fcef0 0x7f0bbc0fd320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:56.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.831+0000 7f0bc2c00700 1 -- 172.21.15.148:0/1717434085 >> 172.21.15.148:0/1717434085 conn(0x7f0bbc0f8620 msgr2=0x7f0bbc0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:56.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.832+0000 7f0bc2c00700 1 -- 172.21.15.148:0/1717434085 shutdown_connections 2024-02-28T16:25:56.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.832+0000 7f0bc2c00700 1 -- 172.21.15.148:0/1717434085 wait complete. 2024-02-28T16:25:56.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.833+0000 7f0bc2c00700 1 Processor -- start 2024-02-28T16:25:56.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.833+0000 7f0bc2c00700 1 -- start start 2024-02-28T16:25:56.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.834+0000 7f0bc2c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0fcef0 0x7f0bbc10fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:56.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.834+0000 7f0bc2c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fe0e0 0x7f0bbc1100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:56.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.834+0000 7f0bc2c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1106d0 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.834+0000 7f0bc2c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc110f70 con 0x7f0bbc0fcef0 2024-02-28T16:25:56.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.834+0000 7f0bbb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fe0e0 0x7f0bbc1100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:56.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.835+0000 7f0bbb400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fe0e0 0x7f0bbc1100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59852/0 (socket says 172.21.15.148:59852) 2024-02-28T16:25:56.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.835+0000 7f0bbbe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0fcef0 0x7f0bbc10fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:56.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.835+0000 7f0bbb400700 1 -- 172.21.15.148:0/3412574564 learned_addr learned my addr 172.21.15.148:0/3412574564 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:56.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.835+0000 7f0bbb400700 1 -- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0fcef0 msgr2=0x7f0bbc10fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:56.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.835+0000 7f0bbb400700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0fcef0 0x7f0bbc10fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:56.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.835+0000 7f0bbb400700 1 -- 172.21.15.148:0/3412574564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4005040 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.825 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.836+0000 7f0bbb400700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fe0e0 0x7f0bbc1100d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4002a50 tx=0x7f0ba40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:56.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.836+0000 7f0bb3e00700 1 -- 172.21.15.148:0/3412574564 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba4007cc0 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.836+0000 7f0bb3e00700 1 -- 172.21.15.148:0/3412574564 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ba400f040 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.836+0000 7f0bb3e00700 1 -- 172.21.15.148:0/3412574564 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba400da30 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.836+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc111250 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.826 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.837+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc111790 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.827 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.838+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc102210 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.840+0000 7f0bb3e00700 1 -- 172.21.15.148:0/3412574564 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f0ba400db90 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.841+0000 7f0bb3e00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f0ba006b2e0 0x7f0ba006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:56.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.841+0000 7f0bb3e00700 1 -- 172.21.15.148:0/3412574564 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0ba4089b60 con 0x7f0bbc0fe0e0 2024-02-28T16:25:56.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.842+0000 7f0bbbe00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f0ba006b2e0 0x7f0ba006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:56.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.843+0000 7f0bbbe00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f0ba006b2e0 0x7f0ba006d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400b840 tx=0x7f0bb4009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:56.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:56.846+0000 7f0bb3e00700 1 -- 172.21.15.148:0/3412574564 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f0ba4057620 con 0x7f0bbc0fe0e0 2024-02-28T16:25:57.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.144+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bbc111a70 con 0x7f0ba006b2e0 2024-02-28T16:25:57.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.149+0000 7f0bb3e00700 1 -- 172.21.15.148:0/3412574564 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f0bbc111a70 con 0x7f0ba006b2e0 2024-02-28T16:25:57.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f0ba006b2e0 msgr2=0x7f0ba006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f0ba006b2e0 0x7f0ba006d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400b840 tx=0x7f0bb4009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fe0e0 msgr2=0x7f0bbc1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fe0e0 0x7f0bbc1100d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4002a50 tx=0x7f0ba40046b0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 shutdown_connections 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f0ba006b2e0 0x7f0ba006d790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bbc0fcef0 0x7f0bbc10fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 --2- 172.21.15.148:0/3412574564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bbc0fe0e0 0x7f0bbc1100d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 >> 172.21.15.148:0/3412574564 conn(0x7f0bbc0f8620 msgr2=0x7f0bbc0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:57.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 shutdown_connections 2024-02-28T16:25:57.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.152+0000 7f0bc2c00700 1 -- 172.21.15.148:0/3412574564 wait complete. 2024-02-28T16:25:57.163 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:25:57.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.349+0000 7f2902800700 1 -- 172.21.15.148:0/2775177178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fe1d0 msgr2=0x7f28fc100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.349+0000 7f2902800700 1 --2- 172.21.15.148:0/2775177178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc100650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28e8004940 tx=0x7f28e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:57.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.349+0000 7f2902800700 1 -- 172.21.15.148:0/2775177178 shutdown_connections 2024-02-28T16:25:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.349+0000 7f2902800700 1 --2- 172.21.15.148:0/2775177178 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc100650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.350+0000 7f2902800700 1 --2- 172.21.15.148:0/2775177178 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fb870 0x7f28fc0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.350+0000 7f2902800700 1 -- 172.21.15.148:0/2775177178 >> 172.21.15.148:0/2775177178 conn(0x7f28fc0f74e0 msgr2=0x7f28fc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.350+0000 7f2902800700 1 -- 172.21.15.148:0/2775177178 shutdown_connections 2024-02-28T16:25:57.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.350+0000 7f2902800700 1 -- 172.21.15.148:0/2775177178 wait complete. 2024-02-28T16:25:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.350+0000 7f2902800700 1 Processor -- start 2024-02-28T16:25:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.351+0000 7f2902800700 1 -- start start 2024-02-28T16:25:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.351+0000 7f2902800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fb870 0x7f28fc113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.351+0000 7f2902800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc114480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.351+0000 7f2902800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc114a80 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.351+0000 7f2902800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc115320 con 0x7f28fc0fb870 2024-02-28T16:25:57.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.352+0000 7f28faa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc114480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.352+0000 7f28faa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc114480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59872/0 (socket says 172.21.15.148:59872) 2024-02-28T16:25:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.352+0000 7f28faa00700 1 -- 172.21.15.148:0/2619462833 learned_addr learned my addr 172.21.15.148:0/2619462833 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.352+0000 7f28fb400700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fb870 0x7f28fc113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:57.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.353+0000 7f28faa00700 1 -- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fb870 msgr2=0x7f28fc113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.353+0000 7f28faa00700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fb870 0x7f28fc113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.353+0000 7f28faa00700 1 -- 172.21.15.148:0/2619462833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8005040 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.353+0000 7f28faa00700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc114480 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009fd0 tx=0x7f28e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.353+0000 7f28f3400700 1 -- 172.21.15.148:0/2619462833 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28e800e040 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.354+0000 7f28f3400700 1 -- 172.21.15.148:0/2619462833 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f28e800bcc0 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.354+0000 7f28f3400700 1 -- 172.21.15.148:0/2619462833 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28e801c630 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.354+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc1155a0 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.354+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc115ae0 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.345 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.355+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc10e050 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.357+0000 7f28f3400700 1 -- 172.21.15.148:0/2619462833 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f28e8013980 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.358+0000 7f28f3400700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f28e006b2e0 0x7f28e006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:57.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.358+0000 7f28f3400700 1 -- 172.21.15.148:0/2619462833 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f28e808b1f0 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.348 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.359+0000 7f28fb400700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f28e006b2e0 0x7f28e006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:57.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.360+0000 7f28fb400700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f28e006b2e0 0x7f28e006d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0041d0 tx=0x7f28ec0043c0 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:57.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.366+0000 7f28f3400700 1 -- 172.21.15.148:0/2619462833 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f28e8058de0 con 0x7f28fc0fe1d0 2024-02-28T16:25:57.517 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:57 smithi148 ceph-mon[28767]: pgmap v23: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 102 op/s 2024-02-28T16:25:57.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.736+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28fc115e30 con 0x7f28e006b2e0 2024-02-28T16:25:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.739+0000 7f28f3400700 1 -- 172.21.15.148:0/2619462833 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f28fc115e30 con 0x7f28e006b2e0 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f28e006b2e0 msgr2=0x7f28e006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f28e006b2e0 0x7f28e006d790 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0041d0 tx=0x7f28ec0043c0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fe1d0 msgr2=0x7f28fc114480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc114480 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009fd0 tx=0x7f28e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 shutdown_connections 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f28e006b2e0 0x7f28e006d790 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f28fc0fb870 0x7f28fc113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 --2- 172.21.15.148:0/2619462833 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f28fc0fe1d0 0x7f28fc114480 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.745+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 >> 172.21.15.148:0/2619462833 conn(0x7f28fc0f74e0 msgr2=0x7f28fc0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:57.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.746+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 shutdown_connections 2024-02-28T16:25:57.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.746+0000 7f2902800700 1 -- 172.21.15.148:0/2619462833 wait complete. 2024-02-28T16:25:57.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.969+0000 7f3f39e00700 1 -- 172.21.15.148:0/3948908875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 msgr2=0x7f3f340fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.969+0000 7f3f39e00700 1 --2- 172.21.15.148:0/3948908875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f340fd320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3f24004940 tx=0x7f3f24009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:57.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.970+0000 7f3f39e00700 1 -- 172.21.15.148:0/3948908875 shutdown_connections 2024-02-28T16:25:57.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.970+0000 7f3f39e00700 1 --2- 172.21.15.148:0/3948908875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f340fe0e0 0x7f3f340fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.970+0000 7f3f39e00700 1 --2- 172.21.15.148:0/3948908875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f340fd320 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.970+0000 7f3f39e00700 1 -- 172.21.15.148:0/3948908875 >> 172.21.15.148:0/3948908875 conn(0x7f3f340f8620 msgr2=0x7f3f340faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:57.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.972+0000 7f3f39e00700 1 -- 172.21.15.148:0/3948908875 shutdown_connections 2024-02-28T16:25:57.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.972+0000 7f3f39e00700 1 -- 172.21.15.148:0/3948908875 wait complete. 2024-02-28T16:25:57.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.973+0000 7f3f39e00700 1 Processor -- start 2024-02-28T16:25:57.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.973+0000 7f3f39e00700 1 -- start start 2024-02-28T16:25:57.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f39e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f34071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:57.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f39e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f340fe0e0 0x7f3f340702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:57.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f39e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f34111650 con 0x7f3f340fcef0 2024-02-28T16:25:57.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f39e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f341117c0 con 0x7f3f340fe0e0 2024-02-28T16:25:57.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f32a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f34071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:57.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f32000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f340fe0e0 0x7f3f340702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:57.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f32a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f34071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59890/0 (socket says 172.21.15.148:59890) 2024-02-28T16:25:57.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.974+0000 7f3f32a00700 1 -- 172.21.15.148:0/1077054644 learned_addr learned my addr 172.21.15.148:0/1077054644 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:57.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.975+0000 7f3f32000700 1 -- 172.21.15.148:0/1077054644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 msgr2=0x7f3f34071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:57.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.975+0000 7f3f32000700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f34071e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:57.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.975+0000 7f3f32000700 1 -- 172.21.15.148:0/1077054644 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f24005040 con 0x7f3f340fe0e0 2024-02-28T16:25:57.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.976+0000 7f3f32a00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f34071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:25:57.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.976+0000 7f3f32000700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f340fe0e0 0x7f3f340702e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f20002820 tx=0x7f3f20004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:57.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.976+0000 7f3f2aa00700 1 -- 172.21.15.148:0/1077054644 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f20007cc0 con 0x7f3f340fe0e0 2024-02-28T16:25:57.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.976+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f34070940 con 0x7f3f340fe0e0 2024-02-28T16:25:57.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.977+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f34070e80 con 0x7f3f340fe0e0 2024-02-28T16:25:57.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.977+0000 7f3f2aa00700 1 -- 172.21.15.148:0/1077054644 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f2000f040 con 0x7f3f340fe0e0 2024-02-28T16:25:57.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.977+0000 7f3f2aa00700 1 -- 172.21.15.148:0/1077054644 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f2001c7d0 con 0x7f3f340fe0e0 2024-02-28T16:25:57.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.980+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f140052e0 con 0x7f3f340fe0e0 2024-02-28T16:25:57.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.980+0000 7f3f2aa00700 1 -- 172.21.15.148:0/1077054644 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f3f2000d3e0 con 0x7f3f340fe0e0 2024-02-28T16:25:57.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.981+0000 7f3f2aa00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3f1806b3b0 0x7f3f1806d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:57.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.981+0000 7f3f2aa00700 1 -- 172.21.15.148:0/1077054644 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3f20089a50 con 0x7f3f340fe0e0 2024-02-28T16:25:57.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.982+0000 7f3f32a00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3f1806b3b0 0x7f3f1806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:57.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:57.984+0000 7f3f32a00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3f1806b3b0 0x7f3f1806d860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f24004f90 tx=0x7f3f24009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:57 smithi157 ceph-mon[38346]: pgmap v23: 65 pgs: 65 active+clean; 142 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 102 op/s 2024-02-28T16:25:57.994 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.004+0000 7f3f2aa00700 1 -- 172.21.15.148:0/1077054644 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3f20057510 con 0x7f3f340fe0e0 2024-02-28T16:25:58.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.386+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f14000bf0 con 0x7f3f1806b3b0 2024-02-28T16:25:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.424+0000 7f3f2aa00700 1 -- 172.21.15.148:0/1077054644 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3f14000bf0 con 0x7f3f1806b3b0 2024-02-28T16:25:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.427+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3f1806b3b0 msgr2=0x7f3f1806d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:58.417 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.427+0000 7f3f39e00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3f1806b3b0 0x7f3f1806d860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f24004f90 tx=0x7f3f24009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 starting - - - - 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (11m) 26s ago 11m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (10m) 30s ago 10m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (8m) 26s ago 11m 74.6M - 9.4.7 954c08fa6188 9cb307a9b404 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (3m) 26s ago 3m 11.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (3m) 26s ago 3m 109M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (3m) 30s ago 3m 11.8M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (3m) 30s ago 3m 11.9M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:25:58.418 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:9283 running (13m) 26s ago 13m 319M - 17.2.7-535-gc0f02e60 1c37ed371348 0efadaac859c 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (56s) 30s ago 9m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1ed96a6b633e 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (13m) 26s ago 13m 46.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (9m) 30s ago 9m 37.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 starting - - - - 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (9m) 30s ago 9m 7944k - 1.5.0 0da6a335fe13 e10955ca2cb2 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (8m) 26s ago 8m 76.1M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (7m) 26s ago 7m 67.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (7m) 26s ago 7m 65.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (6m) 30s ago 6m 71.0M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (5m) 30s ago 5m 71.1M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (5m) 30s ago 5m 62.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:25:58.419 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (8m) 26s ago 10m 50.7M - 2.43.0 a07b618ecd1d 92209c2989e2 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.427+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f340fe0e0 msgr2=0x7f3f340702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.427+0000 7f3f39e00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f340fe0e0 0x7f3f340702e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f20002820 tx=0x7f3f20004570 comp rx=0 tx=0).stop 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.428+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 shutdown_connections 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.428+0000 7f3f39e00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3f1806b3b0 0x7f3f1806d860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.428+0000 7f3f39e00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f340fcef0 0x7f3f34071e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.428+0000 7f3f39e00700 1 --2- 172.21.15.148:0/1077054644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f340fe0e0 0x7f3f340702e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.428+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 >> 172.21.15.148:0/1077054644 conn(0x7f3f340f8620 msgr2=0x7f3f341013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.428+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 shutdown_connections 2024-02-28T16:25:58.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.428+0000 7f3f39e00700 1 -- 172.21.15.148:0/1077054644 wait complete. 2024-02-28T16:25:58.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:58 smithi148 ceph-mon[28767]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:58.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:58 smithi148 ceph-mon[28767]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.605+0000 7fc4ad000700 1 -- 172.21.15.148:0/3541879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 msgr2=0x7fc4a81007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.605+0000 7fc4ad000700 1 --2- 172.21.15.148:0/3541879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a81007b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc494004940 tx=0x7fc494009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.606+0000 7fc4ad000700 1 -- 172.21.15.148:0/3541879375 shutdown_connections 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.606+0000 7fc4ad000700 1 --2- 172.21.15.148:0/3541879375 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a81007b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.606+0000 7fc4ad000700 1 --2- 172.21.15.148:0/3541879375 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4a80ff150 0x7fc4a80ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.606+0000 7fc4ad000700 1 -- 172.21.15.148:0/3541879375 >> 172.21.15.148:0/3541879375 conn(0x7fc4a80fa920 msgr2=0x7fc4a80fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.606+0000 7fc4ad000700 1 -- 172.21.15.148:0/3541879375 shutdown_connections 2024-02-28T16:25:58.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.607+0000 7fc4ad000700 1 -- 172.21.15.148:0/3541879375 wait complete. 2024-02-28T16:25:58.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.608+0000 7fc4ad000700 1 Processor -- start 2024-02-28T16:25:58.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.608+0000 7fc4ad000700 1 -- start start 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.609+0000 7fc4ad000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4a80ff150 0x7fc4a810fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.609+0000 7fc4ad000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a8110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.609+0000 7fc4ad000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8110730 con 0x7fc4a8100360 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.609+0000 7fc4ad000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8110fd0 con 0x7fc4a80ff150 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.609+0000 7fc4a5400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a8110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.609+0000 7fc4a5400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a8110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59902/0 (socket says 172.21.15.148:59902) 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.609+0000 7fc4a5400700 1 -- 172.21.15.148:0/548798149 learned_addr learned my addr 172.21.15.148:0/548798149 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.610+0000 7fc4a5e00700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4a80ff150 0x7fc4a810fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:58.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.610+0000 7fc4a5400700 1 -- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4a80ff150 msgr2=0x7fc4a810fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:58.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.610+0000 7fc4a5400700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4a80ff150 0x7fc4a810fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:58.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.610+0000 7fc4a5400700 1 -- 172.21.15.148:0/548798149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494005040 con 0x7fc4a8100360 2024-02-28T16:25:58.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.610+0000 7fc4a5400700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a8110130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc494009fd0 tx=0x7fc494009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.611+0000 7fc49e000700 1 -- 172.21.15.148:0/548798149 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49400e040 con 0x7fc4a8100360 2024-02-28T16:25:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.611+0000 7fc49e000700 1 -- 172.21.15.148:0/548798149 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc49400bbf0 con 0x7fc4a8100360 2024-02-28T16:25:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.611+0000 7fc49e000700 1 -- 172.21.15.148:0/548798149 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc49401c630 con 0x7fc4a8100360 2024-02-28T16:25:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.611+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a8111250 con 0x7fc4a8100360 2024-02-28T16:25:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.611+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a8111790 con 0x7fc4a8100360 2024-02-28T16:25:58.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.614+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a804bed0 con 0x7fc4a8100360 2024-02-28T16:25:58.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.614+0000 7fc49e000700 1 -- 172.21.15.148:0/548798149 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fc494013980 con 0x7fc4a8100360 2024-02-28T16:25:58.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.615+0000 7fc49e000700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fc48c06b2e0 0x7fc48c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:58.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.616+0000 7fc49e000700 1 -- 172.21.15.148:0/548798149 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc49408b190 con 0x7fc4a8100360 2024-02-28T16:25:58.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.617+0000 7fc4a5e00700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fc48c06b2e0 0x7fc48c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:58.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.619+0000 7fc4a5e00700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fc48c06b2e0 0x7fc48c06d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc498009fd0 tx=0x7fc498009f00 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:58.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:58.621+0000 7fc49e000700 1 -- 172.21.15.148:0/548798149 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc494058cd0 con 0x7fc4a8100360 2024-02-28T16:25:58.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:58 smithi157 ceph-mon[38346]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:58.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:58 smithi157 ceph-mon[38346]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:59.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.126+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc4a8107c30 con 0x7fc4a8100360 2024-02-28T16:25:59.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.128+0000 7fc49e000700 1 -- 172.21.15.148:0/548798149 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fc494058860 con 0x7fc4a8100360 2024-02-28T16:25:59.117 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:25:59.117 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 13, 2024-02-28T16:25:59.118 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:25:59.119 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:25:59.119 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:25:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.131+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fc48c06b2e0 msgr2=0x7fc48c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.131+0000 7fc4ad000700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fc48c06b2e0 0x7fc48c06d790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc498009fd0 tx=0x7fc498009f00 comp rx=0 tx=0).stop 2024-02-28T16:25:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.131+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 msgr2=0x7fc4a8110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.131+0000 7fc4ad000700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a8110130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc494009fd0 tx=0x7fc494009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.133+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 shutdown_connections 2024-02-28T16:25:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.133+0000 7fc4ad000700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fc48c06b2e0 0x7fc48c06d790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.133+0000 7fc4ad000700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4a80ff150 0x7fc4a810fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.133+0000 7fc4ad000700 1 --2- 172.21.15.148:0/548798149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4a8100360 0x7fc4a8110130 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.133+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 >> 172.21.15.148:0/548798149 conn(0x7fc4a80fa920 msgr2=0x7fc4a8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.133+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 shutdown_connections 2024-02-28T16:25:59.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.133+0000 7fc4ad000700 1 -- 172.21.15.148:0/548798149 wait complete. 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 -- 172.21.15.148:0/3315825331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c104760 msgr2=0x7f320c104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 --2- 172.21.15.148:0/3315825331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c104760 0x7f320c104bb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f31f8004940 tx=0x7f31f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 -- 172.21.15.148:0/3315825331 shutdown_connections 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 --2- 172.21.15.148:0/3315825331 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c104760 0x7f320c104bb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 --2- 172.21.15.148:0/3315825331 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f320c1035a0 0x7f320c1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 -- 172.21.15.148:0/3315825331 >> 172.21.15.148:0/3315825331 conn(0x7f320c0668f0 msgr2=0x7f320c066d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 -- 172.21.15.148:0/3315825331 shutdown_connections 2024-02-28T16:25:59.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.335+0000 7f3212a00700 1 -- 172.21.15.148:0/3315825331 wait complete. 2024-02-28T16:25:59.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.336+0000 7f3212a00700 1 Processor -- start 2024-02-28T16:25:59.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.337+0000 7f3212a00700 1 -- start start 2024-02-28T16:25:59.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.337+0000 7f3212a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c1035a0 0x7f320c113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.337+0000 7f3212a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f320c104760 0x7f320c1144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.337+0000 7f3212a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c114ab0 con 0x7f320c1035a0 2024-02-28T16:25:59.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.337+0000 7f3212a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c115350 con 0x7f320c104760 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c1035a0 0x7f320c113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c1035a0 0x7f320c113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:59920/0 (socket says 172.21.15.148:59920) 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320be00700 1 -- 172.21.15.148:0/2804381142 learned_addr learned my addr 172.21.15.148:0/2804381142 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320b400700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f320c104760 0x7f320c1144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320be00700 1 -- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f320c104760 msgr2=0x7f320c1144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320be00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f320c104760 0x7f320c1144b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320be00700 1 -- 172.21.15.148:0/2804381142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8005040 con 0x7f320c1035a0 2024-02-28T16:25:59.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.338+0000 7f320b400700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f320c104760 0x7f320c1144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:25:59.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.339+0000 7f320be00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c1035a0 0x7f320c113f70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31fc002a80 tx=0x7f31fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:59.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.339+0000 7f3203e00700 1 -- 172.21.15.148:0/2804381142 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31fc007cc0 con 0x7f320c1035a0 2024-02-28T16:25:59.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.339+0000 7f3203e00700 1 -- 172.21.15.148:0/2804381142 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31fc00f040 con 0x7f320c1035a0 2024-02-28T16:25:59.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.339+0000 7f3203e00700 1 -- 172.21.15.148:0/2804381142 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31fc00dad0 con 0x7f320c1035a0 2024-02-28T16:25:59.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.340+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c115630 con 0x7f320c1035a0 2024-02-28T16:25:59.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.340+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c115b70 con 0x7f320c1035a0 2024-02-28T16:25:59.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.342+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320c04bed0 con 0x7f320c1035a0 2024-02-28T16:25:59.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.344+0000 7f3203e00700 1 -- 172.21.15.148:0/2804381142 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f31fc00dc30 con 0x7f320c1035a0 2024-02-28T16:25:59.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.345+0000 7f3203e00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f31f006b2e0 0x7f31f006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:25:59.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.345+0000 7f3203e00700 1 -- 172.21.15.148:0/2804381142 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f31fc0894a0 con 0x7f320c1035a0 2024-02-28T16:25:59.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.346+0000 7f320b400700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f31f006b2e0 0x7f31f006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:25:59.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.347+0000 7f320b400700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f31f006b2e0 0x7f31f006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31f800b7a0 tx=0x7f31f8009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:25:59.344 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.355+0000 7f3203e00700 1 -- 172.21.15.148:0/2804381142 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f31fc04e620 con 0x7f320c1035a0 2024-02-28T16:25:59.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.727+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f320c1090b0 con 0x7f31f006b2e0 2024-02-28T16:25:59.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.732+0000 7f3203e00700 1 -- 172.21.15.148:0/2804381142 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f320c1090b0 con 0x7f31f006b2e0 2024-02-28T16:25:59.722 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:25:59.722 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:25:59.722 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:25:59.722 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:25:59.722 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [], 2024-02-28T16:25:59.722 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "1/2 daemons upgraded", 2024-02-28T16:25:59.723 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "", 2024-02-28T16:25:59.723 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:25:59.723 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:25:59.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f31f006b2e0 msgr2=0x7f31f006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f31f006b2e0 0x7f31f006d790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31f800b7a0 tx=0x7f31f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:25:59.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c1035a0 msgr2=0x7f320c113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:25:59.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c1035a0 0x7f320c113f70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31fc002a80 tx=0x7f31fc004600 comp rx=0 tx=0).stop 2024-02-28T16:25:59.726 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 shutdown_connections 2024-02-28T16:25:59.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f31f006b2e0 0x7f31f006d790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c1035a0 0x7f320c113f70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 --2- 172.21.15.148:0/2804381142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f320c104760 0x7f320c1144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:25:59.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 >> 172.21.15.148:0/2804381142 conn(0x7f320c0668f0 msgr2=0x7f320c107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:25:59.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.736+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 shutdown_connections 2024-02-28T16:25:59.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:25:59.738+0000 7f3212a00700 1 -- 172.21.15.148:0/2804381142 wait complete. 2024-02-28T16:25:59.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:59 smithi157 ceph-mon[38346]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:59.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:59 smithi157 ceph-mon[38346]: pgmap v24: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 146 op/s 2024-02-28T16:25:59.822 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:25:59 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/548798149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:25:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:59 smithi148 ceph-mon[28767]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:25:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:59 smithi148 ceph-mon[28767]: pgmap v24: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 146 op/s 2024-02-28T16:25:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:25:59 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/548798149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:00 smithi148 ceph-mon[28767]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:01.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:00 smithi157 ceph-mon[38346]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:02.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:01 smithi148 ceph-mon[28767]: pgmap v25: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 99 op/s 2024-02-28T16:26:02.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:01 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:02.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:01 smithi157 ceph-mon[38346]: pgmap v25: 65 pgs: 65 active+clean; 148 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 99 op/s 2024-02-28T16:26:02.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:01 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:04.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:03 smithi157 ceph-mon[38346]: pgmap v26: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 195 op/s 2024-02-28T16:26:04.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:03 smithi148 ceph-mon[28767]: pgmap v26: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 195 op/s 2024-02-28T16:26:06.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:05 smithi157 ceph-mon[38346]: pgmap v27: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 140 op/s 2024-02-28T16:26:06.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:05 smithi148 ceph-mon[28767]: pgmap v27: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 140 op/s 2024-02-28T16:26:08.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:07 smithi157 ceph-mon[38346]: pgmap v28: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 140 op/s 2024-02-28T16:26:08.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:07 smithi148 ceph-mon[28767]: pgmap v28: 65 pgs: 65 active+clean; 159 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.4 MiB/s wr, 140 op/s 2024-02-28T16:26:10.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:09 smithi157 ceph-mon[38346]: pgmap v29: 65 pgs: 65 active+clean; 173 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 247 op/s 2024-02-28T16:26:10.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:09 smithi148 ceph-mon[28767]: pgmap v29: 65 pgs: 65 active+clean; 173 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.7 MiB/s wr, 247 op/s 2024-02-28T16:26:12.029 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:11 smithi148 ceph-mon[28767]: pgmap v30: 65 pgs: 65 active+clean; 173 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 203 op/s 2024-02-28T16:26:12.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:11 smithi157 ceph-mon[38346]: pgmap v30: 65 pgs: 65 active+clean; 173 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.1 MiB/s wr, 203 op/s 2024-02-28T16:26:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:13 smithi148 ceph-mon[28767]: pgmap v31: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 256 op/s 2024-02-28T16:26:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:13 smithi157 ceph-mon[38346]: pgmap v31: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.1 MiB/s wr, 256 op/s 2024-02-28T16:26:15.893 INFO:tasks.workunit.client.0.smithi148.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T16:26:15.907 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:26:15.907 INFO:tasks.workunit.client.0.smithi148.stderr:+ make 2024-02-28T16:26:16.057 INFO:tasks.workunit.client.0.smithi148.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T16:26:16.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:15 smithi148 ceph-mon[28767]: pgmap v32: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 160 op/s 2024-02-28T16:26:16.209 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:15 smithi157 ceph-mon[38346]: pgmap v32: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 160 op/s 2024-02-28T16:26:17.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:16 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:17.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:16 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:17.789 INFO:tasks.workunit.client.0.smithi148.stderr:++ readlink -f fsstress 2024-02-28T16:26:17.797 INFO:tasks.workunit.client.0.smithi148.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T16:26:17.797 INFO:tasks.workunit.client.0.smithi148.stderr:+ popd 2024-02-28T16:26:17.802 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:26:17.802 INFO:tasks.workunit.client.0.smithi148.stderr:+ popd 2024-02-28T16:26:17.805 INFO:tasks.workunit.client.0.smithi148.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-28T16:26:17.806 INFO:tasks.workunit.client.0.smithi148.stderr:++ mktemp -d -p . 2024-02-28T16:26:17.814 INFO:tasks.workunit.client.0.smithi148.stderr:+ T=./tmp.LSsvsRNMvx 2024-02-28T16:26:17.814 INFO:tasks.workunit.client.0.smithi148.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.LSsvsRNMvx -l 1 -n 1000 -p 10 -v 2024-02-28T16:26:17.826 INFO:tasks.workunit.client.0.smithi148.stdout:seed = 1708365091 2024-02-28T16:26:17.838 INFO:tasks.workunit.client.0.smithi148.stdout:0/0: write - no filename 2024-02-28T16:26:17.842 INFO:tasks.workunit.client.0.smithi148.stdout:0/1: symlink l0 0 2024-02-28T16:26:17.844 INFO:tasks.workunit.client.0.smithi148.stdout:0/2: chown l0 0 1 2024-02-28T16:26:17.847 INFO:tasks.workunit.client.0.smithi148.stdout:1/0: creat f0 x:0 0 0 2024-02-28T16:26:17.847 INFO:tasks.workunit.client.0.smithi148.stdout:3/0: link - no file 2024-02-28T16:26:17.847 INFO:tasks.workunit.client.0.smithi148.stdout:0/3: mkdir d1 0 2024-02-28T16:26:17.849 INFO:tasks.workunit.client.0.smithi148.stdout:1/1: write f0 [997782,52041] 0 2024-02-28T16:26:17.850 INFO:tasks.workunit.client.0.smithi148.stdout:0/4: rename d1 to d1/d2 22 2024-02-28T16:26:17.852 INFO:tasks.workunit.client.0.smithi148.stdout:4/0: fdatasync - no filename 2024-02-28T16:26:17.852 INFO:tasks.workunit.client.0.smithi148.stdout:4/1: write - no filename 2024-02-28T16:26:17.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/1: symlink l0 0 2024-02-28T16:26:17.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/2: dread - no filename 2024-02-28T16:26:17.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/3: write - no filename 2024-02-28T16:26:17.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/4: write - no filename 2024-02-28T16:26:17.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/5: dwrite - no filename 2024-02-28T16:26:17.853 INFO:tasks.workunit.client.0.smithi148.stdout:3/6: dread - no filename 2024-02-28T16:26:17.855 INFO:tasks.workunit.client.0.smithi148.stdout:1/2: fdatasync f0 0 2024-02-28T16:26:17.857 INFO:tasks.workunit.client.0.smithi148.stdout:3/7: mkdir d1 0 2024-02-28T16:26:17.857 INFO:tasks.workunit.client.0.smithi148.stdout:3/8: dread - no filename 2024-02-28T16:26:17.857 INFO:tasks.workunit.client.0.smithi148.stdout:0/5: symlink d1/l3 0 2024-02-28T16:26:17.857 INFO:tasks.workunit.client.0.smithi148.stdout:0/6: dread - no filename 2024-02-28T16:26:17.966 INFO:tasks.workunit.client.0.smithi148.stdout:4/2: creat f0 x:0 0 0 2024-02-28T16:26:17.967 INFO:tasks.workunit.client.0.smithi148.stdout:0/7: mkdir d1/d4 0 2024-02-28T16:26:17.967 INFO:tasks.workunit.client.0.smithi148.stdout:6/0: dwrite - no filename 2024-02-28T16:26:17.970 INFO:tasks.workunit.client.0.smithi148.stdout:3/9: symlink d1/l2 0 2024-02-28T16:26:17.970 INFO:tasks.workunit.client.0.smithi148.stdout:3/10: dwrite - no filename 2024-02-28T16:26:17.970 INFO:tasks.workunit.client.0.smithi148.stdout:3/11: dread - no filename 2024-02-28T16:26:17.970 INFO:tasks.workunit.client.0.smithi148.stdout:5/0: getdents . 0 2024-02-28T16:26:17.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/1: chown . 4324 1 2024-02-28T16:26:17.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/2: read - no filename 2024-02-28T16:26:17.971 INFO:tasks.workunit.client.0.smithi148.stdout:3/12: readlink l0 0 2024-02-28T16:26:17.971 INFO:tasks.workunit.client.0.smithi148.stdout:3/13: dread - no filename 2024-02-28T16:26:17.971 INFO:tasks.workunit.client.0.smithi148.stdout:3/14: fdatasync - no filename 2024-02-28T16:26:17.974 INFO:tasks.workunit.client.0.smithi148.stdout:7/0: chown . 1083138 1 2024-02-28T16:26:17.974 INFO:tasks.workunit.client.0.smithi148.stdout:7/1: link - no file 2024-02-28T16:26:17.974 INFO:tasks.workunit.client.0.smithi148.stdout:7/2: chown . 102587688 1 2024-02-28T16:26:17.974 INFO:tasks.workunit.client.0.smithi148.stdout:7/3: write - no filename 2024-02-28T16:26:17.974 INFO:tasks.workunit.client.0.smithi148.stdout:7/4: write - no filename 2024-02-28T16:26:17.974 INFO:tasks.workunit.client.0.smithi148.stdout:7/5: dwrite - no filename 2024-02-28T16:26:17.976 INFO:tasks.workunit.client.0.smithi148.stdout:1/3: dread f0 [0,4194304] 0 2024-02-28T16:26:18.078 INFO:tasks.workunit.client.0.smithi148.stdout:6/1: mkdir d0 0 2024-02-28T16:26:18.079 INFO:tasks.workunit.client.0.smithi148.stdout:6/2: dread - no filename 2024-02-28T16:26:18.079 INFO:tasks.workunit.client.0.smithi148.stdout:6/3: fsync - no filename 2024-02-28T16:26:18.085 INFO:tasks.workunit.client.0.smithi148.stdout:3/15: creat d1/f3 x:0 0 0 2024-02-28T16:26:18.086 INFO:tasks.workunit.client.0.smithi148.stdout:5/3: symlink l0 0 2024-02-28T16:26:18.086 INFO:tasks.workunit.client.0.smithi148.stdout:5/4: fdatasync - no filename 2024-02-28T16:26:18.089 INFO:tasks.workunit.client.0.smithi148.stdout:0/8: creat d1/d4/f5 x:0 0 0 2024-02-28T16:26:18.089 INFO:tasks.workunit.client.0.smithi148.stdout:1/4: symlink l1 0 2024-02-28T16:26:18.092 INFO:tasks.workunit.client.0.smithi148.stdout:7/6: mkdir d0 0 2024-02-28T16:26:18.092 INFO:tasks.workunit.client.0.smithi148.stdout:5/5: chown l0 211 1 2024-02-28T16:26:18.092 INFO:tasks.workunit.client.0.smithi148.stdout:6/4: symlink d0/l1 0 2024-02-28T16:26:18.097 INFO:tasks.workunit.client.0.smithi148.stdout:8/0: truncate - no filename 2024-02-28T16:26:18.097 INFO:tasks.workunit.client.0.smithi148.stdout:8/1: write - no filename 2024-02-28T16:26:18.097 INFO:tasks.workunit.client.0.smithi148.stdout:8/2: truncate - no filename 2024-02-28T16:26:18.098 INFO:tasks.workunit.client.0.smithi148.stdout:0/9: dread - d1/d4/f5 zero size 2024-02-28T16:26:18.100 INFO:tasks.workunit.client.0.smithi148.stdout:1/5: mkdir d2 0 2024-02-28T16:26:18.100 INFO:tasks.workunit.client.0.smithi148.stdout:3/16: symlink d1/l4 0 2024-02-28T16:26:18.103 INFO:tasks.workunit.client.0.smithi148.stdout:9/0: write - no filename 2024-02-28T16:26:18.103 INFO:tasks.workunit.client.0.smithi148.stdout:9/1: readlink - no filename 2024-02-28T16:26:18.104 INFO:tasks.workunit.client.0.smithi148.stdout:0/10: dread - d1/d4/f5 zero size 2024-02-28T16:26:18.107 INFO:tasks.workunit.client.0.smithi148.stdout:0/11: write d1/d4/f5 [40001,7933] 0 2024-02-28T16:26:18.111 INFO:tasks.workunit.client.0.smithi148.stdout:4/3: dwrite f0 [0,4194304] 0 2024-02-28T16:26:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:17 smithi148 ceph-mon[28767]: pgmap v33: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 160 op/s 2024-02-28T16:26:18.157 INFO:tasks.workunit.client.0.smithi148.stdout:5/6: mkdir d1 0 2024-02-28T16:26:18.158 INFO:tasks.workunit.client.0.smithi148.stdout:5/7: fdatasync - no filename 2024-02-28T16:26:18.159 INFO:tasks.workunit.client.0.smithi148.stdout:6/5: creat d0/f2 x:0 0 0 2024-02-28T16:26:18.160 INFO:tasks.workunit.client.0.smithi148.stdout:3/17: creat d1/f5 x:0 0 0 2024-02-28T16:26:18.161 INFO:tasks.workunit.client.0.smithi148.stdout:0/12: creat d1/f6 x:0 0 0 2024-02-28T16:26:18.162 INFO:tasks.workunit.client.0.smithi148.stdout:4/4: creat f1 x:0 0 0 2024-02-28T16:26:18.163 INFO:tasks.workunit.client.0.smithi148.stdout:7/7: creat d0/f1 x:0 0 0 2024-02-28T16:26:18.164 INFO:tasks.workunit.client.0.smithi148.stdout:1/6: symlink d2/l3 0 2024-02-28T16:26:18.165 INFO:tasks.workunit.client.0.smithi148.stdout:1/7: chown d2 52 1 2024-02-28T16:26:18.167 INFO:tasks.workunit.client.0.smithi148.stdout:9/2: creat f0 x:0 0 0 2024-02-28T16:26:18.167 INFO:tasks.workunit.client.0.smithi148.stdout:6/6: symlink d0/l3 0 2024-02-28T16:26:18.168 INFO:tasks.workunit.client.0.smithi148.stdout:3/18: creat d1/f6 x:0 0 0 2024-02-28T16:26:18.168 INFO:tasks.workunit.client.0.smithi148.stdout:5/8: mknod d1/c2 0 2024-02-28T16:26:18.168 INFO:tasks.workunit.client.0.smithi148.stdout:5/9: truncate - no filename 2024-02-28T16:26:18.168 INFO:tasks.workunit.client.0.smithi148.stdout:5/10: write - no filename 2024-02-28T16:26:18.169 INFO:tasks.workunit.client.0.smithi148.stdout:0/13: mkdir d1/d7 0 2024-02-28T16:26:18.171 INFO:tasks.workunit.client.0.smithi148.stdout:1/8: mknod d2/c4 0 2024-02-28T16:26:18.171 INFO:tasks.workunit.client.0.smithi148.stdout:7/8: creat d0/f2 x:0 0 0 2024-02-28T16:26:18.172 INFO:tasks.workunit.client.0.smithi148.stdout:0/14: fdatasync d1/d4/f5 0 2024-02-28T16:26:18.172 INFO:tasks.workunit.client.0.smithi148.stdout:6/7: mkdir d0/d4 0 2024-02-28T16:26:18.175 INFO:tasks.workunit.client.0.smithi148.stdout:0/15: fdatasync d1/d4/f5 0 2024-02-28T16:26:18.177 INFO:tasks.workunit.client.0.smithi148.stdout:6/8: write d0/f2 [119405,80738] 0 2024-02-28T16:26:18.177 INFO:tasks.workunit.client.0.smithi148.stdout:0/16: readlink l0 0 2024-02-28T16:26:18.179 INFO:tasks.workunit.client.0.smithi148.stdout:6/9: write d0/f2 [1017567,110371] 0 2024-02-28T16:26:18.180 INFO:tasks.workunit.client.0.smithi148.stdout:0/17: mkdir d1/d7/d8 0 2024-02-28T16:26:18.180 INFO:tasks.workunit.client.0.smithi148.stdout:4/5: dread f0 [0,4194304] 0 2024-02-28T16:26:18.183 INFO:tasks.workunit.client.0.smithi148.stdout:0/18: write d1/d4/f5 [198494,111769] 0 2024-02-28T16:26:18.183 INFO:tasks.workunit.client.0.smithi148.stdout:4/6: link f0 f2 0 2024-02-28T16:26:18.186 INFO:tasks.workunit.client.0.smithi148.stdout:0/19: link l0 d1/l9 0 2024-02-28T16:26:18.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/20: readlink d1/l3 0 2024-02-28T16:26:18.189 INFO:tasks.workunit.client.0.smithi148.stdout:0/21: write d1/d4/f5 [498947,57761] 0 2024-02-28T16:26:18.190 INFO:tasks.workunit.client.0.smithi148.stdout:0/22: chown d1/l3 338001377 1 2024-02-28T16:26:18.192 INFO:tasks.workunit.client.0.smithi148.stdout:0/23: chown l0 100 1 2024-02-28T16:26:18.195 INFO:tasks.workunit.client.0.smithi148.stdout:0/24: mknod d1/ca 0 2024-02-28T16:26:18.196 INFO:tasks.workunit.client.0.smithi148.stdout:6/10: read d0/f2 [61606,124978] 0 2024-02-28T16:26:18.197 INFO:tasks.workunit.client.0.smithi148.stdout:0/25: chown d1/ca 1855012933 1 2024-02-28T16:26:18.202 INFO:tasks.workunit.client.0.smithi148.stdout:0/26: write d1/d4/f5 [808474,48727] 0 2024-02-28T16:26:18.204 INFO:tasks.workunit.client.0.smithi148.stdout:6/11: mkdir d0/d4/d5 0 2024-02-28T16:26:18.206 INFO:tasks.workunit.client.0.smithi148.stdout:0/27: write d1/f6 [1004848,8924] 0 2024-02-28T16:26:18.211 INFO:tasks.workunit.client.0.smithi148.stdout:4/7: dwrite f2 [0,4194304] 0 2024-02-28T16:26:18.213 INFO:tasks.workunit.client.0.smithi148.stdout:4/8: chown f0 17 1 2024-02-28T16:26:18.234 INFO:tasks.workunit.client.0.smithi148.stdout:0/28: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:26:18.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:17 smithi157 ceph-mon[38346]: pgmap v33: 65 pgs: 65 active+clean; 184 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.2 MiB/s wr, 160 op/s 2024-02-28T16:26:18.451 INFO:tasks.workunit.client.0.smithi148.stdout:4/9: write f2 [4792549,44546] 0 2024-02-28T16:26:18.460 INFO:tasks.workunit.client.0.smithi148.stdout:3/19: getdents d1 0 2024-02-28T16:26:18.463 INFO:tasks.workunit.client.0.smithi148.stdout:7/9: getdents d0 0 2024-02-28T16:26:18.464 INFO:tasks.workunit.client.0.smithi148.stdout:1/9: getdents d2 0 2024-02-28T16:26:18.468 INFO:tasks.workunit.client.0.smithi148.stdout:6/12: getdents d0 0 2024-02-28T16:26:18.473 INFO:tasks.workunit.client.0.smithi148.stdout:1/10: mkdir d2/d5 0 2024-02-28T16:26:18.474 INFO:tasks.workunit.client.0.smithi148.stdout:6/13: creat d0/f6 x:0 0 0 2024-02-28T16:26:18.475 INFO:tasks.workunit.client.0.smithi148.stdout:0/29: rmdir d1 39 2024-02-28T16:26:18.482 INFO:tasks.workunit.client.0.smithi148.stdout:1/11: write f0 [759295,61681] 0 2024-02-28T16:26:18.484 INFO:tasks.workunit.client.0.smithi148.stdout:6/14: truncate d0/f6 993705 0 2024-02-28T16:26:18.491 INFO:tasks.workunit.client.0.smithi148.stdout:4/10: dwrite f2 [4194304,4194304] 0 2024-02-28T16:26:18.493 INFO:tasks.workunit.client.0.smithi148.stdout:0/30: write d1/d4/f5 [555609,84670] 0 2024-02-28T16:26:18.498 INFO:tasks.workunit.client.0.smithi148.stdout:4/11: mkdir d3 0 2024-02-28T16:26:18.498 INFO:tasks.workunit.client.0.smithi148.stdout:3/20: dwrite d1/f5 [0,4194304] 0 2024-02-28T16:26:18.500 INFO:tasks.workunit.client.0.smithi148.stdout:1/12: mkdir d2/d5/d6 0 2024-02-28T16:26:18.502 INFO:tasks.workunit.client.0.smithi148.stdout:0/31: truncate d1/d4/f5 1461266 0 2024-02-28T16:26:18.502 INFO:tasks.workunit.client.0.smithi148.stdout:1/13: fdatasync f0 0 2024-02-28T16:26:18.503 INFO:tasks.workunit.client.0.smithi148.stdout:3/21: stat d1/l4 0 2024-02-28T16:26:18.506 INFO:tasks.workunit.client.0.smithi148.stdout:7/10: dwrite d0/f1 [0,4194304] 0 2024-02-28T16:26:18.511 INFO:tasks.workunit.client.0.smithi148.stdout:4/12: rmdir d3 0 2024-02-28T16:26:18.511 INFO:tasks.workunit.client.0.smithi148.stdout:4/13: rmdir - no directory 2024-02-28T16:26:18.511 INFO:tasks.workunit.client.0.smithi148.stdout:1/14: dread f0 [0,4194304] 0 2024-02-28T16:26:18.513 INFO:tasks.workunit.client.0.smithi148.stdout:1/15: stat d2/c4 0 2024-02-28T16:26:18.519 INFO:tasks.workunit.client.0.smithi148.stdout:7/11: getdents d0 0 2024-02-28T16:26:18.520 INFO:tasks.workunit.client.0.smithi148.stdout:4/14: symlink l4 0 2024-02-28T16:26:18.529 INFO:tasks.workunit.client.0.smithi148.stdout:7/12: mkdir d0/d3 0 2024-02-28T16:26:18.530 INFO:tasks.workunit.client.0.smithi148.stdout:4/15: write f0 [3184368,44949] 0 2024-02-28T16:26:18.536 INFO:tasks.workunit.client.0.smithi148.stdout:7/13: write d0/f1 [3365469,81988] 0 2024-02-28T16:26:18.541 INFO:tasks.workunit.client.0.smithi148.stdout:0/32: dwrite d1/d4/f5 [0,4194304] 0 2024-02-28T16:26:18.542 INFO:tasks.workunit.client.0.smithi148.stdout:7/14: write d0/f2 [708204,16600] 0 2024-02-28T16:26:18.543 INFO:tasks.workunit.client.0.smithi148.stdout:3/22: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:26:18.547 INFO:tasks.workunit.client.0.smithi148.stdout:7/15: write d0/f1 [2512281,74141] 0 2024-02-28T16:26:18.550 INFO:tasks.workunit.client.0.smithi148.stdout:1/16: getdents d2/d5 0 2024-02-28T16:26:18.553 INFO:tasks.workunit.client.0.smithi148.stdout:1/17: truncate f0 2091918 0 2024-02-28T16:26:18.554 INFO:tasks.workunit.client.0.smithi148.stdout:3/23: mknod d1/c7 0 2024-02-28T16:26:18.557 INFO:tasks.workunit.client.0.smithi148.stdout:3/24: write d1/f5 [3110896,88158] 0 2024-02-28T16:26:18.561 INFO:tasks.workunit.client.0.smithi148.stdout:3/25: chown d1/c7 120709507 1 2024-02-28T16:26:18.561 INFO:tasks.workunit.client.0.smithi148.stdout:0/33: dread d1/f6 [0,4194304] 0 2024-02-28T16:26:18.564 INFO:tasks.workunit.client.0.smithi148.stdout:1/18: unlink d2/c4 0 2024-02-28T16:26:18.565 INFO:tasks.workunit.client.0.smithi148.stdout:1/19: chown d2/d5/d6 265078 1 2024-02-28T16:26:18.579 INFO:tasks.workunit.client.0.smithi148.stdout:3/26: rename d1/f5 to d1/f8 0 2024-02-28T16:26:18.588 INFO:tasks.workunit.client.0.smithi148.stdout:1/20: dwrite f0 [0,4194304] 0 2024-02-28T16:26:18.600 INFO:tasks.workunit.client.0.smithi148.stdout:0/34: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:26:18.601 INFO:tasks.workunit.client.0.smithi148.stdout:1/21: mkdir d2/d5/d6/d7 0 2024-02-28T16:26:18.608 INFO:tasks.workunit.client.0.smithi148.stdout:0/35: mknod d1/cb 0 2024-02-28T16:26:18.608 INFO:tasks.workunit.client.0.smithi148.stdout:3/27: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:26:18.610 INFO:tasks.workunit.client.0.smithi148.stdout:3/28: write d1/f3 [3020966,38177] 0 2024-02-28T16:26:18.614 INFO:tasks.workunit.client.0.smithi148.stdout:1/22: mkdir d2/d5/d6/d8 0 2024-02-28T16:26:18.618 INFO:tasks.workunit.client.0.smithi148.stdout:1/23: chown d2/d5/d6/d7 1194271 1 2024-02-28T16:26:18.619 INFO:tasks.workunit.client.0.smithi148.stdout:0/36: symlink d1/d4/lc 0 2024-02-28T16:26:18.620 INFO:tasks.workunit.client.0.smithi148.stdout:1/24: chown d2/d5/d6 778 1 2024-02-28T16:26:18.624 INFO:tasks.workunit.client.0.smithi148.stdout:3/29: write d1/f8 [4015740,19028] 0 2024-02-28T16:26:18.625 INFO:tasks.workunit.client.0.smithi148.stdout:3/30: readlink d1/l2 0 2024-02-28T16:26:18.630 INFO:tasks.workunit.client.0.smithi148.stdout:7/16: truncate d0/f1 1133604 0 2024-02-28T16:26:18.632 INFO:tasks.workunit.client.0.smithi148.stdout:1/25: fdatasync f0 0 2024-02-28T16:26:18.633 INFO:tasks.workunit.client.0.smithi148.stdout:3/31: creat d1/f9 x:0 0 0 2024-02-28T16:26:18.636 INFO:tasks.workunit.client.0.smithi148.stdout:0/37: link d1/ca d1/d7/d8/cd 0 2024-02-28T16:26:18.646 INFO:tasks.workunit.client.0.smithi148.stdout:1/26: creat d2/d5/d6/d8/f9 x:0 0 0 2024-02-28T16:26:18.652 INFO:tasks.workunit.client.0.smithi148.stdout:3/32: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:26:18.652 INFO:tasks.workunit.client.0.smithi148.stdout:7/17: rmdir d0/d3 0 2024-02-28T16:26:18.653 INFO:tasks.workunit.client.0.smithi148.stdout:3/33: chown d1/f8 894535 1 2024-02-28T16:26:18.654 INFO:tasks.workunit.client.0.smithi148.stdout:1/27: mknod d2/ca 0 2024-02-28T16:26:18.655 INFO:tasks.workunit.client.0.smithi148.stdout:3/34: read d1/f6 [365019,32475] 0 2024-02-28T16:26:18.656 INFO:tasks.workunit.client.0.smithi148.stdout:7/18: rmdir d0 39 2024-02-28T16:26:18.661 INFO:tasks.workunit.client.0.smithi148.stdout:3/35: creat d1/fa x:0 0 0 2024-02-28T16:26:18.670 INFO:tasks.workunit.client.0.smithi148.stdout:3/36: mkdir d1/db 0 2024-02-28T16:26:18.683 INFO:tasks.workunit.client.0.smithi148.stdout:1/28: getdents d2/d5/d6/d8 0 2024-02-28T16:26:18.684 INFO:tasks.workunit.client.0.smithi148.stdout:0/38: truncate d1/d4/f5 3838832 0 2024-02-28T16:26:18.687 INFO:tasks.workunit.client.0.smithi148.stdout:3/37: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:26:18.694 INFO:tasks.workunit.client.0.smithi148.stdout:3/38: mknod d1/cc 0 2024-02-28T16:26:18.697 INFO:tasks.workunit.client.0.smithi148.stdout:3/39: fsync d1/f8 0 2024-02-28T16:26:18.698 INFO:tasks.workunit.client.0.smithi148.stdout:3/40: fsync d1/f9 0 2024-02-28T16:26:18.700 INFO:tasks.workunit.client.0.smithi148.stdout:3/41: write d1/f3 [3105317,98275] 0 2024-02-28T16:26:18.702 INFO:tasks.workunit.client.0.smithi148.stdout:1/29: dread f0 [0,4194304] 0 2024-02-28T16:26:18.705 INFO:tasks.workunit.client.0.smithi148.stdout:1/30: read - d2/d5/d6/d8/f9 zero size 2024-02-28T16:26:18.705 INFO:tasks.workunit.client.0.smithi148.stdout:3/42: creat d1/fd x:0 0 0 2024-02-28T16:26:18.709 INFO:tasks.workunit.client.0.smithi148.stdout:1/31: symlink d2/lb 0 2024-02-28T16:26:18.712 INFO:tasks.workunit.client.0.smithi148.stdout:1/32: rmdir d2/d5 39 2024-02-28T16:26:18.717 INFO:tasks.workunit.client.0.smithi148.stdout:0/39: dread d1/d4/f5 [0,4194304] 0 2024-02-28T16:26:18.720 INFO:tasks.workunit.client.0.smithi148.stdout:3/43: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:26:18.722 INFO:tasks.workunit.client.0.smithi148.stdout:3/44: write d1/fa [597803,92222] 0 2024-02-28T16:26:18.799 INFO:tasks.workunit.client.0.smithi148.stdout:7/19: truncate d0/f1 740195 0 2024-02-28T16:26:18.801 INFO:tasks.workunit.client.0.smithi148.stdout:0/40: creat d1/d4/fe x:0 0 0 2024-02-28T16:26:18.802 INFO:tasks.workunit.client.0.smithi148.stdout:3/45: mknod d1/ce 0 2024-02-28T16:26:18.803 INFO:tasks.workunit.client.0.smithi148.stdout:7/20: mkdir d0/d4 0 2024-02-28T16:26:18.804 INFO:tasks.workunit.client.0.smithi148.stdout:3/46: read - d1/fd zero size 2024-02-28T16:26:18.831 INFO:tasks.workunit.client.0.smithi148.stdout:3/47: dwrite d1/fa [0,4194304] 0 2024-02-28T16:26:18.838 INFO:tasks.workunit.client.0.smithi148.stdout:0/41: creat d1/ff x:0 0 0 2024-02-28T16:26:18.840 INFO:tasks.workunit.client.0.smithi148.stdout:3/48: chown d1/f6 2029 1 2024-02-28T16:26:18.846 INFO:tasks.workunit.client.0.smithi148.stdout:3/49: write d1/f8 [1977064,16338] 0 2024-02-28T16:26:18.850 INFO:tasks.workunit.client.0.smithi148.stdout:3/50: mknod d1/cf 0 2024-02-28T16:26:18.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/51: readlink d1/l4 0 2024-02-28T16:26:18.853 INFO:tasks.workunit.client.0.smithi148.stdout:7/21: truncate d0/f2 392197 0 2024-02-28T16:26:18.854 INFO:tasks.workunit.client.0.smithi148.stdout:3/52: dread - d1/f9 zero size 2024-02-28T16:26:18.856 INFO:tasks.workunit.client.0.smithi148.stdout:7/22: rename d0/d4 to d0/d4/d5 22 2024-02-28T16:26:18.859 INFO:tasks.workunit.client.0.smithi148.stdout:3/53: creat d1/db/f10 x:0 0 0 2024-02-28T16:26:18.862 INFO:tasks.workunit.client.0.smithi148.stdout:3/54: dread - d1/fd zero size 2024-02-28T16:26:18.865 INFO:tasks.workunit.client.0.smithi148.stdout:3/55: chown d1/f8 5 1 2024-02-28T16:26:18.867 INFO:tasks.workunit.client.0.smithi148.stdout:0/42: dwrite d1/d4/fe [0,4194304] 0 2024-02-28T16:26:18.868 INFO:tasks.workunit.client.0.smithi148.stdout:0/43: chown d1/d7/d8 217067898 1 2024-02-28T16:26:18.870 INFO:tasks.workunit.client.0.smithi148.stdout:0/44: fsync d1/ff 0 2024-02-28T16:26:18.875 INFO:tasks.workunit.client.0.smithi148.stdout:0/45: creat d1/d4/f10 x:0 0 0 2024-02-28T16:26:18.882 INFO:tasks.workunit.client.0.smithi148.stdout:3/56: dread d1/fa [0,4194304] 0 2024-02-28T16:26:18.883 INFO:tasks.workunit.client.0.smithi148.stdout:0/46: rename d1/d7 to d1/d11 0 2024-02-28T16:26:18.886 INFO:tasks.workunit.client.0.smithi148.stdout:3/57: dread - d1/f9 zero size 2024-02-28T16:26:18.890 INFO:tasks.workunit.client.0.smithi148.stdout:3/58: unlink d1/cf 0 2024-02-28T16:26:18.902 INFO:tasks.workunit.client.0.smithi148.stdout:7/23: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:18.917 INFO:tasks.workunit.client.0.smithi148.stdout:0/47: dwrite d1/f6 [4194304,4194304] 0 2024-02-28T16:26:18.923 INFO:tasks.workunit.client.0.smithi148.stdout:3/59: dwrite d1/f9 [0,4194304] 0 2024-02-28T16:26:18.928 INFO:tasks.workunit.client.0.smithi148.stdout:0/48: link d1/cb d1/d11/d8/c12 0 2024-02-28T16:26:18.932 INFO:tasks.workunit.client.0.smithi148.stdout:3/60: link d1/cc d1/db/c11 0 2024-02-28T16:26:18.933 INFO:tasks.workunit.client.0.smithi148.stdout:0/49: symlink d1/d11/d8/l13 0 2024-02-28T16:26:18.934 INFO:tasks.workunit.client.0.smithi148.stdout:3/61: chown d1/fd 0 1 2024-02-28T16:26:18.935 INFO:tasks.workunit.client.0.smithi148.stdout:0/50: truncate d1/ff 803258 0 2024-02-28T16:26:18.950 INFO:tasks.workunit.client.0.smithi148.stdout:3/62: truncate d1/f3 1801149 0 2024-02-28T16:26:18.951 INFO:tasks.workunit.client.0.smithi148.stdout:0/51: dread d1/d4/fe [0,4194304] 0 2024-02-28T16:26:18.952 INFO:tasks.workunit.client.0.smithi148.stdout:3/63: write d1/f8 [1220033,120819] 0 2024-02-28T16:26:18.954 INFO:tasks.workunit.client.0.smithi148.stdout:0/52: readlink l0 0 2024-02-28T16:26:18.956 INFO:tasks.workunit.client.0.smithi148.stdout:0/53: write d1/ff [1721795,33837] 0 2024-02-28T16:26:18.959 INFO:tasks.workunit.client.0.smithi148.stdout:0/54: unlink d1/d4/f5 0 2024-02-28T16:26:18.961 INFO:tasks.workunit.client.0.smithi148.stdout:0/55: mknod d1/d11/c14 0 2024-02-28T16:26:18.965 INFO:tasks.workunit.client.0.smithi148.stdout:3/64: dread d1/f8 [0,4194304] 0 2024-02-28T16:26:18.967 INFO:tasks.workunit.client.0.smithi148.stdout:3/65: fdatasync d1/f9 0 2024-02-28T16:26:18.980 INFO:tasks.workunit.client.0.smithi148.stdout:0/56: dread d1/ff [0,4194304] 0 2024-02-28T16:26:19.005 INFO:tasks.workunit.client.0.smithi148.stdout:3/66: symlink d1/l12 0 2024-02-28T16:26:19.006 INFO:tasks.workunit.client.0.smithi148.stdout:3/67: chown d1/f9 926676063 1 2024-02-28T16:26:19.011 INFO:tasks.workunit.client.0.smithi148.stdout:0/57: rename d1/d11 to d1/d15 0 2024-02-28T16:26:19.014 INFO:tasks.workunit.client.0.smithi148.stdout:0/58: creat d1/d4/f16 x:0 0 0 2024-02-28T16:26:19.022 INFO:tasks.workunit.client.0.smithi148.stdout:0/59: rename d1/ca to d1/d4/c17 0 2024-02-28T16:26:19.050 INFO:tasks.workunit.client.0.smithi148.stdout:3/68: truncate d1/f8 646711 0 2024-02-28T16:26:19.054 INFO:tasks.workunit.client.0.smithi148.stdout:0/60: getdents d1/d4 0 2024-02-28T16:26:19.057 INFO:tasks.workunit.client.0.smithi148.stdout:0/61: mknod d1/d15/d8/c18 0 2024-02-28T16:26:19.059 INFO:tasks.workunit.client.0.smithi148.stdout:0/62: creat d1/f19 x:0 0 0 2024-02-28T16:26:19.063 INFO:tasks.workunit.client.0.smithi148.stdout:0/63: symlink d1/d4/l1a 0 2024-02-28T16:26:19.064 INFO:tasks.workunit.client.0.smithi148.stdout:0/64: stat d1/d15/d8/c12 0 2024-02-28T16:26:19.066 INFO:tasks.workunit.client.0.smithi148.stdout:0/65: write d1/f6 [7903352,9256] 0 2024-02-28T16:26:19.070 INFO:tasks.workunit.client.0.smithi148.stdout:0/66: symlink d1/d15/l1b 0 2024-02-28T16:26:19.074 INFO:tasks.workunit.client.0.smithi148.stdout:3/69: write d1/f8 [967421,62719] 0 2024-02-28T16:26:19.078 INFO:tasks.workunit.client.0.smithi148.stdout:0/67: dread d1/ff [0,4194304] 0 2024-02-28T16:26:19.081 INFO:tasks.workunit.client.0.smithi148.stdout:0/68: creat d1/d15/f1c x:0 0 0 2024-02-28T16:26:19.082 INFO:tasks.workunit.client.0.smithi148.stdout:0/69: chown d1/d15/d8 13 1 2024-02-28T16:26:19.091 INFO:tasks.workunit.client.0.smithi148.stdout:3/70: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:26:19.095 INFO:tasks.workunit.client.0.smithi148.stdout:3/71: mkdir d1/d13 0 2024-02-28T16:26:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:19 smithi157 ceph-mon[38346]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 206 op/s 2024-02-28T16:26:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:19 smithi148 ceph-mon[28767]: pgmap v34: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 3.0 MiB/s wr, 206 op/s 2024-02-28T16:26:22.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:21 smithi157 ceph-mon[38346]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 99 op/s 2024-02-28T16:26:22.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:21 smithi148 ceph-mon[28767]: pgmap v35: 65 pgs: 65 active+clean; 194 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1.8 MiB/s wr, 99 op/s 2024-02-28T16:26:24.181 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:23 smithi148 ceph-mon[28767]: pgmap v36: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 8.9 MiB/s wr, 148 op/s 2024-02-28T16:26:24.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:23 smithi157 ceph-mon[38346]: pgmap v36: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 8.9 MiB/s wr, 148 op/s 2024-02-28T16:26:26.023 INFO:tasks.workunit.client.0.smithi148.stdout:2/0: sync 2024-02-28T16:26:26.031 INFO:tasks.workunit.client.0.smithi148.stdout:2/1: mkdir d0 0 2024-02-28T16:26:26.031 INFO:tasks.workunit.client.0.smithi148.stdout:2/2: dwrite - no filename 2024-02-28T16:26:26.032 INFO:tasks.workunit.client.0.smithi148.stdout:2/3: rename d0 to d0/d1 22 2024-02-28T16:26:26.032 INFO:tasks.workunit.client.0.smithi148.stdout:2/4: truncate - no filename 2024-02-28T16:26:26.039 INFO:tasks.workunit.client.0.smithi148.stdout:2/5: creat d0/f2 x:0 0 0 2024-02-28T16:26:26.043 INFO:tasks.workunit.client.0.smithi148.stdout:2/6: write d0/f2 [828017,97355] 0 2024-02-28T16:26:26.045 INFO:tasks.workunit.client.0.smithi148.stdout:2/7: chown d0 1 1 2024-02-28T16:26:26.051 INFO:tasks.workunit.client.0.smithi148.stdout:2/8: mknod d0/c3 0 2024-02-28T16:26:26.053 INFO:tasks.workunit.client.0.smithi148.stdout:2/9: stat d0/f2 0 2024-02-28T16:26:26.058 INFO:tasks.workunit.client.0.smithi148.stdout:2/10: read d0/f2 [142504,105815] 0 2024-02-28T16:26:26.065 INFO:tasks.workunit.client.0.smithi148.stdout:2/11: write d0/f2 [1242697,123464] 0 2024-02-28T16:26:26.073 INFO:tasks.workunit.client.0.smithi148.stdout:2/12: symlink d0/l4 0 2024-02-28T16:26:26.077 INFO:tasks.workunit.client.0.smithi148.stdout:2/13: write d0/f2 [2135799,63315] 0 2024-02-28T16:26:26.083 INFO:tasks.workunit.client.0.smithi148.stdout:2/14: mknod d0/c5 0 2024-02-28T16:26:26.115 INFO:tasks.workunit.client.0.smithi148.stdout:2/15: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:26.120 INFO:tasks.workunit.client.0.smithi148.stdout:2/16: write d0/f2 [2364942,49860] 0 2024-02-28T16:26:26.139 INFO:tasks.workunit.client.0.smithi148.stdout:8/3: sync 2024-02-28T16:26:26.139 INFO:tasks.workunit.client.0.smithi148.stdout:8/4: dread - no filename 2024-02-28T16:26:26.140 INFO:tasks.workunit.client.0.smithi148.stdout:8/5: chown . 446 1 2024-02-28T16:26:26.147 INFO:tasks.workunit.client.0.smithi148.stdout:8/6: creat f0 x:0 0 0 2024-02-28T16:26:26.151 INFO:tasks.workunit.client.0.smithi148.stdout:8/7: unlink f0 0 2024-02-28T16:26:26.151 INFO:tasks.workunit.client.0.smithi148.stdout:8/8: write - no filename 2024-02-28T16:26:26.155 INFO:tasks.workunit.client.0.smithi148.stdout:8/9: mkdir d1 0 2024-02-28T16:26:26.161 INFO:tasks.workunit.client.0.smithi148.stdout:8/10: mknod d1/c2 0 2024-02-28T16:26:26.164 INFO:tasks.workunit.client.0.smithi148.stdout:8/11: chown d1/c2 87 1 2024-02-28T16:26:26.167 INFO:tasks.workunit.client.0.smithi148.stdout:8/12: mkdir d1/d3 0 2024-02-28T16:26:26.167 INFO:tasks.workunit.client.0.smithi148.stdout:8/13: read - no filename 2024-02-28T16:26:26.168 INFO:tasks.workunit.client.0.smithi148.stdout:8/14: dread - no filename 2024-02-28T16:26:26.168 INFO:tasks.workunit.client.0.smithi148.stdout:8/15: chown d1 148 1 2024-02-28T16:26:26.171 INFO:tasks.workunit.client.0.smithi148.stdout:8/16: creat d1/d3/f4 x:0 0 0 2024-02-28T16:26:26.172 INFO:tasks.workunit.client.0.smithi148.stdout:8/17: stat d1/d3 0 2024-02-28T16:26:26.173 INFO:tasks.workunit.client.0.smithi148.stdout:8/18: write d1/d3/f4 [812577,14694] 0 2024-02-28T16:26:26.176 INFO:tasks.workunit.client.0.smithi148.stdout:2/17: fdatasync d0/f2 0 2024-02-28T16:26:26.188 INFO:tasks.workunit.client.0.smithi148.stdout:8/19: getdents d1 0 2024-02-28T16:26:26.191 INFO:tasks.workunit.client.0.smithi148.stdout:8/20: unlink d1/c2 0 2024-02-28T16:26:26.193 INFO:tasks.workunit.client.0.smithi148.stdout:2/18: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:26.195 INFO:tasks.workunit.client.0.smithi148.stdout:8/21: creat d1/d3/f5 x:0 0 0 2024-02-28T16:26:26.195 INFO:tasks.workunit.client.0.smithi148.stdout:2/19: chown d0/l4 12 1 2024-02-28T16:26:26.197 INFO:tasks.workunit.client.0.smithi148.stdout:8/22: write d1/d3/f5 [581005,30077] 0 2024-02-28T16:26:26.201 INFO:tasks.workunit.client.0.smithi148.stdout:2/20: rename d0/f2 to d0/f6 0 2024-02-28T16:26:26.203 INFO:tasks.workunit.client.0.smithi148.stdout:8/23: mknod d1/c6 0 2024-02-28T16:26:26.205 INFO:tasks.workunit.client.0.smithi148.stdout:2/21: mknod d0/c7 0 2024-02-28T16:26:26.206 INFO:tasks.workunit.client.0.smithi148.stdout:8/24: creat d1/f7 x:0 0 0 2024-02-28T16:26:26.210 INFO:tasks.workunit.client.0.smithi148.stdout:8/25: mknod d1/c8 0 2024-02-28T16:26:26.212 INFO:tasks.workunit.client.0.smithi148.stdout:8/26: creat d1/f9 x:0 0 0 2024-02-28T16:26:26.216 INFO:tasks.workunit.client.0.smithi148.stdout:2/22: dread d0/f6 [0,4194304] 0 2024-02-28T16:26:26.224 INFO:tasks.workunit.client.0.smithi148.stdout:8/27: fsync d1/f9 0 2024-02-28T16:26:26.225 INFO:tasks.workunit.client.0.smithi148.stdout:8/28: dread - d1/f9 zero size 2024-02-28T16:26:26.228 INFO:tasks.workunit.client.0.smithi148.stdout:8/29: creat d1/d3/fa x:0 0 0 2024-02-28T16:26:26.231 INFO:tasks.workunit.client.0.smithi148.stdout:8/30: write d1/d3/f5 [1493902,44423] 0 2024-02-28T16:26:26.235 INFO:tasks.workunit.client.0.smithi148.stdout:8/31: dread - d1/f7 zero size 2024-02-28T16:26:26.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:25 smithi157 ceph-mon[38346]: pgmap v37: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 8.0 MiB/s wr, 94 op/s 2024-02-28T16:26:26.237 INFO:tasks.workunit.client.0.smithi148.stdout:8/32: mknod d1/d3/cb 0 2024-02-28T16:26:26.238 INFO:tasks.workunit.client.0.smithi148.stdout:8/33: readlink - no filename 2024-02-28T16:26:26.238 INFO:tasks.workunit.client.0.smithi148.stdout:2/23: dwrite d0/f6 [4194304,4194304] 0 2024-02-28T16:26:26.239 INFO:tasks.workunit.client.0.smithi148.stdout:8/34: dread - d1/d3/fa zero size 2024-02-28T16:26:26.241 INFO:tasks.workunit.client.0.smithi148.stdout:2/24: creat d0/f8 x:0 0 0 2024-02-28T16:26:26.244 INFO:tasks.workunit.client.0.smithi148.stdout:2/25: mkdir d0/d9 0 2024-02-28T16:26:26.244 INFO:tasks.workunit.client.0.smithi148.stdout:8/35: link d1/d3/cb d1/d3/cc 0 2024-02-28T16:26:26.246 INFO:tasks.workunit.client.0.smithi148.stdout:2/26: write d0/f8 [984535,104346] 0 2024-02-28T16:26:26.246 INFO:tasks.workunit.client.0.smithi148.stdout:8/36: truncate d1/f7 827655 0 2024-02-28T16:26:26.249 INFO:tasks.workunit.client.0.smithi148.stdout:2/27: unlink d0/c7 0 2024-02-28T16:26:26.254 INFO:tasks.workunit.client.0.smithi148.stdout:2/28: rename d0/f6 to d0/d9/fa 0 2024-02-28T16:26:26.255 INFO:tasks.workunit.client.0.smithi148.stdout:2/29: chown d0/f8 901 1 2024-02-28T16:26:26.256 INFO:tasks.workunit.client.0.smithi148.stdout:2/30: symlink d0/lb 0 2024-02-28T16:26:26.257 INFO:tasks.workunit.client.0.smithi148.stdout:8/37: dread d1/d3/f4 [0,4194304] 0 2024-02-28T16:26:26.257 INFO:tasks.workunit.client.0.smithi148.stdout:2/31: chown d0/d9 265564879 1 2024-02-28T16:26:26.260 INFO:tasks.workunit.client.0.smithi148.stdout:2/32: symlink d0/lc 0 2024-02-28T16:26:26.283 INFO:tasks.workunit.client.0.smithi148.stdout:8/38: dwrite d1/d3/f5 [0,4194304] 0 2024-02-28T16:26:26.285 INFO:tasks.workunit.client.0.smithi148.stdout:8/39: write d1/d3/f5 [2876561,86580] 0 2024-02-28T16:26:26.287 INFO:tasks.workunit.client.0.smithi148.stdout:8/40: stat d1/f7 0 2024-02-28T16:26:26.289 INFO:tasks.workunit.client.0.smithi148.stdout:2/33: truncate d0/f8 181497 0 2024-02-28T16:26:26.293 INFO:tasks.workunit.client.0.smithi148.stdout:8/41: write d1/d3/f5 [5141864,37075] 0 2024-02-28T16:26:26.295 INFO:tasks.workunit.client.0.smithi148.stdout:8/42: mkdir d1/dd 0 2024-02-28T16:26:26.298 INFO:tasks.workunit.client.0.smithi148.stdout:8/43: mkdir d1/de 0 2024-02-28T16:26:26.298 INFO:tasks.workunit.client.0.smithi148.stdout:8/44: dread - d1/d3/fa zero size 2024-02-28T16:26:26.299 INFO:tasks.workunit.client.0.smithi148.stdout:9/3: sync 2024-02-28T16:26:26.300 INFO:tasks.workunit.client.0.smithi148.stdout:9/4: readlink - no filename 2024-02-28T16:26:26.301 INFO:tasks.workunit.client.0.smithi148.stdout:9/5: chown f0 1522 1 2024-02-28T16:26:26.303 INFO:tasks.workunit.client.0.smithi148.stdout:9/6: creat f1 x:0 0 0 2024-02-28T16:26:26.304 INFO:tasks.workunit.client.0.smithi148.stdout:9/7: dread - f1 zero size 2024-02-28T16:26:26.306 INFO:tasks.workunit.client.0.smithi148.stdout:9/8: rename f1 to f2 0 2024-02-28T16:26:26.308 INFO:tasks.workunit.client.0.smithi148.stdout:9/9: creat f3 x:0 0 0 2024-02-28T16:26:26.310 INFO:tasks.workunit.client.0.smithi148.stdout:9/10: dread - f0 zero size 2024-02-28T16:26:26.311 INFO:tasks.workunit.client.0.smithi148.stdout:8/45: rmdir d1 39 2024-02-28T16:26:26.312 INFO:tasks.workunit.client.0.smithi148.stdout:9/11: unlink f0 0 2024-02-28T16:26:26.315 INFO:tasks.workunit.client.0.smithi148.stdout:8/46: write d1/f7 [1237953,98316] 0 2024-02-28T16:26:26.315 INFO:tasks.workunit.client.0.smithi148.stdout:9/12: symlink l4 0 2024-02-28T16:26:26.319 INFO:tasks.workunit.client.0.smithi148.stdout:9/13: write f2 [748756,27149] 0 2024-02-28T16:26:26.320 INFO:tasks.workunit.client.0.smithi148.stdout:8/47: creat d1/de/ff x:0 0 0 2024-02-28T16:26:26.322 INFO:tasks.workunit.client.0.smithi148.stdout:9/14: mknod c5 0 2024-02-28T16:26:26.324 INFO:tasks.workunit.client.0.smithi148.stdout:9/15: mknod c6 0 2024-02-28T16:26:26.324 INFO:tasks.workunit.client.0.smithi148.stdout:8/48: creat d1/dd/f10 x:0 0 0 2024-02-28T16:26:26.325 INFO:tasks.workunit.client.0.smithi148.stdout:9/16: mkdir d7 0 2024-02-28T16:26:26.329 INFO:tasks.workunit.client.0.smithi148.stdout:9/17: symlink d7/l8 0 2024-02-28T16:26:26.337 INFO:tasks.workunit.client.0.smithi148.stdout:9/18: dread f2 [0,4194304] 0 2024-02-28T16:26:26.351 INFO:tasks.workunit.client.0.smithi148.stdout:8/49: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:26:26.352 INFO:tasks.workunit.client.0.smithi148.stdout:8/50: stat d1/f7 0 2024-02-28T16:26:26.356 INFO:tasks.workunit.client.0.smithi148.stdout:9/19: truncate f2 293356 0 2024-02-28T16:26:26.357 INFO:tasks.workunit.client.0.smithi148.stdout:8/51: dread d1/d3/f4 [0,4194304] 0 2024-02-28T16:26:26.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:25 smithi148 ceph-mon[28767]: pgmap v37: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 8.0 MiB/s wr, 94 op/s 2024-02-28T16:26:26.383 INFO:tasks.workunit.client.0.smithi148.stdout:8/52: dwrite d1/dd/f10 [0,4194304] 0 2024-02-28T16:26:26.386 INFO:tasks.workunit.client.0.smithi148.stdout:8/53: chown d1/c8 9762745 1 2024-02-28T16:26:26.386 INFO:tasks.workunit.client.0.smithi148.stdout:8/54: readlink - no filename 2024-02-28T16:26:26.387 INFO:tasks.workunit.client.0.smithi148.stdout:9/20: dwrite f2 [0,4194304] 0 2024-02-28T16:26:26.391 INFO:tasks.workunit.client.0.smithi148.stdout:9/21: symlink d7/l9 0 2024-02-28T16:26:26.394 INFO:tasks.workunit.client.0.smithi148.stdout:8/55: link d1/d3/cc d1/d3/c11 0 2024-02-28T16:26:26.395 INFO:tasks.workunit.client.0.smithi148.stdout:8/56: dread - d1/f9 zero size 2024-02-28T16:26:26.397 INFO:tasks.workunit.client.0.smithi148.stdout:9/22: link c6 d7/ca 0 2024-02-28T16:26:26.399 INFO:tasks.workunit.client.0.smithi148.stdout:9/23: creat d7/fb x:0 0 0 2024-02-28T16:26:26.409 INFO:tasks.workunit.client.0.smithi148.stdout:8/57: dread d1/d3/f5 [0,4194304] 0 2024-02-28T16:26:26.412 INFO:tasks.workunit.client.0.smithi148.stdout:8/58: write d1/d3/f4 [636309,17912] 0 2024-02-28T16:26:26.414 INFO:tasks.workunit.client.0.smithi148.stdout:8/59: chown d1/c6 367830636 1 2024-02-28T16:26:26.416 INFO:tasks.workunit.client.0.smithi148.stdout:8/60: mkdir d1/d12 0 2024-02-28T16:26:26.419 INFO:tasks.workunit.client.0.smithi148.stdout:9/24: fsync f2 0 2024-02-28T16:26:26.420 INFO:tasks.workunit.client.0.smithi148.stdout:9/25: truncate f3 622669 0 2024-02-28T16:26:26.421 INFO:tasks.workunit.client.0.smithi148.stdout:9/26: readlink l4 0 2024-02-28T16:26:26.422 INFO:tasks.workunit.client.0.smithi148.stdout:9/27: chown c5 13 1 2024-02-28T16:26:26.439 INFO:tasks.workunit.client.0.smithi148.stdout:8/61: dwrite d1/de/ff [0,4194304] 0 2024-02-28T16:26:26.445 INFO:tasks.workunit.client.0.smithi148.stdout:8/62: rmdir d1/d12 0 2024-02-28T16:26:26.445 INFO:tasks.workunit.client.0.smithi148.stdout:9/28: dwrite d7/fb [0,4194304] 0 2024-02-28T16:26:26.448 INFO:tasks.workunit.client.0.smithi148.stdout:8/63: dread - d1/d3/fa zero size 2024-02-28T16:26:26.449 INFO:tasks.workunit.client.0.smithi148.stdout:9/29: creat d7/fc x:0 0 0 2024-02-28T16:26:26.451 INFO:tasks.workunit.client.0.smithi148.stdout:8/64: mkdir d1/dd/d13 0 2024-02-28T16:26:26.453 INFO:tasks.workunit.client.0.smithi148.stdout:9/30: mkdir d7/dd 0 2024-02-28T16:26:26.454 INFO:tasks.workunit.client.0.smithi148.stdout:8/65: fsync d1/d3/f5 0 2024-02-28T16:26:26.457 INFO:tasks.workunit.client.0.smithi148.stdout:8/66: rename d1 to d1/dd/d14 22 2024-02-28T16:26:26.473 INFO:tasks.workunit.client.0.smithi148.stdout:9/31: dwrite d7/fb [0,4194304] 0 2024-02-28T16:26:26.476 INFO:tasks.workunit.client.0.smithi148.stdout:9/32: creat d7/dd/fe x:0 0 0 2024-02-28T16:26:26.478 INFO:tasks.workunit.client.0.smithi148.stdout:9/33: symlink d7/dd/lf 0 2024-02-28T16:26:26.480 INFO:tasks.workunit.client.0.smithi148.stdout:9/34: write f3 [728933,102155] 0 2024-02-28T16:26:26.481 INFO:tasks.workunit.client.0.smithi148.stdout:5/11: sync 2024-02-28T16:26:26.481 INFO:tasks.workunit.client.0.smithi148.stdout:7/24: sync 2024-02-28T16:26:26.481 INFO:tasks.workunit.client.0.smithi148.stdout:6/15: sync 2024-02-28T16:26:26.481 INFO:tasks.workunit.client.0.smithi148.stdout:3/72: sync 2024-02-28T16:26:26.482 INFO:tasks.workunit.client.0.smithi148.stdout:0/70: sync 2024-02-28T16:26:26.482 INFO:tasks.workunit.client.0.smithi148.stdout:1/33: sync 2024-02-28T16:26:26.482 INFO:tasks.workunit.client.0.smithi148.stdout:4/16: sync 2024-02-28T16:26:26.483 INFO:tasks.workunit.client.0.smithi148.stdout:7/25: chown d0/d4 7690742 1 2024-02-28T16:26:26.483 INFO:tasks.workunit.client.0.smithi148.stdout:9/35: write d7/fb [1801550,108497] 0 2024-02-28T16:26:26.484 INFO:tasks.workunit.client.0.smithi148.stdout:0/71: chown d1/d4/l1a 2025 1 2024-02-28T16:26:26.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/72: chown d1/d15 57681 1 2024-02-28T16:26:26.486 INFO:tasks.workunit.client.0.smithi148.stdout:3/73: read - d1/fd zero size 2024-02-28T16:26:26.487 INFO:tasks.workunit.client.0.smithi148.stdout:6/16: symlink d0/d4/l7 0 2024-02-28T16:26:26.488 INFO:tasks.workunit.client.0.smithi148.stdout:7/26: rmdir d0 39 2024-02-28T16:26:26.490 INFO:tasks.workunit.client.0.smithi148.stdout:9/36: mknod d7/c10 0 2024-02-28T16:26:26.492 INFO:tasks.workunit.client.0.smithi148.stdout:1/34: dread - d2/d5/d6/d8/f9 zero size 2024-02-28T16:26:26.493 INFO:tasks.workunit.client.0.smithi148.stdout:0/73: creat d1/d15/d8/f1d x:0 0 0 2024-02-28T16:26:26.494 INFO:tasks.workunit.client.0.smithi148.stdout:3/74: mknod d1/c14 0 2024-02-28T16:26:26.496 INFO:tasks.workunit.client.0.smithi148.stdout:9/37: mknod d7/c11 0 2024-02-28T16:26:26.497 INFO:tasks.workunit.client.0.smithi148.stdout:9/38: chown d7 745507 1 2024-02-28T16:26:26.498 INFO:tasks.workunit.client.0.smithi148.stdout:6/17: write d0/f2 [1532290,112208] 0 2024-02-28T16:26:26.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/75: rename d1/f6 to d1/d13/f15 0 2024-02-28T16:26:26.501 INFO:tasks.workunit.client.0.smithi148.stdout:9/39: dread - d7/dd/fe zero size 2024-02-28T16:26:26.501 INFO:tasks.workunit.client.0.smithi148.stdout:3/76: readlink l0 0 2024-02-28T16:26:26.502 INFO:tasks.workunit.client.0.smithi148.stdout:0/74: truncate d1/ff 2332689 0 2024-02-28T16:26:26.502 INFO:tasks.workunit.client.0.smithi148.stdout:1/35: truncate f0 2866233 0 2024-02-28T16:26:26.503 INFO:tasks.workunit.client.0.smithi148.stdout:4/17: dread f2 [4194304,4194304] 0 2024-02-28T16:26:26.504 INFO:tasks.workunit.client.0.smithi148.stdout:6/18: mkdir d0/d8 0 2024-02-28T16:26:26.506 INFO:tasks.workunit.client.0.smithi148.stdout:3/77: chown d1/cc 771 1 2024-02-28T16:26:26.507 INFO:tasks.workunit.client.0.smithi148.stdout:7/27: mknod d0/d4/c6 0 2024-02-28T16:26:26.514 INFO:tasks.workunit.client.0.smithi148.stdout:7/28: creat d0/f7 x:0 0 0 2024-02-28T16:26:26.515 INFO:tasks.workunit.client.0.smithi148.stdout:1/36: creat d2/d5/d6/d7/fc x:0 0 0 2024-02-28T16:26:26.517 INFO:tasks.workunit.client.0.smithi148.stdout:6/19: creat d0/d4/d5/f9 x:0 0 0 2024-02-28T16:26:26.520 INFO:tasks.workunit.client.0.smithi148.stdout:7/29: read d0/f1 [450969,100926] 0 2024-02-28T16:26:26.524 INFO:tasks.workunit.client.0.smithi148.stdout:6/20: unlink d0/l1 0 2024-02-28T16:26:26.525 INFO:tasks.workunit.client.0.smithi148.stdout:9/40: dwrite d7/fc [0,4194304] 0 2024-02-28T16:26:26.525 INFO:tasks.workunit.client.0.smithi148.stdout:0/75: dread d1/d4/fe [0,4194304] 0 2024-02-28T16:26:26.528 INFO:tasks.workunit.client.0.smithi148.stdout:7/30: symlink d0/d4/l8 0 2024-02-28T16:26:26.529 INFO:tasks.workunit.client.0.smithi148.stdout:7/31: readlink d0/d4/l8 0 2024-02-28T16:26:26.530 INFO:tasks.workunit.client.0.smithi148.stdout:6/21: creat d0/d4/fa x:0 0 0 2024-02-28T16:26:26.532 INFO:tasks.workunit.client.0.smithi148.stdout:6/22: write d0/f2 [246413,69054] 0 2024-02-28T16:26:26.533 INFO:tasks.workunit.client.0.smithi148.stdout:3/78: stat d1/d13/f15 0 2024-02-28T16:26:26.534 INFO:tasks.workunit.client.0.smithi148.stdout:0/76: read d1/f6 [3379648,106739] 0 2024-02-28T16:26:26.544 INFO:tasks.workunit.client.0.smithi148.stdout:0/77: truncate d1/d4/f16 508700 0 2024-02-28T16:26:26.548 INFO:tasks.workunit.client.0.smithi148.stdout:6/23: rmdir d0/d4/d5 39 2024-02-28T16:26:26.551 INFO:tasks.workunit.client.0.smithi148.stdout:0/78: symlink d1/d15/l1e 0 2024-02-28T16:26:26.554 INFO:tasks.workunit.client.0.smithi148.stdout:9/41: dwrite d7/fc [0,4194304] 0 2024-02-28T16:26:26.556 INFO:tasks.workunit.client.0.smithi148.stdout:0/79: mknod d1/c1f 0 2024-02-28T16:26:26.556 INFO:tasks.workunit.client.0.smithi148.stdout:7/32: write d0/f2 [2660319,82168] 0 2024-02-28T16:26:26.563 INFO:tasks.workunit.client.0.smithi148.stdout:6/24: truncate d0/d4/d5/f9 360933 0 2024-02-28T16:26:26.565 INFO:tasks.workunit.client.0.smithi148.stdout:7/33: mkdir d0/d9 0 2024-02-28T16:26:26.568 INFO:tasks.workunit.client.0.smithi148.stdout:9/42: mkdir d7/d12 0 2024-02-28T16:26:26.570 INFO:tasks.workunit.client.0.smithi148.stdout:4/18: dwrite f1 [0,4194304] 0 2024-02-28T16:26:26.571 INFO:tasks.workunit.client.0.smithi148.stdout:4/19: rmdir - no directory 2024-02-28T16:26:26.572 INFO:tasks.workunit.client.0.smithi148.stdout:0/80: write d1/f6 [7060280,41379] 0 2024-02-28T16:26:26.574 INFO:tasks.workunit.client.0.smithi148.stdout:7/34: chown d0/d9 3 1 2024-02-28T16:26:26.575 INFO:tasks.workunit.client.0.smithi148.stdout:6/25: mkdir d0/d4/db 0 2024-02-28T16:26:26.576 INFO:tasks.workunit.client.0.smithi148.stdout:4/20: mknod c5 0 2024-02-28T16:26:26.578 INFO:tasks.workunit.client.0.smithi148.stdout:9/43: chown d7/dd/fe 1033107043 1 2024-02-28T16:26:26.582 INFO:tasks.workunit.client.0.smithi148.stdout:3/79: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:26:26.584 INFO:tasks.workunit.client.0.smithi148.stdout:9/44: write f2 [1622304,114899] 0 2024-02-28T16:26:26.585 INFO:tasks.workunit.client.0.smithi148.stdout:1/37: dwrite d2/d5/d6/d8/f9 [0,4194304] 0 2024-02-28T16:26:26.586 INFO:tasks.workunit.client.0.smithi148.stdout:3/80: chown d1/d13 175373 1 2024-02-28T16:26:26.588 INFO:tasks.workunit.client.0.smithi148.stdout:6/26: chown d0/d4/l7 5 1 2024-02-28T16:26:26.589 INFO:tasks.workunit.client.0.smithi148.stdout:0/81: creat d1/d15/d8/f20 x:0 0 0 2024-02-28T16:26:26.592 INFO:tasks.workunit.client.0.smithi148.stdout:6/27: write d0/d4/fa [51592,16704] 0 2024-02-28T16:26:26.596 INFO:tasks.workunit.client.0.smithi148.stdout:1/38: mknod d2/d5/d6/cd 0 2024-02-28T16:26:26.598 INFO:tasks.workunit.client.0.smithi148.stdout:7/35: link d0/f7 d0/d4/fa 0 2024-02-28T16:26:26.600 INFO:tasks.workunit.client.0.smithi148.stdout:9/45: mknod d7/d12/c13 0 2024-02-28T16:26:26.604 INFO:tasks.workunit.client.0.smithi148.stdout:0/82: symlink d1/d15/l21 0 2024-02-28T16:26:26.607 INFO:tasks.workunit.client.0.smithi148.stdout:7/36: chown d0/d4/c6 142927 1 2024-02-28T16:26:26.609 INFO:tasks.workunit.client.0.smithi148.stdout:9/46: creat d7/f14 x:0 0 0 2024-02-28T16:26:26.610 INFO:tasks.workunit.client.0.smithi148.stdout:0/83: creat d1/f22 x:0 0 0 2024-02-28T16:26:26.611 INFO:tasks.workunit.client.0.smithi148.stdout:9/47: write f2 [1632186,2243] 0 2024-02-28T16:26:26.613 INFO:tasks.workunit.client.0.smithi148.stdout:0/84: read - d1/f22 zero size 2024-02-28T16:26:26.615 INFO:tasks.workunit.client.0.smithi148.stdout:6/28: link d0/f2 d0/d8/fc 0 2024-02-28T16:26:26.620 INFO:tasks.workunit.client.0.smithi148.stdout:3/81: getdents d1/d13 0 2024-02-28T16:26:26.620 INFO:tasks.workunit.client.0.smithi148.stdout:0/85: write d1/f6 [8802210,45771] 0 2024-02-28T16:26:26.626 INFO:tasks.workunit.client.0.smithi148.stdout:4/21: dwrite f0 [4194304,4194304] 0 2024-02-28T16:26:26.629 INFO:tasks.workunit.client.0.smithi148.stdout:3/82: creat d1/d13/f16 x:0 0 0 2024-02-28T16:26:26.630 INFO:tasks.workunit.client.0.smithi148.stdout:0/86: creat d1/d15/d8/f23 x:0 0 0 2024-02-28T16:26:26.641 INFO:tasks.workunit.client.0.smithi148.stdout:0/87: creat d1/f24 x:0 0 0 2024-02-28T16:26:26.642 INFO:tasks.workunit.client.0.smithi148.stdout:1/39: dwrite d2/d5/d6/d7/fc [0,4194304] 0 2024-02-28T16:26:26.649 INFO:tasks.workunit.client.0.smithi148.stdout:7/37: fsync d0/f7 0 2024-02-28T16:26:26.651 INFO:tasks.workunit.client.0.smithi148.stdout:0/88: truncate d1/d15/d8/f20 970351 0 2024-02-28T16:26:26.658 INFO:tasks.workunit.client.0.smithi148.stdout:7/38: mknod d0/cb 0 2024-02-28T16:26:26.658 INFO:tasks.workunit.client.0.smithi148.stdout:0/89: chown d1/d15/l1e 0 1 2024-02-28T16:26:26.661 INFO:tasks.workunit.client.0.smithi148.stdout:6/29: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:26.661 INFO:tasks.workunit.client.0.smithi148.stdout:7/39: stat d0/f1 0 2024-02-28T16:26:26.661 INFO:tasks.workunit.client.0.smithi148.stdout:4/22: dread f0 [0,4194304] 0 2024-02-28T16:26:26.664 INFO:tasks.workunit.client.0.smithi148.stdout:4/23: read f1 [3806302,81368] 0 2024-02-28T16:26:26.667 INFO:tasks.workunit.client.0.smithi148.stdout:1/40: truncate f0 1579750 0 2024-02-28T16:26:26.670 INFO:tasks.workunit.client.0.smithi148.stdout:3/83: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:26.681 INFO:tasks.workunit.client.0.smithi148.stdout:6/30: dread d0/f2 [0,4194304] 0 2024-02-28T16:26:26.683 INFO:tasks.workunit.client.0.smithi148.stdout:2/34: sync 2024-02-28T16:26:26.684 INFO:tasks.workunit.client.0.smithi148.stdout:2/35: readlink d0/lc 0 2024-02-28T16:26:26.687 INFO:tasks.workunit.client.0.smithi148.stdout:1/41: creat d2/d5/d6/fe x:0 0 0 2024-02-28T16:26:26.690 INFO:tasks.workunit.client.0.smithi148.stdout:3/84: fsync d1/d13/f15 0 2024-02-28T16:26:26.692 INFO:tasks.workunit.client.0.smithi148.stdout:7/40: creat d0/d9/fc x:0 0 0 2024-02-28T16:26:26.694 INFO:tasks.workunit.client.0.smithi148.stdout:6/31: fdatasync d0/f6 0 2024-02-28T16:26:26.698 INFO:tasks.workunit.client.0.smithi148.stdout:4/24: rename f1 to f6 0 2024-02-28T16:26:26.700 INFO:tasks.workunit.client.0.smithi148.stdout:1/42: creat d2/d5/ff x:0 0 0 2024-02-28T16:26:26.701 INFO:tasks.workunit.client.0.smithi148.stdout:1/43: readlink l1 0 2024-02-28T16:26:26.703 INFO:tasks.workunit.client.0.smithi148.stdout:3/85: creat d1/d13/f17 x:0 0 0 2024-02-28T16:26:26.705 INFO:tasks.workunit.client.0.smithi148.stdout:3/86: stat d1/db/c11 0 2024-02-28T16:26:26.712 INFO:tasks.workunit.client.0.smithi148.stdout:4/25: creat f7 x:0 0 0 2024-02-28T16:26:26.714 INFO:tasks.workunit.client.0.smithi148.stdout:4/26: truncate f7 379457 0 2024-02-28T16:26:26.717 INFO:tasks.workunit.client.0.smithi148.stdout:0/90: write d1/ff [1811755,8522] 0 2024-02-28T16:26:26.722 INFO:tasks.workunit.client.0.smithi148.stdout:7/41: dwrite d0/d9/fc [0,4194304] 0 2024-02-28T16:26:26.722 INFO:tasks.workunit.client.0.smithi148.stdout:0/91: fsync d1/ff 0 2024-02-28T16:26:26.724 INFO:tasks.workunit.client.0.smithi148.stdout:6/32: write d0/f6 [1558449,11348] 0 2024-02-28T16:26:26.724 INFO:tasks.workunit.client.0.smithi148.stdout:7/42: dread - d0/f7 zero size 2024-02-28T16:26:26.726 INFO:tasks.workunit.client.0.smithi148.stdout:6/33: chown d0/d4/l7 91 1 2024-02-28T16:26:26.728 INFO:tasks.workunit.client.0.smithi148.stdout:6/34: chown d0/d4/fa 990850269 1 2024-02-28T16:26:26.730 INFO:tasks.workunit.client.0.smithi148.stdout:0/92: mkdir d1/d4/d25 0 2024-02-28T16:26:26.730 INFO:tasks.workunit.client.0.smithi148.stdout:7/43: truncate d0/d4/fa 276948 0 2024-02-28T16:26:26.731 INFO:tasks.workunit.client.0.smithi148.stdout:7/44: chown d0/d4 29399838 1 2024-02-28T16:26:26.734 INFO:tasks.workunit.client.0.smithi148.stdout:0/93: mknod d1/d15/c26 0 2024-02-28T16:26:26.737 INFO:tasks.workunit.client.0.smithi148.stdout:6/35: write d0/d4/d5/f9 [833405,35914] 0 2024-02-28T16:26:26.737 INFO:tasks.workunit.client.0.smithi148.stdout:7/45: chown d0/f1 11 1 2024-02-28T16:26:26.743 INFO:tasks.workunit.client.0.smithi148.stdout:0/94: stat d1/d4/l1a 0 2024-02-28T16:26:26.744 INFO:tasks.workunit.client.0.smithi148.stdout:6/36: creat d0/fd x:0 0 0 2024-02-28T16:26:26.745 INFO:tasks.workunit.client.0.smithi148.stdout:7/46: symlink d0/ld 0 2024-02-28T16:26:26.748 INFO:tasks.workunit.client.0.smithi148.stdout:6/37: chown d0/d4 394 1 2024-02-28T16:26:26.751 INFO:tasks.workunit.client.0.smithi148.stdout:7/47: creat d0/d9/fe x:0 0 0 2024-02-28T16:26:26.755 INFO:tasks.workunit.client.0.smithi148.stdout:0/95: mkdir d1/d15/d27 0 2024-02-28T16:26:26.756 INFO:tasks.workunit.client.0.smithi148.stdout:6/38: write d0/f6 [517221,76950] 0 2024-02-28T16:26:26.756 INFO:tasks.workunit.client.0.smithi148.stdout:7/48: chown d0/d9 30920900 1 2024-02-28T16:26:26.756 INFO:tasks.workunit.client.0.smithi148.stdout:2/36: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:26:26.759 INFO:tasks.workunit.client.0.smithi148.stdout:6/39: chown d0/d4/d5 195286894 1 2024-02-28T16:26:26.762 INFO:tasks.workunit.client.0.smithi148.stdout:6/40: mknod d0/ce 0 2024-02-28T16:26:26.763 INFO:tasks.workunit.client.0.smithi148.stdout:4/27: dwrite f6 [0,4194304] 0 2024-02-28T16:26:26.764 INFO:tasks.workunit.client.0.smithi148.stdout:0/96: symlink d1/d15/d8/l28 0 2024-02-28T16:26:26.767 INFO:tasks.workunit.client.0.smithi148.stdout:4/28: read f7 [185175,37016] 0 2024-02-28T16:26:26.767 INFO:tasks.workunit.client.0.smithi148.stdout:2/37: mkdir d0/dd 0 2024-02-28T16:26:26.770 INFO:tasks.workunit.client.0.smithi148.stdout:0/97: read d1/f6 [6896845,94762] 0 2024-02-28T16:26:26.772 INFO:tasks.workunit.client.0.smithi148.stdout:6/41: link d0/fd d0/d8/ff 0 2024-02-28T16:26:26.775 INFO:tasks.workunit.client.0.smithi148.stdout:7/49: write d0/f1 [1714719,74504] 0 2024-02-28T16:26:26.777 INFO:tasks.workunit.client.0.smithi148.stdout:2/38: symlink d0/d9/le 0 2024-02-28T16:26:26.777 INFO:tasks.workunit.client.0.smithi148.stdout:7/50: chown d0 735 1 2024-02-28T16:26:26.785 INFO:tasks.workunit.client.0.smithi148.stdout:6/42: rmdir d0/d4/db 0 2024-02-28T16:26:26.791 INFO:tasks.workunit.client.0.smithi148.stdout:6/43: mkdir d0/d10 0 2024-02-28T16:26:26.798 INFO:tasks.workunit.client.0.smithi148.stdout:4/29: truncate f2 3712484 0 2024-02-28T16:26:26.799 INFO:tasks.workunit.client.0.smithi148.stdout:4/30: readlink l4 0 2024-02-28T16:26:26.800 INFO:tasks.workunit.client.0.smithi148.stdout:4/31: readlink l4 0 2024-02-28T16:26:26.805 INFO:tasks.workunit.client.0.smithi148.stdout:2/39: dread d0/d9/fa [4194304,4194304] 0 2024-02-28T16:26:26.806 INFO:tasks.workunit.client.0.smithi148.stdout:0/98: dwrite d1/d15/d8/f23 [0,4194304] 0 2024-02-28T16:26:26.806 INFO:tasks.workunit.client.0.smithi148.stdout:6/44: rename d0/fd to d0/d4/f11 0 2024-02-28T16:26:26.809 INFO:tasks.workunit.client.0.smithi148.stdout:2/40: write d0/f8 [2117205,84987] 0 2024-02-28T16:26:26.811 INFO:tasks.workunit.client.0.smithi148.stdout:7/51: dwrite d0/d9/fc [4194304,4194304] 0 2024-02-28T16:26:26.817 INFO:tasks.workunit.client.0.smithi148.stdout:6/45: write d0/f2 [1371602,129885] 0 2024-02-28T16:26:26.820 INFO:tasks.workunit.client.0.smithi148.stdout:6/46: chown d0/d4 1663653 1 2024-02-28T16:26:26.823 INFO:tasks.workunit.client.0.smithi148.stdout:2/41: rename d0/lb to d0/dd/lf 0 2024-02-28T16:26:26.835 INFO:tasks.workunit.client.0.smithi148.stdout:0/99: link d1/d4/f10 d1/d15/d8/f29 0 2024-02-28T16:26:26.837 INFO:tasks.workunit.client.0.smithi148.stdout:4/32: dread f0 [0,4194304] 0 2024-02-28T16:26:26.841 INFO:tasks.workunit.client.0.smithi148.stdout:0/100: creat d1/d15/f2a x:0 0 0 2024-02-28T16:26:26.843 INFO:tasks.workunit.client.0.smithi148.stdout:4/33: fsync f2 0 2024-02-28T16:26:26.843 INFO:tasks.workunit.client.0.smithi148.stdout:6/47: getdents d0/d4/d5 0 2024-02-28T16:26:26.847 INFO:tasks.workunit.client.0.smithi148.stdout:2/42: dread d0/f8 [0,4194304] 0 2024-02-28T16:26:26.847 INFO:tasks.workunit.client.0.smithi148.stdout:4/34: write f6 [329685,83759] 0 2024-02-28T16:26:26.849 INFO:tasks.workunit.client.0.smithi148.stdout:7/52: dwrite d0/f1 [0,4194304] 0 2024-02-28T16:26:26.849 INFO:tasks.workunit.client.0.smithi148.stdout:0/101: write d1/d15/d8/f20 [1920062,31506] 0 2024-02-28T16:26:26.851 INFO:tasks.workunit.client.0.smithi148.stdout:6/48: creat d0/d10/f12 x:0 0 0 2024-02-28T16:26:26.852 INFO:tasks.workunit.client.0.smithi148.stdout:4/35: write f0 [4593801,74831] 0 2024-02-28T16:26:26.856 INFO:tasks.workunit.client.0.smithi148.stdout:0/102: dread - d1/d15/d8/f1d zero size 2024-02-28T16:26:26.856 INFO:tasks.workunit.client.0.smithi148.stdout:4/36: chown f6 231804589 1 2024-02-28T16:26:26.856 INFO:tasks.workunit.client.0.smithi148.stdout:7/53: unlink d0/ld 0 2024-02-28T16:26:26.857 INFO:tasks.workunit.client.0.smithi148.stdout:4/37: write f0 [3913198,97548] 0 2024-02-28T16:26:26.857 INFO:tasks.workunit.client.0.smithi148.stdout:0/103: write d1/d15/d8/f20 [1222648,21476] 0 2024-02-28T16:26:26.864 INFO:tasks.workunit.client.0.smithi148.stdout:4/38: fsync f7 0 2024-02-28T16:26:26.865 INFO:tasks.workunit.client.0.smithi148.stdout:4/39: chown f2 106691343 1 2024-02-28T16:26:26.868 INFO:tasks.workunit.client.0.smithi148.stdout:0/104: mknod d1/d15/d27/c2b 0 2024-02-28T16:26:26.870 INFO:tasks.workunit.client.0.smithi148.stdout:4/40: mkdir d8 0 2024-02-28T16:26:26.872 INFO:tasks.workunit.client.0.smithi148.stdout:8/67: sync 2024-02-28T16:26:26.872 INFO:tasks.workunit.client.0.smithi148.stdout:0/105: dread - d1/d15/f1c zero size 2024-02-28T16:26:26.875 INFO:tasks.workunit.client.0.smithi148.stdout:8/68: chown d1/dd/d13 168104 1 2024-02-28T16:26:26.877 INFO:tasks.workunit.client.0.smithi148.stdout:4/41: write f2 [4428194,15589] 0 2024-02-28T16:26:26.879 INFO:tasks.workunit.client.0.smithi148.stdout:0/106: unlink d1/ff 0 2024-02-28T16:26:26.883 INFO:tasks.workunit.client.0.smithi148.stdout:8/69: mknod d1/d3/c15 0 2024-02-28T16:26:26.886 INFO:tasks.workunit.client.0.smithi148.stdout:4/42: symlink d8/l9 0 2024-02-28T16:26:26.887 INFO:tasks.workunit.client.0.smithi148.stdout:8/70: chown d1/dd 3814335 1 2024-02-28T16:26:26.898 INFO:tasks.workunit.client.0.smithi148.stdout:4/43: creat d8/fa x:0 0 0 2024-02-28T16:26:26.898 INFO:tasks.workunit.client.0.smithi148.stdout:2/43: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:26:26.903 INFO:tasks.workunit.client.0.smithi148.stdout:6/49: dwrite d0/d8/ff [0,4194304] 0 2024-02-28T16:26:26.911 INFO:tasks.workunit.client.0.smithi148.stdout:2/44: chown d0/d9/fa 5 1 2024-02-28T16:26:26.911 INFO:tasks.workunit.client.0.smithi148.stdout:4/44: truncate d8/fa 951172 0 2024-02-28T16:26:26.917 INFO:tasks.workunit.client.0.smithi148.stdout:7/54: dwrite d0/d4/fa [0,4194304] 0 2024-02-28T16:26:26.919 INFO:tasks.workunit.client.0.smithi148.stdout:6/50: creat d0/d10/f13 x:0 0 0 2024-02-28T16:26:26.921 INFO:tasks.workunit.client.0.smithi148.stdout:7/55: chown d0/cb 32505 1 2024-02-28T16:26:26.922 INFO:tasks.workunit.client.0.smithi148.stdout:4/45: write f2 [1472023,70426] 0 2024-02-28T16:26:26.927 INFO:tasks.workunit.client.0.smithi148.stdout:4/46: readlink d8/l9 0 2024-02-28T16:26:26.929 INFO:tasks.workunit.client.0.smithi148.stdout:7/56: write d0/f2 [175822,95414] 0 2024-02-28T16:26:26.932 INFO:tasks.workunit.client.0.smithi148.stdout:4/47: truncate d8/fa 1314247 0 2024-02-28T16:26:26.936 INFO:tasks.workunit.client.0.smithi148.stdout:8/71: dwrite d1/f9 [0,4194304] 0 2024-02-28T16:26:26.942 INFO:tasks.workunit.client.0.smithi148.stdout:7/57: creat d0/d4/ff x:0 0 0 2024-02-28T16:26:26.942 INFO:tasks.workunit.client.0.smithi148.stdout:2/45: truncate d0/d9/fa 469378 0 2024-02-28T16:26:26.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/72: symlink d1/l16 0 2024-02-28T16:26:26.948 INFO:tasks.workunit.client.0.smithi148.stdout:6/51: rename d0/d4/d5 to d0/d4/d14 0 2024-02-28T16:26:26.953 INFO:tasks.workunit.client.0.smithi148.stdout:6/52: creat d0/d10/f15 x:0 0 0 2024-02-28T16:26:26.955 INFO:tasks.workunit.client.0.smithi148.stdout:2/46: link d0/f8 d0/f10 0 2024-02-28T16:26:26.956 INFO:tasks.workunit.client.0.smithi148.stdout:6/53: chown d0/d4/f11 945 1 2024-02-28T16:26:26.961 INFO:tasks.workunit.client.0.smithi148.stdout:8/73: link d1/c6 d1/dd/d13/c17 0 2024-02-28T16:26:26.964 INFO:tasks.workunit.client.0.smithi148.stdout:4/48: truncate f2 3142080 0 2024-02-28T16:26:26.964 INFO:tasks.workunit.client.0.smithi148.stdout:7/58: dread d0/d4/fa [0,4194304] 0 2024-02-28T16:26:26.965 INFO:tasks.workunit.client.0.smithi148.stdout:6/54: creat d0/f16 x:0 0 0 2024-02-28T16:26:26.968 INFO:tasks.workunit.client.0.smithi148.stdout:8/74: mkdir d1/d3/d18 0 2024-02-28T16:26:26.970 INFO:tasks.workunit.client.0.smithi148.stdout:8/75: write d1/d3/f5 [893533,4511] 0 2024-02-28T16:26:26.972 INFO:tasks.workunit.client.0.smithi148.stdout:6/55: mknod d0/d10/c17 0 2024-02-28T16:26:26.972 INFO:tasks.workunit.client.0.smithi148.stdout:8/76: write d1/f9 [3234969,39514] 0 2024-02-28T16:26:26.976 INFO:tasks.workunit.client.0.smithi148.stdout:6/56: truncate d0/d10/f12 704285 0 2024-02-28T16:26:26.978 INFO:tasks.workunit.client.0.smithi148.stdout:4/49: read f2 [30095,49635] 0 2024-02-28T16:26:26.987 INFO:tasks.workunit.client.0.smithi148.stdout:2/47: dread d0/d9/fa [0,4194304] 0 2024-02-28T16:26:26.988 INFO:tasks.workunit.client.0.smithi148.stdout:2/48: rename d0 to d0/d9/d11 22 2024-02-28T16:26:26.992 INFO:tasks.workunit.client.0.smithi148.stdout:8/77: link d1/f9 d1/d3/f19 0 2024-02-28T16:26:26.994 INFO:tasks.workunit.client.0.smithi148.stdout:7/59: getdents d0/d9 0 2024-02-28T16:26:26.994 INFO:tasks.workunit.client.0.smithi148.stdout:4/50: dwrite d8/fa [0,4194304] 0 2024-02-28T16:26:26.995 INFO:tasks.workunit.client.0.smithi148.stdout:6/57: mknod d0/d4/c18 0 2024-02-28T16:26:26.996 INFO:tasks.workunit.client.0.smithi148.stdout:8/78: write d1/de/ff [4679473,28780] 0 2024-02-28T16:26:27.000 INFO:tasks.workunit.client.0.smithi148.stdout:2/49: truncate d0/f8 1769177 0 2024-02-28T16:26:27.002 INFO:tasks.workunit.client.0.smithi148.stdout:7/60: truncate d0/d4/ff 130695 0 2024-02-28T16:26:27.003 INFO:tasks.workunit.client.0.smithi148.stdout:6/58: symlink d0/d4/d14/l19 0 2024-02-28T16:26:27.003 INFO:tasks.workunit.client.0.smithi148.stdout:7/61: fdatasync d0/d4/ff 0 2024-02-28T16:26:27.005 INFO:tasks.workunit.client.0.smithi148.stdout:4/51: link f0 d8/fb 0 2024-02-28T16:26:27.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/79: chown d1/d3/d18 184042 1 2024-02-28T16:26:27.006 INFO:tasks.workunit.client.0.smithi148.stdout:6/59: truncate d0/d10/f13 496632 0 2024-02-28T16:26:27.006 INFO:tasks.workunit.client.0.smithi148.stdout:8/80: readlink d1/l16 0 2024-02-28T16:26:27.006 INFO:tasks.workunit.client.0.smithi148.stdout:4/52: readlink d8/l9 0 2024-02-28T16:26:27.007 INFO:tasks.workunit.client.0.smithi148.stdout:8/81: fsync d1/d3/f4 0 2024-02-28T16:26:27.011 INFO:tasks.workunit.client.0.smithi148.stdout:4/53: mknod d8/cc 0 2024-02-28T16:26:27.016 INFO:tasks.workunit.client.0.smithi148.stdout:1/44: sync 2024-02-28T16:26:27.016 INFO:tasks.workunit.client.0.smithi148.stdout:3/87: sync 2024-02-28T16:26:27.016 INFO:tasks.workunit.client.0.smithi148.stdout:9/48: sync 2024-02-28T16:26:27.016 INFO:tasks.workunit.client.0.smithi148.stdout:5/12: sync 2024-02-28T16:26:27.017 INFO:tasks.workunit.client.0.smithi148.stdout:6/60: rename d0/d4/d14/f9 to d0/d10/f1a 0 2024-02-28T16:26:27.018 INFO:tasks.workunit.client.0.smithi148.stdout:9/49: chown d7/dd/fe 29 1 2024-02-28T16:26:27.023 INFO:tasks.workunit.client.0.smithi148.stdout:4/54: mknod d8/cd 0 2024-02-28T16:26:27.025 INFO:tasks.workunit.client.0.smithi148.stdout:7/62: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:27.025 INFO:tasks.workunit.client.0.smithi148.stdout:8/82: mkdir d1/dd/d13/d1a 0 2024-02-28T16:26:27.027 INFO:tasks.workunit.client.0.smithi148.stdout:3/88: read d1/fa [2544605,97316] 0 2024-02-28T16:26:27.031 INFO:tasks.workunit.client.0.smithi148.stdout:5/13: mkdir d1/d3 0 2024-02-28T16:26:27.031 INFO:tasks.workunit.client.0.smithi148.stdout:5/14: dwrite - no filename 2024-02-28T16:26:27.031 INFO:tasks.workunit.client.0.smithi148.stdout:5/15: read - no filename 2024-02-28T16:26:27.031 INFO:tasks.workunit.client.0.smithi148.stdout:5/16: fsync - no filename 2024-02-28T16:26:27.031 INFO:tasks.workunit.client.0.smithi148.stdout:5/17: fsync - no filename 2024-02-28T16:26:27.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/18: chown d1/d3 3402 1 2024-02-28T16:26:27.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/19: truncate - no filename 2024-02-28T16:26:27.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/20: dwrite - no filename 2024-02-28T16:26:27.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/21: dread - no filename 2024-02-28T16:26:27.032 INFO:tasks.workunit.client.0.smithi148.stdout:1/45: creat d2/d5/d6/d8/f10 x:0 0 0 2024-02-28T16:26:27.035 INFO:tasks.workunit.client.0.smithi148.stdout:1/46: chown l1 0 1 2024-02-28T16:26:27.035 INFO:tasks.workunit.client.0.smithi148.stdout:4/55: symlink d8/le 0 2024-02-28T16:26:27.036 INFO:tasks.workunit.client.0.smithi148.stdout:1/47: chown d2/d5/d6/d7 821077 1 2024-02-28T16:26:27.037 INFO:tasks.workunit.client.0.smithi148.stdout:7/63: mknod d0/c10 0 2024-02-28T16:26:27.039 INFO:tasks.workunit.client.0.smithi148.stdout:1/48: fdatasync d2/d5/d6/d8/f9 0 2024-02-28T16:26:27.039 INFO:tasks.workunit.client.0.smithi148.stdout:9/50: unlink c6 0 2024-02-28T16:26:27.041 INFO:tasks.workunit.client.0.smithi148.stdout:6/61: mkdir d0/d4/d1b 0 2024-02-28T16:26:27.043 INFO:tasks.workunit.client.0.smithi148.stdout:3/89: creat d1/d13/f18 x:0 0 0 2024-02-28T16:26:27.043 INFO:tasks.workunit.client.0.smithi148.stdout:3/90: stat l0 0 2024-02-28T16:26:27.045 INFO:tasks.workunit.client.0.smithi148.stdout:3/91: readlink d1/l12 0 2024-02-28T16:26:27.046 INFO:tasks.workunit.client.0.smithi148.stdout:6/62: write d0/d8/ff [3074590,94508] 0 2024-02-28T16:26:27.047 INFO:tasks.workunit.client.0.smithi148.stdout:6/63: stat d0/f6 0 2024-02-28T16:26:27.050 INFO:tasks.workunit.client.0.smithi148.stdout:5/22: symlink d1/d3/l4 0 2024-02-28T16:26:27.051 INFO:tasks.workunit.client.0.smithi148.stdout:6/64: chown d0/d4/d14/l19 1 1 2024-02-28T16:26:27.052 INFO:tasks.workunit.client.0.smithi148.stdout:9/51: rename d7/d12 to d7/d15 0 2024-02-28T16:26:27.059 INFO:tasks.workunit.client.0.smithi148.stdout:9/52: unlink d7/f14 0 2024-02-28T16:26:27.063 INFO:tasks.workunit.client.0.smithi148.stdout:3/92: truncate d1/fd 902106 0 2024-02-28T16:26:27.072 INFO:tasks.workunit.client.0.smithi148.stdout:3/93: mkdir d1/d13/d19 0 2024-02-28T16:26:27.076 INFO:tasks.workunit.client.0.smithi148.stdout:1/49: dwrite d2/d5/ff [0,4194304] 0 2024-02-28T16:26:27.076 INFO:tasks.workunit.client.0.smithi148.stdout:6/65: rmdir d0/d4 39 2024-02-28T16:26:27.080 INFO:tasks.workunit.client.0.smithi148.stdout:4/56: write f7 [929896,5805] 0 2024-02-28T16:26:27.084 INFO:tasks.workunit.client.0.smithi148.stdout:1/50: chown d2 1083276 1 2024-02-28T16:26:27.084 INFO:tasks.workunit.client.0.smithi148.stdout:3/94: rename l0 to d1/d13/l1a 0 2024-02-28T16:26:27.085 INFO:tasks.workunit.client.0.smithi148.stdout:1/51: readlink d2/l3 0 2024-02-28T16:26:27.086 INFO:tasks.workunit.client.0.smithi148.stdout:7/64: dwrite d0/d4/ff [0,4194304] 0 2024-02-28T16:26:27.090 INFO:tasks.workunit.client.0.smithi148.stdout:8/83: truncate d1/de/ff 359988 0 2024-02-28T16:26:27.090 INFO:tasks.workunit.client.0.smithi148.stdout:4/57: rmdir d8 39 2024-02-28T16:26:27.091 INFO:tasks.workunit.client.0.smithi148.stdout:9/53: dread f2 [0,4194304] 0 2024-02-28T16:26:27.091 INFO:tasks.workunit.client.0.smithi148.stdout:1/52: read - d2/d5/d6/fe zero size 2024-02-28T16:26:27.093 INFO:tasks.workunit.client.0.smithi148.stdout:5/23: rename d1/d3 to d1/d5 0 2024-02-28T16:26:27.097 INFO:tasks.workunit.client.0.smithi148.stdout:7/65: creat d0/f11 x:0 0 0 2024-02-28T16:26:27.099 INFO:tasks.workunit.client.0.smithi148.stdout:7/66: read d0/d4/fa [925269,43883] 0 2024-02-28T16:26:27.109 INFO:tasks.workunit.client.0.smithi148.stdout:6/66: mknod d0/d8/c1c 0 2024-02-28T16:26:27.110 INFO:tasks.workunit.client.0.smithi148.stdout:3/95: mkdir d1/d13/d19/d1b 0 2024-02-28T16:26:27.114 INFO:tasks.workunit.client.0.smithi148.stdout:5/24: symlink d1/d5/l6 0 2024-02-28T16:26:27.115 INFO:tasks.workunit.client.0.smithi148.stdout:4/58: mkdir d8/df 0 2024-02-28T16:26:27.117 INFO:tasks.workunit.client.0.smithi148.stdout:6/67: write d0/d10/f1a [977355,36708] 0 2024-02-28T16:26:27.118 INFO:tasks.workunit.client.0.smithi148.stdout:8/84: rename d1/dd/d13/c17 to d1/dd/d13/d1a/c1b 0 2024-02-28T16:26:27.120 INFO:tasks.workunit.client.0.smithi148.stdout:3/96: unlink d1/d13/f16 0 2024-02-28T16:26:27.122 INFO:tasks.workunit.client.0.smithi148.stdout:1/53: rename d2/d5/d6 to d2/d5/d6/d11 22 2024-02-28T16:26:27.123 INFO:tasks.workunit.client.0.smithi148.stdout:7/67: dwrite d0/f11 [0,4194304] 0 2024-02-28T16:26:27.130 INFO:tasks.workunit.client.0.smithi148.stdout:5/25: mknod d1/d5/c7 0 2024-02-28T16:26:27.144 INFO:tasks.workunit.client.0.smithi148.stdout:8/85: creat d1/f1c x:0 0 0 2024-02-28T16:26:27.151 INFO:tasks.workunit.client.0.smithi148.stdout:8/86: write d1/d3/fa [594303,10646] 0 2024-02-28T16:26:27.151 INFO:tasks.workunit.client.0.smithi148.stdout:7/68: dwrite d0/f1 [0,4194304] 0 2024-02-28T16:26:27.152 INFO:tasks.workunit.client.0.smithi148.stdout:5/26: unlink d1/d5/l6 0 2024-02-28T16:26:27.153 INFO:tasks.workunit.client.0.smithi148.stdout:7/69: chown d0 1251375 1 2024-02-28T16:26:27.153 INFO:tasks.workunit.client.0.smithi148.stdout:5/27: readlink l0 0 2024-02-28T16:26:27.153 INFO:tasks.workunit.client.0.smithi148.stdout:8/87: read d1/f7 [110502,8140] 0 2024-02-28T16:26:27.155 INFO:tasks.workunit.client.0.smithi148.stdout:7/70: readlink d0/d4/l8 0 2024-02-28T16:26:27.156 INFO:tasks.workunit.client.0.smithi148.stdout:5/28: chown d1/d5 41342522 1 2024-02-28T16:26:27.157 INFO:tasks.workunit.client.0.smithi148.stdout:8/88: chown d1/dd 320 1 2024-02-28T16:26:27.158 INFO:tasks.workunit.client.0.smithi148.stdout:7/71: fdatasync d0/d9/fc 0 2024-02-28T16:26:27.159 INFO:tasks.workunit.client.0.smithi148.stdout:4/59: write d8/fb [211343,45660] 0 2024-02-28T16:26:27.162 INFO:tasks.workunit.client.0.smithi148.stdout:7/72: write d0/d4/ff [2768668,123669] 0 2024-02-28T16:26:27.163 INFO:tasks.workunit.client.0.smithi148.stdout:4/60: write d8/fa [3685692,81264] 0 2024-02-28T16:26:27.164 INFO:tasks.workunit.client.0.smithi148.stdout:3/97: write d1/f8 [549595,66706] 0 2024-02-28T16:26:27.166 INFO:tasks.workunit.client.0.smithi148.stdout:9/54: rename f2 to d7/d15/f16 0 2024-02-28T16:26:27.166 INFO:tasks.workunit.client.0.smithi148.stdout:3/98: chown d1/db 160 1 2024-02-28T16:26:27.168 INFO:tasks.workunit.client.0.smithi148.stdout:6/68: link d0/f6 d0/f1d 0 2024-02-28T16:26:27.171 INFO:tasks.workunit.client.0.smithi148.stdout:5/29: rename d1/d5 to d1/d8 0 2024-02-28T16:26:27.172 INFO:tasks.workunit.client.0.smithi148.stdout:5/30: dread - no filename 2024-02-28T16:26:27.173 INFO:tasks.workunit.client.0.smithi148.stdout:0/107: sync 2024-02-28T16:26:27.174 INFO:tasks.workunit.client.0.smithi148.stdout:7/73: symlink d0/d9/l12 0 2024-02-28T16:26:27.176 INFO:tasks.workunit.client.0.smithi148.stdout:4/61: creat d8/f10 x:0 0 0 2024-02-28T16:26:27.178 INFO:tasks.workunit.client.0.smithi148.stdout:0/108: stat d1/d15/c14 0 2024-02-28T16:26:27.181 INFO:tasks.workunit.client.0.smithi148.stdout:7/74: chown d0/d4/c6 16320 1 2024-02-28T16:26:27.181 INFO:tasks.workunit.client.0.smithi148.stdout:3/99: rename d1/f9 to d1/d13/d19/f1c 0 2024-02-28T16:26:27.182 INFO:tasks.workunit.client.0.smithi148.stdout:5/31: rmdir d1 39 2024-02-28T16:26:27.182 INFO:tasks.workunit.client.0.smithi148.stdout:5/32: write - no filename 2024-02-28T16:26:27.183 INFO:tasks.workunit.client.0.smithi148.stdout:6/69: chown d0/d4/d14/l19 2 1 2024-02-28T16:26:27.186 INFO:tasks.workunit.client.0.smithi148.stdout:6/70: readlink d0/d4/l7 0 2024-02-28T16:26:27.190 INFO:tasks.workunit.client.0.smithi148.stdout:0/109: chown d1/d15/d8/f29 223807 1 2024-02-28T16:26:27.190 INFO:tasks.workunit.client.0.smithi148.stdout:8/89: getdents d1/dd 0 2024-02-28T16:26:27.192 INFO:tasks.workunit.client.0.smithi148.stdout:3/100: mknod d1/d13/d19/c1d 0 2024-02-28T16:26:27.194 INFO:tasks.workunit.client.0.smithi148.stdout:1/54: dwrite f0 [0,4194304] 0 2024-02-28T16:26:27.195 INFO:tasks.workunit.client.0.smithi148.stdout:5/33: creat d1/f9 x:0 0 0 2024-02-28T16:26:27.197 INFO:tasks.workunit.client.0.smithi148.stdout:7/75: rename d0/d4/fa to d0/f13 0 2024-02-28T16:26:27.199 INFO:tasks.workunit.client.0.smithi148.stdout:0/110: fdatasync d1/d15/f2a 0 2024-02-28T16:26:27.200 INFO:tasks.workunit.client.0.smithi148.stdout:6/71: read - d0/d10/f15 zero size 2024-02-28T16:26:27.202 INFO:tasks.workunit.client.0.smithi148.stdout:1/55: rename d2/d5/d6/fe to d2/d5/d6/d7/f12 0 2024-02-28T16:26:27.205 INFO:tasks.workunit.client.0.smithi148.stdout:7/76: symlink d0/l14 0 2024-02-28T16:26:27.205 INFO:tasks.workunit.client.0.smithi148.stdout:9/55: dread d7/fb [0,4194304] 0 2024-02-28T16:26:27.206 INFO:tasks.workunit.client.0.smithi148.stdout:3/101: creat d1/d13/f1e x:0 0 0 2024-02-28T16:26:27.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/111: mknod d1/d15/d8/c2c 0 2024-02-28T16:26:27.211 INFO:tasks.workunit.client.0.smithi148.stdout:3/102: chown d1/c7 14 1 2024-02-28T16:26:27.213 INFO:tasks.workunit.client.0.smithi148.stdout:4/62: dwrite f0 [0,4194304] 0 2024-02-28T16:26:27.214 INFO:tasks.workunit.client.0.smithi148.stdout:3/103: chown d1/fa 92046 1 2024-02-28T16:26:27.216 INFO:tasks.workunit.client.0.smithi148.stdout:7/77: truncate d0/d9/fe 461675 0 2024-02-28T16:26:27.224 INFO:tasks.workunit.client.0.smithi148.stdout:6/72: symlink d0/d4/d1b/l1e 0 2024-02-28T16:26:27.230 INFO:tasks.workunit.client.0.smithi148.stdout:0/112: rename d1/d4/f10 to d1/d4/d25/f2d 0 2024-02-28T16:26:27.231 INFO:tasks.workunit.client.0.smithi148.stdout:6/73: readlink d0/d4/l7 0 2024-02-28T16:26:27.231 INFO:tasks.workunit.client.0.smithi148.stdout:8/90: link d1/f9 d1/d3/f1d 0 2024-02-28T16:26:27.234 INFO:tasks.workunit.client.0.smithi148.stdout:6/74: write d0/f2 [4318851,2845] 0 2024-02-28T16:26:27.235 INFO:tasks.workunit.client.0.smithi148.stdout:3/104: creat d1/d13/d19/d1b/f1f x:0 0 0 2024-02-28T16:26:27.237 INFO:tasks.workunit.client.0.smithi148.stdout:1/56: dread f0 [0,4194304] 0 2024-02-28T16:26:27.238 INFO:tasks.workunit.client.0.smithi148.stdout:8/91: creat d1/d3/f1e x:0 0 0 2024-02-28T16:26:27.244 INFO:tasks.workunit.client.0.smithi148.stdout:4/63: dread d8/fa [0,4194304] 0 2024-02-28T16:26:27.244 INFO:tasks.workunit.client.0.smithi148.stdout:3/105: rename d1/d13/f18 to d1/f20 0 2024-02-28T16:26:27.251 INFO:tasks.workunit.client.0.smithi148.stdout:9/56: dwrite d7/dd/fe [0,4194304] 0 2024-02-28T16:26:27.254 INFO:tasks.workunit.client.0.smithi148.stdout:4/64: write f2 [771452,113909] 0 2024-02-28T16:26:27.255 INFO:tasks.workunit.client.0.smithi148.stdout:1/57: mkdir d2/d5/d6/d13 0 2024-02-28T16:26:27.258 INFO:tasks.workunit.client.0.smithi148.stdout:4/65: fdatasync f2 0 2024-02-28T16:26:27.258 INFO:tasks.workunit.client.0.smithi148.stdout:8/92: chown d1/f9 99434 1 2024-02-28T16:26:27.260 INFO:tasks.workunit.client.0.smithi148.stdout:6/75: creat d0/d4/d1b/f1f x:0 0 0 2024-02-28T16:26:27.260 INFO:tasks.workunit.client.0.smithi148.stdout:4/66: chown d8 70390365 1 2024-02-28T16:26:27.261 INFO:tasks.workunit.client.0.smithi148.stdout:7/78: truncate d0/d4/ff 1414619 0 2024-02-28T16:26:27.266 INFO:tasks.workunit.client.0.smithi148.stdout:8/93: fsync d1/d3/f4 0 2024-02-28T16:26:27.269 INFO:tasks.workunit.client.0.smithi148.stdout:6/76: chown d0/d10/f1a 100 1 2024-02-28T16:26:27.269 INFO:tasks.workunit.client.0.smithi148.stdout:4/67: creat d8/f11 x:0 0 0 2024-02-28T16:26:27.270 INFO:tasks.workunit.client.0.smithi148.stdout:7/79: readlink d0/l14 0 2024-02-28T16:26:27.271 INFO:tasks.workunit.client.0.smithi148.stdout:0/113: dwrite d1/d15/d8/f20 [0,4194304] 0 2024-02-28T16:26:27.273 INFO:tasks.workunit.client.0.smithi148.stdout:1/58: creat d2/d5/d6/d7/f14 x:0 0 0 2024-02-28T16:26:27.274 INFO:tasks.workunit.client.0.smithi148.stdout:8/94: truncate d1/d3/f19 540049 0 2024-02-28T16:26:27.275 INFO:tasks.workunit.client.0.smithi148.stdout:6/77: read - d0/d4/d1b/f1f zero size 2024-02-28T16:26:27.280 INFO:tasks.workunit.client.0.smithi148.stdout:3/106: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:26:27.280 INFO:tasks.workunit.client.0.smithi148.stdout:9/57: creat d7/f17 x:0 0 0 2024-02-28T16:26:27.280 INFO:tasks.workunit.client.0.smithi148.stdout:4/68: creat d8/f12 x:0 0 0 2024-02-28T16:26:27.297 INFO:tasks.workunit.client.0.smithi148.stdout:4/69: dread f2 [0,4194304] 0 2024-02-28T16:26:27.297 INFO:tasks.workunit.client.0.smithi148.stdout:9/58: unlink d7/d15/f16 0 2024-02-28T16:26:27.298 INFO:tasks.workunit.client.0.smithi148.stdout:3/107: creat d1/d13/f21 x:0 0 0 2024-02-28T16:26:27.298 INFO:tasks.workunit.client.0.smithi148.stdout:7/80: truncate d0/d9/fc 8135178 0 2024-02-28T16:26:27.303 INFO:tasks.workunit.client.0.smithi148.stdout:3/108: write d1/f20 [826490,51315] 0 2024-02-28T16:26:27.303 INFO:tasks.workunit.client.0.smithi148.stdout:7/81: rmdir d0/d4 39 2024-02-28T16:26:27.306 INFO:tasks.workunit.client.0.smithi148.stdout:9/59: unlink d7/dd/fe 0 2024-02-28T16:26:27.307 INFO:tasks.workunit.client.0.smithi148.stdout:6/78: dread d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:27.309 INFO:tasks.workunit.client.0.smithi148.stdout:9/60: dread - d7/f17 zero size 2024-02-28T16:26:27.313 INFO:tasks.workunit.client.0.smithi148.stdout:4/70: rename c5 to d8/df/c13 0 2024-02-28T16:26:27.317 INFO:tasks.workunit.client.0.smithi148.stdout:9/61: dread f3 [0,4194304] 0 2024-02-28T16:26:27.322 INFO:tasks.workunit.client.0.smithi148.stdout:3/109: creat d1/db/f22 x:0 0 0 2024-02-28T16:26:27.326 INFO:tasks.workunit.client.0.smithi148.stdout:3/110: read - d1/d13/f1e zero size 2024-02-28T16:26:27.330 INFO:tasks.workunit.client.0.smithi148.stdout:8/95: truncate d1/d3/fa 267659 0 2024-02-28T16:26:27.330 INFO:tasks.workunit.client.0.smithi148.stdout:7/82: creat d0/d4/f15 x:0 0 0 2024-02-28T16:26:27.333 INFO:tasks.workunit.client.0.smithi148.stdout:6/79: dread d0/d8/fc [0,4194304] 0 2024-02-28T16:26:27.337 INFO:tasks.workunit.client.0.smithi148.stdout:0/114: dwrite d1/d4/f16 [0,4194304] 0 2024-02-28T16:26:27.342 INFO:tasks.workunit.client.0.smithi148.stdout:8/96: mknod d1/c1f 0 2024-02-28T16:26:27.342 INFO:tasks.workunit.client.0.smithi148.stdout:4/71: dwrite f0 [0,4194304] 0 2024-02-28T16:26:27.344 INFO:tasks.workunit.client.0.smithi148.stdout:8/97: write d1/f1c [663332,112950] 0 2024-02-28T16:26:27.345 INFO:tasks.workunit.client.0.smithi148.stdout:6/80: unlink d0/f2 0 2024-02-28T16:26:27.347 INFO:tasks.workunit.client.0.smithi148.stdout:2/50: sync 2024-02-28T16:26:27.349 INFO:tasks.workunit.client.0.smithi148.stdout:2/51: read d0/d9/fa [370814,114018] 0 2024-02-28T16:26:27.354 INFO:tasks.workunit.client.0.smithi148.stdout:0/115: creat d1/d4/d25/f2e x:0 0 0 2024-02-28T16:26:27.356 INFO:tasks.workunit.client.0.smithi148.stdout:0/116: stat d1/d15 0 2024-02-28T16:26:27.357 INFO:tasks.workunit.client.0.smithi148.stdout:9/62: creat d7/f18 x:0 0 0 2024-02-28T16:26:27.359 INFO:tasks.workunit.client.0.smithi148.stdout:4/72: unlink d8/fa 0 2024-02-28T16:26:27.360 INFO:tasks.workunit.client.0.smithi148.stdout:9/63: chown l4 290 1 2024-02-28T16:26:27.363 INFO:tasks.workunit.client.0.smithi148.stdout:6/81: mknod d0/d4/d1b/c20 0 2024-02-28T16:26:27.371 INFO:tasks.workunit.client.0.smithi148.stdout:9/64: dread f3 [0,4194304] 0 2024-02-28T16:26:27.371 INFO:tasks.workunit.client.0.smithi148.stdout:9/65: chown f3 41 1 2024-02-28T16:26:27.372 INFO:tasks.workunit.client.0.smithi148.stdout:4/73: rename d8/fb to d8/f14 0 2024-02-28T16:26:27.376 INFO:tasks.workunit.client.0.smithi148.stdout:9/66: chown f3 2 1 2024-02-28T16:26:27.378 INFO:tasks.workunit.client.0.smithi148.stdout:6/82: rmdir d0/d4/d14 39 2024-02-28T16:26:27.378 INFO:tasks.workunit.client.0.smithi148.stdout:3/111: write d1/fd [1345346,59394] 0 2024-02-28T16:26:27.382 INFO:tasks.workunit.client.0.smithi148.stdout:3/112: stat d1/d13/f1e 0 2024-02-28T16:26:27.387 INFO:tasks.workunit.client.0.smithi148.stdout:4/74: rename f2 to d8/f15 0 2024-02-28T16:26:27.390 INFO:tasks.workunit.client.0.smithi148.stdout:8/98: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:26:27.393 INFO:tasks.workunit.client.0.smithi148.stdout:9/67: truncate d7/f18 888899 0 2024-02-28T16:26:27.394 INFO:tasks.workunit.client.0.smithi148.stdout:0/117: dwrite d1/f22 [0,4194304] 0 2024-02-28T16:26:27.394 INFO:tasks.workunit.client.0.smithi148.stdout:3/113: write d1/f3 [3757171,34411] 0 2024-02-28T16:26:27.395 INFO:tasks.workunit.client.0.smithi148.stdout:6/83: chown d0/d10/c17 310 1 2024-02-28T16:26:27.399 INFO:tasks.workunit.client.0.smithi148.stdout:8/99: readlink d1/l16 0 2024-02-28T16:26:27.401 INFO:tasks.workunit.client.0.smithi148.stdout:3/114: read - d1/d13/f21 zero size 2024-02-28T16:26:27.401 INFO:tasks.workunit.client.0.smithi148.stdout:2/52: write d0/f10 [764702,120818] 0 2024-02-28T16:26:27.403 INFO:tasks.workunit.client.0.smithi148.stdout:6/84: write d0/d10/f15 [86811,9483] 0 2024-02-28T16:26:27.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/100: write d1/f1c [235946,57444] 0 2024-02-28T16:26:27.405 INFO:tasks.workunit.client.0.smithi148.stdout:4/75: symlink d8/l16 0 2024-02-28T16:26:27.408 INFO:tasks.workunit.client.0.smithi148.stdout:8/101: chown d1/f7 242666547 1 2024-02-28T16:26:27.413 INFO:tasks.workunit.client.0.smithi148.stdout:9/68: rmdir d7/d15 39 2024-02-28T16:26:27.420 INFO:tasks.workunit.client.0.smithi148.stdout:0/118: mkdir d1/d2f 0 2024-02-28T16:26:27.423 INFO:tasks.workunit.client.0.smithi148.stdout:2/53: unlink d0/lc 0 2024-02-28T16:26:27.424 INFO:tasks.workunit.client.0.smithi148.stdout:3/115: creat d1/d13/f23 x:0 0 0 2024-02-28T16:26:27.426 INFO:tasks.workunit.client.0.smithi148.stdout:0/119: truncate d1/f24 813192 0 2024-02-28T16:26:27.428 INFO:tasks.workunit.client.0.smithi148.stdout:9/69: symlink d7/dd/l19 0 2024-02-28T16:26:27.433 INFO:tasks.workunit.client.0.smithi148.stdout:2/54: mknod d0/c12 0 2024-02-28T16:26:27.441 INFO:tasks.workunit.client.0.smithi148.stdout:6/85: mkdir d0/d8/d21 0 2024-02-28T16:26:27.449 INFO:tasks.workunit.client.0.smithi148.stdout:2/55: fdatasync d0/d9/fa 0 2024-02-28T16:26:27.456 INFO:tasks.workunit.client.0.smithi148.stdout:8/102: dwrite d1/dd/f10 [0,4194304] 0 2024-02-28T16:26:27.458 INFO:tasks.workunit.client.0.smithi148.stdout:2/56: mkdir d0/d9/d13 0 2024-02-28T16:26:27.459 INFO:tasks.workunit.client.0.smithi148.stdout:0/120: link d1/d4/d25/f2d d1/d15/d8/f30 0 2024-02-28T16:26:27.461 INFO:tasks.workunit.client.0.smithi148.stdout:4/76: dwrite d8/f11 [0,4194304] 0 2024-02-28T16:26:27.469 INFO:tasks.workunit.client.0.smithi148.stdout:0/121: truncate d1/f24 1571466 0 2024-02-28T16:26:27.477 INFO:tasks.workunit.client.0.smithi148.stdout:3/116: dread d1/fa [0,4194304] 0 2024-02-28T16:26:27.479 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:27 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:26:27.479 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:27 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:26:27.479 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:27 smithi148 ceph-mon[28767]: Reconfiguring prometheus.smithi148 (dependencies changed)... 2024-02-28T16:26:27.479 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:27 smithi148 ceph-mon[28767]: pgmap v38: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 8.0 MiB/s wr, 94 op/s 2024-02-28T16:26:27.479 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:27 smithi148 ceph-mon[28767]: Reconfiguring daemon prometheus.smithi148 on smithi148 2024-02-28T16:26:27.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:27 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:26:27.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:27 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:26:27.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:27 smithi157 ceph-mon[38346]: Reconfiguring prometheus.smithi148 (dependencies changed)... 2024-02-28T16:26:27.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:27 smithi157 ceph-mon[38346]: pgmap v38: 65 pgs: 65 active+clean; 246 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 231 KiB/s rd, 8.0 MiB/s wr, 94 op/s 2024-02-28T16:26:27.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:27 smithi157 ceph-mon[38346]: Reconfiguring daemon prometheus.smithi148 on smithi148 2024-02-28T16:26:27.499 INFO:tasks.workunit.client.0.smithi148.stdout:3/117: write d1/d13/f1e [857609,80298] 0 2024-02-28T16:26:27.506 INFO:tasks.workunit.client.0.smithi148.stdout:6/86: dwrite d0/d10/f1a [0,4194304] 0 2024-02-28T16:26:27.508 INFO:tasks.workunit.client.0.smithi148.stdout:2/57: truncate d0/f10 1260832 0 2024-02-28T16:26:27.520 INFO:tasks.workunit.client.0.smithi148.stdout:2/58: chown d0/c5 8944 1 2024-02-28T16:26:27.527 INFO:tasks.workunit.client.0.smithi148.stdout:8/103: dwrite d1/d3/f1e [0,4194304] 0 2024-02-28T16:26:27.527 INFO:tasks.workunit.client.0.smithi148.stdout:5/34: sync 2024-02-28T16:26:27.529 INFO:tasks.workunit.client.0.smithi148.stdout:6/87: truncate d0/d10/f15 412429 0 2024-02-28T16:26:27.537 INFO:tasks.workunit.client.0.smithi148.stdout:9/70: dwrite f3 [0,4194304] 0 2024-02-28T16:26:27.545 INFO:tasks.workunit.client.0.smithi148.stdout:5/35: creat d1/d8/fa x:0 0 0 2024-02-28T16:26:27.546 INFO:tasks.workunit.client.0.smithi148.stdout:2/59: dread d0/d9/fa [0,4194304] 0 2024-02-28T16:26:27.549 INFO:tasks.workunit.client.0.smithi148.stdout:0/122: dwrite d1/f6 [4194304,4194304] 0 2024-02-28T16:26:27.558 INFO:tasks.workunit.client.0.smithi148.stdout:2/60: chown d0/c12 63 1 2024-02-28T16:26:27.559 INFO:tasks.workunit.client.0.smithi148.stdout:5/36: dread - d1/f9 zero size 2024-02-28T16:26:27.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/77: dwrite d8/f14 [0,4194304] 0 2024-02-28T16:26:27.565 INFO:tasks.workunit.client.0.smithi148.stdout:5/37: chown d1/d8/fa 6 1 2024-02-28T16:26:27.569 INFO:tasks.workunit.client.0.smithi148.stdout:6/88: getdents d0 0 2024-02-28T16:26:27.571 INFO:tasks.workunit.client.0.smithi148.stdout:5/38: dread - d1/d8/fa zero size 2024-02-28T16:26:27.572 INFO:tasks.workunit.client.0.smithi148.stdout:4/78: write f0 [356182,112816] 0 2024-02-28T16:26:27.575 INFO:tasks.workunit.client.0.smithi148.stdout:3/118: dread d1/f3 [0,4194304] 0 2024-02-28T16:26:27.576 INFO:tasks.workunit.client.0.smithi148.stdout:5/39: write d1/f9 [195370,61527] 0 2024-02-28T16:26:27.586 INFO:tasks.workunit.client.0.smithi148.stdout:2/61: rename d0/d9/le to d0/dd/l14 0 2024-02-28T16:26:27.592 INFO:tasks.workunit.client.0.smithi148.stdout:4/79: mkdir d8/df/d17 0 2024-02-28T16:26:27.596 INFO:tasks.workunit.client.0.smithi148.stdout:2/62: rmdir d0/d9 39 2024-02-28T16:26:27.599 INFO:tasks.workunit.client.0.smithi148.stdout:4/80: chown l4 69683647 1 2024-02-28T16:26:27.599 INFO:tasks.workunit.client.0.smithi148.stdout:0/123: dread d1/d15/d8/f20 [0,4194304] 0 2024-02-28T16:26:27.601 INFO:tasks.workunit.client.0.smithi148.stdout:3/119: symlink d1/d13/d19/d1b/l24 0 2024-02-28T16:26:27.604 INFO:tasks.workunit.client.0.smithi148.stdout:9/71: getdents d7/d15 0 2024-02-28T16:26:27.608 INFO:tasks.workunit.client.0.smithi148.stdout:4/81: chown d8/f11 118091861 1 2024-02-28T16:26:27.610 INFO:tasks.workunit.client.0.smithi148.stdout:6/89: dwrite d0/d4/fa [0,4194304] 0 2024-02-28T16:26:27.613 INFO:tasks.workunit.client.0.smithi148.stdout:3/120: chown d1/c7 70272 1 2024-02-28T16:26:27.618 INFO:tasks.workunit.client.0.smithi148.stdout:0/124: mknod d1/d15/d8/c31 0 2024-02-28T16:26:27.620 INFO:tasks.workunit.client.0.smithi148.stdout:9/72: creat d7/d15/f1a x:0 0 0 2024-02-28T16:26:27.624 INFO:tasks.workunit.client.0.smithi148.stdout:5/40: dwrite d1/f9 [0,4194304] 0 2024-02-28T16:26:27.626 INFO:tasks.workunit.client.0.smithi148.stdout:3/121: truncate d1/d13/f1e 1854172 0 2024-02-28T16:26:27.628 INFO:tasks.workunit.client.0.smithi148.stdout:9/73: dread d7/f18 [0,4194304] 0 2024-02-28T16:26:27.628 INFO:tasks.workunit.client.0.smithi148.stdout:3/122: chown d1/db/f10 1465 1 2024-02-28T16:26:27.636 INFO:tasks.workunit.client.0.smithi148.stdout:4/82: dread f0 [0,4194304] 0 2024-02-28T16:26:27.637 INFO:tasks.workunit.client.0.smithi148.stdout:6/90: write d0/d8/ff [2306057,6355] 0 2024-02-28T16:26:27.638 INFO:tasks.workunit.client.0.smithi148.stdout:4/83: dread - d8/f10 zero size 2024-02-28T16:26:27.639 INFO:tasks.workunit.client.0.smithi148.stdout:2/63: rename d0/dd/l14 to d0/d9/d13/l15 0 2024-02-28T16:26:27.643 INFO:tasks.workunit.client.0.smithi148.stdout:2/64: dread d0/d9/fa [0,4194304] 0 2024-02-28T16:26:27.645 INFO:tasks.workunit.client.0.smithi148.stdout:9/74: write d7/f18 [735329,48848] 0 2024-02-28T16:26:27.647 INFO:tasks.workunit.client.0.smithi148.stdout:3/123: symlink d1/l25 0 2024-02-28T16:26:27.651 INFO:tasks.workunit.client.0.smithi148.stdout:5/41: fsync d1/f9 0 2024-02-28T16:26:27.653 INFO:tasks.workunit.client.0.smithi148.stdout:6/91: mkdir d0/d22 0 2024-02-28T16:26:27.656 INFO:tasks.workunit.client.0.smithi148.stdout:4/84: creat d8/f18 x:0 0 0 2024-02-28T16:26:27.657 INFO:tasks.workunit.client.0.smithi148.stdout:2/65: creat d0/d9/d13/f16 x:0 0 0 2024-02-28T16:26:27.659 INFO:tasks.workunit.client.0.smithi148.stdout:9/75: creat d7/d15/f1b x:0 0 0 2024-02-28T16:26:27.663 INFO:tasks.workunit.client.0.smithi148.stdout:0/125: link d1/f19 d1/d4/d25/f32 0 2024-02-28T16:26:27.668 INFO:tasks.workunit.client.0.smithi148.stdout:2/66: symlink d0/d9/l17 0 2024-02-28T16:26:27.669 INFO:tasks.workunit.client.0.smithi148.stdout:3/124: dwrite d1/fd [0,4194304] 0 2024-02-28T16:26:27.680 INFO:tasks.workunit.client.0.smithi148.stdout:0/126: creat d1/d4/f33 x:0 0 0 2024-02-28T16:26:27.682 INFO:tasks.workunit.client.0.smithi148.stdout:4/85: creat d8/df/d17/f19 x:0 0 0 2024-02-28T16:26:27.684 INFO:tasks.workunit.client.0.smithi148.stdout:4/86: fdatasync d8/f18 0 2024-02-28T16:26:27.686 INFO:tasks.workunit.client.0.smithi148.stdout:3/125: readlink d1/d13/l1a 0 2024-02-28T16:26:27.688 INFO:tasks.workunit.client.0.smithi148.stdout:3/126: chown d1/db/f10 71000 1 2024-02-28T16:26:27.688 INFO:tasks.workunit.client.0.smithi148.stdout:1/59: sync 2024-02-28T16:26:27.688 INFO:tasks.workunit.client.0.smithi148.stdout:7/83: sync 2024-02-28T16:26:27.692 INFO:tasks.workunit.client.0.smithi148.stdout:3/127: dread - d1/d13/f17 zero size 2024-02-28T16:26:27.694 INFO:tasks.workunit.client.0.smithi148.stdout:9/76: mkdir d7/d1c 0 2024-02-28T16:26:27.697 INFO:tasks.workunit.client.0.smithi148.stdout:2/67: mkdir d0/d18 0 2024-02-28T16:26:27.697 INFO:tasks.workunit.client.0.smithi148.stdout:1/60: fsync d2/d5/d6/d7/fc 0 2024-02-28T16:26:27.703 INFO:tasks.workunit.client.0.smithi148.stdout:1/61: chown d2/d5/d6/d7/f12 154543350 1 2024-02-28T16:26:27.705 INFO:tasks.workunit.client.0.smithi148.stdout:5/42: truncate d1/f9 2331968 0 2024-02-28T16:26:27.713 INFO:tasks.workunit.client.0.smithi148.stdout:5/43: dread - d1/d8/fa zero size 2024-02-28T16:26:27.713 INFO:tasks.workunit.client.0.smithi148.stdout:3/128: rename d1/d13/d19/c1d to d1/c26 0 2024-02-28T16:26:27.715 INFO:tasks.workunit.client.0.smithi148.stdout:0/127: dwrite d1/f24 [0,4194304] 0 2024-02-28T16:26:27.723 INFO:tasks.workunit.client.0.smithi148.stdout:7/84: dwrite d0/f1 [0,4194304] 0 2024-02-28T16:26:27.724 INFO:tasks.workunit.client.0.smithi148.stdout:0/128: chown l0 6032810 1 2024-02-28T16:26:27.725 INFO:tasks.workunit.client.0.smithi148.stdout:2/68: dread d0/f10 [0,4194304] 0 2024-02-28T16:26:27.729 INFO:tasks.workunit.client.0.smithi148.stdout:7/85: fsync d0/f11 0 2024-02-28T16:26:27.731 INFO:tasks.workunit.client.0.smithi148.stdout:1/62: truncate d2/d5/d6/d7/f14 181544 0 2024-02-28T16:26:27.733 INFO:tasks.workunit.client.0.smithi148.stdout:6/92: truncate d0/d4/fa 3921089 0 2024-02-28T16:26:27.738 INFO:tasks.workunit.client.0.smithi148.stdout:0/129: mkdir d1/d15/d27/d34 0 2024-02-28T16:26:27.742 INFO:tasks.workunit.client.0.smithi148.stdout:7/86: symlink d0/d9/l16 0 2024-02-28T16:26:27.743 INFO:tasks.workunit.client.0.smithi148.stdout:0/130: stat d1/d4/d25/f2e 0 2024-02-28T16:26:27.744 INFO:tasks.workunit.client.0.smithi148.stdout:1/63: mkdir d2/d15 0 2024-02-28T16:26:27.748 INFO:tasks.workunit.client.0.smithi148.stdout:9/77: dwrite d7/fc [0,4194304] 0 2024-02-28T16:26:27.749 INFO:tasks.workunit.client.0.smithi148.stdout:2/69: dread d0/f10 [0,4194304] 0 2024-02-28T16:26:27.757 INFO:tasks.workunit.client.0.smithi148.stdout:5/44: dwrite d1/d8/fa [0,4194304] 0 2024-02-28T16:26:27.765 INFO:tasks.workunit.client.0.smithi148.stdout:0/131: chown d1/d15/d8/f29 69230954 1 2024-02-28T16:26:27.766 INFO:tasks.workunit.client.0.smithi148.stdout:6/93: truncate d0/d10/f12 310870 0 2024-02-28T16:26:27.766 INFO:tasks.workunit.client.0.smithi148.stdout:3/129: dwrite d1/f20 [0,4194304] 0 2024-02-28T16:26:27.767 INFO:tasks.workunit.client.0.smithi148.stdout:1/64: link f0 d2/d5/d6/f16 0 2024-02-28T16:26:27.770 INFO:tasks.workunit.client.0.smithi148.stdout:5/45: mkdir d1/db 0 2024-02-28T16:26:27.772 INFO:tasks.workunit.client.0.smithi148.stdout:2/70: creat d0/d18/f19 x:0 0 0 2024-02-28T16:26:27.774 INFO:tasks.workunit.client.0.smithi148.stdout:7/87: truncate d0/d9/fc 6379751 0 2024-02-28T16:26:27.780 INFO:tasks.workunit.client.0.smithi148.stdout:0/132: rename d1/d15/d8/f23 to d1/d15/d27/f35 0 2024-02-28T16:26:27.780 INFO:tasks.workunit.client.0.smithi148.stdout:5/46: rename d1/d8 to d1/d8/dc 22 2024-02-28T16:26:27.783 INFO:tasks.workunit.client.0.smithi148.stdout:7/88: truncate d0/d9/fe 764104 0 2024-02-28T16:26:27.790 INFO:tasks.workunit.client.0.smithi148.stdout:9/78: dread d7/fc [0,4194304] 0 2024-02-28T16:26:27.790 INFO:tasks.workunit.client.0.smithi148.stdout:9/79: chown d7/dd/lf 14357 1 2024-02-28T16:26:27.793 INFO:tasks.workunit.client.0.smithi148.stdout:2/71: mknod d0/d18/c1a 0 2024-02-28T16:26:27.795 INFO:tasks.workunit.client.0.smithi148.stdout:9/80: truncate d7/d15/f1b 979700 0 2024-02-28T16:26:27.795 INFO:tasks.workunit.client.0.smithi148.stdout:5/47: symlink d1/ld 0 2024-02-28T16:26:27.795 INFO:tasks.workunit.client.0.smithi148.stdout:0/133: unlink d1/d15/d8/l28 0 2024-02-28T16:26:27.803 INFO:tasks.workunit.client.0.smithi148.stdout:0/134: write d1/f6 [5139192,93045] 0 2024-02-28T16:26:27.803 INFO:tasks.workunit.client.0.smithi148.stdout:2/72: write d0/d9/fa [1113371,112045] 0 2024-02-28T16:26:27.805 INFO:tasks.workunit.client.0.smithi148.stdout:9/81: rmdir d7/dd 39 2024-02-28T16:26:27.808 INFO:tasks.workunit.client.0.smithi148.stdout:7/89: link d0/d9/l12 d0/d4/l17 0 2024-02-28T16:26:27.818 INFO:tasks.workunit.client.0.smithi148.stdout:7/90: chown d0/l14 21 1 2024-02-28T16:26:27.822 INFO:tasks.workunit.client.0.smithi148.stdout:0/135: symlink d1/d4/d25/l36 0 2024-02-28T16:26:27.822 INFO:tasks.workunit.client.0.smithi148.stdout:2/73: write d0/d9/fa [582104,83903] 0 2024-02-28T16:26:27.826 INFO:tasks.workunit.client.0.smithi148.stdout:9/82: dread d7/d15/f1b [0,4194304] 0 2024-02-28T16:26:27.826 INFO:tasks.workunit.client.0.smithi148.stdout:6/94: dwrite d0/d10/f15 [0,4194304] 0 2024-02-28T16:26:27.826 INFO:tasks.workunit.client.0.smithi148.stdout:5/48: link d1/d8/c7 d1/db/ce 0 2024-02-28T16:26:27.829 INFO:tasks.workunit.client.0.smithi148.stdout:7/91: fsync d0/f7 0 2024-02-28T16:26:27.831 INFO:tasks.workunit.client.0.smithi148.stdout:0/136: chown d1/d15/d8/l13 1013 1 2024-02-28T16:26:27.832 INFO:tasks.workunit.client.0.smithi148.stdout:2/74: mknod d0/dd/c1b 0 2024-02-28T16:26:27.833 INFO:tasks.workunit.client.0.smithi148.stdout:9/83: readlink d7/l8 0 2024-02-28T16:26:27.836 INFO:tasks.workunit.client.0.smithi148.stdout:3/130: dwrite d1/fd [4194304,4194304] 0 2024-02-28T16:26:27.836 INFO:tasks.workunit.client.0.smithi148.stdout:1/65: dwrite f0 [0,4194304] 0 2024-02-28T16:26:27.838 INFO:tasks.workunit.client.0.smithi148.stdout:5/49: read d1/f9 [2063095,53792] 0 2024-02-28T16:26:27.844 INFO:tasks.workunit.client.0.smithi148.stdout:5/50: rename d1/d8 to d1/d8/df 22 2024-02-28T16:26:27.858 INFO:tasks.workunit.client.0.smithi148.stdout:7/92: dwrite d0/f1 [0,4194304] 0 2024-02-28T16:26:27.859 INFO:tasks.workunit.client.0.smithi148.stdout:5/51: mknod d1/d8/c10 0 2024-02-28T16:26:27.859 INFO:tasks.workunit.client.0.smithi148.stdout:9/84: fsync d7/d15/f1b 0 2024-02-28T16:26:27.860 INFO:tasks.workunit.client.0.smithi148.stdout:1/66: write d2/d5/d6/d7/f12 [7775,44868] 0 2024-02-28T16:26:27.862 INFO:tasks.workunit.client.0.smithi148.stdout:9/85: chown d7/d15 88 1 2024-02-28T16:26:27.866 INFO:tasks.workunit.client.0.smithi148.stdout:0/137: rmdir d1/d2f 0 2024-02-28T16:26:27.870 INFO:tasks.workunit.client.0.smithi148.stdout:7/93: mkdir d0/d18 0 2024-02-28T16:26:27.871 INFO:tasks.workunit.client.0.smithi148.stdout:5/52: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:27.874 INFO:tasks.workunit.client.0.smithi148.stdout:3/131: link d1/d13/d19/d1b/l24 d1/d13/d19/l27 0 2024-02-28T16:26:27.877 INFO:tasks.workunit.client.0.smithi148.stdout:9/86: mknod d7/dd/c1d 0 2024-02-28T16:26:27.879 INFO:tasks.workunit.client.0.smithi148.stdout:1/67: fsync f0 0 2024-02-28T16:26:27.880 INFO:tasks.workunit.client.0.smithi148.stdout:7/94: mkdir d0/d18/d19 0 2024-02-28T16:26:27.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/53: read d1/f9 [856170,42195] 0 2024-02-28T16:26:27.880 INFO:tasks.workunit.client.0.smithi148.stdout:3/132: chown d1/f3 3452 1 2024-02-28T16:26:27.884 INFO:tasks.workunit.client.0.smithi148.stdout:9/87: mkdir d7/dd/d1e 0 2024-02-28T16:26:27.887 INFO:tasks.workunit.client.0.smithi148.stdout:2/75: dwrite d0/f10 [0,4194304] 0 2024-02-28T16:26:27.888 INFO:tasks.workunit.client.0.smithi148.stdout:5/54: stat d1/d8/c7 0 2024-02-28T16:26:27.890 INFO:tasks.workunit.client.0.smithi148.stdout:1/68: write d2/d5/d6/d7/f12 [382690,1474] 0 2024-02-28T16:26:27.892 INFO:tasks.workunit.client.0.smithi148.stdout:3/133: creat d1/d13/d19/f28 x:0 0 0 2024-02-28T16:26:27.892 INFO:tasks.workunit.client.0.smithi148.stdout:6/95: dwrite d0/d4/fa [0,4194304] 0 2024-02-28T16:26:27.893 INFO:tasks.workunit.client.0.smithi148.stdout:9/88: write f3 [3395373,130138] 0 2024-02-28T16:26:27.900 INFO:tasks.workunit.client.0.smithi148.stdout:0/138: link d1/d15/d8/cd d1/d15/d8/c37 0 2024-02-28T16:26:27.902 INFO:tasks.workunit.client.0.smithi148.stdout:1/69: symlink d2/d5/d6/l17 0 2024-02-28T16:26:27.906 INFO:tasks.workunit.client.0.smithi148.stdout:0/139: fsync d1/d4/fe 0 2024-02-28T16:26:27.910 INFO:tasks.workunit.client.0.smithi148.stdout:9/89: mkdir d7/d1c/d1f 0 2024-02-28T16:26:27.910 INFO:tasks.workunit.client.0.smithi148.stdout:0/140: read d1/d4/f16 [1084294,5194] 0 2024-02-28T16:26:27.913 INFO:tasks.workunit.client.0.smithi148.stdout:0/141: chown d1/d15/d8/f1d 719307 1 2024-02-28T16:26:27.917 INFO:tasks.workunit.client.0.smithi148.stdout:6/96: creat d0/d8/d21/f23 x:0 0 0 2024-02-28T16:26:27.920 INFO:tasks.workunit.client.0.smithi148.stdout:7/95: truncate d0/d9/fe 626141 0 2024-02-28T16:26:27.922 INFO:tasks.workunit.client.0.smithi148.stdout:3/134: dwrite d1/f3 [0,4194304] 0 2024-02-28T16:26:27.923 INFO:tasks.workunit.client.0.smithi148.stdout:9/90: creat d7/d1c/f20 x:0 0 0 2024-02-28T16:26:27.925 INFO:tasks.workunit.client.0.smithi148.stdout:2/76: getdents d0 0 2024-02-28T16:26:27.928 INFO:tasks.workunit.client.0.smithi148.stdout:5/55: truncate d1/d8/fa 2467843 0 2024-02-28T16:26:27.928 INFO:tasks.workunit.client.0.smithi148.stdout:8/104: sync 2024-02-28T16:26:27.929 INFO:tasks.workunit.client.0.smithi148.stdout:0/142: rmdir d1 39 2024-02-28T16:26:27.936 INFO:tasks.workunit.client.0.smithi148.stdout:3/135: mknod d1/c29 0 2024-02-28T16:26:27.937 INFO:tasks.workunit.client.0.smithi148.stdout:2/77: mkdir d0/d1c 0 2024-02-28T16:26:27.944 INFO:tasks.workunit.client.0.smithi148.stdout:5/56: rmdir d1/d8 39 2024-02-28T16:26:27.946 INFO:tasks.workunit.client.0.smithi148.stdout:7/96: rename d0/d4/ff to d0/d9/f1a 0 2024-02-28T16:26:27.948 INFO:tasks.workunit.client.0.smithi148.stdout:7/97: readlink d0/d4/l8 0 2024-02-28T16:26:27.949 INFO:tasks.workunit.client.0.smithi148.stdout:3/136: dread d1/f20 [0,4194304] 0 2024-02-28T16:26:27.951 INFO:tasks.workunit.client.0.smithi148.stdout:9/91: getdents d7/dd/d1e 0 2024-02-28T16:26:27.957 INFO:tasks.workunit.client.0.smithi148.stdout:0/143: rename d1/d4/f16 to d1/d15/d27/d34/f38 0 2024-02-28T16:26:27.962 INFO:tasks.workunit.client.0.smithi148.stdout:6/97: truncate d0/d8/fc 338172 0 2024-02-28T16:26:27.963 INFO:tasks.workunit.client.0.smithi148.stdout:5/57: mknod d1/d8/c11 0 2024-02-28T16:26:27.968 INFO:tasks.workunit.client.0.smithi148.stdout:2/78: mkdir d0/d1d 0 2024-02-28T16:26:27.969 INFO:tasks.workunit.client.0.smithi148.stdout:6/98: rmdir d0 39 2024-02-28T16:26:27.971 INFO:tasks.workunit.client.0.smithi148.stdout:3/137: rename d1/f20 to d1/d13/d19/d1b/f2a 0 2024-02-28T16:26:27.971 INFO:tasks.workunit.client.0.smithi148.stdout:8/105: dwrite d1/d3/fa [0,4194304] 0 2024-02-28T16:26:27.974 INFO:tasks.workunit.client.0.smithi148.stdout:8/106: read d1/f1c [167663,29238] 0 2024-02-28T16:26:27.978 INFO:tasks.workunit.client.0.smithi148.stdout:3/138: fdatasync d1/d13/f23 0 2024-02-28T16:26:27.978 INFO:tasks.workunit.client.0.smithi148.stdout:5/58: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:27.978 INFO:tasks.workunit.client.0.smithi148.stdout:5/59: chown d1/ld 56201143 1 2024-02-28T16:26:27.980 INFO:tasks.workunit.client.0.smithi148.stdout:7/98: write d0/d9/f1a [3185,130221] 0 2024-02-28T16:26:27.981 INFO:tasks.workunit.client.0.smithi148.stdout:9/92: creat d7/f21 x:0 0 0 2024-02-28T16:26:27.986 INFO:tasks.workunit.client.0.smithi148.stdout:0/144: truncate d1/f22 1442812 0 2024-02-28T16:26:27.991 INFO:tasks.workunit.client.0.smithi148.stdout:3/139: truncate d1/d13/f15 545417 0 2024-02-28T16:26:27.993 INFO:tasks.workunit.client.0.smithi148.stdout:3/140: write d1/fd [512763,73073] 0 2024-02-28T16:26:27.994 INFO:tasks.workunit.client.0.smithi148.stdout:9/93: unlink d7/d15/f1b 0 2024-02-28T16:26:28.000 INFO:tasks.workunit.client.0.smithi148.stdout:0/145: chown d1/d4/d25/f32 45741374 1 2024-02-28T16:26:28.000 INFO:tasks.workunit.client.0.smithi148.stdout:7/99: dwrite d0/d9/f1a [0,4194304] 0 2024-02-28T16:26:28.000 INFO:tasks.workunit.client.0.smithi148.stdout:6/99: truncate d0/f16 674338 0 2024-02-28T16:26:28.000 INFO:tasks.workunit.client.0.smithi148.stdout:7/100: read - d0/d4/f15 zero size 2024-02-28T16:26:28.001 INFO:tasks.workunit.client.0.smithi148.stdout:7/101: chown d0/l14 165977699 1 2024-02-28T16:26:28.003 INFO:tasks.workunit.client.0.smithi148.stdout:8/107: link d1/d3/f4 d1/d3/f20 0 2024-02-28T16:26:28.003 INFO:tasks.workunit.client.0.smithi148.stdout:2/79: dread d0/f10 [0,4194304] 0 2024-02-28T16:26:28.006 INFO:tasks.workunit.client.0.smithi148.stdout:3/141: stat d1/d13/d19/f1c 0 2024-02-28T16:26:28.010 INFO:tasks.workunit.client.0.smithi148.stdout:6/100: creat d0/d8/d21/f24 x:0 0 0 2024-02-28T16:26:28.017 INFO:tasks.workunit.client.0.smithi148.stdout:8/108: creat d1/dd/d13/d1a/f21 x:0 0 0 2024-02-28T16:26:28.019 INFO:tasks.workunit.client.0.smithi148.stdout:7/102: dwrite d0/f7 [0,4194304] 0 2024-02-28T16:26:28.022 INFO:tasks.workunit.client.0.smithi148.stdout:3/142: dread d1/d13/d19/f1c [0,4194304] 0 2024-02-28T16:26:28.022 INFO:tasks.workunit.client.0.smithi148.stdout:2/80: unlink d0/d9/fa 0 2024-02-28T16:26:28.025 INFO:tasks.workunit.client.0.smithi148.stdout:9/94: creat d7/f22 x:0 0 0 2024-02-28T16:26:28.026 INFO:tasks.workunit.client.0.smithi148.stdout:2/81: write d0/d9/d13/f16 [772499,90194] 0 2024-02-28T16:26:28.026 INFO:tasks.workunit.client.0.smithi148.stdout:0/146: link d1/d15/d8/c18 d1/d15/d27/d34/c39 0 2024-02-28T16:26:28.028 INFO:tasks.workunit.client.0.smithi148.stdout:9/95: write d7/f18 [1226961,29915] 0 2024-02-28T16:26:28.031 INFO:tasks.workunit.client.0.smithi148.stdout:8/109: rmdir d1/dd/d13 39 2024-02-28T16:26:28.033 INFO:tasks.workunit.client.0.smithi148.stdout:7/103: mkdir d0/d9/d1b 0 2024-02-28T16:26:28.033 INFO:tasks.workunit.client.0.smithi148.stdout:8/110: chown d1/d3/f4 688 1 2024-02-28T16:26:28.035 INFO:tasks.workunit.client.0.smithi148.stdout:3/143: unlink d1/f3 0 2024-02-28T16:26:28.036 INFO:tasks.workunit.client.0.smithi148.stdout:3/144: write d1/fd [9317867,4155] 0 2024-02-28T16:26:28.038 INFO:tasks.workunit.client.0.smithi148.stdout:2/82: chown d0/dd 88 1 2024-02-28T16:26:28.040 INFO:tasks.workunit.client.0.smithi148.stdout:3/145: write d1/d13/d19/d1b/f1f [731174,40515] 0 2024-02-28T16:26:28.043 INFO:tasks.workunit.client.0.smithi148.stdout:9/96: rename d7/dd/l19 to d7/d1c/l23 0 2024-02-28T16:26:28.050 INFO:tasks.workunit.client.0.smithi148.stdout:8/111: mkdir d1/de/d22 0 2024-02-28T16:26:28.052 INFO:tasks.workunit.client.0.smithi148.stdout:2/83: write d0/f10 [1680138,115772] 0 2024-02-28T16:26:28.053 INFO:tasks.workunit.client.0.smithi148.stdout:9/97: mkdir d7/d15/d24 0 2024-02-28T16:26:28.055 INFO:tasks.workunit.client.0.smithi148.stdout:7/104: mkdir d0/d18/d19/d1c 0 2024-02-28T16:26:28.059 INFO:tasks.workunit.client.0.smithi148.stdout:9/98: dread - d7/d1c/f20 zero size 2024-02-28T16:26:28.060 INFO:tasks.workunit.client.0.smithi148.stdout:8/112: mkdir d1/dd/d13/d23 0 2024-02-28T16:26:28.067 INFO:tasks.workunit.client.0.smithi148.stdout:3/146: dwrite d1/d13/f17 [0,4194304] 0 2024-02-28T16:26:28.069 INFO:tasks.workunit.client.0.smithi148.stdout:9/99: symlink d7/d15/d24/l25 0 2024-02-28T16:26:28.074 INFO:tasks.workunit.client.0.smithi148.stdout:6/101: dwrite d0/d8/fc [0,4194304] 0 2024-02-28T16:26:28.074 INFO:tasks.workunit.client.0.smithi148.stdout:8/113: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:28.075 INFO:tasks.workunit.client.0.smithi148.stdout:3/147: creat d1/d13/f2b x:0 0 0 2024-02-28T16:26:28.082 INFO:tasks.workunit.client.0.smithi148.stdout:3/148: symlink d1/l2c 0 2024-02-28T16:26:28.084 INFO:tasks.workunit.client.0.smithi148.stdout:6/102: unlink d0/d8/d21/f24 0 2024-02-28T16:26:28.084 INFO:tasks.workunit.client.0.smithi148.stdout:8/114: mkdir d1/dd/d13/d24 0 2024-02-28T16:26:28.093 INFO:tasks.workunit.client.0.smithi148.stdout:2/84: dwrite d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:28.097 INFO:tasks.workunit.client.0.smithi148.stdout:7/105: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:28.101 INFO:tasks.workunit.client.0.smithi148.stdout:8/115: chown d1/d3/f1e 614 1 2024-02-28T16:26:28.104 INFO:tasks.workunit.client.0.smithi148.stdout:2/85: read - d0/d18/f19 zero size 2024-02-28T16:26:28.104 INFO:tasks.workunit.client.0.smithi148.stdout:6/103: truncate d0/d8/d21/f23 860321 0 2024-02-28T16:26:28.111 INFO:tasks.workunit.client.0.smithi148.stdout:9/100: dwrite d7/d1c/f20 [0,4194304] 0 2024-02-28T16:26:28.112 INFO:tasks.workunit.client.0.smithi148.stdout:6/104: mkdir d0/d22/d25 0 2024-02-28T16:26:28.118 INFO:tasks.workunit.client.0.smithi148.stdout:9/101: fsync d7/f17 0 2024-02-28T16:26:28.118 INFO:tasks.workunit.client.0.smithi148.stdout:2/86: write d0/d9/d13/f16 [3105410,124000] 0 2024-02-28T16:26:28.122 INFO:tasks.workunit.client.0.smithi148.stdout:6/105: write d0/d8/ff [584456,66441] 0 2024-02-28T16:26:28.124 INFO:tasks.workunit.client.0.smithi148.stdout:8/116: dread d1/f1c [0,4194304] 0 2024-02-28T16:26:28.127 INFO:tasks.workunit.client.0.smithi148.stdout:2/87: fsync d0/f10 0 2024-02-28T16:26:28.129 INFO:tasks.workunit.client.0.smithi148.stdout:7/106: dread d0/d9/fe [0,4194304] 0 2024-02-28T16:26:28.129 INFO:tasks.workunit.client.0.smithi148.stdout:3/149: dwrite d1/d13/f21 [0,4194304] 0 2024-02-28T16:26:28.130 INFO:tasks.workunit.client.0.smithi148.stdout:9/102: chown l4 1224 1 2024-02-28T16:26:28.134 INFO:tasks.workunit.client.0.smithi148.stdout:6/106: fsync d0/f6 0 2024-02-28T16:26:28.136 INFO:tasks.workunit.client.0.smithi148.stdout:8/117: mkdir d1/dd/d13/d1a/d25 0 2024-02-28T16:26:28.140 INFO:tasks.workunit.client.0.smithi148.stdout:8/118: chown d1/dd/d13/d23 36 1 2024-02-28T16:26:28.140 INFO:tasks.workunit.client.0.smithi148.stdout:9/103: getdents d7/d1c/d1f 0 2024-02-28T16:26:28.144 INFO:tasks.workunit.client.0.smithi148.stdout:3/150: symlink d1/d13/d19/l2d 0 2024-02-28T16:26:28.150 INFO:tasks.workunit.client.0.smithi148.stdout:9/104: chown d7/ca 358 1 2024-02-28T16:26:28.150 INFO:tasks.workunit.client.0.smithi148.stdout:8/119: creat d1/de/d22/f26 x:0 0 0 2024-02-28T16:26:28.151 INFO:tasks.workunit.client.0.smithi148.stdout:3/151: fsync d1/d13/f2b 0 2024-02-28T16:26:28.152 INFO:tasks.workunit.client.0.smithi148.stdout:9/105: stat d7/f17 0 2024-02-28T16:26:28.154 INFO:tasks.workunit.client.0.smithi148.stdout:3/152: chown d1/d13/f15 75 1 2024-02-28T16:26:28.155 INFO:tasks.workunit.client.0.smithi148.stdout:8/120: write d1/d3/f1e [1104029,108204] 0 2024-02-28T16:26:28.157 INFO:tasks.workunit.client.0.smithi148.stdout:7/107: dread d0/f1 [0,4194304] 0 2024-02-28T16:26:28.159 INFO:tasks.workunit.client.0.smithi148.stdout:3/153: dread - d1/d13/f23 zero size 2024-02-28T16:26:28.159 INFO:tasks.workunit.client.0.smithi148.stdout:8/121: fdatasync d1/d3/f4 0 2024-02-28T16:26:28.160 INFO:tasks.workunit.client.0.smithi148.stdout:7/108: fsync d0/f2 0 2024-02-28T16:26:28.162 INFO:tasks.workunit.client.0.smithi148.stdout:2/88: dwrite d0/f10 [0,4194304] 0 2024-02-28T16:26:28.162 INFO:tasks.workunit.client.0.smithi148.stdout:9/106: getdents d7/d15 0 2024-02-28T16:26:28.164 INFO:tasks.workunit.client.0.smithi148.stdout:6/107: dwrite d0/d10/f13 [0,4194304] 0 2024-02-28T16:26:28.165 INFO:tasks.workunit.client.0.smithi148.stdout:2/89: chown d0/dd/c1b 13280651 1 2024-02-28T16:26:28.167 INFO:tasks.workunit.client.0.smithi148.stdout:6/108: chown d0/d4 998191112 1 2024-02-28T16:26:28.172 INFO:tasks.workunit.client.0.smithi148.stdout:6/109: write d0/d4/f11 [2933752,127750] 0 2024-02-28T16:26:28.175 INFO:tasks.workunit.client.0.smithi148.stdout:8/122: getdents d1/dd/d13/d24 0 2024-02-28T16:26:28.177 INFO:tasks.workunit.client.0.smithi148.stdout:2/90: symlink d0/d1c/l1e 0 2024-02-28T16:26:28.177 INFO:tasks.workunit.client.0.smithi148.stdout:8/123: fdatasync d1/dd/f10 0 2024-02-28T16:26:28.178 INFO:tasks.workunit.client.0.smithi148.stdout:2/91: fdatasync d0/d18/f19 0 2024-02-28T16:26:28.183 INFO:tasks.workunit.client.0.smithi148.stdout:3/154: getdents d1 0 2024-02-28T16:26:28.183 INFO:tasks.workunit.client.0.smithi148.stdout:2/92: write d0/d9/d13/f16 [3095963,103976] 0 2024-02-28T16:26:28.183 INFO:tasks.workunit.client.0.smithi148.stdout:8/124: creat d1/f27 x:0 0 0 2024-02-28T16:26:28.189 INFO:tasks.workunit.client.0.smithi148.stdout:9/107: dwrite d7/fc [0,4194304] 0 2024-02-28T16:26:28.190 INFO:tasks.workunit.client.0.smithi148.stdout:3/155: symlink d1/d13/l2e 0 2024-02-28T16:26:28.192 INFO:tasks.workunit.client.0.smithi148.stdout:2/93: creat d0/d1c/f1f x:0 0 0 2024-02-28T16:26:28.193 INFO:tasks.workunit.client.0.smithi148.stdout:8/125: symlink d1/de/l28 0 2024-02-28T16:26:28.196 INFO:tasks.workunit.client.0.smithi148.stdout:3/156: symlink d1/l2f 0 2024-02-28T16:26:28.197 INFO:tasks.workunit.client.0.smithi148.stdout:6/110: write d0/f1d [87855,49638] 0 2024-02-28T16:26:28.198 INFO:tasks.workunit.client.0.smithi148.stdout:3/157: write d1/d13/f21 [4967758,94632] 0 2024-02-28T16:26:28.199 INFO:tasks.workunit.client.0.smithi148.stdout:9/108: rename d7/dd/d1e to d7/dd/d26 0 2024-02-28T16:26:28.201 INFO:tasks.workunit.client.0.smithi148.stdout:2/94: rmdir d0/d9/d13 39 2024-02-28T16:26:28.206 INFO:tasks.workunit.client.0.smithi148.stdout:8/126: mknod d1/dd/d13/d24/c29 0 2024-02-28T16:26:28.211 INFO:tasks.workunit.client.0.smithi148.stdout:6/111: rename d0/d4/d1b/l1e to d0/d4/d1b/l26 0 2024-02-28T16:26:28.211 INFO:tasks.workunit.client.0.smithi148.stdout:2/95: mkdir d0/d18/d20 0 2024-02-28T16:26:28.213 INFO:tasks.workunit.client.0.smithi148.stdout:9/109: creat d7/d1c/d1f/f27 x:0 0 0 2024-02-28T16:26:28.215 INFO:tasks.workunit.client.0.smithi148.stdout:8/127: symlink d1/dd/d13/d24/l2a 0 2024-02-28T16:26:28.215 INFO:tasks.workunit.client.0.smithi148.stdout:9/110: chown d7/f17 2 1 2024-02-28T16:26:28.218 INFO:tasks.workunit.client.0.smithi148.stdout:6/112: dread d0/d10/f12 [0,4194304] 0 2024-02-28T16:26:28.232 INFO:tasks.workunit.client.0.smithi148.stdout:8/128: write d1/f9 [1420941,56039] 0 2024-02-28T16:26:28.233 INFO:tasks.workunit.client.0.smithi148.stdout:2/96: dread d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:28.246 INFO:tasks.workunit.client.0.smithi148.stdout:3/158: dwrite d1/fa [0,4194304] 0 2024-02-28T16:26:28.246 INFO:tasks.workunit.client.0.smithi148.stdout:9/111: dwrite d7/f17 [0,4194304] 0 2024-02-28T16:26:28.250 INFO:tasks.workunit.client.0.smithi148.stdout:6/113: dwrite d0/d10/f1a [0,4194304] 0 2024-02-28T16:26:28.253 INFO:tasks.workunit.client.0.smithi148.stdout:3/159: creat d1/d13/d19/f30 x:0 0 0 2024-02-28T16:26:28.253 INFO:tasks.workunit.client.0.smithi148.stdout:2/97: getdents d0/d1d 0 2024-02-28T16:26:28.254 INFO:tasks.workunit.client.0.smithi148.stdout:9/112: mknod d7/dd/d26/c28 0 2024-02-28T16:26:28.261 INFO:tasks.workunit.client.0.smithi148.stdout:6/114: mkdir d0/d22/d27 0 2024-02-28T16:26:28.262 INFO:tasks.workunit.client.0.smithi148.stdout:9/113: write d7/d1c/d1f/f27 [39699,75300] 0 2024-02-28T16:26:28.264 INFO:tasks.workunit.client.0.smithi148.stdout:3/160: readlink d1/d13/d19/l27 0 2024-02-28T16:26:28.266 INFO:tasks.workunit.client.0.smithi148.stdout:6/115: chown d0/d8/d21/f23 4 1 2024-02-28T16:26:28.266 INFO:tasks.workunit.client.0.smithi148.stdout:2/98: write d0/d9/d13/f16 [3522522,89509] 0 2024-02-28T16:26:28.270 INFO:tasks.workunit.client.0.smithi148.stdout:6/116: write d0/f16 [1059068,28645] 0 2024-02-28T16:26:28.271 INFO:tasks.workunit.client.0.smithi148.stdout:8/129: dwrite d1/de/ff [0,4194304] 0 2024-02-28T16:26:28.271 INFO:tasks.workunit.client.0.smithi148.stdout:2/99: dread - d0/d1c/f1f zero size 2024-02-28T16:26:28.272 INFO:tasks.workunit.client.0.smithi148.stdout:6/117: chown d0/d22/d27 11376 1 2024-02-28T16:26:28.272 INFO:tasks.workunit.client.0.smithi148.stdout:9/114: rename l4 to d7/dd/d26/l29 0 2024-02-28T16:26:28.278 INFO:tasks.workunit.client.0.smithi148.stdout:9/115: truncate d7/d1c/f20 4529808 0 2024-02-28T16:26:28.290 INFO:tasks.workunit.client.0.smithi148.stdout:2/100: unlink d0/d9/d13/l15 0 2024-02-28T16:26:28.298 INFO:tasks.workunit.client.0.smithi148.stdout:2/101: fsync d0/d1c/f1f 0 2024-02-28T16:26:28.299 INFO:tasks.workunit.client.0.smithi148.stdout:8/130: dwrite d1/dd/d13/d1a/f21 [0,4194304] 0 2024-02-28T16:26:28.301 INFO:tasks.workunit.client.0.smithi148.stdout:6/118: dwrite d0/f16 [0,4194304] 0 2024-02-28T16:26:28.305 INFO:tasks.workunit.client.0.smithi148.stdout:9/116: dwrite d7/fc [0,4194304] 0 2024-02-28T16:26:28.312 INFO:tasks.workunit.client.0.smithi148.stdout:6/119: rmdir d0 39 2024-02-28T16:26:28.312 INFO:tasks.workunit.client.0.smithi148.stdout:9/117: chown d7/dd/d26 7616802 1 2024-02-28T16:26:28.316 INFO:tasks.workunit.client.0.smithi148.stdout:2/102: creat d0/d9/f21 x:0 0 0 2024-02-28T16:26:28.317 INFO:tasks.workunit.client.0.smithi148.stdout:8/131: rename d1/dd/d13/d1a/f21 to d1/d3/d18/f2b 0 2024-02-28T16:26:28.318 INFO:tasks.workunit.client.0.smithi148.stdout:9/118: dread - d7/f22 zero size 2024-02-28T16:26:28.320 INFO:tasks.workunit.client.0.smithi148.stdout:2/103: rmdir d0/d1c 39 2024-02-28T16:26:28.321 INFO:tasks.workunit.client.0.smithi148.stdout:3/161: dwrite d1/d13/f15 [0,4194304] 0 2024-02-28T16:26:28.322 INFO:tasks.workunit.client.0.smithi148.stdout:8/132: truncate d1/f27 226334 0 2024-02-28T16:26:28.327 INFO:tasks.workunit.client.0.smithi148.stdout:9/119: symlink d7/dd/l2a 0 2024-02-28T16:26:28.328 INFO:tasks.workunit.client.0.smithi148.stdout:2/104: write d0/d9/d13/f16 [3685087,1995] 0 2024-02-28T16:26:28.331 INFO:tasks.workunit.client.0.smithi148.stdout:3/162: symlink d1/d13/l31 0 2024-02-28T16:26:28.331 INFO:tasks.workunit.client.0.smithi148.stdout:8/133: unlink d1/d3/c15 0 2024-02-28T16:26:28.333 INFO:tasks.workunit.client.0.smithi148.stdout:2/105: dread - d0/d9/f21 zero size 2024-02-28T16:26:28.333 INFO:tasks.workunit.client.0.smithi148.stdout:3/163: stat d1/l12 0 2024-02-28T16:26:28.334 INFO:tasks.workunit.client.0.smithi148.stdout:6/120: rename d0/d8/fc to d0/d4/d14/f28 0 2024-02-28T16:26:28.335 INFO:tasks.workunit.client.0.smithi148.stdout:2/106: dread - d0/d9/f21 zero size 2024-02-28T16:26:28.336 INFO:tasks.workunit.client.0.smithi148.stdout:3/164: mkdir d1/d13/d19/d32 0 2024-02-28T16:26:28.337 INFO:tasks.workunit.client.0.smithi148.stdout:3/165: stat d1/d13/l1a 0 2024-02-28T16:26:28.338 INFO:tasks.workunit.client.0.smithi148.stdout:6/121: mknod d0/d10/c29 0 2024-02-28T16:26:28.340 INFO:tasks.workunit.client.0.smithi148.stdout:3/166: write d1/f8 [534138,2606] 0 2024-02-28T16:26:28.341 INFO:tasks.workunit.client.0.smithi148.stdout:2/107: mknod d0/d1d/c22 0 2024-02-28T16:26:28.342 INFO:tasks.workunit.client.0.smithi148.stdout:2/108: readlink d0/d9/l17 0 2024-02-28T16:26:28.344 INFO:tasks.workunit.client.0.smithi148.stdout:8/134: getdents d1/dd 0 2024-02-28T16:26:28.345 INFO:tasks.workunit.client.0.smithi148.stdout:8/135: fsync d1/d3/fa 0 2024-02-28T16:26:28.346 INFO:tasks.workunit.client.0.smithi148.stdout:8/136: readlink d1/dd/d13/d24/l2a 0 2024-02-28T16:26:28.349 INFO:tasks.workunit.client.0.smithi148.stdout:3/167: dread d1/fa [0,4194304] 0 2024-02-28T16:26:28.352 INFO:tasks.workunit.client.0.smithi148.stdout:2/109: write d0/d1c/f1f [653263,85562] 0 2024-02-28T16:26:28.355 INFO:tasks.workunit.client.0.smithi148.stdout:6/122: link d0/d4/c18 d0/d22/c2a 0 2024-02-28T16:26:28.357 INFO:tasks.workunit.client.0.smithi148.stdout:8/137: unlink d1/d3/f1d 0 2024-02-28T16:26:28.370 INFO:tasks.workunit.client.0.smithi148.stdout:3/168: dwrite d1/d13/d19/f30 [0,4194304] 0 2024-02-28T16:26:28.372 INFO:tasks.workunit.client.0.smithi148.stdout:2/110: dwrite d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:28.374 INFO:tasks.workunit.client.0.smithi148.stdout:8/138: getdents d1/dd/d13/d1a 0 2024-02-28T16:26:28.378 INFO:tasks.workunit.client.0.smithi148.stdout:6/123: link d0/ce d0/d8/c2b 0 2024-02-28T16:26:28.383 INFO:tasks.workunit.client.0.smithi148.stdout:8/139: fdatasync d1/f9 0 2024-02-28T16:26:28.389 INFO:tasks.workunit.client.0.smithi148.stdout:8/140: mkdir d1/de/d2c 0 2024-02-28T16:26:28.393 INFO:tasks.workunit.client.0.smithi148.stdout:8/141: chown d1/d3/f20 150255678 1 2024-02-28T16:26:28.399 INFO:tasks.workunit.client.0.smithi148.stdout:6/124: dread d0/d4/fa [0,4194304] 0 2024-02-28T16:26:28.400 INFO:tasks.workunit.client.0.smithi148.stdout:8/142: rename d1/c8 to d1/de/d2c/c2d 0 2024-02-28T16:26:28.402 INFO:tasks.workunit.client.0.smithi148.stdout:3/169: dwrite d1/d13/d19/f1c [0,4194304] 0 2024-02-28T16:26:28.404 INFO:tasks.workunit.client.0.smithi148.stdout:2/111: dwrite d0/d1c/f1f [0,4194304] 0 2024-02-28T16:26:28.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/143: readlink d1/dd/d13/d24/l2a 0 2024-02-28T16:26:28.412 INFO:tasks.workunit.client.0.smithi148.stdout:3/170: creat d1/d13/d19/f33 x:0 0 0 2024-02-28T16:26:28.419 INFO:tasks.workunit.client.0.smithi148.stdout:8/144: read d1/d3/f20 [648919,71571] 0 2024-02-28T16:26:28.423 INFO:tasks.workunit.client.0.smithi148.stdout:8/145: read d1/f9 [467828,127512] 0 2024-02-28T16:26:28.425 INFO:tasks.workunit.client.0.smithi148.stdout:6/125: dread d0/d4/d14/f28 [0,4194304] 0 2024-02-28T16:26:28.426 INFO:tasks.workunit.client.0.smithi148.stdout:8/146: chown d1/dd/d13/d24/l2a 4904392 1 2024-02-28T16:26:28.428 INFO:tasks.workunit.client.0.smithi148.stdout:6/126: write d0/f1d [1121389,69081] 0 2024-02-28T16:26:28.428 INFO:tasks.workunit.client.0.smithi148.stdout:2/112: dwrite d0/d1c/f1f [0,4194304] 0 2024-02-28T16:26:28.430 INFO:tasks.workunit.client.0.smithi148.stdout:8/147: creat d1/f2e x:0 0 0 2024-02-28T16:26:28.431 INFO:tasks.workunit.client.0.smithi148.stdout:6/127: write d0/d10/f1a [3563302,59367] 0 2024-02-28T16:26:28.432 INFO:tasks.workunit.client.0.smithi148.stdout:3/171: dread d1/d13/d19/f1c [0,4194304] 0 2024-02-28T16:26:28.435 INFO:tasks.workunit.client.0.smithi148.stdout:3/172: chown d1/cc 404 1 2024-02-28T16:26:28.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/173: truncate d1/d13/d19/f30 4467594 0 2024-02-28T16:26:28.440 INFO:tasks.workunit.client.0.smithi148.stdout:3/174: read - d1/db/f22 zero size 2024-02-28T16:26:28.441 INFO:tasks.workunit.client.0.smithi148.stdout:6/128: unlink d0/d4/d1b/l26 0 2024-02-28T16:26:28.444 INFO:tasks.workunit.client.0.smithi148.stdout:6/129: chown d0/d4/f11 730010015 1 2024-02-28T16:26:28.444 INFO:tasks.workunit.client.0.smithi148.stdout:8/148: dread d1/d3/fa [0,4194304] 0 2024-02-28T16:26:28.445 INFO:tasks.workunit.client.0.smithi148.stdout:2/113: dread d0/f8 [0,4194304] 0 2024-02-28T16:26:28.446 INFO:tasks.workunit.client.0.smithi148.stdout:3/175: symlink d1/d13/d19/d1b/l34 0 2024-02-28T16:26:28.446 INFO:tasks.workunit.client.0.smithi148.stdout:8/149: write d1/f7 [1656493,127644] 0 2024-02-28T16:26:28.449 INFO:tasks.workunit.client.0.smithi148.stdout:3/176: rmdir d1/db 39 2024-02-28T16:26:28.451 INFO:tasks.workunit.client.0.smithi148.stdout:2/114: mkdir d0/d1d/d23 0 2024-02-28T16:26:28.451 INFO:tasks.workunit.client.0.smithi148.stdout:3/177: chown d1/d13/l2e 299532 1 2024-02-28T16:26:28.457 INFO:tasks.workunit.client.0.smithi148.stdout:6/130: dread d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:28.458 INFO:tasks.workunit.client.0.smithi148.stdout:3/178: mkdir d1/db/d35 0 2024-02-28T16:26:28.461 INFO:tasks.workunit.client.0.smithi148.stdout:2/115: creat d0/f24 x:0 0 0 2024-02-28T16:26:28.461 INFO:tasks.workunit.client.0.smithi148.stdout:6/131: write d0/d4/fa [3577706,115767] 0 2024-02-28T16:26:28.465 INFO:tasks.workunit.client.0.smithi148.stdout:2/116: mknod d0/d1d/c25 0 2024-02-28T16:26:28.466 INFO:tasks.workunit.client.0.smithi148.stdout:6/132: symlink d0/d4/d1b/l2c 0 2024-02-28T16:26:28.468 INFO:tasks.workunit.client.0.smithi148.stdout:2/117: readlink d0/l4 0 2024-02-28T16:26:28.469 INFO:tasks.workunit.client.0.smithi148.stdout:6/133: write d0/d4/fa [4669692,5650] 0 2024-02-28T16:26:28.471 INFO:tasks.workunit.client.0.smithi148.stdout:2/118: symlink d0/d9/d13/l26 0 2024-02-28T16:26:28.475 INFO:tasks.workunit.client.0.smithi148.stdout:8/150: truncate d1/d3/d18/f2b 397751 0 2024-02-28T16:26:28.477 INFO:tasks.workunit.client.0.smithi148.stdout:3/179: dwrite d1/d13/f1e [0,4194304] 0 2024-02-28T16:26:28.478 INFO:tasks.workunit.client.0.smithi148.stdout:8/151: write d1/f7 [1145550,116454] 0 2024-02-28T16:26:28.481 INFO:tasks.workunit.client.0.smithi148.stdout:6/134: symlink d0/l2d 0 2024-02-28T16:26:28.483 INFO:tasks.workunit.client.0.smithi148.stdout:2/119: creat d0/f27 x:0 0 0 2024-02-28T16:26:28.484 INFO:tasks.workunit.client.0.smithi148.stdout:2/120: readlink d0/d9/l17 0 2024-02-28T16:26:28.488 INFO:tasks.workunit.client.0.smithi148.stdout:3/180: link d1/c29 d1/c36 0 2024-02-28T16:26:28.491 INFO:tasks.workunit.client.0.smithi148.stdout:2/121: creat d0/d18/f28 x:0 0 0 2024-02-28T16:26:28.493 INFO:tasks.workunit.client.0.smithi148.stdout:2/122: symlink d0/d1c/l29 0 2024-02-28T16:26:28.495 INFO:tasks.workunit.client.0.smithi148.stdout:3/181: creat d1/d13/d19/d32/f37 x:0 0 0 2024-02-28T16:26:28.497 INFO:tasks.workunit.client.0.smithi148.stdout:3/182: readlink d1/d13/d19/d1b/l34 0 2024-02-28T16:26:28.497 INFO:tasks.workunit.client.0.smithi148.stdout:2/123: write d0/f10 [2329420,1387] 0 2024-02-28T16:26:28.499 INFO:tasks.workunit.client.0.smithi148.stdout:6/135: rmdir d0/d4/d1b 39 2024-02-28T16:26:28.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/183: dread - d1/db/f22 zero size 2024-02-28T16:26:28.501 INFO:tasks.workunit.client.0.smithi148.stdout:1/70: sync 2024-02-28T16:26:28.501 INFO:tasks.workunit.client.0.smithi148.stdout:4/87: sync 2024-02-28T16:26:28.501 INFO:tasks.workunit.client.0.smithi148.stdout:8/152: dwrite d1/d3/fa [0,4194304] 0 2024-02-28T16:26:28.502 INFO:tasks.workunit.client.0.smithi148.stdout:2/124: symlink d0/d1d/l2a 0 2024-02-28T16:26:28.506 INFO:tasks.workunit.client.0.smithi148.stdout:2/125: write d0/d1c/f1f [974127,56578] 0 2024-02-28T16:26:28.508 INFO:tasks.workunit.client.0.smithi148.stdout:2/126: truncate d0/f27 96565 0 2024-02-28T16:26:28.510 INFO:tasks.workunit.client.0.smithi148.stdout:4/88: symlink d8/l1a 0 2024-02-28T16:26:28.510 INFO:tasks.workunit.client.0.smithi148.stdout:2/127: truncate d0/f24 533376 0 2024-02-28T16:26:28.511 INFO:tasks.workunit.client.0.smithi148.stdout:4/89: write d8/f12 [381273,56934] 0 2024-02-28T16:26:28.512 INFO:tasks.workunit.client.0.smithi148.stdout:2/128: chown d0/d9/d13/l26 560862942 1 2024-02-28T16:26:28.512 INFO:tasks.workunit.client.0.smithi148.stdout:4/90: dread - d8/f18 zero size 2024-02-28T16:26:28.513 INFO:tasks.workunit.client.0.smithi148.stdout:3/184: mkdir d1/d13/d19/d1b/d38 0 2024-02-28T16:26:28.515 INFO:tasks.workunit.client.0.smithi148.stdout:2/129: write d0/d18/f19 [535059,80144] 0 2024-02-28T16:26:28.519 INFO:tasks.workunit.client.0.smithi148.stdout:8/153: unlink d1/d3/f5 0 2024-02-28T16:26:28.519 INFO:tasks.workunit.client.0.smithi148.stdout:6/136: rename d0/d10/f12 to d0/d4/d1b/f2e 0 2024-02-28T16:26:28.523 INFO:tasks.workunit.client.0.smithi148.stdout:1/71: symlink d2/l18 0 2024-02-28T16:26:28.526 INFO:tasks.workunit.client.0.smithi148.stdout:6/137: write d0/d10/f1a [1526007,103876] 0 2024-02-28T16:26:28.529 INFO:tasks.workunit.client.0.smithi148.stdout:4/91: write f0 [3220805,97388] 0 2024-02-28T16:26:28.529 INFO:tasks.workunit.client.0.smithi148.stdout:1/72: write d2/d5/ff [3967721,9281] 0 2024-02-28T16:26:28.531 INFO:tasks.workunit.client.0.smithi148.stdout:6/138: write d0/d10/f1a [785216,125998] 0 2024-02-28T16:26:28.532 INFO:tasks.workunit.client.0.smithi148.stdout:2/130: mkdir d0/dd/d2b 0 2024-02-28T16:26:28.541 INFO:tasks.workunit.client.0.smithi148.stdout:1/73: rmdir d2/d5 39 2024-02-28T16:26:28.544 INFO:tasks.workunit.client.0.smithi148.stdout:3/185: dwrite d1/d13/d19/d1b/f1f [0,4194304] 0 2024-02-28T16:26:28.548 INFO:tasks.workunit.client.0.smithi148.stdout:4/92: rename d8/f10 to d8/df/f1b 0 2024-02-28T16:26:28.548 INFO:tasks.workunit.client.0.smithi148.stdout:6/139: dread d0/f6 [0,4194304] 0 2024-02-28T16:26:28.551 INFO:tasks.workunit.client.0.smithi148.stdout:6/140: chown d0/f16 918447848 1 2024-02-28T16:26:28.555 INFO:tasks.workunit.client.0.smithi148.stdout:3/186: creat d1/db/f39 x:0 0 0 2024-02-28T16:26:28.557 INFO:tasks.workunit.client.0.smithi148.stdout:2/131: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:26:28.557 INFO:tasks.workunit.client.0.smithi148.stdout:7/109: sync 2024-02-28T16:26:28.557 INFO:tasks.workunit.client.0.smithi148.stdout:0/147: sync 2024-02-28T16:26:28.558 INFO:tasks.workunit.client.0.smithi148.stdout:5/60: sync 2024-02-28T16:26:28.559 INFO:tasks.workunit.client.0.smithi148.stdout:1/74: rename d2/d5/d6/d13 to d2/d5/d19 0 2024-02-28T16:26:28.561 INFO:tasks.workunit.client.0.smithi148.stdout:6/141: symlink d0/d22/l2f 0 2024-02-28T16:26:28.562 INFO:tasks.workunit.client.0.smithi148.stdout:4/93: link d8/f12 d8/f1c 0 2024-02-28T16:26:28.564 INFO:tasks.workunit.client.0.smithi148.stdout:4/94: fdatasync d8/f18 0 2024-02-28T16:26:28.568 INFO:tasks.workunit.client.0.smithi148.stdout:6/142: dread d0/d8/d21/f23 [0,4194304] 0 2024-02-28T16:26:28.570 INFO:tasks.workunit.client.0.smithi148.stdout:6/143: read d0/d10/f1a [2582057,2822] 0 2024-02-28T16:26:28.571 INFO:tasks.workunit.client.0.smithi148.stdout:1/75: mkdir d2/d5/d1a 0 2024-02-28T16:26:28.574 INFO:tasks.workunit.client.0.smithi148.stdout:3/187: unlink d1/c29 0 2024-02-28T16:26:28.581 INFO:tasks.workunit.client.0.smithi148.stdout:0/148: link d1/d15/d8/f29 d1/d15/d27/d34/f3a 0 2024-02-28T16:26:28.585 INFO:tasks.workunit.client.0.smithi148.stdout:0/149: chown d1/f24 1876 1 2024-02-28T16:26:28.588 INFO:tasks.workunit.client.0.smithi148.stdout:7/110: dwrite d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:28.590 INFO:tasks.workunit.client.0.smithi148.stdout:5/61: dread d1/d8/fa [0,4194304] 0 2024-02-28T16:26:28.591 INFO:tasks.workunit.client.0.smithi148.stdout:1/76: creat d2/d5/d6/f1b x:0 0 0 2024-02-28T16:26:28.594 INFO:tasks.workunit.client.0.smithi148.stdout:3/188: rename d1/d13/d19/l2d to d1/d13/l3a 0 2024-02-28T16:26:28.595 INFO:tasks.workunit.client.0.smithi148.stdout:4/95: dread d8/f11 [0,4194304] 0 2024-02-28T16:26:28.597 INFO:tasks.workunit.client.0.smithi148.stdout:7/111: rmdir d0/d9 39 2024-02-28T16:26:28.598 INFO:tasks.workunit.client.0.smithi148.stdout:1/77: read d2/d5/d6/d7/f14 [6511,36586] 0 2024-02-28T16:26:28.600 INFO:tasks.workunit.client.0.smithi148.stdout:3/189: write d1/db/f39 [963672,83457] 0 2024-02-28T16:26:28.600 INFO:tasks.workunit.client.0.smithi148.stdout:0/150: rename d1/d15/d8/l13 to d1/d15/l3b 0 2024-02-28T16:26:28.605 INFO:tasks.workunit.client.0.smithi148.stdout:1/78: chown d2/d5/d6/d7/fc 16810725 1 2024-02-28T16:26:28.605 INFO:tasks.workunit.client.0.smithi148.stdout:2/132: truncate d0/f8 2719175 0 2024-02-28T16:26:28.607 INFO:tasks.workunit.client.0.smithi148.stdout:6/144: dwrite d0/f6 [0,4194304] 0 2024-02-28T16:26:28.608 INFO:tasks.workunit.client.0.smithi148.stdout:1/79: stat d2/lb 0 2024-02-28T16:26:28.610 INFO:tasks.workunit.client.0.smithi148.stdout:4/96: creat d8/df/d17/f1d x:0 0 0 2024-02-28T16:26:28.613 INFO:tasks.workunit.client.0.smithi148.stdout:4/97: dread - d8/df/d17/f19 zero size 2024-02-28T16:26:28.627 INFO:tasks.workunit.client.0.smithi148.stdout:7/112: unlink d0/d9/l16 0 2024-02-28T16:26:28.629 INFO:tasks.workunit.client.0.smithi148.stdout:0/151: creat d1/d4/f3c x:0 0 0 2024-02-28T16:26:28.635 INFO:tasks.workunit.client.0.smithi148.stdout:2/133: dwrite d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:28.636 INFO:tasks.workunit.client.0.smithi148.stdout:1/80: rename d2/d5/d6/cd to d2/d5/d1a/c1c 0 2024-02-28T16:26:28.637 INFO:tasks.workunit.client.0.smithi148.stdout:6/145: dwrite d0/f16 [4194304,4194304] 0 2024-02-28T16:26:28.637 INFO:tasks.workunit.client.0.smithi148.stdout:4/98: symlink d8/l1e 0 2024-02-28T16:26:28.637 INFO:tasks.workunit.client.0.smithi148.stdout:7/113: fsync d0/d4/f15 0 2024-02-28T16:26:28.643 INFO:tasks.workunit.client.0.smithi148.stdout:4/99: write f7 [1653512,103959] 0 2024-02-28T16:26:28.647 INFO:tasks.workunit.client.0.smithi148.stdout:5/62: dwrite d1/f9 [0,4194304] 0 2024-02-28T16:26:28.654 INFO:tasks.workunit.client.0.smithi148.stdout:2/134: mkdir d0/dd/d2c 0 2024-02-28T16:26:28.659 INFO:tasks.workunit.client.0.smithi148.stdout:4/100: mkdir d8/df/d1f 0 2024-02-28T16:26:28.661 INFO:tasks.workunit.client.0.smithi148.stdout:5/63: dread d1/d8/fa [0,4194304] 0 2024-02-28T16:26:28.664 INFO:tasks.workunit.client.0.smithi148.stdout:6/146: truncate d0/d10/f1a 2128246 0 2024-02-28T16:26:28.664 INFO:tasks.workunit.client.0.smithi148.stdout:3/190: creat d1/d13/f3b x:0 0 0 2024-02-28T16:26:28.666 INFO:tasks.workunit.client.0.smithi148.stdout:1/81: creat d2/d15/f1d x:0 0 0 2024-02-28T16:26:28.667 INFO:tasks.workunit.client.0.smithi148.stdout:4/101: creat d8/df/f20 x:0 0 0 2024-02-28T16:26:28.669 INFO:tasks.workunit.client.0.smithi148.stdout:4/102: readlink d8/le 0 2024-02-28T16:26:28.674 INFO:tasks.workunit.client.0.smithi148.stdout:2/135: unlink d0/c12 0 2024-02-28T16:26:28.674 INFO:tasks.workunit.client.0.smithi148.stdout:3/191: write d1/d13/d19/f28 [125612,62082] 0 2024-02-28T16:26:28.676 INFO:tasks.workunit.client.0.smithi148.stdout:5/64: mkdir d1/d12 0 2024-02-28T16:26:28.678 INFO:tasks.workunit.client.0.smithi148.stdout:1/82: symlink d2/l1e 0 2024-02-28T16:26:28.682 INFO:tasks.workunit.client.0.smithi148.stdout:7/114: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:28.691 INFO:tasks.workunit.client.0.smithi148.stdout:1/83: creat d2/d5/f1f x:0 0 0 2024-02-28T16:26:28.698 INFO:tasks.workunit.client.0.smithi148.stdout:4/103: dwrite d8/df/f20 [0,4194304] 0 2024-02-28T16:26:28.699 INFO:tasks.workunit.client.0.smithi148.stdout:5/65: symlink d1/l13 0 2024-02-28T16:26:28.701 INFO:tasks.workunit.client.0.smithi148.stdout:0/152: dread d1/d4/fe [0,4194304] 0 2024-02-28T16:26:28.702 INFO:tasks.workunit.client.0.smithi148.stdout:9/120: sync 2024-02-28T16:26:28.702 INFO:tasks.workunit.client.0.smithi148.stdout:6/147: dwrite d0/f1d [0,4194304] 0 2024-02-28T16:26:28.706 INFO:tasks.workunit.client.0.smithi148.stdout:6/148: chown d0/d8/d21 401 1 2024-02-28T16:26:28.717 INFO:tasks.workunit.client.0.smithi148.stdout:4/104: mkdir d8/d21 0 2024-02-28T16:26:28.718 INFO:tasks.workunit.client.0.smithi148.stdout:4/105: chown l4 0 1 2024-02-28T16:26:28.719 INFO:tasks.workunit.client.0.smithi148.stdout:0/153: fdatasync d1/d15/f1c 0 2024-02-28T16:26:28.721 INFO:tasks.workunit.client.0.smithi148.stdout:4/106: chown d8/df/d17/f1d 17975140 1 2024-02-28T16:26:28.723 INFO:tasks.workunit.client.0.smithi148.stdout:4/107: readlink d8/le 0 2024-02-28T16:26:28.724 INFO:tasks.workunit.client.0.smithi148.stdout:1/84: dwrite d2/d5/d6/d7/f12 [0,4194304] 0 2024-02-28T16:26:28.725 INFO:tasks.workunit.client.0.smithi148.stdout:9/121: rename f3 to d7/dd/f2b 0 2024-02-28T16:26:28.727 INFO:tasks.workunit.client.0.smithi148.stdout:1/85: readlink d2/d5/d6/l17 0 2024-02-28T16:26:28.728 INFO:tasks.workunit.client.0.smithi148.stdout:3/192: rename d1/fd to d1/f3c 0 2024-02-28T16:26:28.730 INFO:tasks.workunit.client.0.smithi148.stdout:3/193: write d1/d13/f23 [396994,30148] 0 2024-02-28T16:26:28.732 INFO:tasks.workunit.client.0.smithi148.stdout:6/149: unlink d0/f6 0 2024-02-28T16:26:28.737 INFO:tasks.workunit.client.0.smithi148.stdout:8/154: sync 2024-02-28T16:26:28.745 INFO:tasks.workunit.client.0.smithi148.stdout:2/136: truncate d0/d1c/f1f 1720626 0 2024-02-28T16:26:28.746 INFO:tasks.workunit.client.0.smithi148.stdout:0/154: write d1/d15/d8/f20 [2229610,31638] 0 2024-02-28T16:26:28.749 INFO:tasks.workunit.client.0.smithi148.stdout:4/108: unlink d8/cc 0 2024-02-28T16:26:28.750 INFO:tasks.workunit.client.0.smithi148.stdout:5/66: write d1/d8/fa [3478412,58826] 0 2024-02-28T16:26:28.751 INFO:tasks.workunit.client.0.smithi148.stdout:4/109: chown f0 659645807 1 2024-02-28T16:26:28.753 INFO:tasks.workunit.client.0.smithi148.stdout:4/110: write d8/df/f20 [2390334,7603] 0 2024-02-28T16:26:28.755 INFO:tasks.workunit.client.0.smithi148.stdout:9/122: mknod d7/dd/c2c 0 2024-02-28T16:26:28.755 INFO:tasks.workunit.client.0.smithi148.stdout:6/150: dwrite d0/d4/fa [4194304,4194304] 0 2024-02-28T16:26:28.757 INFO:tasks.workunit.client.0.smithi148.stdout:1/86: symlink d2/d5/d1a/l20 0 2024-02-28T16:26:28.758 INFO:tasks.workunit.client.0.smithi148.stdout:1/87: chown d2/d5/d6/l17 0 1 2024-02-28T16:26:28.761 INFO:tasks.workunit.client.0.smithi148.stdout:3/194: mknod d1/d13/d19/d32/c3d 0 2024-02-28T16:26:28.764 INFO:tasks.workunit.client.0.smithi148.stdout:7/115: getdents d0/d9 0 2024-02-28T16:26:28.767 INFO:tasks.workunit.client.0.smithi148.stdout:0/155: unlink d1/d15/d8/f20 0 2024-02-28T16:26:28.770 INFO:tasks.workunit.client.0.smithi148.stdout:5/67: symlink d1/d8/l14 0 2024-02-28T16:26:28.773 INFO:tasks.workunit.client.0.smithi148.stdout:1/88: dwrite d2/d5/ff [0,4194304] 0 2024-02-28T16:26:28.775 INFO:tasks.workunit.client.0.smithi148.stdout:4/111: stat d8/df/c13 0 2024-02-28T16:26:28.776 INFO:tasks.workunit.client.0.smithi148.stdout:4/112: stat d8/df/d17 0 2024-02-28T16:26:28.776 INFO:tasks.workunit.client.0.smithi148.stdout:1/89: dread - d2/d15/f1d zero size 2024-02-28T16:26:28.778 INFO:tasks.workunit.client.0.smithi148.stdout:9/123: symlink d7/d1c/d1f/l2d 0 2024-02-28T16:26:28.779 INFO:tasks.workunit.client.0.smithi148.stdout:1/90: stat d2/d15/f1d 0 2024-02-28T16:26:28.779 INFO:tasks.workunit.client.0.smithi148.stdout:4/113: write d8/df/d17/f19 [414501,100656] 0 2024-02-28T16:26:28.781 INFO:tasks.workunit.client.0.smithi148.stdout:6/151: symlink d0/d22/l30 0 2024-02-28T16:26:28.794 INFO:tasks.workunit.client.0.smithi148.stdout:2/137: symlink d0/dd/d2c/l2d 0 2024-02-28T16:26:28.794 INFO:tasks.workunit.client.0.smithi148.stdout:7/116: rmdir d0/d4 39 2024-02-28T16:26:28.795 INFO:tasks.workunit.client.0.smithi148.stdout:2/138: rename d0 to d0/dd/d2b/d2e 22 2024-02-28T16:26:28.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/117: write d0/f2 [1673444,104845] 0 2024-02-28T16:26:28.797 INFO:tasks.workunit.client.0.smithi148.stdout:0/156: rmdir d1/d15/d27 39 2024-02-28T16:26:28.800 INFO:tasks.workunit.client.0.smithi148.stdout:9/124: creat d7/dd/f2e x:0 0 0 2024-02-28T16:26:28.801 INFO:tasks.workunit.client.0.smithi148.stdout:4/114: creat d8/f22 x:0 0 0 2024-02-28T16:26:28.804 INFO:tasks.workunit.client.0.smithi148.stdout:1/91: creat d2/d5/d6/d8/f21 x:0 0 0 2024-02-28T16:26:28.808 INFO:tasks.workunit.client.0.smithi148.stdout:2/139: mknod d0/d1d/c2f 0 2024-02-28T16:26:28.813 INFO:tasks.workunit.client.0.smithi148.stdout:9/125: creat d7/d15/d24/f2f x:0 0 0 2024-02-28T16:26:28.814 INFO:tasks.workunit.client.0.smithi148.stdout:4/115: symlink d8/df/d17/l23 0 2024-02-28T16:26:28.819 INFO:tasks.workunit.client.0.smithi148.stdout:0/157: mkdir d1/d15/d3d 0 2024-02-28T16:26:28.822 INFO:tasks.workunit.client.0.smithi148.stdout:1/92: dwrite d2/d5/d6/d8/f21 [0,4194304] 0 2024-02-28T16:26:28.822 INFO:tasks.workunit.client.0.smithi148.stdout:2/140: dread d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:28.823 INFO:tasks.workunit.client.0.smithi148.stdout:9/126: creat d7/d1c/d1f/f30 x:0 0 0 2024-02-28T16:26:28.823 INFO:tasks.workunit.client.0.smithi148.stdout:9/127: dread - d7/f21 zero size 2024-02-28T16:26:28.826 INFO:tasks.workunit.client.0.smithi148.stdout:1/93: write d2/d5/d6/d7/fc [250459,31189] 0 2024-02-28T16:26:28.829 INFO:tasks.workunit.client.0.smithi148.stdout:7/118: creat d0/f1d x:0 0 0 2024-02-28T16:26:28.833 INFO:tasks.workunit.client.0.smithi148.stdout:5/68: truncate d1/f9 2295631 0 2024-02-28T16:26:28.835 INFO:tasks.workunit.client.0.smithi148.stdout:2/141: fsync d0/f10 0 2024-02-28T16:26:28.836 INFO:tasks.workunit.client.0.smithi148.stdout:9/128: dread d7/dd/f2b [0,4194304] 0 2024-02-28T16:26:28.838 INFO:tasks.workunit.client.0.smithi148.stdout:4/116: link f7 d8/d21/f24 0 2024-02-28T16:26:28.839 INFO:tasks.workunit.client.0.smithi148.stdout:7/119: unlink d0/f1 0 2024-02-28T16:26:28.840 INFO:tasks.workunit.client.0.smithi148.stdout:6/152: symlink d0/l31 0 2024-02-28T16:26:28.846 INFO:tasks.workunit.client.0.smithi148.stdout:9/129: symlink d7/d1c/l31 0 2024-02-28T16:26:28.847 INFO:tasks.workunit.client.0.smithi148.stdout:4/117: mknod d8/df/d17/c25 0 2024-02-28T16:26:28.850 INFO:tasks.workunit.client.0.smithi148.stdout:1/94: rmdir d2/d5/d19 0 2024-02-28T16:26:28.851 INFO:tasks.workunit.client.0.smithi148.stdout:0/158: getdents d1 0 2024-02-28T16:26:28.853 INFO:tasks.workunit.client.0.smithi148.stdout:0/159: dread - d1/d4/d25/f2e zero size 2024-02-28T16:26:28.854 INFO:tasks.workunit.client.0.smithi148.stdout:9/130: rename d7/d15 to d7/d1c/d32 0 2024-02-28T16:26:28.855 INFO:tasks.workunit.client.0.smithi148.stdout:2/142: rmdir d0/d1d/d23 0 2024-02-28T16:26:28.857 INFO:tasks.workunit.client.0.smithi148.stdout:2/143: read d0/f8 [1525252,61003] 0 2024-02-28T16:26:28.858 INFO:tasks.workunit.client.0.smithi148.stdout:7/120: dread d0/f2 [0,4194304] 0 2024-02-28T16:26:28.858 INFO:tasks.workunit.client.0.smithi148.stdout:0/160: chown d1/d4/d25/f32 18996334 1 2024-02-28T16:26:28.859 INFO:tasks.workunit.client.0.smithi148.stdout:9/131: write d7/d1c/f20 [3084904,114598] 0 2024-02-28T16:26:28.860 INFO:tasks.workunit.client.0.smithi148.stdout:1/95: truncate f0 3498541 0 2024-02-28T16:26:28.864 INFO:tasks.workunit.client.0.smithi148.stdout:1/96: write d2/d5/d6/d8/f21 [1722001,51972] 0 2024-02-28T16:26:28.865 INFO:tasks.workunit.client.0.smithi148.stdout:1/97: dread - d2/d5/f1f zero size 2024-02-28T16:26:28.869 INFO:tasks.workunit.client.0.smithi148.stdout:6/153: truncate d0/d4/d1b/f1f 965702 0 2024-02-28T16:26:28.874 INFO:tasks.workunit.client.0.smithi148.stdout:2/144: unlink d0/c3 0 2024-02-28T16:26:28.875 INFO:tasks.workunit.client.0.smithi148.stdout:7/121: mknod d0/c1e 0 2024-02-28T16:26:28.876 INFO:tasks.workunit.client.0.smithi148.stdout:2/145: chown d0/d1d 455 1 2024-02-28T16:26:28.876 INFO:tasks.workunit.client.0.smithi148.stdout:0/161: mkdir d1/d15/d3e 0 2024-02-28T16:26:28.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/132: link d7/f17 d7/d1c/d1f/f33 0 2024-02-28T16:26:28.882 INFO:tasks.workunit.client.0.smithi148.stdout:5/69: dwrite d1/f9 [0,4194304] 0 2024-02-28T16:26:28.885 INFO:tasks.workunit.client.0.smithi148.stdout:0/162: truncate d1/d15/d8/f1d 616374 0 2024-02-28T16:26:28.886 INFO:tasks.workunit.client.0.smithi148.stdout:2/146: creat d0/dd/d2c/f30 x:0 0 0 2024-02-28T16:26:28.887 INFO:tasks.workunit.client.0.smithi148.stdout:5/70: write d1/f9 [2344285,98] 0 2024-02-28T16:26:28.888 INFO:tasks.workunit.client.0.smithi148.stdout:1/98: dwrite d2/d5/ff [0,4194304] 0 2024-02-28T16:26:28.895 INFO:tasks.workunit.client.0.smithi148.stdout:5/71: chown d1/db/ce 1848827423 1 2024-02-28T16:26:28.896 INFO:tasks.workunit.client.0.smithi148.stdout:1/99: symlink d2/d5/d1a/l22 0 2024-02-28T16:26:28.900 INFO:tasks.workunit.client.0.smithi148.stdout:2/147: write d0/d18/f28 [4921013,77520] 0 2024-02-28T16:26:28.900 INFO:tasks.workunit.client.0.smithi148.stdout:9/133: dread d7/f17 [0,4194304] 0 2024-02-28T16:26:28.905 INFO:tasks.workunit.client.0.smithi148.stdout:9/134: creat d7/d1c/f34 x:0 0 0 2024-02-28T16:26:28.907 INFO:tasks.workunit.client.0.smithi148.stdout:2/148: write d0/f8 [2102498,3789] 0 2024-02-28T16:26:28.910 INFO:tasks.workunit.client.0.smithi148.stdout:9/135: fsync d7/d1c/d1f/f27 0 2024-02-28T16:26:28.917 INFO:tasks.workunit.client.0.smithi148.stdout:1/100: truncate d2/d5/d6/d8/f10 842521 0 2024-02-28T16:26:28.917 INFO:tasks.workunit.client.0.smithi148.stdout:7/122: write d0/d9/fc [3666427,12932] 0 2024-02-28T16:26:28.918 INFO:tasks.workunit.client.0.smithi148.stdout:0/163: dwrite d1/d4/f3c [0,4194304] 0 2024-02-28T16:26:28.920 INFO:tasks.workunit.client.0.smithi148.stdout:6/154: dwrite d0/d8/ff [0,4194304] 0 2024-02-28T16:26:28.927 INFO:tasks.workunit.client.0.smithi148.stdout:5/72: dread d1/d8/fa [0,4194304] 0 2024-02-28T16:26:28.929 INFO:tasks.workunit.client.0.smithi148.stdout:2/149: creat d0/dd/d2b/f31 x:0 0 0 2024-02-28T16:26:28.933 INFO:tasks.workunit.client.0.smithi148.stdout:1/101: rename f0 to d2/d5/d6/f23 0 2024-02-28T16:26:28.934 INFO:tasks.workunit.client.0.smithi148.stdout:2/150: rmdir d0/d1d 39 2024-02-28T16:26:28.939 INFO:tasks.workunit.client.0.smithi148.stdout:6/155: mknod d0/d10/c32 0 2024-02-28T16:26:28.941 INFO:tasks.workunit.client.0.smithi148.stdout:5/73: mknod d1/db/c15 0 2024-02-28T16:26:28.944 INFO:tasks.workunit.client.0.smithi148.stdout:1/102: rmdir d2/d15 39 2024-02-28T16:26:28.945 INFO:tasks.workunit.client.0.smithi148.stdout:0/164: dread d1/f22 [0,4194304] 0 2024-02-28T16:26:28.948 INFO:tasks.workunit.client.0.smithi148.stdout:6/156: mknod d0/d22/d27/c33 0 2024-02-28T16:26:28.949 INFO:tasks.workunit.client.0.smithi148.stdout:5/74: symlink d1/db/l16 0 2024-02-28T16:26:28.949 INFO:tasks.workunit.client.0.smithi148.stdout:9/136: dwrite d7/d1c/f34 [0,4194304] 0 2024-02-28T16:26:28.954 INFO:tasks.workunit.client.0.smithi148.stdout:2/151: rename d0/d1d/c2f to d0/dd/c32 0 2024-02-28T16:26:28.954 INFO:tasks.workunit.client.0.smithi148.stdout:6/157: mknod d0/d8/d21/c34 0 2024-02-28T16:26:28.955 INFO:tasks.workunit.client.0.smithi148.stdout:7/123: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:28.957 INFO:tasks.workunit.client.0.smithi148.stdout:2/152: chown d0/l4 4 1 2024-02-28T16:26:28.959 INFO:tasks.workunit.client.0.smithi148.stdout:9/137: rmdir d7/dd/d26 39 2024-02-28T16:26:28.960 INFO:tasks.workunit.client.0.smithi148.stdout:2/153: truncate d0/dd/d2b/f31 803662 0 2024-02-28T16:26:28.966 INFO:tasks.workunit.client.0.smithi148.stdout:7/124: write d0/d4/f15 [4394076,44884] 0 2024-02-28T16:26:28.966 INFO:tasks.workunit.client.0.smithi148.stdout:6/158: mknod d0/d22/c35 0 2024-02-28T16:26:28.966 INFO:tasks.workunit.client.0.smithi148.stdout:2/154: readlink d0/d1d/l2a 0 2024-02-28T16:26:28.966 INFO:tasks.workunit.client.0.smithi148.stdout:5/75: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:28.977 INFO:tasks.workunit.client.0.smithi148.stdout:0/165: creat d1/d15/f3f x:0 0 0 2024-02-28T16:26:28.980 INFO:tasks.workunit.client.0.smithi148.stdout:1/103: rename d2/d5/f1f to d2/d5/d1a/f24 0 2024-02-28T16:26:28.981 INFO:tasks.workunit.client.0.smithi148.stdout:7/125: symlink d0/d18/l1f 0 2024-02-28T16:26:28.984 INFO:tasks.workunit.client.0.smithi148.stdout:0/166: dread d1/d15/d8/f1d [0,4194304] 0 2024-02-28T16:26:28.984 INFO:tasks.workunit.client.0.smithi148.stdout:7/126: fsync d0/d9/f1a 0 2024-02-28T16:26:28.989 INFO:tasks.workunit.client.0.smithi148.stdout:6/159: creat d0/d22/d25/f36 x:0 0 0 2024-02-28T16:26:28.999 INFO:tasks.workunit.client.0.smithi148.stdout:7/127: dread d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:28.999 INFO:tasks.workunit.client.0.smithi148.stdout:1/104: mkdir d2/d25 0 2024-02-28T16:26:29.002 INFO:tasks.workunit.client.0.smithi148.stdout:9/138: dread d7/fb [0,4194304] 0 2024-02-28T16:26:29.009 INFO:tasks.workunit.client.0.smithi148.stdout:5/76: rename d1/d8/l4 to d1/l17 0 2024-02-28T16:26:29.012 INFO:tasks.workunit.client.0.smithi148.stdout:6/160: link d0/d10/f13 d0/d22/f37 0 2024-02-28T16:26:29.018 INFO:tasks.workunit.client.0.smithi148.stdout:7/128: dwrite d0/f13 [0,4194304] 0 2024-02-28T16:26:29.026 INFO:tasks.workunit.client.0.smithi148.stdout:5/77: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:29.026 INFO:tasks.workunit.client.0.smithi148.stdout:1/105: rename d2/d5/d6/d7/f14 to d2/f26 0 2024-02-28T16:26:29.029 INFO:tasks.workunit.client.0.smithi148.stdout:9/139: dwrite d7/d1c/f34 [4194304,4194304] 0 2024-02-28T16:26:29.030 INFO:tasks.workunit.client.0.smithi148.stdout:0/167: write d1/d15/d8/f29 [297133,121664] 0 2024-02-28T16:26:29.031 INFO:tasks.workunit.client.0.smithi148.stdout:0/168: readlink d1/d4/l1a 0 2024-02-28T16:26:29.031 INFO:tasks.workunit.client.0.smithi148.stdout:1/106: creat d2/d5/d6/f27 x:0 0 0 2024-02-28T16:26:29.032 INFO:tasks.workunit.client.0.smithi148.stdout:9/140: truncate d7/fc 5154520 0 2024-02-28T16:26:29.032 INFO:tasks.workunit.client.0.smithi148.stdout:7/129: link d0/cb d0/d9/c20 0 2024-02-28T16:26:29.039 INFO:tasks.workunit.client.0.smithi148.stdout:5/78: mknod d1/d12/c18 0 2024-02-28T16:26:29.039 INFO:tasks.workunit.client.0.smithi148.stdout:6/161: rename d0/d8/d21/f23 to d0/d22/f38 0 2024-02-28T16:26:29.041 INFO:tasks.workunit.client.0.smithi148.stdout:5/79: readlink d1/d8/l14 0 2024-02-28T16:26:29.042 INFO:tasks.workunit.client.0.smithi148.stdout:0/169: unlink d1/d15/f3f 0 2024-02-28T16:26:29.050 INFO:tasks.workunit.client.0.smithi148.stdout:9/141: mkdir d7/dd/d35 0 2024-02-28T16:26:29.052 INFO:tasks.workunit.client.0.smithi148.stdout:1/107: dwrite d2/d5/d6/f1b [0,4194304] 0 2024-02-28T16:26:29.054 INFO:tasks.workunit.client.0.smithi148.stdout:5/80: symlink d1/l19 0 2024-02-28T16:26:29.054 INFO:tasks.workunit.client.0.smithi148.stdout:5/81: readlink l0 0 2024-02-28T16:26:29.055 INFO:tasks.workunit.client.0.smithi148.stdout:1/108: chown d2/d5/d1a/l20 5143 1 2024-02-28T16:26:29.057 INFO:tasks.workunit.client.0.smithi148.stdout:1/109: stat d2/d5/d6/d7/f12 0 2024-02-28T16:26:29.059 INFO:tasks.workunit.client.0.smithi148.stdout:7/130: getdents d0/d18 0 2024-02-28T16:26:29.059 INFO:tasks.workunit.client.0.smithi148.stdout:1/110: chown d2/d5 6412581 1 2024-02-28T16:26:29.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/162: link d0/l3 d0/d22/d27/l39 0 2024-02-28T16:26:29.070 INFO:tasks.workunit.client.0.smithi148.stdout:9/142: dread d7/d1c/f34 [4194304,4194304] 0 2024-02-28T16:26:29.070 INFO:tasks.workunit.client.0.smithi148.stdout:0/170: dwrite d1/f24 [4194304,4194304] 0 2024-02-28T16:26:29.072 INFO:tasks.workunit.client.0.smithi148.stdout:6/163: write d0/f16 [5020761,56941] 0 2024-02-28T16:26:29.073 INFO:tasks.workunit.client.0.smithi148.stdout:5/82: mkdir d1/d1a 0 2024-02-28T16:26:29.075 INFO:tasks.workunit.client.0.smithi148.stdout:7/131: truncate d0/f11 1299125 0 2024-02-28T16:26:29.077 INFO:tasks.workunit.client.0.smithi148.stdout:0/171: mknod d1/d15/d8/c40 0 2024-02-28T16:26:29.079 INFO:tasks.workunit.client.0.smithi148.stdout:7/132: symlink d0/d9/l21 0 2024-02-28T16:26:29.080 INFO:tasks.workunit.client.0.smithi148.stdout:9/143: mknod d7/c36 0 2024-02-28T16:26:29.081 INFO:tasks.workunit.client.0.smithi148.stdout:7/133: write d0/f2 [4978039,75121] 0 2024-02-28T16:26:29.084 INFO:tasks.workunit.client.0.smithi148.stdout:6/164: write d0/f1d [2969194,16909] 0 2024-02-28T16:26:29.084 INFO:tasks.workunit.client.0.smithi148.stdout:9/144: truncate d7/d1c/d1f/f30 446918 0 2024-02-28T16:26:29.088 INFO:tasks.workunit.client.0.smithi148.stdout:0/172: write d1/d15/d27/f35 [4687659,106981] 0 2024-02-28T16:26:29.094 INFO:tasks.workunit.client.0.smithi148.stdout:9/145: chown d7/d1c/d1f/l2d 82 1 2024-02-28T16:26:29.094 INFO:tasks.workunit.client.0.smithi148.stdout:0/173: stat d1/d15/d8/cd 0 2024-02-28T16:26:29.100 INFO:tasks.workunit.client.0.smithi148.stdout:0/174: creat d1/f41 x:0 0 0 2024-02-28T16:26:29.100 INFO:tasks.workunit.client.0.smithi148.stdout:5/83: dwrite d1/d8/fa [0,4194304] 0 2024-02-28T16:26:29.104 INFO:tasks.workunit.client.0.smithi148.stdout:5/84: write d1/d8/fa [1142071,54789] 0 2024-02-28T16:26:29.107 INFO:tasks.workunit.client.0.smithi148.stdout:6/165: write d0/d10/f1a [771492,117161] 0 2024-02-28T16:26:29.110 INFO:tasks.workunit.client.0.smithi148.stdout:0/175: rename d1/d15/c14 to d1/d15/d8/c42 0 2024-02-28T16:26:29.115 INFO:tasks.workunit.client.0.smithi148.stdout:6/166: write d0/d4/d1b/f1f [1919217,48103] 0 2024-02-28T16:26:29.116 INFO:tasks.workunit.client.0.smithi148.stdout:1/111: dread d2/d5/d6/d7/fc [0,4194304] 0 2024-02-28T16:26:29.118 INFO:tasks.workunit.client.0.smithi148.stdout:6/167: rmdir d0/d22 39 2024-02-28T16:26:29.120 INFO:tasks.workunit.client.0.smithi148.stdout:1/112: dread - d2/d5/d1a/f24 zero size 2024-02-28T16:26:29.122 INFO:tasks.workunit.client.0.smithi148.stdout:0/176: creat d1/d15/d3d/f43 x:0 0 0 2024-02-28T16:26:29.123 INFO:tasks.workunit.client.0.smithi148.stdout:9/146: dwrite d7/d1c/f34 [4194304,4194304] 0 2024-02-28T16:26:29.124 INFO:tasks.workunit.client.0.smithi148.stdout:1/113: mknod d2/d5/d6/d7/c28 0 2024-02-28T16:26:29.126 INFO:tasks.workunit.client.0.smithi148.stdout:6/168: mkdir d0/d22/d25/d3a 0 2024-02-28T16:26:29.126 INFO:tasks.workunit.client.0.smithi148.stdout:5/85: fsync d1/d8/fa 0 2024-02-28T16:26:29.127 INFO:tasks.workunit.client.0.smithi148.stdout:1/114: fdatasync d2/d5/d6/f1b 0 2024-02-28T16:26:29.132 INFO:tasks.workunit.client.0.smithi148.stdout:8/155: sync 2024-02-28T16:26:29.132 INFO:tasks.workunit.client.0.smithi148.stdout:4/118: sync 2024-02-28T16:26:29.132 INFO:tasks.workunit.client.0.smithi148.stdout:3/195: sync 2024-02-28T16:26:29.132 INFO:tasks.workunit.client.0.smithi148.stdout:2/155: sync 2024-02-28T16:26:29.134 INFO:tasks.workunit.client.0.smithi148.stdout:8/156: chown d1 43130 1 2024-02-28T16:26:29.134 INFO:tasks.workunit.client.0.smithi148.stdout:5/86: write d1/d8/fa [2506939,28904] 0 2024-02-28T16:26:29.134 INFO:tasks.workunit.client.0.smithi148.stdout:7/134: dread d0/f11 [0,4194304] 0 2024-02-28T16:26:29.137 INFO:tasks.workunit.client.0.smithi148.stdout:1/115: rename d2/d5/d6/d7/c28 to d2/d5/d6/c29 0 2024-02-28T16:26:29.138 INFO:tasks.workunit.client.0.smithi148.stdout:5/87: read d1/d8/fa [79553,6156] 0 2024-02-28T16:26:29.140 INFO:tasks.workunit.client.0.smithi148.stdout:1/116: truncate d2/d5/d1a/f24 479238 0 2024-02-28T16:26:29.141 INFO:tasks.workunit.client.0.smithi148.stdout:9/147: truncate d7/d1c/d1f/f33 1010883 0 2024-02-28T16:26:29.143 INFO:tasks.workunit.client.0.smithi148.stdout:9/148: read d7/fc [3569093,88269] 0 2024-02-28T16:26:29.143 INFO:tasks.workunit.client.0.smithi148.stdout:4/119: creat d8/f26 x:0 0 0 2024-02-28T16:26:29.146 INFO:tasks.workunit.client.0.smithi148.stdout:0/177: rmdir d1/d15/d3d 39 2024-02-28T16:26:29.148 INFO:tasks.workunit.client.0.smithi148.stdout:7/135: symlink d0/d18/d19/l22 0 2024-02-28T16:26:29.150 INFO:tasks.workunit.client.0.smithi148.stdout:6/169: symlink d0/d4/l3b 0 2024-02-28T16:26:29.154 INFO:tasks.workunit.client.0.smithi148.stdout:9/149: rmdir d7/d1c/d32/d24 39 2024-02-28T16:26:29.159 INFO:tasks.workunit.client.0.smithi148.stdout:3/196: dread d1/d13/d19/d1b/f2a [0,4194304] 0 2024-02-28T16:26:29.163 INFO:tasks.workunit.client.0.smithi148.stdout:8/157: dwrite d1/d3/fa [4194304,4194304] 0 2024-02-28T16:26:29.168 INFO:tasks.workunit.client.0.smithi148.stdout:1/117: dread d2/d5/d6/d7/fc [0,4194304] 0 2024-02-28T16:26:29.171 INFO:tasks.workunit.client.0.smithi148.stdout:3/197: rename d1/d13/f2b to d1/d13/f3e 0 2024-02-28T16:26:29.173 INFO:tasks.workunit.client.0.smithi148.stdout:5/88: creat d1/f1b x:0 0 0 2024-02-28T16:26:29.174 INFO:tasks.workunit.client.0.smithi148.stdout:7/136: creat d0/d18/d19/d1c/f23 x:0 0 0 2024-02-28T16:26:29.175 INFO:tasks.workunit.client.0.smithi148.stdout:4/120: write d8/f12 [1441515,34251] 0 2024-02-28T16:26:29.175 INFO:tasks.workunit.client.0.smithi148.stdout:5/89: chown d1/db/c15 47845 1 2024-02-28T16:26:29.176 INFO:tasks.workunit.client.0.smithi148.stdout:2/156: getdents d0/dd/d2c 0 2024-02-28T16:26:29.178 INFO:tasks.workunit.client.0.smithi148.stdout:0/178: link d1/d4/f33 d1/d15/f44 0 2024-02-28T16:26:29.179 INFO:tasks.workunit.client.0.smithi148.stdout:5/90: dread - d1/f1b zero size 2024-02-28T16:26:29.183 INFO:tasks.workunit.client.0.smithi148.stdout:0/179: write d1/f24 [1634230,104557] 0 2024-02-28T16:26:29.183 INFO:tasks.workunit.client.0.smithi148.stdout:9/150: dwrite d7/f21 [0,4194304] 0 2024-02-28T16:26:29.184 INFO:tasks.workunit.client.0.smithi148.stdout:3/198: write d1/d13/f3e [273304,91320] 0 2024-02-28T16:26:29.189 INFO:tasks.workunit.client.0.smithi148.stdout:0/180: stat d1/d4/f3c 0 2024-02-28T16:26:29.189 INFO:tasks.workunit.client.0.smithi148.stdout:0/181: dread - d1/f19 zero size 2024-02-28T16:26:29.191 INFO:tasks.workunit.client.0.smithi148.stdout:8/158: rename d1/c6 to d1/dd/d13/d24/c2f 0 2024-02-28T16:26:29.192 INFO:tasks.workunit.client.0.smithi148.stdout:9/151: read d7/f18 [1040136,130118] 0 2024-02-28T16:26:29.195 INFO:tasks.workunit.client.0.smithi148.stdout:2/157: unlink d0/dd/d2c/f30 0 2024-02-28T16:26:29.195 INFO:tasks.workunit.client.0.smithi148.stdout:7/137: mknod d0/d18/d19/d1c/c24 0 2024-02-28T16:26:29.201 INFO:tasks.workunit.client.0.smithi148.stdout:1/118: link l1 d2/d5/d6/d7/l2a 0 2024-02-28T16:26:29.202 INFO:tasks.workunit.client.0.smithi148.stdout:5/91: truncate d1/d8/fa 2468146 0 2024-02-28T16:26:29.207 INFO:tasks.workunit.client.0.smithi148.stdout:9/152: stat d7/dd/d26 0 2024-02-28T16:26:29.207 INFO:tasks.workunit.client.0.smithi148.stdout:3/199: mkdir d1/d3f 0 2024-02-28T16:26:29.209 INFO:tasks.workunit.client.0.smithi148.stdout:4/121: dwrite d8/f12 [0,4194304] 0 2024-02-28T16:26:29.213 INFO:tasks.workunit.client.0.smithi148.stdout:1/119: write d2/d5/d6/d7/fc [453096,93991] 0 2024-02-28T16:26:29.214 INFO:tasks.workunit.client.0.smithi148.stdout:5/92: mknod d1/d12/c1c 0 2024-02-28T16:26:29.220 INFO:tasks.workunit.client.0.smithi148.stdout:2/158: creat d0/d18/d20/f33 x:0 0 0 2024-02-28T16:26:29.223 INFO:tasks.workunit.client.0.smithi148.stdout:7/138: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:29.223 INFO:tasks.workunit.client.0.smithi148.stdout:1/120: write d2/d5/d6/d7/fc [1630525,71980] 0 2024-02-28T16:26:29.224 INFO:tasks.workunit.client.0.smithi148.stdout:4/122: mknod d8/df/c27 0 2024-02-28T16:26:29.224 INFO:tasks.workunit.client.0.smithi148.stdout:2/159: chown d0/d18/f19 2199 1 2024-02-28T16:26:29.226 INFO:tasks.workunit.client.0.smithi148.stdout:6/170: rename d0/d10/f1a to d0/d4/f3c 0 2024-02-28T16:26:29.226 INFO:tasks.workunit.client.0.smithi148.stdout:0/182: write d1/d15/f44 [377444,33442] 0 2024-02-28T16:26:29.229 INFO:tasks.workunit.client.0.smithi148.stdout:2/160: dread - d0/d9/f21 zero size 2024-02-28T16:26:29.229 INFO:tasks.workunit.client.0.smithi148.stdout:4/123: write d8/f22 [758442,54798] 0 2024-02-28T16:26:29.230 INFO:tasks.workunit.client.0.smithi148.stdout:6/171: read d0/d4/f11 [3522108,115746] 0 2024-02-28T16:26:29.231 INFO:tasks.workunit.client.0.smithi148.stdout:1/121: stat d2/d5/d1a/l22 0 2024-02-28T16:26:29.235 INFO:tasks.workunit.client.0.smithi148.stdout:4/124: stat d8/d21/f24 0 2024-02-28T16:26:29.237 INFO:tasks.workunit.client.0.smithi148.stdout:9/153: dread d7/f18 [0,4194304] 0 2024-02-28T16:26:29.241 INFO:tasks.workunit.client.0.smithi148.stdout:7/139: mkdir d0/d9/d25 0 2024-02-28T16:26:29.246 INFO:tasks.workunit.client.0.smithi148.stdout:2/161: creat d0/d1d/f34 x:0 0 0 2024-02-28T16:26:29.252 INFO:tasks.workunit.client.0.smithi148.stdout:8/159: dwrite d1/d3/f4 [0,4194304] 0 2024-02-28T16:26:29.254 INFO:tasks.workunit.client.0.smithi148.stdout:2/162: fsync d0/d9/f21 0 2024-02-28T16:26:29.256 INFO:tasks.workunit.client.0.smithi148.stdout:3/200: rename d1/fa to d1/f40 0 2024-02-28T16:26:29.257 INFO:tasks.workunit.client.0.smithi148.stdout:4/125: creat d8/df/d1f/f28 x:0 0 0 2024-02-28T16:26:29.260 INFO:tasks.workunit.client.0.smithi148.stdout:0/183: dwrite d1/f41 [0,4194304] 0 2024-02-28T16:26:29.261 INFO:tasks.workunit.client.0.smithi148.stdout:2/163: symlink d0/dd/d2b/l35 0 2024-02-28T16:26:29.262 INFO:tasks.workunit.client.0.smithi148.stdout:0/184: stat d1/d4/f3c 0 2024-02-28T16:26:29.264 INFO:tasks.workunit.client.0.smithi148.stdout:6/172: write d0/d8/ff [5190863,67352] 0 2024-02-28T16:26:29.266 INFO:tasks.workunit.client.0.smithi148.stdout:3/201: chown d1/db/f10 292361 1 2024-02-28T16:26:29.268 INFO:tasks.workunit.client.0.smithi148.stdout:5/93: dwrite d1/f9 [0,4194304] 0 2024-02-28T16:26:29.268 INFO:tasks.workunit.client.0.smithi148.stdout:8/160: rename d1/de/d22/f26 to d1/de/d2c/f30 0 2024-02-28T16:26:29.270 INFO:tasks.workunit.client.0.smithi148.stdout:0/185: creat d1/d4/f45 x:0 0 0 2024-02-28T16:26:29.271 INFO:tasks.workunit.client.0.smithi148.stdout:6/173: symlink d0/d22/d25/l3d 0 2024-02-28T16:26:29.273 INFO:tasks.workunit.client.0.smithi148.stdout:3/202: mkdir d1/d13/d19/d32/d41 0 2024-02-28T16:26:29.274 INFO:tasks.workunit.client.0.smithi148.stdout:8/161: rmdir d1/dd 39 2024-02-28T16:26:29.280 INFO:tasks.workunit.client.0.smithi148.stdout:5/94: link d1/d12/c18 d1/db/c1d 0 2024-02-28T16:26:29.280 INFO:tasks.workunit.client.0.smithi148.stdout:8/162: readlink d1/dd/d13/d24/l2a 0 2024-02-28T16:26:29.280 INFO:tasks.workunit.client.0.smithi148.stdout:3/203: symlink d1/d3f/l42 0 2024-02-28T16:26:29.281 INFO:tasks.workunit.client.0.smithi148.stdout:5/95: dread - d1/f1b zero size 2024-02-28T16:26:29.282 INFO:tasks.workunit.client.0.smithi148.stdout:3/204: chown d1/d13/f21 1914109 1 2024-02-28T16:26:29.284 INFO:tasks.workunit.client.0.smithi148.stdout:8/163: creat d1/d3/d18/f31 x:0 0 0 2024-02-28T16:26:29.287 INFO:tasks.workunit.client.0.smithi148.stdout:3/205: truncate d1/d13/d19/f28 1122302 0 2024-02-28T16:26:29.289 INFO:tasks.workunit.client.0.smithi148.stdout:3/206: stat d1/d13/d19/d1b/l24 0 2024-02-28T16:26:29.295 INFO:tasks.workunit.client.0.smithi148.stdout:5/96: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:29.295 INFO:tasks.workunit.client.0.smithi148.stdout:3/207: creat d1/d13/d19/d1b/d38/f43 x:0 0 0 2024-02-28T16:26:29.297 INFO:tasks.workunit.client.0.smithi148.stdout:5/97: rmdir d1/d8 39 2024-02-28T16:26:29.297 INFO:tasks.workunit.client.0.smithi148.stdout:8/164: fsync d1/d3/f20 0 2024-02-28T16:26:29.299 INFO:tasks.workunit.client.0.smithi148.stdout:3/208: creat d1/d13/d19/d1b/f44 x:0 0 0 2024-02-28T16:26:29.300 INFO:tasks.workunit.client.0.smithi148.stdout:7/140: truncate d0/d4/f15 4294918 0 2024-02-28T16:26:29.302 INFO:tasks.workunit.client.0.smithi148.stdout:8/165: chown d1/dd/d13/d1a/c1b 1672 1 2024-02-28T16:26:29.303 INFO:tasks.workunit.client.0.smithi148.stdout:4/126: truncate f6 496490 0 2024-02-28T16:26:29.307 INFO:tasks.workunit.client.0.smithi148.stdout:3/209: mkdir d1/db/d45 0 2024-02-28T16:26:29.308 INFO:tasks.workunit.client.0.smithi148.stdout:3/210: truncate d1/d13/f1e 4749391 0 2024-02-28T16:26:29.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/127: unlink d8/df/d1f/f28 0 2024-02-28T16:26:29.309 INFO:tasks.workunit.client.0.smithi148.stdout:0/186: write d1/d4/d25/f32 [49998,28289] 0 2024-02-28T16:26:29.313 INFO:tasks.workunit.client.0.smithi148.stdout:0/187: dread - d1/d15/f1c zero size 2024-02-28T16:26:29.314 INFO:tasks.workunit.client.0.smithi148.stdout:4/128: symlink d8/df/l29 0 2024-02-28T16:26:29.317 INFO:tasks.workunit.client.0.smithi148.stdout:5/98: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:29.317 INFO:tasks.workunit.client.0.smithi148.stdout:4/129: dread - d8/f18 zero size 2024-02-28T16:26:29.321 INFO:tasks.workunit.client.0.smithi148.stdout:4/130: readlink d8/l9 0 2024-02-28T16:26:29.321 INFO:tasks.workunit.client.0.smithi148.stdout:0/188: read d1/d15/f44 [289832,120660] 0 2024-02-28T16:26:29.325 INFO:tasks.workunit.client.0.smithi148.stdout:6/174: dwrite d0/d22/f38 [0,4194304] 0 2024-02-28T16:26:29.327 INFO:tasks.workunit.client.0.smithi148.stdout:5/99: rmdir d1/db 39 2024-02-28T16:26:29.327 INFO:tasks.workunit.client.0.smithi148.stdout:8/166: write d1/d3/f19 [1592355,7314] 0 2024-02-28T16:26:29.329 INFO:tasks.workunit.client.0.smithi148.stdout:0/189: mkdir d1/d46 0 2024-02-28T16:26:29.330 INFO:tasks.workunit.client.0.smithi148.stdout:8/167: dread - d1/d3/d18/f31 zero size 2024-02-28T16:26:29.330 INFO:tasks.workunit.client.0.smithi148.stdout:3/211: dread d1/d13/d19/f30 [0,4194304] 0 2024-02-28T16:26:29.331 INFO:tasks.workunit.client.0.smithi148.stdout:4/131: mknod d8/d21/c2a 0 2024-02-28T16:26:29.336 INFO:tasks.workunit.client.0.smithi148.stdout:6/175: write d0/d4/d14/f28 [3526995,17374] 0 2024-02-28T16:26:29.337 INFO:tasks.workunit.client.0.smithi148.stdout:4/132: rename f0 to d8/df/d1f/f2b 0 2024-02-28T16:26:29.338 INFO:tasks.workunit.client.0.smithi148.stdout:6/176: write d0/d8/ff [669189,63511] 0 2024-02-28T16:26:29.342 INFO:tasks.workunit.client.0.smithi148.stdout:3/212: dread d1/d13/f23 [0,4194304] 0 2024-02-28T16:26:29.342 INFO:tasks.workunit.client.0.smithi148.stdout:6/177: write d0/d8/ff [1363335,38502] 0 2024-02-28T16:26:29.347 INFO:tasks.workunit.client.0.smithi148.stdout:8/168: dread d1/d3/d18/f2b [0,4194304] 0 2024-02-28T16:26:29.347 INFO:tasks.workunit.client.0.smithi148.stdout:8/169: fsync d1/f2e 0 2024-02-28T16:26:29.349 INFO:tasks.workunit.client.0.smithi148.stdout:5/100: truncate d1/d8/fa 906398 0 2024-02-28T16:26:29.350 INFO:tasks.workunit.client.0.smithi148.stdout:0/190: link d1/d15/d8/c37 d1/d46/c47 0 2024-02-28T16:26:29.357 INFO:tasks.workunit.client.0.smithi148.stdout:4/133: dread f7 [0,4194304] 0 2024-02-28T16:26:29.361 INFO:tasks.workunit.client.0.smithi148.stdout:8/170: rename d1/d3/f19 to d1/de/d22/f32 0 2024-02-28T16:26:29.368 INFO:tasks.workunit.client.0.smithi148.stdout:4/134: rename d8/f18 to d8/df/d17/f2c 0 2024-02-28T16:26:29.369 INFO:tasks.workunit.client.0.smithi148.stdout:8/171: dread d1/f1c [0,4194304] 0 2024-02-28T16:26:29.372 INFO:tasks.workunit.client.0.smithi148.stdout:4/135: chown d8/df/d17 37 1 2024-02-28T16:26:29.373 INFO:tasks.workunit.client.0.smithi148.stdout:5/101: read d1/d8/fa [854536,113250] 0 2024-02-28T16:26:29.373 INFO:tasks.workunit.client.0.smithi148.stdout:3/213: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:26:29.378 INFO:tasks.workunit.client.0.smithi148.stdout:5/102: read d1/d8/fa [655238,33581] 0 2024-02-28T16:26:29.379 INFO:tasks.workunit.client.0.smithi148.stdout:6/178: truncate d0/d8/ff 3495485 0 2024-02-28T16:26:29.379 INFO:tasks.workunit.client.0.smithi148.stdout:0/191: dwrite d1/f19 [0,4194304] 0 2024-02-28T16:26:29.381 INFO:tasks.workunit.client.0.smithi148.stdout:3/214: symlink d1/d13/d19/d1b/l46 0 2024-02-28T16:26:29.381 INFO:tasks.workunit.client.0.smithi148.stdout:5/103: dread - d1/f1b zero size 2024-02-28T16:26:29.384 INFO:tasks.workunit.client.0.smithi148.stdout:5/104: chown d1/ld 11 1 2024-02-28T16:26:29.384 INFO:tasks.workunit.client.0.smithi148.stdout:6/179: write d0/d22/d25/f36 [421369,54806] 0 2024-02-28T16:26:29.385 INFO:tasks.workunit.client.0.smithi148.stdout:3/215: chown d1/d13/d19/d1b/l34 304266004 1 2024-02-28T16:26:29.392 INFO:tasks.workunit.client.0.smithi148.stdout:5/105: dread d1/d8/fa [0,4194304] 0 2024-02-28T16:26:29.395 INFO:tasks.workunit.client.0.smithi148.stdout:6/180: mkdir d0/d22/d27/d3e 0 2024-02-28T16:26:29.398 INFO:tasks.workunit.client.0.smithi148.stdout:6/181: chown d0/d22/l2f 45776259 1 2024-02-28T16:26:29.400 INFO:tasks.workunit.client.0.smithi148.stdout:6/182: chown d0/d4/d1b/f1f 7985368 1 2024-02-28T16:26:29.400 INFO:tasks.workunit.client.0.smithi148.stdout:3/216: unlink d1/cc 0 2024-02-28T16:26:29.401 INFO:tasks.workunit.client.0.smithi148.stdout:8/172: truncate d1/de/ff 1710672 0 2024-02-28T16:26:29.407 INFO:tasks.workunit.client.0.smithi148.stdout:8/173: mkdir d1/dd/d13/d1a/d33 0 2024-02-28T16:26:29.409 INFO:tasks.workunit.client.0.smithi148.stdout:6/183: symlink d0/d4/l3f 0 2024-02-28T16:26:29.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/184: stat d0/l31 0 2024-02-28T16:26:29.411 INFO:tasks.workunit.client.0.smithi148.stdout:8/174: dread d1/f27 [0,4194304] 0 2024-02-28T16:26:29.413 INFO:tasks.workunit.client.0.smithi148.stdout:0/192: dwrite d1/d4/d25/f32 [0,4194304] 0 2024-02-28T16:26:29.414 INFO:tasks.workunit.client.0.smithi148.stdout:6/185: fsync d0/d4/d1b/f1f 0 2024-02-28T16:26:29.419 INFO:tasks.workunit.client.0.smithi148.stdout:5/106: dwrite d1/d8/fa [0,4194304] 0 2024-02-28T16:26:29.422 INFO:tasks.workunit.client.0.smithi148.stdout:0/193: unlink d1/d15/f1c 0 2024-02-28T16:26:29.425 INFO:tasks.workunit.client.0.smithi148.stdout:5/107: stat d1/d8/c7 0 2024-02-28T16:26:29.425 INFO:tasks.workunit.client.0.smithi148.stdout:8/175: rmdir d1/de 39 2024-02-28T16:26:29.429 INFO:tasks.workunit.client.0.smithi148.stdout:3/217: dwrite d1/d13/f3b [0,4194304] 0 2024-02-28T16:26:29.437 INFO:tasks.workunit.client.0.smithi148.stdout:0/194: write d1/d4/f33 [336879,106937] 0 2024-02-28T16:26:29.438 INFO:tasks.workunit.client.0.smithi148.stdout:5/108: write d1/f9 [2688958,62814] 0 2024-02-28T16:26:29.448 INFO:tasks.workunit.client.0.smithi148.stdout:6/186: symlink d0/l40 0 2024-02-28T16:26:29.450 INFO:tasks.workunit.client.0.smithi148.stdout:5/109: symlink d1/d8/l1e 0 2024-02-28T16:26:29.455 INFO:tasks.workunit.client.0.smithi148.stdout:0/195: mknod d1/d46/c48 0 2024-02-28T16:26:29.457 INFO:tasks.workunit.client.0.smithi148.stdout:6/187: creat d0/d22/d25/d3a/f41 x:0 0 0 2024-02-28T16:26:29.458 INFO:tasks.workunit.client.0.smithi148.stdout:0/196: rmdir d1/d15 39 2024-02-28T16:26:29.459 INFO:tasks.workunit.client.0.smithi148.stdout:6/188: chown d0/d22/d27 634301 1 2024-02-28T16:26:29.461 INFO:tasks.workunit.client.0.smithi148.stdout:3/218: write d1/db/f22 [701326,113234] 0 2024-02-28T16:26:29.464 INFO:tasks.workunit.client.0.smithi148.stdout:3/219: stat d1/d13/f1e 0 2024-02-28T16:26:29.467 INFO:tasks.workunit.client.0.smithi148.stdout:6/189: dread - d0/d22/d25/d3a/f41 zero size 2024-02-28T16:26:29.468 INFO:tasks.workunit.client.0.smithi148.stdout:0/197: truncate d1/d4/f33 1419532 0 2024-02-28T16:26:29.472 INFO:tasks.workunit.client.0.smithi148.stdout:8/176: dwrite d1/de/d2c/f30 [0,4194304] 0 2024-02-28T16:26:29.475 INFO:tasks.workunit.client.0.smithi148.stdout:5/110: dwrite d1/f9 [4194304,4194304] 0 2024-02-28T16:26:29.475 INFO:tasks.workunit.client.0.smithi148.stdout:6/190: write d0/f16 [680388,72691] 0 2024-02-28T16:26:29.486 INFO:tasks.workunit.client.0.smithi148.stdout:3/220: rename d1/d13/d19/f1c to d1/db/d35/f47 0 2024-02-28T16:26:29.490 INFO:tasks.workunit.client.0.smithi148.stdout:8/177: mkdir d1/de/d22/d34 0 2024-02-28T16:26:29.490 INFO:tasks.workunit.client.0.smithi148.stdout:0/198: fsync d1/d15/d27/d34/f38 0 2024-02-28T16:26:29.491 INFO:tasks.workunit.client.0.smithi148.stdout:5/111: creat d1/d12/f1f x:0 0 0 2024-02-28T16:26:29.495 INFO:tasks.workunit.client.0.smithi148.stdout:3/221: chown d1/c7 34280 1 2024-02-28T16:26:29.498 INFO:tasks.workunit.client.0.smithi148.stdout:5/112: mkdir d1/d8/d20 0 2024-02-28T16:26:29.500 INFO:tasks.workunit.client.0.smithi148.stdout:0/199: symlink d1/d4/d25/l49 0 2024-02-28T16:26:29.502 INFO:tasks.workunit.client.0.smithi148.stdout:5/113: write d1/d12/f1f [222422,123917] 0 2024-02-28T16:26:29.512 INFO:tasks.workunit.client.0.smithi148.stdout:8/178: dread d1/d3/f4 [0,4194304] 0 2024-02-28T16:26:29.516 INFO:tasks.workunit.client.0.smithi148.stdout:6/191: truncate d0/d4/fa 3004288 0 2024-02-28T16:26:29.520 INFO:tasks.workunit.client.0.smithi148.stdout:3/222: dwrite d1/d13/d19/f28 [0,4194304] 0 2024-02-28T16:26:29.520 INFO:tasks.workunit.client.0.smithi148.stdout:5/114: rename d1/d12/c18 to d1/d1a/c21 0 2024-02-28T16:26:29.525 INFO:tasks.workunit.client.0.smithi148.stdout:6/192: symlink d0/d4/l42 0 2024-02-28T16:26:29.530 INFO:tasks.workunit.client.0.smithi148.stdout:8/179: rename d1/de/d2c to d1/d3/d35 0 2024-02-28T16:26:29.531 INFO:tasks.workunit.client.0.smithi148.stdout:5/115: write d1/d12/f1f [536471,59532] 0 2024-02-28T16:26:29.533 INFO:tasks.workunit.client.0.smithi148.stdout:3/223: creat d1/db/f48 x:0 0 0 2024-02-28T16:26:29.534 INFO:tasks.workunit.client.0.smithi148.stdout:0/200: dwrite d1/d15/d27/d34/f3a [0,4194304] 0 2024-02-28T16:26:29.543 INFO:tasks.workunit.client.0.smithi148.stdout:8/180: creat d1/d3/d35/f36 x:0 0 0 2024-02-28T16:26:29.546 INFO:tasks.workunit.client.0.smithi148.stdout:8/181: fsync d1/f27 0 2024-02-28T16:26:29.549 INFO:tasks.workunit.client.0.smithi148.stdout:3/224: getdents d1 0 2024-02-28T16:26:29.555 INFO:tasks.workunit.client.0.smithi148.stdout:5/116: dwrite d1/f9 [4194304,4194304] 0 2024-02-28T16:26:29.558 INFO:tasks.workunit.client.0.smithi148.stdout:3/225: fsync d1/d13/f23 0 2024-02-28T16:26:29.563 INFO:tasks.workunit.client.0.smithi148.stdout:8/182: mknod d1/dd/d13/d1a/d33/c37 0 2024-02-28T16:26:29.565 INFO:tasks.workunit.client.0.smithi148.stdout:0/201: dwrite d1/d15/d27/d34/f3a [0,4194304] 0 2024-02-28T16:26:29.567 INFO:tasks.workunit.client.0.smithi148.stdout:3/226: creat d1/d13/d19/d1b/d38/f49 x:0 0 0 2024-02-28T16:26:29.571 INFO:tasks.workunit.client.0.smithi148.stdout:8/183: mknod d1/dd/d13/d1a/c38 0 2024-02-28T16:26:29.572 INFO:tasks.workunit.client.0.smithi148.stdout:3/227: creat d1/d13/d19/f4a x:0 0 0 2024-02-28T16:26:29.579 INFO:tasks.workunit.client.0.smithi148.stdout:0/202: truncate d1/f22 2012518 0 2024-02-28T16:26:29.581 INFO:tasks.workunit.client.0.smithi148.stdout:8/184: mknod d1/d3/d18/c39 0 2024-02-28T16:26:29.582 INFO:tasks.workunit.client.0.smithi148.stdout:6/193: dwrite d0/d22/f37 [4194304,4194304] 0 2024-02-28T16:26:29.583 INFO:tasks.workunit.client.0.smithi148.stdout:0/203: chown d1/d15/d8/c12 19717 1 2024-02-28T16:26:29.586 INFO:tasks.workunit.client.0.smithi148.stdout:6/194: chown d0/d22/d25/f36 1010 1 2024-02-28T16:26:29.586 INFO:tasks.workunit.client.0.smithi148.stdout:0/204: chown d1/f41 18246 1 2024-02-28T16:26:29.586 INFO:tasks.workunit.client.0.smithi148.stdout:8/185: write d1/d3/f20 [531101,53737] 0 2024-02-28T16:26:29.588 INFO:tasks.workunit.client.0.smithi148.stdout:3/228: mknod d1/d13/d19/d32/d41/c4b 0 2024-02-28T16:26:29.589 INFO:tasks.workunit.client.0.smithi148.stdout:5/117: truncate d1/f9 3134278 0 2024-02-28T16:26:29.592 INFO:tasks.workunit.client.0.smithi148.stdout:5/118: fdatasync d1/f1b 0 2024-02-28T16:26:29.593 INFO:tasks.workunit.client.0.smithi148.stdout:8/186: fdatasync d1/f9 0 2024-02-28T16:26:29.595 INFO:tasks.workunit.client.0.smithi148.stdout:0/205: mkdir d1/d46/d4a 0 2024-02-28T16:26:29.595 INFO:tasks.workunit.client.0.smithi148.stdout:8/187: fdatasync d1/de/d22/f32 0 2024-02-28T16:26:29.596 INFO:tasks.workunit.client.0.smithi148.stdout:8/188: chown d1/d3/d35 1 1 2024-02-28T16:26:29.598 INFO:tasks.workunit.client.0.smithi148.stdout:3/229: symlink d1/d13/d19/l4c 0 2024-02-28T16:26:29.598 INFO:tasks.workunit.client.0.smithi148.stdout:8/189: readlink d1/dd/d13/d24/l2a 0 2024-02-28T16:26:29.601 INFO:tasks.workunit.client.0.smithi148.stdout:5/119: mknod d1/d8/d20/c22 0 2024-02-28T16:26:29.601 INFO:tasks.workunit.client.0.smithi148.stdout:0/206: chown d1/d15/d8/cd 0 1 2024-02-28T16:26:29.604 INFO:tasks.workunit.client.0.smithi148.stdout:8/190: mkdir d1/dd/d13/d24/d3a 0 2024-02-28T16:26:29.607 INFO:tasks.workunit.client.0.smithi148.stdout:8/191: chown d1/dd/d13/d1a/d33/c37 10 1 2024-02-28T16:26:29.608 INFO:tasks.workunit.client.0.smithi148.stdout:0/207: mknod d1/d15/d27/c4b 0 2024-02-28T16:26:29.609 INFO:tasks.workunit.client.0.smithi148.stdout:3/230: fsync d1/db/f10 0 2024-02-28T16:26:29.610 INFO:tasks.workunit.client.0.smithi148.stdout:8/192: write d1/de/d22/f32 [2626746,83370] 0 2024-02-28T16:26:29.612 INFO:tasks.workunit.client.0.smithi148.stdout:5/120: rmdir d1/db 39 2024-02-28T16:26:29.615 INFO:tasks.workunit.client.0.smithi148.stdout:3/231: truncate d1/d13/d19/d1b/f2a 4977857 0 2024-02-28T16:26:29.619 INFO:tasks.workunit.client.0.smithi148.stdout:8/193: mknod d1/dd/d13/d24/d3a/c3b 0 2024-02-28T16:26:29.619 INFO:tasks.workunit.client.0.smithi148.stdout:6/195: dwrite d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:29.620 INFO:tasks.workunit.client.0.smithi148.stdout:0/208: creat d1/d15/d3d/f4c x:0 0 0 2024-02-28T16:26:29.621 INFO:tasks.workunit.client.0.smithi148.stdout:3/232: rmdir d1/db/d35 39 2024-02-28T16:26:29.626 INFO:tasks.workunit.client.0.smithi148.stdout:6/196: write d0/f1d [3288318,21687] 0 2024-02-28T16:26:29.631 INFO:tasks.workunit.client.0.smithi148.stdout:5/121: getdents d1/d8/d20 0 2024-02-28T16:26:29.633 INFO:tasks.workunit.client.0.smithi148.stdout:5/122: write d1/f1b [412443,71253] 0 2024-02-28T16:26:29.635 INFO:tasks.workunit.client.0.smithi148.stdout:6/197: read d0/d4/fa [2293216,119801] 0 2024-02-28T16:26:29.638 INFO:tasks.workunit.client.0.smithi148.stdout:6/198: write d0/d8/ff [3968566,65236] 0 2024-02-28T16:26:29.639 INFO:tasks.workunit.client.0.smithi148.stdout:0/209: dread d1/d15/d8/f29 [0,4194304] 0 2024-02-28T16:26:29.642 INFO:tasks.workunit.client.0.smithi148.stdout:5/123: dread d1/d12/f1f [0,4194304] 0 2024-02-28T16:26:29.643 INFO:tasks.workunit.client.0.smithi148.stdout:3/233: write d1/d13/d19/f30 [2776152,2927] 0 2024-02-28T16:26:29.644 INFO:tasks.workunit.client.0.smithi148.stdout:8/194: link d1/d3/c11 d1/de/c3c 0 2024-02-28T16:26:29.645 INFO:tasks.workunit.client.0.smithi148.stdout:0/210: write d1/d15/d27/f35 [672270,51623] 0 2024-02-28T16:26:29.648 INFO:tasks.workunit.client.0.smithi148.stdout:5/124: mkdir d1/d8/d23 0 2024-02-28T16:26:29.656 INFO:tasks.workunit.client.0.smithi148.stdout:3/234: dread d1/f8 [0,4194304] 0 2024-02-28T16:26:29.659 INFO:tasks.workunit.client.0.smithi148.stdout:0/211: mknod d1/d15/d3e/c4d 0 2024-02-28T16:26:29.665 INFO:tasks.workunit.client.0.smithi148.stdout:8/195: getdents d1/dd/d13/d1a 0 2024-02-28T16:26:29.666 INFO:tasks.workunit.client.0.smithi148.stdout:8/196: readlink d1/de/l28 0 2024-02-28T16:26:29.669 INFO:tasks.workunit.client.0.smithi148.stdout:0/212: link d1/f24 d1/d15/d3e/f4e 0 2024-02-28T16:26:29.670 INFO:tasks.workunit.client.0.smithi148.stdout:3/235: dwrite d1/d13/f17 [4194304,4194304] 0 2024-02-28T16:26:29.672 INFO:tasks.workunit.client.0.smithi148.stdout:8/197: unlink d1/l16 0 2024-02-28T16:26:29.674 INFO:tasks.workunit.client.0.smithi148.stdout:8/198: chown d1/de/l28 40142 1 2024-02-28T16:26:29.675 INFO:tasks.workunit.client.0.smithi148.stdout:5/125: rename d1/db/c1d to d1/c24 0 2024-02-28T16:26:29.678 INFO:tasks.workunit.client.0.smithi148.stdout:0/213: mknod d1/d46/c4f 0 2024-02-28T16:26:29.679 INFO:tasks.workunit.client.0.smithi148.stdout:0/214: readlink d1/d4/d25/l36 0 2024-02-28T16:26:29.683 INFO:tasks.workunit.client.0.smithi148.stdout:8/199: rename d1/dd/d13/d24/d3a/c3b to d1/de/d22/c3d 0 2024-02-28T16:26:29.684 INFO:tasks.workunit.client.0.smithi148.stdout:8/200: chown d1/f27 61008 1 2024-02-28T16:26:29.686 INFO:tasks.workunit.client.0.smithi148.stdout:0/215: rename d1/d4/d25/f2d to d1/d4/d25/f50 0 2024-02-28T16:26:29.689 INFO:tasks.workunit.client.0.smithi148.stdout:0/216: write d1/d4/d25/f32 [452545,62120] 0 2024-02-28T16:26:29.690 INFO:tasks.workunit.client.0.smithi148.stdout:5/126: rename d1/d12 to d1/db/d25 0 2024-02-28T16:26:29.691 INFO:tasks.workunit.client.0.smithi148.stdout:0/217: chown d1/d4/lc 963778683 1 2024-02-28T16:26:29.691 INFO:tasks.workunit.client.0.smithi148.stdout:3/236: creat d1/db/d45/f4d x:0 0 0 2024-02-28T16:26:29.693 INFO:tasks.workunit.client.0.smithi148.stdout:8/201: creat d1/dd/d13/d1a/f3e x:0 0 0 2024-02-28T16:26:29.694 INFO:tasks.workunit.client.0.smithi148.stdout:8/202: stat d1/dd/d13/d1a/d25 0 2024-02-28T16:26:29.697 INFO:tasks.workunit.client.0.smithi148.stdout:0/218: symlink d1/d15/d3e/l51 0 2024-02-28T16:26:29.699 INFO:tasks.workunit.client.0.smithi148.stdout:3/237: mknod d1/d13/d19/d32/c4e 0 2024-02-28T16:26:29.699 INFO:tasks.workunit.client.0.smithi148.stdout:0/219: write d1/f19 [850978,2194] 0 2024-02-28T16:26:29.702 INFO:tasks.workunit.client.0.smithi148.stdout:0/220: write d1/d15/f44 [1374801,1483] 0 2024-02-28T16:26:29.703 INFO:tasks.workunit.client.0.smithi148.stdout:8/203: creat d1/dd/d13/d1a/f3f x:0 0 0 2024-02-28T16:26:29.711 INFO:tasks.workunit.client.0.smithi148.stdout:5/127: creat d1/f26 x:0 0 0 2024-02-28T16:26:29.712 INFO:tasks.workunit.client.0.smithi148.stdout:0/221: creat d1/d15/d8/f52 x:0 0 0 2024-02-28T16:26:29.713 INFO:tasks.workunit.client.0.smithi148.stdout:8/204: mknod d1/dd/d13/d24/d3a/c40 0 2024-02-28T16:26:29.715 INFO:tasks.workunit.client.0.smithi148.stdout:0/222: write d1/d4/d25/f2e [176647,45606] 0 2024-02-28T16:26:29.715 INFO:tasks.workunit.client.0.smithi148.stdout:5/128: fdatasync d1/f9 0 2024-02-28T16:26:29.719 INFO:tasks.workunit.client.0.smithi148.stdout:0/223: truncate d1/d4/f45 363031 0 2024-02-28T16:26:29.720 INFO:tasks.workunit.client.0.smithi148.stdout:5/129: rmdir d1/d8/d20 39 2024-02-28T16:26:29.720 INFO:tasks.workunit.client.0.smithi148.stdout:8/205: unlink d1/de/c3c 0 2024-02-28T16:26:29.722 INFO:tasks.workunit.client.0.smithi148.stdout:5/130: write d1/db/d25/f1f [486077,103982] 0 2024-02-28T16:26:29.723 INFO:tasks.workunit.client.0.smithi148.stdout:0/224: write d1/d15/d8/f29 [2116840,101134] 0 2024-02-28T16:26:29.726 INFO:tasks.workunit.client.0.smithi148.stdout:5/131: creat d1/db/f27 x:0 0 0 2024-02-28T16:26:29.728 INFO:tasks.workunit.client.0.smithi148.stdout:0/225: symlink d1/d4/l53 0 2024-02-28T16:26:29.730 INFO:tasks.workunit.client.0.smithi148.stdout:0/226: chown d1/d15/l1b 868 1 2024-02-28T16:26:29.732 INFO:tasks.workunit.client.0.smithi148.stdout:5/132: mknod d1/d8/c28 0 2024-02-28T16:26:29.732 INFO:tasks.workunit.client.0.smithi148.stdout:8/206: dread d1/d3/f20 [0,4194304] 0 2024-02-28T16:26:29.734 INFO:tasks.workunit.client.0.smithi148.stdout:0/227: mkdir d1/d15/d27/d54 0 2024-02-28T16:26:29.735 INFO:tasks.workunit.client.0.smithi148.stdout:8/207: fsync d1/d3/f4 0 2024-02-28T16:26:29.743 INFO:tasks.workunit.client.0.smithi148.stdout:3/238: dwrite d1/db/f10 [0,4194304] 0 2024-02-28T16:26:29.746 INFO:tasks.workunit.client.0.smithi148.stdout:3/239: truncate d1/f8 4237658 0 2024-02-28T16:26:29.748 INFO:tasks.workunit.client.0.smithi148.stdout:0/228: write d1/d15/d8/f1d [1536162,20785] 0 2024-02-28T16:26:29.749 INFO:tasks.workunit.client.0.smithi148.stdout:5/133: dwrite d1/f9 [0,4194304] 0 2024-02-28T16:26:29.760 INFO:tasks.workunit.client.0.smithi148.stdout:5/134: symlink d1/d8/d20/l29 0 2024-02-28T16:26:29.761 INFO:tasks.workunit.client.0.smithi148.stdout:0/229: getdents d1/d46/d4a 0 2024-02-28T16:26:29.764 INFO:tasks.workunit.client.0.smithi148.stdout:5/135: write d1/d8/fa [1466287,42948] 0 2024-02-28T16:26:29.772 INFO:tasks.workunit.client.0.smithi148.stdout:5/136: link d1/db/f27 d1/d1a/f2a 0 2024-02-28T16:26:29.773 INFO:tasks.workunit.client.0.smithi148.stdout:3/240: dwrite d1/d13/f3e [0,4194304] 0 2024-02-28T16:26:29.785 INFO:tasks.workunit.client.0.smithi148.stdout:3/241: rename d1/d13/d19/d1b/l46 to d1/db/d45/l4f 0 2024-02-28T16:26:29.790 INFO:tasks.workunit.client.0.smithi148.stdout:0/230: dwrite d1/d4/f33 [0,4194304] 0 2024-02-28T16:26:29.792 INFO:tasks.workunit.client.0.smithi148.stdout:0/231: stat d1/d15 0 2024-02-28T16:26:29.794 INFO:tasks.workunit.client.0.smithi148.stdout:0/232: readlink d1/d4/d25/l49 0 2024-02-28T16:26:29.796 INFO:tasks.workunit.client.0.smithi148.stdout:3/242: rename d1/d13/d19/f30 to d1/d13/d19/f50 0 2024-02-28T16:26:29.800 INFO:tasks.workunit.client.0.smithi148.stdout:5/137: dwrite d1/db/d25/f1f [0,4194304] 0 2024-02-28T16:26:29.807 INFO:tasks.workunit.client.0.smithi148.stdout:3/243: symlink d1/db/d35/l51 0 2024-02-28T16:26:29.812 INFO:tasks.workunit.client.0.smithi148.stdout:5/138: dread d1/f1b [0,4194304] 0 2024-02-28T16:26:29.817 INFO:tasks.workunit.client.0.smithi148.stdout:1/122: sync 2024-02-28T16:26:29.823 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:29 smithi157 ceph-mon[38346]: pgmap v39: 65 pgs: 65 active+clean; 353 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 513 KiB/s rd, 23 MiB/s wr, 155 op/s 2024-02-28T16:26:29.824 INFO:tasks.workunit.client.0.smithi148.stdout:0/233: dwrite d1/d4/f33 [0,4194304] 0 2024-02-28T16:26:29.824 INFO:tasks.workunit.client.0.smithi148.stdout:1/123: stat d2/d5/d6/c29 0 2024-02-28T16:26:29.828 INFO:tasks.workunit.client.0.smithi148.stdout:1/124: fsync d2/d5/d6/f1b 0 2024-02-28T16:26:29.831 INFO:tasks.workunit.client.0.smithi148.stdout:0/234: creat d1/d15/f55 x:0 0 0 2024-02-28T16:26:29.834 INFO:tasks.workunit.client.0.smithi148.stdout:1/125: dread - d2/d15/f1d zero size 2024-02-28T16:26:29.834 INFO:tasks.workunit.client.0.smithi148.stdout:3/244: dwrite d1/db/d45/f4d [0,4194304] 0 2024-02-28T16:26:29.837 INFO:tasks.workunit.client.0.smithi148.stdout:5/139: truncate d1/d8/fa 882304 0 2024-02-28T16:26:29.838 INFO:tasks.workunit.client.0.smithi148.stdout:0/235: symlink d1/d4/l56 0 2024-02-28T16:26:29.839 INFO:tasks.workunit.client.0.smithi148.stdout:1/126: rmdir d2/d5/d6/d8 39 2024-02-28T16:26:29.841 INFO:tasks.workunit.client.0.smithi148.stdout:5/140: chown d1/d8/c10 1478 1 2024-02-28T16:26:29.842 INFO:tasks.workunit.client.0.smithi148.stdout:1/127: chown d2/d5/d6 10175247 1 2024-02-28T16:26:29.842 INFO:tasks.workunit.client.0.smithi148.stdout:3/245: mkdir d1/db/d35/d52 0 2024-02-28T16:26:29.846 INFO:tasks.workunit.client.0.smithi148.stdout:0/236: creat d1/d46/d4a/f57 x:0 0 0 2024-02-28T16:26:29.849 INFO:tasks.workunit.client.0.smithi148.stdout:5/141: rename d1/f1b to d1/d1a/f2b 0 2024-02-28T16:26:29.850 INFO:tasks.workunit.client.0.smithi148.stdout:1/128: truncate d2/d5/d6/d7/f12 4411965 0 2024-02-28T16:26:29.850 INFO:tasks.workunit.client.0.smithi148.stdout:3/246: truncate d1/d13/d19/d1b/d38/f49 696228 0 2024-02-28T16:26:29.853 INFO:tasks.workunit.client.0.smithi148.stdout:1/129: write d2/d5/d6/f1b [3136866,29164] 0 2024-02-28T16:26:29.859 INFO:tasks.workunit.client.0.smithi148.stdout:1/130: mkdir d2/d5/d2b 0 2024-02-28T16:26:29.870 INFO:tasks.workunit.client.0.smithi148.stdout:1/131: write d2/d5/d6/d8/f9 [1213334,59531] 0 2024-02-28T16:26:29.872 INFO:tasks.workunit.client.0.smithi148.stdout:0/237: dwrite d1/d4/d25/f2e [0,4194304] 0 2024-02-28T16:26:29.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:29 smithi148 ceph-mon[28767]: pgmap v39: 65 pgs: 65 active+clean; 353 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 513 KiB/s rd, 23 MiB/s wr, 155 op/s 2024-02-28T16:26:29.874 INFO:tasks.workunit.client.0.smithi148.stdout:5/142: dwrite d1/f26 [0,4194304] 0 2024-02-28T16:26:29.874 INFO:tasks.workunit.client.0.smithi148.stdout:0/238: read d1/d4/fe [1551111,92516] 0 2024-02-28T16:26:29.878 INFO:tasks.workunit.client.0.smithi148.stdout:0/239: write d1/f19 [802333,63716] 0 2024-02-28T16:26:29.886 INFO:tasks.workunit.client.0.smithi148.stdout:1/132: dread d2/d5/d6/d8/f21 [0,4194304] 0 2024-02-28T16:26:29.887 INFO:tasks.workunit.client.0.smithi148.stdout:1/133: readlink d2/l3 0 2024-02-28T16:26:29.888 INFO:tasks.workunit.client.0.smithi148.stdout:1/134: chown d2/d5/d2b 8 1 2024-02-28T16:26:29.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 -- 172.21.15.148:0/2944388951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fcef0 msgr2=0x7fe8a00fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:29.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 --2- 172.21.15.148:0/2944388951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fcef0 0x7fe8a00fd320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe894004940 tx=0x7fe894009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:29.933 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 -- 172.21.15.148:0/2944388951 shutdown_connections 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 --2- 172.21.15.148:0/2944388951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8a00fe0e0 0x7fe8a00fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 --2- 172.21.15.148:0/2944388951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fcef0 0x7fe8a00fd320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 -- 172.21.15.148:0/2944388951 >> 172.21.15.148:0/2944388951 conn(0x7fe8a00f8620 msgr2=0x7fe8a00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 -- 172.21.15.148:0/2944388951 shutdown_connections 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.942+0000 7fe8a7600700 1 -- 172.21.15.148:0/2944388951 wait complete. 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.943+0000 7fe8a7600700 1 Processor -- start 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.943+0000 7fe8a7600700 1 -- start start 2024-02-28T16:26:29.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.943+0000 7fe8a7600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8a00fcef0 0x7fe8a010fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.943+0000 7fe8a7600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fe0e0 0x7fe8a01100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.943+0000 7fe8a7600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a01106d0 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.943+0000 7fe8a7600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0110f70 con 0x7fe8a00fcef0 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fe0e0 0x7fe8a01100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fe0e0 0x7fe8a01100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56468/0 (socket says 172.21.15.148:56468) 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89fe00700 1 -- 172.21.15.148:0/3026612758 learned_addr learned my addr 172.21.15.148:0/3026612758 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe8a4c00700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8a00fcef0 0x7fe8a010fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89fe00700 1 -- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8a00fcef0 msgr2=0x7fe8a010fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89fe00700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8a00fcef0 0x7fe8a010fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89fe00700 1 -- 172.21.15.148:0/3026612758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894005040 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89fe00700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fe0e0 0x7fe8a01100d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00c830 tx=0x7fe88c004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:29.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89cc00700 1 -- 172.21.15.148:0/3026612758 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88c00a760 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.936 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89cc00700 1 -- 172.21.15.148:0/3026612758 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe88c00ad90 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a0111250 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.944+0000 7fe89cc00700 1 -- 172.21.15.148:0/3026612758 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88c0113a0 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.945+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a0111790 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.946+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0102210 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.947+0000 7fe89cc00700 1 -- 172.21.15.148:0/3026612758 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7fe88c012400 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.949+0000 7fe89cc00700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe88806b2e0 0x7fe88806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:29.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.949+0000 7fe89cc00700 1 -- 172.21.15.148:0/3026612758 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe88c089da0 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.949+0000 7fe8a4c00700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe88806b2e0 0x7fe88806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:29.939 INFO:tasks.workunit.client.0.smithi148.stdout:5/143: fsync d1/f26 0 2024-02-28T16:26:29.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.951+0000 7fe8a4c00700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe88806b2e0 0x7fe88806d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe89400b020 tx=0x7fe894009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:29.944 INFO:tasks.workunit.client.0.smithi148.stdout:1/135: dwrite d2/d5/d6/f1b [4194304,4194304] 0 2024-02-28T16:26:29.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:29.956+0000 7fe89cc00700 1 -- 172.21.15.148:0/3026612758 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe88c0579f0 con 0x7fe8a00fe0e0 2024-02-28T16:26:29.946 INFO:tasks.workunit.client.0.smithi148.stdout:1/136: chown d2/l18 0 1 2024-02-28T16:26:29.951 INFO:tasks.workunit.client.0.smithi148.stdout:1/137: unlink d2/d5/ff 0 2024-02-28T16:26:29.955 INFO:tasks.workunit.client.0.smithi148.stdout:1/138: fdatasync d2/d5/d6/d7/fc 0 2024-02-28T16:26:29.960 INFO:tasks.workunit.client.0.smithi148.stdout:1/139: dread d2/d5/d6/d8/f10 [0,4194304] 0 2024-02-28T16:26:29.962 INFO:tasks.workunit.client.0.smithi148.stdout:5/144: dwrite d1/d1a/f2a [0,4194304] 0 2024-02-28T16:26:29.964 INFO:tasks.workunit.client.0.smithi148.stdout:1/140: write d2/d5/d6/d8/f21 [1948331,23052] 0 2024-02-28T16:26:29.976 INFO:tasks.workunit.client.0.smithi148.stdout:5/145: dread d1/db/f27 [0,4194304] 0 2024-02-28T16:26:29.977 INFO:tasks.workunit.client.0.smithi148.stdout:5/146: write d1/f9 [2473511,76265] 0 2024-02-28T16:26:29.987 INFO:tasks.workunit.client.0.smithi148.stdout:1/141: truncate d2/d5/d6/f1b 995278 0 2024-02-28T16:26:29.988 INFO:tasks.workunit.client.0.smithi148.stdout:5/147: write d1/d8/fa [618533,64110] 0 2024-02-28T16:26:29.991 INFO:tasks.workunit.client.0.smithi148.stdout:5/148: rmdir d1 39 2024-02-28T16:26:29.993 INFO:tasks.workunit.client.0.smithi148.stdout:1/142: rename d2/d15/f1d to d2/d5/d1a/f2c 0 2024-02-28T16:26:29.997 INFO:tasks.workunit.client.0.smithi148.stdout:1/143: creat d2/d15/f2d x:0 0 0 2024-02-28T16:26:29.998 INFO:tasks.workunit.client.0.smithi148.stdout:5/149: mknod d1/d8/d23/c2c 0 2024-02-28T16:26:30.012 INFO:tasks.workunit.client.0.smithi148.stdout:1/144: dwrite d2/d5/d1a/f2c [0,4194304] 0 2024-02-28T16:26:30.018 INFO:tasks.workunit.client.0.smithi148.stdout:1/145: unlink d2/l1e 0 2024-02-28T16:26:30.021 INFO:tasks.workunit.client.0.smithi148.stdout:1/146: chown d2/ca 26017837 1 2024-02-28T16:26:30.021 INFO:tasks.workunit.client.0.smithi148.stdout:5/150: dwrite d1/d1a/f2b [0,4194304] 0 2024-02-28T16:26:30.029 INFO:tasks.workunit.client.0.smithi148.stdout:1/147: dread d2/d5/d6/d8/f10 [0,4194304] 0 2024-02-28T16:26:30.033 INFO:tasks.workunit.client.0.smithi148.stdout:1/148: mknod d2/d5/d2b/c2e 0 2024-02-28T16:26:30.034 INFO:tasks.workunit.client.0.smithi148.stdout:1/149: chown d2/d25 0 1 2024-02-28T16:26:30.040 INFO:tasks.workunit.client.0.smithi148.stdout:5/151: dwrite d1/db/f27 [0,4194304] 0 2024-02-28T16:26:30.046 INFO:tasks.workunit.client.0.smithi148.stdout:5/152: creat d1/d8/d23/f2d x:0 0 0 2024-02-28T16:26:30.050 INFO:tasks.workunit.client.0.smithi148.stdout:5/153: creat d1/db/d25/f2e x:0 0 0 2024-02-28T16:26:30.051 INFO:tasks.workunit.client.0.smithi148.stdout:9/154: sync 2024-02-28T16:26:30.053 INFO:tasks.workunit.client.0.smithi148.stdout:1/150: dwrite d2/d5/d6/d7/f12 [0,4194304] 0 2024-02-28T16:26:30.056 INFO:tasks.workunit.client.0.smithi148.stdout:1/151: write d2/d5/d6/d7/f12 [2716172,117895] 0 2024-02-28T16:26:30.056 INFO:tasks.workunit.client.0.smithi148.stdout:9/155: creat d7/dd/f37 x:0 0 0 2024-02-28T16:26:30.060 INFO:tasks.workunit.client.0.smithi148.stdout:1/152: write d2/d5/d6/d8/f21 [5022692,11613] 0 2024-02-28T16:26:30.067 INFO:tasks.workunit.client.0.smithi148.stdout:9/156: rename d7/f22 to d7/d1c/d32/d24/f38 0 2024-02-28T16:26:30.071 INFO:tasks.workunit.client.0.smithi148.stdout:5/154: dwrite d1/f26 [4194304,4194304] 0 2024-02-28T16:26:30.072 INFO:tasks.workunit.client.0.smithi148.stdout:9/157: write d7/f18 [1969804,65649] 0 2024-02-28T16:26:30.074 INFO:tasks.workunit.client.0.smithi148.stdout:5/155: write d1/f26 [2664932,78151] 0 2024-02-28T16:26:30.087 INFO:tasks.workunit.client.0.smithi148.stdout:9/158: rename d7/d1c/d32/c13 to d7/dd/c39 0 2024-02-28T16:26:30.088 INFO:tasks.workunit.client.0.smithi148.stdout:5/156: getdents d1/d8 0 2024-02-28T16:26:30.090 INFO:tasks.workunit.client.0.smithi148.stdout:1/153: dwrite d2/d5/d6/d7/fc [4194304,4194304] 0 2024-02-28T16:26:30.096 INFO:tasks.workunit.client.0.smithi148.stdout:1/154: rename d2/d5/d6/c29 to d2/d5/d6/d8/c2f 0 2024-02-28T16:26:30.099 INFO:tasks.workunit.client.0.smithi148.stdout:1/155: read d2/d5/d6/d8/f21 [3343555,104558] 0 2024-02-28T16:26:30.102 INFO:tasks.workunit.client.0.smithi148.stdout:9/159: dread d7/fb [0,4194304] 0 2024-02-28T16:26:30.102 INFO:tasks.workunit.client.0.smithi148.stdout:9/160: chown d7 7904 1 2024-02-28T16:26:30.105 INFO:tasks.workunit.client.0.smithi148.stdout:1/156: dread d2/d5/d6/f1b [0,4194304] 0 2024-02-28T16:26:30.105 INFO:tasks.workunit.client.0.smithi148.stdout:9/161: write d7/d1c/f34 [1697741,56004] 0 2024-02-28T16:26:30.107 INFO:tasks.workunit.client.0.smithi148.stdout:5/157: dread d1/f9 [0,4194304] 0 2024-02-28T16:26:30.108 INFO:tasks.workunit.client.0.smithi148.stdout:9/162: mknod d7/d1c/c3a 0 2024-02-28T16:26:30.111 INFO:tasks.workunit.client.0.smithi148.stdout:1/157: write d2/d5/d6/d8/f21 [4414738,72296] 0 2024-02-28T16:26:30.114 INFO:tasks.workunit.client.0.smithi148.stdout:5/158: creat d1/f2f x:0 0 0 2024-02-28T16:26:30.117 INFO:tasks.workunit.client.0.smithi148.stdout:1/158: creat d2/d15/f30 x:0 0 0 2024-02-28T16:26:30.122 INFO:tasks.workunit.client.0.smithi148.stdout:1/159: stat d2/d5/d6/d7/l2a 0 2024-02-28T16:26:30.123 INFO:tasks.workunit.client.0.smithi148.stdout:1/160: readlink d2/d5/d1a/l22 0 2024-02-28T16:26:30.127 INFO:tasks.workunit.client.0.smithi148.stdout:9/163: dread d7/d1c/f34 [4194304,4194304] 0 2024-02-28T16:26:30.127 INFO:tasks.workunit.client.0.smithi148.stdout:5/159: dread d1/db/f27 [0,4194304] 0 2024-02-28T16:26:30.129 INFO:tasks.workunit.client.0.smithi148.stdout:9/164: write d7/fb [3484764,29531] 0 2024-02-28T16:26:30.130 INFO:tasks.workunit.client.0.smithi148.stdout:5/160: read d1/db/d25/f1f [675601,48583] 0 2024-02-28T16:26:30.140 INFO:tasks.workunit.client.0.smithi148.stdout:5/161: getdents d1/d8 0 2024-02-28T16:26:30.144 INFO:tasks.workunit.client.0.smithi148.stdout:5/162: symlink d1/d1a/l30 0 2024-02-28T16:26:30.146 INFO:tasks.workunit.client.0.smithi148.stdout:1/161: dwrite d2/d5/d6/f23 [0,4194304] 0 2024-02-28T16:26:30.146 INFO:tasks.workunit.client.0.smithi148.stdout:5/163: stat d1/d8/c11 0 2024-02-28T16:26:30.149 INFO:tasks.workunit.client.0.smithi148.stdout:9/165: dwrite d7/d1c/d1f/f30 [0,4194304] 0 2024-02-28T16:26:30.158 INFO:tasks.workunit.client.0.smithi148.stdout:9/166: symlink d7/d1c/d32/d24/l3b 0 2024-02-28T16:26:30.161 INFO:tasks.workunit.client.0.smithi148.stdout:9/167: write d7/f18 [1562510,45622] 0 2024-02-28T16:26:30.165 INFO:tasks.workunit.client.0.smithi148.stdout:9/168: write d7/f18 [617980,36034] 0 2024-02-28T16:26:30.167 INFO:tasks.workunit.client.0.smithi148.stdout:9/169: dread - d7/d1c/d32/d24/f2f zero size 2024-02-28T16:26:30.168 INFO:tasks.workunit.client.0.smithi148.stdout:9/170: readlink d7/dd/lf 0 2024-02-28T16:26:30.171 INFO:tasks.workunit.client.0.smithi148.stdout:5/164: dwrite d1/d8/d23/f2d [0,4194304] 0 2024-02-28T16:26:30.173 INFO:tasks.workunit.client.0.smithi148.stdout:5/165: stat d1/d1a 0 2024-02-28T16:26:30.175 INFO:tasks.workunit.client.0.smithi148.stdout:5/166: dread - d1/db/d25/f2e zero size 2024-02-28T16:26:30.177 INFO:tasks.workunit.client.0.smithi148.stdout:5/167: write d1/f26 [8025677,7780] 0 2024-02-28T16:26:30.181 INFO:tasks.workunit.client.0.smithi148.stdout:5/168: mkdir d1/d8/d20/d31 0 2024-02-28T16:26:30.195 INFO:tasks.workunit.client.0.smithi148.stdout:1/162: dread d2/d5/d6/d8/f9 [0,4194304] 0 2024-02-28T16:26:30.199 INFO:tasks.workunit.client.0.smithi148.stdout:5/169: dwrite d1/db/f27 [4194304,4194304] 0 2024-02-28T16:26:30.212 INFO:tasks.workunit.client.0.smithi148.stdout:1/163: dread d2/d5/d6/f23 [0,4194304] 0 2024-02-28T16:26:30.218 INFO:tasks.workunit.client.0.smithi148.stdout:1/164: unlink d2/d5/d6/d8/c2f 0 2024-02-28T16:26:30.219 INFO:tasks.workunit.client.0.smithi148.stdout:1/165: rmdir d2/d5/d1a 39 2024-02-28T16:26:30.220 INFO:tasks.workunit.client.0.smithi148.stdout:5/170: dwrite d1/d8/d23/f2d [0,4194304] 0 2024-02-28T16:26:30.222 INFO:tasks.workunit.client.0.smithi148.stdout:5/171: chown d1/d8/fa 38 1 2024-02-28T16:26:30.223 INFO:tasks.workunit.client.0.smithi148.stdout:1/166: rmdir d2/d5/d1a 39 2024-02-28T16:26:30.226 INFO:tasks.workunit.client.0.smithi148.stdout:1/167: creat d2/d5/d2b/f31 x:0 0 0 2024-02-28T16:26:30.227 INFO:tasks.workunit.client.0.smithi148.stdout:5/172: getdents d1/d8/d20 0 2024-02-28T16:26:30.228 INFO:tasks.workunit.client.0.smithi148.stdout:1/168: creat d2/d5/d2b/f32 x:0 0 0 2024-02-28T16:26:30.229 INFO:tasks.workunit.client.0.smithi148.stdout:5/173: fsync d1/d1a/f2b 0 2024-02-28T16:26:30.230 INFO:tasks.workunit.client.0.smithi148.stdout:5/174: dread - d1/db/d25/f2e zero size 2024-02-28T16:26:30.238 INFO:tasks.workunit.client.0.smithi148.stdout:5/175: getdents d1/d8/d20 0 2024-02-28T16:26:30.241 INFO:tasks.workunit.client.0.smithi148.stdout:5/176: mkdir d1/d8/d20/d32 0 2024-02-28T16:26:30.245 INFO:tasks.workunit.client.0.smithi148.stdout:5/177: rename d1/d8/c7 to d1/d8/d20/d31/c33 0 2024-02-28T16:26:30.247 INFO:tasks.workunit.client.0.smithi148.stdout:1/169: dwrite d2/d5/d6/d8/f9 [0,4194304] 0 2024-02-28T16:26:30.247 INFO:tasks.workunit.client.0.smithi148.stdout:5/178: fsync d1/db/d25/f2e 0 2024-02-28T16:26:30.252 INFO:tasks.workunit.client.0.smithi148.stdout:1/170: mkdir d2/d15/d33 0 2024-02-28T16:26:30.253 INFO:tasks.workunit.client.0.smithi148.stdout:5/179: symlink d1/d1a/l34 0 2024-02-28T16:26:30.255 INFO:tasks.workunit.client.0.smithi148.stdout:5/180: read d1/d8/d23/f2d [1195950,51331] 0 2024-02-28T16:26:30.258 INFO:tasks.workunit.client.0.smithi148.stdout:5/181: chown d1/d1a/f2a 246316203 1 2024-02-28T16:26:30.260 INFO:tasks.workunit.client.0.smithi148.stdout:1/171: rename d2/l3 to d2/l34 0 2024-02-28T16:26:30.263 INFO:tasks.workunit.client.0.smithi148.stdout:5/182: rmdir d1/d8/d20/d32 0 2024-02-28T16:26:30.265 INFO:tasks.workunit.client.0.smithi148.stdout:1/172: rename d2/d5/d2b/f31 to d2/d15/f35 0 2024-02-28T16:26:30.266 INFO:tasks.workunit.client.0.smithi148.stdout:5/183: rmdir d1/d8/d20 39 2024-02-28T16:26:30.280 INFO:tasks.workunit.client.0.smithi148.stdout:1/173: dwrite d2/d5/d6/d8/f9 [4194304,4194304] 0 2024-02-28T16:26:30.292 INFO:tasks.workunit.client.0.smithi148.stdout:1/174: dwrite d2/d5/d6/d7/f12 [0,4194304] 0 2024-02-28T16:26:30.296 INFO:tasks.workunit.client.0.smithi148.stdout:1/175: creat d2/d5/d6/d8/f36 x:0 0 0 2024-02-28T16:26:30.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.308+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8a0111a80 con 0x7fe88806b2e0 2024-02-28T16:26:30.299 INFO:tasks.workunit.client.0.smithi148.stdout:1/176: read d2/d5/d6/d8/f10 [291510,85209] 0 2024-02-28T16:26:30.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.312+0000 7fe89cc00700 1 -- 172.21.15.148:0/3026612758 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe8a0111a80 con 0x7fe88806b2e0 2024-02-28T16:26:30.302 INFO:tasks.workunit.client.0.smithi148.stdout:1/177: write d2/d5/d6/f16 [2526373,41877] 0 2024-02-28T16:26:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe88806b2e0 msgr2=0x7fe88806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe88806b2e0 0x7fe88806d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe89400b020 tx=0x7fe894009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fe0e0 msgr2=0x7fe8a01100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fe0e0 0x7fe8a01100d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00c830 tx=0x7fe88c004470 comp rx=0 tx=0).stop 2024-02-28T16:26:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 shutdown_connections 2024-02-28T16:26:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fe88806b2e0 0x7fe88806d790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8a00fcef0 0x7fe8a010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 --2- 172.21.15.148:0/3026612758 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8a00fe0e0 0x7fe8a01100d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.315+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 >> 172.21.15.148:0/3026612758 conn(0x7fe8a00f8620 msgr2=0x7fe8a00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.316+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 shutdown_connections 2024-02-28T16:26:30.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.316+0000 7fe8a7600700 1 -- 172.21.15.148:0/3026612758 wait complete. 2024-02-28T16:26:30.323 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:26:30.400 INFO:tasks.workunit.client.0.smithi148.stdout:7/141: sync 2024-02-28T16:26:30.400 INFO:tasks.workunit.client.0.smithi148.stdout:0/240: sync 2024-02-28T16:26:30.401 INFO:tasks.workunit.client.0.smithi148.stdout:8/208: sync 2024-02-28T16:26:30.401 INFO:tasks.workunit.client.0.smithi148.stdout:6/199: sync 2024-02-28T16:26:30.401 INFO:tasks.workunit.client.0.smithi148.stdout:3/247: sync 2024-02-28T16:26:30.401 INFO:tasks.workunit.client.0.smithi148.stdout:2/164: sync 2024-02-28T16:26:30.401 INFO:tasks.workunit.client.0.smithi148.stdout:4/136: sync 2024-02-28T16:26:30.408 INFO:tasks.workunit.client.0.smithi148.stdout:6/200: mknod d0/d22/d25/d3a/c43 0 2024-02-28T16:26:30.408 INFO:tasks.workunit.client.0.smithi148.stdout:6/201: stat d0/d22/d27 0 2024-02-28T16:26:30.413 INFO:tasks.workunit.client.0.smithi148.stdout:6/202: write d0/d22/d25/d3a/f41 [839085,104242] 0 2024-02-28T16:26:30.417 INFO:tasks.workunit.client.0.smithi148.stdout:8/209: truncate d1/dd/f10 4036530 0 2024-02-28T16:26:30.419 INFO:tasks.workunit.client.0.smithi148.stdout:6/203: read d0/d10/f15 [3092242,90726] 0 2024-02-28T16:26:30.426 INFO:tasks.workunit.client.0.smithi148.stdout:8/210: rename d1/f9 to d1/dd/d13/d24/d3a/f41 0 2024-02-28T16:26:30.426 INFO:tasks.workunit.client.0.smithi148.stdout:7/142: dwrite d0/f1d [0,4194304] 0 2024-02-28T16:26:30.429 INFO:tasks.workunit.client.0.smithi148.stdout:6/204: creat d0/d22/f44 x:0 0 0 2024-02-28T16:26:30.435 INFO:tasks.workunit.client.0.smithi148.stdout:7/143: creat d0/d4/f26 x:0 0 0 2024-02-28T16:26:30.436 INFO:tasks.workunit.client.0.smithi148.stdout:8/211: creat d1/dd/d13/d1a/f42 x:0 0 0 2024-02-28T16:26:30.443 INFO:tasks.workunit.client.0.smithi148.stdout:2/165: dwrite d0/d9/f21 [0,4194304] 0 2024-02-28T16:26:30.445 INFO:tasks.workunit.client.0.smithi148.stdout:0/241: dwrite d1/f19 [0,4194304] 0 2024-02-28T16:26:30.449 INFO:tasks.workunit.client.0.smithi148.stdout:2/166: stat d0/dd/d2b 0 2024-02-28T16:26:30.451 INFO:tasks.workunit.client.0.smithi148.stdout:8/212: symlink d1/de/d22/l43 0 2024-02-28T16:26:30.452 INFO:tasks.workunit.client.0.smithi148.stdout:4/137: dread d8/df/d1f/f2b [0,4194304] 0 2024-02-28T16:26:30.454 INFO:tasks.workunit.client.0.smithi148.stdout:7/144: creat d0/d18/d19/f27 x:0 0 0 2024-02-28T16:26:30.457 INFO:tasks.workunit.client.0.smithi148.stdout:0/242: symlink d1/d15/d3e/l58 0 2024-02-28T16:26:30.459 INFO:tasks.workunit.client.0.smithi148.stdout:7/145: write d0/d9/fc [4996586,77272] 0 2024-02-28T16:26:30.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/167: mkdir d0/dd/d2b/d36 0 2024-02-28T16:26:30.462 INFO:tasks.workunit.client.0.smithi148.stdout:4/138: creat d8/d21/f2d x:0 0 0 2024-02-28T16:26:30.464 INFO:tasks.workunit.client.0.smithi148.stdout:6/205: dwrite d0/d4/d1b/f1f [0,4194304] 0 2024-02-28T16:26:30.464 INFO:tasks.workunit.client.0.smithi148.stdout:4/139: dread - d8/f26 zero size 2024-02-28T16:26:30.465 INFO:tasks.workunit.client.0.smithi148.stdout:8/213: truncate d1/d3/d18/f2b 20844 0 2024-02-28T16:26:30.465 INFO:tasks.workunit.client.0.smithi148.stdout:0/243: readlink d1/l3 0 2024-02-28T16:26:30.466 INFO:tasks.workunit.client.0.smithi148.stdout:2/168: symlink d0/d1d/l37 0 2024-02-28T16:26:30.469 INFO:tasks.workunit.client.0.smithi148.stdout:7/146: mkdir d0/d18/d19/d28 0 2024-02-28T16:26:30.469 INFO:tasks.workunit.client.0.smithi148.stdout:8/214: chown d1/dd/d13/d1a/f42 26218 1 2024-02-28T16:26:30.471 INFO:tasks.workunit.client.0.smithi148.stdout:0/244: mknod d1/d4/d25/c59 0 2024-02-28T16:26:30.475 INFO:tasks.workunit.client.0.smithi148.stdout:4/140: mknod d8/df/d1f/c2e 0 2024-02-28T16:26:30.478 INFO:tasks.workunit.client.0.smithi148.stdout:6/206: chown d0/d22/c2a 76134878 1 2024-02-28T16:26:30.478 INFO:tasks.workunit.client.0.smithi148.stdout:7/147: chown d0/cb 421 1 2024-02-28T16:26:30.482 INFO:tasks.workunit.client.0.smithi148.stdout:0/245: fsync d1/d4/fe 0 2024-02-28T16:26:30.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.499+0000 7f2243a00700 1 -- 172.21.15.148:0/1166703459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 msgr2=0x7f223c0ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:30.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.499+0000 7f2243a00700 1 --2- 172.21.15.148:0/1166703459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 0x7f223c0ffe60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2230004880 tx=0x7f2230009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:30.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.499+0000 7f2243a00700 1 -- 172.21.15.148:0/1166703459 shutdown_connections 2024-02-28T16:26:30.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.499+0000 7f2243a00700 1 --2- 172.21.15.148:0/1166703459 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 0x7f223c102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.499+0000 7f2243a00700 1 --2- 172.21.15.148:0/1166703459 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 0x7f223c0ffe60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.499+0000 7f2243a00700 1 -- 172.21.15.148:0/1166703459 >> 172.21.15.148:0/1166703459 conn(0x7f223c0f74e0 msgr2=0x7f223c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:30.491 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.502+0000 7f2243a00700 1 -- 172.21.15.148:0/1166703459 shutdown_connections 2024-02-28T16:26:30.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.502+0000 7f2243a00700 1 -- 172.21.15.148:0/1166703459 wait complete. 2024-02-28T16:26:30.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.503+0000 7f2243a00700 1 Processor -- start 2024-02-28T16:26:30.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.503+0000 7f2243a00700 1 -- start start 2024-02-28T16:26:30.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.503+0000 7f2243a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 0x7f223c113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:30.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.504+0000 7f2243a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 0x7f223c114460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:30.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.504+0000 7f2243a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c114a60 con 0x7f223c1003a0 2024-02-28T16:26:30.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.504+0000 7f2243a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c115300 con 0x7f223c0fda80 2024-02-28T16:26:30.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.504+0000 7f223be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 0x7f223c114460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:30.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.504+0000 7f223be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 0x7f223c114460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56480/0 (socket says 172.21.15.148:56480) 2024-02-28T16:26:30.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.504+0000 7f223be00700 1 -- 172.21.15.148:0/3767797616 learned_addr learned my addr 172.21.15.148:0/3767797616 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:26:30.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.504+0000 7f2241000700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 0x7f223c113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:30.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.505+0000 7f2241000700 1 -- 172.21.15.148:0/3767797616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 msgr2=0x7f223c114460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:30.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.505+0000 7f2241000700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 0x7f223c114460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.505+0000 7f2241000700 1 -- 172.21.15.148:0/3767797616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230005040 con 0x7f223c0fda80 2024-02-28T16:26:30.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.505+0000 7f223be00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 0x7f223c114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:26:30.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.505+0000 7f2241000700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 0x7f223c113f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2230004880 tx=0x7f2230009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:30.495 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.505+0000 7f2238c00700 1 -- 172.21.15.148:0/3767797616 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223000e070 con 0x7f223c0fda80 2024-02-28T16:26:30.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.506+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c115580 con 0x7f223c0fda80 2024-02-28T16:26:30.496 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.506+0000 7f2238c00700 1 -- 172.21.15.148:0/3767797616 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2230013e60 con 0x7f223c0fda80 2024-02-28T16:26:30.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.506+0000 7f2238c00700 1 -- 172.21.15.148:0/3767797616 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f223001ce30 con 0x7f223c0fda80 2024-02-28T16:26:30.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.506+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c115a60 con 0x7f223c0fda80 2024-02-28T16:26:30.497 INFO:tasks.workunit.client.0.smithi148.stdout:2/169: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:26:30.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.508+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c04bed0 con 0x7f223c0fda80 2024-02-28T16:26:30.501 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.511+0000 7f2238c00700 1 -- 172.21.15.148:0/3767797616 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f223001c690 con 0x7f223c0fda80 2024-02-28T16:26:30.501 INFO:tasks.workunit.client.0.smithi148.stdout:4/141: link d8/df/d1f/f2b d8/df/d17/f2f 0 2024-02-28T16:26:30.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.512+0000 7f2238c00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f222406b2e0 0x7f222406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:30.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.512+0000 7f2238c00700 1 -- 172.21.15.148:0/3767797616 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f223008b150 con 0x7f223c0fda80 2024-02-28T16:26:30.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.513+0000 7f223be00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f222406b2e0 0x7f222406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:30.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.514+0000 7f223be00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f222406b2e0 0x7f222406d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2228009b80 tx=0x7f222800b040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:30.506 INFO:tasks.workunit.client.0.smithi148.stdout:6/207: creat d0/d22/d27/d3e/f45 x:0 0 0 2024-02-28T16:26:30.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.518+0000 7f2238c00700 1 -- 172.21.15.148:0/3767797616 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2230058c90 con 0x7f223c0fda80 2024-02-28T16:26:30.510 INFO:tasks.workunit.client.0.smithi148.stdout:9/171: sync 2024-02-28T16:26:30.512 INFO:tasks.workunit.client.0.smithi148.stdout:0/246: dwrite d1/d15/f2a [0,4194304] 0 2024-02-28T16:26:30.513 INFO:tasks.workunit.client.0.smithi148.stdout:9/172: chown d7/f21 1356 1 2024-02-28T16:26:30.515 INFO:tasks.workunit.client.0.smithi148.stdout:0/247: truncate d1/d15/d8/f30 5120707 0 2024-02-28T16:26:30.515 INFO:tasks.workunit.client.0.smithi148.stdout:9/173: fsync d7/dd/f37 0 2024-02-28T16:26:30.523 INFO:tasks.workunit.client.0.smithi148.stdout:7/148: link d0/d18/d19/f27 d0/d18/d19/f29 0 2024-02-28T16:26:30.524 INFO:tasks.workunit.client.0.smithi148.stdout:7/149: chown d0/d9 634596310 1 2024-02-28T16:26:30.528 INFO:tasks.workunit.client.0.smithi148.stdout:2/170: rename d0/dd/d2c to d0/d9/d13/d38 0 2024-02-28T16:26:30.534 INFO:tasks.workunit.client.0.smithi148.stdout:4/142: creat d8/d21/f30 x:0 0 0 2024-02-28T16:26:30.536 INFO:tasks.workunit.client.0.smithi148.stdout:0/248: dwrite d1/d15/d27/d34/f3a [0,4194304] 0 2024-02-28T16:26:30.536 INFO:tasks.workunit.client.0.smithi148.stdout:9/174: dread d7/d1c/d1f/f30 [0,4194304] 0 2024-02-28T16:26:30.538 INFO:tasks.workunit.client.0.smithi148.stdout:0/249: chown d1/f41 3544 1 2024-02-28T16:26:30.541 INFO:tasks.workunit.client.0.smithi148.stdout:6/208: mknod d0/d22/d25/c46 0 2024-02-28T16:26:30.552 INFO:tasks.workunit.client.0.smithi148.stdout:8/215: truncate d1/d3/d18/f2b 801577 0 2024-02-28T16:26:30.555 INFO:tasks.workunit.client.0.smithi148.stdout:7/150: creat d0/d18/f2a x:0 0 0 2024-02-28T16:26:30.559 INFO:tasks.workunit.client.0.smithi148.stdout:2/171: unlink d0/d1c/l1e 0 2024-02-28T16:26:30.561 INFO:tasks.workunit.client.0.smithi148.stdout:4/143: symlink d8/df/l31 0 2024-02-28T16:26:30.564 INFO:tasks.workunit.client.0.smithi148.stdout:0/250: chown d1/f22 24250 1 2024-02-28T16:26:30.566 INFO:tasks.workunit.client.0.smithi148.stdout:6/209: creat d0/d4/d1b/f47 x:0 0 0 2024-02-28T16:26:30.569 INFO:tasks.workunit.client.0.smithi148.stdout:8/216: unlink d1/de/d22/l43 0 2024-02-28T16:26:30.573 INFO:tasks.workunit.client.0.smithi148.stdout:2/172: symlink d0/d18/d20/l39 0 2024-02-28T16:26:30.574 INFO:tasks.workunit.client.0.smithi148.stdout:9/175: fdatasync d7/f17 0 2024-02-28T16:26:30.575 INFO:tasks.workunit.client.0.smithi148.stdout:5/184: sync 2024-02-28T16:26:30.575 INFO:tasks.workunit.client.0.smithi148.stdout:1/178: sync 2024-02-28T16:26:30.575 INFO:tasks.workunit.client.0.smithi148.stdout:3/248: sync 2024-02-28T16:26:30.583 INFO:tasks.workunit.client.0.smithi148.stdout:0/251: mkdir d1/d15/d27/d34/d5a 0 2024-02-28T16:26:30.583 INFO:tasks.workunit.client.0.smithi148.stdout:7/151: mkdir d0/d18/d19/d28/d2b 0 2024-02-28T16:26:30.590 INFO:tasks.workunit.client.0.smithi148.stdout:8/217: creat d1/dd/d13/d1a/f44 x:0 0 0 2024-02-28T16:26:30.594 INFO:tasks.workunit.client.0.smithi148.stdout:7/152: readlink d0/d18/d19/l22 0 2024-02-28T16:26:30.594 INFO:tasks.workunit.client.0.smithi148.stdout:2/173: mkdir d0/d9/d13/d38/d3a 0 2024-02-28T16:26:30.597 INFO:tasks.workunit.client.0.smithi148.stdout:8/218: fsync d1/d3/d35/f30 0 2024-02-28T16:26:30.602 INFO:tasks.workunit.client.0.smithi148.stdout:8/219: chown d1/f2e 0 1 2024-02-28T16:26:30.609 INFO:tasks.workunit.client.0.smithi148.stdout:5/185: dwrite d1/d1a/f2a [4194304,4194304] 0 2024-02-28T16:26:30.609 INFO:tasks.workunit.client.0.smithi148.stdout:1/179: dread d2/d5/d1a/f24 [0,4194304] 0 2024-02-28T16:26:30.611 INFO:tasks.workunit.client.0.smithi148.stdout:7/153: symlink d0/d18/d19/d1c/l2c 0 2024-02-28T16:26:30.611 INFO:tasks.workunit.client.0.smithi148.stdout:3/249: dwrite d1/d13/f15 [0,4194304] 0 2024-02-28T16:26:30.618 INFO:tasks.workunit.client.0.smithi148.stdout:6/210: rename d0/d10/c32 to d0/d4/c48 0 2024-02-28T16:26:30.626 INFO:tasks.workunit.client.0.smithi148.stdout:9/176: dwrite d7/f18 [0,4194304] 0 2024-02-28T16:26:30.626 INFO:tasks.workunit.client.0.smithi148.stdout:5/186: readlink d1/d8/d20/l29 0 2024-02-28T16:26:30.628 INFO:tasks.workunit.client.0.smithi148.stdout:5/187: chown d1/d8/l1e 27636472 1 2024-02-28T16:26:30.629 INFO:tasks.workunit.client.0.smithi148.stdout:9/177: readlink d7/dd/lf 0 2024-02-28T16:26:30.632 INFO:tasks.workunit.client.0.smithi148.stdout:5/188: fsync d1/db/d25/f2e 0 2024-02-28T16:26:30.635 INFO:tasks.workunit.client.0.smithi148.stdout:0/252: truncate d1/d15/f44 1756121 0 2024-02-28T16:26:30.637 INFO:tasks.workunit.client.0.smithi148.stdout:7/154: mknod d0/d4/c2d 0 2024-02-28T16:26:30.637 INFO:tasks.workunit.client.0.smithi148.stdout:9/178: write d7/d1c/d32/d24/f2f [334885,55150] 0 2024-02-28T16:26:30.639 INFO:tasks.workunit.client.0.smithi148.stdout:3/250: truncate d1/d13/d19/d1b/d38/f49 1643239 0 2024-02-28T16:26:30.639 INFO:tasks.workunit.client.0.smithi148.stdout:2/174: creat d0/d9/f3b x:0 0 0 2024-02-28T16:26:30.640 INFO:tasks.workunit.client.0.smithi148.stdout:6/211: mkdir d0/d22/d49 0 2024-02-28T16:26:30.643 INFO:tasks.workunit.client.0.smithi148.stdout:1/180: mknod d2/d25/c37 0 2024-02-28T16:26:30.646 INFO:tasks.workunit.client.0.smithi148.stdout:3/251: readlink d1/d13/d19/l27 0 2024-02-28T16:26:30.648 INFO:tasks.workunit.client.0.smithi148.stdout:6/212: write d0/d10/f13 [4157177,49228] 0 2024-02-28T16:26:30.650 INFO:tasks.workunit.client.0.smithi148.stdout:5/189: creat d1/d1a/f35 x:0 0 0 2024-02-28T16:26:30.653 INFO:tasks.workunit.client.0.smithi148.stdout:4/144: dwrite f7 [0,4194304] 0 2024-02-28T16:26:30.657 INFO:tasks.workunit.client.0.smithi148.stdout:1/181: creat d2/d5/d6/d7/f38 x:0 0 0 2024-02-28T16:26:30.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/220: dwrite d1/d3/f20 [0,4194304] 0 2024-02-28T16:26:30.662 INFO:tasks.workunit.client.0.smithi148.stdout:3/252: truncate d1/d13/d19/d1b/d38/f43 718861 0 2024-02-28T16:26:30.669 INFO:tasks.workunit.client.0.smithi148.stdout:6/213: creat d0/d22/d27/f4a x:0 0 0 2024-02-28T16:26:30.675 INFO:tasks.workunit.client.0.smithi148.stdout:5/190: unlink d1/f9 0 2024-02-28T16:26:30.677 INFO:tasks.workunit.client.0.smithi148.stdout:2/175: dwrite d0/dd/d2b/f31 [0,4194304] 0 2024-02-28T16:26:30.683 INFO:tasks.workunit.client.0.smithi148.stdout:7/155: dwrite d0/f7 [0,4194304] 0 2024-02-28T16:26:30.684 INFO:tasks.workunit.client.0.smithi148.stdout:2/176: stat d0/d9 0 2024-02-28T16:26:30.687 INFO:tasks.workunit.client.0.smithi148.stdout:2/177: write d0/f8 [2150688,25961] 0 2024-02-28T16:26:30.688 INFO:tasks.workunit.client.0.smithi148.stdout:9/179: creat d7/f3c x:0 0 0 2024-02-28T16:26:30.689 INFO:tasks.workunit.client.0.smithi148.stdout:8/221: dread d1/d3/d35/f30 [0,4194304] 0 2024-02-28T16:26:30.705 INFO:tasks.workunit.client.0.smithi148.stdout:5/191: rename d1/db/d25/c1c to d1/db/d25/c36 0 2024-02-28T16:26:30.710 INFO:tasks.workunit.client.0.smithi148.stdout:5/192: readlink d1/d8/d20/l29 0 2024-02-28T16:26:30.710 INFO:tasks.workunit.client.0.smithi148.stdout:2/178: creat d0/d9/d13/f3c x:0 0 0 2024-02-28T16:26:30.720 INFO:tasks.workunit.client.0.smithi148.stdout:8/222: dwrite d1/d3/fa [0,4194304] 0 2024-02-28T16:26:30.721 INFO:tasks.workunit.client.0.smithi148.stdout:6/214: unlink d0/d4/c48 0 2024-02-28T16:26:30.722 INFO:tasks.workunit.client.0.smithi148.stdout:2/179: truncate d0/d18/d20/f33 449730 0 2024-02-28T16:26:30.724 INFO:tasks.workunit.client.0.smithi148.stdout:6/215: write d0/d10/f13 [36526,65947] 0 2024-02-28T16:26:30.724 INFO:tasks.workunit.client.0.smithi148.stdout:2/180: dread - d0/d1d/f34 zero size 2024-02-28T16:26:30.726 INFO:tasks.workunit.client.0.smithi148.stdout:9/180: dwrite d7/dd/f37 [0,4194304] 0 2024-02-28T16:26:30.732 INFO:tasks.workunit.client.0.smithi148.stdout:7/156: fsync d0/f13 0 2024-02-28T16:26:30.749 INFO:tasks.workunit.client.0.smithi148.stdout:8/223: dwrite d1/dd/d13/d1a/f3f [0,4194304] 0 2024-02-28T16:26:30.751 INFO:tasks.workunit.client.0.smithi148.stdout:4/145: getdents d8/df/d17 0 2024-02-28T16:26:30.755 INFO:tasks.workunit.client.0.smithi148.stdout:6/216: fsync d0/d4/f3c 0 2024-02-28T16:26:30.758 INFO:tasks.workunit.client.0.smithi148.stdout:8/224: dread d1/f27 [0,4194304] 0 2024-02-28T16:26:30.759 INFO:tasks.workunit.client.0.smithi148.stdout:9/181: mkdir d7/d1c/d3d 0 2024-02-28T16:26:30.762 INFO:tasks.workunit.client.0.smithi148.stdout:1/182: rename d2/d5/d1a/c1c to d2/d5/c39 0 2024-02-28T16:26:30.764 INFO:tasks.workunit.client.0.smithi148.stdout:9/182: readlink d7/dd/lf 0 2024-02-28T16:26:30.768 INFO:tasks.workunit.client.0.smithi148.stdout:7/157: dwrite d0/d4/f26 [0,4194304] 0 2024-02-28T16:26:30.770 INFO:tasks.workunit.client.0.smithi148.stdout:6/217: write d0/d22/d27/f4a [507619,42376] 0 2024-02-28T16:26:30.770 INFO:tasks.workunit.client.0.smithi148.stdout:2/181: symlink d0/d9/d13/d38/d3a/l3d 0 2024-02-28T16:26:30.771 INFO:tasks.workunit.client.0.smithi148.stdout:5/193: link d1/d1a/l30 d1/db/l37 0 2024-02-28T16:26:30.772 INFO:tasks.workunit.client.0.smithi148.stdout:9/183: write d7/dd/f2e [134904,83537] 0 2024-02-28T16:26:30.773 INFO:tasks.workunit.client.0.smithi148.stdout:3/253: dread d1/d13/d19/d1b/f2a [0,4194304] 0 2024-02-28T16:26:30.777 INFO:tasks.workunit.client.0.smithi148.stdout:2/182: fsync d0/d18/f28 0 2024-02-28T16:26:30.778 INFO:tasks.workunit.client.0.smithi148.stdout:8/225: write d1/de/d22/f32 [2166171,93193] 0 2024-02-28T16:26:30.779 INFO:tasks.workunit.client.0.smithi148.stdout:1/183: write d2/d5/d1a/f24 [1199790,8959] 0 2024-02-28T16:26:30.779 INFO:tasks.workunit.client.0.smithi148.stdout:4/146: rename l4 to d8/df/l32 0 2024-02-28T16:26:30.781 INFO:tasks.workunit.client.0.smithi148.stdout:2/183: chown d0/l4 60711 1 2024-02-28T16:26:30.783 INFO:tasks.workunit.client.0.smithi148.stdout:4/147: dread - d8/d21/f2d zero size 2024-02-28T16:26:30.783 INFO:tasks.workunit.client.0.smithi148.stdout:6/218: write d0/d4/d14/f28 [4488092,36319] 0 2024-02-28T16:26:30.784 INFO:tasks.workunit.client.0.smithi148.stdout:3/254: fsync d1/d13/f15 0 2024-02-28T16:26:30.790 INFO:tasks.workunit.client.0.smithi148.stdout:9/184: readlink d7/l9 0 2024-02-28T16:26:30.791 INFO:tasks.workunit.client.0.smithi148.stdout:5/194: unlink d1/d8/l14 0 2024-02-28T16:26:30.794 INFO:tasks.workunit.client.0.smithi148.stdout:9/185: truncate d7/f3c 582395 0 2024-02-28T16:26:30.796 INFO:tasks.workunit.client.0.smithi148.stdout:9/186: chown d7/d1c/d32/d24 50 1 2024-02-28T16:26:30.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/158: symlink d0/d18/d19/d1c/l2e 0 2024-02-28T16:26:30.809 INFO:tasks.workunit.client.0.smithi148.stdout:8/226: dwrite d1/dd/d13/d24/d3a/f41 [0,4194304] 0 2024-02-28T16:26:30.811 INFO:tasks.workunit.client.0.smithi148.stdout:1/184: creat d2/d5/d1a/f3a x:0 0 0 2024-02-28T16:26:30.813 INFO:tasks.workunit.client.0.smithi148.stdout:4/148: read f6 [48019,119123] 0 2024-02-28T16:26:30.815 INFO:tasks.workunit.client.0.smithi148.stdout:2/184: dwrite d0/d9/f3b [0,4194304] 0 2024-02-28T16:26:30.815 INFO:tasks.workunit.client.0.smithi148.stdout:5/195: mknod d1/db/c38 0 2024-02-28T16:26:30.817 INFO:tasks.workunit.client.0.smithi148.stdout:3/255: dread d1/d13/d19/d1b/f2a [0,4194304] 0 2024-02-28T16:26:30.822 INFO:tasks.workunit.client.0.smithi148.stdout:1/185: symlink d2/d25/l3b 0 2024-02-28T16:26:30.826 INFO:tasks.workunit.client.0.smithi148.stdout:1/186: chown d2/d5/d6/d7/f38 118422 1 2024-02-28T16:26:30.830 INFO:tasks.workunit.client.0.smithi148.stdout:1/187: write d2/d5/d6/d7/f38 [460498,7870] 0 2024-02-28T16:26:30.831 INFO:tasks.workunit.client.0.smithi148.stdout:3/256: write d1/d13/d19/f33 [589253,12786] 0 2024-02-28T16:26:30.837 INFO:tasks.workunit.client.0.smithi148.stdout:3/257: write d1/d13/d19/d32/f37 [821754,93227] 0 2024-02-28T16:26:30.842 INFO:tasks.workunit.client.0.smithi148.stdout:4/149: rename d8/df/d1f/f2b to d8/f33 0 2024-02-28T16:26:30.845 INFO:tasks.workunit.client.0.smithi148.stdout:8/227: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:26:30.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.860+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f223c102010 con 0x7f222406b2e0 2024-02-28T16:26:30.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.864+0000 7f2238c00700 1 -- 172.21.15.148:0/3767797616 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f223c102010 con 0x7f222406b2e0 2024-02-28T16:26:30.855 INFO:tasks.workunit.client.0.smithi148.stdout:7/159: dread d0/d9/fc [4194304,4194304] 0 2024-02-28T16:26:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.867+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f222406b2e0 msgr2=0x7f222406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.867+0000 7f2243a00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f222406b2e0 0x7f222406d790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2228009b80 tx=0x7f222800b040 comp rx=0 tx=0).stop 2024-02-28T16:26:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.867+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 msgr2=0x7f223c113f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.867+0000 7f2243a00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 0x7f223c113f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2230004880 tx=0x7f2230009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.868+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 shutdown_connections 2024-02-28T16:26:30.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.868+0000 7f2243a00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f222406b2e0 0x7f222406d790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.868+0000 7f2243a00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f223c0fda80 0x7f223c113f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.868+0000 7f2243a00700 1 --2- 172.21.15.148:0/3767797616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f223c1003a0 0x7f223c114460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:30.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.868+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 >> 172.21.15.148:0/3767797616 conn(0x7f223c0f74e0 msgr2=0x7f223c0f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:30.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.869+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 shutdown_connections 2024-02-28T16:26:30.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:30.869+0000 7f2243a00700 1 -- 172.21.15.148:0/3767797616 wait complete. 2024-02-28T16:26:30.860 INFO:tasks.workunit.client.0.smithi148.stdout:7/160: stat d0/f1d 0 2024-02-28T16:26:30.861 INFO:tasks.workunit.client.0.smithi148.stdout:5/196: dread d1/d8/fa [0,4194304] 0 2024-02-28T16:26:30.864 INFO:tasks.workunit.client.0.smithi148.stdout:5/197: read d1/d1a/f2b [3925303,93465] 0 2024-02-28T16:26:30.865 INFO:tasks.workunit.client.0.smithi148.stdout:3/258: rename d1/d13/f3e to d1/d13/d19/d32/d41/f53 0 2024-02-28T16:26:30.867 INFO:tasks.workunit.client.0.smithi148.stdout:9/187: link d7/l9 d7/dd/l3e 0 2024-02-28T16:26:30.874 INFO:tasks.workunit.client.0.smithi148.stdout:6/219: write d0/d4/fa [3546316,93832] 0 2024-02-28T16:26:30.876 INFO:tasks.workunit.client.0.smithi148.stdout:2/185: write d0/d9/f3b [4622681,21868] 0 2024-02-28T16:26:30.879 INFO:tasks.workunit.client.0.smithi148.stdout:9/188: unlink d7/f18 0 2024-02-28T16:26:30.880 INFO:tasks.workunit.client.0.smithi148.stdout:7/161: dread d0/f11 [0,4194304] 0 2024-02-28T16:26:30.881 INFO:tasks.workunit.client.0.smithi148.stdout:5/198: creat d1/d8/d20/d31/f39 x:0 0 0 2024-02-28T16:26:30.887 INFO:tasks.workunit.client.0.smithi148.stdout:3/259: dwrite d1/d13/d19/d32/f37 [0,4194304] 0 2024-02-28T16:26:30.888 INFO:tasks.workunit.client.0.smithi148.stdout:2/186: creat d0/d9/d13/d38/f3e x:0 0 0 2024-02-28T16:26:30.891 INFO:tasks.workunit.client.0.smithi148.stdout:6/220: rename d0/d22/d27/f4a to d0/d22/d25/f4b 0 2024-02-28T16:26:30.891 INFO:tasks.workunit.client.0.smithi148.stdout:1/188: dread d2/d5/d6/d7/fc [0,4194304] 0 2024-02-28T16:26:30.892 INFO:tasks.workunit.client.0.smithi148.stdout:2/187: chown d0/d1d 496 1 2024-02-28T16:26:30.895 INFO:tasks.workunit.client.0.smithi148.stdout:2/188: stat d0/d9/d13/d38/f3e 0 2024-02-28T16:26:30.895 INFO:tasks.workunit.client.0.smithi148.stdout:9/189: write d7/d1c/f34 [5048401,56201] 0 2024-02-28T16:26:30.900 INFO:tasks.workunit.client.0.smithi148.stdout:8/228: truncate d1/d3/f20 3218187 0 2024-02-28T16:26:30.902 INFO:tasks.workunit.client.0.smithi148.stdout:7/162: creat d0/d9/d25/f2f x:0 0 0 2024-02-28T16:26:30.903 INFO:tasks.workunit.client.0.smithi148.stdout:5/199: dread d1/db/f27 [4194304,4194304] 0 2024-02-28T16:26:30.904 INFO:tasks.workunit.client.0.smithi148.stdout:9/190: mknod d7/d1c/d1f/c3f 0 2024-02-28T16:26:30.907 INFO:tasks.workunit.client.0.smithi148.stdout:2/189: symlink d0/d18/d20/l3f 0 2024-02-28T16:26:30.909 INFO:tasks.workunit.client.0.smithi148.stdout:2/190: write d0/d9/f3b [5360856,126419] 0 2024-02-28T16:26:30.912 INFO:tasks.workunit.client.0.smithi148.stdout:7/163: fdatasync d0/d9/fc 0 2024-02-28T16:26:30.913 INFO:tasks.workunit.client.0.smithi148.stdout:5/200: chown d1/db/d25/c36 0 1 2024-02-28T16:26:30.914 INFO:tasks.workunit.client.0.smithi148.stdout:2/191: write d0/d9/d13/f3c [309365,8213] 0 2024-02-28T16:26:30.915 INFO:tasks.workunit.client.0.smithi148.stdout:2/192: stat d0/f27 0 2024-02-28T16:26:30.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/201: dread - d1/f2f zero size 2024-02-28T16:26:30.918 INFO:tasks.workunit.client.0.smithi148.stdout:8/229: unlink d1/de/d22/c3d 0 2024-02-28T16:26:30.919 INFO:tasks.workunit.client.0.smithi148.stdout:9/191: symlink d7/dd/d35/l40 0 2024-02-28T16:26:30.921 INFO:tasks.workunit.client.0.smithi148.stdout:6/221: getdents d0 0 2024-02-28T16:26:30.921 INFO:tasks.workunit.client.0.smithi148.stdout:1/189: getdents d2/d25 0 2024-02-28T16:26:30.923 INFO:tasks.workunit.client.0.smithi148.stdout:2/193: unlink d0/d9/f3b 0 2024-02-28T16:26:30.926 INFO:tasks.workunit.client.0.smithi148.stdout:8/230: mknod d1/dd/d13/c45 0 2024-02-28T16:26:30.928 INFO:tasks.workunit.client.0.smithi148.stdout:9/192: fdatasync d7/f17 0 2024-02-28T16:26:30.934 INFO:tasks.workunit.client.0.smithi148.stdout:1/190: getdents d2/d5/d6/d7 0 2024-02-28T16:26:30.934 INFO:tasks.workunit.client.0.smithi148.stdout:8/231: creat d1/d3/d35/f46 x:0 0 0 2024-02-28T16:26:30.943 INFO:tasks.workunit.client.0.smithi148.stdout:9/193: symlink d7/d1c/l41 0 2024-02-28T16:26:30.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/232: fdatasync d1/f1c 0 2024-02-28T16:26:30.950 INFO:tasks.workunit.client.0.smithi148.stdout:5/202: dwrite d1/db/d25/f2e [0,4194304] 0 2024-02-28T16:26:30.950 INFO:tasks.workunit.client.0.smithi148.stdout:3/260: dread d1/d13/f17 [0,4194304] 0 2024-02-28T16:26:30.955 INFO:tasks.workunit.client.0.smithi148.stdout:5/203: readlink d1/ld 0 2024-02-28T16:26:30.956 INFO:tasks.workunit.client.0.smithi148.stdout:8/233: creat d1/d3/f47 x:0 0 0 2024-02-28T16:26:30.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/234: fsync d1/d3/f1e 0 2024-02-28T16:26:30.964 INFO:tasks.workunit.client.0.smithi148.stdout:9/194: write d7/d1c/d1f/f30 [4887968,93476] 0 2024-02-28T16:26:30.965 INFO:tasks.workunit.client.0.smithi148.stdout:3/261: read - d1/d13/d19/f4a zero size 2024-02-28T16:26:30.967 INFO:tasks.workunit.client.0.smithi148.stdout:5/204: creat d1/db/d25/f3a x:0 0 0 2024-02-28T16:26:30.970 INFO:tasks.workunit.client.0.smithi148.stdout:2/194: dwrite d0/d9/d13/f3c [0,4194304] 0 2024-02-28T16:26:30.973 INFO:tasks.workunit.client.0.smithi148.stdout:2/195: stat d0/d1c/l29 0 2024-02-28T16:26:30.975 INFO:tasks.workunit.client.0.smithi148.stdout:6/222: dwrite d0/d22/d25/f36 [0,4194304] 0 2024-02-28T16:26:30.977 INFO:tasks.workunit.client.0.smithi148.stdout:8/235: rename d1/de to d1/d3/d18/d48 0 2024-02-28T16:26:30.980 INFO:tasks.workunit.client.0.smithi148.stdout:1/191: dwrite d2/d5/d6/d7/fc [0,4194304] 0 2024-02-28T16:26:30.982 INFO:tasks.workunit.client.0.smithi148.stdout:7/164: dwrite d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:30.995 INFO:tasks.workunit.client.0.smithi148.stdout:1/192: rmdir d2/d5 39 2024-02-28T16:26:31.007 INFO:tasks.workunit.client.0.smithi148.stdout:6/223: creat d0/f4c x:0 0 0 2024-02-28T16:26:31.010 INFO:tasks.workunit.client.0.smithi148.stdout:2/196: dwrite d0/f24 [0,4194304] 0 2024-02-28T16:26:31.011 INFO:tasks.workunit.client.0.smithi148.stdout:2/197: readlink d0/d1d/l2a 0 2024-02-28T16:26:31.020 INFO:tasks.workunit.client.0.smithi148.stdout:2/198: write d0/f27 [62742,14106] 0 2024-02-28T16:26:31.020 INFO:tasks.workunit.client.0.smithi148.stdout:5/205: getdents d1/d8/d23 0 2024-02-28T16:26:31.023 INFO:tasks.workunit.client.0.smithi148.stdout:7/165: dread d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:31.032 INFO:tasks.workunit.client.0.smithi148.stdout:1/193: mkdir d2/d5/d3c 0 2024-02-28T16:26:31.034 INFO:tasks.workunit.client.0.smithi148.stdout:7/166: read d0/d9/f1a [4071503,84014] 0 2024-02-28T16:26:31.035 INFO:tasks.workunit.client.0.smithi148.stdout:6/224: rmdir d0 39 2024-02-28T16:26:31.040 INFO:tasks.workunit.client.0.smithi148.stdout:1/194: creat d2/d5/d6/f3d x:0 0 0 2024-02-28T16:26:31.045 INFO:tasks.workunit.client.0.smithi148.stdout:7/167: dread d0/d9/fe [0,4194304] 0 2024-02-28T16:26:31.045 INFO:tasks.workunit.client.0.smithi148.stdout:3/262: dread d1/db/d35/f47 [0,4194304] 0 2024-02-28T16:26:31.047 INFO:tasks.workunit.client.0.smithi148.stdout:0/253: sync 2024-02-28T16:26:31.054 INFO:tasks.workunit.client.0.smithi148.stdout:2/199: dwrite d0/dd/d2b/f31 [4194304,4194304] 0 2024-02-28T16:26:31.054 INFO:tasks.workunit.client.0.smithi148.stdout:5/206: dwrite d1/db/d25/f3a [0,4194304] 0 2024-02-28T16:26:31.056 INFO:tasks.workunit.client.0.smithi148.stdout:3/263: read - d1/db/f48 zero size 2024-02-28T16:26:31.056 INFO:tasks.workunit.client.0.smithi148.stdout:1/195: creat d2/d5/d6/d8/f3e x:0 0 0 2024-02-28T16:26:31.056 INFO:tasks.workunit.client.0.smithi148.stdout:8/236: dwrite d1/d3/d18/f2b [0,4194304] 0 2024-02-28T16:26:31.062 INFO:tasks.workunit.client.0.smithi148.stdout:1/196: write d2/d15/f30 [337672,91796] 0 2024-02-28T16:26:31.069 INFO:tasks.workunit.client.0.smithi148.stdout:5/207: creat d1/d8/d20/f3b x:0 0 0 2024-02-28T16:26:31.071 INFO:tasks.workunit.client.0.smithi148.stdout:2/200: creat d0/dd/f40 x:0 0 0 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 -- 172.21.15.148:0/2276134466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fcef0 msgr2=0x7f3d1c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 --2- 172.21.15.148:0/2276134466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fcef0 0x7f3d1c0fd320 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004940 tx=0x7f3d0c009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 -- 172.21.15.148:0/2276134466 shutdown_connections 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 --2- 172.21.15.148:0/2276134466 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d1c0fe0e0 0x7f3d1c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 --2- 172.21.15.148:0/2276134466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fcef0 0x7f3d1c0fd320 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 -- 172.21.15.148:0/2276134466 >> 172.21.15.148:0/2276134466 conn(0x7f3d1c0f8620 msgr2=0x7f3d1c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 -- 172.21.15.148:0/2276134466 shutdown_connections 2024-02-28T16:26:31.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.101+0000 7f3d21c00700 1 -- 172.21.15.148:0/2276134466 wait complete. 2024-02-28T16:26:31.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.102+0000 7f3d21c00700 1 Processor -- start 2024-02-28T16:26:31.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.102+0000 7f3d21c00700 1 -- start start 2024-02-28T16:26:31.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.102+0000 7f3d21c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d1c0fcef0 0x7f3d1c10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:31.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.102+0000 7f3d21c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fe0e0 0x7f3d1c10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:31.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.102+0000 7f3d21c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c10e4b0 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.102+0000 7f3d21c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c10ed50 con 0x7f3d1c0fcef0 2024-02-28T16:26:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.103+0000 7f3d1a000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fe0e0 0x7f3d1c10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.103+0000 7f3d1a000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fe0e0 0x7f3d1c10deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56492/0 (socket says 172.21.15.148:56492) 2024-02-28T16:26:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.103+0000 7f3d1a000700 1 -- 172.21.15.148:0/4054542641 learned_addr learned my addr 172.21.15.148:0/4054542641 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:26:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.103+0000 7f3d1aa00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d1c0fcef0 0x7f3d1c10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.103+0000 7f3d1a000700 1 -- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d1c0fcef0 msgr2=0x7f3d1c10d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.103+0000 7f3d1a000700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d1c0fcef0 0x7f3d1c10d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.103+0000 7f3d1a000700 1 -- 172.21.15.148:0/4054542641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c005040 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.104+0000 7f3d1a000700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fe0e0 0x7f3d1c10deb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c830 tx=0x7f3d08004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:31.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.104+0000 7f3d12a00700 1 -- 172.21.15.148:0/4054542641 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d080106f0 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.104+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c10f030 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.104+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c10f570 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.104+0000 7f3d12a00700 1 -- 172.21.15.148:0/4054542641 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d08010d20 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.104+0000 7f3d12a00700 1 -- 172.21.15.148:0/4054542641 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d08012400 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.106+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc0052e0 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.107+0000 7f3d12a00700 1 -- 172.21.15.148:0/4054542641 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f3d08012560 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.108+0000 7f3d12a00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3d0006b2e0 0x7f3d0006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:31.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.108+0000 7f3d12a00700 1 -- 172.21.15.148:0/4054542641 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3d08089b20 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.109+0000 7f3d1aa00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3d0006b2e0 0x7f3d0006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:31.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.110+0000 7f3d1aa00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3d0006b2e0 0x7f3d0006d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004890 tx=0x7f3d0c009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:31.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.113+0000 7f3d12a00700 1 -- 172.21.15.148:0/4054542641 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3d08057830 con 0x7f3d1c0fe0e0 2024-02-28T16:26:31.183 INFO:tasks.workunit.client.0.smithi148.stdout:8/237: mkdir d1/dd/d13/d24/d3a/d49 0 2024-02-28T16:26:31.187 INFO:tasks.workunit.client.0.smithi148.stdout:3/264: creat d1/db/d35/d52/f54 x:0 0 0 2024-02-28T16:26:31.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/254: truncate d1/d15/d27/f35 3360747 0 2024-02-28T16:26:31.187 INFO:tasks.workunit.client.0.smithi148.stdout:2/201: dread - d0/d1d/f34 zero size 2024-02-28T16:26:31.187 INFO:tasks.workunit.client.0.smithi148.stdout:7/168: symlink d0/d18/d19/d28/d2b/l30 0 2024-02-28T16:26:31.187 INFO:tasks.workunit.client.0.smithi148.stdout:1/197: mkdir d2/d3f 0 2024-02-28T16:26:31.188 INFO:tasks.workunit.client.0.smithi148.stdout:8/238: write d1/dd/d13/d1a/f42 [71010,782] 0 2024-02-28T16:26:31.189 INFO:tasks.workunit.client.0.smithi148.stdout:0/255: fsync d1/f24 0 2024-02-28T16:26:31.193 INFO:tasks.workunit.client.0.smithi148.stdout:7/169: creat d0/d18/d19/d1c/f31 x:0 0 0 2024-02-28T16:26:31.195 INFO:tasks.workunit.client.0.smithi148.stdout:0/256: write d1/d15/d8/f1d [2480269,58757] 0 2024-02-28T16:26:31.197 INFO:tasks.workunit.client.0.smithi148.stdout:3/265: getdents d1/d13/d19 0 2024-02-28T16:26:31.197 INFO:tasks.workunit.client.0.smithi148.stdout:7/170: stat d0/d18/d19/d1c/l2e 0 2024-02-28T16:26:31.202 INFO:tasks.workunit.client.0.smithi148.stdout:3/266: chown d1/c14 26468 1 2024-02-28T16:26:31.210 INFO:tasks.workunit.client.0.smithi148.stdout:8/239: getdents d1/d3/d18 0 2024-02-28T16:26:31.212 INFO:tasks.workunit.client.0.smithi148.stdout:5/208: dwrite d1/f26 [4194304,4194304] 0 2024-02-28T16:26:31.216 INFO:tasks.workunit.client.0.smithi148.stdout:5/209: stat d1/db/d25 0 2024-02-28T16:26:31.218 INFO:tasks.workunit.client.0.smithi148.stdout:8/240: symlink d1/dd/d13/d1a/l4a 0 2024-02-28T16:26:31.219 INFO:tasks.workunit.client.0.smithi148.stdout:2/202: dwrite d0/f27 [0,4194304] 0 2024-02-28T16:26:31.222 INFO:tasks.workunit.client.0.smithi148.stdout:1/198: dwrite d2/d5/d2b/f32 [0,4194304] 0 2024-02-28T16:26:31.222 INFO:tasks.workunit.client.0.smithi148.stdout:5/210: mkdir d1/db/d3c 0 2024-02-28T16:26:31.226 INFO:tasks.workunit.client.0.smithi148.stdout:5/211: readlink d1/d8/d20/l29 0 2024-02-28T16:26:31.229 INFO:tasks.workunit.client.0.smithi148.stdout:7/171: dread d0/f13 [0,4194304] 0 2024-02-28T16:26:31.229 INFO:tasks.workunit.client.0.smithi148.stdout:2/203: read d0/d1c/f1f [2750,84848] 0 2024-02-28T16:26:31.231 INFO:tasks.workunit.client.0.smithi148.stdout:0/257: write d1/d4/f33 [2312630,93097] 0 2024-02-28T16:26:31.236 INFO:tasks.workunit.client.0.smithi148.stdout:4/150: sync 2024-02-28T16:26:31.237 INFO:tasks.workunit.client.0.smithi148.stdout:3/267: dread d1/d13/f17 [4194304,4194304] 0 2024-02-28T16:26:31.238 INFO:tasks.workunit.client.0.smithi148.stdout:0/258: creat d1/d46/d4a/f5b x:0 0 0 2024-02-28T16:26:31.239 INFO:tasks.workunit.client.0.smithi148.stdout:2/204: truncate d0/dd/f40 252779 0 2024-02-28T16:26:31.239 INFO:tasks.workunit.client.0.smithi148.stdout:7/172: write d0/d4/f15 [293601,4756] 0 2024-02-28T16:26:31.245 INFO:tasks.workunit.client.0.smithi148.stdout:4/151: chown d8/f11 106101742 1 2024-02-28T16:26:31.248 INFO:tasks.workunit.client.0.smithi148.stdout:2/205: rmdir d0/d9/d13 39 2024-02-28T16:26:31.250 INFO:tasks.workunit.client.0.smithi148.stdout:0/259: symlink d1/d15/d3e/l5c 0 2024-02-28T16:26:31.253 INFO:tasks.workunit.client.0.smithi148.stdout:4/152: creat d8/df/f34 x:0 0 0 2024-02-28T16:26:31.253 INFO:tasks.workunit.client.0.smithi148.stdout:3/268: mknod d1/d13/d19/d32/c55 0 2024-02-28T16:26:31.253 INFO:tasks.workunit.client.0.smithi148.stdout:7/173: mkdir d0/d18/d19/d1c/d32 0 2024-02-28T16:26:31.257 INFO:tasks.workunit.client.0.smithi148.stdout:8/241: dwrite d1/dd/d13/d1a/f44 [0,4194304] 0 2024-02-28T16:26:31.257 INFO:tasks.workunit.client.0.smithi148.stdout:0/260: rmdir d1/d15/d3e 39 2024-02-28T16:26:31.257 INFO:tasks.workunit.client.0.smithi148.stdout:2/206: dread - d0/d9/d13/d38/f3e zero size 2024-02-28T16:26:31.258 INFO:tasks.workunit.client.0.smithi148.stdout:1/199: dread d2/d5/d6/f16 [0,4194304] 0 2024-02-28T16:26:31.258 INFO:tasks.workunit.client.0.smithi148.stdout:3/269: stat d1/d13/d19/f33 0 2024-02-28T16:26:31.258 INFO:tasks.workunit.client.0.smithi148.stdout:4/153: mkdir d8/d35 0 2024-02-28T16:26:31.262 INFO:tasks.workunit.client.0.smithi148.stdout:4/154: fdatasync d8/d21/f30 0 2024-02-28T16:26:31.262 INFO:tasks.workunit.client.0.smithi148.stdout:7/174: dread d0/d9/fe [0,4194304] 0 2024-02-28T16:26:31.265 INFO:tasks.workunit.client.0.smithi148.stdout:3/270: chown d1/l4 352426 1 2024-02-28T16:26:31.266 INFO:tasks.workunit.client.0.smithi148.stdout:2/207: read d0/d9/d13/f16 [262889,68632] 0 2024-02-28T16:26:31.267 INFO:tasks.workunit.client.0.smithi148.stdout:8/242: write d1/d3/d35/f30 [2723975,71215] 0 2024-02-28T16:26:31.271 INFO:tasks.workunit.client.0.smithi148.stdout:3/271: write d1/d13/f15 [3061650,114179] 0 2024-02-28T16:26:31.271 INFO:tasks.workunit.client.0.smithi148.stdout:4/155: creat d8/df/f36 x:0 0 0 2024-02-28T16:26:31.271 INFO:tasks.workunit.client.0.smithi148.stdout:8/243: stat d1/dd/d13/d1a/f3f 0 2024-02-28T16:26:31.274 INFO:tasks.workunit.client.0.smithi148.stdout:5/212: fsync d1/f26 0 2024-02-28T16:26:31.275 INFO:tasks.workunit.client.0.smithi148.stdout:2/208: fdatasync d0/d9/d13/f16 0 2024-02-28T16:26:31.279 INFO:tasks.workunit.client.0.smithi148.stdout:0/261: read d1/d4/f3c [4003414,94558] 0 2024-02-28T16:26:31.281 INFO:tasks.workunit.client.0.smithi148.stdout:1/200: rename d2/d5/d6 to d2/d5/d40 0 2024-02-28T16:26:31.283 INFO:tasks.workunit.client.0.smithi148.stdout:8/244: creat d1/dd/d13/d1a/f4b x:0 0 0 2024-02-28T16:26:31.284 INFO:tasks.workunit.client.0.smithi148.stdout:3/272: write d1/f3c [9843690,38784] 0 2024-02-28T16:26:31.286 INFO:tasks.workunit.client.0.smithi148.stdout:7/175: truncate d0/f2 1198869 0 2024-02-28T16:26:31.287 INFO:tasks.workunit.client.0.smithi148.stdout:0/262: unlink d1/d46/c47 0 2024-02-28T16:26:31.289 INFO:tasks.workunit.client.0.smithi148.stdout:8/245: read d1/d3/d18/f2b [1964524,93164] 0 2024-02-28T16:26:31.290 INFO:tasks.workunit.client.0.smithi148.stdout:7/176: fdatasync d0/f1d 0 2024-02-28T16:26:31.297 INFO:tasks.workunit.client.0.smithi148.stdout:3/273: mkdir d1/d13/d19/d56 0 2024-02-28T16:26:31.298 INFO:tasks.workunit.client.0.smithi148.stdout:3/274: readlink d1/l4 0 2024-02-28T16:26:31.302 INFO:tasks.workunit.client.0.smithi148.stdout:3/275: chown d1/d13/d19/d1b/f44 3939 1 2024-02-28T16:26:31.310 INFO:tasks.workunit.client.0.smithi148.stdout:1/201: dwrite d2/d5/d2b/f32 [0,4194304] 0 2024-02-28T16:26:31.310 INFO:tasks.workunit.client.0.smithi148.stdout:2/209: link d0/d18/d20/l3f d0/d9/d13/d38/l41 0 2024-02-28T16:26:31.310 INFO:tasks.workunit.client.0.smithi148.stdout:9/195: sync 2024-02-28T16:26:31.312 INFO:tasks.workunit.client.0.smithi148.stdout:5/213: truncate d1/db/d25/f2e 2239292 0 2024-02-28T16:26:31.313 INFO:tasks.workunit.client.0.smithi148.stdout:2/210: chown d0/d1d/l2a 16090 1 2024-02-28T16:26:31.319 INFO:tasks.workunit.client.0.smithi148.stdout:1/202: fdatasync d2/d5/d40/f3d 0 2024-02-28T16:26:31.319 INFO:tasks.workunit.client.0.smithi148.stdout:5/214: dread - d1/d1a/f35 zero size 2024-02-28T16:26:31.319 INFO:tasks.workunit.client.0.smithi148.stdout:9/196: dread d7/d1c/d1f/f27 [0,4194304] 0 2024-02-28T16:26:31.319 INFO:tasks.workunit.client.0.smithi148.stdout:4/156: getdents d8/d21 0 2024-02-28T16:26:31.319 INFO:tasks.workunit.client.0.smithi148.stdout:8/246: dwrite d1/d3/f1e [0,4194304] 0 2024-02-28T16:26:31.324 INFO:tasks.workunit.client.0.smithi148.stdout:3/276: creat d1/db/d35/f57 x:0 0 0 2024-02-28T16:26:31.326 INFO:tasks.workunit.client.0.smithi148.stdout:1/203: write d2/d5/d40/f1b [443189,75445] 0 2024-02-28T16:26:31.327 INFO:tasks.workunit.client.0.smithi148.stdout:4/157: chown d8/l9 0 1 2024-02-28T16:26:31.333 INFO:tasks.workunit.client.0.smithi148.stdout:3/277: rmdir d1/d13/d19/d32/d41 39 2024-02-28T16:26:31.335 INFO:tasks.workunit.client.0.smithi148.stdout:4/158: mkdir d8/d37 0 2024-02-28T16:26:31.341 INFO:tasks.workunit.client.0.smithi148.stdout:4/159: stat d8/df/f1b 0 2024-02-28T16:26:31.341 INFO:tasks.workunit.client.0.smithi148.stdout:0/263: link d1/d15/l3b d1/d15/d3e/l5d 0 2024-02-28T16:26:31.346 INFO:tasks.workunit.client.0.smithi148.stdout:0/264: fsync d1/d46/d4a/f5b 0 2024-02-28T16:26:31.351 INFO:tasks.workunit.client.0.smithi148.stdout:7/177: dwrite d0/d18/d19/f27 [0,4194304] 0 2024-02-28T16:26:31.355 INFO:tasks.workunit.client.0.smithi148.stdout:4/160: creat d8/d35/f38 x:0 0 0 2024-02-28T16:26:31.361 INFO:tasks.workunit.client.0.smithi148.stdout:9/197: dread d7/d1c/d1f/f30 [0,4194304] 0 2024-02-28T16:26:31.366 INFO:tasks.workunit.client.0.smithi148.stdout:8/247: dread d1/d3/d18/f2b [0,4194304] 0 2024-02-28T16:26:31.366 INFO:tasks.workunit.client.0.smithi148.stdout:5/215: dwrite d1/d8/d20/f3b [0,4194304] 0 2024-02-28T16:26:31.370 INFO:tasks.workunit.client.0.smithi148.stdout:9/198: write d7/dd/f2e [243510,28814] 0 2024-02-28T16:26:31.370 INFO:tasks.workunit.client.0.smithi148.stdout:1/204: dread d2/d5/d40/f16 [0,4194304] 0 2024-02-28T16:26:31.384 INFO:tasks.workunit.client.0.smithi148.stdout:7/178: truncate d0/d4/f15 1862753 0 2024-02-28T16:26:31.384 INFO:tasks.workunit.client.0.smithi148.stdout:0/265: rename d1/d15/d27/d34/f38 to d1/d15/d3d/f5e 0 2024-02-28T16:26:31.390 INFO:tasks.workunit.client.0.smithi148.stdout:3/278: dwrite d1/d13/f3b [0,4194304] 0 2024-02-28T16:26:31.392 INFO:tasks.workunit.client.0.smithi148.stdout:9/199: rename d7/d1c/d1f/f30 to d7/d1c/d32/d24/f42 0 2024-02-28T16:26:31.401 INFO:tasks.workunit.client.0.smithi148.stdout:0/266: mkdir d1/d46/d5f 0 2024-02-28T16:26:31.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/248: truncate d1/d3/f20 835823 0 2024-02-28T16:26:31.405 INFO:tasks.workunit.client.0.smithi148.stdout:4/161: dwrite d8/df/f34 [0,4194304] 0 2024-02-28T16:26:31.406 INFO:tasks.workunit.client.0.smithi148.stdout:9/200: mkdir d7/d43 0 2024-02-28T16:26:31.410 INFO:tasks.workunit.client.0.smithi148.stdout:8/249: chown d1/f2e 26717 1 2024-02-28T16:26:31.415 INFO:tasks.workunit.client.0.smithi148.stdout:3/279: creat d1/db/f58 x:0 0 0 2024-02-28T16:26:31.419 INFO:tasks.workunit.client.0.smithi148.stdout:0/267: chown d1/d46/c48 1907705 1 2024-02-28T16:26:31.421 INFO:tasks.workunit.client.0.smithi148.stdout:4/162: creat d8/d35/f39 x:0 0 0 2024-02-28T16:26:31.421 INFO:tasks.workunit.client.0.smithi148.stdout:7/179: rmdir d0 39 2024-02-28T16:26:31.425 INFO:tasks.workunit.client.0.smithi148.stdout:5/216: dwrite d1/f26 [4194304,4194304] 0 2024-02-28T16:26:31.426 INFO:tasks.workunit.client.0.smithi148.stdout:1/205: dwrite d2/d5/d1a/f3a [0,4194304] 0 2024-02-28T16:26:31.431 INFO:tasks.workunit.client.0.smithi148.stdout:5/217: truncate d1/d1a/f35 334022 0 2024-02-28T16:26:31.432 INFO:tasks.workunit.client.0.smithi148.stdout:3/280: creat d1/d13/d19/f59 x:0 0 0 2024-02-28T16:26:31.433 INFO:tasks.workunit.client.0.smithi148.stdout:1/206: stat d2/d5/d40/f1b 0 2024-02-28T16:26:31.436 INFO:tasks.workunit.client.0.smithi148.stdout:4/163: creat d8/d35/f3a x:0 0 0 2024-02-28T16:26:31.438 INFO:tasks.workunit.client.0.smithi148.stdout:9/201: dwrite d7/d1c/f20 [0,4194304] 0 2024-02-28T16:26:31.442 INFO:tasks.workunit.client.0.smithi148.stdout:1/207: stat d2/d5/d40/d8/f36 0 2024-02-28T16:26:31.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.456+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cfc000bf0 con 0x7f3d0006b2e0 2024-02-28T16:26:31.447 INFO:tasks.workunit.client.0.smithi148.stdout:8/250: dwrite d1/dd/d13/d1a/f4b [0,4194304] 0 2024-02-28T16:26:31.450 INFO:tasks.workunit.client.0.smithi148.stdout:8/251: dread - d1/d3/f47 zero size 2024-02-28T16:26:31.450 INFO:tasks.workunit.client.0.smithi148.stdout:9/202: chown d7/c11 2384919 1 2024-02-28T16:26:31.454 INFO:tasks.workunit.client.0.smithi148.stdout:5/218: fsync d1/d8/d23/f2d 0 2024-02-28T16:26:31.462 INFO:tasks.workunit.client.0.smithi148.stdout:3/281: rename d1/d13/d19/d32/c55 to d1/c5a 0 2024-02-28T16:26:31.464 INFO:tasks.workunit.client.0.smithi148.stdout:0/268: dwrite d1/f22 [0,4194304] 0 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.476+0000 7f3d12a00700 1 -- 172.21.15.148:0/4054542641 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f3cfc000bf0 con 0x7f3d0006b2e0 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 starting - - - - 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (12m) 59s ago 12m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (10m) 63s ago 10m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 starting - - - - 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (4m) 59s ago 4m 11.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:26:31.466 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (3m) 59s ago 3m 109M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (3m) 63s ago 3m 11.8M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (3m) 63s ago 3m 11.9M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:9283 running (13m) 59s ago 13m 319M - 17.2.7-535-gc0f02e60 1c37ed371348 0efadaac859c 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (90s) 63s ago 10m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1ed96a6b633e 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (13m) 59s ago 14m 46.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (9m) 63s ago 9m 37.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 starting - - - - 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (10m) 63s ago 10m 7944k - 1.5.0 0da6a335fe13 e10955ca2cb2 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (8m) 59s ago 8m 76.1M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (8m) 59s ago 8m 67.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (7m) 59s ago 7m 65.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (7m) 63s ago 7m 71.0M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (6m) 63s ago 6m 71.1M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (5m) 63s ago 5m 62.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:26:31.467 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (9m) 59s ago 11m 50.7M - 2.43.0 a07b618ecd1d 92209c2989e2 2024-02-28T16:26:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3d0006b2e0 msgr2=0x7f3d0006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3d0006b2e0 0x7f3d0006d790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004890 tx=0x7f3d0c009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fe0e0 msgr2=0x7f3d1c10deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:31.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fe0e0 0x7f3d1c10deb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c830 tx=0x7f3d08004470 comp rx=0 tx=0).stop 2024-02-28T16:26:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 shutdown_connections 2024-02-28T16:26:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3d0006b2e0 0x7f3d0006d790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3d1c0fcef0 0x7f3d1c10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 --2- 172.21.15.148:0/4054542641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d1c0fe0e0 0x7f3d1c10deb0 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c830 tx=0x7f3d08004470 comp rx=0 tx=0).stop 2024-02-28T16:26:31.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.480+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 >> 172.21.15.148:0/4054542641 conn(0x7f3d1c0f8620 msgr2=0x7f3d1c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:31.470 INFO:tasks.workunit.client.0.smithi148.stdout:7/180: dwrite d0/f11 [0,4194304] 0 2024-02-28T16:26:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.482+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 shutdown_connections 2024-02-28T16:26:31.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.482+0000 7f3d21c00700 1 -- 172.21.15.148:0/4054542641 wait complete. 2024-02-28T16:26:31.480 INFO:tasks.workunit.client.0.smithi148.stdout:5/219: creat d1/db/d25/f3d x:0 0 0 2024-02-28T16:26:31.486 INFO:tasks.workunit.client.0.smithi148.stdout:0/269: dread d1/f19 [0,4194304] 0 2024-02-28T16:26:31.486 INFO:tasks.workunit.client.0.smithi148.stdout:7/181: chown d0/d4/l17 6475 1 2024-02-28T16:26:31.488 INFO:tasks.workunit.client.0.smithi148.stdout:9/203: symlink d7/d43/l44 0 2024-02-28T16:26:31.495 INFO:tasks.workunit.client.0.smithi148.stdout:0/270: write d1/d4/f3c [3856941,28319] 0 2024-02-28T16:26:31.496 INFO:tasks.workunit.client.0.smithi148.stdout:0/271: chown d1/d4/d25 389 1 2024-02-28T16:26:31.497 INFO:tasks.workunit.client.0.smithi148.stdout:1/208: creat d2/f41 x:0 0 0 2024-02-28T16:26:31.497 INFO:tasks.workunit.client.0.smithi148.stdout:6/225: sync 2024-02-28T16:26:31.499 INFO:tasks.workunit.client.0.smithi148.stdout:5/220: dwrite d1/d1a/f2b [0,4194304] 0 2024-02-28T16:26:31.508 INFO:tasks.workunit.client.0.smithi148.stdout:9/204: chown d7/d1c/l23 14 1 2024-02-28T16:26:31.509 INFO:tasks.workunit.client.0.smithi148.stdout:4/164: getdents d8/df/d1f 0 2024-02-28T16:26:31.512 INFO:tasks.workunit.client.0.smithi148.stdout:0/272: creat d1/d4/f60 x:0 0 0 2024-02-28T16:26:31.515 INFO:tasks.workunit.client.0.smithi148.stdout:8/252: chown d1/d3/f20 2192 1 2024-02-28T16:26:31.517 INFO:tasks.workunit.client.0.smithi148.stdout:1/209: creat d2/d5/d1a/f42 x:0 0 0 2024-02-28T16:26:31.520 INFO:tasks.workunit.client.0.smithi148.stdout:1/210: write d2/d5/d2b/f32 [754700,73731] 0 2024-02-28T16:26:31.521 INFO:tasks.workunit.client.0.smithi148.stdout:7/182: truncate d0/f2 1819039 0 2024-02-28T16:26:31.527 INFO:tasks.workunit.client.0.smithi148.stdout:4/165: creat d8/df/d1f/f3b x:0 0 0 2024-02-28T16:26:31.528 INFO:tasks.workunit.client.0.smithi148.stdout:6/226: chown d0/d10/f13 2 1 2024-02-28T16:26:31.530 INFO:tasks.workunit.client.0.smithi148.stdout:0/273: rmdir d1/d15/d3e 39 2024-02-28T16:26:31.530 INFO:tasks.workunit.client.0.smithi148.stdout:1/211: dread d2/d5/d40/d8/f10 [0,4194304] 0 2024-02-28T16:26:31.534 INFO:tasks.workunit.client.0.smithi148.stdout:5/221: unlink d1/db/d25/f3d 0 2024-02-28T16:26:31.536 INFO:tasks.workunit.client.0.smithi148.stdout:4/166: creat d8/df/d1f/f3c x:0 0 0 2024-02-28T16:26:31.536 INFO:tasks.workunit.client.0.smithi148.stdout:3/282: mkdir d1/d13/d19/d56/d5b 0 2024-02-28T16:26:31.537 INFO:tasks.workunit.client.0.smithi148.stdout:8/253: getdents d1/d3/d18/d48/d22/d34 0 2024-02-28T16:26:31.542 INFO:tasks.workunit.client.0.smithi148.stdout:5/222: symlink d1/db/l3e 0 2024-02-28T16:26:31.543 INFO:tasks.workunit.client.0.smithi148.stdout:6/227: mknod d0/d22/d25/c4d 0 2024-02-28T16:26:31.543 INFO:tasks.workunit.client.0.smithi148.stdout:4/167: chown d8/df/c13 13 1 2024-02-28T16:26:31.543 INFO:tasks.workunit.client.0.smithi148.stdout:0/274: dread d1/d15/d27/d34/f3a [4194304,4194304] 0 2024-02-28T16:26:31.545 INFO:tasks.workunit.client.0.smithi148.stdout:9/205: getdents d7/d1c/d32 0 2024-02-28T16:26:31.546 INFO:tasks.workunit.client.0.smithi148.stdout:1/212: rmdir d2/d5/d3c 0 2024-02-28T16:26:31.549 INFO:tasks.workunit.client.0.smithi148.stdout:7/183: dwrite d0/f11 [0,4194304] 0 2024-02-28T16:26:31.549 INFO:tasks.workunit.client.0.smithi148.stdout:3/283: rename d1/d13/d19/f50 to d1/d13/d19/d1b/f5c 0 2024-02-28T16:26:31.550 INFO:tasks.workunit.client.0.smithi148.stdout:8/254: creat d1/dd/d13/d24/d3a/d49/f4c x:0 0 0 2024-02-28T16:26:31.552 INFO:tasks.workunit.client.0.smithi148.stdout:4/168: mkdir d8/d21/d3d 0 2024-02-28T16:26:31.554 INFO:tasks.workunit.client.0.smithi148.stdout:1/213: fdatasync d2/d15/f35 0 2024-02-28T16:26:31.554 INFO:tasks.workunit.client.0.smithi148.stdout:9/206: creat d7/d1c/f45 x:0 0 0 2024-02-28T16:26:31.555 INFO:tasks.workunit.client.0.smithi148.stdout:5/223: mknod d1/d8/c3f 0 2024-02-28T16:26:31.556 INFO:tasks.workunit.client.0.smithi148.stdout:7/184: readlink d0/d18/d19/d1c/l2c 0 2024-02-28T16:26:31.558 INFO:tasks.workunit.client.0.smithi148.stdout:0/275: fsync d1/d15/d27/f35 0 2024-02-28T16:26:31.559 INFO:tasks.workunit.client.0.smithi148.stdout:5/224: truncate d1/f2f 586691 0 2024-02-28T16:26:31.560 INFO:tasks.workunit.client.0.smithi148.stdout:6/228: link d0/f1d d0/d22/d27/f4e 0 2024-02-28T16:26:31.564 INFO:tasks.workunit.client.0.smithi148.stdout:4/169: rename d8/df/d17/f2f to d8/f3e 0 2024-02-28T16:26:31.564 INFO:tasks.workunit.client.0.smithi148.stdout:7/185: write d0/f11 [2526372,123091] 0 2024-02-28T16:26:31.567 INFO:tasks.workunit.client.0.smithi148.stdout:1/214: creat d2/d5/d1a/f43 x:0 0 0 2024-02-28T16:26:31.572 INFO:tasks.workunit.client.0.smithi148.stdout:5/225: chown d1/db/ce 32329 1 2024-02-28T16:26:31.574 INFO:tasks.workunit.client.0.smithi148.stdout:2/211: sync 2024-02-28T16:26:31.574 INFO:tasks.workunit.client.0.smithi148.stdout:9/207: creat d7/dd/d26/f46 x:0 0 0 2024-02-28T16:26:31.578 INFO:tasks.workunit.client.0.smithi148.stdout:3/284: unlink d1/db/d35/f57 0 2024-02-28T16:26:31.584 INFO:tasks.workunit.client.0.smithi148.stdout:6/229: stat d0/d4/d14 0 2024-02-28T16:26:31.584 INFO:tasks.workunit.client.0.smithi148.stdout:7/186: symlink d0/d18/d19/l33 0 2024-02-28T16:26:31.587 INFO:tasks.workunit.client.0.smithi148.stdout:4/170: chown d8/df/l32 6342 1 2024-02-28T16:26:31.588 INFO:tasks.workunit.client.0.smithi148.stdout:9/208: dread d7/f17 [0,4194304] 0 2024-02-28T16:26:31.588 INFO:tasks.workunit.client.0.smithi148.stdout:8/255: dwrite d1/dd/d13/d1a/f4b [4194304,4194304] 0 2024-02-28T16:26:31.588 INFO:tasks.workunit.client.0.smithi148.stdout:0/276: rename d1/d4/d25/f32 to d1/d4/d25/f61 0 2024-02-28T16:26:31.596 INFO:tasks.workunit.client.0.smithi148.stdout:5/226: creat d1/d8/d20/d31/f40 x:0 0 0 2024-02-28T16:26:31.597 INFO:tasks.workunit.client.0.smithi148.stdout:2/212: symlink d0/dd/d2b/l42 0 2024-02-28T16:26:31.603 INFO:tasks.workunit.client.0.smithi148.stdout:3/285: mknod d1/d13/d19/d1b/d38/c5d 0 2024-02-28T16:26:31.603 INFO:tasks.workunit.client.0.smithi148.stdout:6/230: dwrite d0/d4/d1b/f1f [0,4194304] 0 2024-02-28T16:26:31.604 INFO:tasks.workunit.client.0.smithi148.stdout:3/286: dread - d1/d13/d19/f4a zero size 2024-02-28T16:26:31.607 INFO:tasks.workunit.client.0.smithi148.stdout:7/187: mknod d0/d18/c34 0 2024-02-28T16:26:31.618 INFO:tasks.workunit.client.0.smithi148.stdout:1/215: symlink d2/d15/d33/l44 0 2024-02-28T16:26:31.619 INFO:tasks.workunit.client.0.smithi148.stdout:0/277: creat d1/d46/f62 x:0 0 0 2024-02-28T16:26:31.622 INFO:tasks.workunit.client.0.smithi148.stdout:8/256: mknod d1/dd/d13/d24/d3a/c4d 0 2024-02-28T16:26:31.624 INFO:tasks.workunit.client.0.smithi148.stdout:1/216: chown d2/d5/d40/l17 4830 1 2024-02-28T16:26:31.624 INFO:tasks.workunit.client.0.smithi148.stdout:9/209: unlink d7/c36 0 2024-02-28T16:26:31.629 INFO:tasks.workunit.client.0.smithi148.stdout:8/257: chown d1 6 1 2024-02-28T16:26:31.631 INFO:tasks.workunit.client.0.smithi148.stdout:4/171: rmdir d8/df 39 2024-02-28T16:26:31.633 INFO:tasks.workunit.client.0.smithi148.stdout:3/287: write d1/db/d35/f47 [3652092,86519] 0 2024-02-28T16:26:31.633 INFO:tasks.workunit.client.0.smithi148.stdout:8/258: read - d1/f2e zero size 2024-02-28T16:26:31.633 INFO:tasks.workunit.client.0.smithi148.stdout:2/213: dwrite d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:31.637 INFO:tasks.workunit.client.0.smithi148.stdout:1/217: write d2/d5/d40/d8/f36 [429200,71031] 0 2024-02-28T16:26:31.639 INFO:tasks.workunit.client.0.smithi148.stdout:9/210: mknod d7/d43/c47 0 2024-02-28T16:26:31.642 INFO:tasks.workunit.client.0.smithi148.stdout:8/259: chown d1/dd/d13/d1a/d33 800 1 2024-02-28T16:26:31.644 INFO:tasks.workunit.client.0.smithi148.stdout:6/231: dwrite d0/d4/d14/f28 [0,4194304] 0 2024-02-28T16:26:31.644 INFO:tasks.workunit.client.0.smithi148.stdout:3/288: rmdir d1/d13 39 2024-02-28T16:26:31.646 INFO:tasks.workunit.client.0.smithi148.stdout:6/232: chown d0/d4 81577 1 2024-02-28T16:26:31.646 INFO:tasks.workunit.client.0.smithi148.stdout:7/188: dwrite d0/d18/d19/d1c/f23 [0,4194304] 0 2024-02-28T16:26:31.647 INFO:tasks.workunit.client.0.smithi148.stdout:9/211: write d7/fb [4403493,108826] 0 2024-02-28T16:26:31.653 INFO:tasks.workunit.client.0.smithi148.stdout:4/172: rmdir d8/df/d17 39 2024-02-28T16:26:31.666 INFO:tasks.workunit.client.0.smithi148.stdout:0/278: getdents d1/d15/d3d 0 2024-02-28T16:26:31.667 INFO:tasks.workunit.client.0.smithi148.stdout:7/189: dwrite d0/d18/f2a [0,4194304] 0 2024-02-28T16:26:31.669 INFO:tasks.workunit.client.0.smithi148.stdout:6/233: creat d0/d22/d25/f4f x:0 0 0 2024-02-28T16:26:31.673 INFO:tasks.workunit.client.0.smithi148.stdout:9/212: dread d7/fc [4194304,4194304] 0 2024-02-28T16:26:31.675 INFO:tasks.workunit.client.0.smithi148.stdout:1/218: symlink d2/d5/d40/l45 0 2024-02-28T16:26:31.677 INFO:tasks.workunit.client.0.smithi148.stdout:3/289: dread - d1/d13/d19/f59 zero size 2024-02-28T16:26:31.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.695+0000 7f3b7ea00700 1 -- 172.21.15.148:0/2046983382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 msgr2=0x7f3b78100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:31.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.695+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/2046983382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78100650 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3b64004940 tx=0x7f3b64009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:31.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.695+0000 7f3b7ea00700 1 -- 172.21.15.148:0/2046983382 shutdown_connections 2024-02-28T16:26:31.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.695+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/2046983382 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78100650 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.695+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/2046983382 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b780fb870 0x7f3b780fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.695+0000 7f3b7ea00700 1 -- 172.21.15.148:0/2046983382 >> 172.21.15.148:0/2046983382 conn(0x7f3b780f74e0 msgr2=0x7f3b780f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:31.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.696+0000 7f3b7ea00700 1 -- 172.21.15.148:0/2046983382 shutdown_connections 2024-02-28T16:26:31.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.696+0000 7f3b7ea00700 1 -- 172.21.15.148:0/2046983382 wait complete. 2024-02-28T16:26:31.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.698+0000 7f3b7ea00700 1 Processor -- start 2024-02-28T16:26:31.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.698+0000 7f3b7ea00700 1 -- start start 2024-02-28T16:26:31.688 INFO:tasks.workunit.client.0.smithi148.stdout:7/190: creat d0/d18/d19/d28/f35 x:0 0 0 2024-02-28T16:26:31.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b7ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b780fb870 0x7f3b78113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:31.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b7ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:31.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b7ea00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78114b00 con 0x7f3b780fe1d0 2024-02-28T16:26:31.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b7ea00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78115340 con 0x7f3b780fb870 2024-02-28T16:26:31.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b77e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b780fb870 0x7f3b78113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:31.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b77400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:31.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b77400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78114470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56510/0 (socket says 172.21.15.148:56510) 2024-02-28T16:26:31.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.700+0000 7f3b77400700 1 -- 172.21.15.148:0/3424702829 learned_addr learned my addr 172.21.15.148:0/3424702829 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:26:31.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.701+0000 7f3b77400700 1 -- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b780fb870 msgr2=0x7f3b78113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:31.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.702+0000 7f3b77400700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b780fb870 0x7f3b78113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:31.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.702+0000 7f3b77400700 1 -- 172.21.15.148:0/3424702829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64005040 con 0x7f3b780fe1d0 2024-02-28T16:26:31.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.702+0000 7f3b77e00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b780fb870 0x7f3b78113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:26:31.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.702+0000 7f3b77400700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78114470 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3b640093b0 tx=0x7f3b64009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:31.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.703+0000 7f3b6fe00700 1 -- 172.21.15.148:0/3424702829 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6400e040 con 0x7f3b780fe1d0 2024-02-28T16:26:31.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.703+0000 7f3b6fe00700 1 -- 172.21.15.148:0/3424702829 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b6400bcc0 con 0x7f3b780fe1d0 2024-02-28T16:26:31.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.703+0000 7f3b6fe00700 1 -- 172.21.15.148:0/3424702829 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6401c630 con 0x7f3b780fe1d0 2024-02-28T16:26:31.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.703+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b781155c0 con 0x7f3b780fe1d0 2024-02-28T16:26:31.693 INFO:tasks.workunit.client.0.smithi148.stdout:7/191: write d0/d18/f2a [3497685,77067] 0 2024-02-28T16:26:31.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.703+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b78115b00 con 0x7f3b780fe1d0 2024-02-28T16:26:31.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.706+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7804bed0 con 0x7f3b780fe1d0 2024-02-28T16:26:31.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.707+0000 7f3b6fe00700 1 -- 172.21.15.148:0/3424702829 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f3b64013980 con 0x7f3b780fe1d0 2024-02-28T16:26:31.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.708+0000 7f3b6fe00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3b5c06b2e0 0x7f3b5c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:31.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.709+0000 7f3b6fe00700 1 -- 172.21.15.148:0/3424702829 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3b6408b130 con 0x7f3b780fe1d0 2024-02-28T16:26:31.698 INFO:tasks.workunit.client.0.smithi148.stdout:7/192: fsync d0/d18/d19/d1c/f31 0 2024-02-28T16:26:31.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.709+0000 7f3b77e00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3b5c06b2e0 0x7f3b5c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:31.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.710+0000 7f3b77e00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3b5c06b2e0 0x7f3b5c06d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009fd0 tx=0x7f3b680091a0 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:31.705 INFO:tasks.workunit.client.0.smithi148.stdout:4/173: write d8/f3e [4713620,35072] 0 2024-02-28T16:26:31.706 INFO:tasks.workunit.client.0.smithi148.stdout:4/174: stat d8/df/c13 0 2024-02-28T16:26:31.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:31.717+0000 7f3b6fe00700 1 -- 172.21.15.148:0/3424702829 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3b64058c70 con 0x7f3b780fe1d0 2024-02-28T16:26:31.708 INFO:tasks.workunit.client.0.smithi148.stdout:6/234: mknod d0/d8/d21/c50 0 2024-02-28T16:26:31.709 INFO:tasks.workunit.client.0.smithi148.stdout:3/290: dwrite d1/db/f48 [0,4194304] 0 2024-02-28T16:26:31.711 INFO:tasks.workunit.client.0.smithi148.stdout:6/235: chown d0/d22/d25/c4d 3239 1 2024-02-28T16:26:31.712 INFO:tasks.workunit.client.0.smithi148.stdout:3/291: dread - d1/db/d35/d52/f54 zero size 2024-02-28T16:26:31.713 INFO:tasks.workunit.client.0.smithi148.stdout:3/292: readlink d1/d13/l2e 0 2024-02-28T16:26:31.714 INFO:tasks.workunit.client.0.smithi148.stdout:9/213: creat d7/f48 x:0 0 0 2024-02-28T16:26:31.717 INFO:tasks.workunit.client.0.smithi148.stdout:8/260: truncate d1/d3/d18/d48/d22/f32 821043 0 2024-02-28T16:26:31.722 INFO:tasks.workunit.client.0.smithi148.stdout:0/279: rmdir d1/d15/d27/d54 0 2024-02-28T16:26:31.725 INFO:tasks.workunit.client.0.smithi148.stdout:0/280: write d1/d15/f55 [861143,85269] 0 2024-02-28T16:26:31.732 INFO:tasks.workunit.client.0.smithi148.stdout:6/236: mknod d0/d10/c51 0 2024-02-28T16:26:31.734 INFO:tasks.workunit.client.0.smithi148.stdout:6/237: write d0/d4/d14/f28 [382299,86126] 0 2024-02-28T16:26:31.741 INFO:tasks.workunit.client.0.smithi148.stdout:8/261: mknod d1/d3/d18/d48/d22/c4e 0 2024-02-28T16:26:31.745 INFO:tasks.workunit.client.0.smithi148.stdout:0/281: rename d1/d15/l21 to d1/d46/d5f/l63 0 2024-02-28T16:26:31.748 INFO:tasks.workunit.client.0.smithi148.stdout:1/219: getdents d2 0 2024-02-28T16:26:31.750 INFO:tasks.workunit.client.0.smithi148.stdout:1/220: fdatasync d2/d5/d40/f1b 0 2024-02-28T16:26:31.752 INFO:tasks.workunit.client.0.smithi148.stdout:1/221: dread - d2/d5/d40/f3d zero size 2024-02-28T16:26:31.754 INFO:tasks.workunit.client.0.smithi148.stdout:1/222: dread d2/f26 [0,4194304] 0 2024-02-28T16:26:31.755 INFO:tasks.workunit.client.0.smithi148.stdout:7/193: creat d0/f36 x:0 0 0 2024-02-28T16:26:31.756 INFO:tasks.workunit.client.0.smithi148.stdout:6/238: dwrite d0/d4/d1b/f47 [0,4194304] 0 2024-02-28T16:26:31.757 INFO:tasks.workunit.client.0.smithi148.stdout:4/175: creat d8/f3f x:0 0 0 2024-02-28T16:26:31.758 INFO:tasks.workunit.client.0.smithi148.stdout:4/176: stat d8 0 2024-02-28T16:26:31.767 INFO:tasks.workunit.client.0.smithi148.stdout:0/282: write d1/f19 [5001113,97084] 0 2024-02-28T16:26:31.769 INFO:tasks.workunit.client.0.smithi148.stdout:9/214: dwrite d7/fc [4194304,4194304] 0 2024-02-28T16:26:31.777 INFO:tasks.workunit.client.0.smithi148.stdout:6/239: unlink d0/d4/d1b/c20 0 2024-02-28T16:26:31.784 INFO:tasks.workunit.client.0.smithi148.stdout:8/262: getdents d1/dd/d13/d1a/d25 0 2024-02-28T16:26:31.785 INFO:tasks.workunit.client.0.smithi148.stdout:0/283: mknod d1/d46/d4a/c64 0 2024-02-28T16:26:31.791 INFO:tasks.workunit.client.0.smithi148.stdout:1/223: mkdir d2/d3f/d46 0 2024-02-28T16:26:31.798 INFO:tasks.workunit.client.0.smithi148.stdout:4/177: mkdir d8/d40 0 2024-02-28T16:26:31.802 INFO:tasks.workunit.client.0.smithi148.stdout:8/263: unlink d1/d3/d18/d48/d22/c4e 0 2024-02-28T16:26:31.807 INFO:tasks.workunit.client.0.smithi148.stdout:6/240: dwrite d0/d22/f38 [4194304,4194304] 0 2024-02-28T16:26:31.808 INFO:tasks.workunit.client.0.smithi148.stdout:7/194: link d0/d18/d19/d1c/l2e d0/d9/d1b/l37 0 2024-02-28T16:26:31.809 INFO:tasks.workunit.client.0.smithi148.stdout:0/284: dwrite d1/d4/f60 [0,4194304] 0 2024-02-28T16:26:31.811 INFO:tasks.workunit.client.0.smithi148.stdout:8/264: mknod d1/dd/c4f 0 2024-02-28T16:26:31.812 INFO:tasks.workunit.client.0.smithi148.stdout:0/285: chown d1/d46/f62 714195 1 2024-02-28T16:26:31.813 INFO:tasks.workunit.client.0.smithi148.stdout:0/286: fdatasync d1/f41 0 2024-02-28T16:26:31.814 INFO:tasks.workunit.client.0.smithi148.stdout:9/215: dwrite d7/dd/f2b [0,4194304] 0 2024-02-28T16:26:31.816 INFO:tasks.workunit.client.0.smithi148.stdout:4/178: creat d8/d40/f41 x:0 0 0 2024-02-28T16:26:31.829 INFO:tasks.workunit.client.0.smithi148.stdout:9/216: mkdir d7/d1c/d1f/d49 0 2024-02-28T16:26:31.830 INFO:tasks.workunit.client.0.smithi148.stdout:9/217: readlink d7/d1c/l41 0 2024-02-28T16:26:31.838 INFO:tasks.workunit.client.0.smithi148.stdout:4/179: unlink d8/d35/f39 0 2024-02-28T16:26:31.844 INFO:tasks.workunit.client.0.smithi148.stdout:0/287: dread d1/d4/f33 [0,4194304] 0 2024-02-28T16:26:31.845 INFO:tasks.workunit.client.0.smithi148.stdout:4/180: creat d8/df/d1f/f42 x:0 0 0 2024-02-28T16:26:31.846 INFO:tasks.workunit.client.0.smithi148.stdout:0/288: fdatasync d1/f22 0 2024-02-28T16:26:31.846 INFO:tasks.workunit.client.0.smithi148.stdout:9/218: getdents d7/d1c/d3d 0 2024-02-28T16:26:31.851 INFO:tasks.workunit.client.0.smithi148.stdout:0/289: creat d1/d15/d3d/f65 x:0 0 0 2024-02-28T16:26:31.852 INFO:tasks.workunit.client.0.smithi148.stdout:4/181: getdents d8/d21/d3d 0 2024-02-28T16:26:31.852 INFO:tasks.workunit.client.0.smithi148.stdout:0/290: readlink d1/d4/lc 0 2024-02-28T16:26:31.855 INFO:tasks.workunit.client.0.smithi148.stdout:0/291: truncate d1/d15/d8/f30 5528439 0 2024-02-28T16:26:31.857 INFO:tasks.workunit.client.0.smithi148.stdout:8/265: fdatasync d1/dd/d13/d1a/f44 0 2024-02-28T16:26:31.858 INFO:tasks.workunit.client.0.smithi148.stdout:4/182: symlink d8/d21/d3d/l43 0 2024-02-28T16:26:31.864 INFO:tasks.workunit.client.0.smithi148.stdout:8/266: rmdir d1/dd/d13/d24 39 2024-02-28T16:26:31.869 INFO:tasks.workunit.client.0.smithi148.stdout:0/292: creat d1/d15/d27/d34/d5a/f66 x:0 0 0 2024-02-28T16:26:31.873 INFO:tasks.workunit.client.0.smithi148.stdout:0/293: write d1/d4/f45 [230306,26941] 0 2024-02-28T16:26:31.873 INFO:tasks.workunit.client.0.smithi148.stdout:8/267: mkdir d1/dd/d13/d1a/d25/d50 0 2024-02-28T16:26:31.879 INFO:tasks.workunit.client.0.smithi148.stdout:9/219: dread d7/fc [0,4194304] 0 2024-02-28T16:26:31.880 INFO:tasks.workunit.client.0.smithi148.stdout:0/294: mkdir d1/d15/d3d/d67 0 2024-02-28T16:26:31.883 INFO:tasks.workunit.client.0.smithi148.stdout:4/183: dwrite d8/d21/f24 [0,4194304] 0 2024-02-28T16:26:31.884 INFO:tasks.workunit.client.0.smithi148.stdout:7/195: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:31.885 INFO:tasks.workunit.client.0.smithi148.stdout:9/220: write d7/d1c/d1f/f27 [85851,122636] 0 2024-02-28T16:26:31.889 INFO:tasks.workunit.client.0.smithi148.stdout:8/268: mkdir d1/dd/d51 0 2024-02-28T16:26:31.894 INFO:tasks.workunit.client.0.smithi148.stdout:9/221: dread d7/f17 [0,4194304] 0 2024-02-28T16:26:31.898 INFO:tasks.workunit.client.0.smithi148.stdout:4/184: symlink d8/d37/l44 0 2024-02-28T16:26:31.900 INFO:tasks.workunit.client.0.smithi148.stdout:7/196: symlink d0/l38 0 2024-02-28T16:26:31.902 INFO:tasks.workunit.client.0.smithi148.stdout:9/222: rmdir d7/dd/d35 39 2024-02-28T16:26:31.908 INFO:tasks.workunit.client.0.smithi148.stdout:0/295: link d1/d15/f2a d1/d15/d3e/f68 0 2024-02-28T16:26:31.908 INFO:tasks.workunit.client.0.smithi148.stdout:8/269: write d1/d3/d18/f2b [5032340,126230] 0 2024-02-28T16:26:31.910 INFO:tasks.workunit.client.0.smithi148.stdout:4/185: symlink d8/l45 0 2024-02-28T16:26:31.911 INFO:tasks.workunit.client.0.smithi148.stdout:9/223: creat d7/d1c/d1f/f4a x:0 0 0 2024-02-28T16:26:31.919 INFO:tasks.workunit.client.0.smithi148.stdout:0/296: symlink d1/d46/d4a/l69 0 2024-02-28T16:26:31.919 INFO:tasks.workunit.client.0.smithi148.stdout:4/186: mknod d8/d35/c46 0 2024-02-28T16:26:31.919 INFO:tasks.workunit.client.0.smithi148.stdout:9/224: stat d7/dd/d35/l40 0 2024-02-28T16:26:31.919 INFO:tasks.workunit.client.0.smithi148.stdout:8/270: symlink d1/dd/l52 0 2024-02-28T16:26:31.919 INFO:tasks.workunit.client.0.smithi148.stdout:4/187: dread - d8/d35/f38 zero size 2024-02-28T16:26:31.921 INFO:tasks.workunit.client.0.smithi148.stdout:4/188: write d8/df/d1f/f42 [730263,15037] 0 2024-02-28T16:26:31.922 INFO:tasks.workunit.client.0.smithi148.stdout:0/297: creat d1/d4/d25/f6a x:0 0 0 2024-02-28T16:26:31.924 INFO:tasks.workunit.client.0.smithi148.stdout:0/298: chown d1/f22 81 1 2024-02-28T16:26:31.931 INFO:tasks.workunit.client.0.smithi148.stdout:0/299: rmdir d1/d15/d8 39 2024-02-28T16:26:31.934 INFO:tasks.workunit.client.0.smithi148.stdout:8/271: link d1/d3/d35/f36 d1/d3/f53 0 2024-02-28T16:26:31.936 INFO:tasks.workunit.client.0.smithi148.stdout:8/272: chown d1/f2e 971075 1 2024-02-28T16:26:31.936 INFO:tasks.workunit.client.0.smithi148.stdout:4/189: link d8/f15 d8/f47 0 2024-02-28T16:26:31.938 INFO:tasks.workunit.client.0.smithi148.stdout:9/225: getdents d7/d1c/d1f 0 2024-02-28T16:26:31.938 INFO:tasks.workunit.client.0.smithi148.stdout:4/190: fsync d8/d21/f24 0 2024-02-28T16:26:31.941 INFO:tasks.workunit.client.0.smithi148.stdout:8/273: mkdir d1/dd/d54 0 2024-02-28T16:26:31.945 INFO:tasks.workunit.client.0.smithi148.stdout:7/197: dwrite d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:31.946 INFO:tasks.workunit.client.0.smithi148.stdout:4/191: unlink d8/l1e 0 2024-02-28T16:26:31.948 INFO:tasks.workunit.client.0.smithi148.stdout:4/192: fdatasync d8/df/d1f/f3c 0 2024-02-28T16:26:31.949 INFO:tasks.workunit.client.0.smithi148.stdout:8/274: read - d1/d3/d35/f46 zero size 2024-02-28T16:26:31.952 INFO:tasks.workunit.client.0.smithi148.stdout:4/193: rmdir d8/d40 39 2024-02-28T16:26:31.956 INFO:tasks.workunit.client.0.smithi148.stdout:7/198: mkdir d0/d9/d25/d39 0 2024-02-28T16:26:31.957 INFO:tasks.workunit.client.0.smithi148.stdout:4/194: rmdir d8/d37 39 2024-02-28T16:26:31.960 INFO:tasks.workunit.client.0.smithi148.stdout:7/199: readlink d0/d18/d19/d28/d2b/l30 0 2024-02-28T16:26:31.962 INFO:tasks.workunit.client.0.smithi148.stdout:4/195: chown d8/d37 1 1 2024-02-28T16:26:31.963 INFO:tasks.workunit.client.0.smithi148.stdout:8/275: dread d1/f1c [0,4194304] 0 2024-02-28T16:26:31.964 INFO:tasks.workunit.client.0.smithi148.stdout:9/226: dwrite d7/d1c/d1f/f27 [0,4194304] 0 2024-02-28T16:26:31.964 INFO:tasks.workunit.client.0.smithi148.stdout:7/200: fdatasync d0/d4/f26 0 2024-02-28T16:26:31.967 INFO:tasks.workunit.client.0.smithi148.stdout:0/300: dwrite d1/d4/d25/f50 [4194304,4194304] 0 2024-02-28T16:26:31.967 INFO:tasks.workunit.client.0.smithi148.stdout:4/196: chown d8/d35/f3a 6400 1 2024-02-28T16:26:31.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/201: readlink d0/d4/l8 0 2024-02-28T16:26:31.973 INFO:tasks.workunit.client.0.smithi148.stdout:0/301: fdatasync d1/d15/f44 0 2024-02-28T16:26:31.974 INFO:tasks.workunit.client.0.smithi148.stdout:8/276: chown d1/dd/d13/d24/d3a 13 1 2024-02-28T16:26:31.975 INFO:tasks.workunit.client.0.smithi148.stdout:9/227: rename d7/d43/c47 to d7/dd/d26/c4b 0 2024-02-28T16:26:31.977 INFO:tasks.workunit.client.0.smithi148.stdout:7/202: mkdir d0/d18/d19/d28/d2b/d3a 0 2024-02-28T16:26:31.980 INFO:tasks.workunit.client.0.smithi148.stdout:0/302: rmdir d1/d15/d3d 39 2024-02-28T16:26:31.983 INFO:tasks.workunit.client.0.smithi148.stdout:4/197: rename d8/f47 to d8/d37/f48 0 2024-02-28T16:26:31.986 INFO:tasks.workunit.client.0.smithi148.stdout:9/228: read d7/d1c/f34 [7949371,38672] 0 2024-02-28T16:26:31.987 INFO:tasks.workunit.client.0.smithi148.stdout:0/303: creat d1/d46/f6b x:0 0 0 2024-02-28T16:26:31.990 INFO:tasks.workunit.client.0.smithi148.stdout:9/229: dread - d7/d1c/d1f/f4a zero size 2024-02-28T16:26:31.990 INFO:tasks.workunit.client.0.smithi148.stdout:0/304: write d1/d4/d25/f61 [5655430,34584] 0 2024-02-28T16:26:31.992 INFO:tasks.workunit.client.0.smithi148.stdout:7/203: creat d0/d18/d19/d1c/d32/f3b x:0 0 0 2024-02-28T16:26:31.996 INFO:tasks.workunit.client.0.smithi148.stdout:7/204: rename d0/d18/d19/d28 to d0/d18/d19/d28/d2b/d3c 22 2024-02-28T16:26:31.997 INFO:tasks.workunit.client.0.smithi148.stdout:0/305: mkdir d1/d15/d27/d34/d5a/d6c 0 2024-02-28T16:26:31.998 INFO:tasks.workunit.client.0.smithi148.stdout:9/230: dread d7/dd/f2e [0,4194304] 0 2024-02-28T16:26:32.000 INFO:tasks.workunit.client.0.smithi148.stdout:8/277: write d1/d3/f20 [1546491,26757] 0 2024-02-28T16:26:32.001 INFO:tasks.workunit.client.0.smithi148.stdout:9/231: write d7/fb [1840029,116060] 0 2024-02-28T16:26:32.001 INFO:tasks.workunit.client.0.smithi148.stdout:9/232: chown d7/dd/d26 3 1 2024-02-28T16:26:32.003 INFO:tasks.workunit.client.0.smithi148.stdout:9/233: chown d7/dd/f2e 12 1 2024-02-28T16:26:32.006 INFO:tasks.workunit.client.0.smithi148.stdout:4/198: truncate d8/f1c 3779893 0 2024-02-28T16:26:32.008 INFO:tasks.workunit.client.0.smithi148.stdout:7/205: creat d0/d18/d19/d1c/d32/f3d x:0 0 0 2024-02-28T16:26:32.010 INFO:tasks.workunit.client.0.smithi148.stdout:8/278: mkdir d1/d3/d18/d48/d22/d55 0 2024-02-28T16:26:32.014 INFO:tasks.workunit.client.0.smithi148.stdout:4/199: rename f7 to d8/d35/f49 0 2024-02-28T16:26:32.015 INFO:tasks.workunit.client.0.smithi148.stdout:9/234: creat d7/d1c/d1f/d49/f4c x:0 0 0 2024-02-28T16:26:32.015 INFO:tasks.workunit.client.0.smithi148.stdout:8/279: symlink d1/dd/d13/d24/d3a/l56 0 2024-02-28T16:26:32.017 INFO:tasks.workunit.client.0.smithi148.stdout:0/306: dwrite d1/f19 [0,4194304] 0 2024-02-28T16:26:32.021 INFO:tasks.workunit.client.0.smithi148.stdout:9/235: creat d7/dd/d26/f4d x:0 0 0 2024-02-28T16:26:32.021 INFO:tasks.workunit.client.0.smithi148.stdout:4/200: creat d8/df/f4a x:0 0 0 2024-02-28T16:26:32.029 INFO:tasks.workunit.client.0.smithi148.stdout:4/201: creat d8/df/d1f/f4b x:0 0 0 2024-02-28T16:26:32.033 INFO:tasks.workunit.client.0.smithi148.stdout:4/202: creat d8/d21/d3d/f4c x:0 0 0 2024-02-28T16:26:32.033 INFO:tasks.workunit.client.0.smithi148.stdout:7/206: dwrite d0/d18/d19/d1c/d32/f3b [0,4194304] 0 2024-02-28T16:26:32.035 INFO:tasks.workunit.client.0.smithi148.stdout:7/207: chown d0/d18 170620 1 2024-02-28T16:26:32.046 INFO:tasks.workunit.client.0.smithi148.stdout:7/208: truncate d0/d9/fe 661536 0 2024-02-28T16:26:32.048 INFO:tasks.workunit.client.0.smithi148.stdout:9/236: dwrite d7/d1c/d1f/f4a [0,4194304] 0 2024-02-28T16:26:32.050 INFO:tasks.workunit.client.0.smithi148.stdout:7/209: write d0/d18/d19/d1c/d32/f3b [1349709,111521] 0 2024-02-28T16:26:32.054 INFO:tasks.workunit.client.0.smithi148.stdout:9/237: mknod d7/d1c/d32/d24/c4e 0 2024-02-28T16:26:32.054 INFO:tasks.workunit.client.0.smithi148.stdout:8/280: write d1/dd/f10 [987459,26875] 0 2024-02-28T16:26:32.058 INFO:tasks.workunit.client.0.smithi148.stdout:9/238: symlink d7/dd/d26/l4f 0 2024-02-28T16:26:32.061 INFO:tasks.workunit.client.0.smithi148.stdout:7/210: mknod d0/d9/d1b/c3e 0 2024-02-28T16:26:32.064 INFO:tasks.workunit.client.0.smithi148.stdout:9/239: rename d7/dd/d26/f46 to d7/dd/d35/f50 0 2024-02-28T16:26:32.066 INFO:tasks.workunit.client.0.smithi148.stdout:7/211: mknod d0/d9/d25/d39/c3f 0 2024-02-28T16:26:32.066 INFO:tasks.workunit.client.0.smithi148.stdout:9/240: write d7/d1c/d32/d24/f38 [23932,124608] 0 2024-02-28T16:26:32.068 INFO:tasks.workunit.client.0.smithi148.stdout:8/281: dread d1/d3/d18/d48/d22/f32 [0,4194304] 0 2024-02-28T16:26:32.073 INFO:tasks.workunit.client.0.smithi148.stdout:8/282: rename d1/d3/d35/f46 to d1/dd/d13/d24/d3a/d49/f57 0 2024-02-28T16:26:32.076 INFO:tasks.workunit.client.0.smithi148.stdout:8/283: chown d1/dd/d13/d23 0 1 2024-02-28T16:26:32.079 INFO:tasks.workunit.client.0.smithi148.stdout:8/284: write d1/d3/f1e [5130165,44055] 0 2024-02-28T16:26:32.081 INFO:tasks.workunit.client.0.smithi148.stdout:8/285: read d1/f27 [169434,56518] 0 2024-02-28T16:26:32.084 INFO:tasks.workunit.client.0.smithi148.stdout:8/286: write d1/d3/f4 [1568242,49452] 0 2024-02-28T16:26:32.085 INFO:tasks.workunit.client.0.smithi148.stdout:9/241: dwrite d7/d1c/d1f/d49/f4c [0,4194304] 0 2024-02-28T16:26:32.088 INFO:tasks.workunit.client.0.smithi148.stdout:7/212: dwrite d0/f2 [0,4194304] 0 2024-02-28T16:26:32.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/242: rename d7/ca to d7/d1c/d1f/d49/c51 0 2024-02-28T16:26:32.101 INFO:tasks.workunit.client.0.smithi148.stdout:8/287: dwrite d1/d3/f4 [0,4194304] 0 2024-02-28T16:26:32.103 INFO:tasks.workunit.client.0.smithi148.stdout:9/243: dread d7/d1c/d1f/f4a [0,4194304] 0 2024-02-28T16:26:32.106 INFO:tasks.workunit.client.0.smithi148.stdout:8/288: unlink d1/d3/fa 0 2024-02-28T16:26:32.106 INFO:tasks.workunit.client.0.smithi148.stdout:8/289: stat d1/c1f 0 2024-02-28T16:26:32.107 INFO:tasks.workunit.client.0.smithi148.stdout:9/244: creat d7/d1c/f52 x:0 0 0 2024-02-28T16:26:32.108 INFO:tasks.workunit.client.0.smithi148.stdout:8/290: chown d1/d3/d18/d48/d22/d55 15377373 1 2024-02-28T16:26:32.109 INFO:tasks.workunit.client.0.smithi148.stdout:9/245: creat d7/dd/d35/f53 x:0 0 0 2024-02-28T16:26:32.113 INFO:tasks.workunit.client.0.smithi148.stdout:9/246: getdents d7/d1c/d1f 0 2024-02-28T16:26:32.122 INFO:tasks.workunit.client.0.smithi148.stdout:9/247: write d7/d1c/d1f/f33 [430097,70935] 0 2024-02-28T16:26:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:31 smithi148 ceph-mon[28767]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:31 smithi148 ceph-mon[28767]: pgmap v40: 65 pgs: 65 active+clean; 353 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 513 KiB/s rd, 22 MiB/s wr, 110 op/s 2024-02-28T16:26:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:31 smithi148 ceph-mon[28767]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:31 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:32.127 INFO:tasks.workunit.client.0.smithi148.stdout:9/248: getdents d7/d43 0 2024-02-28T16:26:32.127 INFO:tasks.workunit.client.0.smithi148.stdout:8/291: dwrite d1/f27 [0,4194304] 0 2024-02-28T16:26:32.129 INFO:tasks.workunit.client.0.smithi148.stdout:9/249: chown d7/d1c/f20 0 1 2024-02-28T16:26:32.133 INFO:tasks.workunit.client.0.smithi148.stdout:8/292: symlink d1/d3/d18/d48/d22/d34/l58 0 2024-02-28T16:26:32.138 INFO:tasks.workunit.client.0.smithi148.stdout:9/250: link d7/d1c/d1f/f33 d7/d1c/d32/f54 0 2024-02-28T16:26:32.139 INFO:tasks.workunit.client.0.smithi148.stdout:9/251: symlink d7/d1c/d1f/l55 0 2024-02-28T16:26:32.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/252: creat d7/d1c/d3d/f56 x:0 0 0 2024-02-28T16:26:32.145 INFO:tasks.workunit.client.0.smithi148.stdout:9/253: symlink d7/d1c/l57 0 2024-02-28T16:26:32.147 INFO:tasks.workunit.client.0.smithi148.stdout:9/254: mkdir d7/d43/d58 0 2024-02-28T16:26:32.152 INFO:tasks.workunit.client.0.smithi148.stdout:8/293: dwrite d1/d3/d35/f36 [0,4194304] 0 2024-02-28T16:26:32.164 INFO:tasks.workunit.client.0.smithi148.stdout:9/255: dwrite d7/dd/f2e [0,4194304] 0 2024-02-28T16:26:32.166 INFO:tasks.workunit.client.0.smithi148.stdout:9/256: read - d7/dd/d35/f50 zero size 2024-02-28T16:26:32.169 INFO:tasks.workunit.client.0.smithi148.stdout:8/294: dwrite d1/dd/f10 [0,4194304] 0 2024-02-28T16:26:32.172 INFO:tasks.workunit.client.0.smithi148.stdout:9/257: write d7/dd/d35/f50 [10136,95866] 0 2024-02-28T16:26:32.172 INFO:tasks.workunit.client.0.smithi148.stdout:8/295: chown d1/dd/d54 31430090 1 2024-02-28T16:26:32.180 INFO:tasks.workunit.client.0.smithi148.stdout:8/296: link d1/d3/d18/f2b d1/dd/d13/d24/d3a/f59 0 2024-02-28T16:26:32.187 INFO:tasks.workunit.client.0.smithi148.stdout:8/297: write d1/dd/d13/d1a/f3f [3462609,6372] 0 2024-02-28T16:26:32.190 INFO:tasks.workunit.client.0.smithi148.stdout:8/298: mkdir d1/d3/d18/d5a 0 2024-02-28T16:26:32.200 INFO:tasks.workunit.client.0.smithi148.stdout:8/299: getdents d1/d3/d18 0 2024-02-28T16:26:32.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.220+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3b78115f60 con 0x7f3b780fe1d0 2024-02-28T16:26:32.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.222+0000 7f3b6fe00700 1 -- 172.21.15.148:0/3424702829 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f3b64058800 con 0x7f3b780fe1d0 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:26:32.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 13, 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:26:32.213 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:26:32.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.225+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3b5c06b2e0 msgr2=0x7f3b5c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:32.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.225+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3b5c06b2e0 0x7f3b5c06d790 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009fd0 tx=0x7f3b680091a0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.225+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 msgr2=0x7f3b78114470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:32.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.225+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78114470 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3b640093b0 tx=0x7f3b64009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:32.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.226+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 shutdown_connections 2024-02-28T16:26:32.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.226+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f3b5c06b2e0 0x7f3b5c06d790 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.226+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b780fb870 0x7f3b78113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.226+0000 7f3b7ea00700 1 --2- 172.21.15.148:0/3424702829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b780fe1d0 0x7f3b78114470 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.226+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 >> 172.21.15.148:0/3424702829 conn(0x7f3b780f74e0 msgr2=0x7f3b780f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:32.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.228+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 shutdown_connections 2024-02-28T16:26:32.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.228+0000 7f3b7ea00700 1 -- 172.21.15.148:0/3424702829 wait complete. 2024-02-28T16:26:32.220 INFO:tasks.workunit.client.0.smithi148.stdout:8/300: dread d1/dd/d13/d1a/f44 [0,4194304] 0 2024-02-28T16:26:32.224 INFO:tasks.workunit.client.0.smithi148.stdout:8/301: symlink d1/d3/d18/d48/d22/d55/l5b 0 2024-02-28T16:26:32.226 INFO:tasks.workunit.client.0.smithi148.stdout:8/302: stat d1/dd/d13/d24/c29 0 2024-02-28T16:26:32.229 INFO:tasks.workunit.client.0.smithi148.stdout:8/303: write d1/dd/d13/d1a/f44 [5050542,49987] 0 2024-02-28T16:26:32.230 INFO:tasks.workunit.client.0.smithi148.stdout:8/304: write d1/f2e [585522,101199] 0 2024-02-28T16:26:32.232 INFO:tasks.workunit.client.0.smithi148.stdout:8/305: write d1/d3/f1e [5809665,89893] 0 2024-02-28T16:26:32.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:31 smithi157 ceph-mon[38346]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:32.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:31 smithi157 ceph-mon[38346]: pgmap v40: 65 pgs: 65 active+clean; 353 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 513 KiB/s rd, 22 MiB/s wr, 110 op/s 2024-02-28T16:26:32.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:31 smithi157 ceph-mon[38346]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:32.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:31 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:32.359 INFO:tasks.workunit.client.0.smithi148.stdout:5/227: sync 2024-02-28T16:26:32.364 INFO:tasks.workunit.client.0.smithi148.stdout:5/228: rmdir d1/d8/d20/d31 39 2024-02-28T16:26:32.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 -- 172.21.15.148:0/2123721401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fb870 msgr2=0x7f54980fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:32.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 --2- 172.21.15.148:0/2123721401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fb870 0x7f54980fdc90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5488004940 tx=0x7f5488009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:32.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 -- 172.21.15.148:0/2123721401 shutdown_connections 2024-02-28T16:26:32.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 --2- 172.21.15.148:0/2123721401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54980fe1d0 0x7f5498100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 --2- 172.21.15.148:0/2123721401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fb870 0x7f54980fdc90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 -- 172.21.15.148:0/2123721401 >> 172.21.15.148:0/2123721401 conn(0x7f54980f74e0 msgr2=0x7f54980f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:32.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 -- 172.21.15.148:0/2123721401 shutdown_connections 2024-02-28T16:26:32.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.379+0000 7f549dc00700 1 -- 172.21.15.148:0/2123721401 wait complete. 2024-02-28T16:26:32.369 INFO:tasks.workunit.client.0.smithi148.stdout:5/229: rename d1/d1a/f2a to d1/f41 0 2024-02-28T16:26:32.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.380+0000 7f549dc00700 1 Processor -- start 2024-02-28T16:26:32.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.381+0000 7f549dc00700 1 -- start start 2024-02-28T16:26:32.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.381+0000 7f549dc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54980fb870 0x7f5498113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:32.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.381+0000 7f549dc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fe1d0 0x7f5498114480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:32.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.381+0000 7f549dc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498114b10 con 0x7f54980fe1d0 2024-02-28T16:26:32.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.381+0000 7f549dc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498115350 con 0x7f54980fb870 2024-02-28T16:26:32.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.381+0000 7f5496000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fe1d0 0x7f5498114480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:32.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.382+0000 7f5496000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fe1d0 0x7f5498114480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41554/0 (socket says 172.21.15.148:41554) 2024-02-28T16:26:32.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.382+0000 7f5496000700 1 -- 172.21.15.148:0/2551804127 learned_addr learned my addr 172.21.15.148:0/2551804127 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:26:32.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.382+0000 7f5496a00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54980fb870 0x7f5498113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:32.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.382+0000 7f5496000700 1 -- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54980fb870 msgr2=0x7f5498113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:32.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.382+0000 7f5496000700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54980fb870 0x7f5498113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.382+0000 7f5496000700 1 -- 172.21.15.148:0/2551804127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488005040 con 0x7f54980fe1d0 2024-02-28T16:26:32.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.382+0000 7f5496000700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fe1d0 0x7f5498114480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f548400b790 tx=0x7f5484009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:32.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.383+0000 7f548ea00700 1 -- 172.21.15.148:0/2551804127 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f548400f770 con 0x7f54980fe1d0 2024-02-28T16:26:32.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.383+0000 7f548ea00700 1 -- 172.21.15.148:0/2551804127 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f548400fda0 con 0x7f54980fe1d0 2024-02-28T16:26:32.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.383+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5498115630 con 0x7f54980fe1d0 2024-02-28T16:26:32.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.383+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498115b70 con 0x7f54980fe1d0 2024-02-28T16:26:32.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.383+0000 7f548ea00700 1 -- 172.21.15.148:0/2551804127 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f548400d310 con 0x7f54980fe1d0 2024-02-28T16:26:32.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.384+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54780052e0 con 0x7f54980fe1d0 2024-02-28T16:26:32.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.385+0000 7f548ea00700 1 -- 172.21.15.148:0/2551804127 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 25) v1 ==== 89014+0+0 (secure 0 0 0) 0x7f548400d5b0 con 0x7f54980fe1d0 2024-02-28T16:26:32.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.386+0000 7f548ea00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f547c06b2e0 0x7f547c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:26:32.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.386+0000 7f548ea00700 1 -- 172.21.15.148:0/2551804127 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5484089c90 con 0x7f54980fe1d0 2024-02-28T16:26:32.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.387+0000 7f5496a00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f547c06b2e0 0x7f547c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:26:32.377 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.388+0000 7f5496a00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f547c06b2e0 0x7f547c06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f548800b020 tx=0x7f5488009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:26:32.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.391+0000 7f548ea00700 1 -- 172.21.15.148:0/2551804127 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5484057950 con 0x7f54980fe1d0 2024-02-28T16:26:32.534 INFO:tasks.workunit.client.0.smithi148.stdout:2/214: sync 2024-02-28T16:26:32.535 INFO:tasks.workunit.client.0.smithi148.stdout:2/215: stat d0/d18/f19 0 2024-02-28T16:26:32.538 INFO:tasks.workunit.client.0.smithi148.stdout:2/216: write d0/f10 [1425960,95334] 0 2024-02-28T16:26:32.541 INFO:tasks.workunit.client.0.smithi148.stdout:2/217: chown d0/f27 1 1 2024-02-28T16:26:32.572 INFO:tasks.workunit.client.0.smithi148.stdout:2/218: truncate d0/f10 4007601 0 2024-02-28T16:26:32.578 INFO:tasks.workunit.client.0.smithi148.stdout:2/219: truncate d0/d9/d13/f3c 4566637 0 2024-02-28T16:26:32.583 INFO:tasks.workunit.client.0.smithi148.stdout:2/220: rmdir d0/d18 39 2024-02-28T16:26:32.604 INFO:tasks.workunit.client.0.smithi148.stdout:2/221: dwrite d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:32.615 INFO:tasks.workunit.client.0.smithi148.stdout:2/222: link d0/l4 d0/d9/d13/d38/l43 0 2024-02-28T16:26:32.617 INFO:tasks.workunit.client.0.smithi148.stdout:2/223: dread - d0/d9/d13/d38/f3e zero size 2024-02-28T16:26:32.632 INFO:tasks.workunit.client.0.smithi148.stdout:2/224: chown d0/d9/d13/d38/l43 929 1 2024-02-28T16:26:32.636 INFO:tasks.workunit.client.0.smithi148.stdout:2/225: read d0/f24 [2016268,10973] 0 2024-02-28T16:26:32.640 INFO:tasks.workunit.client.0.smithi148.stdout:2/226: write d0/d9/f21 [4091513,124862] 0 2024-02-28T16:26:32.645 INFO:tasks.workunit.client.0.smithi148.stdout:2/227: mknod d0/d18/c44 0 2024-02-28T16:26:32.645 INFO:tasks.workunit.client.0.smithi148.stdout:2/228: chown d0/dd 69 1 2024-02-28T16:26:32.656 INFO:tasks.workunit.client.0.smithi148.stdout:3/293: sync 2024-02-28T16:26:32.664 INFO:tasks.workunit.client.0.smithi148.stdout:2/229: dwrite d0/dd/d2b/f31 [0,4194304] 0 2024-02-28T16:26:32.669 INFO:tasks.workunit.client.0.smithi148.stdout:3/294: creat d1/d13/d19/d56/f5e x:0 0 0 2024-02-28T16:26:32.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/230: readlink d0/d18/d20/l3f 0 2024-02-28T16:26:32.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.684+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5478000bf0 con 0x7f547c06b2e0 2024-02-28T16:26:32.675 INFO:tasks.workunit.client.0.smithi148.stdout:3/295: write d1/f40 [3318964,31085] 0 2024-02-28T16:26:32.677 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:26:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:26:32.677 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:26:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:26:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [], 2024-02-28T16:26:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "1/2 daemons upgraded", 2024-02-28T16:26:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "", 2024-02-28T16:26:32.678 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:26:32.678 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:26:32.678 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.688+0000 7f548ea00700 1 -- 172.21.15.148:0/2551804127 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f5478000bf0 con 0x7f547c06b2e0 2024-02-28T16:26:32.680 INFO:tasks.workunit.client.0.smithi148.stdout:2/231: rename d0/dd/d2b/l35 to d0/d18/l45 0 2024-02-28T16:26:32.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f547c06b2e0 msgr2=0x7f547c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:32.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f547c06b2e0 0x7f547c06d790 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f548800b020 tx=0x7f5488009e30 comp rx=0 tx=0).stop 2024-02-28T16:26:32.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fe1d0 msgr2=0x7f5498114480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:26:32.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fe1d0 0x7f5498114480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f548400b790 tx=0x7f5484009250 comp rx=0 tx=0).stop 2024-02-28T16:26:32.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 shutdown_connections 2024-02-28T16:26:32.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f547c06b2e0 0x7f547c06d790 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f54980fb870 0x7f5498113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 --2- 172.21.15.148:0/2551804127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f54980fe1d0 0x7f5498114480 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:26:32.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.692+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 >> 172.21.15.148:0/2551804127 conn(0x7f54980f74e0 msgr2=0x7f54980f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:26:32.684 INFO:tasks.workunit.client.0.smithi148.stdout:3/296: chown d1/db/f39 95263642 1 2024-02-28T16:26:32.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.693+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 shutdown_connections 2024-02-28T16:26:32.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:26:32.693+0000 7f549dc00700 1 -- 172.21.15.148:0/2551804127 wait complete. 2024-02-28T16:26:32.685 INFO:tasks.workunit.client.0.smithi148.stdout:2/232: mkdir d0/d18/d20/d46 0 2024-02-28T16:26:32.686 INFO:tasks.workunit.client.0.smithi148.stdout:3/297: write d1/db/f58 [639348,63848] 0 2024-02-28T16:26:32.690 INFO:tasks.workunit.client.0.smithi148.stdout:3/298: creat d1/d13/d19/d1b/f5f x:0 0 0 2024-02-28T16:26:32.696 INFO:tasks.workunit.client.0.smithi148.stdout:2/233: creat d0/d9/f47 x:0 0 0 2024-02-28T16:26:32.698 INFO:tasks.workunit.client.0.smithi148.stdout:2/234: read - d0/d1d/f34 zero size 2024-02-28T16:26:32.698 INFO:tasks.workunit.client.0.smithi148.stdout:2/235: fdatasync d0/d9/f47 0 2024-02-28T16:26:32.699 INFO:tasks.workunit.client.0.smithi148.stdout:3/299: rename d1/d13/d19/d32/d41/f53 to d1/d13/d19/d32/d41/f60 0 2024-02-28T16:26:32.702 INFO:tasks.workunit.client.0.smithi148.stdout:3/300: rmdir d1/d13/d19/d32/d41 39 2024-02-28T16:26:32.706 INFO:tasks.workunit.client.0.smithi148.stdout:3/301: truncate d1/d13/d19/d1b/d38/f49 2570185 0 2024-02-28T16:26:32.711 INFO:tasks.workunit.client.0.smithi148.stdout:3/302: mknod d1/db/d45/c61 0 2024-02-28T16:26:32.714 INFO:tasks.workunit.client.0.smithi148.stdout:3/303: creat d1/db/d35/f62 x:0 0 0 2024-02-28T16:26:32.765 INFO:tasks.workunit.client.0.smithi148.stdout:3/304: dwrite d1/d13/d19/f28 [4194304,4194304] 0 2024-02-28T16:26:32.767 INFO:tasks.workunit.client.0.smithi148.stdout:3/305: readlink d1/l12 0 2024-02-28T16:26:32.770 INFO:tasks.workunit.client.0.smithi148.stdout:3/306: truncate d1/d13/d19/d1b/f5f 1004683 0 2024-02-28T16:26:32.772 INFO:tasks.workunit.client.0.smithi148.stdout:3/307: stat d1/ce 0 2024-02-28T16:26:32.777 INFO:tasks.workunit.client.0.smithi148.stdout:3/308: unlink d1/f3c 0 2024-02-28T16:26:32.791 INFO:tasks.workunit.client.0.smithi148.stdout:3/309: dwrite d1/d13/d19/d1b/f2a [0,4194304] 0 2024-02-28T16:26:32.795 INFO:tasks.workunit.client.0.smithi148.stdout:3/310: unlink d1/d13/f23 0 2024-02-28T16:26:32.825 INFO:tasks.workunit.client.0.smithi148.stdout:3/311: dread d1/db/f10 [0,4194304] 0 2024-02-28T16:26:32.826 INFO:tasks.workunit.client.0.smithi148.stdout:3/312: readlink d1/d13/d19/l4c 0 2024-02-28T16:26:32.841 INFO:tasks.workunit.client.0.smithi148.stdout:3/313: dwrite d1/d13/d19/f4a [0,4194304] 0 2024-02-28T16:26:32.842 INFO:tasks.workunit.client.0.smithi148.stdout:3/314: stat d1/db/f10 0 2024-02-28T16:26:32.847 INFO:tasks.workunit.client.0.smithi148.stdout:3/315: unlink d1/d13/d19/d1b/d38/f49 0 2024-02-28T16:26:32.849 INFO:tasks.workunit.client.0.smithi148.stdout:7/213: sync 2024-02-28T16:26:32.849 INFO:tasks.workunit.client.0.smithi148.stdout:9/258: sync 2024-02-28T16:26:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:1/224: sync 2024-02-28T16:26:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:0/307: sync 2024-02-28T16:26:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:8/306: sync 2024-02-28T16:26:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:6/241: sync 2024-02-28T16:26:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:5/230: sync 2024-02-28T16:26:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:4/203: sync 2024-02-28T16:26:32.850 INFO:tasks.workunit.client.0.smithi148.stdout:3/316: chown d1/db/f58 290 1 2024-02-28T16:26:32.854 INFO:tasks.workunit.client.0.smithi148.stdout:6/242: stat d0/d22/c2a 0 2024-02-28T16:26:32.860 INFO:tasks.workunit.client.0.smithi148.stdout:8/307: creat d1/dd/d13/d24/d3a/f5c x:0 0 0 2024-02-28T16:26:32.861 INFO:tasks.workunit.client.0.smithi148.stdout:4/204: fdatasync d8/f15 0 2024-02-28T16:26:32.863 INFO:tasks.workunit.client.0.smithi148.stdout:9/259: read d7/d1c/d32/f54 [670197,17475] 0 2024-02-28T16:26:32.863 INFO:tasks.workunit.client.0.smithi148.stdout:8/308: chown d1/dd/d13/d1a/f44 7371402 1 2024-02-28T16:26:32.864 INFO:tasks.workunit.client.0.smithi148.stdout:3/317: creat d1/d13/d19/d56/f63 x:0 0 0 2024-02-28T16:26:32.866 INFO:tasks.workunit.client.0.smithi148.stdout:6/243: mkdir d0/d22/d27/d3e/d52 0 2024-02-28T16:26:32.868 INFO:tasks.workunit.client.0.smithi148.stdout:0/308: rename d1/d15/d3d/f4c to d1/d15/d27/d34/f6d 0 2024-02-28T16:26:32.870 INFO:tasks.workunit.client.0.smithi148.stdout:3/318: fdatasync d1/d13/d19/d1b/f2a 0 2024-02-28T16:26:32.872 INFO:tasks.workunit.client.0.smithi148.stdout:1/225: link d2/d5/d1a/f42 d2/d5/d40/d7/f47 0 2024-02-28T16:26:32.873 INFO:tasks.workunit.client.0.smithi148.stdout:4/205: mkdir d8/d21/d3d/d4d 0 2024-02-28T16:26:32.876 INFO:tasks.workunit.client.0.smithi148.stdout:4/206: readlink d8/le 0 2024-02-28T16:26:32.876 INFO:tasks.workunit.client.0.smithi148.stdout:3/319: write d1/d13/d19/d1b/f2a [1710964,20643] 0 2024-02-28T16:26:32.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/231: dwrite d1/d1a/f35 [0,4194304] 0 2024-02-28T16:26:32.880 INFO:tasks.workunit.client.0.smithi148.stdout:7/214: dwrite d0/d18/f2a [0,4194304] 0 2024-02-28T16:26:32.880 INFO:tasks.workunit.client.0.smithi148.stdout:4/207: write d8/f3f [518412,13140] 0 2024-02-28T16:26:32.881 INFO:tasks.workunit.client.0.smithi148.stdout:6/244: write d0/f16 [1614259,109798] 0 2024-02-28T16:26:32.882 INFO:tasks.workunit.client.0.smithi148.stdout:2/236: sync 2024-02-28T16:26:32.885 INFO:tasks.workunit.client.0.smithi148.stdout:3/320: fdatasync d1/d13/d19/d1b/f1f 0 2024-02-28T16:26:32.887 INFO:tasks.workunit.client.0.smithi148.stdout:8/309: dread d1/d3/d18/f2b [0,4194304] 0 2024-02-28T16:26:32.891 INFO:tasks.workunit.client.0.smithi148.stdout:7/215: chown d0/d9/fe 1097655945 1 2024-02-28T16:26:32.892 INFO:tasks.workunit.client.0.smithi148.stdout:9/260: rmdir d7/d43/d58 0 2024-02-28T16:26:32.910 INFO:tasks.workunit.client.0.smithi148.stdout:6/245: dwrite d0/d4/fa [0,4194304] 0 2024-02-28T16:26:32.911 INFO:tasks.workunit.client.0.smithi148.stdout:8/310: fdatasync d1/dd/d13/d24/d3a/f41 0 2024-02-28T16:26:32.915 INFO:tasks.workunit.client.0.smithi148.stdout:9/261: dread d7/d1c/d1f/f27 [0,4194304] 0 2024-02-28T16:26:32.915 INFO:tasks.workunit.client.0.smithi148.stdout:7/216: symlink d0/d18/d19/d1c/d32/l40 0 2024-02-28T16:26:32.917 INFO:tasks.workunit.client.0.smithi148.stdout:7/217: chown d0/d18/d19/d1c/c24 224359529 1 2024-02-28T16:26:32.918 INFO:tasks.workunit.client.0.smithi148.stdout:4/208: creat d8/d21/d3d/d4d/f4e x:0 0 0 2024-02-28T16:26:32.922 INFO:tasks.workunit.client.0.smithi148.stdout:8/311: creat d1/d3/d18/f5d x:0 0 0 2024-02-28T16:26:32.923 INFO:tasks.workunit.client.0.smithi148.stdout:1/226: dread d2/d5/d40/d7/f12 [0,4194304] 0 2024-02-28T16:26:32.923 INFO:tasks.workunit.client.0.smithi148.stdout:9/262: rmdir d7/d1c/d32 39 2024-02-28T16:26:32.925 INFO:tasks.workunit.client.0.smithi148.stdout:6/246: mknod d0/d4/d14/c53 0 2024-02-28T16:26:32.925 INFO:tasks.workunit.client.0.smithi148.stdout:2/237: dwrite d0/f24 [0,4194304] 0 2024-02-28T16:26:32.925 INFO:tasks.workunit.client.0.smithi148.stdout:5/232: write d1/db/d25/f1f [3346344,122874] 0 2024-02-28T16:26:32.927 INFO:tasks.workunit.client.0.smithi148.stdout:8/312: dread - d1/d3/f47 zero size 2024-02-28T16:26:32.931 INFO:tasks.workunit.client.0.smithi148.stdout:9/263: read d7/dd/d35/f50 [67081,1110] 0 2024-02-28T16:26:32.932 INFO:tasks.workunit.client.0.smithi148.stdout:7/218: creat d0/d18/d19/f41 x:0 0 0 2024-02-28T16:26:32.933 INFO:tasks.workunit.client.0.smithi148.stdout:6/247: stat d0/d4/c18 0 2024-02-28T16:26:32.935 INFO:tasks.workunit.client.0.smithi148.stdout:1/227: truncate d2/f26 1052436 0 2024-02-28T16:26:32.936 INFO:tasks.workunit.client.0.smithi148.stdout:1/228: readlink d2/lb 0 2024-02-28T16:26:32.938 INFO:tasks.workunit.client.0.smithi148.stdout:7/219: read d0/f13 [3590389,97432] 0 2024-02-28T16:26:32.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/313: creat d1/f5e x:0 0 0 2024-02-28T16:26:32.945 INFO:tasks.workunit.client.0.smithi148.stdout:3/321: dread d1/d13/f21 [0,4194304] 0 2024-02-28T16:26:32.945 INFO:tasks.workunit.client.0.smithi148.stdout:2/238: rename d0/dd/c32 to d0/d18/d20/c48 0 2024-02-28T16:26:32.945 INFO:tasks.workunit.client.0.smithi148.stdout:5/233: creat d1/d1a/f42 x:0 0 0 2024-02-28T16:26:32.949 INFO:tasks.workunit.client.0.smithi148.stdout:1/229: mknod d2/d5/d1a/c48 0 2024-02-28T16:26:32.953 INFO:tasks.workunit.client.0.smithi148.stdout:3/322: chown d1/d13/d19/l4c 502 1 2024-02-28T16:26:32.957 INFO:tasks.workunit.client.0.smithi148.stdout:7/220: rmdir d0/d9/d25 39 2024-02-28T16:26:32.960 INFO:tasks.workunit.client.0.smithi148.stdout:4/209: truncate d8/d21/f24 2695176 0 2024-02-28T16:26:32.962 INFO:tasks.workunit.client.0.smithi148.stdout:5/234: rmdir d1/db/d3c 0 2024-02-28T16:26:32.965 INFO:tasks.workunit.client.0.smithi148.stdout:8/314: rename d1/dd/d13/d24/d3a/f41 to d1/dd/d13/d1a/f5f 0 2024-02-28T16:26:32.968 INFO:tasks.workunit.client.0.smithi148.stdout:4/210: stat d8/df/f20 0 2024-02-28T16:26:32.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/221: creat d0/d9/d25/f42 x:0 0 0 2024-02-28T16:26:32.969 INFO:tasks.workunit.client.0.smithi148.stdout:1/230: write d2/d5/d40/d8/f36 [1099790,81596] 0 2024-02-28T16:26:32.969 INFO:tasks.workunit.client.0.smithi148.stdout:6/248: dwrite d0/f16 [8388608,4194304] 0 2024-02-28T16:26:32.971 INFO:tasks.workunit.client.0.smithi148.stdout:3/323: rename d1/ce to d1/d13/d19/d1b/c64 0 2024-02-28T16:26:32.974 INFO:tasks.workunit.client.0.smithi148.stdout:8/315: write d1/d3/f20 [4465671,63864] 0 2024-02-28T16:26:32.976 INFO:tasks.workunit.client.0.smithi148.stdout:5/235: creat d1/f43 x:0 0 0 2024-02-28T16:26:32.980 INFO:tasks.workunit.client.0.smithi148.stdout:4/211: unlink d8/df/d1f/f3b 0 2024-02-28T16:26:32.982 INFO:tasks.workunit.client.0.smithi148.stdout:7/222: mknod d0/d9/d25/d39/c43 0 2024-02-28T16:26:32.983 INFO:tasks.workunit.client.0.smithi148.stdout:6/249: symlink d0/d22/l54 0 2024-02-28T16:26:32.984 INFO:tasks.workunit.client.0.smithi148.stdout:1/231: rename d2/d15/f2d to d2/d15/d33/f49 0 2024-02-28T16:26:32.988 INFO:tasks.workunit.client.0.smithi148.stdout:2/239: dwrite d0/d9/f21 [0,4194304] 0 2024-02-28T16:26:32.988 INFO:tasks.workunit.client.0.smithi148.stdout:4/212: creat d8/d37/f4f x:0 0 0 2024-02-28T16:26:32.992 INFO:tasks.workunit.client.0.smithi148.stdout:1/232: write d2/d5/d40/f1b [708245,20951] 0 2024-02-28T16:26:32.993 INFO:tasks.workunit.client.0.smithi148.stdout:8/316: mkdir d1/d3/d18/d5a/d60 0 2024-02-28T16:26:32.995 INFO:tasks.workunit.client.0.smithi148.stdout:5/236: mkdir d1/d44 0 2024-02-28T16:26:32.996 INFO:tasks.workunit.client.0.smithi148.stdout:4/213: dread - d8/df/d1f/f3c zero size 2024-02-28T16:26:32.997 INFO:tasks.workunit.client.0.smithi148.stdout:6/250: mkdir d0/d22/d25/d3a/d55 0 2024-02-28T16:26:32.997 INFO:tasks.workunit.client.0.smithi148.stdout:9/264: dread d7/d1c/d32/d24/f42 [0,4194304] 0 2024-02-28T16:26:32.998 INFO:tasks.workunit.client.0.smithi148.stdout:3/324: creat d1/db/f65 x:0 0 0 2024-02-28T16:26:33.000 INFO:tasks.workunit.client.0.smithi148.stdout:3/325: fsync d1/db/f39 0 2024-02-28T16:26:33.001 INFO:tasks.workunit.client.0.smithi148.stdout:3/326: readlink d1/l12 0 2024-02-28T16:26:33.003 INFO:tasks.workunit.client.0.smithi148.stdout:5/237: unlink d1/db/c15 0 2024-02-28T16:26:33.005 INFO:tasks.workunit.client.0.smithi148.stdout:4/214: creat d8/d35/f50 x:0 0 0 2024-02-28T16:26:33.007 INFO:tasks.workunit.client.0.smithi148.stdout:7/223: dwrite d0/d18/f2a [4194304,4194304] 0 2024-02-28T16:26:33.059 INFO:tasks.workunit.client.0.smithi148.stdout:1/233: fsync d2/f26 0 2024-02-28T16:26:33.059 INFO:tasks.workunit.client.0.smithi148.stdout:5/238: creat d1/d1a/f45 x:0 0 0 2024-02-28T16:26:33.065 INFO:tasks.workunit.client.0.smithi148.stdout:7/224: creat d0/d9/d25/d39/f44 x:0 0 0 2024-02-28T16:26:33.067 INFO:tasks.workunit.client.0.smithi148.stdout:1/234: mkdir d2/d5/d2b/d4a 0 2024-02-28T16:26:33.068 INFO:tasks.workunit.client.0.smithi148.stdout:8/317: dwrite d1/dd/d13/d1a/f44 [0,4194304] 0 2024-02-28T16:26:33.069 INFO:tasks.workunit.client.0.smithi148.stdout:7/225: write d0/d9/f1a [4351266,119847] 0 2024-02-28T16:26:33.072 INFO:tasks.workunit.client.0.smithi148.stdout:4/215: dread f6 [0,4194304] 0 2024-02-28T16:26:33.076 INFO:tasks.workunit.client.0.smithi148.stdout:1/235: mknod d2/d5/d40/d8/c4b 0 2024-02-28T16:26:33.077 INFO:tasks.workunit.client.0.smithi148.stdout:7/226: dread - d0/d18/d19/d28/f35 zero size 2024-02-28T16:26:33.081 INFO:tasks.workunit.client.0.smithi148.stdout:8/318: symlink d1/d3/d18/d48/d22/d55/l61 0 2024-02-28T16:26:33.089 INFO:tasks.workunit.client.0.smithi148.stdout:4/216: getdents d8/d37 0 2024-02-28T16:26:33.090 INFO:tasks.workunit.client.0.smithi148.stdout:5/239: dread d1/d1a/f35 [0,4194304] 0 2024-02-28T16:26:33.092 INFO:tasks.workunit.client.0.smithi148.stdout:4/217: chown d8/df/l31 79463 1 2024-02-28T16:26:33.097 INFO:tasks.workunit.client.0.smithi148.stdout:2/240: dread d0/f27 [0,4194304] 0 2024-02-28T16:26:33.098 INFO:tasks.workunit.client.0.smithi148.stdout:1/236: dwrite d2/d5/d40/d8/f3e [0,4194304] 0 2024-02-28T16:26:33.100 INFO:tasks.workunit.client.0.smithi148.stdout:7/227: link d0/d9/c20 d0/c45 0 2024-02-28T16:26:33.103 INFO:tasks.workunit.client.0.smithi148.stdout:3/327: dread d1/f40 [0,4194304] 0 2024-02-28T16:26:33.104 INFO:tasks.workunit.client.0.smithi148.stdout:4/218: rename d8/df/d17/l23 to d8/d35/l51 0 2024-02-28T16:26:33.105 INFO:tasks.workunit.client.0.smithi148.stdout:8/319: write d1/d3/d18/d48/d22/f32 [690095,10090] 0 2024-02-28T16:26:33.110 INFO:tasks.workunit.client.0.smithi148.stdout:4/219: creat d8/d21/d3d/f52 x:0 0 0 2024-02-28T16:26:33.113 INFO:tasks.workunit.client.0.smithi148.stdout:1/237: getdents d2/d5/d2b 0 2024-02-28T16:26:33.114 INFO:tasks.workunit.client.0.smithi148.stdout:1/238: readlink d2/l18 0 2024-02-28T16:26:33.115 INFO:tasks.workunit.client.0.smithi148.stdout:8/320: creat d1/f62 x:0 0 0 2024-02-28T16:26:33.121 INFO:tasks.workunit.client.0.smithi148.stdout:8/321: symlink d1/d3/d35/l63 0 2024-02-28T16:26:33.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:32 smithi148 ceph-mon[28767]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:33.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:32 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3424702829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:33.124 INFO:tasks.workunit.client.0.smithi148.stdout:1/239: getdents d2/d5/d1a 0 2024-02-28T16:26:33.125 INFO:tasks.workunit.client.0.smithi148.stdout:3/328: dwrite d1/d13/d19/d1b/f44 [0,4194304] 0 2024-02-28T16:26:33.126 INFO:tasks.workunit.client.0.smithi148.stdout:1/240: chown d2/d25/l3b 24 1 2024-02-28T16:26:33.132 INFO:tasks.workunit.client.0.smithi148.stdout:8/322: symlink d1/dd/d13/d1a/d25/d50/l64 0 2024-02-28T16:26:33.136 INFO:tasks.workunit.client.0.smithi148.stdout:2/241: dread d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:33.137 INFO:tasks.workunit.client.0.smithi148.stdout:8/323: creat d1/d3/d18/d48/d22/d34/f65 x:0 0 0 2024-02-28T16:26:33.140 INFO:tasks.workunit.client.0.smithi148.stdout:2/242: chown d0/d9/d13/d38/d3a/l3d 3523 1 2024-02-28T16:26:33.143 INFO:tasks.workunit.client.0.smithi148.stdout:8/324: mknod d1/d3/d18/d48/d22/d55/c66 0 2024-02-28T16:26:33.143 INFO:tasks.workunit.client.0.smithi148.stdout:3/329: dwrite d1/d13/f3b [0,4194304] 0 2024-02-28T16:26:33.144 INFO:tasks.workunit.client.0.smithi148.stdout:2/243: mkdir d0/d1c/d49 0 2024-02-28T16:26:33.145 INFO:tasks.workunit.client.0.smithi148.stdout:8/325: write d1/d3/d18/f31 [234478,66517] 0 2024-02-28T16:26:33.148 INFO:tasks.workunit.client.0.smithi148.stdout:2/244: write d0/d1d/f34 [96714,7951] 0 2024-02-28T16:26:33.148 INFO:tasks.workunit.client.0.smithi148.stdout:8/326: fsync d1/d3/f20 0 2024-02-28T16:26:33.154 INFO:tasks.workunit.client.0.smithi148.stdout:4/220: dread d8/df/f20 [0,4194304] 0 2024-02-28T16:26:33.158 INFO:tasks.workunit.client.0.smithi148.stdout:4/221: write d8/df/d17/f1d [900036,125368] 0 2024-02-28T16:26:33.169 INFO:tasks.workunit.client.0.smithi148.stdout:3/330: truncate d1/f40 298333 0 2024-02-28T16:26:33.169 INFO:tasks.workunit.client.0.smithi148.stdout:2/245: dwrite d0/dd/f40 [0,4194304] 0 2024-02-28T16:26:33.174 INFO:tasks.workunit.client.0.smithi148.stdout:8/327: dwrite d1/f5e [0,4194304] 0 2024-02-28T16:26:33.174 INFO:tasks.workunit.client.0.smithi148.stdout:4/222: write d8/f14 [659817,46681] 0 2024-02-28T16:26:33.179 INFO:tasks.workunit.client.0.smithi148.stdout:4/223: fdatasync d8/d40/f41 0 2024-02-28T16:26:33.182 INFO:tasks.workunit.client.0.smithi148.stdout:4/224: write d8/f3f [833718,88938] 0 2024-02-28T16:26:33.184 INFO:tasks.workunit.client.0.smithi148.stdout:2/246: dread d0/d18/f19 [0,4194304] 0 2024-02-28T16:26:33.189 INFO:tasks.workunit.client.0.smithi148.stdout:3/331: rename d1/f40 to d1/db/d35/d52/f66 0 2024-02-28T16:26:33.191 INFO:tasks.workunit.client.0.smithi148.stdout:4/225: creat d8/d40/f53 x:0 0 0 2024-02-28T16:26:33.196 INFO:tasks.workunit.client.0.smithi148.stdout:3/332: chown d1/d13/d19/d1b/f2a 211802402 1 2024-02-28T16:26:33.196 INFO:tasks.workunit.client.0.smithi148.stdout:8/328: link d1/d3/d18/d48/l28 d1/dd/d13/d24/l67 0 2024-02-28T16:26:33.202 INFO:tasks.workunit.client.0.smithi148.stdout:4/226: creat d8/d21/f54 x:0 0 0 2024-02-28T16:26:33.202 INFO:tasks.workunit.client.0.smithi148.stdout:2/247: read d0/f10 [1867174,106410] 0 2024-02-28T16:26:33.207 INFO:tasks.workunit.client.0.smithi148.stdout:3/333: dread d1/db/f39 [0,4194304] 0 2024-02-28T16:26:33.207 INFO:tasks.workunit.client.0.smithi148.stdout:8/329: rename d1/d3/d35 to d1/dd/d13/d68 0 2024-02-28T16:26:33.211 INFO:tasks.workunit.client.0.smithi148.stdout:2/248: creat d0/d9/d13/d38/d3a/f4a x:0 0 0 2024-02-28T16:26:33.212 INFO:tasks.workunit.client.0.smithi148.stdout:4/227: dread d8/df/d17/f1d [0,4194304] 0 2024-02-28T16:26:33.213 INFO:tasks.workunit.client.0.smithi148.stdout:2/249: stat d0/d1c/f1f 0 2024-02-28T16:26:33.214 INFO:tasks.workunit.client.0.smithi148.stdout:4/228: chown d8/df/f36 0 1 2024-02-28T16:26:33.217 INFO:tasks.workunit.client.0.smithi148.stdout:2/250: creat d0/d1c/d49/f4b x:0 0 0 2024-02-28T16:26:33.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:32 smithi157 ceph-mon[38346]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:33.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:32 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3424702829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:26:33.274 INFO:tasks.workunit.client.0.smithi148.stdout:8/330: dwrite d1/f62 [0,4194304] 0 2024-02-28T16:26:33.274 INFO:tasks.workunit.client.0.smithi148.stdout:2/251: write d0/d18/f19 [1271405,106405] 0 2024-02-28T16:26:33.275 INFO:tasks.workunit.client.0.smithi148.stdout:4/229: dread d8/df/d17/f19 [0,4194304] 0 2024-02-28T16:26:33.279 INFO:tasks.workunit.client.0.smithi148.stdout:2/252: mknod d0/d9/c4c 0 2024-02-28T16:26:33.287 INFO:tasks.workunit.client.0.smithi148.stdout:4/230: rename d8/f1c to d8/d21/f55 0 2024-02-28T16:26:33.290 INFO:tasks.workunit.client.0.smithi148.stdout:3/334: dread d1/d13/d19/d1b/f1f [0,4194304] 0 2024-02-28T16:26:33.300 INFO:tasks.workunit.client.0.smithi148.stdout:8/331: truncate d1/dd/d13/d1a/f3f 885483 0 2024-02-28T16:26:33.301 INFO:tasks.workunit.client.0.smithi148.stdout:3/335: truncate d1/d13/f15 530797 0 2024-02-28T16:26:33.304 INFO:tasks.workunit.client.0.smithi148.stdout:3/336: write d1/d13/d19/d1b/d38/f43 [1719240,110762] 0 2024-02-28T16:26:33.308 INFO:tasks.workunit.client.0.smithi148.stdout:2/253: dwrite d0/d1c/f1f [0,4194304] 0 2024-02-28T16:26:33.309 INFO:tasks.workunit.client.0.smithi148.stdout:3/337: unlink d1/db/c11 0 2024-02-28T16:26:33.314 INFO:tasks.workunit.client.0.smithi148.stdout:3/338: write d1/d13/d19/d56/f63 [831078,126414] 0 2024-02-28T16:26:33.318 INFO:tasks.workunit.client.0.smithi148.stdout:2/254: link d0/d1d/c25 d0/dd/d2b/d36/c4d 0 2024-02-28T16:26:33.322 INFO:tasks.workunit.client.0.smithi148.stdout:2/255: rename d0/f8 to d0/d1c/f4e 0 2024-02-28T16:26:33.331 INFO:tasks.workunit.client.0.smithi148.stdout:3/339: truncate d1/d13/f17 3490298 0 2024-02-28T16:26:33.332 INFO:tasks.workunit.client.0.smithi148.stdout:2/256: dread d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:33.333 INFO:tasks.workunit.client.0.smithi148.stdout:2/257: creat d0/dd/d2b/f4f x:0 0 0 2024-02-28T16:26:33.336 INFO:tasks.workunit.client.0.smithi148.stdout:0/309: sync 2024-02-28T16:26:33.338 INFO:tasks.workunit.client.0.smithi148.stdout:0/310: readlink d1/d15/l3b 0 2024-02-28T16:26:33.341 INFO:tasks.workunit.client.0.smithi148.stdout:0/311: fdatasync d1/d15/d3e/f68 0 2024-02-28T16:26:33.342 INFO:tasks.workunit.client.0.smithi148.stdout:3/340: dread d1/db/f10 [0,4194304] 0 2024-02-28T16:26:33.350 INFO:tasks.workunit.client.0.smithi148.stdout:0/312: getdents d1/d15/d27/d34/d5a 0 2024-02-28T16:26:33.352 INFO:tasks.workunit.client.0.smithi148.stdout:0/313: creat d1/d4/f6e x:0 0 0 2024-02-28T16:26:33.355 INFO:tasks.workunit.client.0.smithi148.stdout:0/314: write d1/d15/d3d/f65 [217045,129342] 0 2024-02-28T16:26:33.358 INFO:tasks.workunit.client.0.smithi148.stdout:0/315: truncate d1/d46/d4a/f5b 498754 0 2024-02-28T16:26:33.360 INFO:tasks.workunit.client.0.smithi148.stdout:0/316: read - d1/d46/d4a/f57 zero size 2024-02-28T16:26:33.363 INFO:tasks.workunit.client.0.smithi148.stdout:3/341: dwrite d1/d13/f15 [0,4194304] 0 2024-02-28T16:26:33.363 INFO:tasks.workunit.client.0.smithi148.stdout:0/317: creat d1/d46/d4a/f6f x:0 0 0 2024-02-28T16:26:33.370 INFO:tasks.workunit.client.0.smithi148.stdout:3/342: chown d1/d13/d19/d32/d41/f60 248310 1 2024-02-28T16:26:33.373 INFO:tasks.workunit.client.0.smithi148.stdout:3/343: unlink d1/db/f39 0 2024-02-28T16:26:33.374 INFO:tasks.workunit.client.0.smithi148.stdout:3/344: fdatasync d1/d13/d19/d1b/f1f 0 2024-02-28T16:26:33.377 INFO:tasks.workunit.client.0.smithi148.stdout:0/318: dread d1/d15/f55 [0,4194304] 0 2024-02-28T16:26:33.379 INFO:tasks.workunit.client.0.smithi148.stdout:3/345: rename d1/l12 to d1/db/d35/l67 0 2024-02-28T16:26:33.382 INFO:tasks.workunit.client.0.smithi148.stdout:0/319: dread d1/d4/f45 [0,4194304] 0 2024-02-28T16:26:33.386 INFO:tasks.workunit.client.0.smithi148.stdout:0/320: rename d1/d4/l56 to d1/d15/d27/d34/d5a/l70 0 2024-02-28T16:26:33.388 INFO:tasks.workunit.client.0.smithi148.stdout:0/321: fsync d1/d15/d27/d34/d5a/f66 0 2024-02-28T16:26:33.392 INFO:tasks.workunit.client.0.smithi148.stdout:3/346: dwrite d1/db/f65 [0,4194304] 0 2024-02-28T16:26:33.394 INFO:tasks.workunit.client.0.smithi148.stdout:3/347: write d1/d13/f3b [1593991,1394] 0 2024-02-28T16:26:33.400 INFO:tasks.workunit.client.0.smithi148.stdout:3/348: dread - d1/db/d35/d52/f54 zero size 2024-02-28T16:26:33.400 INFO:tasks.workunit.client.0.smithi148.stdout:3/349: read d1/db/f10 [790038,26588] 0 2024-02-28T16:26:33.401 INFO:tasks.workunit.client.0.smithi148.stdout:3/350: rmdir d1/db/d35/d52 39 2024-02-28T16:26:33.402 INFO:tasks.workunit.client.0.smithi148.stdout:3/351: readlink d1/d13/l31 0 2024-02-28T16:26:33.407 INFO:tasks.workunit.client.0.smithi148.stdout:3/352: rename d1/db/f58 to d1/d13/d19/d56/d5b/f68 0 2024-02-28T16:26:33.417 INFO:tasks.workunit.client.0.smithi148.stdout:0/322: dread d1/d15/d3e/f4e [0,4194304] 0 2024-02-28T16:26:33.435 INFO:tasks.workunit.client.0.smithi148.stdout:0/323: dwrite d1/d15/d27/d34/f6d [0,4194304] 0 2024-02-28T16:26:33.437 INFO:tasks.workunit.client.0.smithi148.stdout:3/353: dread d1/d13/d19/d1b/f5c [0,4194304] 0 2024-02-28T16:26:33.439 INFO:tasks.workunit.client.0.smithi148.stdout:0/324: mkdir d1/d15/d27/d34/d5a/d71 0 2024-02-28T16:26:33.441 INFO:tasks.workunit.client.0.smithi148.stdout:0/325: dread - d1/d15/d8/f52 zero size 2024-02-28T16:26:33.446 INFO:tasks.workunit.client.0.smithi148.stdout:0/326: read d1/d4/d25/f2e [1612260,129409] 0 2024-02-28T16:26:33.448 INFO:tasks.workunit.client.0.smithi148.stdout:0/327: readlink d1/d46/d4a/l69 0 2024-02-28T16:26:33.451 INFO:tasks.workunit.client.0.smithi148.stdout:0/328: write d1/d46/d4a/f5b [880053,102989] 0 2024-02-28T16:26:33.453 INFO:tasks.workunit.client.0.smithi148.stdout:0/329: dread - d1/d46/f6b zero size 2024-02-28T16:26:33.455 INFO:tasks.workunit.client.0.smithi148.stdout:3/354: dwrite d1/d13/f15 [4194304,4194304] 0 2024-02-28T16:26:33.467 INFO:tasks.workunit.client.0.smithi148.stdout:0/330: dwrite d1/f41 [0,4194304] 0 2024-02-28T16:26:33.469 INFO:tasks.workunit.client.0.smithi148.stdout:0/331: write d1/d4/f3c [1600723,11843] 0 2024-02-28T16:26:33.505 INFO:tasks.workunit.client.0.smithi148.stdout:6/251: sync 2024-02-28T16:26:33.532 INFO:tasks.workunit.client.0.smithi148.stdout:3/355: creat d1/d13/f69 x:0 0 0 2024-02-28T16:26:33.536 INFO:tasks.workunit.client.0.smithi148.stdout:3/356: write d1/db/d35/f62 [311683,25231] 0 2024-02-28T16:26:33.539 INFO:tasks.workunit.client.0.smithi148.stdout:0/332: mknod d1/d15/d27/d34/c72 0 2024-02-28T16:26:33.541 INFO:tasks.workunit.client.0.smithi148.stdout:6/252: symlink d0/d22/d27/l56 0 2024-02-28T16:26:33.541 INFO:tasks.workunit.client.0.smithi148.stdout:0/333: fdatasync d1/d4/f60 0 2024-02-28T16:26:33.542 INFO:tasks.workunit.client.0.smithi148.stdout:6/253: chown d0/d22 979628 1 2024-02-28T16:26:33.544 INFO:tasks.workunit.client.0.smithi148.stdout:3/357: write d1/d13/d19/d32/d41/f60 [1833100,56596] 0 2024-02-28T16:26:33.547 INFO:tasks.workunit.client.0.smithi148.stdout:6/254: unlink d0/f1d 0 2024-02-28T16:26:33.548 INFO:tasks.workunit.client.0.smithi148.stdout:0/334: symlink d1/l73 0 2024-02-28T16:26:33.549 INFO:tasks.workunit.client.0.smithi148.stdout:6/255: stat d0/d22/d49 0 2024-02-28T16:26:33.572 INFO:tasks.workunit.client.0.smithi148.stdout:6/256: dwrite d0/d22/d25/f36 [4194304,4194304] 0 2024-02-28T16:26:33.576 INFO:tasks.workunit.client.0.smithi148.stdout:3/358: dwrite d1/f8 [0,4194304] 0 2024-02-28T16:26:33.576 INFO:tasks.workunit.client.0.smithi148.stdout:6/257: write d0/f4c [214534,31770] 0 2024-02-28T16:26:33.578 INFO:tasks.workunit.client.0.smithi148.stdout:6/258: stat d0/d22/l30 0 2024-02-28T16:26:33.581 INFO:tasks.workunit.client.0.smithi148.stdout:6/259: write d0/d22/f37 [8643148,95223] 0 2024-02-28T16:26:33.586 INFO:tasks.workunit.client.0.smithi148.stdout:6/260: mknod d0/d4/d1b/c57 0 2024-02-28T16:26:33.587 INFO:tasks.workunit.client.0.smithi148.stdout:0/335: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:26:33.588 INFO:tasks.workunit.client.0.smithi148.stdout:6/261: chown d0/d8/ff 4142 1 2024-02-28T16:26:33.594 INFO:tasks.workunit.client.0.smithi148.stdout:0/336: mkdir d1/d15/d27/d34/d5a/d71/d74 0 2024-02-28T16:26:33.596 INFO:tasks.workunit.client.0.smithi148.stdout:3/359: link d1/d13/d19/d1b/c64 d1/d3f/c6a 0 2024-02-28T16:26:33.596 INFO:tasks.workunit.client.0.smithi148.stdout:6/262: chown d0/d22/d27/f4e 45019 1 2024-02-28T16:26:33.597 INFO:tasks.workunit.client.0.smithi148.stdout:3/360: stat d1/db/d35/f62 0 2024-02-28T16:26:33.598 INFO:tasks.workunit.client.0.smithi148.stdout:0/337: unlink d1/d46/d4a/c64 0 2024-02-28T16:26:33.599 INFO:tasks.workunit.client.0.smithi148.stdout:6/263: creat d0/d22/d25/f58 x:0 0 0 2024-02-28T16:26:33.603 INFO:tasks.workunit.client.0.smithi148.stdout:6/264: unlink d0/d10/f15 0 2024-02-28T16:26:33.604 INFO:tasks.workunit.client.0.smithi148.stdout:6/265: chown d0/d4 18 1 2024-02-28T16:26:33.608 INFO:tasks.workunit.client.0.smithi148.stdout:6/266: getdents d0/d22/d27/d3e 0 2024-02-28T16:26:33.612 INFO:tasks.workunit.client.0.smithi148.stdout:6/267: write d0/d22/d25/f58 [577432,116658] 0 2024-02-28T16:26:33.614 INFO:tasks.workunit.client.0.smithi148.stdout:0/338: truncate d1/d4/d25/f50 3239093 0 2024-02-28T16:26:33.616 INFO:tasks.workunit.client.0.smithi148.stdout:6/268: mkdir d0/d4/d14/d59 0 2024-02-28T16:26:33.616 INFO:tasks.workunit.client.0.smithi148.stdout:0/339: dread - d1/d15/d27/d34/d5a/f66 zero size 2024-02-28T16:26:33.620 INFO:tasks.workunit.client.0.smithi148.stdout:6/269: creat d0/d22/d49/f5a x:0 0 0 2024-02-28T16:26:33.624 INFO:tasks.workunit.client.0.smithi148.stdout:6/270: getdents d0/d10 0 2024-02-28T16:26:33.634 INFO:tasks.workunit.client.0.smithi148.stdout:0/340: dwrite d1/d15/f44 [0,4194304] 0 2024-02-28T16:26:33.638 INFO:tasks.workunit.client.0.smithi148.stdout:0/341: unlink d1/d15/l3b 0 2024-02-28T16:26:33.639 INFO:tasks.workunit.client.0.smithi148.stdout:6/271: dread d0/d4/f3c [0,4194304] 0 2024-02-28T16:26:33.640 INFO:tasks.workunit.client.0.smithi148.stdout:6/272: chown d0/d10 1 1 2024-02-28T16:26:33.641 INFO:tasks.workunit.client.0.smithi148.stdout:0/342: write d1/d46/d4a/f57 [222320,10997] 0 2024-02-28T16:26:33.642 INFO:tasks.workunit.client.0.smithi148.stdout:6/273: fdatasync d0/d22/d49/f5a 0 2024-02-28T16:26:33.656 INFO:tasks.workunit.client.0.smithi148.stdout:0/343: truncate d1/d15/d8/f29 1813458 0 2024-02-28T16:26:33.668 INFO:tasks.workunit.client.0.smithi148.stdout:6/274: dread d0/d4/d1b/f47 [0,4194304] 0 2024-02-28T16:26:33.675 INFO:tasks.workunit.client.0.smithi148.stdout:6/275: symlink d0/l5b 0 2024-02-28T16:26:33.676 INFO:tasks.workunit.client.0.smithi148.stdout:0/344: link d1/d15/d8/f29 d1/d15/d27/d34/d5a/d6c/f75 0 2024-02-28T16:26:33.680 INFO:tasks.workunit.client.0.smithi148.stdout:0/345: creat d1/d46/f76 x:0 0 0 2024-02-28T16:26:33.683 INFO:tasks.workunit.client.0.smithi148.stdout:0/346: symlink d1/d46/d4a/l77 0 2024-02-28T16:26:33.684 INFO:tasks.workunit.client.0.smithi148.stdout:6/276: rmdir d0/d22/d25/d3a/d55 0 2024-02-28T16:26:33.690 INFO:tasks.workunit.client.0.smithi148.stdout:0/347: rename d1/d15/d27/f35 to d1/d15/f78 0 2024-02-28T16:26:33.697 INFO:tasks.workunit.client.0.smithi148.stdout:6/277: dwrite d0/d22/d25/f36 [0,4194304] 0 2024-02-28T16:26:33.700 INFO:tasks.workunit.client.0.smithi148.stdout:0/348: rename d1/d15/d27/d34/c39 to d1/d46/d4a/c79 0 2024-02-28T16:26:33.702 INFO:tasks.workunit.client.0.smithi148.stdout:6/278: creat d0/d22/d25/d3a/f5c x:0 0 0 2024-02-28T16:26:33.702 INFO:tasks.workunit.client.0.smithi148.stdout:0/349: write d1/d46/f6b [342594,41697] 0 2024-02-28T16:26:33.707 INFO:tasks.workunit.client.0.smithi148.stdout:6/279: mknod d0/d22/d25/d3a/c5d 0 2024-02-28T16:26:33.716 INFO:tasks.workunit.client.0.smithi148.stdout:6/280: unlink d0/l3 0 2024-02-28T16:26:33.716 INFO:tasks.workunit.client.0.smithi148.stdout:5/240: sync 2024-02-28T16:26:33.716 INFO:tasks.workunit.client.0.smithi148.stdout:2/258: sync 2024-02-28T16:26:33.716 INFO:tasks.workunit.client.0.smithi148.stdout:4/231: sync 2024-02-28T16:26:33.716 INFO:tasks.workunit.client.0.smithi148.stdout:9/265: sync 2024-02-28T16:26:33.717 INFO:tasks.workunit.client.0.smithi148.stdout:8/332: sync 2024-02-28T16:26:33.717 INFO:tasks.workunit.client.0.smithi148.stdout:1/241: sync 2024-02-28T16:26:33.717 INFO:tasks.workunit.client.0.smithi148.stdout:7/228: sync 2024-02-28T16:26:33.718 INFO:tasks.workunit.client.0.smithi148.stdout:0/350: getdents d1/d15/d8 0 2024-02-28T16:26:33.721 INFO:tasks.workunit.client.0.smithi148.stdout:8/333: write d1/dd/d13/d1a/f4b [8123813,105774] 0 2024-02-28T16:26:33.725 INFO:tasks.workunit.client.0.smithi148.stdout:0/351: unlink d1/l73 0 2024-02-28T16:26:33.725 INFO:tasks.workunit.client.0.smithi148.stdout:8/334: write d1/d3/f20 [4620288,14941] 0 2024-02-28T16:26:33.757 INFO:tasks.workunit.client.0.smithi148.stdout:1/242: rmdir d2/d5/d40/d7 39 2024-02-28T16:26:33.757 INFO:tasks.workunit.client.0.smithi148.stdout:8/335: fdatasync d1/dd/d13/d24/d3a/f5c 0 2024-02-28T16:26:33.757 INFO:tasks.workunit.client.0.smithi148.stdout:7/229: mkdir d0/d9/d46 0 2024-02-28T16:26:33.758 INFO:tasks.workunit.client.0.smithi148.stdout:4/232: rename d8/f3e to d8/d21/f56 0 2024-02-28T16:26:33.758 INFO:tasks.workunit.client.0.smithi148.stdout:2/259: truncate d0/f10 1789903 0 2024-02-28T16:26:33.760 INFO:tasks.workunit.client.0.smithi148.stdout:8/336: stat d1/f62 0 2024-02-28T16:26:33.760 INFO:tasks.workunit.client.0.smithi148.stdout:0/352: unlink d1/d46/f62 0 2024-02-28T16:26:33.761 INFO:tasks.workunit.client.0.smithi148.stdout:2/260: chown d0 1 1 2024-02-28T16:26:33.761 INFO:tasks.workunit.client.0.smithi148.stdout:1/243: fsync d2/d5/d1a/f24 0 2024-02-28T16:26:33.767 INFO:tasks.workunit.client.0.smithi148.stdout:7/230: write d0/d18/d19/d1c/d32/f3b [254039,15876] 0 2024-02-28T16:26:33.769 INFO:tasks.workunit.client.0.smithi148.stdout:9/266: dwrite d7/fb [0,4194304] 0 2024-02-28T16:26:33.774 INFO:tasks.workunit.client.0.smithi148.stdout:2/261: creat d0/d18/d20/f50 x:0 0 0 2024-02-28T16:26:33.774 INFO:tasks.workunit.client.0.smithi148.stdout:5/241: dwrite d1/db/d25/f1f [0,4194304] 0 2024-02-28T16:26:33.781 INFO:tasks.workunit.client.0.smithi148.stdout:1/244: fdatasync d2/d5/d40/d7/fc 0 2024-02-28T16:26:33.785 INFO:tasks.workunit.client.0.smithi148.stdout:8/337: creat d1/dd/d13/d24/d3a/f69 x:0 0 0 2024-02-28T16:26:33.789 INFO:tasks.workunit.client.0.smithi148.stdout:0/353: dwrite d1/d4/f6e [0,4194304] 0 2024-02-28T16:26:33.790 INFO:tasks.workunit.client.0.smithi148.stdout:4/233: dwrite d8/f3f [0,4194304] 0 2024-02-28T16:26:33.796 INFO:tasks.workunit.client.0.smithi148.stdout:7/231: dwrite d0/d9/d25/f42 [0,4194304] 0 2024-02-28T16:26:33.796 INFO:tasks.workunit.client.0.smithi148.stdout:1/245: mknod d2/d3f/c4c 0 2024-02-28T16:26:33.800 INFO:tasks.workunit.client.0.smithi148.stdout:9/267: mkdir d7/d1c/d59 0 2024-02-28T16:26:33.801 INFO:tasks.workunit.client.0.smithi148.stdout:7/232: write d0/d9/fc [5185241,7732] 0 2024-02-28T16:26:33.804 INFO:tasks.workunit.client.0.smithi148.stdout:2/262: dread d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:33.808 INFO:tasks.workunit.client.0.smithi148.stdout:7/233: read - d0/d9/d25/d39/f44 zero size 2024-02-28T16:26:33.811 INFO:tasks.workunit.client.0.smithi148.stdout:4/234: symlink d8/df/d1f/l57 0 2024-02-28T16:26:33.813 INFO:tasks.workunit.client.0.smithi148.stdout:1/246: creat d2/d15/f4d x:0 0 0 2024-02-28T16:26:33.813 INFO:tasks.workunit.client.0.smithi148.stdout:9/268: rmdir d7/d1c/d1f/d49 39 2024-02-28T16:26:33.818 INFO:tasks.workunit.client.0.smithi148.stdout:5/242: dwrite d1/db/f27 [0,4194304] 0 2024-02-28T16:26:33.819 INFO:tasks.workunit.client.0.smithi148.stdout:8/338: link d1/dd/d13/d1a/f5f d1/d3/d18/d48/d22/d55/f6a 0 2024-02-28T16:26:33.825 INFO:tasks.workunit.client.0.smithi148.stdout:7/234: rename d0/d18/d19 to d0/d9/d25/d47 0 2024-02-28T16:26:33.825 INFO:tasks.workunit.client.0.smithi148.stdout:9/269: unlink d7/dd/f37 0 2024-02-28T16:26:33.826 INFO:tasks.workunit.client.0.smithi148.stdout:0/354: read d1/d15/f2a [2477227,64117] 0 2024-02-28T16:26:33.833 INFO:tasks.workunit.client.0.smithi148.stdout:7/235: creat d0/d9/d25/d47/d1c/f48 x:0 0 0 2024-02-28T16:26:33.837 INFO:tasks.workunit.client.0.smithi148.stdout:2/263: dwrite d0/d9/d13/d38/d3a/f4a [0,4194304] 0 2024-02-28T16:26:33.840 INFO:tasks.workunit.client.0.smithi148.stdout:2/264: dread - d0/d1c/d49/f4b zero size 2024-02-28T16:26:33.841 INFO:tasks.workunit.client.0.smithi148.stdout:8/339: fdatasync d1/d3/d18/d48/d22/d55/f6a 0 2024-02-28T16:26:33.842 INFO:tasks.workunit.client.0.smithi148.stdout:1/247: dread d2/d5/d40/d7/f12 [0,4194304] 0 2024-02-28T16:26:33.844 INFO:tasks.workunit.client.0.smithi148.stdout:4/235: dwrite d8/d21/f54 [0,4194304] 0 2024-02-28T16:26:33.845 INFO:tasks.workunit.client.0.smithi148.stdout:1/248: dread - d2/d5/d40/f27 zero size 2024-02-28T16:26:33.851 INFO:tasks.workunit.client.0.smithi148.stdout:9/270: mknod d7/dd/c5a 0 2024-02-28T16:26:33.859 INFO:tasks.workunit.client.0.smithi148.stdout:5/243: creat d1/d8/d20/f46 x:0 0 0 2024-02-28T16:26:33.860 INFO:tasks.workunit.client.0.smithi148.stdout:5/244: fdatasync d1/d1a/f42 0 2024-02-28T16:26:33.864 INFO:tasks.workunit.client.0.smithi148.stdout:0/355: rename d1/d15/d3e to d1/d15/d27/d7a 0 2024-02-28T16:26:33.865 INFO:tasks.workunit.client.0.smithi148.stdout:3/361: sync 2024-02-28T16:26:33.866 INFO:tasks.workunit.client.0.smithi148.stdout:7/236: mkdir d0/d9/d25/d47/d28/d2b/d3a/d49 0 2024-02-28T16:26:33.870 INFO:tasks.workunit.client.0.smithi148.stdout:8/340: creat d1/dd/d54/f6b x:0 0 0 2024-02-28T16:26:33.871 INFO:tasks.workunit.client.0.smithi148.stdout:3/362: dread d1/d13/d19/f33 [0,4194304] 0 2024-02-28T16:26:33.876 INFO:tasks.workunit.client.0.smithi148.stdout:5/245: read d1/db/d25/f2e [1396463,108400] 0 2024-02-28T16:26:33.879 INFO:tasks.workunit.client.0.smithi148.stdout:1/249: dwrite d2/d5/d40/f16 [0,4194304] 0 2024-02-28T16:26:33.886 INFO:tasks.workunit.client.0.smithi148.stdout:4/236: rmdir d8/df 39 2024-02-28T16:26:33.892 INFO:tasks.workunit.client.0.smithi148.stdout:0/356: mkdir d1/d15/d3d/d67/d7b 0 2024-02-28T16:26:33.897 INFO:tasks.workunit.client.0.smithi148.stdout:5/246: dwrite d1/db/d25/f1f [0,4194304] 0 2024-02-28T16:26:33.905 INFO:tasks.workunit.client.0.smithi148.stdout:1/250: dwrite d2/d15/f30 [0,4194304] 0 2024-02-28T16:26:33.911 INFO:tasks.workunit.client.0.smithi148.stdout:9/271: link d7/dd/c1d d7/d1c/c5b 0 2024-02-28T16:26:33.918 INFO:tasks.workunit.client.0.smithi148.stdout:3/363: creat d1/db/d35/f6b x:0 0 0 2024-02-28T16:26:33.920 INFO:tasks.workunit.client.0.smithi148.stdout:7/237: dread d0/f1d [0,4194304] 0 2024-02-28T16:26:33.929 INFO:tasks.workunit.client.0.smithi148.stdout:8/341: write d1/dd/d13/d24/d3a/f59 [4139800,46756] 0 2024-02-28T16:26:33.930 INFO:tasks.workunit.client.0.smithi148.stdout:9/272: mkdir d7/d1c/d1f/d49/d5c 0 2024-02-28T16:26:33.931 INFO:tasks.workunit.client.0.smithi148.stdout:7/238: symlink d0/d4/l4a 0 2024-02-28T16:26:33.933 INFO:tasks.workunit.client.0.smithi148.stdout:5/247: dwrite d1/d1a/f2b [0,4194304] 0 2024-02-28T16:26:33.939 INFO:tasks.workunit.client.0.smithi148.stdout:8/342: creat d1/d3/f6c x:0 0 0 2024-02-28T16:26:33.940 INFO:tasks.workunit.client.0.smithi148.stdout:7/239: rmdir d0/d9/d25/d47 39 2024-02-28T16:26:33.942 INFO:tasks.workunit.client.0.smithi148.stdout:0/357: dwrite d1/d4/f45 [0,4194304] 0 2024-02-28T16:26:33.947 INFO:tasks.workunit.client.0.smithi148.stdout:7/240: readlink d0/d9/d1b/l37 0 2024-02-28T16:26:33.948 INFO:tasks.workunit.client.0.smithi148.stdout:8/343: creat d1/d3/d18/d5a/d60/f6d x:0 0 0 2024-02-28T16:26:33.951 INFO:tasks.workunit.client.0.smithi148.stdout:5/248: symlink d1/d8/d20/l47 0 2024-02-28T16:26:33.954 INFO:tasks.workunit.client.0.smithi148.stdout:0/358: creat d1/d15/d27/d34/f7c x:0 0 0 2024-02-28T16:26:33.955 INFO:tasks.workunit.client.0.smithi148.stdout:9/273: dread d7/d1c/d32/d24/f2f [0,4194304] 0 2024-02-28T16:26:33.957 INFO:tasks.workunit.client.0.smithi148.stdout:1/251: truncate d2/d5/d40/d8/f9 8085658 0 2024-02-28T16:26:33.957 INFO:tasks.workunit.client.0.smithi148.stdout:7/241: chown d0/d4/l8 180860380 1 2024-02-28T16:26:33.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/344: rmdir d1/dd/d13/d24/d3a/d49 39 2024-02-28T16:26:33.961 INFO:tasks.workunit.client.0.smithi148.stdout:4/237: dwrite d8/d21/f55 [0,4194304] 0 2024-02-28T16:26:33.962 INFO:tasks.workunit.client.0.smithi148.stdout:5/249: write d1/db/d25/f3a [4009782,123798] 0 2024-02-28T16:26:33.963 INFO:tasks.workunit.client.0.smithi148.stdout:7/242: fdatasync d0/d9/d25/f2f 0 2024-02-28T16:26:33.965 INFO:tasks.workunit.client.0.smithi148.stdout:0/359: mknod d1/d4/d25/c7d 0 2024-02-28T16:26:33.965 INFO:tasks.workunit.client.0.smithi148.stdout:4/238: fdatasync d8/d35/f38 0 2024-02-28T16:26:33.966 INFO:tasks.workunit.client.0.smithi148.stdout:9/274: write d7/d1c/d32/d24/f38 [1134174,24956] 0 2024-02-28T16:26:33.969 INFO:tasks.workunit.client.0.smithi148.stdout:5/250: dread - d1/d1a/f45 zero size 2024-02-28T16:26:33.970 INFO:tasks.workunit.client.0.smithi148.stdout:3/364: dwrite d1/d13/d19/d32/f37 [4194304,4194304] 0 2024-02-28T16:26:33.972 INFO:tasks.workunit.client.0.smithi148.stdout:7/243: dread - d0/d9/d25/d39/f44 zero size 2024-02-28T16:26:33.973 INFO:tasks.workunit.client.0.smithi148.stdout:0/360: write d1/d4/f3c [258509,18267] 0 2024-02-28T16:26:33.978 INFO:tasks.workunit.client.0.smithi148.stdout:5/251: fdatasync d1/d1a/f42 0 2024-02-28T16:26:33.978 INFO:tasks.workunit.client.0.smithi148.stdout:7/244: write d0/f1d [1352412,124920] 0 2024-02-28T16:26:33.980 INFO:tasks.workunit.client.0.smithi148.stdout:5/252: truncate d1/f2f 1250800 0 2024-02-28T16:26:33.981 INFO:tasks.workunit.client.0.smithi148.stdout:5/253: readlink d1/ld 0 2024-02-28T16:26:33.983 INFO:tasks.workunit.client.0.smithi148.stdout:5/254: write d1/f26 [6623086,68022] 0 2024-02-28T16:26:33.986 INFO:tasks.workunit.client.0.smithi148.stdout:5/255: truncate d1/d1a/f42 233678 0 2024-02-28T16:26:33.999 INFO:tasks.workunit.client.0.smithi148.stdout:8/345: mknod d1/d3/d18/c6e 0 2024-02-28T16:26:34.005 INFO:tasks.workunit.client.0.smithi148.stdout:5/256: dwrite d1/f43 [0,4194304] 0 2024-02-28T16:26:34.018 INFO:tasks.workunit.client.0.smithi148.stdout:1/252: symlink d2/d5/d40/d8/l4e 0 2024-02-28T16:26:34.022 INFO:tasks.workunit.client.0.smithi148.stdout:3/365: dread d1/db/d45/f4d [0,4194304] 0 2024-02-28T16:26:34.024 INFO:tasks.workunit.client.0.smithi148.stdout:1/253: truncate d2/d5/d40/f3d 546989 0 2024-02-28T16:26:34.026 INFO:tasks.workunit.client.0.smithi148.stdout:3/366: write d1/d13/d19/d32/f37 [757299,52696] 0 2024-02-28T16:26:34.028 INFO:tasks.workunit.client.0.smithi148.stdout:3/367: fsync d1/db/d45/f4d 0 2024-02-28T16:26:34.029 INFO:tasks.workunit.client.0.smithi148.stdout:1/254: readlink d2/d25/l3b 0 2024-02-28T16:26:34.036 INFO:tasks.workunit.client.0.smithi148.stdout:8/346: dread d1/dd/d13/d68/f30 [0,4194304] 0 2024-02-28T16:26:34.042 INFO:tasks.workunit.client.0.smithi148.stdout:1/255: dread d2/d5/d40/f16 [0,4194304] 0 2024-02-28T16:26:34.045 INFO:tasks.workunit.client.0.smithi148.stdout:1/256: read d2/d5/d40/f16 [189271,4219] 0 2024-02-28T16:26:34.050 INFO:tasks.workunit.client.0.smithi148.stdout:0/361: dread d1/d15/d27/d34/f3a [0,4194304] 0 2024-02-28T16:26:34.050 INFO:tasks.workunit.client.0.smithi148.stdout:3/368: creat d1/d13/d19/d56/f6c x:0 0 0 2024-02-28T16:26:34.056 INFO:tasks.workunit.client.0.smithi148.stdout:6/281: sync 2024-02-28T16:26:34.056 INFO:tasks.workunit.client.0.smithi148.stdout:2/265: sync 2024-02-28T16:26:34.056 INFO:tasks.workunit.client.0.smithi148.stdout:7/245: symlink d0/d9/d25/l4b 0 2024-02-28T16:26:34.057 INFO:tasks.workunit.client.0.smithi148.stdout:6/282: chown d0/d10/c29 695 1 2024-02-28T16:26:34.059 INFO:tasks.workunit.client.0.smithi148.stdout:2/266: truncate d0/d1c/d49/f4b 263327 0 2024-02-28T16:26:34.060 INFO:tasks.workunit.client.0.smithi148.stdout:5/257: mknod d1/d8/c48 0 2024-02-28T16:26:34.061 INFO:tasks.workunit.client.0.smithi148.stdout:2/267: stat d0/d18/f28 0 2024-02-28T16:26:34.063 INFO:tasks.workunit.client.0.smithi148.stdout:1/257: dwrite d2/d5/d40/d8/f3e [0,4194304] 0 2024-02-28T16:26:34.066 INFO:tasks.workunit.client.0.smithi148.stdout:1/258: write d2/d15/f4d [315214,83034] 0 2024-02-28T16:26:34.074 INFO:tasks.workunit.client.0.smithi148.stdout:4/239: getdents d8/d35 0 2024-02-28T16:26:34.075 INFO:tasks.workunit.client.0.smithi148.stdout:5/258: creat d1/db/f49 x:0 0 0 2024-02-28T16:26:34.078 INFO:tasks.workunit.client.0.smithi148.stdout:0/362: mkdir d1/d15/d27/d34/d5a/d71/d74/d7e 0 2024-02-28T16:26:34.080 INFO:tasks.workunit.client.0.smithi148.stdout:1/259: symlink d2/d5/d40/d7/l4f 0 2024-02-28T16:26:34.084 INFO:tasks.workunit.client.0.smithi148.stdout:7/246: mkdir d0/d9/d4c 0 2024-02-28T16:26:34.086 INFO:tasks.workunit.client.0.smithi148.stdout:2/268: getdents d0/d18/d20/d46 0 2024-02-28T16:26:34.089 INFO:tasks.workunit.client.0.smithi148.stdout:1/260: mknod d2/d5/d40/d8/c50 0 2024-02-28T16:26:34.091 INFO:tasks.workunit.client.0.smithi148.stdout:7/247: mknod d0/d9/d1b/c4d 0 2024-02-28T16:26:34.091 INFO:tasks.workunit.client.0.smithi148.stdout:1/261: fdatasync d2/d5/d40/d8/f36 0 2024-02-28T16:26:34.094 INFO:tasks.workunit.client.0.smithi148.stdout:0/363: dwrite d1/d15/d27/d34/f7c [0,4194304] 0 2024-02-28T16:26:34.098 INFO:tasks.workunit.client.0.smithi148.stdout:2/269: creat d0/d18/d20/f51 x:0 0 0 2024-02-28T16:26:34.098 INFO:tasks.workunit.client.0.smithi148.stdout:0/364: write d1/d4/f45 [731202,72337] 0 2024-02-28T16:26:34.098 INFO:tasks.workunit.client.0.smithi148.stdout:5/259: mkdir d1/d8/d20/d31/d4a 0 2024-02-28T16:26:34.102 INFO:tasks.workunit.client.0.smithi148.stdout:6/283: getdents d0/d8/d21 0 2024-02-28T16:26:34.106 INFO:tasks.workunit.client.0.smithi148.stdout:6/284: fdatasync d0/d22/d25/f4f 0 2024-02-28T16:26:34.106 INFO:tasks.workunit.client.0.smithi148.stdout:0/365: readlink d1/d15/d27/d7a/l58 0 2024-02-28T16:26:34.108 INFO:tasks.workunit.client.0.smithi148.stdout:6/285: fsync d0/f4c 0 2024-02-28T16:26:34.108 INFO:tasks.workunit.client.0.smithi148.stdout:2/270: mkdir d0/d1d/d52 0 2024-02-28T16:26:34.109 INFO:tasks.workunit.client.0.smithi148.stdout:0/366: chown d1/d4/f6e 1 1 2024-02-28T16:26:34.109 INFO:tasks.workunit.client.0.smithi148.stdout:7/248: dwrite d0/f7 [0,4194304] 0 2024-02-28T16:26:34.116 INFO:tasks.workunit.client.0.smithi148.stdout:2/271: creat d0/d18/d20/d46/f53 x:0 0 0 2024-02-28T16:26:34.121 INFO:tasks.workunit.client.0.smithi148.stdout:6/286: unlink d0/d22/d27/f4e 0 2024-02-28T16:26:34.121 INFO:tasks.workunit.client.0.smithi148.stdout:1/262: dread d2/d5/d40/f16 [0,4194304] 0 2024-02-28T16:26:34.122 INFO:tasks.workunit.client.0.smithi148.stdout:6/287: fdatasync d0/d22/f44 0 2024-02-28T16:26:34.124 INFO:tasks.workunit.client.0.smithi148.stdout:2/272: chown d0/l4 5 1 2024-02-28T16:26:34.125 INFO:tasks.workunit.client.0.smithi148.stdout:1/263: write d2/d5/d40/d8/f21 [1820020,72053] 0 2024-02-28T16:26:34.127 INFO:tasks.workunit.client.0.smithi148.stdout:7/249: truncate d0/d4/f26 1457934 0 2024-02-28T16:26:34.128 INFO:tasks.workunit.client.0.smithi148.stdout:1/264: chown d2/d5/d40/d7/f47 392395 1 2024-02-28T16:26:34.130 INFO:tasks.workunit.client.0.smithi148.stdout:7/250: read d0/d4/f15 [1402791,101835] 0 2024-02-28T16:26:34.135 INFO:tasks.workunit.client.0.smithi148.stdout:2/273: mkdir d0/d1d/d52/d54 0 2024-02-28T16:26:34.138 INFO:tasks.workunit.client.0.smithi148.stdout:2/274: rmdir d0/dd/d2b/d36 39 2024-02-28T16:26:34.141 INFO:tasks.workunit.client.0.smithi148.stdout:3/369: unlink d1/d13/l1a 0 2024-02-28T16:26:34.143 INFO:tasks.workunit.client.0.smithi148.stdout:7/251: dread d0/f13 [0,4194304] 0 2024-02-28T16:26:34.143 INFO:tasks.workunit.client.0.smithi148.stdout:1/265: dwrite d2/d5/d1a/f24 [0,4194304] 0 2024-02-28T16:26:34.145 INFO:tasks.workunit.client.0.smithi148.stdout:7/252: fdatasync d0/d9/d25/f42 0 2024-02-28T16:26:34.150 INFO:tasks.workunit.client.0.smithi148.stdout:7/253: chown d0/d4 476 1 2024-02-28T16:26:34.150 INFO:tasks.workunit.client.0.smithi148.stdout:9/275: rename d7/d1c/f52 to d7/dd/d26/f5d 0 2024-02-28T16:26:34.154 INFO:tasks.workunit.client.0.smithi148.stdout:9/276: write d7/d1c/f45 [1009846,14414] 0 2024-02-28T16:26:34.158 INFO:tasks.workunit.client.0.smithi148.stdout:8/347: rename d1/d3/d18/d48/d22/d55/c66 to d1/d3/d18/d48/d22/c6f 0 2024-02-28T16:26:34.161 INFO:tasks.workunit.client.0.smithi148.stdout:7/254: truncate d0/d9/d25/d47/f27 5234139 0 2024-02-28T16:26:34.164 INFO:tasks.workunit.client.0.smithi148.stdout:2/275: dwrite d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:34.168 INFO:tasks.workunit.client.0.smithi148.stdout:4/240: rename d8/d37/f48 to d8/d21/d3d/d4d/f58 0 2024-02-28T16:26:34.170 INFO:tasks.workunit.client.0.smithi148.stdout:8/348: readlink d1/d3/d18/d48/l28 0 2024-02-28T16:26:34.170 INFO:tasks.workunit.client.0.smithi148.stdout:1/266: dwrite d2/d5/d40/d7/f38 [0,4194304] 0 2024-02-28T16:26:34.170 INFO:tasks.workunit.client.0.smithi148.stdout:4/241: readlink d8/l9 0 2024-02-28T16:26:34.171 INFO:tasks.workunit.client.0.smithi148.stdout:2/276: mkdir d0/d1d/d55 0 2024-02-28T16:26:34.172 INFO:tasks.workunit.client.0.smithi148.stdout:8/349: chown d1/c1f 632 1 2024-02-28T16:26:34.173 INFO:tasks.workunit.client.0.smithi148.stdout:2/277: chown d0/d18/d20/f33 2412 1 2024-02-28T16:26:34.174 INFO:tasks.workunit.client.0.smithi148.stdout:8/350: dread - d1/d3/f6c zero size 2024-02-28T16:26:34.176 INFO:tasks.workunit.client.0.smithi148.stdout:5/260: rename d1/d8/d20/c22 to d1/db/c4b 0 2024-02-28T16:26:34.180 INFO:tasks.workunit.client.0.smithi148.stdout:0/367: write d1/d4/d25/f50 [15256,123917] 0 2024-02-28T16:26:34.183 INFO:tasks.workunit.client.0.smithi148.stdout:2/278: chown d0/dd/f40 900373 1 2024-02-28T16:26:34.194 INFO:tasks.workunit.client.0.smithi148.stdout:8/351: readlink d1/d3/d18/d48/d22/d34/l58 0 2024-02-28T16:26:34.195 INFO:tasks.workunit.client.0.smithi148.stdout:5/261: creat d1/d8/d20/d31/d4a/f4c x:0 0 0 2024-02-28T16:26:34.196 INFO:tasks.workunit.client.0.smithi148.stdout:0/368: readlink d1/d15/d27/d7a/l5c 0 2024-02-28T16:26:34.198 INFO:tasks.workunit.client.0.smithi148.stdout:7/255: dwrite d0/f36 [0,4194304] 0 2024-02-28T16:26:34.199 INFO:tasks.workunit.client.0.smithi148.stdout:3/370: write d1/d13/f17 [3983762,38256] 0 2024-02-28T16:26:34.205 INFO:tasks.workunit.client.0.smithi148.stdout:4/242: dread d8/df/d1f/f42 [0,4194304] 0 2024-02-28T16:26:34.208 INFO:tasks.workunit.client.0.smithi148.stdout:7/256: chown d0/f1d 2 1 2024-02-28T16:26:34.211 INFO:tasks.workunit.client.0.smithi148.stdout:1/267: dwrite d2/d5/d40/f1b [0,4194304] 0 2024-02-28T16:26:34.211 INFO:tasks.workunit.client.0.smithi148.stdout:4/243: chown d8/d21/f54 124033 1 2024-02-28T16:26:34.215 INFO:tasks.workunit.client.0.smithi148.stdout:6/288: rename d0/l5b to d0/d22/d27/l5e 0 2024-02-28T16:26:34.215 INFO:tasks.workunit.client.0.smithi148.stdout:1/268: stat d2/l18 0 2024-02-28T16:26:34.215 INFO:tasks.workunit.client.0.smithi148.stdout:8/352: mkdir d1/d3/d18/d48/d70 0 2024-02-28T16:26:34.215 INFO:tasks.workunit.client.0.smithi148.stdout:7/257: read d0/d9/f1a [866915,98835] 0 2024-02-28T16:26:34.221 INFO:tasks.workunit.client.0.smithi148.stdout:0/369: rmdir d1/d15/d27/d34/d5a 39 2024-02-28T16:26:34.221 INFO:tasks.workunit.client.0.smithi148.stdout:3/371: symlink d1/d13/d19/l6d 0 2024-02-28T16:26:34.221 INFO:tasks.workunit.client.0.smithi148.stdout:6/289: write d0/d22/d49/f5a [578824,38314] 0 2024-02-28T16:26:34.221 INFO:tasks.workunit.client.0.smithi148.stdout:8/353: dread - d1/d3/d18/d48/d22/d34/f65 zero size 2024-02-28T16:26:34.221 INFO:tasks.workunit.client.0.smithi148.stdout:9/277: dwrite d7/d1c/d32/f1a [0,4194304] 0 2024-02-28T16:26:34.221 INFO:tasks.workunit.client.0.smithi148.stdout:1/269: read - d2/d15/d33/f49 zero size 2024-02-28T16:26:34.222 INFO:tasks.workunit.client.0.smithi148.stdout:4/244: mknod d8/d21/c59 0 2024-02-28T16:26:34.224 INFO:tasks.workunit.client.0.smithi148.stdout:1/270: chown d2/d5 12 1 2024-02-28T16:26:34.225 INFO:tasks.workunit.client.0.smithi148.stdout:0/370: read d1/f24 [7606322,124136] 0 2024-02-28T16:26:34.229 INFO:tasks.workunit.client.0.smithi148.stdout:3/372: mknod d1/d13/d19/d1b/d38/c6e 0 2024-02-28T16:26:34.232 INFO:tasks.workunit.client.0.smithi148.stdout:3/373: chown d1/d13/f21 81595 1 2024-02-28T16:26:34.233 INFO:tasks.workunit.client.0.smithi148.stdout:6/290: chown d0/d22/d25/d3a/f5c 60 1 2024-02-28T16:26:34.234 INFO:tasks.workunit.client.0.smithi148.stdout:4/245: write d8/f33 [5077979,46039] 0 2024-02-28T16:26:34.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:33 smithi157 ceph-mon[38346]: pgmap v41: 65 pgs: 65 active+clean; 759 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 5.9 MiB/s rd, 90 MiB/s wr, 232 op/s 2024-02-28T16:26:34.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:33 smithi157 ceph-mon[38346]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:34.238 INFO:tasks.workunit.client.0.smithi148.stdout:4/246: chown d8/f3f 848480071 1 2024-02-28T16:26:34.243 INFO:tasks.workunit.client.0.smithi148.stdout:7/258: link d0/d9/d25/d47/f27 d0/d9/d25/d47/d1c/d32/f4e 0 2024-02-28T16:26:34.243 INFO:tasks.workunit.client.0.smithi148.stdout:1/271: unlink d2/d5/d40/d7/l4f 0 2024-02-28T16:26:34.246 INFO:tasks.workunit.client.0.smithi148.stdout:7/259: fsync d0/d9/fc 0 2024-02-28T16:26:34.246 INFO:tasks.workunit.client.0.smithi148.stdout:0/371: rmdir d1/d15/d27/d34/d5a 39 2024-02-28T16:26:34.247 INFO:tasks.workunit.client.0.smithi148.stdout:2/279: truncate d0/d9/d13/f3c 1332425 0 2024-02-28T16:26:34.251 INFO:tasks.workunit.client.0.smithi148.stdout:5/262: dwrite d1/d8/fa [0,4194304] 0 2024-02-28T16:26:34.251 INFO:tasks.workunit.client.0.smithi148.stdout:1/272: truncate d2/d5/d40/f3d 971844 0 2024-02-28T16:26:34.251 INFO:tasks.workunit.client.0.smithi148.stdout:5/263: dread - d1/d8/d20/d31/d4a/f4c zero size 2024-02-28T16:26:34.251 INFO:tasks.workunit.client.0.smithi148.stdout:3/374: rename d1/db/f10 to d1/d13/f6f 0 2024-02-28T16:26:34.251 INFO:tasks.workunit.client.0.smithi148.stdout:4/247: unlink d8/le 0 2024-02-28T16:26:34.254 INFO:tasks.workunit.client.0.smithi148.stdout:9/278: creat d7/dd/f5e x:0 0 0 2024-02-28T16:26:34.260 INFO:tasks.workunit.client.0.smithi148.stdout:0/372: creat d1/d4/d25/f7f x:0 0 0 2024-02-28T16:26:34.262 INFO:tasks.workunit.client.0.smithi148.stdout:7/260: symlink d0/d9/d25/d47/d28/d2b/d3a/l4f 0 2024-02-28T16:26:34.266 INFO:tasks.workunit.client.0.smithi148.stdout:7/261: truncate d0/d9/fc 6934140 0 2024-02-28T16:26:34.267 INFO:tasks.workunit.client.0.smithi148.stdout:4/248: mknod d8/df/d1f/c5a 0 2024-02-28T16:26:34.272 INFO:tasks.workunit.client.0.smithi148.stdout:8/354: dwrite d1/dd/d13/d1a/f3f [0,4194304] 0 2024-02-28T16:26:34.272 INFO:tasks.workunit.client.0.smithi148.stdout:5/264: creat d1/d8/d20/d31/f4d x:0 0 0 2024-02-28T16:26:34.274 INFO:tasks.workunit.client.0.smithi148.stdout:5/265: chown d1/d8/c48 3 1 2024-02-28T16:26:34.276 INFO:tasks.workunit.client.0.smithi148.stdout:9/279: creat d7/d1c/d1f/d49/f5f x:0 0 0 2024-02-28T16:26:34.277 INFO:tasks.workunit.client.0.smithi148.stdout:8/355: chown d1/d3/d18/d48/d22/d34 1167 1 2024-02-28T16:26:34.280 INFO:tasks.workunit.client.0.smithi148.stdout:1/273: link d2/d5/d40/d8/f21 d2/f51 0 2024-02-28T16:26:34.280 INFO:tasks.workunit.client.0.smithi148.stdout:3/375: mkdir d1/db/d35/d70 0 2024-02-28T16:26:34.282 INFO:tasks.workunit.client.0.smithi148.stdout:6/291: dread d0/d22/f38 [4194304,4194304] 0 2024-02-28T16:26:34.282 INFO:tasks.workunit.client.0.smithi148.stdout:8/356: fdatasync d1/dd/d13/d24/d3a/f59 0 2024-02-28T16:26:34.286 INFO:tasks.workunit.client.0.smithi148.stdout:8/357: write d1/d3/d18/d48/d22/d34/f65 [860388,57225] 0 2024-02-28T16:26:34.287 INFO:tasks.workunit.client.0.smithi148.stdout:4/249: mknod d8/d21/d3d/d4d/c5b 0 2024-02-28T16:26:34.288 INFO:tasks.workunit.client.0.smithi148.stdout:0/373: mkdir d1/d15/d27/d34/d5a/d71/d80 0 2024-02-28T16:26:34.291 INFO:tasks.workunit.client.0.smithi148.stdout:7/262: creat d0/d9/d4c/f50 x:0 0 0 2024-02-28T16:26:34.292 INFO:tasks.workunit.client.0.smithi148.stdout:1/274: chown d2/d5/d40/d8/f36 1 1 2024-02-28T16:26:34.293 INFO:tasks.workunit.client.0.smithi148.stdout:0/374: write d1/f41 [2049849,114030] 0 2024-02-28T16:26:34.295 INFO:tasks.workunit.client.0.smithi148.stdout:7/263: chown d0/d9/d25/d47/d1c/d32/l40 27854219 1 2024-02-28T16:26:34.297 INFO:tasks.workunit.client.0.smithi148.stdout:4/250: chown d8/d35/f49 56 1 2024-02-28T16:26:34.301 INFO:tasks.workunit.client.0.smithi148.stdout:8/358: symlink d1/d3/d18/d5a/d60/l71 0 2024-02-28T16:26:34.304 INFO:tasks.workunit.client.0.smithi148.stdout:0/375: mknod d1/d46/c81 0 2024-02-28T16:26:34.306 INFO:tasks.workunit.client.0.smithi148.stdout:2/280: dwrite d0/f10 [0,4194304] 0 2024-02-28T16:26:34.306 INFO:tasks.workunit.client.0.smithi148.stdout:1/275: mknod d2/d25/c52 0 2024-02-28T16:26:34.307 INFO:tasks.workunit.client.0.smithi148.stdout:0/376: write d1/d46/d4a/f57 [1278859,102094] 0 2024-02-28T16:26:34.309 INFO:tasks.workunit.client.0.smithi148.stdout:4/251: creat d8/d21/d3d/d4d/f5c x:0 0 0 2024-02-28T16:26:34.311 INFO:tasks.workunit.client.0.smithi148.stdout:1/276: read - d2/d5/d1a/f43 zero size 2024-02-28T16:26:34.312 INFO:tasks.workunit.client.0.smithi148.stdout:5/266: truncate d1/f26 7592838 0 2024-02-28T16:26:34.313 INFO:tasks.workunit.client.0.smithi148.stdout:1/277: chown d2/d5/d40/d7 6099465 1 2024-02-28T16:26:34.314 INFO:tasks.workunit.client.0.smithi148.stdout:3/376: mkdir d1/db/d35/d70/d71 0 2024-02-28T16:26:34.316 INFO:tasks.workunit.client.0.smithi148.stdout:2/281: mknod d0/dd/d2b/d36/c56 0 2024-02-28T16:26:34.316 INFO:tasks.workunit.client.0.smithi148.stdout:7/264: creat d0/d9/d25/d47/d28/d2b/d3a/d49/f51 x:0 0 0 2024-02-28T16:26:34.318 INFO:tasks.workunit.client.0.smithi148.stdout:0/377: creat d1/d46/d5f/f82 x:0 0 0 2024-02-28T16:26:34.320 INFO:tasks.workunit.client.0.smithi148.stdout:4/252: truncate d8/f11 1110311 0 2024-02-28T16:26:34.328 INFO:tasks.workunit.client.0.smithi148.stdout:5/267: mkdir d1/d8/d20/d4e 0 2024-02-28T16:26:34.331 INFO:tasks.workunit.client.0.smithi148.stdout:9/280: truncate d7/d1c/d32/f54 252462 0 2024-02-28T16:26:34.331 INFO:tasks.workunit.client.0.smithi148.stdout:5/268: truncate d1/d8/d20/f46 807284 0 2024-02-28T16:26:34.332 INFO:tasks.workunit.client.0.smithi148.stdout:2/282: dwrite d0/d1c/d49/f4b [0,4194304] 0 2024-02-28T16:26:34.339 INFO:tasks.workunit.client.0.smithi148.stdout:3/377: symlink d1/db/d35/d70/d71/l72 0 2024-02-28T16:26:34.342 INFO:tasks.workunit.client.0.smithi148.stdout:7/265: mknod d0/c52 0 2024-02-28T16:26:34.348 INFO:tasks.workunit.client.0.smithi148.stdout:7/266: dread - d0/d9/d25/f2f zero size 2024-02-28T16:26:34.353 INFO:tasks.workunit.client.0.smithi148.stdout:5/269: dwrite d1/db/f49 [0,4194304] 0 2024-02-28T16:26:34.354 INFO:tasks.workunit.client.0.smithi148.stdout:1/278: creat d2/d5/d40/f53 x:0 0 0 2024-02-28T16:26:34.356 INFO:tasks.workunit.client.0.smithi148.stdout:9/281: dwrite d7/d1c/d32/f1a [4194304,4194304] 0 2024-02-28T16:26:34.357 INFO:tasks.workunit.client.0.smithi148.stdout:3/378: creat d1/d13/d19/d56/f73 x:0 0 0 2024-02-28T16:26:34.358 INFO:tasks.workunit.client.0.smithi148.stdout:0/378: creat d1/d15/d27/d34/f83 x:0 0 0 2024-02-28T16:26:34.360 INFO:tasks.workunit.client.0.smithi148.stdout:0/379: fdatasync d1/f41 0 2024-02-28T16:26:34.360 INFO:tasks.workunit.client.0.smithi148.stdout:7/267: mknod d0/d4/c53 0 2024-02-28T16:26:34.362 INFO:tasks.workunit.client.0.smithi148.stdout:7/268: chown d0/f7 410185874 1 2024-02-28T16:26:34.363 INFO:tasks.workunit.client.0.smithi148.stdout:0/380: write d1/d15/d8/f30 [2253514,54358] 0 2024-02-28T16:26:34.367 INFO:tasks.workunit.client.0.smithi148.stdout:5/270: rmdir d1/db 39 2024-02-28T16:26:34.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:33 smithi148 ceph-mon[28767]: pgmap v41: 65 pgs: 65 active+clean; 759 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 5.9 MiB/s rd, 90 MiB/s wr, 232 op/s 2024-02-28T16:26:34.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:33 smithi148 ceph-mon[28767]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:26:34.375 INFO:tasks.workunit.client.0.smithi148.stdout:9/282: creat d7/d43/f60 x:0 0 0 2024-02-28T16:26:34.377 INFO:tasks.workunit.client.0.smithi148.stdout:9/283: chown d7/d1c/l31 10145107 1 2024-02-28T16:26:34.378 INFO:tasks.workunit.client.0.smithi148.stdout:3/379: dwrite d1/d13/d19/f28 [4194304,4194304] 0 2024-02-28T16:26:34.379 INFO:tasks.workunit.client.0.smithi148.stdout:9/284: dread - d7/d1c/d3d/f56 zero size 2024-02-28T16:26:34.392 INFO:tasks.workunit.client.0.smithi148.stdout:7/269: creat d0/d9/d25/d39/f54 x:0 0 0 2024-02-28T16:26:34.393 INFO:tasks.workunit.client.0.smithi148.stdout:2/283: getdents d0/d18/d20/d46 0 2024-02-28T16:26:34.394 INFO:tasks.workunit.client.0.smithi148.stdout:9/285: creat d7/d1c/d3d/f61 x:0 0 0 2024-02-28T16:26:34.396 INFO:tasks.workunit.client.0.smithi148.stdout:0/381: creat d1/f84 x:0 0 0 2024-02-28T16:26:34.399 INFO:tasks.workunit.client.0.smithi148.stdout:7/270: write d0/d9/d25/d47/d1c/d32/f3b [1054500,22606] 0 2024-02-28T16:26:34.402 INFO:tasks.workunit.client.0.smithi148.stdout:0/382: dread d1/d46/f6b [0,4194304] 0 2024-02-28T16:26:34.404 INFO:tasks.workunit.client.0.smithi148.stdout:2/284: mknod d0/dd/d2b/c57 0 2024-02-28T16:26:34.404 INFO:tasks.workunit.client.0.smithi148.stdout:9/286: creat d7/d1c/d59/f62 x:0 0 0 2024-02-28T16:26:34.406 INFO:tasks.workunit.client.0.smithi148.stdout:2/285: readlink d0/d9/l17 0 2024-02-28T16:26:34.409 INFO:tasks.workunit.client.0.smithi148.stdout:3/380: truncate d1/db/f65 3253539 0 2024-02-28T16:26:34.409 INFO:tasks.workunit.client.0.smithi148.stdout:7/271: symlink d0/d9/d25/d47/d28/d2b/d3a/l55 0 2024-02-28T16:26:34.411 INFO:tasks.workunit.client.0.smithi148.stdout:9/287: mknod d7/dd/d26/c63 0 2024-02-28T16:26:34.412 INFO:tasks.workunit.client.0.smithi148.stdout:2/286: symlink d0/d9/d13/d38/d3a/l58 0 2024-02-28T16:26:34.413 INFO:tasks.workunit.client.0.smithi148.stdout:7/272: fsync d0/d9/d25/d47/d1c/f48 0 2024-02-28T16:26:34.414 INFO:tasks.workunit.client.0.smithi148.stdout:3/381: creat d1/d13/d19/d1b/f74 x:0 0 0 2024-02-28T16:26:34.415 INFO:tasks.workunit.client.0.smithi148.stdout:9/288: mknod d7/d1c/d3d/c64 0 2024-02-28T16:26:34.417 INFO:tasks.workunit.client.0.smithi148.stdout:2/287: mkdir d0/d59 0 2024-02-28T16:26:34.419 INFO:tasks.workunit.client.0.smithi148.stdout:3/382: rename d1/d13 to d1/d13/d19/d56/d5b/d75 22 2024-02-28T16:26:34.421 INFO:tasks.workunit.client.0.smithi148.stdout:2/288: readlink d0/d9/d13/d38/d3a/l58 0 2024-02-28T16:26:34.422 INFO:tasks.workunit.client.0.smithi148.stdout:3/383: chown d1/d3f 26407 1 2024-02-28T16:26:34.424 INFO:tasks.workunit.client.0.smithi148.stdout:9/289: dread d7/d1c/d1f/f33 [0,4194304] 0 2024-02-28T16:26:34.425 INFO:tasks.workunit.client.0.smithi148.stdout:3/384: read - d1/d13/d19/d1b/f74 zero size 2024-02-28T16:26:34.428 INFO:tasks.workunit.client.0.smithi148.stdout:0/383: dwrite d1/d46/d5f/f82 [0,4194304] 0 2024-02-28T16:26:34.431 INFO:tasks.workunit.client.0.smithi148.stdout:9/290: write d7/dd/f2b [4335950,67122] 0 2024-02-28T16:26:34.434 INFO:tasks.workunit.client.0.smithi148.stdout:5/271: dread d1/db/f27 [4194304,4194304] 0 2024-02-28T16:26:34.437 INFO:tasks.workunit.client.0.smithi148.stdout:0/384: chown d1/d15/l1b 4735138 1 2024-02-28T16:26:34.441 INFO:tasks.workunit.client.0.smithi148.stdout:9/291: creat d7/d1c/d32/d24/f65 x:0 0 0 2024-02-28T16:26:34.443 INFO:tasks.workunit.client.0.smithi148.stdout:5/272: creat d1/d8/d23/f4f x:0 0 0 2024-02-28T16:26:34.445 INFO:tasks.workunit.client.0.smithi148.stdout:0/385: unlink d1/d4/d25/c7d 0 2024-02-28T16:26:34.447 INFO:tasks.workunit.client.0.smithi148.stdout:9/292: symlink d7/dd/d35/l66 0 2024-02-28T16:26:34.449 INFO:tasks.workunit.client.0.smithi148.stdout:5/273: mkdir d1/d8/d20/d31/d50 0 2024-02-28T16:26:34.452 INFO:tasks.workunit.client.0.smithi148.stdout:7/273: dread d0/d9/d25/d47/d1c/f23 [0,4194304] 0 2024-02-28T16:26:34.452 INFO:tasks.workunit.client.0.smithi148.stdout:9/293: read - d7/d1c/d3d/f61 zero size 2024-02-28T16:26:34.454 INFO:tasks.workunit.client.0.smithi148.stdout:0/386: symlink d1/d15/d27/d34/d5a/d71/d80/l85 0 2024-02-28T16:26:34.454 INFO:tasks.workunit.client.0.smithi148.stdout:3/385: dwrite d1/d13/f21 [0,4194304] 0 2024-02-28T16:26:34.455 INFO:tasks.workunit.client.0.smithi148.stdout:7/274: dread - d0/d9/d25/d47/d1c/f48 zero size 2024-02-28T16:26:34.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/275: mknod d0/c56 0 2024-02-28T16:26:34.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/289: dread d0/d9/f21 [0,4194304] 0 2024-02-28T16:26:34.462 INFO:tasks.workunit.client.0.smithi148.stdout:0/387: mknod d1/d15/d27/d34/d5a/d71/c86 0 2024-02-28T16:26:34.464 INFO:tasks.workunit.client.0.smithi148.stdout:2/290: write d0/d1c/f4e [4130149,18840] 0 2024-02-28T16:26:34.465 INFO:tasks.workunit.client.0.smithi148.stdout:7/276: truncate d0/d9/d25/f42 4429863 0 2024-02-28T16:26:34.468 INFO:tasks.workunit.client.0.smithi148.stdout:9/294: link d7/d1c/d1f/l55 d7/dd/l67 0 2024-02-28T16:26:34.470 INFO:tasks.workunit.client.0.smithi148.stdout:0/388: mknod d1/d15/d3d/d67/c87 0 2024-02-28T16:26:34.473 INFO:tasks.workunit.client.0.smithi148.stdout:3/386: fsync d1/db/d35/d52/f66 0 2024-02-28T16:26:34.473 INFO:tasks.workunit.client.0.smithi148.stdout:7/277: symlink d0/d4/l57 0 2024-02-28T16:26:34.475 INFO:tasks.workunit.client.0.smithi148.stdout:0/389: dread - d1/d4/d25/f6a zero size 2024-02-28T16:26:34.477 INFO:tasks.workunit.client.0.smithi148.stdout:7/278: dread - d0/d9/d25/d39/f54 zero size 2024-02-28T16:26:34.477 INFO:tasks.workunit.client.0.smithi148.stdout:0/390: readlink d1/d4/d25/l49 0 2024-02-28T16:26:34.480 INFO:tasks.workunit.client.0.smithi148.stdout:2/291: link d0/dd/d2b/l42 d0/d1c/d49/l5a 0 2024-02-28T16:26:34.483 INFO:tasks.workunit.client.0.smithi148.stdout:7/279: creat d0/d9/d25/d47/f58 x:0 0 0 2024-02-28T16:26:34.483 INFO:tasks.workunit.client.0.smithi148.stdout:5/274: dread d1/d1a/f35 [0,4194304] 0 2024-02-28T16:26:34.484 INFO:tasks.workunit.client.0.smithi148.stdout:7/280: chown d0/d9/f1a 0 1 2024-02-28T16:26:34.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/391: truncate d1/f24 6950583 0 2024-02-28T16:26:34.487 INFO:tasks.workunit.client.0.smithi148.stdout:0/392: chown d1/d15/d27/d34/c72 110 1 2024-02-28T16:26:34.490 INFO:tasks.workunit.client.0.smithi148.stdout:5/275: mknod d1/d8/d20/c51 0 2024-02-28T16:26:34.493 INFO:tasks.workunit.client.0.smithi148.stdout:5/276: creat d1/d8/d23/f52 x:0 0 0 2024-02-28T16:26:34.496 INFO:tasks.workunit.client.0.smithi148.stdout:5/277: write d1/d1a/f2b [3801939,66627] 0 2024-02-28T16:26:34.496 INFO:tasks.workunit.client.0.smithi148.stdout:0/393: getdents d1/d15 0 2024-02-28T16:26:34.496 INFO:tasks.workunit.client.0.smithi148.stdout:9/295: write d7/d1c/d1f/f33 [1275385,50266] 0 2024-02-28T16:26:34.500 INFO:tasks.workunit.client.0.smithi148.stdout:9/296: dread - d7/f48 zero size 2024-02-28T16:26:34.500 INFO:tasks.workunit.client.0.smithi148.stdout:5/278: rmdir d1/d1a 39 2024-02-28T16:26:34.500 INFO:tasks.workunit.client.0.smithi148.stdout:7/281: dwrite d0/d9/d25/d47/d1c/d32/f3b [0,4194304] 0 2024-02-28T16:26:34.501 INFO:tasks.workunit.client.0.smithi148.stdout:3/387: truncate d1/d13/d19/d1b/f2a 3570113 0 2024-02-28T16:26:34.504 INFO:tasks.workunit.client.0.smithi148.stdout:7/282: fdatasync d0/d9/d25/d47/f58 0 2024-02-28T16:26:34.505 INFO:tasks.workunit.client.0.smithi148.stdout:3/388: stat d1/d13/d19/d56/f63 0 2024-02-28T16:26:34.508 INFO:tasks.workunit.client.0.smithi148.stdout:5/279: read d1/d1a/f35 [1539060,50234] 0 2024-02-28T16:26:34.513 INFO:tasks.workunit.client.0.smithi148.stdout:3/389: mknod d1/db/d35/d70/c76 0 2024-02-28T16:26:34.514 INFO:tasks.workunit.client.0.smithi148.stdout:5/280: fdatasync d1/d1a/f35 0 2024-02-28T16:26:34.517 INFO:tasks.workunit.client.0.smithi148.stdout:3/390: write d1/d13/d19/d1b/d38/f43 [684933,130827] 0 2024-02-28T16:26:34.521 INFO:tasks.workunit.client.0.smithi148.stdout:9/297: truncate d7/dd/f2b 1251581 0 2024-02-28T16:26:34.523 INFO:tasks.workunit.client.0.smithi148.stdout:3/391: chown d1/l25 747263992 1 2024-02-28T16:26:34.525 INFO:tasks.workunit.client.0.smithi148.stdout:9/298: mkdir d7/dd/d35/d68 0 2024-02-28T16:26:34.527 INFO:tasks.workunit.client.0.smithi148.stdout:3/392: unlink d1/d13/l31 0 2024-02-28T16:26:34.527 INFO:tasks.workunit.client.0.smithi148.stdout:9/299: chown d7/f17 122464 1 2024-02-28T16:26:34.531 INFO:tasks.workunit.client.0.smithi148.stdout:7/283: truncate d0/d9/fc 4617964 0 2024-02-28T16:26:34.533 INFO:tasks.workunit.client.0.smithi148.stdout:7/284: chown d0/d9/d25/d47/d28/d2b 0 1 2024-02-28T16:26:34.535 INFO:tasks.workunit.client.0.smithi148.stdout:5/281: dwrite d1/d8/d23/f52 [0,4194304] 0 2024-02-28T16:26:34.538 INFO:tasks.workunit.client.0.smithi148.stdout:5/282: read d1/d1a/f2b [1586103,4947] 0 2024-02-28T16:26:34.540 INFO:tasks.workunit.client.0.smithi148.stdout:7/285: symlink d0/d4/l59 0 2024-02-28T16:26:34.545 INFO:tasks.workunit.client.0.smithi148.stdout:7/286: rmdir d0/d9/d25/d47/d28 39 2024-02-28T16:26:34.546 INFO:tasks.workunit.client.0.smithi148.stdout:7/287: chown d0/d9/d46 239 1 2024-02-28T16:26:34.549 INFO:tasks.workunit.client.0.smithi148.stdout:9/300: dwrite d7/d1c/d32/f54 [0,4194304] 0 2024-02-28T16:26:34.552 INFO:tasks.workunit.client.0.smithi148.stdout:3/393: truncate d1/d13/f3b 2119218 0 2024-02-28T16:26:34.552 INFO:tasks.workunit.client.0.smithi148.stdout:7/288: mknod d0/d18/c5a 0 2024-02-28T16:26:34.556 INFO:tasks.workunit.client.0.smithi148.stdout:3/394: chown d1/d13/d19/d1b 120 1 2024-02-28T16:26:34.564 INFO:tasks.workunit.client.0.smithi148.stdout:3/395: creat d1/d3f/f77 x:0 0 0 2024-02-28T16:26:34.570 INFO:tasks.workunit.client.0.smithi148.stdout:5/283: dwrite d1/d8/d20/d31/f39 [0,4194304] 0 2024-02-28T16:26:34.571 INFO:tasks.workunit.client.0.smithi148.stdout:7/289: creat d0/d9/d25/d47/d28/d2b/d3a/f5b x:0 0 0 2024-02-28T16:26:34.574 INFO:tasks.workunit.client.0.smithi148.stdout:5/284: readlink d1/d8/d20/l47 0 2024-02-28T16:26:34.576 INFO:tasks.workunit.client.0.smithi148.stdout:9/301: dwrite d7/d1c/d32/d24/f42 [0,4194304] 0 2024-02-28T16:26:34.578 INFO:tasks.workunit.client.0.smithi148.stdout:3/396: fsync d1/d13/d19/d56/d5b/f68 0 2024-02-28T16:26:34.590 INFO:tasks.workunit.client.0.smithi148.stdout:5/285: rename d1/d8/l1e to d1/d8/d20/d31/d4a/l53 0 2024-02-28T16:26:34.591 INFO:tasks.workunit.client.0.smithi148.stdout:3/397: creat d1/d13/f78 x:0 0 0 2024-02-28T16:26:34.593 INFO:tasks.workunit.client.0.smithi148.stdout:7/290: truncate d0/d9/fc 3028029 0 2024-02-28T16:26:34.599 INFO:tasks.workunit.client.0.smithi148.stdout:3/398: creat d1/d13/d19/f79 x:0 0 0 2024-02-28T16:26:34.601 INFO:tasks.workunit.client.0.smithi148.stdout:9/302: dwrite d7/d1c/d1f/d49/f5f [0,4194304] 0 2024-02-28T16:26:34.606 INFO:tasks.workunit.client.0.smithi148.stdout:7/291: getdents d0/d9/d25/d47 0 2024-02-28T16:26:34.613 INFO:tasks.workunit.client.0.smithi148.stdout:7/292: mkdir d0/d9/d25/d47/d28/d2b/d5c 0 2024-02-28T16:26:34.618 INFO:tasks.workunit.client.0.smithi148.stdout:5/286: dwrite d1/f2f [0,4194304] 0 2024-02-28T16:26:34.623 INFO:tasks.workunit.client.0.smithi148.stdout:5/287: chown d1/d8/d20/d4e 830215817 1 2024-02-28T16:26:34.624 INFO:tasks.workunit.client.0.smithi148.stdout:7/293: write d0/d9/d25/d47/f58 [772733,46347] 0 2024-02-28T16:26:34.626 INFO:tasks.workunit.client.0.smithi148.stdout:7/294: fdatasync d0/d9/d25/d47/f58 0 2024-02-28T16:26:34.627 INFO:tasks.workunit.client.0.smithi148.stdout:9/303: dwrite d7/d1c/d1f/f4a [4194304,4194304] 0 2024-02-28T16:26:34.631 INFO:tasks.workunit.client.0.smithi148.stdout:3/399: dwrite d1/db/f65 [0,4194304] 0 2024-02-28T16:26:34.639 INFO:tasks.workunit.client.0.smithi148.stdout:5/288: truncate d1/d1a/f35 2595630 0 2024-02-28T16:26:34.642 INFO:tasks.workunit.client.0.smithi148.stdout:9/304: link d7/f17 d7/dd/d26/f69 0 2024-02-28T16:26:34.648 INFO:tasks.workunit.client.0.smithi148.stdout:9/305: mkdir d7/d1c/d1f/d49/d6a 0 2024-02-28T16:26:34.648 INFO:tasks.workunit.client.0.smithi148.stdout:5/289: link d1/d8/c10 d1/c54 0 2024-02-28T16:26:34.648 INFO:tasks.workunit.client.0.smithi148.stdout:3/400: write d1/db/d45/f4d [1373220,28867] 0 2024-02-28T16:26:34.651 INFO:tasks.workunit.client.0.smithi148.stdout:5/290: chown d1/d8/c48 4312 1 2024-02-28T16:26:34.655 INFO:tasks.workunit.client.0.smithi148.stdout:9/306: mkdir d7/dd/d35/d6b 0 2024-02-28T16:26:34.659 INFO:tasks.workunit.client.0.smithi148.stdout:5/291: rmdir d1/d8/d20/d31/d4a 39 2024-02-28T16:26:34.659 INFO:tasks.workunit.client.0.smithi148.stdout:9/307: mknod d7/c6c 0 2024-02-28T16:26:34.660 INFO:tasks.workunit.client.0.smithi148.stdout:9/308: read - d7/f48 zero size 2024-02-28T16:26:34.661 INFO:tasks.workunit.client.0.smithi148.stdout:9/309: chown d7/dd/d35/d68 3425074 1 2024-02-28T16:26:34.668 INFO:tasks.workunit.client.0.smithi148.stdout:3/401: truncate d1/db/f48 2370178 0 2024-02-28T16:26:34.669 INFO:tasks.workunit.client.0.smithi148.stdout:7/295: dread d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:34.669 INFO:tasks.workunit.client.0.smithi148.stdout:9/310: truncate d7/f17 535377 0 2024-02-28T16:26:34.670 INFO:tasks.workunit.client.0.smithi148.stdout:3/402: write d1/d13/d19/f79 [887525,67426] 0 2024-02-28T16:26:34.674 INFO:tasks.workunit.client.0.smithi148.stdout:9/311: symlink d7/d1c/d59/l6d 0 2024-02-28T16:26:34.674 INFO:tasks.workunit.client.0.smithi148.stdout:3/403: stat d1/c14 0 2024-02-28T16:26:34.676 INFO:tasks.workunit.client.0.smithi148.stdout:7/296: unlink d0/d4/f26 0 2024-02-28T16:26:34.676 INFO:tasks.workunit.client.0.smithi148.stdout:3/404: rename d1/db/d35 to d1/db/d35/d52/d7a 22 2024-02-28T16:26:34.678 INFO:tasks.workunit.client.0.smithi148.stdout:3/405: write d1/db/f65 [4823288,25874] 0 2024-02-28T16:26:34.678 INFO:tasks.workunit.client.0.smithi148.stdout:7/297: chown d0/d9/d25/d47/d1c/f48 101478705 1 2024-02-28T16:26:34.679 INFO:tasks.workunit.client.0.smithi148.stdout:3/406: fdatasync d1/d13/f1e 0 2024-02-28T16:26:34.680 INFO:tasks.workunit.client.0.smithi148.stdout:9/312: symlink d7/l6e 0 2024-02-28T16:26:34.681 INFO:tasks.workunit.client.0.smithi148.stdout:3/407: chown d1/d13/d19/l4c 1998 1 2024-02-28T16:26:34.685 INFO:tasks.workunit.client.0.smithi148.stdout:3/408: stat d1/d13/d19/d1b/f2a 0 2024-02-28T16:26:34.688 INFO:tasks.workunit.client.0.smithi148.stdout:7/298: symlink d0/d9/d46/l5d 0 2024-02-28T16:26:34.694 INFO:tasks.workunit.client.0.smithi148.stdout:7/299: rename d0/d4/l4a to d0/d4/l5e 0 2024-02-28T16:26:34.697 INFO:tasks.workunit.client.0.smithi148.stdout:9/313: dwrite d7/d43/f60 [0,4194304] 0 2024-02-28T16:26:34.704 INFO:tasks.workunit.client.0.smithi148.stdout:3/409: getdents d1/d13/d19/d1b/d38 0 2024-02-28T16:26:34.713 INFO:tasks.workunit.client.0.smithi148.stdout:9/314: getdents d7/dd 0 2024-02-28T16:26:34.715 INFO:tasks.workunit.client.0.smithi148.stdout:7/300: dread d0/d9/fc [0,4194304] 0 2024-02-28T16:26:34.733 INFO:tasks.workunit.client.0.smithi148.stdout:9/315: dwrite d7/d1c/d32/d24/f65 [0,4194304] 0 2024-02-28T16:26:34.735 INFO:tasks.workunit.client.0.smithi148.stdout:3/410: dread d1/d13/f1e [0,4194304] 0 2024-02-28T16:26:34.738 INFO:tasks.workunit.client.0.smithi148.stdout:9/316: readlink d7/d1c/l31 0 2024-02-28T16:26:34.739 INFO:tasks.workunit.client.0.smithi148.stdout:9/317: stat d7/d1c/d1f/f4a 0 2024-02-28T16:26:34.743 INFO:tasks.workunit.client.0.smithi148.stdout:7/301: dread d0/d9/d25/d47/d1c/d32/f4e [0,4194304] 0 2024-02-28T16:26:34.744 INFO:tasks.workunit.client.0.smithi148.stdout:9/318: symlink d7/dd/l6f 0 2024-02-28T16:26:34.751 INFO:tasks.workunit.client.0.smithi148.stdout:3/411: rename d1/d13/d19/d1b/f5f to d1/f7b 0 2024-02-28T16:26:34.758 INFO:tasks.workunit.client.0.smithi148.stdout:7/302: truncate d0/d9/d25/d47/f58 278796 0 2024-02-28T16:26:34.762 INFO:tasks.workunit.client.0.smithi148.stdout:7/303: mknod d0/d18/c5f 0 2024-02-28T16:26:34.764 INFO:tasks.workunit.client.0.smithi148.stdout:3/412: dwrite d1/d13/d19/d32/f37 [0,4194304] 0 2024-02-28T16:26:34.769 INFO:tasks.workunit.client.0.smithi148.stdout:7/304: mknod d0/d9/d25/d47/d1c/c60 0 2024-02-28T16:26:34.771 INFO:tasks.workunit.client.0.smithi148.stdout:3/413: mkdir d1/d13/d19/d1b/d38/d7c 0 2024-02-28T16:26:34.772 INFO:tasks.workunit.client.0.smithi148.stdout:7/305: chown d0/d9/d25/d47/d1c/f48 11 1 2024-02-28T16:26:34.773 INFO:tasks.workunit.client.0.smithi148.stdout:9/319: creat d7/dd/d35/f70 x:0 0 0 2024-02-28T16:26:34.775 INFO:tasks.workunit.client.0.smithi148.stdout:3/414: chown d1/d3f/c6a 6 1 2024-02-28T16:26:34.778 INFO:tasks.workunit.client.0.smithi148.stdout:7/306: symlink d0/d9/d46/l61 0 2024-02-28T16:26:34.780 INFO:tasks.workunit.client.0.smithi148.stdout:9/320: mknod d7/dd/d26/c71 0 2024-02-28T16:26:34.780 INFO:tasks.workunit.client.0.smithi148.stdout:7/307: dread - d0/d9/d25/d47/d28/f35 zero size 2024-02-28T16:26:34.784 INFO:tasks.workunit.client.0.smithi148.stdout:7/308: creat d0/d9/d1b/f62 x:0 0 0 2024-02-28T16:26:34.786 INFO:tasks.workunit.client.0.smithi148.stdout:9/321: mknod d7/dd/c72 0 2024-02-28T16:26:34.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/309: write d0/d9/d4c/f50 [382321,529] 0 2024-02-28T16:26:34.789 INFO:tasks.workunit.client.0.smithi148.stdout:3/415: dwrite d1/d13/f69 [0,4194304] 0 2024-02-28T16:26:34.791 INFO:tasks.workunit.client.0.smithi148.stdout:9/322: read d7/dd/f2e [3151385,24107] 0 2024-02-28T16:26:34.803 INFO:tasks.workunit.client.0.smithi148.stdout:9/323: mknod d7/dd/d35/c73 0 2024-02-28T16:26:34.809 INFO:tasks.workunit.client.0.smithi148.stdout:9/324: getdents d7/d1c/d1f/d49 0 2024-02-28T16:26:34.810 INFO:tasks.workunit.client.0.smithi148.stdout:9/325: dread - d7/f48 zero size 2024-02-28T16:26:34.820 INFO:tasks.workunit.client.0.smithi148.stdout:9/326: rename d7/dd/d35 to d7/d1c/d74 0 2024-02-28T16:26:34.828 INFO:tasks.workunit.client.0.smithi148.stdout:9/327: creat d7/d1c/f75 x:0 0 0 2024-02-28T16:26:34.828 INFO:tasks.workunit.client.0.smithi148.stdout:7/310: dwrite d0/d9/d25/d47/f58 [0,4194304] 0 2024-02-28T16:26:34.828 INFO:tasks.workunit.client.0.smithi148.stdout:3/416: dwrite d1/db/f48 [0,4194304] 0 2024-02-28T16:26:34.830 INFO:tasks.workunit.client.0.smithi148.stdout:9/328: read d7/d1c/d32/f54 [249769,25478] 0 2024-02-28T16:26:34.835 INFO:tasks.workunit.client.0.smithi148.stdout:3/417: rename d1/f8 to d1/db/d45/f7d 0 2024-02-28T16:26:34.837 INFO:tasks.workunit.client.0.smithi148.stdout:3/418: fsync d1/d13/f78 0 2024-02-28T16:26:34.838 INFO:tasks.workunit.client.0.smithi148.stdout:9/329: read - d7/dd/d26/f5d zero size 2024-02-28T16:26:34.838 INFO:tasks.workunit.client.0.smithi148.stdout:3/419: stat d1/d13/d19/d32/c4e 0 2024-02-28T16:26:34.839 INFO:tasks.workunit.client.0.smithi148.stdout:7/311: truncate d0/f1d 3169554 0 2024-02-28T16:26:34.840 INFO:tasks.workunit.client.0.smithi148.stdout:9/330: chown d7/d1c/d1f/d49/d6a 818487721 1 2024-02-28T16:26:34.842 INFO:tasks.workunit.client.0.smithi148.stdout:7/312: write d0/f7 [2036361,128123] 0 2024-02-28T16:26:34.842 INFO:tasks.workunit.client.0.smithi148.stdout:9/331: write d7/d1c/f75 [318140,22966] 0 2024-02-28T16:26:34.842 INFO:tasks.workunit.client.0.smithi148.stdout:3/420: symlink d1/db/d35/d70/d71/l7e 0 2024-02-28T16:26:34.845 INFO:tasks.workunit.client.0.smithi148.stdout:7/313: write d0/d18/f2a [2023640,69863] 0 2024-02-28T16:26:34.847 INFO:tasks.workunit.client.0.smithi148.stdout:3/421: creat d1/d3f/f7f x:0 0 0 2024-02-28T16:26:34.849 INFO:tasks.workunit.client.0.smithi148.stdout:3/422: readlink d1/db/d35/l51 0 2024-02-28T16:26:34.850 INFO:tasks.workunit.client.0.smithi148.stdout:7/314: chown d0/d9/d46/l61 486 1 2024-02-28T16:26:34.853 INFO:tasks.workunit.client.0.smithi148.stdout:7/315: creat d0/d4/f63 x:0 0 0 2024-02-28T16:26:34.855 INFO:tasks.workunit.client.0.smithi148.stdout:9/332: mknod d7/d1c/d1f/d49/d6a/c76 0 2024-02-28T16:26:34.859 INFO:tasks.workunit.client.0.smithi148.stdout:7/316: rename d0/d18/c5f to d0/d9/d46/c64 0 2024-02-28T16:26:34.863 INFO:tasks.workunit.client.0.smithi148.stdout:7/317: mkdir d0/d9/d46/d65 0 2024-02-28T16:26:34.868 INFO:tasks.workunit.client.0.smithi148.stdout:7/318: mknod d0/d9/d25/d47/d28/d2b/c66 0 2024-02-28T16:26:34.869 INFO:tasks.workunit.client.0.smithi148.stdout:9/333: truncate d7/f3c 300462 0 2024-02-28T16:26:34.875 INFO:tasks.workunit.client.0.smithi148.stdout:7/319: rename d0/d4/l8 to d0/d9/d25/d47/d28/d2b/d3a/l67 0 2024-02-28T16:26:34.876 INFO:tasks.workunit.client.0.smithi148.stdout:7/320: chown d0/d18/f2a 108049278 1 2024-02-28T16:26:34.880 INFO:tasks.workunit.client.0.smithi148.stdout:7/321: rename d0/f11 to d0/d9/d25/d47/f68 0 2024-02-28T16:26:34.882 INFO:tasks.workunit.client.0.smithi148.stdout:7/322: fdatasync d0/d9/fc 0 2024-02-28T16:26:35.018 INFO:tasks.workunit.client.0.smithi148.stdout:6/292: sync 2024-02-28T16:26:35.059 INFO:tasks.workunit.client.0.smithi148.stdout:6/293: dwrite d0/d4/d1b/f2e [0,4194304] 0 2024-02-28T16:26:35.062 INFO:tasks.workunit.client.0.smithi148.stdout:6/294: write d0/d4/f11 [1280455,59392] 0 2024-02-28T16:26:35.066 INFO:tasks.workunit.client.0.smithi148.stdout:6/295: fsync d0/d22/f37 0 2024-02-28T16:26:35.073 INFO:tasks.workunit.client.0.smithi148.stdout:6/296: rmdir d0/d22/d27 39 2024-02-28T16:26:35.106 INFO:tasks.workunit.client.0.smithi148.stdout:6/297: dwrite d0/d4/d1b/f47 [4194304,4194304] 0 2024-02-28T16:26:35.110 INFO:tasks.workunit.client.0.smithi148.stdout:6/298: readlink d0/l2d 0 2024-02-28T16:26:35.117 INFO:tasks.workunit.client.0.smithi148.stdout:6/299: mknod d0/d8/d21/c5f 0 2024-02-28T16:26:35.124 INFO:tasks.workunit.client.0.smithi148.stdout:6/300: symlink d0/d4/d14/d59/l60 0 2024-02-28T16:26:35.131 INFO:tasks.workunit.client.0.smithi148.stdout:6/301: mknod d0/d22/d25/c61 0 2024-02-28T16:26:35.136 INFO:tasks.workunit.client.0.smithi148.stdout:6/302: write d0/d4/f11 [4205899,55196] 0 2024-02-28T16:26:35.166 INFO:tasks.workunit.client.0.smithi148.stdout:6/303: dwrite d0/d4/d1b/f2e [0,4194304] 0 2024-02-28T16:26:35.170 INFO:tasks.workunit.client.0.smithi148.stdout:6/304: chown d0/d8/d21/c50 42 1 2024-02-28T16:26:35.203 INFO:tasks.workunit.client.0.smithi148.stdout:6/305: dwrite d0/d22/f38 [8388608,4194304] 0 2024-02-28T16:26:35.207 INFO:tasks.workunit.client.0.smithi148.stdout:6/306: write d0/d10/f13 [1913472,56313] 0 2024-02-28T16:26:35.210 INFO:tasks.workunit.client.0.smithi148.stdout:6/307: fsync d0/d8/ff 0 2024-02-28T16:26:35.221 INFO:tasks.workunit.client.0.smithi148.stdout:6/308: rename d0/d4/d1b/f2e to d0/d22/d27/f62 0 2024-02-28T16:26:35.231 INFO:tasks.workunit.client.0.smithi148.stdout:8/359: sync 2024-02-28T16:26:35.235 INFO:tasks.workunit.client.0.smithi148.stdout:6/309: dread d0/d22/d25/f58 [0,4194304] 0 2024-02-28T16:26:35.237 INFO:tasks.workunit.client.0.smithi148.stdout:8/360: rename d1/f5e to d1/d3/d18/d48/d70/f72 0 2024-02-28T16:26:35.238 INFO:tasks.workunit.client.0.smithi148.stdout:6/310: symlink d0/d22/d27/l63 0 2024-02-28T16:26:35.241 INFO:tasks.workunit.client.0.smithi148.stdout:6/311: mknod d0/d8/d21/c64 0 2024-02-28T16:26:35.246 INFO:tasks.workunit.client.0.smithi148.stdout:0/394: sync 2024-02-28T16:26:35.246 INFO:tasks.workunit.client.0.smithi148.stdout:1/279: sync 2024-02-28T16:26:35.246 INFO:tasks.workunit.client.0.smithi148.stdout:3/423: sync 2024-02-28T16:26:35.247 INFO:tasks.workunit.client.0.smithi148.stdout:4/253: sync 2024-02-28T16:26:35.247 INFO:tasks.workunit.client.0.smithi148.stdout:9/334: sync 2024-02-28T16:26:35.247 INFO:tasks.workunit.client.0.smithi148.stdout:7/323: sync 2024-02-28T16:26:35.247 INFO:tasks.workunit.client.0.smithi148.stdout:2/292: sync 2024-02-28T16:26:35.247 INFO:tasks.workunit.client.0.smithi148.stdout:5/292: sync 2024-02-28T16:26:35.251 INFO:tasks.workunit.client.0.smithi148.stdout:2/293: symlink d0/d9/d13/d38/l5b 0 2024-02-28T16:26:35.253 INFO:tasks.workunit.client.0.smithi148.stdout:3/424: dread - d1/db/d35/f6b zero size 2024-02-28T16:26:35.255 INFO:tasks.workunit.client.0.smithi148.stdout:0/395: rmdir d1/d15/d27/d34/d5a/d71 39 2024-02-28T16:26:35.257 INFO:tasks.workunit.client.0.smithi148.stdout:9/335: write d7/d1c/f75 [627422,70689] 0 2024-02-28T16:26:35.260 INFO:tasks.workunit.client.0.smithi148.stdout:7/324: truncate d0/d9/d25/d39/f54 226053 0 2024-02-28T16:26:35.262 INFO:tasks.workunit.client.0.smithi148.stdout:2/294: write d0/d18/d20/f51 [149172,89767] 0 2024-02-28T16:26:35.262 INFO:tasks.workunit.client.0.smithi148.stdout:4/254: getdents d8/d40 0 2024-02-28T16:26:35.268 INFO:tasks.workunit.client.0.smithi148.stdout:0/396: fdatasync d1/d46/f6b 0 2024-02-28T16:26:35.276 INFO:tasks.workunit.client.0.smithi148.stdout:6/312: dwrite d0/f16 [4194304,4194304] 0 2024-02-28T16:26:35.276 INFO:tasks.workunit.client.0.smithi148.stdout:8/361: dread d1/dd/d13/d1a/f44 [0,4194304] 0 2024-02-28T16:26:35.276 INFO:tasks.workunit.client.0.smithi148.stdout:8/362: stat d1/d3/d18/d48/l28 0 2024-02-28T16:26:35.281 INFO:tasks.workunit.client.0.smithi148.stdout:5/293: truncate d1/d8/d23/f52 177143 0 2024-02-28T16:26:35.281 INFO:tasks.workunit.client.0.smithi148.stdout:1/280: write d2/f51 [5086185,83503] 0 2024-02-28T16:26:35.283 INFO:tasks.workunit.client.0.smithi148.stdout:8/363: readlink d1/d3/d18/d48/d22/d55/l61 0 2024-02-28T16:26:35.285 INFO:tasks.workunit.client.0.smithi148.stdout:6/313: write d0/d22/d27/f62 [4609250,64663] 0 2024-02-28T16:26:35.285 INFO:tasks.workunit.client.0.smithi148.stdout:7/325: creat d0/d9/d25/d47/d28/d2b/f69 x:0 0 0 2024-02-28T16:26:35.293 INFO:tasks.workunit.client.0.smithi148.stdout:3/425: dwrite d1/d13/d19/d56/f5e [0,4194304] 0 2024-02-28T16:26:35.295 INFO:tasks.workunit.client.0.smithi148.stdout:4/255: dwrite d8/f26 [0,4194304] 0 2024-02-28T16:26:35.297 INFO:tasks.workunit.client.0.smithi148.stdout:1/281: symlink d2/d3f/l54 0 2024-02-28T16:26:35.301 INFO:tasks.workunit.client.0.smithi148.stdout:7/326: stat d0/d9/d25/d47/f58 0 2024-02-28T16:26:35.302 INFO:tasks.workunit.client.0.smithi148.stdout:3/426: chown d1/d13/f15 653241 1 2024-02-28T16:26:35.303 INFO:tasks.workunit.client.0.smithi148.stdout:6/314: write d0/d8/ff [2506811,79310] 0 2024-02-28T16:26:35.303 INFO:tasks.workunit.client.0.smithi148.stdout:8/364: read d1/dd/d13/d68/f36 [763800,125207] 0 2024-02-28T16:26:35.304 INFO:tasks.workunit.client.0.smithi148.stdout:5/294: creat d1/f55 x:0 0 0 2024-02-28T16:26:35.304 INFO:tasks.workunit.client.0.smithi148.stdout:1/282: readlink d2/d15/d33/l44 0 2024-02-28T16:26:35.309 INFO:tasks.workunit.client.0.smithi148.stdout:4/256: chown d8/df/l32 515724 1 2024-02-28T16:26:35.313 INFO:tasks.workunit.client.0.smithi148.stdout:5/295: write d1/f43 [5049594,125910] 0 2024-02-28T16:26:35.314 INFO:tasks.workunit.client.0.smithi148.stdout:8/365: write d1/d3/f53 [3231903,44902] 0 2024-02-28T16:26:35.317 INFO:tasks.workunit.client.0.smithi148.stdout:9/336: dwrite d7/dd/f2e [0,4194304] 0 2024-02-28T16:26:35.320 INFO:tasks.workunit.client.0.smithi148.stdout:0/397: dwrite d1/d46/d4a/f6f [0,4194304] 0 2024-02-28T16:26:35.328 INFO:tasks.workunit.client.0.smithi148.stdout:4/257: mknod d8/d37/c5d 0 2024-02-28T16:26:35.328 INFO:tasks.workunit.client.0.smithi148.stdout:5/296: fsync d1/d8/d23/f2d 0 2024-02-28T16:26:35.332 INFO:tasks.workunit.client.0.smithi148.stdout:8/366: creat d1/d3/d18/d48/d22/d34/f73 x:0 0 0 2024-02-28T16:26:35.339 INFO:tasks.workunit.client.0.smithi148.stdout:4/258: rmdir d8/d40 39 2024-02-28T16:26:35.339 INFO:tasks.workunit.client.0.smithi148.stdout:7/327: dwrite d0/f7 [0,4194304] 0 2024-02-28T16:26:35.346 INFO:tasks.workunit.client.0.smithi148.stdout:1/283: dwrite d2/d5/d1a/f43 [0,4194304] 0 2024-02-28T16:26:35.346 INFO:tasks.workunit.client.0.smithi148.stdout:6/315: creat d0/d22/f65 x:0 0 0 2024-02-28T16:26:35.346 INFO:tasks.workunit.client.0.smithi148.stdout:9/337: write d7/dd/d26/f5d [822945,102938] 0 2024-02-28T16:26:35.351 INFO:tasks.workunit.client.0.smithi148.stdout:5/297: truncate d1/db/d25/f2e 3199168 0 2024-02-28T16:26:35.352 INFO:tasks.workunit.client.0.smithi148.stdout:6/316: fdatasync d0/d22/f44 0 2024-02-28T16:26:35.354 INFO:tasks.workunit.client.0.smithi148.stdout:0/398: rename d1/d15/d27/d34/f3a to d1/d15/d27/d34/d5a/d6c/f88 0 2024-02-28T16:26:35.360 INFO:tasks.workunit.client.0.smithi148.stdout:0/399: readlink d1/l3 0 2024-02-28T16:26:35.361 INFO:tasks.workunit.client.0.smithi148.stdout:6/317: write d0/d4/d14/f28 [2799618,92378] 0 2024-02-28T16:26:35.366 INFO:tasks.workunit.client.0.smithi148.stdout:5/298: readlink d1/db/l37 0 2024-02-28T16:26:35.367 INFO:tasks.workunit.client.0.smithi148.stdout:3/427: dwrite d1/db/f22 [0,4194304] 0 2024-02-28T16:26:35.367 INFO:tasks.workunit.client.0.smithi148.stdout:6/318: chown d0/d22/d27/f62 1082 1 2024-02-28T16:26:35.367 INFO:tasks.workunit.client.0.smithi148.stdout:9/338: rename d7/d1c/l23 to d7/d1c/d74/d6b/l77 0 2024-02-28T16:26:35.367 INFO:tasks.workunit.client.0.smithi148.stdout:1/284: creat d2/d5/d2b/d4a/f55 x:0 0 0 2024-02-28T16:26:35.367 INFO:tasks.workunit.client.0.smithi148.stdout:0/400: fdatasync d1/d4/d25/f61 0 2024-02-28T16:26:35.370 INFO:tasks.workunit.client.0.smithi148.stdout:4/259: symlink d8/d40/l5e 0 2024-02-28T16:26:35.376 INFO:tasks.workunit.client.0.smithi148.stdout:5/299: write d1/d8/fa [461171,108444] 0 2024-02-28T16:26:35.379 INFO:tasks.workunit.client.0.smithi148.stdout:8/367: dread d1/d3/d18/d48/d22/f32 [0,4194304] 0 2024-02-28T16:26:35.379 INFO:tasks.workunit.client.0.smithi148.stdout:3/428: read d1/db/d35/f62 [1220,48956] 0 2024-02-28T16:26:35.379 INFO:tasks.workunit.client.0.smithi148.stdout:4/260: truncate d8/df/f36 891595 0 2024-02-28T16:26:35.382 INFO:tasks.workunit.client.0.smithi148.stdout:4/261: dread - d8/d40/f41 zero size 2024-02-28T16:26:35.382 INFO:tasks.workunit.client.0.smithi148.stdout:3/429: read - d1/db/d35/f6b zero size 2024-02-28T16:26:35.388 INFO:tasks.workunit.client.0.smithi148.stdout:1/285: rmdir d2/d25 39 2024-02-28T16:26:35.391 INFO:tasks.workunit.client.0.smithi148.stdout:1/286: read d2/d5/d40/f16 [3591400,84683] 0 2024-02-28T16:26:35.393 INFO:tasks.workunit.client.0.smithi148.stdout:0/401: rename d1/d46/d4a/f6f to d1/d15/d3d/d67/f89 0 2024-02-28T16:26:35.394 INFO:tasks.workunit.client.0.smithi148.stdout:5/300: rmdir d1/d8/d23 39 2024-02-28T16:26:35.400 INFO:tasks.workunit.client.0.smithi148.stdout:3/430: mkdir d1/db/d45/d80 0 2024-02-28T16:26:35.401 INFO:tasks.workunit.client.0.smithi148.stdout:6/319: mkdir d0/d22/d27/d66 0 2024-02-28T16:26:35.405 INFO:tasks.workunit.client.0.smithi148.stdout:9/339: read d7/d1c/d74/f50 [12025,121627] 0 2024-02-28T16:26:35.405 INFO:tasks.workunit.client.0.smithi148.stdout:6/320: truncate d0/d22/f44 544493 0 2024-02-28T16:26:35.408 INFO:tasks.workunit.client.0.smithi148.stdout:6/321: chown d0/d22/c2a 15186 1 2024-02-28T16:26:35.408 INFO:tasks.workunit.client.0.smithi148.stdout:8/368: mkdir d1/dd/d13/d24/d3a/d49/d74 0 2024-02-28T16:26:35.408 INFO:tasks.workunit.client.0.smithi148.stdout:9/340: truncate d7/dd/d26/f4d 729823 0 2024-02-28T16:26:35.409 INFO:tasks.workunit.client.0.smithi148.stdout:6/322: stat d0/d22/f38 0 2024-02-28T16:26:35.410 INFO:tasks.workunit.client.0.smithi148.stdout:3/431: rename d1/d13/d19/d32/d41/c4b to d1/db/d45/c81 0 2024-02-28T16:26:35.411 INFO:tasks.workunit.client.0.smithi148.stdout:1/287: symlink d2/d3f/d46/l56 0 2024-02-28T16:26:35.413 INFO:tasks.workunit.client.0.smithi148.stdout:5/301: creat d1/d8/d20/d31/d50/f56 x:0 0 0 2024-02-28T16:26:35.416 INFO:tasks.workunit.client.0.smithi148.stdout:1/288: write d2/d5/d1a/f24 [4968203,17986] 0 2024-02-28T16:26:35.417 INFO:tasks.workunit.client.0.smithi148.stdout:7/328: dread d0/f1d [0,4194304] 0 2024-02-28T16:26:35.418 INFO:tasks.workunit.client.0.smithi148.stdout:0/402: mkdir d1/d8a 0 2024-02-28T16:26:35.419 INFO:tasks.workunit.client.0.smithi148.stdout:1/289: chown d2/d5/d40/d8/f3e 48 1 2024-02-28T16:26:35.421 INFO:tasks.workunit.client.0.smithi148.stdout:1/290: write d2/f51 [2668742,36939] 0 2024-02-28T16:26:35.421 INFO:tasks.workunit.client.0.smithi148.stdout:5/302: mknod d1/d8/d20/d31/d50/c57 0 2024-02-28T16:26:35.422 INFO:tasks.workunit.client.0.smithi148.stdout:0/403: dread d1/d46/f6b [0,4194304] 0 2024-02-28T16:26:35.427 INFO:tasks.workunit.client.0.smithi148.stdout:7/329: mkdir d0/d9/d25/d47/d28/d2b/d3a/d6a 0 2024-02-28T16:26:35.430 INFO:tasks.workunit.client.0.smithi148.stdout:6/323: creat d0/d8/f67 x:0 0 0 2024-02-28T16:26:35.432 INFO:tasks.workunit.client.0.smithi148.stdout:1/291: symlink d2/d15/d33/l57 0 2024-02-28T16:26:35.434 INFO:tasks.workunit.client.0.smithi148.stdout:3/432: dwrite d1/d13/d19/d1b/f1f [0,4194304] 0 2024-02-28T16:26:35.435 INFO:tasks.workunit.client.0.smithi148.stdout:8/369: dwrite d1/d3/d18/d48/d22/d55/f6a [0,4194304] 0 2024-02-28T16:26:35.439 INFO:tasks.workunit.client.0.smithi148.stdout:8/370: chown d1/dd/d54 9 1 2024-02-28T16:26:35.441 INFO:tasks.workunit.client.0.smithi148.stdout:3/433: creat d1/d13/d19/d1b/d38/f82 x:0 0 0 2024-02-28T16:26:35.442 INFO:tasks.workunit.client.0.smithi148.stdout:6/324: truncate d0/d22/d27/d3e/f45 393592 0 2024-02-28T16:26:35.444 INFO:tasks.workunit.client.0.smithi148.stdout:0/404: dwrite d1/d46/d4a/f5b [0,4194304] 0 2024-02-28T16:26:35.446 INFO:tasks.workunit.client.0.smithi148.stdout:1/292: symlink d2/d25/l58 0 2024-02-28T16:26:35.447 INFO:tasks.workunit.client.0.smithi148.stdout:7/330: rmdir d0/d9/d25/d47/d28/d2b/d3a 39 2024-02-28T16:26:35.448 INFO:tasks.workunit.client.0.smithi148.stdout:0/405: chown d1/f6 559 1 2024-02-28T16:26:35.449 INFO:tasks.workunit.client.0.smithi148.stdout:3/434: creat d1/db/d35/d70/d71/f83 x:0 0 0 2024-02-28T16:26:35.450 INFO:tasks.workunit.client.0.smithi148.stdout:1/293: truncate d2/d5/d40/f3d 1716837 0 2024-02-28T16:26:35.451 INFO:tasks.workunit.client.0.smithi148.stdout:3/435: write d1/db/f22 [841271,38509] 0 2024-02-28T16:26:35.452 INFO:tasks.workunit.client.0.smithi148.stdout:1/294: dread - d2/d15/d33/f49 zero size 2024-02-28T16:26:35.453 INFO:tasks.workunit.client.0.smithi148.stdout:0/406: rmdir d1 39 2024-02-28T16:26:35.454 INFO:tasks.workunit.client.0.smithi148.stdout:3/436: chown d1/db/d35/d70/d71/l72 131460861 1 2024-02-28T16:26:35.456 INFO:tasks.workunit.client.0.smithi148.stdout:7/331: creat d0/d9/d4c/f6b x:0 0 0 2024-02-28T16:26:35.458 INFO:tasks.workunit.client.0.smithi148.stdout:1/295: truncate d2/d5/d40/d7/f38 4280543 0 2024-02-28T16:26:35.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/332: stat d0/d4/f63 0 2024-02-28T16:26:35.460 INFO:tasks.workunit.client.0.smithi148.stdout:6/325: dread d0/d22/d27/f62 [0,4194304] 0 2024-02-28T16:26:35.462 INFO:tasks.workunit.client.0.smithi148.stdout:1/296: read d2/d5/d40/d7/f12 [4010569,14332] 0 2024-02-28T16:26:35.464 INFO:tasks.workunit.client.0.smithi148.stdout:6/326: chown d0/l40 685258 1 2024-02-28T16:26:35.466 INFO:tasks.workunit.client.0.smithi148.stdout:6/327: dread - d0/d8/f67 zero size 2024-02-28T16:26:35.469 INFO:tasks.workunit.client.0.smithi148.stdout:1/297: rmdir d2/d25 39 2024-02-28T16:26:35.469 INFO:tasks.workunit.client.0.smithi148.stdout:0/407: creat d1/d15/d27/d34/d5a/d71/d74/f8b x:0 0 0 2024-02-28T16:26:35.469 INFO:tasks.workunit.client.0.smithi148.stdout:6/328: write d0/d22/d25/f36 [8199851,114043] 0 2024-02-28T16:26:35.471 INFO:tasks.workunit.client.0.smithi148.stdout:1/298: fdatasync d2/d5/d40/d7/f47 0 2024-02-28T16:26:35.472 INFO:tasks.workunit.client.0.smithi148.stdout:6/329: stat d0/d22/d25/c46 0 2024-02-28T16:26:35.473 INFO:tasks.workunit.client.0.smithi148.stdout:3/437: dread d1/d13/d19/f28 [4194304,4194304] 0 2024-02-28T16:26:35.478 INFO:tasks.workunit.client.0.smithi148.stdout:1/299: symlink d2/l59 0 2024-02-28T16:26:35.478 INFO:tasks.workunit.client.0.smithi148.stdout:7/333: truncate d0/f13 994115 0 2024-02-28T16:26:35.480 INFO:tasks.workunit.client.0.smithi148.stdout:3/438: creat d1/db/d35/d70/d71/f84 x:0 0 0 2024-02-28T16:26:35.481 INFO:tasks.workunit.client.0.smithi148.stdout:1/300: creat d2/d5/d2b/d4a/f5a x:0 0 0 2024-02-28T16:26:35.484 INFO:tasks.workunit.client.0.smithi148.stdout:1/301: fsync d2/d5/d2b/d4a/f55 0 2024-02-28T16:26:35.484 INFO:tasks.workunit.client.0.smithi148.stdout:6/330: link d0/d22/c35 d0/c68 0 2024-02-28T16:26:35.485 INFO:tasks.workunit.client.0.smithi148.stdout:3/439: read d1/d13/f3b [917429,125294] 0 2024-02-28T16:26:35.486 INFO:tasks.workunit.client.0.smithi148.stdout:6/331: readlink d0/l40 0 2024-02-28T16:26:35.488 INFO:tasks.workunit.client.0.smithi148.stdout:3/440: rmdir d1/db/d35/d70 39 2024-02-28T16:26:35.489 INFO:tasks.workunit.client.0.smithi148.stdout:7/334: dread d0/f1d [0,4194304] 0 2024-02-28T16:26:35.490 INFO:tasks.workunit.client.0.smithi148.stdout:1/302: read d2/d5/d40/d8/f36 [475730,89920] 0 2024-02-28T16:26:35.491 INFO:tasks.workunit.client.0.smithi148.stdout:6/332: mknod d0/d22/d27/d3e/d52/c69 0 2024-02-28T16:26:35.495 INFO:tasks.workunit.client.0.smithi148.stdout:3/441: rename d1/d13/d19/d32/c3d to d1/d13/d19/d32/d41/c85 0 2024-02-28T16:26:35.496 INFO:tasks.workunit.client.0.smithi148.stdout:3/442: readlink d1/d13/d19/l4c 0 2024-02-28T16:26:35.499 INFO:tasks.workunit.client.0.smithi148.stdout:3/443: write d1/db/d35/f6b [273429,79264] 0 2024-02-28T16:26:35.501 INFO:tasks.workunit.client.0.smithi148.stdout:6/333: getdents d0/d4/d14 0 2024-02-28T16:26:35.502 INFO:tasks.workunit.client.0.smithi148.stdout:3/444: unlink d1/c36 0 2024-02-28T16:26:35.511 INFO:tasks.workunit.client.0.smithi148.stdout:5/303: read d1/d8/d23/f2d [3097007,30114] 0 2024-02-28T16:26:35.515 INFO:tasks.workunit.client.0.smithi148.stdout:5/304: symlink d1/l58 0 2024-02-28T16:26:35.518 INFO:tasks.workunit.client.0.smithi148.stdout:5/305: write d1/d8/d20/f46 [667301,13743] 0 2024-02-28T16:26:35.520 INFO:tasks.workunit.client.0.smithi148.stdout:3/445: dread d1/d13/d19/f79 [0,4194304] 0 2024-02-28T16:26:35.522 INFO:tasks.workunit.client.0.smithi148.stdout:3/446: write d1/d13/f17 [1338310,107009] 0 2024-02-28T16:26:35.522 INFO:tasks.workunit.client.0.smithi148.stdout:5/306: creat d1/d44/f59 x:0 0 0 2024-02-28T16:26:35.523 INFO:tasks.workunit.client.0.smithi148.stdout:2/295: sync 2024-02-28T16:26:35.524 INFO:tasks.workunit.client.0.smithi148.stdout:3/447: read d1/d13/d19/d1b/f1f [2204047,63549] 0 2024-02-28T16:26:35.525 INFO:tasks.workunit.client.0.smithi148.stdout:1/303: write d2/d5/d40/d8/f9 [6536521,88065] 0 2024-02-28T16:26:35.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/296: write d0/d18/f28 [1824542,105378] 0 2024-02-28T16:26:35.528 INFO:tasks.workunit.client.0.smithi148.stdout:7/335: truncate d0/d9/d25/d47/f58 1941957 0 2024-02-28T16:26:35.529 INFO:tasks.workunit.client.0.smithi148.stdout:1/304: readlink d2/d15/d33/l44 0 2024-02-28T16:26:35.532 INFO:tasks.workunit.client.0.smithi148.stdout:6/334: truncate d0/d4/d1b/f47 6858000 0 2024-02-28T16:26:35.536 INFO:tasks.workunit.client.0.smithi148.stdout:7/336: write d0/d9/d25/d47/f41 [327310,17872] 0 2024-02-28T16:26:35.536 INFO:tasks.workunit.client.0.smithi148.stdout:1/305: unlink d2/d5/d40/d8/f3e 0 2024-02-28T16:26:35.539 INFO:tasks.workunit.client.0.smithi148.stdout:1/306: chown d2/d5/d40/d7 44302285 1 2024-02-28T16:26:35.541 INFO:tasks.workunit.client.0.smithi148.stdout:6/335: rmdir d0/d8 39 2024-02-28T16:26:35.545 INFO:tasks.workunit.client.0.smithi148.stdout:1/307: chown d2/d5/d2b/d4a 919142882 1 2024-02-28T16:26:35.546 INFO:tasks.workunit.client.0.smithi148.stdout:5/307: dwrite d1/db/d25/f3a [0,4194304] 0 2024-02-28T16:26:35.546 INFO:tasks.workunit.client.0.smithi148.stdout:6/336: chown d0/d10/f13 2 1 2024-02-28T16:26:35.548 INFO:tasks.workunit.client.0.smithi148.stdout:3/448: dread d1/d13/d19/f28 [4194304,4194304] 0 2024-02-28T16:26:35.552 INFO:tasks.workunit.client.0.smithi148.stdout:5/308: fdatasync d1/db/f27 0 2024-02-28T16:26:35.556 INFO:tasks.workunit.client.0.smithi148.stdout:7/337: rename d0/l38 to d0/d9/d25/d47/d28/d2b/d3a/d49/l6c 0 2024-02-28T16:26:35.558 INFO:tasks.workunit.client.0.smithi148.stdout:2/297: dwrite d0/d9/f21 [0,4194304] 0 2024-02-28T16:26:35.558 INFO:tasks.workunit.client.0.smithi148.stdout:6/337: mknod d0/d22/d49/c6a 0 2024-02-28T16:26:35.565 INFO:tasks.workunit.client.0.smithi148.stdout:5/309: rmdir d1/db 39 2024-02-28T16:26:35.572 INFO:tasks.workunit.client.0.smithi148.stdout:3/449: symlink d1/db/d35/d70/l86 0 2024-02-28T16:26:35.575 INFO:tasks.workunit.client.0.smithi148.stdout:5/310: fdatasync d1/db/f27 0 2024-02-28T16:26:35.576 INFO:tasks.workunit.client.0.smithi148.stdout:3/450: fsync d1/d13/d19/d1b/f74 0 2024-02-28T16:26:35.578 INFO:tasks.workunit.client.0.smithi148.stdout:2/298: link d0/dd/d2b/f31 d0/d1d/f5c 0 2024-02-28T16:26:35.579 INFO:tasks.workunit.client.0.smithi148.stdout:7/338: dread d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:35.579 INFO:tasks.workunit.client.0.smithi148.stdout:6/338: unlink d0/d8/c2b 0 2024-02-28T16:26:35.581 INFO:tasks.workunit.client.0.smithi148.stdout:5/311: symlink d1/d44/l5a 0 2024-02-28T16:26:35.582 INFO:tasks.workunit.client.0.smithi148.stdout:3/451: truncate d1/db/d35/d52/f54 48963 0 2024-02-28T16:26:35.584 INFO:tasks.workunit.client.0.smithi148.stdout:2/299: mkdir d0/d18/d20/d5d 0 2024-02-28T16:26:35.584 INFO:tasks.workunit.client.0.smithi148.stdout:7/339: write d0/d9/d25/d47/d28/d2b/d3a/d49/f51 [855947,45714] 0 2024-02-28T16:26:35.586 INFO:tasks.workunit.client.0.smithi148.stdout:6/339: creat d0/d22/d49/f6b x:0 0 0 2024-02-28T16:26:35.587 INFO:tasks.workunit.client.0.smithi148.stdout:7/340: read d0/d9/d25/f42 [2823927,46310] 0 2024-02-28T16:26:35.588 INFO:tasks.workunit.client.0.smithi148.stdout:5/312: chown d1/d1a/c21 53156 1 2024-02-28T16:26:35.588 INFO:tasks.workunit.client.0.smithi148.stdout:3/452: write d1/f7b [1657334,103991] 0 2024-02-28T16:26:35.591 INFO:tasks.workunit.client.0.smithi148.stdout:2/300: rename d0/f24 to d0/dd/f5e 0 2024-02-28T16:26:35.591 INFO:tasks.workunit.client.0.smithi148.stdout:7/341: write d0/d9/d1b/f62 [364722,109844] 0 2024-02-28T16:26:35.595 INFO:tasks.workunit.client.0.smithi148.stdout:5/313: truncate d1/d8/d20/d31/f40 802697 0 2024-02-28T16:26:35.595 INFO:tasks.workunit.client.0.smithi148.stdout:1/308: truncate d2/d15/f30 1565792 0 2024-02-28T16:26:35.598 INFO:tasks.workunit.client.0.smithi148.stdout:2/301: creat d0/d1c/f5f x:0 0 0 2024-02-28T16:26:35.599 INFO:tasks.workunit.client.0.smithi148.stdout:5/314: write d1/db/f27 [367150,117143] 0 2024-02-28T16:26:35.599 INFO:tasks.workunit.client.0.smithi148.stdout:7/342: stat d0/d9/d25/d47/f68 0 2024-02-28T16:26:35.601 INFO:tasks.workunit.client.0.smithi148.stdout:2/302: rmdir d0/dd 39 2024-02-28T16:26:35.602 INFO:tasks.workunit.client.0.smithi148.stdout:2/303: chown d0/f27 989283 1 2024-02-28T16:26:35.608 INFO:tasks.workunit.client.0.smithi148.stdout:3/453: dread d1/d13/f17 [0,4194304] 0 2024-02-28T16:26:35.610 INFO:tasks.workunit.client.0.smithi148.stdout:2/304: getdents d0/dd/d2b/d36 0 2024-02-28T16:26:35.611 INFO:tasks.workunit.client.0.smithi148.stdout:3/454: rmdir d1/db/d35/d52 39 2024-02-28T16:26:35.613 INFO:tasks.workunit.client.0.smithi148.stdout:2/305: mknod d0/dd/c60 0 2024-02-28T16:26:35.677 INFO:tasks.workunit.client.0.smithi148.stdout:7/343: truncate d0/d9/d25/d47/f58 1357142 0 2024-02-28T16:26:35.677 INFO:tasks.workunit.client.0.smithi148.stdout:1/309: rmdir d2/d15 39 2024-02-28T16:26:35.678 INFO:tasks.workunit.client.0.smithi148.stdout:3/455: write d1/d13/d19/f28 [3805387,15133] 0 2024-02-28T16:26:35.679 INFO:tasks.workunit.client.0.smithi148.stdout:6/340: truncate d0/d22/d25/f36 4929826 0 2024-02-28T16:26:35.681 INFO:tasks.workunit.client.0.smithi148.stdout:2/306: mknod d0/dd/c61 0 2024-02-28T16:26:35.683 INFO:tasks.workunit.client.0.smithi148.stdout:3/456: truncate d1/d13/f78 64653 0 2024-02-28T16:26:35.685 INFO:tasks.workunit.client.0.smithi148.stdout:7/344: chown d0/d9/d25/d47/l33 0 1 2024-02-28T16:26:35.686 INFO:tasks.workunit.client.0.smithi148.stdout:1/310: mknod d2/d5/d1a/c5b 0 2024-02-28T16:26:35.688 INFO:tasks.workunit.client.0.smithi148.stdout:6/341: chown d0/d22/d27/l5e 17801 1 2024-02-28T16:26:35.688 INFO:tasks.workunit.client.0.smithi148.stdout:1/311: chown d2/d5/d40/d7 176 1 2024-02-28T16:26:35.690 INFO:tasks.workunit.client.0.smithi148.stdout:1/312: chown d2/d5/d1a/c5b 618 1 2024-02-28T16:26:35.691 INFO:tasks.workunit.client.0.smithi148.stdout:3/457: creat d1/db/d35/d70/f87 x:0 0 0 2024-02-28T16:26:35.693 INFO:tasks.workunit.client.0.smithi148.stdout:7/345: creat d0/d9/d25/d47/d28/d2b/d3a/d49/f6d x:0 0 0 2024-02-28T16:26:35.693 INFO:tasks.workunit.client.0.smithi148.stdout:3/458: write d1/d13/d19/d1b/f44 [1198192,48257] 0 2024-02-28T16:26:35.696 INFO:tasks.workunit.client.0.smithi148.stdout:2/307: dwrite d0/d1c/f4e [0,4194304] 0 2024-02-28T16:26:35.699 INFO:tasks.workunit.client.0.smithi148.stdout:3/459: mkdir d1/d13/d19/d88 0 2024-02-28T16:26:35.701 INFO:tasks.workunit.client.0.smithi148.stdout:6/342: creat d0/d8/f6c x:0 0 0 2024-02-28T16:26:35.703 INFO:tasks.workunit.client.0.smithi148.stdout:2/308: read d0/d18/d20/f51 [123243,60239] 0 2024-02-28T16:26:35.723 INFO:tasks.workunit.client.0.smithi148.stdout:3/460: dread d1/db/d45/f4d [0,4194304] 0 2024-02-28T16:26:35.725 INFO:tasks.workunit.client.0.smithi148.stdout:3/461: chown d1/d13/d19/d88 501 1 2024-02-28T16:26:35.731 INFO:tasks.workunit.client.0.smithi148.stdout:3/462: write d1/d13/d19/d1b/f1f [2982765,23325] 0 2024-02-28T16:26:35.736 INFO:tasks.workunit.client.0.smithi148.stdout:2/309: dread d0/dd/d2b/f31 [0,4194304] 0 2024-02-28T16:26:35.737 INFO:tasks.workunit.client.0.smithi148.stdout:3/463: dread d1/db/d35/d52/f54 [0,4194304] 0 2024-02-28T16:26:35.747 INFO:tasks.workunit.client.0.smithi148.stdout:3/464: fdatasync d1/d13/d19/d1b/f5c 0 2024-02-28T16:26:35.751 INFO:tasks.workunit.client.0.smithi148.stdout:3/465: chown d1/db/d35/d70/d71/f84 1634695 1 2024-02-28T16:26:35.755 INFO:tasks.workunit.client.0.smithi148.stdout:4/262: sync 2024-02-28T16:26:35.755 INFO:tasks.workunit.client.0.smithi148.stdout:7/346: dwrite d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:35.758 INFO:tasks.workunit.client.0.smithi148.stdout:3/466: mkdir d1/db/d89 0 2024-02-28T16:26:35.760 INFO:tasks.workunit.client.0.smithi148.stdout:3/467: fdatasync d1/db/f65 0 2024-02-28T16:26:35.761 INFO:tasks.workunit.client.0.smithi148.stdout:3/468: fdatasync d1/d3f/f7f 0 2024-02-28T16:26:35.762 INFO:tasks.workunit.client.0.smithi148.stdout:2/310: write d0/dd/d2b/f31 [4725779,48962] 0 2024-02-28T16:26:35.764 INFO:tasks.workunit.client.0.smithi148.stdout:4/263: mkdir d8/df/d5f 0 2024-02-28T16:26:35.768 INFO:tasks.workunit.client.0.smithi148.stdout:7/347: link d0/d9/d25/d47/f41 d0/d9/d46/f6e 0 2024-02-28T16:26:35.770 INFO:tasks.workunit.client.0.smithi148.stdout:2/311: getdents d0/d1d/d55 0 2024-02-28T16:26:35.770 INFO:tasks.workunit.client.0.smithi148.stdout:3/469: dread d1/d13/d19/d56/d5b/f68 [0,4194304] 0 2024-02-28T16:26:35.772 INFO:tasks.workunit.client.0.smithi148.stdout:2/312: rmdir d0/d18 39 2024-02-28T16:26:35.772 INFO:tasks.workunit.client.0.smithi148.stdout:7/348: chown d0/d9/d25/d47/d1c/f31 215775638 1 2024-02-28T16:26:35.772 INFO:tasks.workunit.client.0.smithi148.stdout:3/470: fsync d1/d13/d19/d1b/f1f 0 2024-02-28T16:26:35.776 INFO:tasks.workunit.client.0.smithi148.stdout:2/313: mknod d0/d1d/d55/c62 0 2024-02-28T16:26:35.781 INFO:tasks.workunit.client.0.smithi148.stdout:4/264: dwrite d8/f12 [4194304,4194304] 0 2024-02-28T16:26:35.782 INFO:tasks.workunit.client.0.smithi148.stdout:4/265: dread - d8/d40/f41 zero size 2024-02-28T16:26:35.784 INFO:tasks.workunit.client.0.smithi148.stdout:3/471: link d1/d13/f1e d1/d13/d19/d1b/d38/f8a 0 2024-02-28T16:26:35.787 INFO:tasks.workunit.client.0.smithi148.stdout:7/349: getdents d0/d9/d25/d47/d28/d2b 0 2024-02-28T16:26:35.788 INFO:tasks.workunit.client.0.smithi148.stdout:2/314: creat d0/d1d/d52/d54/f63 x:0 0 0 2024-02-28T16:26:35.790 INFO:tasks.workunit.client.0.smithi148.stdout:3/472: creat d1/db/d45/f8b x:0 0 0 2024-02-28T16:26:35.792 INFO:tasks.workunit.client.0.smithi148.stdout:4/266: creat d8/d21/d3d/d4d/f60 x:0 0 0 2024-02-28T16:26:35.793 INFO:tasks.workunit.client.0.smithi148.stdout:7/350: mkdir d0/d9/d25/d47/d28/d2b/d6f 0 2024-02-28T16:26:35.794 INFO:tasks.workunit.client.0.smithi148.stdout:4/267: chown d8/df/l31 0 1 2024-02-28T16:26:35.795 INFO:tasks.workunit.client.0.smithi148.stdout:3/473: rmdir d1/db/d35/d70 39 2024-02-28T16:26:35.795 INFO:tasks.workunit.client.0.smithi148.stdout:4/268: write d8/d40/f41 [328564,52036] 0 2024-02-28T16:26:35.797 INFO:tasks.workunit.client.0.smithi148.stdout:7/351: chown d0/c45 362 1 2024-02-28T16:26:35.800 INFO:tasks.workunit.client.0.smithi148.stdout:2/315: creat d0/d9/f64 x:0 0 0 2024-02-28T16:26:35.800 INFO:tasks.workunit.client.0.smithi148.stdout:4/269: symlink d8/df/d17/l61 0 2024-02-28T16:26:35.801 INFO:tasks.workunit.client.0.smithi148.stdout:2/316: chown d0/d1c/d49 98 1 2024-02-28T16:26:35.802 INFO:tasks.workunit.client.0.smithi148.stdout:4/270: rename d8 to d8/d21/d3d/d62 22 2024-02-28T16:26:35.809 INFO:tasks.workunit.client.0.smithi148.stdout:4/271: unlink d8/d35/f38 0 2024-02-28T16:26:35.811 INFO:tasks.workunit.client.0.smithi148.stdout:4/272: truncate d8/df/d1f/f42 1608305 0 2024-02-28T16:26:35.822 INFO:tasks.workunit.client.0.smithi148.stdout:2/317: dread d0/dd/f40 [0,4194304] 0 2024-02-28T16:26:35.824 INFO:tasks.workunit.client.0.smithi148.stdout:2/318: read - d0/d1c/f5f zero size 2024-02-28T16:26:35.828 INFO:tasks.workunit.client.0.smithi148.stdout:3/474: truncate d1/d13/f21 2308207 0 2024-02-28T16:26:35.830 INFO:tasks.workunit.client.0.smithi148.stdout:7/352: write d0/d9/d25/d47/f27 [4065654,42175] 0 2024-02-28T16:26:35.831 INFO:tasks.workunit.client.0.smithi148.stdout:2/319: write d0/d18/d20/f51 [408189,49518] 0 2024-02-28T16:26:35.832 INFO:tasks.workunit.client.0.smithi148.stdout:4/273: dread d8/d21/d3d/d4d/f58 [0,4194304] 0 2024-02-28T16:26:35.834 INFO:tasks.workunit.client.0.smithi148.stdout:7/353: write d0/f36 [1287267,54553] 0 2024-02-28T16:26:35.836 INFO:tasks.workunit.client.0.smithi148.stdout:4/274: write d8/d21/f54 [3136873,40492] 0 2024-02-28T16:26:35.837 INFO:tasks.workunit.client.0.smithi148.stdout:2/320: mknod d0/d9/c65 0 2024-02-28T16:26:35.838 INFO:tasks.workunit.client.0.smithi148.stdout:7/354: dread - d0/d9/d25/d47/d1c/f31 zero size 2024-02-28T16:26:35.839 INFO:tasks.workunit.client.0.smithi148.stdout:2/321: stat d0/d18/c44 0 2024-02-28T16:26:35.839 INFO:tasks.workunit.client.0.smithi148.stdout:4/275: fdatasync d8/f22 0 2024-02-28T16:26:35.842 INFO:tasks.workunit.client.0.smithi148.stdout:7/355: mkdir d0/d4/d70 0 2024-02-28T16:26:35.843 INFO:tasks.workunit.client.0.smithi148.stdout:4/276: write d8/d21/d3d/d4d/f4e [679872,72881] 0 2024-02-28T16:26:35.845 INFO:tasks.workunit.client.0.smithi148.stdout:3/475: dread d1/db/f22 [0,4194304] 0 2024-02-28T16:26:35.847 INFO:tasks.workunit.client.0.smithi148.stdout:4/277: write d8/df/d1f/f3c [372248,34170] 0 2024-02-28T16:26:35.848 INFO:tasks.workunit.client.0.smithi148.stdout:2/322: mkdir d0/d66 0 2024-02-28T16:26:35.851 INFO:tasks.workunit.client.0.smithi148.stdout:4/278: chown d8/df/d1f/c2e 24 1 2024-02-28T16:26:35.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/476: chown d1/c7 0 1 2024-02-28T16:26:35.852 INFO:tasks.workunit.client.0.smithi148.stdout:7/356: creat d0/f71 x:0 0 0 2024-02-28T16:26:35.858 INFO:tasks.workunit.client.0.smithi148.stdout:3/477: stat d1/db/d35/d70/d71/f84 0 2024-02-28T16:26:35.861 INFO:tasks.workunit.client.0.smithi148.stdout:7/357: unlink d0/f7 0 2024-02-28T16:26:35.865 INFO:tasks.workunit.client.0.smithi148.stdout:2/323: dwrite d0/f27 [0,4194304] 0 2024-02-28T16:26:35.868 INFO:tasks.workunit.client.0.smithi148.stdout:7/358: dread d0/d9/d1b/f62 [0,4194304] 0 2024-02-28T16:26:35.870 INFO:tasks.workunit.client.0.smithi148.stdout:7/359: fsync d0/d18/f2a 0 2024-02-28T16:26:35.875 INFO:tasks.workunit.client.0.smithi148.stdout:2/324: rename d0/d18/d20/f51 to d0/d1d/d55/f67 0 2024-02-28T16:26:35.876 INFO:tasks.workunit.client.0.smithi148.stdout:4/279: dwrite d8/df/d1f/f42 [0,4194304] 0 2024-02-28T16:26:35.878 INFO:tasks.workunit.client.0.smithi148.stdout:2/325: chown d0/dd/c61 276184114 1 2024-02-28T16:26:35.879 INFO:tasks.workunit.client.0.smithi148.stdout:7/360: chown d0/d9/d25/d47/d28/d2b/d5c 107977319 1 2024-02-28T16:26:35.881 INFO:tasks.workunit.client.0.smithi148.stdout:2/326: dread - d0/d18/d20/f50 zero size 2024-02-28T16:26:35.882 INFO:tasks.workunit.client.0.smithi148.stdout:3/478: dwrite d1/d13/d19/d1b/d38/f82 [0,4194304] 0 2024-02-28T16:26:35.883 INFO:tasks.workunit.client.0.smithi148.stdout:7/361: write d0/f71 [672958,34402] 0 2024-02-28T16:26:35.884 INFO:tasks.workunit.client.0.smithi148.stdout:4/280: dread d8/df/d1f/f3c [0,4194304] 0 2024-02-28T16:26:35.886 INFO:tasks.workunit.client.0.smithi148.stdout:4/281: dread - d8/d21/f30 zero size 2024-02-28T16:26:35.899 INFO:tasks.workunit.client.0.smithi148.stdout:3/479: dread d1/d13/d19/d1b/d38/f43 [0,4194304] 0 2024-02-28T16:26:35.901 INFO:tasks.workunit.client.0.smithi148.stdout:3/480: truncate d1/d3f/f77 106153 0 2024-02-28T16:26:35.906 INFO:tasks.workunit.client.0.smithi148.stdout:4/282: truncate d8/f11 1269252 0 2024-02-28T16:26:35.908 INFO:tasks.workunit.client.0.smithi148.stdout:4/283: write d8/df/d1f/f42 [3239597,13316] 0 2024-02-28T16:26:35.909 INFO:tasks.workunit.client.0.smithi148.stdout:7/362: write d0/f1d [1225177,99882] 0 2024-02-28T16:26:35.910 INFO:tasks.workunit.client.0.smithi148.stdout:4/284: chown d8/df/d17/l61 190537478 1 2024-02-28T16:26:35.913 INFO:tasks.workunit.client.0.smithi148.stdout:2/327: link d0/d9/c4c d0/c68 0 2024-02-28T16:26:35.913 INFO:tasks.workunit.client.0.smithi148.stdout:4/285: write d8/d40/f53 [344963,39000] 0 2024-02-28T16:26:35.913 INFO:tasks.workunit.client.0.smithi148.stdout:8/371: sync 2024-02-28T16:26:35.914 INFO:tasks.workunit.client.0.smithi148.stdout:9/341: sync 2024-02-28T16:26:35.916 INFO:tasks.workunit.client.0.smithi148.stdout:4/286: fsync d8/d21/d3d/f4c 0 2024-02-28T16:26:35.917 INFO:tasks.workunit.client.0.smithi148.stdout:2/328: write d0/d18/d20/f50 [87447,51016] 0 2024-02-28T16:26:35.918 INFO:tasks.workunit.client.0.smithi148.stdout:4/287: readlink d8/d37/l44 0 2024-02-28T16:26:35.918 INFO:tasks.workunit.client.0.smithi148.stdout:3/481: creat d1/d13/d19/d88/f8c x:0 0 0 2024-02-28T16:26:35.922 INFO:tasks.workunit.client.0.smithi148.stdout:2/329: dread d0/d1d/d55/f67 [0,4194304] 0 2024-02-28T16:26:35.923 INFO:tasks.workunit.client.0.smithi148.stdout:8/372: mkdir d1/d3/d18/d48/d70/d75 0 2024-02-28T16:26:35.926 INFO:tasks.workunit.client.0.smithi148.stdout:4/288: write d8/df/f1b [492532,70476] 0 2024-02-28T16:26:35.928 INFO:tasks.workunit.client.0.smithi148.stdout:4/289: chown d8/d35/f49 209737839 1 2024-02-28T16:26:35.930 INFO:tasks.workunit.client.0.smithi148.stdout:8/373: fsync d1/dd/d13/d1a/f3e 0 2024-02-28T16:26:35.931 INFO:tasks.workunit.client.0.smithi148.stdout:4/290: chown d8/df/d1f/f4b 8212680 1 2024-02-28T16:26:35.932 INFO:tasks.workunit.client.0.smithi148.stdout:9/342: getdents d7/d1c/d74 0 2024-02-28T16:26:35.936 INFO:tasks.workunit.client.0.smithi148.stdout:7/363: fsync d0/d9/d25/d47/f29 0 2024-02-28T16:26:35.936 INFO:tasks.workunit.client.0.smithi148.stdout:8/374: symlink d1/dd/d13/d24/d3a/d49/l76 0 2024-02-28T16:26:35.939 INFO:tasks.workunit.client.0.smithi148.stdout:9/343: mkdir d7/d1c/d32/d24/d78 0 2024-02-28T16:26:35.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/375: mkdir d1/dd/d51/d77 0 2024-02-28T16:26:35.943 INFO:tasks.workunit.client.0.smithi148.stdout:9/344: stat d7/dd/d26/c71 0 2024-02-28T16:26:35.945 INFO:tasks.workunit.client.0.smithi148.stdout:3/482: dwrite d1/d13/f17 [4194304,4194304] 0 2024-02-28T16:26:35.948 INFO:tasks.workunit.client.0.smithi148.stdout:7/364: chown d0/d9/d25/d47/d1c/f23 17373 1 2024-02-28T16:26:35.948 INFO:tasks.workunit.client.0.smithi148.stdout:2/330: dwrite d0/d1d/f34 [0,4194304] 0 2024-02-28T16:26:35.952 INFO:tasks.workunit.client.0.smithi148.stdout:3/483: chown d1/d13/d19/d1b/d38/c5d 113198 1 2024-02-28T16:26:35.953 INFO:tasks.workunit.client.0.smithi148.stdout:3/484: read d1/db/f22 [770100,114256] 0 2024-02-28T16:26:35.957 INFO:tasks.workunit.client.0.smithi148.stdout:4/291: dwrite d8/df/f4a [0,4194304] 0 2024-02-28T16:26:35.960 INFO:tasks.workunit.client.0.smithi148.stdout:0/408: sync 2024-02-28T16:26:35.962 INFO:tasks.workunit.client.0.smithi148.stdout:9/345: rename d7/dd/l67 to d7/d1c/d1f/d49/d5c/l79 0 2024-02-28T16:26:35.964 INFO:tasks.workunit.client.0.smithi148.stdout:0/409: write d1/d4/f33 [517619,84548] 0 2024-02-28T16:26:35.971 INFO:tasks.workunit.client.0.smithi148.stdout:4/292: mknod d8/d40/c63 0 2024-02-28T16:26:35.978 INFO:tasks.workunit.client.0.smithi148.stdout:9/346: readlink d7/l9 0 2024-02-28T16:26:35.979 INFO:tasks.workunit.client.0.smithi148.stdout:0/410: rmdir d1/d15/d27/d34/d5a/d6c 39 2024-02-28T16:26:35.980 INFO:tasks.workunit.client.0.smithi148.stdout:8/376: link d1/dd/d13/d68/l63 d1/dd/d51/d77/l78 0 2024-02-28T16:26:35.980 INFO:tasks.workunit.client.0.smithi148.stdout:7/365: dwrite d0/d9/d25/d47/d28/d2b/d3a/f5b [0,4194304] 0 2024-02-28T16:26:35.990 INFO:tasks.workunit.client.0.smithi148.stdout:2/331: rename d0/d18/d20/c48 to d0/d9/d13/d38/d3a/c69 0 2024-02-28T16:26:35.994 INFO:tasks.workunit.client.0.smithi148.stdout:8/377: rmdir d1/dd/d13/d24/d3a 39 2024-02-28T16:26:35.995 INFO:tasks.workunit.client.0.smithi148.stdout:7/366: rmdir d0/d9/d25/d47/d28 39 2024-02-28T16:26:35.998 INFO:tasks.workunit.client.0.smithi148.stdout:7/367: dread - d0/d9/d4c/f6b zero size 2024-02-28T16:26:36.002 INFO:tasks.workunit.client.0.smithi148.stdout:2/332: rename d0 to d0/d9/d6a 22 2024-02-28T16:26:36.003 INFO:tasks.workunit.client.0.smithi148.stdout:0/411: truncate d1/f41 1664370 0 2024-02-28T16:26:36.004 INFO:tasks.workunit.client.0.smithi148.stdout:4/293: dwrite d8/f22 [0,4194304] 0 2024-02-28T16:26:36.007 INFO:tasks.workunit.client.0.smithi148.stdout:2/333: truncate d0/d1c/f5f 121003 0 2024-02-28T16:26:36.010 INFO:tasks.workunit.client.0.smithi148.stdout:2/334: fsync d0/dd/d2b/f31 0 2024-02-28T16:26:36.011 INFO:tasks.workunit.client.0.smithi148.stdout:4/294: creat d8/d21/d3d/f64 x:0 0 0 2024-02-28T16:26:36.013 INFO:tasks.workunit.client.0.smithi148.stdout:0/412: rename d1/d15/d27/d34/c72 to d1/d4/d25/c8c 0 2024-02-28T16:26:36.018 INFO:tasks.workunit.client.0.smithi148.stdout:4/295: write d8/df/f4a [1190605,88488] 0 2024-02-28T16:26:36.018 INFO:tasks.workunit.client.0.smithi148.stdout:8/378: dwrite d1/d3/d18/f5d [0,4194304] 0 2024-02-28T16:26:36.018 INFO:tasks.workunit.client.0.smithi148.stdout:2/335: write d0/d1c/f5f [211391,93994] 0 2024-02-28T16:26:36.019 INFO:tasks.workunit.client.0.smithi148.stdout:9/347: dread d7/d1c/f20 [0,4194304] 0 2024-02-28T16:26:36.020 INFO:tasks.workunit.client.0.smithi148.stdout:2/336: fdatasync d0/d18/f19 0 2024-02-28T16:26:36.022 INFO:tasks.workunit.client.0.smithi148.stdout:8/379: write d1/d3/f1e [366048,90729] 0 2024-02-28T16:26:36.024 INFO:tasks.workunit.client.0.smithi148.stdout:0/413: readlink d1/d15/d27/d34/d5a/l70 0 2024-02-28T16:26:36.026 INFO:tasks.workunit.client.0.smithi148.stdout:4/296: mknod d8/d37/c65 0 2024-02-28T16:26:36.026 INFO:tasks.workunit.client.0.smithi148.stdout:8/380: stat d1 0 2024-02-28T16:26:36.034 INFO:tasks.workunit.client.0.smithi148.stdout:0/414: chown d1/d15/d27/d7a/l5d 132019905 1 2024-02-28T16:26:36.035 INFO:tasks.workunit.client.0.smithi148.stdout:9/348: symlink d7/d1c/l7a 0 2024-02-28T16:26:36.036 INFO:tasks.workunit.client.0.smithi148.stdout:4/297: getdents d8/df/d5f 0 2024-02-28T16:26:36.038 INFO:tasks.workunit.client.0.smithi148.stdout:9/349: write d7/d1c/f20 [952619,27989] 0 2024-02-28T16:26:36.042 INFO:tasks.workunit.client.0.smithi148.stdout:9/350: stat d7/d1c/d3d/c64 0 2024-02-28T16:26:36.043 INFO:tasks.workunit.client.0.smithi148.stdout:2/337: dread d0/d1c/f4e [0,4194304] 0 2024-02-28T16:26:36.046 INFO:tasks.workunit.client.0.smithi148.stdout:2/338: write d0/d9/f21 [557953,50318] 0 2024-02-28T16:26:36.047 INFO:tasks.workunit.client.0.smithi148.stdout:4/298: dread d8/d21/d3d/d4d/f4e [0,4194304] 0 2024-02-28T16:26:36.051 INFO:tasks.workunit.client.0.smithi148.stdout:2/339: creat d0/d9/d13/d38/f6b x:0 0 0 2024-02-28T16:26:36.053 INFO:tasks.workunit.client.0.smithi148.stdout:9/351: rename d7/d1c/d1f/l55 to d7/d1c/d3d/l7b 0 2024-02-28T16:26:36.055 INFO:tasks.workunit.client.0.smithi148.stdout:2/340: mknod d0/d9/c6c 0 2024-02-28T16:26:36.059 INFO:tasks.workunit.client.0.smithi148.stdout:0/415: dread d1/d4/fe [0,4194304] 0 2024-02-28T16:26:36.059 INFO:tasks.workunit.client.0.smithi148.stdout:9/352: link d7/dd/c72 d7/dd/d26/c7c 0 2024-02-28T16:26:36.060 INFO:tasks.workunit.client.0.smithi148.stdout:2/341: truncate d0/d1d/d52/d54/f63 101878 0 2024-02-28T16:26:36.063 INFO:tasks.workunit.client.0.smithi148.stdout:2/342: symlink d0/dd/d2b/d36/l6d 0 2024-02-28T16:26:36.067 INFO:tasks.workunit.client.0.smithi148.stdout:2/343: dread d0/d18/d20/f33 [0,4194304] 0 2024-02-28T16:26:36.067 INFO:tasks.workunit.client.0.smithi148.stdout:9/353: symlink d7/d1c/d32/d24/d78/l7d 0 2024-02-28T16:26:36.070 INFO:tasks.workunit.client.0.smithi148.stdout:9/354: dread d7/f17 [0,4194304] 0 2024-02-28T16:26:36.074 INFO:tasks.workunit.client.0.smithi148.stdout:4/299: dread d8/df/f20 [0,4194304] 0 2024-02-28T16:26:36.077 INFO:tasks.workunit.client.0.smithi148.stdout:0/416: dwrite d1/d4/f3c [0,4194304] 0 2024-02-28T16:26:36.079 INFO:tasks.workunit.client.0.smithi148.stdout:4/300: mkdir d8/d21/d3d/d4d/d66 0 2024-02-28T16:26:36.086 INFO:tasks.workunit.client.0.smithi148.stdout:2/344: dwrite d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:36.095 INFO:tasks.workunit.client.0.smithi148.stdout:0/417: dwrite d1/d15/d8/f29 [0,4194304] 0 2024-02-28T16:26:36.103 INFO:tasks.workunit.client.0.smithi148.stdout:4/301: truncate d8/f14 3967976 0 2024-02-28T16:26:36.106 INFO:tasks.workunit.client.0.smithi148.stdout:2/345: dwrite d0/dd/d2b/f31 [0,4194304] 0 2024-02-28T16:26:36.111 INFO:tasks.workunit.client.0.smithi148.stdout:2/346: read - d0/d9/d13/d38/f3e zero size 2024-02-28T16:26:36.112 INFO:tasks.workunit.client.0.smithi148.stdout:9/355: dwrite d7/d1c/d74/f50 [0,4194304] 0 2024-02-28T16:26:36.113 INFO:tasks.workunit.client.0.smithi148.stdout:2/347: chown d0/d18/d20 149 1 2024-02-28T16:26:36.119 INFO:tasks.workunit.client.0.smithi148.stdout:9/356: mkdir d7/d1c/d1f/d7e 0 2024-02-28T16:26:36.123 INFO:tasks.workunit.client.0.smithi148.stdout:2/348: mkdir d0/d1c/d6e 0 2024-02-28T16:26:36.128 INFO:tasks.workunit.client.0.smithi148.stdout:9/357: mknod d7/d1c/d1f/d49/d6a/c7f 0 2024-02-28T16:26:36.130 INFO:tasks.workunit.client.0.smithi148.stdout:2/349: mknod d0/dd/c6f 0 2024-02-28T16:26:36.133 INFO:tasks.workunit.client.0.smithi148.stdout:2/350: truncate d0/d18/d20/f50 1168855 0 2024-02-28T16:26:36.134 INFO:tasks.workunit.client.0.smithi148.stdout:9/358: chown d7/dd/d26/l29 3 1 2024-02-28T16:26:36.138 INFO:tasks.workunit.client.0.smithi148.stdout:2/351: write d0/d18/d20/d46/f53 [1007996,102288] 0 2024-02-28T16:26:36.141 INFO:tasks.workunit.client.0.smithi148.stdout:9/359: mknod d7/d1c/d32/d24/d78/c80 0 2024-02-28T16:26:36.141 INFO:tasks.workunit.client.0.smithi148.stdout:4/302: dwrite d8/d21/d3d/d4d/f58 [0,4194304] 0 2024-02-28T16:26:36.142 INFO:tasks.workunit.client.0.smithi148.stdout:2/352: creat d0/d1d/f70 x:0 0 0 2024-02-28T16:26:36.143 INFO:tasks.workunit.client.0.smithi148.stdout:9/360: fdatasync d7/d1c/d1f/d49/f4c 0 2024-02-28T16:26:36.145 INFO:tasks.workunit.client.0.smithi148.stdout:4/303: write d8/df/d1f/f42 [2464601,80239] 0 2024-02-28T16:26:36.153 INFO:tasks.workunit.client.0.smithi148.stdout:4/304: rename d8/d40/f53 to d8/d21/f67 0 2024-02-28T16:26:36.154 INFO:tasks.workunit.client.0.smithi148.stdout:2/353: dread d0/d18/d20/f50 [0,4194304] 0 2024-02-28T16:26:36.156 INFO:tasks.workunit.client.0.smithi148.stdout:0/418: dread d1/d4/f60 [0,4194304] 0 2024-02-28T16:26:36.157 INFO:tasks.workunit.client.0.smithi148.stdout:4/305: creat d8/d21/f68 x:0 0 0 2024-02-28T16:26:36.158 INFO:tasks.workunit.client.0.smithi148.stdout:2/354: rename d0/d1c/l29 to d0/d1c/d6e/l71 0 2024-02-28T16:26:36.160 INFO:tasks.workunit.client.0.smithi148.stdout:2/355: read d0/f27 [4112107,105387] 0 2024-02-28T16:26:36.162 INFO:tasks.workunit.client.0.smithi148.stdout:4/306: unlink d8/l1a 0 2024-02-28T16:26:36.165 INFO:tasks.workunit.client.0.smithi148.stdout:2/356: rmdir d0/d1d/d52/d54 39 2024-02-28T16:26:36.168 INFO:tasks.workunit.client.0.smithi148.stdout:2/357: fsync d0/dd/f5e 0 2024-02-28T16:26:36.173 INFO:tasks.workunit.client.0.smithi148.stdout:4/307: rename d8/d40/f41 to d8/f69 0 2024-02-28T16:26:36.177 INFO:tasks.workunit.client.0.smithi148.stdout:2/358: rename d0/d9/d13/d38/d3a/l58 to d0/dd/d2b/d36/l72 0 2024-02-28T16:26:36.180 INFO:tasks.workunit.client.0.smithi148.stdout:4/308: rename d8/d35 to d8/df/d17/d6a 0 2024-02-28T16:26:36.181 INFO:tasks.workunit.client.0.smithi148.stdout:2/359: mkdir d0/d18/d20/d73 0 2024-02-28T16:26:36.182 INFO:tasks.workunit.client.0.smithi148.stdout:2/360: chown d0/d1c 869 1 2024-02-28T16:26:36.182 INFO:tasks.workunit.client.0.smithi148.stdout:4/309: write d8/d21/f30 [18819,122339] 0 2024-02-28T16:26:36.186 INFO:tasks.workunit.client.0.smithi148.stdout:2/361: creat d0/d1d/d55/f74 x:0 0 0 2024-02-28T16:26:36.186 INFO:tasks.workunit.client.0.smithi148.stdout:0/419: dwrite d1/d15/d27/d7a/f4e [4194304,4194304] 0 2024-02-28T16:26:36.189 INFO:tasks.workunit.client.0.smithi148.stdout:0/420: readlink d1/d46/d4a/l69 0 2024-02-28T16:26:36.193 INFO:tasks.workunit.client.0.smithi148.stdout:2/362: mknod d0/d1d/c75 0 2024-02-28T16:26:36.194 INFO:tasks.workunit.client.0.smithi148.stdout:4/310: dread d8/df/d17/f1d [0,4194304] 0 2024-02-28T16:26:36.196 INFO:tasks.workunit.client.0.smithi148.stdout:2/363: chown d0/dd/d2b/l42 16413437 1 2024-02-28T16:26:36.203 INFO:tasks.workunit.client.0.smithi148.stdout:2/364: mkdir d0/d66/d76 0 2024-02-28T16:26:36.204 INFO:tasks.workunit.client.0.smithi148.stdout:4/311: getdents d8 0 2024-02-28T16:26:36.206 INFO:tasks.workunit.client.0.smithi148.stdout:2/365: chown d0/d9/d13 742206136 1 2024-02-28T16:26:36.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/421: dwrite d1/d15/d27/d34/d5a/f66 [0,4194304] 0 2024-02-28T16:26:36.212 INFO:tasks.workunit.client.0.smithi148.stdout:0/422: write d1/d4/d25/f6a [682696,35618] 0 2024-02-28T16:26:36.214 INFO:tasks.workunit.client.0.smithi148.stdout:2/366: chown d0/d18/l45 1865 1 2024-02-28T16:26:36.214 INFO:tasks.workunit.client.0.smithi148.stdout:4/312: creat d8/d21/d3d/d4d/d66/f6b x:0 0 0 2024-02-28T16:26:36.218 INFO:tasks.workunit.client.0.smithi148.stdout:6/343: sync 2024-02-28T16:26:36.218 INFO:tasks.workunit.client.0.smithi148.stdout:5/315: sync 2024-02-28T16:26:36.218 INFO:tasks.workunit.client.0.smithi148.stdout:1/313: sync 2024-02-28T16:26:36.219 INFO:tasks.workunit.client.0.smithi148.stdout:2/367: creat d0/d1d/f77 x:0 0 0 2024-02-28T16:26:36.220 INFO:tasks.workunit.client.0.smithi148.stdout:6/344: read - d0/d8/f67 zero size 2024-02-28T16:26:36.222 INFO:tasks.workunit.client.0.smithi148.stdout:2/368: rmdir d0/dd 39 2024-02-28T16:26:36.226 INFO:tasks.workunit.client.0.smithi148.stdout:2/369: chown d0/f10 3024271 1 2024-02-28T16:26:36.227 INFO:tasks.workunit.client.0.smithi148.stdout:0/423: dread d1/d4/f60 [0,4194304] 0 2024-02-28T16:26:36.228 INFO:tasks.workunit.client.0.smithi148.stdout:0/424: readlink d1/l3 0 2024-02-28T16:26:36.228 INFO:tasks.workunit.client.0.smithi148.stdout:5/316: rename d1/db/d25/c36 to d1/d8/d20/d31/d50/c5b 0 2024-02-28T16:26:36.231 INFO:tasks.workunit.client.0.smithi148.stdout:5/317: write d1/f2f [2776485,45999] 0 2024-02-28T16:26:36.232 INFO:tasks.workunit.client.0.smithi148.stdout:2/370: symlink d0/d1d/l78 0 2024-02-28T16:26:36.234 INFO:tasks.workunit.client.0.smithi148.stdout:5/318: stat d1/d8/d20/f46 0 2024-02-28T16:26:36.237 INFO:tasks.workunit.client.0.smithi148.stdout:4/313: dread d8/d21/d3d/d4d/f58 [0,4194304] 0 2024-02-28T16:26:36.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:35 smithi157 ceph-mon[38346]: pgmap v42: 65 pgs: 65 active+clean; 759 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 5.6 MiB/s rd, 83 MiB/s wr, 183 op/s 2024-02-28T16:26:36.237 INFO:tasks.workunit.client.0.smithi148.stdout:1/314: getdents d2/d15 0 2024-02-28T16:26:36.240 INFO:tasks.workunit.client.0.smithi148.stdout:6/345: dwrite d0/d4/d14/f28 [0,4194304] 0 2024-02-28T16:26:36.244 INFO:tasks.workunit.client.0.smithi148.stdout:0/425: mknod d1/d15/d3d/d67/d7b/c8d 0 2024-02-28T16:26:36.245 INFO:tasks.workunit.client.0.smithi148.stdout:2/371: mknod d0/c79 0 2024-02-28T16:26:36.247 INFO:tasks.workunit.client.0.smithi148.stdout:1/315: rmdir d2/d5 39 2024-02-28T16:26:36.247 INFO:tasks.workunit.client.0.smithi148.stdout:2/372: write d0/d1c/f5f [662861,46390] 0 2024-02-28T16:26:36.250 INFO:tasks.workunit.client.0.smithi148.stdout:4/314: unlink d8/d21/d3d/d4d/d66/f6b 0 2024-02-28T16:26:36.259 INFO:tasks.workunit.client.0.smithi148.stdout:1/316: write d2/d5/d2b/d4a/f5a [438493,128822] 0 2024-02-28T16:26:36.260 INFO:tasks.workunit.client.0.smithi148.stdout:1/317: write d2/d5/d40/d7/f38 [2095792,49428] 0 2024-02-28T16:26:36.261 INFO:tasks.workunit.client.0.smithi148.stdout:4/315: mkdir d8/df/d17/d6a/d6c 0 2024-02-28T16:26:36.265 INFO:tasks.workunit.client.0.smithi148.stdout:2/373: getdents d0/d18/d20 0 2024-02-28T16:26:36.266 INFO:tasks.workunit.client.0.smithi148.stdout:5/319: dread d1/db/f27 [4194304,4194304] 0 2024-02-28T16:26:36.267 INFO:tasks.workunit.client.0.smithi148.stdout:4/316: write d8/f69 [705837,78752] 0 2024-02-28T16:26:36.269 INFO:tasks.workunit.client.0.smithi148.stdout:4/317: rename d8/d40 to d8/d40/d6d 22 2024-02-28T16:26:36.273 INFO:tasks.workunit.client.0.smithi148.stdout:1/318: mknod d2/d5/d2b/c5c 0 2024-02-28T16:26:36.273 INFO:tasks.workunit.client.0.smithi148.stdout:4/318: read d8/df/d1f/f42 [2390038,106166] 0 2024-02-28T16:26:36.273 INFO:tasks.workunit.client.0.smithi148.stdout:6/346: dread d0/d4/d1b/f1f [0,4194304] 0 2024-02-28T16:26:36.275 INFO:tasks.workunit.client.0.smithi148.stdout:6/347: read d0/d10/f13 [6900423,112100] 0 2024-02-28T16:26:36.276 INFO:tasks.workunit.client.0.smithi148.stdout:1/319: fsync d2/f26 0 2024-02-28T16:26:36.277 INFO:tasks.workunit.client.0.smithi148.stdout:6/348: dread - d0/d8/f6c zero size 2024-02-28T16:26:36.286 INFO:tasks.workunit.client.0.smithi148.stdout:1/320: chown d2/d25/l3b 700 1 2024-02-28T16:26:36.286 INFO:tasks.workunit.client.0.smithi148.stdout:0/426: dwrite d1/d15/d27/d7a/f68 [0,4194304] 0 2024-02-28T16:26:36.289 INFO:tasks.workunit.client.0.smithi148.stdout:0/427: chown d1/d15/d27/d7a/f68 1423524 1 2024-02-28T16:26:36.292 INFO:tasks.workunit.client.0.smithi148.stdout:1/321: mkdir d2/d5/d2b/d4a/d5d 0 2024-02-28T16:26:36.294 INFO:tasks.workunit.client.0.smithi148.stdout:1/322: dread - d2/d5/d40/f27 zero size 2024-02-28T16:26:36.294 INFO:tasks.workunit.client.0.smithi148.stdout:5/320: dwrite d1/f26 [4194304,4194304] 0 2024-02-28T16:26:36.295 INFO:tasks.workunit.client.0.smithi148.stdout:0/428: read d1/d15/d3d/f5e [1615716,100421] 0 2024-02-28T16:26:36.296 INFO:tasks.workunit.client.0.smithi148.stdout:4/319: getdents d8/d21/d3d/d4d/d66 0 2024-02-28T16:26:36.297 INFO:tasks.workunit.client.0.smithi148.stdout:1/323: write d2/d5/d1a/f43 [3953488,93166] 0 2024-02-28T16:26:36.298 INFO:tasks.workunit.client.0.smithi148.stdout:2/374: link d0/dd/c60 d0/dd/d2b/c7a 0 2024-02-28T16:26:36.298 INFO:tasks.workunit.client.0.smithi148.stdout:0/429: fdatasync d1/d4/d25/f50 0 2024-02-28T16:26:36.305 INFO:tasks.workunit.client.0.smithi148.stdout:6/349: truncate d0/d22/d25/f58 356899 0 2024-02-28T16:26:36.306 INFO:tasks.workunit.client.0.smithi148.stdout:0/430: mknod d1/d15/d8/c8e 0 2024-02-28T16:26:36.307 INFO:tasks.workunit.client.0.smithi148.stdout:4/320: symlink d8/d21/l6e 0 2024-02-28T16:26:36.309 INFO:tasks.workunit.client.0.smithi148.stdout:0/431: write d1/d4/f60 [3397099,78076] 0 2024-02-28T16:26:36.311 INFO:tasks.workunit.client.0.smithi148.stdout:5/321: rename d1/db/c38 to d1/d8/c5c 0 2024-02-28T16:26:36.314 INFO:tasks.workunit.client.0.smithi148.stdout:2/375: dread d0/d1d/f5c [4194304,4194304] 0 2024-02-28T16:26:36.315 INFO:tasks.workunit.client.0.smithi148.stdout:0/432: readlink d1/d15/d27/d7a/l51 0 2024-02-28T16:26:36.315 INFO:tasks.workunit.client.0.smithi148.stdout:4/321: write d8/d21/d3d/d4d/f4e [827240,66431] 0 2024-02-28T16:26:36.317 INFO:tasks.workunit.client.0.smithi148.stdout:5/322: write d1/db/d25/f3a [2297706,48966] 0 2024-02-28T16:26:36.318 INFO:tasks.workunit.client.0.smithi148.stdout:4/322: readlink d8/l45 0 2024-02-28T16:26:36.322 INFO:tasks.workunit.client.0.smithi148.stdout:2/376: read d0/d9/d13/d38/d3a/f4a [3816763,4378] 0 2024-02-28T16:26:36.327 INFO:tasks.workunit.client.0.smithi148.stdout:6/350: dwrite d0/d4/d14/f28 [4194304,4194304] 0 2024-02-28T16:26:36.328 INFO:tasks.workunit.client.0.smithi148.stdout:0/433: rename d1/l9 to d1/d15/d27/d34/d5a/l8f 0 2024-02-28T16:26:36.331 INFO:tasks.workunit.client.0.smithi148.stdout:5/323: creat d1/d8/d20/d31/d4a/f5d x:0 0 0 2024-02-28T16:26:36.333 INFO:tasks.workunit.client.0.smithi148.stdout:0/434: rmdir d1/d15/d27/d34/d5a/d71 39 2024-02-28T16:26:36.337 INFO:tasks.workunit.client.0.smithi148.stdout:5/324: creat d1/d1a/f5e x:0 0 0 2024-02-28T16:26:36.338 INFO:tasks.workunit.client.0.smithi148.stdout:2/377: rename d0/d1d/d55/f67 to d0/d1d/d52/d54/f7b 0 2024-02-28T16:26:36.339 INFO:tasks.workunit.client.0.smithi148.stdout:0/435: creat d1/d4/f90 x:0 0 0 2024-02-28T16:26:36.340 INFO:tasks.workunit.client.0.smithi148.stdout:6/351: truncate d0/d22/d25/f36 198924 0 2024-02-28T16:26:36.341 INFO:tasks.workunit.client.0.smithi148.stdout:2/378: chown d0/d9/c4c 20 1 2024-02-28T16:26:36.342 INFO:tasks.workunit.client.0.smithi148.stdout:6/352: mknod d0/d4/d14/c6d 0 2024-02-28T16:26:36.344 INFO:tasks.workunit.client.0.smithi148.stdout:5/325: rename d1/d8/d20/f46 to d1/f5f 0 2024-02-28T16:26:36.351 INFO:tasks.workunit.client.0.smithi148.stdout:0/436: rename d1/d15/d8/f29 to d1/d15/d27/d34/d5a/f91 0 2024-02-28T16:26:36.355 INFO:tasks.workunit.client.0.smithi148.stdout:0/437: mkdir d1/d46/d4a/d92 0 2024-02-28T16:26:36.358 INFO:tasks.workunit.client.0.smithi148.stdout:6/353: dwrite d0/d22/f44 [0,4194304] 0 2024-02-28T16:26:36.361 INFO:tasks.workunit.client.0.smithi148.stdout:6/354: fdatasync d0/d22/d25/f4f 0 2024-02-28T16:26:36.361 INFO:tasks.workunit.client.0.smithi148.stdout:5/326: dread d1/d1a/f35 [0,4194304] 0 2024-02-28T16:26:36.361 INFO:tasks.workunit.client.0.smithi148.stdout:0/438: mkdir d1/d46/d5f/d93 0 2024-02-28T16:26:36.365 INFO:tasks.workunit.client.0.smithi148.stdout:6/355: write d0/d22/d25/f4f [447012,2579] 0 2024-02-28T16:26:36.367 INFO:tasks.workunit.client.0.smithi148.stdout:6/356: stat d0/d4/d1b/f1f 0 2024-02-28T16:26:36.367 INFO:tasks.workunit.client.0.smithi148.stdout:5/327: mkdir d1/db/d60 0 2024-02-28T16:26:36.367 INFO:tasks.workunit.client.0.smithi148.stdout:6/357: stat d0/l2d 0 2024-02-28T16:26:36.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/358: chown d0/d8/d21 0 1 2024-02-28T16:26:36.369 INFO:tasks.workunit.client.0.smithi148.stdout:0/439: mknod d1/d15/d3d/d67/d7b/c94 0 2024-02-28T16:26:36.370 INFO:tasks.workunit.client.0.smithi148.stdout:5/328: symlink d1/d44/l61 0 2024-02-28T16:26:36.371 INFO:tasks.workunit.client.0.smithi148.stdout:6/359: chown d0/l40 27120758 1 2024-02-28T16:26:36.371 INFO:tasks.workunit.client.0.smithi148.stdout:2/379: truncate d0/d9/d13/f16 2923754 0 2024-02-28T16:26:36.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:35 smithi148 ceph-mon[28767]: pgmap v42: 65 pgs: 65 active+clean; 759 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 5.6 MiB/s rd, 83 MiB/s wr, 183 op/s 2024-02-28T16:26:36.374 INFO:tasks.workunit.client.0.smithi148.stdout:2/380: dread - d0/d1d/d55/f74 zero size 2024-02-28T16:26:36.375 INFO:tasks.workunit.client.0.smithi148.stdout:5/329: write d1/d8/d20/d31/f39 [1202903,9046] 0 2024-02-28T16:26:36.387 INFO:tasks.workunit.client.0.smithi148.stdout:6/360: creat d0/f6e x:0 0 0 2024-02-28T16:26:36.392 INFO:tasks.workunit.client.0.smithi148.stdout:6/361: creat d0/d10/f6f x:0 0 0 2024-02-28T16:26:36.397 INFO:tasks.workunit.client.0.smithi148.stdout:0/440: dwrite d1/d15/d27/d34/d5a/f66 [4194304,4194304] 0 2024-02-28T16:26:36.399 INFO:tasks.workunit.client.0.smithi148.stdout:2/381: dwrite d0/f10 [0,4194304] 0 2024-02-28T16:26:36.401 INFO:tasks.workunit.client.0.smithi148.stdout:0/441: readlink d1/d15/d27/d7a/l58 0 2024-02-28T16:26:36.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/330: dwrite d1/d8/d20/d31/d4a/f4c [0,4194304] 0 2024-02-28T16:26:36.406 INFO:tasks.workunit.client.0.smithi148.stdout:2/382: creat d0/d66/d76/f7c x:0 0 0 2024-02-28T16:26:36.408 INFO:tasks.workunit.client.0.smithi148.stdout:0/442: creat d1/d15/d3d/d67/d7b/f95 x:0 0 0 2024-02-28T16:26:36.410 INFO:tasks.workunit.client.0.smithi148.stdout:2/383: mknod d0/d18/d20/c7d 0 2024-02-28T16:26:36.412 INFO:tasks.workunit.client.0.smithi148.stdout:5/331: rename d1/c54 to d1/d1a/c62 0 2024-02-28T16:26:36.414 INFO:tasks.workunit.client.0.smithi148.stdout:5/332: read d1/f41 [7985250,13206] 0 2024-02-28T16:26:36.417 INFO:tasks.workunit.client.0.smithi148.stdout:5/333: read d1/db/d25/f1f [3143406,28380] 0 2024-02-28T16:26:36.417 INFO:tasks.workunit.client.0.smithi148.stdout:0/443: unlink d1/c1f 0 2024-02-28T16:26:36.419 INFO:tasks.workunit.client.0.smithi148.stdout:6/362: write d0/d22/d25/d3a/f41 [1509880,111686] 0 2024-02-28T16:26:36.421 INFO:tasks.workunit.client.0.smithi148.stdout:0/444: dread - d1/d15/d3d/f43 zero size 2024-02-28T16:26:36.424 INFO:tasks.workunit.client.0.smithi148.stdout:0/445: write d1/f24 [6336966,51408] 0 2024-02-28T16:26:36.431 INFO:tasks.workunit.client.0.smithi148.stdout:6/363: dread d0/d22/d49/f5a [0,4194304] 0 2024-02-28T16:26:36.431 INFO:tasks.workunit.client.0.smithi148.stdout:5/334: dread d1/f5f [0,4194304] 0 2024-02-28T16:26:36.432 INFO:tasks.workunit.client.0.smithi148.stdout:5/335: chown d1/f5f 13485430 1 2024-02-28T16:26:36.442 INFO:tasks.workunit.client.0.smithi148.stdout:5/336: write d1/d1a/f2b [4238537,117660] 0 2024-02-28T16:26:36.445 INFO:tasks.workunit.client.0.smithi148.stdout:5/337: write d1/f2f [3612511,39849] 0 2024-02-28T16:26:36.446 INFO:tasks.workunit.client.0.smithi148.stdout:6/364: truncate d0/d22/f38 12517654 0 2024-02-28T16:26:36.447 INFO:tasks.workunit.client.0.smithi148.stdout:5/338: chown d1/d8/d20/d31/d4a 124136 1 2024-02-28T16:26:36.449 INFO:tasks.workunit.client.0.smithi148.stdout:0/446: dread d1/f6 [4194304,4194304] 0 2024-02-28T16:26:36.450 INFO:tasks.workunit.client.0.smithi148.stdout:6/365: creat d0/d22/d25/d3a/f70 x:0 0 0 2024-02-28T16:26:36.451 INFO:tasks.workunit.client.0.smithi148.stdout:5/339: mkdir d1/d8/d20/d31/d4a/d63 0 2024-02-28T16:26:36.460 INFO:tasks.workunit.client.0.smithi148.stdout:5/340: rmdir d1/d8/d20/d31/d4a 39 2024-02-28T16:26:36.463 INFO:tasks.workunit.client.0.smithi148.stdout:0/447: truncate d1/d15/d27/d34/d5a/f91 622774 0 2024-02-28T16:26:36.464 INFO:tasks.workunit.client.0.smithi148.stdout:5/341: readlink d1/d8/d20/d31/d4a/l53 0 2024-02-28T16:26:36.468 INFO:tasks.workunit.client.0.smithi148.stdout:6/366: dwrite d0/d10/f13 [0,4194304] 0 2024-02-28T16:26:36.469 INFO:tasks.workunit.client.0.smithi148.stdout:5/342: rename d1/d8/d20/d31/d4a to d1/d44/d64 0 2024-02-28T16:26:36.469 INFO:tasks.workunit.client.0.smithi148.stdout:6/367: chown d0/l31 3560667 1 2024-02-28T16:26:36.473 INFO:tasks.workunit.client.0.smithi148.stdout:5/343: mkdir d1/d44/d65 0 2024-02-28T16:26:36.476 INFO:tasks.workunit.client.0.smithi148.stdout:6/368: mkdir d0/d4/d1b/d71 0 2024-02-28T16:26:36.478 INFO:tasks.workunit.client.0.smithi148.stdout:5/344: write d1/f5f [1009536,100662] 0 2024-02-28T16:26:36.478 INFO:tasks.workunit.client.0.smithi148.stdout:6/369: chown d0/d4/d14/c53 683176 1 2024-02-28T16:26:36.481 INFO:tasks.workunit.client.0.smithi148.stdout:5/345: readlink d1/d44/d64/l53 0 2024-02-28T16:26:36.482 INFO:tasks.workunit.client.0.smithi148.stdout:0/448: dwrite d1/d4/f6e [4194304,4194304] 0 2024-02-28T16:26:36.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/449: fsync d1/d4/f90 0 2024-02-28T16:26:36.488 INFO:tasks.workunit.client.0.smithi148.stdout:5/346: link d1/f26 d1/d1a/f66 0 2024-02-28T16:26:36.508 INFO:tasks.workunit.client.0.smithi148.stdout:5/347: write d1/db/f27 [841699,65209] 0 2024-02-28T16:26:36.511 INFO:tasks.workunit.client.0.smithi148.stdout:6/370: write d0/d22/f38 [783558,68612] 0 2024-02-28T16:26:36.516 INFO:tasks.workunit.client.0.smithi148.stdout:6/371: creat d0/d22/d27/d66/f72 x:0 0 0 2024-02-28T16:26:36.521 INFO:tasks.workunit.client.0.smithi148.stdout:0/450: dwrite d1/d15/d3d/f5e [0,4194304] 0 2024-02-28T16:26:36.523 INFO:tasks.workunit.client.0.smithi148.stdout:0/451: rmdir d1/d15 39 2024-02-28T16:26:36.525 INFO:tasks.workunit.client.0.smithi148.stdout:6/372: dread d0/d22/d25/f4f [0,4194304] 0 2024-02-28T16:26:36.526 INFO:tasks.workunit.client.0.smithi148.stdout:5/348: dwrite d1/f41 [4194304,4194304] 0 2024-02-28T16:26:36.528 INFO:tasks.workunit.client.0.smithi148.stdout:6/373: readlink d0/d22/l54 0 2024-02-28T16:26:36.530 INFO:tasks.workunit.client.0.smithi148.stdout:5/349: mknod d1/d8/d23/c67 0 2024-02-28T16:26:36.535 INFO:tasks.workunit.client.0.smithi148.stdout:5/350: symlink d1/db/d60/l68 0 2024-02-28T16:26:36.542 INFO:tasks.workunit.client.0.smithi148.stdout:0/452: dwrite d1/d46/d4a/f5b [0,4194304] 0 2024-02-28T16:26:36.543 INFO:tasks.workunit.client.0.smithi148.stdout:5/351: creat d1/db/d25/f69 x:0 0 0 2024-02-28T16:26:36.547 INFO:tasks.workunit.client.0.smithi148.stdout:0/453: symlink d1/d4/l96 0 2024-02-28T16:26:36.549 INFO:tasks.workunit.client.0.smithi148.stdout:5/352: rename d1/d8/d20/f3b to d1/db/d25/f6a 0 2024-02-28T16:26:36.566 INFO:tasks.workunit.client.0.smithi148.stdout:5/353: truncate d1/f41 4437108 0 2024-02-28T16:26:36.566 INFO:tasks.workunit.client.0.smithi148.stdout:0/454: write d1/d15/d27/d34/d5a/d6c/f75 [1101213,54035] 0 2024-02-28T16:26:36.568 INFO:tasks.workunit.client.0.smithi148.stdout:5/354: write d1/d1a/f2b [3421582,103366] 0 2024-02-28T16:26:36.571 INFO:tasks.workunit.client.0.smithi148.stdout:0/455: creat d1/d8a/f97 x:0 0 0 2024-02-28T16:26:36.572 INFO:tasks.workunit.client.0.smithi148.stdout:5/355: readlink d1/l17 0 2024-02-28T16:26:36.575 INFO:tasks.workunit.client.0.smithi148.stdout:0/456: mknod d1/d15/d27/d34/d5a/c98 0 2024-02-28T16:26:36.579 INFO:tasks.workunit.client.0.smithi148.stdout:0/457: rename d1/d15/c26 to d1/d15/d27/d34/c99 0 2024-02-28T16:26:36.582 INFO:tasks.workunit.client.0.smithi148.stdout:0/458: symlink d1/d8a/l9a 0 2024-02-28T16:26:36.583 INFO:tasks.workunit.client.0.smithi148.stdout:0/459: chown d1/d4/f90 2618 1 2024-02-28T16:26:36.585 INFO:tasks.workunit.client.0.smithi148.stdout:5/356: dwrite d1/f5f [0,4194304] 0 2024-02-28T16:26:36.592 INFO:tasks.workunit.client.0.smithi148.stdout:5/357: link d1/d8/fa d1/d8/d23/f6b 0 2024-02-28T16:26:36.602 INFO:tasks.workunit.client.0.smithi148.stdout:0/460: write d1/d15/d27/d34/d5a/d71/d74/f8b [284046,100545] 0 2024-02-28T16:26:36.613 INFO:tasks.workunit.client.0.smithi148.stdout:5/358: dwrite d1/d8/fa [0,4194304] 0 2024-02-28T16:26:36.620 INFO:tasks.workunit.client.0.smithi148.stdout:5/359: creat d1/d8/d20/d31/f6c x:0 0 0 2024-02-28T16:26:36.623 INFO:tasks.workunit.client.0.smithi148.stdout:0/461: dwrite d1/d15/d8/f30 [0,4194304] 0 2024-02-28T16:26:36.626 INFO:tasks.workunit.client.0.smithi148.stdout:0/462: stat d1/d15/d27/d7a/l58 0 2024-02-28T16:26:36.627 INFO:tasks.workunit.client.0.smithi148.stdout:5/360: rename d1/d8/d23/c67 to d1/db/d60/c6d 0 2024-02-28T16:26:36.644 INFO:tasks.workunit.client.0.smithi148.stdout:0/463: dwrite d1/d46/d4a/f57 [0,4194304] 0 2024-02-28T16:26:36.648 INFO:tasks.workunit.client.0.smithi148.stdout:5/361: dwrite d1/d8/d20/d31/f6c [0,4194304] 0 2024-02-28T16:26:36.655 INFO:tasks.workunit.client.0.smithi148.stdout:0/464: mkdir d1/d46/d5f/d93/d9b 0 2024-02-28T16:26:36.656 INFO:tasks.workunit.client.0.smithi148.stdout:5/362: truncate d1/d44/d64/f5d 76077 0 2024-02-28T16:26:36.657 INFO:tasks.workunit.client.0.smithi148.stdout:5/363: fsync d1/db/d25/f3a 0 2024-02-28T16:26:36.660 INFO:tasks.workunit.client.0.smithi148.stdout:0/465: unlink d1/d15/d3d/f5e 0 2024-02-28T16:26:36.664 INFO:tasks.workunit.client.0.smithi148.stdout:0/466: read d1/d15/d27/d34/f7c [1322757,48054] 0 2024-02-28T16:26:36.667 INFO:tasks.workunit.client.0.smithi148.stdout:5/364: rename d1/d8/d20/l29 to d1/d8/d20/d4e/l6e 0 2024-02-28T16:26:36.668 INFO:tasks.workunit.client.0.smithi148.stdout:5/365: chown d1/d44/l5a 31 1 2024-02-28T16:26:36.670 INFO:tasks.workunit.client.0.smithi148.stdout:0/467: symlink d1/d46/d5f/d93/l9c 0 2024-02-28T16:26:36.677 INFO:tasks.workunit.client.0.smithi148.stdout:5/366: creat d1/f6f x:0 0 0 2024-02-28T16:26:36.682 INFO:tasks.workunit.client.0.smithi148.stdout:5/367: mknod d1/c70 0 2024-02-28T16:26:36.686 INFO:tasks.workunit.client.0.smithi148.stdout:5/368: mkdir d1/d8/d20/d4e/d71 0 2024-02-28T16:26:36.687 INFO:tasks.workunit.client.0.smithi148.stdout:5/369: dread - d1/d8/d20/d31/f4d zero size 2024-02-28T16:26:36.693 INFO:tasks.workunit.client.0.smithi148.stdout:0/468: truncate d1/d15/d27/d34/d5a/f91 2466235 0 2024-02-28T16:26:36.699 INFO:tasks.workunit.client.0.smithi148.stdout:3/485: sync 2024-02-28T16:26:36.700 INFO:tasks.workunit.client.0.smithi148.stdout:0/469: rename d1/d46 to d1/d15/d27/d34/d5a/d9d 0 2024-02-28T16:26:36.707 INFO:tasks.workunit.client.0.smithi148.stdout:0/470: rename d1/f22 to d1/d15/d27/f9e 0 2024-02-28T16:26:36.718 INFO:tasks.workunit.client.0.smithi148.stdout:5/370: truncate d1/d8/d23/f6b 1200992 0 2024-02-28T16:26:36.720 INFO:tasks.workunit.client.0.smithi148.stdout:0/471: dwrite d1/d15/d27/d34/f6d [0,4194304] 0 2024-02-28T16:26:36.722 INFO:tasks.workunit.client.0.smithi148.stdout:5/371: mknod d1/d44/c72 0 2024-02-28T16:26:36.723 INFO:tasks.workunit.client.0.smithi148.stdout:0/472: readlink d1/d15/d27/d34/d5a/d9d/d4a/l69 0 2024-02-28T16:26:36.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/372: chown d1/db/l37 3848656 1 2024-02-28T16:26:36.731 INFO:tasks.workunit.client.0.smithi148.stdout:1/324: sync 2024-02-28T16:26:36.731 INFO:tasks.workunit.client.0.smithi148.stdout:4/323: sync 2024-02-28T16:26:36.731 INFO:tasks.workunit.client.0.smithi148.stdout:7/368: sync 2024-02-28T16:26:36.731 INFO:tasks.workunit.client.0.smithi148.stdout:8/381: sync 2024-02-28T16:26:36.731 INFO:tasks.workunit.client.0.smithi148.stdout:6/374: sync 2024-02-28T16:26:36.731 INFO:tasks.workunit.client.0.smithi148.stdout:2/384: sync 2024-02-28T16:26:36.732 INFO:tasks.workunit.client.0.smithi148.stdout:9/361: sync 2024-02-28T16:26:36.733 INFO:tasks.workunit.client.0.smithi148.stdout:2/385: stat d0/d66 0 2024-02-28T16:26:36.735 INFO:tasks.workunit.client.0.smithi148.stdout:0/473: creat d1/d15/d27/d34/d5a/d9d/d4a/d92/f9f x:0 0 0 2024-02-28T16:26:36.736 INFO:tasks.workunit.client.0.smithi148.stdout:8/382: read - d1/dd/d13/d1a/f3e zero size 2024-02-28T16:26:36.737 INFO:tasks.workunit.client.0.smithi148.stdout:9/362: write d7/d1c/d1f/f4a [3551077,107616] 0 2024-02-28T16:26:36.742 INFO:tasks.workunit.client.0.smithi148.stdout:3/486: dwrite d1/db/d35/d52/f54 [0,4194304] 0 2024-02-28T16:26:36.744 INFO:tasks.workunit.client.0.smithi148.stdout:7/369: write d0/f36 [3007960,27265] 0 2024-02-28T16:26:36.744 INFO:tasks.workunit.client.0.smithi148.stdout:6/375: unlink d0/d22/l30 0 2024-02-28T16:26:36.748 INFO:tasks.workunit.client.0.smithi148.stdout:6/376: chown d0/d22/d27/d66 273491 1 2024-02-28T16:26:36.748 INFO:tasks.workunit.client.0.smithi148.stdout:3/487: write d1/f7b [1554753,50142] 0 2024-02-28T16:26:36.751 INFO:tasks.workunit.client.0.smithi148.stdout:5/373: getdents d1/d8/d20/d31/d50 0 2024-02-28T16:26:36.752 INFO:tasks.workunit.client.0.smithi148.stdout:3/488: chown d1/d3f/f7f 111436423 1 2024-02-28T16:26:36.753 INFO:tasks.workunit.client.0.smithi148.stdout:8/383: dread d1/d3/d18/d48/d22/d34/f65 [0,4194304] 0 2024-02-28T16:26:36.753 INFO:tasks.workunit.client.0.smithi148.stdout:4/324: creat d8/d21/d3d/f6f x:0 0 0 2024-02-28T16:26:36.757 INFO:tasks.workunit.client.0.smithi148.stdout:8/384: write d1/dd/d13/d1a/f5f [5098212,104182] 0 2024-02-28T16:26:36.757 INFO:tasks.workunit.client.0.smithi148.stdout:4/325: truncate d8/f69 1526949 0 2024-02-28T16:26:36.759 INFO:tasks.workunit.client.0.smithi148.stdout:4/326: chown d8/d21/f2d 15 1 2024-02-28T16:26:36.761 INFO:tasks.workunit.client.0.smithi148.stdout:2/386: dwrite d0/d9/f64 [0,4194304] 0 2024-02-28T16:26:36.765 INFO:tasks.workunit.client.0.smithi148.stdout:0/474: rename d1/d15/d27/d34/f83 to d1/d15/d27/d34/d5a/d9d/d5f/fa0 0 2024-02-28T16:26:36.769 INFO:tasks.workunit.client.0.smithi148.stdout:5/374: unlink d1/d8/d20/c51 0 2024-02-28T16:26:36.771 INFO:tasks.workunit.client.0.smithi148.stdout:5/375: fsync d1/d8/d20/d31/d50/f56 0 2024-02-28T16:26:36.773 INFO:tasks.workunit.client.0.smithi148.stdout:9/363: mkdir d7/d1c/d74/d68/d81 0 2024-02-28T16:26:36.776 INFO:tasks.workunit.client.0.smithi148.stdout:8/385: mknod d1/dd/d13/d1a/d25/c79 0 2024-02-28T16:26:36.777 INFO:tasks.workunit.client.0.smithi148.stdout:0/475: dread d1/d15/d27/d7a/f68 [0,4194304] 0 2024-02-28T16:26:36.779 INFO:tasks.workunit.client.0.smithi148.stdout:2/387: mknod d0/dd/c7e 0 2024-02-28T16:26:36.781 INFO:tasks.workunit.client.0.smithi148.stdout:6/377: mknod d0/d8/c73 0 2024-02-28T16:26:36.782 INFO:tasks.workunit.client.0.smithi148.stdout:6/378: stat d0/d10/c51 0 2024-02-28T16:26:36.788 INFO:tasks.workunit.client.0.smithi148.stdout:9/364: readlink d7/dd/l2a 0 2024-02-28T16:26:36.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/386: rmdir d1/dd/d13/d1a/d25 39 2024-02-28T16:26:36.794 INFO:tasks.workunit.client.0.smithi148.stdout:0/476: dwrite d1/d15/d27/d34/d5a/d9d/f76 [0,4194304] 0 2024-02-28T16:26:36.798 INFO:tasks.workunit.client.0.smithi148.stdout:0/477: chown d1/d15/d3d/d67/d7b 85 1 2024-02-28T16:26:36.799 INFO:tasks.workunit.client.0.smithi148.stdout:2/388: unlink d0/d9/f64 0 2024-02-28T16:26:36.803 INFO:tasks.workunit.client.0.smithi148.stdout:7/370: mknod d0/d9/d25/d47/d28/d2b/c72 0 2024-02-28T16:26:36.811 INFO:tasks.workunit.client.0.smithi148.stdout:9/365: mknod d7/d1c/d3d/c82 0 2024-02-28T16:26:36.815 INFO:tasks.workunit.client.0.smithi148.stdout:8/387: dwrite d1/d3/d18/d48/d22/f32 [0,4194304] 0 2024-02-28T16:26:36.817 INFO:tasks.workunit.client.0.smithi148.stdout:6/379: symlink d0/d4/d1b/d71/l74 0 2024-02-28T16:26:36.818 INFO:tasks.workunit.client.0.smithi148.stdout:2/389: dwrite d0/d9/f47 [0,4194304] 0 2024-02-28T16:26:36.819 INFO:tasks.workunit.client.0.smithi148.stdout:6/380: stat d0/d22/d25/d3a/c5d 0 2024-02-28T16:26:36.820 INFO:tasks.workunit.client.0.smithi148.stdout:0/478: mknod d1/d15/d3d/d67/d7b/ca1 0 2024-02-28T16:26:36.821 INFO:tasks.workunit.client.0.smithi148.stdout:0/479: chown d1/d4/lc 126 1 2024-02-28T16:26:36.822 INFO:tasks.workunit.client.0.smithi148.stdout:3/489: getdents d1 0 2024-02-28T16:26:36.824 INFO:tasks.workunit.client.0.smithi148.stdout:3/490: dread - d1/db/d45/f8b zero size 2024-02-28T16:26:36.828 INFO:tasks.workunit.client.0.smithi148.stdout:7/371: chown d0/d9/d25/d47/l22 100094229 1 2024-02-28T16:26:36.832 INFO:tasks.workunit.client.0.smithi148.stdout:3/491: chown d1/d3f/f7f 5 1 2024-02-28T16:26:36.833 INFO:tasks.workunit.client.0.smithi148.stdout:9/366: fsync d7/d1c/d1f/f33 0 2024-02-28T16:26:36.836 INFO:tasks.workunit.client.0.smithi148.stdout:4/327: truncate d8/d21/f54 3707323 0 2024-02-28T16:26:36.842 INFO:tasks.workunit.client.0.smithi148.stdout:6/381: rename d0/d22/f44 to d0/d4/d14/d59/f75 0 2024-02-28T16:26:36.845 INFO:tasks.workunit.client.0.smithi148.stdout:5/376: truncate d1/d1a/f2b 2234630 0 2024-02-28T16:26:36.847 INFO:tasks.workunit.client.0.smithi148.stdout:2/390: dwrite d0/d9/f47 [0,4194304] 0 2024-02-28T16:26:36.850 INFO:tasks.workunit.client.0.smithi148.stdout:9/367: mkdir d7/d1c/d59/d83 0 2024-02-28T16:26:36.852 INFO:tasks.workunit.client.0.smithi148.stdout:8/388: mknod d1/dd/d13/d24/c7a 0 2024-02-28T16:26:36.853 INFO:tasks.workunit.client.0.smithi148.stdout:0/480: dwrite d1/d15/d3d/f65 [0,4194304] 0 2024-02-28T16:26:36.858 INFO:tasks.workunit.client.0.smithi148.stdout:7/372: dwrite d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:36.858 INFO:tasks.workunit.client.0.smithi148.stdout:4/328: rename d8/d37/c5d to d8/d21/c70 0 2024-02-28T16:26:36.863 INFO:tasks.workunit.client.0.smithi148.stdout:6/382: unlink d0/d4/l3f 0 2024-02-28T16:26:36.866 INFO:tasks.workunit.client.0.smithi148.stdout:3/492: creat d1/d13/d19/d1b/d38/d7c/f8d x:0 0 0 2024-02-28T16:26:36.866 INFO:tasks.workunit.client.0.smithi148.stdout:6/383: dread - d0/d8/f67 zero size 2024-02-28T16:26:36.877 INFO:tasks.workunit.client.0.smithi148.stdout:5/377: read d1/db/f27 [2213037,47237] 0 2024-02-28T16:26:36.878 INFO:tasks.workunit.client.0.smithi148.stdout:2/391: rmdir d0/d9 39 2024-02-28T16:26:36.882 INFO:tasks.workunit.client.0.smithi148.stdout:5/378: truncate d1/d8/d23/f4f 209955 0 2024-02-28T16:26:36.886 INFO:tasks.workunit.client.0.smithi148.stdout:5/379: write d1/d8/d23/f4f [605848,567] 0 2024-02-28T16:26:36.895 INFO:tasks.workunit.client.0.smithi148.stdout:8/389: mknod d1/dd/d13/d1a/d25/d50/c7b 0 2024-02-28T16:26:36.897 INFO:tasks.workunit.client.0.smithi148.stdout:3/493: dread d1/d13/d19/d32/f37 [0,4194304] 0 2024-02-28T16:26:36.897 INFO:tasks.workunit.client.0.smithi148.stdout:0/481: write d1/d15/d8/f1d [728651,73312] 0 2024-02-28T16:26:36.902 INFO:tasks.workunit.client.0.smithi148.stdout:0/482: chown d1/f6 498289 1 2024-02-28T16:26:36.903 INFO:tasks.workunit.client.0.smithi148.stdout:8/390: fsync d1/dd/d13/d24/d3a/f59 0 2024-02-28T16:26:36.905 INFO:tasks.workunit.client.0.smithi148.stdout:5/380: creat d1/d8/d20/d4e/d71/f73 x:0 0 0 2024-02-28T16:26:36.905 INFO:tasks.workunit.client.0.smithi148.stdout:9/368: getdents d7/d1c/d1f/d49 0 2024-02-28T16:26:36.908 INFO:tasks.workunit.client.0.smithi148.stdout:7/373: getdents d0/d9/d1b 0 2024-02-28T16:26:36.908 INFO:tasks.workunit.client.0.smithi148.stdout:3/494: fdatasync d1/d13/d19/d1b/d38/f43 0 2024-02-28T16:26:36.909 INFO:tasks.workunit.client.0.smithi148.stdout:0/483: creat d1/d15/d3d/fa2 x:0 0 0 2024-02-28T16:26:36.911 INFO:tasks.workunit.client.0.smithi148.stdout:6/384: dwrite d0/d22/d25/f4f [0,4194304] 0 2024-02-28T16:26:36.915 INFO:tasks.workunit.client.0.smithi148.stdout:5/381: symlink d1/d44/d64/l74 0 2024-02-28T16:26:36.918 INFO:tasks.workunit.client.0.smithi148.stdout:7/374: symlink d0/d9/d25/d39/l73 0 2024-02-28T16:26:36.921 INFO:tasks.workunit.client.0.smithi148.stdout:3/495: mkdir d1/db/d35/d70/d8e 0 2024-02-28T16:26:36.921 INFO:tasks.workunit.client.0.smithi148.stdout:6/385: mkdir d0/d22/d25/d76 0 2024-02-28T16:26:36.924 INFO:tasks.workunit.client.0.smithi148.stdout:8/391: dread d1/d3/d18/f5d [0,4194304] 0 2024-02-28T16:26:36.924 INFO:tasks.workunit.client.0.smithi148.stdout:5/382: mknod d1/d1a/c75 0 2024-02-28T16:26:36.924 INFO:tasks.workunit.client.0.smithi148.stdout:3/496: write d1/d13/d19/d1b/d38/f43 [264685,90064] 0 2024-02-28T16:26:36.926 INFO:tasks.workunit.client.0.smithi148.stdout:7/375: mkdir d0/d9/d25/d47/d28/d74 0 2024-02-28T16:26:36.926 INFO:tasks.workunit.client.0.smithi148.stdout:5/383: dread - d1/d8/d20/d31/d50/f56 zero size 2024-02-28T16:26:36.926 INFO:tasks.workunit.client.0.smithi148.stdout:8/392: chown d1/dd/d13/d24/d3a/c40 156 1 2024-02-28T16:26:36.929 INFO:tasks.workunit.client.0.smithi148.stdout:7/376: chown d0/f71 987242 1 2024-02-28T16:26:36.932 INFO:tasks.workunit.client.0.smithi148.stdout:5/384: rename d1/db/d25/f6a to d1/d44/d65/f76 0 2024-02-28T16:26:36.932 INFO:tasks.workunit.client.0.smithi148.stdout:8/393: mknod d1/dd/d13/d1a/d25/d50/c7c 0 2024-02-28T16:26:36.935 INFO:tasks.workunit.client.0.smithi148.stdout:7/377: mkdir d0/d9/d25/d47/d28/d2b/d3a/d49/d75 0 2024-02-28T16:26:36.938 INFO:tasks.workunit.client.0.smithi148.stdout:8/394: creat d1/dd/d13/d24/d3a/d49/f7d x:0 0 0 2024-02-28T16:26:36.941 INFO:tasks.workunit.client.0.smithi148.stdout:5/385: unlink d1/d8/d23/f6b 0 2024-02-28T16:26:36.943 INFO:tasks.workunit.client.0.smithi148.stdout:5/386: readlink d1/db/l37 0 2024-02-28T16:26:36.945 INFO:tasks.workunit.client.0.smithi148.stdout:0/484: truncate d1/d4/d25/f2e 1627907 0 2024-02-28T16:26:36.950 INFO:tasks.workunit.client.0.smithi148.stdout:0/485: symlink d1/d15/d27/la3 0 2024-02-28T16:26:36.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/497: dwrite d1/d13/d19/d56/d5b/f68 [0,4194304] 0 2024-02-28T16:26:36.953 INFO:tasks.workunit.client.0.smithi148.stdout:9/369: dwrite d7/f3c [0,4194304] 0 2024-02-28T16:26:36.962 INFO:tasks.workunit.client.0.smithi148.stdout:3/498: symlink d1/db/d35/d70/d71/l8f 0 2024-02-28T16:26:36.962 INFO:tasks.workunit.client.0.smithi148.stdout:3/499: chown d1/db/d89 745474137 1 2024-02-28T16:26:36.964 INFO:tasks.workunit.client.0.smithi148.stdout:5/387: truncate d1/db/d25/f3a 1072626 0 2024-02-28T16:26:36.973 INFO:tasks.workunit.client.0.smithi148.stdout:3/500: mknod d1/db/c90 0 2024-02-28T16:26:36.973 INFO:tasks.workunit.client.0.smithi148.stdout:9/370: getdents d7/d1c/d74/d68 0 2024-02-28T16:26:36.975 INFO:tasks.workunit.client.0.smithi148.stdout:7/378: dread d0/f2 [0,4194304] 0 2024-02-28T16:26:36.976 INFO:tasks.workunit.client.0.smithi148.stdout:5/388: rename d1/d8/c28 to d1/d8/d20/d4e/d71/c77 0 2024-02-28T16:26:36.979 INFO:tasks.workunit.client.0.smithi148.stdout:5/389: chown d1/db/f49 66168578 1 2024-02-28T16:26:36.982 INFO:tasks.workunit.client.0.smithi148.stdout:8/395: dread d1/d3/d18/d48/d70/f72 [0,4194304] 0 2024-02-28T16:26:36.986 INFO:tasks.workunit.client.0.smithi148.stdout:9/371: dread d7/d1c/f75 [0,4194304] 0 2024-02-28T16:26:36.987 INFO:tasks.workunit.client.0.smithi148.stdout:3/501: getdents d1/d13/d19/d88 0 2024-02-28T16:26:36.989 INFO:tasks.workunit.client.0.smithi148.stdout:0/486: dwrite d1/d15/d27/d34/d5a/d6c/f88 [0,4194304] 0 2024-02-28T16:26:36.992 INFO:tasks.workunit.client.0.smithi148.stdout:7/379: rename d0/d9/fe to d0/f76 0 2024-02-28T16:26:36.994 INFO:tasks.workunit.client.0.smithi148.stdout:0/487: readlink d1/d15/d27/d34/d5a/d71/d80/l85 0 2024-02-28T16:26:36.996 INFO:tasks.workunit.client.0.smithi148.stdout:3/502: write d1/d13/d19/d32/f37 [161525,92074] 0 2024-02-28T16:26:36.997 INFO:tasks.workunit.client.0.smithi148.stdout:0/488: write d1/d4/f6e [8582847,25293] 0 2024-02-28T16:26:37.000 INFO:tasks.workunit.client.0.smithi148.stdout:8/396: creat d1/f7e x:0 0 0 2024-02-28T16:26:37.001 INFO:tasks.workunit.client.0.smithi148.stdout:5/390: getdents d1/d8 0 2024-02-28T16:26:37.001 INFO:tasks.workunit.client.0.smithi148.stdout:9/372: symlink d7/d1c/d1f/l84 0 2024-02-28T16:26:37.006 INFO:tasks.workunit.client.0.smithi148.stdout:9/373: stat d7/dd/l6f 0 2024-02-28T16:26:37.006 INFO:tasks.workunit.client.0.smithi148.stdout:7/380: mkdir d0/d9/d25/d47/d28/d2b/d77 0 2024-02-28T16:26:37.006 INFO:tasks.workunit.client.0.smithi148.stdout:3/503: read d1/db/d35/d52/f66 [5600,51579] 0 2024-02-28T16:26:37.012 INFO:tasks.workunit.client.0.smithi148.stdout:9/374: fdatasync d7/d1c/d32/d24/f2f 0 2024-02-28T16:26:37.014 INFO:tasks.workunit.client.0.smithi148.stdout:7/381: truncate d0/d9/d25/f42 1676576 0 2024-02-28T16:26:37.018 INFO:tasks.workunit.client.0.smithi148.stdout:0/489: mkdir d1/d15/d27/d34/d5a/d71/d74/d7e/da4 0 2024-02-28T16:26:37.019 INFO:tasks.workunit.client.0.smithi148.stdout:8/397: write d1/dd/d13/d1a/f42 [710167,60025] 0 2024-02-28T16:26:37.020 INFO:tasks.workunit.client.0.smithi148.stdout:0/490: readlink d1/d15/d27/la3 0 2024-02-28T16:26:37.020 INFO:tasks.workunit.client.0.smithi148.stdout:3/504: symlink d1/db/l91 0 2024-02-28T16:26:37.023 INFO:tasks.workunit.client.0.smithi148.stdout:3/505: fsync d1/d13/f15 0 2024-02-28T16:26:37.025 INFO:tasks.workunit.client.0.smithi148.stdout:7/382: mknod d0/d9/d25/c78 0 2024-02-28T16:26:37.027 INFO:tasks.workunit.client.0.smithi148.stdout:0/491: truncate d1/d15/d3d/f65 4503071 0 2024-02-28T16:26:37.028 INFO:tasks.workunit.client.0.smithi148.stdout:8/398: rename d1/f7e to d1/f7f 0 2024-02-28T16:26:37.031 INFO:tasks.workunit.client.0.smithi148.stdout:0/492: readlink d1/d15/d27/d7a/l5d 0 2024-02-28T16:26:37.031 INFO:tasks.workunit.client.0.smithi148.stdout:7/383: readlink d0/d4/l17 0 2024-02-28T16:26:37.033 INFO:tasks.workunit.client.0.smithi148.stdout:8/399: creat d1/d3/f80 x:0 0 0 2024-02-28T16:26:37.033 INFO:tasks.workunit.client.0.smithi148.stdout:9/375: dwrite d7/d1c/d3d/f56 [0,4194304] 0 2024-02-28T16:26:37.034 INFO:tasks.workunit.client.0.smithi148.stdout:5/391: dwrite d1/d1a/f35 [0,4194304] 0 2024-02-28T16:26:37.045 INFO:tasks.workunit.client.0.smithi148.stdout:5/392: truncate d1/d8/d20/d31/f4d 506641 0 2024-02-28T16:26:37.045 INFO:tasks.workunit.client.0.smithi148.stdout:7/384: creat d0/d18/f79 x:0 0 0 2024-02-28T16:26:37.054 INFO:tasks.workunit.client.0.smithi148.stdout:3/506: dwrite d1/db/d45/f8b [0,4194304] 0 2024-02-28T16:26:37.057 INFO:tasks.workunit.client.0.smithi148.stdout:0/493: dread d1/d15/d27/d34/d5a/f66 [4194304,4194304] 0 2024-02-28T16:26:37.057 INFO:tasks.workunit.client.0.smithi148.stdout:3/507: chown d1/db/d45/d80 2 1 2024-02-28T16:26:37.061 INFO:tasks.workunit.client.0.smithi148.stdout:9/376: dwrite d7/d1c/d32/f1a [4194304,4194304] 0 2024-02-28T16:26:37.066 INFO:tasks.workunit.client.0.smithi148.stdout:9/377: mknod d7/dd/d26/c85 0 2024-02-28T16:26:37.070 INFO:tasks.workunit.client.0.smithi148.stdout:8/400: truncate d1/f27 794730 0 2024-02-28T16:26:37.076 INFO:tasks.workunit.client.0.smithi148.stdout:7/385: dwrite d0/d9/d25/d47/d28/d2b/f69 [0,4194304] 0 2024-02-28T16:26:37.076 INFO:tasks.workunit.client.0.smithi148.stdout:7/386: readlink d0/d4/l17 0 2024-02-28T16:26:37.079 INFO:tasks.workunit.client.0.smithi148.stdout:3/508: creat d1/db/d35/f92 x:0 0 0 2024-02-28T16:26:37.080 INFO:tasks.workunit.client.0.smithi148.stdout:7/387: write d0/d9/d25/d47/d1c/d32/f3d [398322,43407] 0 2024-02-28T16:26:37.081 INFO:tasks.workunit.client.0.smithi148.stdout:0/494: write d1/d15/f2a [115588,36102] 0 2024-02-28T16:26:37.085 INFO:tasks.workunit.client.0.smithi148.stdout:0/495: write d1/d4/f33 [2139923,12465] 0 2024-02-28T16:26:37.086 INFO:tasks.workunit.client.0.smithi148.stdout:3/509: unlink d1/c26 0 2024-02-28T16:26:37.095 INFO:tasks.workunit.client.0.smithi148.stdout:8/401: dread d1/d3/f1e [4194304,4194304] 0 2024-02-28T16:26:37.096 INFO:tasks.workunit.client.0.smithi148.stdout:9/378: dwrite d7/d1c/f45 [0,4194304] 0 2024-02-28T16:26:37.098 INFO:tasks.workunit.client.0.smithi148.stdout:7/388: write d0/f13 [570442,119476] 0 2024-02-28T16:26:37.101 INFO:tasks.workunit.client.0.smithi148.stdout:7/389: stat d0/d18/c34 0 2024-02-28T16:26:37.102 INFO:tasks.workunit.client.0.smithi148.stdout:5/393: dwrite d1/db/d25/f2e [0,4194304] 0 2024-02-28T16:26:37.105 INFO:tasks.workunit.client.0.smithi148.stdout:5/394: readlink d1/l19 0 2024-02-28T16:26:37.107 INFO:tasks.workunit.client.0.smithi148.stdout:8/402: creat d1/d3/d18/d48/d70/d75/f81 x:0 0 0 2024-02-28T16:26:37.110 INFO:tasks.workunit.client.0.smithi148.stdout:0/496: truncate d1/d15/d27/d34/d5a/d9d/d5f/fa0 368348 0 2024-02-28T16:26:37.111 INFO:tasks.workunit.client.0.smithi148.stdout:3/510: rename d1/d13/d19/d1b/f74 to d1/db/d35/d52/f93 0 2024-02-28T16:26:37.115 INFO:tasks.workunit.client.0.smithi148.stdout:7/390: truncate d0/f76 1692330 0 2024-02-28T16:26:37.118 INFO:tasks.workunit.client.0.smithi148.stdout:9/379: write d7/dd/d26/f69 [907121,35617] 0 2024-02-28T16:26:37.120 INFO:tasks.workunit.client.0.smithi148.stdout:5/395: write d1/f26 [6363498,36117] 0 2024-02-28T16:26:37.122 INFO:tasks.workunit.client.0.smithi148.stdout:5/396: readlink d1/l19 0 2024-02-28T16:26:37.123 INFO:tasks.workunit.client.0.smithi148.stdout:8/403: creat d1/d3/d18/d5a/d60/f82 x:0 0 0 2024-02-28T16:26:37.125 INFO:tasks.workunit.client.0.smithi148.stdout:5/397: chown d1/d8/d20/d31/f40 36 1 2024-02-28T16:26:37.126 INFO:tasks.workunit.client.0.smithi148.stdout:9/380: mknod d7/d1c/c86 0 2024-02-28T16:26:37.128 INFO:tasks.workunit.client.0.smithi148.stdout:8/404: fdatasync d1/d3/d18/d48/d70/f72 0 2024-02-28T16:26:37.129 INFO:tasks.workunit.client.0.smithi148.stdout:9/381: readlink d7/d43/l44 0 2024-02-28T16:26:37.133 INFO:tasks.workunit.client.0.smithi148.stdout:0/497: dread d1/d15/d27/d34/d5a/d6c/f88 [0,4194304] 0 2024-02-28T16:26:37.134 INFO:tasks.workunit.client.0.smithi148.stdout:5/398: getdents d1/d44/d65 0 2024-02-28T16:26:37.137 INFO:tasks.workunit.client.0.smithi148.stdout:7/391: write d0/f76 [222411,112909] 0 2024-02-28T16:26:37.137 INFO:tasks.workunit.client.0.smithi148.stdout:3/511: dwrite d1/db/f65 [0,4194304] 0 2024-02-28T16:26:37.148 INFO:tasks.workunit.client.0.smithi148.stdout:0/498: symlink d1/d15/d27/d34/d5a/d71/la5 0 2024-02-28T16:26:37.151 INFO:tasks.workunit.client.0.smithi148.stdout:7/392: getdents d0/d9/d25/d47/d28/d2b/d77 0 2024-02-28T16:26:37.153 INFO:tasks.workunit.client.0.smithi148.stdout:9/382: dwrite d7/dd/d26/f69 [0,4194304] 0 2024-02-28T16:26:37.156 INFO:tasks.workunit.client.0.smithi148.stdout:0/499: symlink d1/d15/d27/d34/d5a/d9d/d5f/d93/la6 0 2024-02-28T16:26:37.157 INFO:tasks.workunit.client.0.smithi148.stdout:9/383: write d7/d1c/d3d/f61 [332016,71559] 0 2024-02-28T16:26:37.160 INFO:tasks.workunit.client.0.smithi148.stdout:8/405: dwrite d1/dd/d13/d1a/f5f [0,4194304] 0 2024-02-28T16:26:37.163 INFO:tasks.workunit.client.0.smithi148.stdout:7/393: creat d0/d9/d46/f7a x:0 0 0 2024-02-28T16:26:37.168 INFO:tasks.workunit.client.0.smithi148.stdout:0/500: mkdir d1/d15/d27/d34/d5a/d9d/d5f/d93/d9b/da7 0 2024-02-28T16:26:37.168 INFO:tasks.workunit.client.0.smithi148.stdout:3/512: dwrite d1/db/f65 [0,4194304] 0 2024-02-28T16:26:37.172 INFO:tasks.workunit.client.0.smithi148.stdout:9/384: creat d7/d1c/d59/d83/f87 x:0 0 0 2024-02-28T16:26:37.174 INFO:tasks.workunit.client.0.smithi148.stdout:8/406: link d1/dd/d13/d24/d3a/l56 d1/dd/d13/d68/l83 0 2024-02-28T16:26:37.176 INFO:tasks.workunit.client.0.smithi148.stdout:0/501: rename d1/d4/f33 to d1/d15/d27/d34/d5a/d9d/d4a/d92/fa8 0 2024-02-28T16:26:37.180 INFO:tasks.workunit.client.0.smithi148.stdout:0/502: read d1/d4/f60 [481990,111536] 0 2024-02-28T16:26:37.182 INFO:tasks.workunit.client.0.smithi148.stdout:3/513: mkdir d1/d13/d19/d94 0 2024-02-28T16:26:37.189 INFO:tasks.workunit.client.0.smithi148.stdout:7/394: dwrite d0/d9/d25/d47/d1c/f48 [0,4194304] 0 2024-02-28T16:26:37.190 INFO:tasks.workunit.client.0.smithi148.stdout:3/514: symlink d1/d13/d19/d32/d41/l95 0 2024-02-28T16:26:37.191 INFO:tasks.workunit.client.0.smithi148.stdout:0/503: creat d1/d15/d27/d34/d5a/d71/d74/fa9 x:0 0 0 2024-02-28T16:26:37.195 INFO:tasks.workunit.client.0.smithi148.stdout:7/395: mknod d0/d9/d46/d65/c7b 0 2024-02-28T16:26:37.198 INFO:tasks.workunit.client.0.smithi148.stdout:3/515: truncate d1/db/d35/d52/f66 181740 0 2024-02-28T16:26:37.200 INFO:tasks.workunit.client.0.smithi148.stdout:3/516: creat d1/db/d45/f96 x:0 0 0 2024-02-28T16:26:37.203 INFO:tasks.workunit.client.0.smithi148.stdout:3/517: write d1/d13/f78 [130353,16516] 0 2024-02-28T16:26:37.209 INFO:tasks.workunit.client.0.smithi148.stdout:7/396: creat d0/d9/d25/f7c x:0 0 0 2024-02-28T16:26:37.212 INFO:tasks.workunit.client.0.smithi148.stdout:8/407: truncate d1/dd/f10 579709 0 2024-02-28T16:26:37.220 INFO:tasks.workunit.client.0.smithi148.stdout:3/518: creat d1/d13/d19/d88/f97 x:0 0 0 2024-02-28T16:26:37.221 INFO:tasks.workunit.client.0.smithi148.stdout:7/397: symlink d0/d4/l7d 0 2024-02-28T16:26:37.229 INFO:tasks.workunit.client.0.smithi148.stdout:0/504: dwrite d1/d15/d3d/f43 [0,4194304] 0 2024-02-28T16:26:37.241 INFO:tasks.workunit.client.0.smithi148.stdout:7/398: getdents d0/d4 0 2024-02-28T16:26:37.242 INFO:tasks.workunit.client.0.smithi148.stdout:0/505: dread d1/d15/f55 [0,4194304] 0 2024-02-28T16:26:37.245 INFO:tasks.workunit.client.0.smithi148.stdout:3/519: truncate d1/d13/d19/f4a 1781808 0 2024-02-28T16:26:37.245 INFO:tasks.workunit.client.0.smithi148.stdout:7/399: chown d0/d9/d25/d47/d28/d2b/f69 1707409811 1 2024-02-28T16:26:37.246 INFO:tasks.workunit.client.0.smithi148.stdout:0/506: fdatasync d1/d15/d27/d34/f7c 0 2024-02-28T16:26:37.251 INFO:tasks.workunit.client.0.smithi148.stdout:7/400: read d0/d9/d25/d47/f27 [3161341,32172] 0 2024-02-28T16:26:37.251 INFO:tasks.workunit.client.0.smithi148.stdout:8/408: dwrite d1/d3/d18/d48/ff [0,4194304] 0 2024-02-28T16:26:37.252 INFO:tasks.workunit.client.0.smithi148.stdout:8/409: stat d1/dd 0 2024-02-28T16:26:37.257 INFO:tasks.workunit.client.0.smithi148.stdout:8/410: mkdir d1/d3/d18/d48/d70/d75/d84 0 2024-02-28T16:26:37.262 INFO:tasks.workunit.client.0.smithi148.stdout:3/520: rename d1/d13/d19/f4a to d1/db/d45/f98 0 2024-02-28T16:26:37.264 INFO:tasks.workunit.client.0.smithi148.stdout:7/401: creat d0/d9/d25/f7e x:0 0 0 2024-02-28T16:26:37.268 INFO:tasks.workunit.client.0.smithi148.stdout:3/521: write d1/d13/d19/d1b/d38/f82 [5001157,112585] 0 2024-02-28T16:26:37.273 INFO:tasks.workunit.client.0.smithi148.stdout:0/507: dwrite d1/d15/d27/d34/d5a/f91 [0,4194304] 0 2024-02-28T16:26:37.273 INFO:tasks.workunit.client.0.smithi148.stdout:3/522: dread - d1/d3f/f7f zero size 2024-02-28T16:26:37.274 INFO:tasks.workunit.client.0.smithi148.stdout:0/508: write d1/d15/d3d/f65 [3014102,31028] 0 2024-02-28T16:26:37.276 INFO:tasks.workunit.client.0.smithi148.stdout:7/402: rename d0/d9/d4c/f50 to d0/d9/d25/d47/d28/d2b/d6f/f7f 0 2024-02-28T16:26:37.284 INFO:tasks.workunit.client.0.smithi148.stdout:8/411: dwrite d1/d3/f6c [0,4194304] 0 2024-02-28T16:26:37.285 INFO:tasks.workunit.client.0.smithi148.stdout:3/523: stat d1/l2f 0 2024-02-28T16:26:37.287 INFO:tasks.workunit.client.0.smithi148.stdout:8/412: chown d1/dd/d13/d24/d3a/f69 4247 1 2024-02-28T16:26:37.288 INFO:tasks.workunit.client.0.smithi148.stdout:0/509: rmdir d1/d15/d27/d34/d5a/d71/d80 39 2024-02-28T16:26:37.288 INFO:tasks.workunit.client.0.smithi148.stdout:7/403: dread d0/d9/d46/f6e [0,4194304] 0 2024-02-28T16:26:37.293 INFO:tasks.workunit.client.0.smithi148.stdout:7/404: write d0/d4/f63 [417046,44500] 0 2024-02-28T16:26:37.293 INFO:tasks.workunit.client.0.smithi148.stdout:0/510: stat d1/d15/d27/d34/d5a/d9d/c48 0 2024-02-28T16:26:37.296 INFO:tasks.workunit.client.0.smithi148.stdout:7/405: chown d0/d9/d25/d47/d28/d2b/c72 303 1 2024-02-28T16:26:37.296 INFO:tasks.workunit.client.0.smithi148.stdout:3/524: link d1/d13/f78 d1/d13/d19/d88/f99 0 2024-02-28T16:26:37.298 INFO:tasks.workunit.client.0.smithi148.stdout:0/511: truncate d1/d15/d3d/d67/d7b/f95 402904 0 2024-02-28T16:26:37.300 INFO:tasks.workunit.client.0.smithi148.stdout:3/525: mkdir d1/d13/d19/d94/d9a 0 2024-02-28T16:26:37.303 INFO:tasks.workunit.client.0.smithi148.stdout:0/512: creat d1/d8a/faa x:0 0 0 2024-02-28T16:26:37.303 INFO:tasks.workunit.client.0.smithi148.stdout:3/526: read d1/d13/f1e [3931,14627] 0 2024-02-28T16:26:37.303 INFO:tasks.workunit.client.0.smithi148.stdout:7/406: mkdir d0/d9/d25/d47/d28/d2b/d80 0 2024-02-28T16:26:37.305 INFO:tasks.workunit.client.0.smithi148.stdout:0/513: fdatasync d1/d15/d27/d7a/f4e 0 2024-02-28T16:26:37.307 INFO:tasks.workunit.client.0.smithi148.stdout:0/514: dread - d1/d4/d25/f7f zero size 2024-02-28T16:26:37.308 INFO:tasks.workunit.client.0.smithi148.stdout:3/527: truncate d1/d13/d19/d1b/f2a 309963 0 2024-02-28T16:26:37.312 INFO:tasks.workunit.client.0.smithi148.stdout:7/407: link d0/d9/d25/d39/c43 d0/d9/d25/d47/d1c/d32/c81 0 2024-02-28T16:26:37.313 INFO:tasks.workunit.client.0.smithi148.stdout:0/515: creat d1/d15/d27/d34/d5a/d71/d74/d7e/da4/fab x:0 0 0 2024-02-28T16:26:37.314 INFO:tasks.workunit.client.0.smithi148.stdout:7/408: write d0/d9/d25/f2f [4827563,60634] 0 2024-02-28T16:26:37.315 INFO:tasks.workunit.client.0.smithi148.stdout:0/516: chown d1/d15/d27/d34/d5a/d6c/f75 4148 1 2024-02-28T16:26:37.318 INFO:tasks.workunit.client.0.smithi148.stdout:7/409: truncate d0/d9/d25/d47/d28/d2b/d3a/f5b 4589868 0 2024-02-28T16:26:37.321 INFO:tasks.workunit.client.0.smithi148.stdout:7/410: write d0/d9/d25/d47/d28/d2b/d3a/d49/f51 [600168,77282] 0 2024-02-28T16:26:37.326 INFO:tasks.workunit.client.0.smithi148.stdout:7/411: truncate d0/d9/d25/d47/f27 5338610 0 2024-02-28T16:26:37.328 INFO:tasks.workunit.client.0.smithi148.stdout:1/325: sync 2024-02-28T16:26:37.331 INFO:tasks.workunit.client.0.smithi148.stdout:0/517: dwrite d1/d15/d8/f1d [0,4194304] 0 2024-02-28T16:26:37.331 INFO:tasks.workunit.client.0.smithi148.stdout:1/326: mknod d2/c5e 0 2024-02-28T16:26:37.334 INFO:tasks.workunit.client.0.smithi148.stdout:0/518: write d1/d15/f2a [2322032,60648] 0 2024-02-28T16:26:37.337 INFO:tasks.workunit.client.0.smithi148.stdout:1/327: link d2/c5e d2/d15/c5f 0 2024-02-28T16:26:37.338 INFO:tasks.workunit.client.0.smithi148.stdout:0/519: mknod d1/d15/d27/cac 0 2024-02-28T16:26:37.338 INFO:tasks.workunit.client.0.smithi148.stdout:1/328: fsync d2/d5/d40/f1b 0 2024-02-28T16:26:37.340 INFO:tasks.workunit.client.0.smithi148.stdout:0/520: chown d1/d15/d8 8516722 1 2024-02-28T16:26:37.342 INFO:tasks.workunit.client.0.smithi148.stdout:1/329: chown d2/d5/d40/d8 6441 1 2024-02-28T16:26:37.344 INFO:tasks.workunit.client.0.smithi148.stdout:1/330: mknod d2/d5/d1a/c60 0 2024-02-28T16:26:37.346 INFO:tasks.workunit.client.0.smithi148.stdout:7/412: dwrite d0/d9/d25/d47/f27 [0,4194304] 0 2024-02-28T16:26:37.349 INFO:tasks.workunit.client.0.smithi148.stdout:7/413: unlink d0/d18/c5a 0 2024-02-28T16:26:37.353 INFO:tasks.workunit.client.0.smithi148.stdout:0/521: dread d1/d15/d27/d34/d5a/d6c/f75 [0,4194304] 0 2024-02-28T16:26:37.355 INFO:tasks.workunit.client.0.smithi148.stdout:7/414: getdents d0/d9/d25/d47 0 2024-02-28T16:26:37.357 INFO:tasks.workunit.client.0.smithi148.stdout:0/522: read d1/d15/d27/d34/d5a/f91 [3024988,121010] 0 2024-02-28T16:26:37.362 INFO:tasks.workunit.client.0.smithi148.stdout:1/331: dwrite d2/d5/d40/f53 [0,4194304] 0 2024-02-28T16:26:37.372 INFO:tasks.workunit.client.0.smithi148.stdout:1/332: fsync d2/d5/d1a/f42 0 2024-02-28T16:26:37.376 INFO:tasks.workunit.client.0.smithi148.stdout:7/415: dread d0/d9/d25/d47/d1c/d32/f4e [0,4194304] 0 2024-02-28T16:26:37.379 INFO:tasks.workunit.client.0.smithi148.stdout:1/333: creat d2/d5/d40/d8/f61 x:0 0 0 2024-02-28T16:26:37.381 INFO:tasks.workunit.client.0.smithi148.stdout:1/334: fsync d2/d5/d40/d8/f9 0 2024-02-28T16:26:37.382 INFO:tasks.workunit.client.0.smithi148.stdout:0/523: dread d1/d4/fe [0,4194304] 0 2024-02-28T16:26:37.382 INFO:tasks.workunit.client.0.smithi148.stdout:7/416: fsync d0/d9/d25/f42 0 2024-02-28T16:26:37.386 INFO:tasks.workunit.client.0.smithi148.stdout:0/524: write d1/d15/d27/d34/d5a/d71/d74/fa9 [454286,16327] 0 2024-02-28T16:26:37.388 INFO:tasks.workunit.client.0.smithi148.stdout:0/525: fsync d1/d15/d27/d34/d5a/d9d/d5f/f82 0 2024-02-28T16:26:37.389 INFO:tasks.workunit.client.0.smithi148.stdout:0/526: fdatasync d1/d4/d25/f61 0 2024-02-28T16:26:37.458 INFO:tasks.workunit.client.0.smithi148.stdout:7/417: truncate d0/f2 3194160 0 2024-02-28T16:26:37.467 INFO:tasks.workunit.client.0.smithi148.stdout:1/335: dwrite d2/d5/d40/f1b [0,4194304] 0 2024-02-28T16:26:37.469 INFO:tasks.workunit.client.0.smithi148.stdout:7/418: rmdir d0/d9/d25/d47/d28/d2b/d3a/d49/d75 0 2024-02-28T16:26:37.471 INFO:tasks.workunit.client.0.smithi148.stdout:1/336: chown d2/d15/f35 0 1 2024-02-28T16:26:37.472 INFO:tasks.workunit.client.0.smithi148.stdout:0/527: dwrite d1/d15/d27/d34/d5a/d9d/d4a/d92/f9f [0,4194304] 0 2024-02-28T16:26:37.479 INFO:tasks.workunit.client.0.smithi148.stdout:1/337: mkdir d2/d15/d62 0 2024-02-28T16:26:37.482 INFO:tasks.workunit.client.0.smithi148.stdout:0/528: symlink d1/d15/d27/d34/d5a/lad 0 2024-02-28T16:26:37.484 INFO:tasks.workunit.client.0.smithi148.stdout:1/338: truncate d2/d5/d40/d8/f21 5715969 0 2024-02-28T16:26:37.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/529: readlink d1/d15/l1e 0 2024-02-28T16:26:37.486 INFO:tasks.workunit.client.0.smithi148.stdout:1/339: read - d2/d15/f35 zero size 2024-02-28T16:26:37.489 INFO:tasks.workunit.client.0.smithi148.stdout:0/530: symlink d1/d15/d27/d34/d5a/d71/lae 0 2024-02-28T16:26:37.492 INFO:tasks.workunit.client.0.smithi148.stdout:0/531: mkdir d1/d15/d3d/d67/daf 0 2024-02-28T16:26:37.496 INFO:tasks.workunit.client.0.smithi148.stdout:0/532: creat d1/d15/d27/d34/fb0 x:0 0 0 2024-02-28T16:26:37.498 INFO:tasks.workunit.client.0.smithi148.stdout:7/419: rmdir d0/d9/d25/d47/d28/d2b/d3a/d49 39 2024-02-28T16:26:37.504 INFO:tasks.workunit.client.0.smithi148.stdout:1/340: write d2/d5/d40/d7/f47 [849708,126353] 0 2024-02-28T16:26:37.511 INFO:tasks.workunit.client.0.smithi148.stdout:7/420: truncate d0/d9/d25/d47/d1c/d32/f3d 49477 0 2024-02-28T16:26:37.513 INFO:tasks.workunit.client.0.smithi148.stdout:0/533: dwrite d1/d15/d3d/f43 [0,4194304] 0 2024-02-28T16:26:37.515 INFO:tasks.workunit.client.0.smithi148.stdout:7/421: mkdir d0/d9/d25/d47/d28/d2b/d6f/d82 0 2024-02-28T16:26:37.523 INFO:tasks.workunit.client.0.smithi148.stdout:0/534: rename d1/d15/f44 to d1/d15/d27/d34/d5a/d71/d80/fb1 0 2024-02-28T16:26:37.523 INFO:tasks.workunit.client.0.smithi148.stdout:1/341: dwrite d2/d5/d40/d8/f21 [4194304,4194304] 0 2024-02-28T16:26:37.524 INFO:tasks.workunit.client.0.smithi148.stdout:7/422: truncate d0/d9/d25/d47/d28/d2b/d3a/d49/f6d 751906 0 2024-02-28T16:26:37.530 INFO:tasks.workunit.client.0.smithi148.stdout:1/342: creat d2/d15/d33/f63 x:0 0 0 2024-02-28T16:26:37.531 INFO:tasks.workunit.client.0.smithi148.stdout:7/423: mknod d0/d9/d46/d65/c83 0 2024-02-28T16:26:37.538 INFO:tasks.workunit.client.0.smithi148.stdout:1/343: fsync d2/d5/d40/d7/f12 0 2024-02-28T16:26:37.541 INFO:tasks.workunit.client.0.smithi148.stdout:0/535: write d1/d15/d27/d7a/f4e [8739096,27995] 0 2024-02-28T16:26:37.543 INFO:tasks.workunit.client.0.smithi148.stdout:1/344: creat d2/d5/d40/d7/f64 x:0 0 0 2024-02-28T16:26:37.547 INFO:tasks.workunit.client.0.smithi148.stdout:0/536: symlink d1/d15/d27/d34/d5a/d9d/d5f/lb2 0 2024-02-28T16:26:37.549 INFO:tasks.workunit.client.0.smithi148.stdout:1/345: creat d2/d15/d62/f65 x:0 0 0 2024-02-28T16:26:37.553 INFO:tasks.workunit.client.0.smithi148.stdout:0/537: mknod d1/d15/d27/d34/d5a/cb3 0 2024-02-28T16:26:37.557 INFO:tasks.workunit.client.0.smithi148.stdout:4/329: sync 2024-02-28T16:26:37.558 INFO:tasks.workunit.client.0.smithi148.stdout:4/330: read - d8/df/d17/f2c zero size 2024-02-28T16:26:37.560 INFO:tasks.workunit.client.0.smithi148.stdout:4/331: chown d8/l45 0 1 2024-02-28T16:26:37.563 INFO:tasks.workunit.client.0.smithi148.stdout:4/332: mkdir d8/d71 0 2024-02-28T16:26:37.566 INFO:tasks.workunit.client.0.smithi148.stdout:4/333: chown d8/d37/f4f 28 1 2024-02-28T16:26:37.567 INFO:tasks.workunit.client.0.smithi148.stdout:1/346: dwrite d2/d5/d40/f16 [0,4194304] 0 2024-02-28T16:26:37.571 INFO:tasks.workunit.client.0.smithi148.stdout:1/347: dread - d2/d5/d40/d8/f61 zero size 2024-02-28T16:26:37.573 INFO:tasks.workunit.client.0.smithi148.stdout:0/538: dwrite d1/d15/d27/d34/d5a/d71/d80/fb1 [0,4194304] 0 2024-02-28T16:26:37.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/334: mkdir d8/d21/d3d/d4d/d72 0 2024-02-28T16:26:37.580 INFO:tasks.workunit.client.0.smithi148.stdout:1/348: symlink d2/d5/l66 0 2024-02-28T16:26:37.584 INFO:tasks.workunit.client.0.smithi148.stdout:0/539: link d1/d15/d27/d7a/l5d d1/d15/d27/d34/d5a/d9d/d5f/lb4 0 2024-02-28T16:26:37.594 INFO:tasks.workunit.client.0.smithi148.stdout:4/335: write d8/f11 [1921325,116129] 0 2024-02-28T16:26:37.599 INFO:tasks.workunit.client.0.smithi148.stdout:4/336: mkdir d8/d40/d73 0 2024-02-28T16:26:37.599 INFO:tasks.workunit.client.0.smithi148.stdout:1/349: dwrite d2/d15/f4d [0,4194304] 0 2024-02-28T16:26:37.603 INFO:tasks.workunit.client.0.smithi148.stdout:1/350: chown d2/d5/d40/d7/l2a 347630333 1 2024-02-28T16:26:37.603 INFO:tasks.workunit.client.0.smithi148.stdout:0/540: dwrite d1/d15/d3d/fa2 [0,4194304] 0 2024-02-28T16:26:37.607 INFO:tasks.workunit.client.0.smithi148.stdout:0/541: fdatasync d1/d15/d8/f30 0 2024-02-28T16:26:37.609 INFO:tasks.workunit.client.0.smithi148.stdout:1/351: getdents d2/d5/d2b 0 2024-02-28T16:26:37.614 INFO:tasks.workunit.client.0.smithi148.stdout:1/352: link d2/d15/d33/f63 d2/d5/d1a/f67 0 2024-02-28T16:26:37.619 INFO:tasks.workunit.client.0.smithi148.stdout:1/353: mknod d2/c68 0 2024-02-28T16:26:37.619 INFO:tasks.workunit.client.0.smithi148.stdout:4/337: dwrite d8/f14 [0,4194304] 0 2024-02-28T16:26:37.621 INFO:tasks.workunit.client.0.smithi148.stdout:0/542: truncate d1/d15/d27/d34/d5a/d6c/f75 1460167 0 2024-02-28T16:26:37.621 INFO:tasks.workunit.client.0.smithi148.stdout:1/354: rmdir d2/d5 39 2024-02-28T16:26:37.630 INFO:tasks.workunit.client.0.smithi148.stdout:1/355: truncate d2/d5/d40/d8/f9 5532295 0 2024-02-28T16:26:37.635 INFO:tasks.workunit.client.0.smithi148.stdout:4/338: write d8/d21/f24 [1142183,75906] 0 2024-02-28T16:26:37.637 INFO:tasks.workunit.client.0.smithi148.stdout:1/356: getdents d2/d15/d62 0 2024-02-28T16:26:37.638 INFO:tasks.workunit.client.0.smithi148.stdout:1/357: readlink d2/l18 0 2024-02-28T16:26:37.640 INFO:tasks.workunit.client.0.smithi148.stdout:4/339: mknod d8/df/d1f/c74 0 2024-02-28T16:26:37.641 INFO:tasks.workunit.client.0.smithi148.stdout:1/358: write d2/d5/d40/d8/f61 [646997,32172] 0 2024-02-28T16:26:37.645 INFO:tasks.workunit.client.0.smithi148.stdout:4/340: link d8/df/d17/f2c d8/d40/f75 0 2024-02-28T16:26:37.648 INFO:tasks.workunit.client.0.smithi148.stdout:4/341: truncate d8/df/d1f/f4b 286810 0 2024-02-28T16:26:37.650 INFO:tasks.workunit.client.0.smithi148.stdout:4/342: symlink d8/d37/l76 0 2024-02-28T16:26:37.655 INFO:tasks.workunit.client.0.smithi148.stdout:1/359: truncate d2/d5/d1a/f24 209972 0 2024-02-28T16:26:37.657 INFO:tasks.workunit.client.0.smithi148.stdout:4/343: dread d8/df/d1f/f4b [0,4194304] 0 2024-02-28T16:26:37.658 INFO:tasks.workunit.client.0.smithi148.stdout:1/360: symlink d2/d3f/l69 0 2024-02-28T16:26:37.658 INFO:tasks.workunit.client.0.smithi148.stdout:4/344: fdatasync d8/d21/f24 0 2024-02-28T16:26:37.659 INFO:tasks.workunit.client.0.smithi148.stdout:1/361: fdatasync d2/d15/d62/f65 0 2024-02-28T16:26:37.659 INFO:tasks.workunit.client.0.smithi148.stdout:1/362: stat d2/f51 0 2024-02-28T16:26:37.660 INFO:tasks.workunit.client.0.smithi148.stdout:4/345: truncate d8/d40/f75 331073 0 2024-02-28T16:26:37.662 INFO:tasks.workunit.client.0.smithi148.stdout:1/363: creat d2/d5/d40/d7/f6a x:0 0 0 2024-02-28T16:26:37.663 INFO:tasks.workunit.client.0.smithi148.stdout:4/346: dread - d8/df/d17/d6a/f3a zero size 2024-02-28T16:26:37.664 INFO:tasks.workunit.client.0.smithi148.stdout:1/364: truncate d2/d5/d1a/f43 4229920 0 2024-02-28T16:26:37.665 INFO:tasks.workunit.client.0.smithi148.stdout:1/365: chown d2/l34 26 1 2024-02-28T16:26:37.667 INFO:tasks.workunit.client.0.smithi148.stdout:1/366: symlink d2/d5/d2b/l6b 0 2024-02-28T16:26:37.670 INFO:tasks.workunit.client.0.smithi148.stdout:1/367: creat d2/f6c x:0 0 0 2024-02-28T16:26:37.676 INFO:tasks.workunit.client.0.smithi148.stdout:1/368: rename d2/d5/d40/f23 to d2/d5/d40/f6d 0 2024-02-28T16:26:37.679 INFO:tasks.workunit.client.0.smithi148.stdout:4/347: dwrite d8/df/d17/d6a/f50 [0,4194304] 0 2024-02-28T16:26:37.682 INFO:tasks.workunit.client.0.smithi148.stdout:1/369: creat d2/d5/d40/d7/f6e x:0 0 0 2024-02-28T16:26:37.687 INFO:tasks.workunit.client.0.smithi148.stdout:1/370: chown d2/d5/d1a/c48 1871861 1 2024-02-28T16:26:37.689 INFO:tasks.workunit.client.0.smithi148.stdout:4/348: rmdir d8/df 39 2024-02-28T16:26:37.692 INFO:tasks.workunit.client.0.smithi148.stdout:1/371: mknod d2/d5/d40/d7/c6f 0 2024-02-28T16:26:37.698 INFO:tasks.workunit.client.0.smithi148.stdout:4/349: creat d8/d21/d3d/d4d/d72/f77 x:0 0 0 2024-02-28T16:26:37.709 INFO:tasks.workunit.client.0.smithi148.stdout:4/350: rename d8/df/d17/d6a/f49 to d8/f78 0 2024-02-28T16:26:37.709 INFO:tasks.workunit.client.0.smithi148.stdout:1/372: write d2/d5/d1a/f67 [430938,574] 0 2024-02-28T16:26:37.711 INFO:tasks.workunit.client.0.smithi148.stdout:4/351: chown d8/d21/f68 11 1 2024-02-28T16:26:37.720 INFO:tasks.workunit.client.0.smithi148.stdout:4/352: creat d8/df/d5f/f79 x:0 0 0 2024-02-28T16:26:37.727 INFO:tasks.workunit.client.0.smithi148.stdout:1/373: dwrite d2/d5/d40/d8/f21 [8388608,4194304] 0 2024-02-28T16:26:37.730 INFO:tasks.workunit.client.0.smithi148.stdout:4/353: link d8/f14 d8/d40/d73/f7a 0 2024-02-28T16:26:37.732 INFO:tasks.workunit.client.0.smithi148.stdout:1/374: mknod d2/d5/d40/d7/c70 0 2024-02-28T16:26:37.732 INFO:tasks.workunit.client.0.smithi148.stdout:2/392: sync 2024-02-28T16:26:37.734 INFO:tasks.workunit.client.0.smithi148.stdout:2/393: fdatasync d0/d18/f28 0 2024-02-28T16:26:37.736 INFO:tasks.workunit.client.0.smithi148.stdout:4/354: rename d8/f11 to d8/df/d5f/f7b 0 2024-02-28T16:26:37.738 INFO:tasks.workunit.client.0.smithi148.stdout:1/375: creat d2/d3f/f71 x:0 0 0 2024-02-28T16:26:37.748 INFO:tasks.workunit.client.0.smithi148.stdout:4/355: mkdir d8/df/d7c 0 2024-02-28T16:26:37.750 INFO:tasks.workunit.client.0.smithi148.stdout:1/376: dread d2/d5/d40/d8/f61 [0,4194304] 0 2024-02-28T16:26:37.757 INFO:tasks.workunit.client.0.smithi148.stdout:1/377: getdents d2/d15 0 2024-02-28T16:26:37.759 INFO:tasks.workunit.client.0.smithi148.stdout:1/378: fsync d2/d5/d1a/f67 0 2024-02-28T16:26:37.761 INFO:tasks.workunit.client.0.smithi148.stdout:4/356: dread d8/d21/d3d/d4d/f58 [0,4194304] 0 2024-02-28T16:26:37.763 INFO:tasks.workunit.client.0.smithi148.stdout:4/357: chown d8/d21/f67 24625 1 2024-02-28T16:26:37.764 INFO:tasks.workunit.client.0.smithi148.stdout:2/394: dread d0/dd/f40 [0,4194304] 0 2024-02-28T16:26:37.766 INFO:tasks.workunit.client.0.smithi148.stdout:4/358: write d8/d21/d3d/d4d/f58 [2618898,82589] 0 2024-02-28T16:26:37.766 INFO:tasks.workunit.client.0.smithi148.stdout:2/395: rmdir d0/d1c/d6e 39 2024-02-28T16:26:37.769 INFO:tasks.workunit.client.0.smithi148.stdout:2/396: creat d0/d59/f7f x:0 0 0 2024-02-28T16:26:37.772 INFO:tasks.workunit.client.0.smithi148.stdout:2/397: creat d0/d9/d13/f80 x:0 0 0 2024-02-28T16:26:37.778 INFO:tasks.workunit.client.0.smithi148.stdout:2/398: dread d0/d1d/d52/d54/f7b [0,4194304] 0 2024-02-28T16:26:37.783 INFO:tasks.workunit.client.0.smithi148.stdout:1/379: getdents d2/d3f 0 2024-02-28T16:26:37.788 INFO:tasks.workunit.client.0.smithi148.stdout:1/380: fsync d2/d5/d40/f16 0 2024-02-28T16:26:37.790 INFO:tasks.workunit.client.0.smithi148.stdout:2/399: getdents d0/d1c/d6e 0 2024-02-28T16:26:37.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/413: sync 2024-02-28T16:26:37.792 INFO:tasks.workunit.client.0.smithi148.stdout:5/399: sync 2024-02-28T16:26:37.792 INFO:tasks.workunit.client.0.smithi148.stdout:6/386: sync 2024-02-28T16:26:37.792 INFO:tasks.workunit.client.0.smithi148.stdout:9/385: sync 2024-02-28T16:26:37.792 INFO:tasks.workunit.client.0.smithi148.stdout:0/543: sync 2024-02-28T16:26:37.793 INFO:tasks.workunit.client.0.smithi148.stdout:7/424: sync 2024-02-28T16:26:37.793 INFO:tasks.workunit.client.0.smithi148.stdout:3/528: sync 2024-02-28T16:26:37.793 INFO:tasks.workunit.client.0.smithi148.stdout:2/400: dread - d0/dd/d2b/f4f zero size 2024-02-28T16:26:37.793 INFO:tasks.workunit.client.0.smithi148.stdout:1/381: symlink d2/d5/d40/d7/l72 0 2024-02-28T16:26:37.796 INFO:tasks.workunit.client.0.smithi148.stdout:0/544: creat d1/d8a/fb5 x:0 0 0 2024-02-28T16:26:37.800 INFO:tasks.workunit.client.0.smithi148.stdout:8/414: write d1/d3/d18/d48/ff [4919251,12723] 0 2024-02-28T16:26:37.800 INFO:tasks.workunit.client.0.smithi148.stdout:9/386: mkdir d7/d1c/d59/d83/d88 0 2024-02-28T16:26:37.801 INFO:tasks.workunit.client.0.smithi148.stdout:4/359: write d8/df/d17/d6a/f3a [103408,25511] 0 2024-02-28T16:26:37.806 INFO:tasks.workunit.client.0.smithi148.stdout:9/387: chown d7/c11 2062092677 1 2024-02-28T16:26:37.807 INFO:tasks.workunit.client.0.smithi148.stdout:7/425: getdents d0/d4 0 2024-02-28T16:26:37.808 INFO:tasks.workunit.client.0.smithi148.stdout:8/415: write d1/dd/d13/d24/d3a/f69 [397751,101195] 0 2024-02-28T16:26:37.810 INFO:tasks.workunit.client.0.smithi148.stdout:9/388: readlink d7/d1c/l41 0 2024-02-28T16:26:37.810 INFO:tasks.workunit.client.0.smithi148.stdout:4/360: read - d8/d21/d3d/d4d/f5c zero size 2024-02-28T16:26:37.817 INFO:tasks.workunit.client.0.smithi148.stdout:2/401: getdents d0/d18/d20/d46 0 2024-02-28T16:26:37.820 INFO:tasks.workunit.client.0.smithi148.stdout:7/426: write d0/d4/f63 [1442934,33217] 0 2024-02-28T16:26:37.822 INFO:tasks.workunit.client.0.smithi148.stdout:3/529: rename d1/d13/d19/d94/d9a to d1/d13/d19/d1b/d38/d9b 0 2024-02-28T16:26:37.827 INFO:tasks.workunit.client.0.smithi148.stdout:4/361: mknod d8/d37/c7d 0 2024-02-28T16:26:37.831 INFO:tasks.workunit.client.0.smithi148.stdout:2/402: mkdir d0/d18/d20/d73/d81 0 2024-02-28T16:26:37.835 INFO:tasks.workunit.client.0.smithi148.stdout:5/400: dwrite d1/d1a/f66 [8388608,4194304] 0 2024-02-28T16:26:37.835 INFO:tasks.workunit.client.0.smithi148.stdout:7/427: creat d0/d9/d46/d65/f84 x:0 0 0 2024-02-28T16:26:37.837 INFO:tasks.workunit.client.0.smithi148.stdout:6/387: dwrite d0/d8/f67 [0,4194304] 0 2024-02-28T16:26:37.839 INFO:tasks.workunit.client.0.smithi148.stdout:8/416: truncate d1/d3/d18/d48/d22/d34/f65 1175106 0 2024-02-28T16:26:37.841 INFO:tasks.workunit.client.0.smithi148.stdout:6/388: chown d0/d4/f3c 80551864 1 2024-02-28T16:26:37.843 INFO:tasks.workunit.client.0.smithi148.stdout:0/545: dwrite d1/d15/d3d/fa2 [0,4194304] 0 2024-02-28T16:26:37.931 INFO:tasks.workunit.client.0.smithi148.stdout:5/401: mknod d1/d1a/c78 0 2024-02-28T16:26:37.931 INFO:tasks.workunit.client.0.smithi148.stdout:7/428: creat d0/d9/d25/d47/d28/d2b/d5c/f85 x:0 0 0 2024-02-28T16:26:37.935 INFO:tasks.workunit.client.0.smithi148.stdout:1/382: dwrite d2/d5/d40/d7/f38 [0,4194304] 0 2024-02-28T16:26:37.936 INFO:tasks.workunit.client.0.smithi148.stdout:6/389: chown d0/d22/d25/d3a 10 1 2024-02-28T16:26:37.941 INFO:tasks.workunit.client.0.smithi148.stdout:0/546: chown d1/d15/d27/d34/d5a/d71/d80/fb1 892 1 2024-02-28T16:26:37.942 INFO:tasks.workunit.client.0.smithi148.stdout:1/383: mknod d2/d5/d2b/c73 0 2024-02-28T16:26:37.943 INFO:tasks.workunit.client.0.smithi148.stdout:5/402: write d1/d8/d20/d31/d50/f56 [769454,122816] 0 2024-02-28T16:26:37.944 INFO:tasks.workunit.client.0.smithi148.stdout:4/362: dwrite d8/d21/f56 [0,4194304] 0 2024-02-28T16:26:37.952 INFO:tasks.workunit.client.0.smithi148.stdout:6/390: rename d0/d22/d25/c46 to d0/c77 0 2024-02-28T16:26:37.952 INFO:tasks.workunit.client.0.smithi148.stdout:3/530: dwrite d1/f7b [0,4194304] 0 2024-02-28T16:26:37.952 INFO:tasks.workunit.client.0.smithi148.stdout:4/363: mkdir d8/d21/d7e 0 2024-02-28T16:26:37.954 INFO:tasks.workunit.client.0.smithi148.stdout:1/384: read d2/d5/d40/d7/f38 [2328050,113078] 0 2024-02-28T16:26:37.954 INFO:tasks.workunit.client.0.smithi148.stdout:9/389: dwrite d7/dd/f2b [0,4194304] 0 2024-02-28T16:26:37.954 INFO:tasks.workunit.client.0.smithi148.stdout:5/403: symlink d1/db/d25/l79 0 2024-02-28T16:26:37.962 INFO:tasks.workunit.client.0.smithi148.stdout:8/417: dwrite d1/dd/d13/d1a/f3e [0,4194304] 0 2024-02-28T16:26:37.963 INFO:tasks.workunit.client.0.smithi148.stdout:7/429: rename d0/d9/d25/d47/d28/d2b/d3a/f5b to d0/d4/d70/f86 0 2024-02-28T16:26:37.969 INFO:tasks.workunit.client.0.smithi148.stdout:3/531: mkdir d1/db/d35/d70/d9c 0 2024-02-28T16:26:37.969 INFO:tasks.workunit.client.0.smithi148.stdout:5/404: mkdir d1/db/d60/d7a 0 2024-02-28T16:26:37.970 INFO:tasks.workunit.client.0.smithi148.stdout:9/390: creat d7/d1c/d1f/d49/f89 x:0 0 0 2024-02-28T16:26:37.972 INFO:tasks.workunit.client.0.smithi148.stdout:9/391: chown d7/d1c/c3a 39 1 2024-02-28T16:26:37.983 INFO:tasks.workunit.client.0.smithi148.stdout:4/364: mknod d8/df/c7f 0 2024-02-28T16:26:37.984 INFO:tasks.workunit.client.0.smithi148.stdout:0/547: rename d1/d15/d3d/d67/d7b to d1/d15/d27/d34/d5a/d71/d80/db6 0 2024-02-28T16:26:37.984 INFO:tasks.workunit.client.0.smithi148.stdout:8/418: dwrite d1/d3/d18/d5a/d60/f6d [0,4194304] 0 2024-02-28T16:26:37.987 INFO:tasks.workunit.client.0.smithi148.stdout:7/430: mknod d0/d4/d70/c87 0 2024-02-28T16:26:37.987 INFO:tasks.workunit.client.0.smithi148.stdout:8/419: readlink d1/d3/d18/d48/d22/d55/l5b 0 2024-02-28T16:26:37.988 INFO:tasks.workunit.client.0.smithi148.stdout:7/431: readlink d0/d9/l21 0 2024-02-28T16:26:37.993 INFO:tasks.workunit.client.0.smithi148.stdout:0/548: chown d1/d15/d27/d7a/c4d 1091 1 2024-02-28T16:26:37.996 INFO:tasks.workunit.client.0.smithi148.stdout:0/549: chown d1/d15/d27/d34/d5a/f66 871896 1 2024-02-28T16:26:37.997 INFO:tasks.workunit.client.0.smithi148.stdout:7/432: mknod d0/d18/c88 0 2024-02-28T16:26:38.000 INFO:tasks.workunit.client.0.smithi148.stdout:5/405: rename d1/d1a/f2b to d1/d8/f7b 0 2024-02-28T16:26:38.001 INFO:tasks.workunit.client.0.smithi148.stdout:6/391: link d0/d4/d14/l19 d0/d4/l78 0 2024-02-28T16:26:38.002 INFO:tasks.workunit.client.0.smithi148.stdout:8/420: truncate d1/f27 487040 0 2024-02-28T16:26:38.007 INFO:tasks.workunit.client.0.smithi148.stdout:0/550: mkdir d1/d15/d27/d34/d5a/d71/d74/d7e/db7 0 2024-02-28T16:26:38.009 INFO:tasks.workunit.client.0.smithi148.stdout:3/532: dread d1/d13/d19/d56/f63 [0,4194304] 0 2024-02-28T16:26:38.014 INFO:tasks.workunit.client.0.smithi148.stdout:3/533: read d1/d13/f1e [391051,12719] 0 2024-02-28T16:26:38.015 INFO:tasks.workunit.client.0.smithi148.stdout:0/551: rename d1/f6 to d1/d15/d27/fb8 0 2024-02-28T16:26:38.019 INFO:tasks.workunit.client.0.smithi148.stdout:7/433: link d0/d9/d25/d47/d1c/d32/l40 d0/d9/d25/d39/l89 0 2024-02-28T16:26:38.020 INFO:tasks.workunit.client.0.smithi148.stdout:3/534: rmdir d1/db/d35/d70 39 2024-02-28T16:26:38.020 INFO:tasks.workunit.client.0.smithi148.stdout:0/552: rmdir d1/d15/d27/d34/d5a/d6c 39 2024-02-28T16:26:38.022 INFO:tasks.workunit.client.0.smithi148.stdout:6/392: dwrite d0/d22/f37 [0,4194304] 0 2024-02-28T16:26:38.022 INFO:tasks.workunit.client.0.smithi148.stdout:3/535: stat d1/db/d45/f96 0 2024-02-28T16:26:38.023 INFO:tasks.workunit.client.0.smithi148.stdout:3/536: chown d1/d3f/l42 10 1 2024-02-28T16:26:38.025 INFO:tasks.workunit.client.0.smithi148.stdout:1/385: truncate d2/d5/d40/f53 1236149 0 2024-02-28T16:26:38.027 INFO:tasks.workunit.client.0.smithi148.stdout:4/365: write d8/df/d1f/f4b [1320562,47230] 0 2024-02-28T16:26:38.031 INFO:tasks.workunit.client.0.smithi148.stdout:6/393: unlink d0/d4/d14/c6d 0 2024-02-28T16:26:38.032 INFO:tasks.workunit.client.0.smithi148.stdout:3/537: chown d1/db/d35/d70 350805481 1 2024-02-28T16:26:38.040 INFO:tasks.workunit.client.0.smithi148.stdout:0/553: rename d1/d4/l96 to d1/d15/d27/d7a/lb9 0 2024-02-28T16:26:38.042 INFO:tasks.workunit.client.0.smithi148.stdout:7/434: dwrite d0/d9/d4c/f6b [0,4194304] 0 2024-02-28T16:26:38.043 INFO:tasks.workunit.client.0.smithi148.stdout:4/366: symlink d8/df/d1f/l80 0 2024-02-28T16:26:38.049 INFO:tasks.workunit.client.0.smithi148.stdout:5/406: mknod d1/d8/d20/d31/d50/c7c 0 2024-02-28T16:26:38.052 INFO:tasks.workunit.client.0.smithi148.stdout:8/421: truncate d1/d3/f1e 352095 0 2024-02-28T16:26:38.054 INFO:tasks.workunit.client.0.smithi148.stdout:4/367: fdatasync d8/df/f34 0 2024-02-28T16:26:38.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/394: dwrite d0/d22/d27/f62 [4194304,4194304] 0 2024-02-28T16:26:38.065 INFO:tasks.workunit.client.0.smithi148.stdout:5/407: fdatasync d1/db/f27 0 2024-02-28T16:26:38.069 INFO:tasks.workunit.client.0.smithi148.stdout:8/422: rmdir d1/dd/d13/d24 39 2024-02-28T16:26:38.073 INFO:tasks.workunit.client.0.smithi148.stdout:8/423: write d1/dd/d54/f6b [881673,56970] 0 2024-02-28T16:26:38.074 INFO:tasks.workunit.client.0.smithi148.stdout:1/386: dwrite d2/d5/d1a/f3a [0,4194304] 0 2024-02-28T16:26:38.076 INFO:tasks.workunit.client.0.smithi148.stdout:4/368: chown d8/d21/f54 851 1 2024-02-28T16:26:38.082 INFO:tasks.workunit.client.0.smithi148.stdout:7/435: link d0/d4/l5e d0/d9/d25/d47/d1c/d32/l8a 0 2024-02-28T16:26:38.085 INFO:tasks.workunit.client.0.smithi148.stdout:8/424: fsync d1/dd/d13/d24/d3a/f59 0 2024-02-28T16:26:38.088 INFO:tasks.workunit.client.0.smithi148.stdout:6/395: creat d0/d22/d25/d76/f79 x:0 0 0 2024-02-28T16:26:38.090 INFO:tasks.workunit.client.0.smithi148.stdout:7/436: write d0/d4/f63 [279727,21077] 0 2024-02-28T16:26:38.090 INFO:tasks.workunit.client.0.smithi148.stdout:4/369: creat d8/df/d5f/f81 x:0 0 0 2024-02-28T16:26:38.094 INFO:tasks.workunit.client.0.smithi148.stdout:5/408: dwrite d1/d1a/f45 [0,4194304] 0 2024-02-28T16:26:38.095 INFO:tasks.workunit.client.0.smithi148.stdout:8/425: chown d1/dd/d13/d68/f30 108742167 1 2024-02-28T16:26:38.099 INFO:tasks.workunit.client.0.smithi148.stdout:3/538: dwrite d1/db/d45/f98 [0,4194304] 0 2024-02-28T16:26:38.100 INFO:tasks.workunit.client.0.smithi148.stdout:1/387: rmdir d2/d5/d2b/d4a/d5d 0 2024-02-28T16:26:38.104 INFO:tasks.workunit.client.0.smithi148.stdout:5/409: symlink d1/d8/d20/d4e/d71/l7d 0 2024-02-28T16:26:38.105 INFO:tasks.workunit.client.0.smithi148.stdout:8/426: stat d1/d3/d18/d48/d70/d75/d84 0 2024-02-28T16:26:38.106 INFO:tasks.workunit.client.0.smithi148.stdout:4/370: creat d8/d21/d3d/d4d/d66/f82 x:0 0 0 2024-02-28T16:26:38.109 INFO:tasks.workunit.client.0.smithi148.stdout:1/388: chown d2/d5/d2b/c5c 3440 1 2024-02-28T16:26:38.110 INFO:tasks.workunit.client.0.smithi148.stdout:0/554: dwrite d1/d4/d25/f50 [0,4194304] 0 2024-02-28T16:26:38.117 INFO:tasks.workunit.client.0.smithi148.stdout:0/555: fsync d1/d15/d27/d34/f6d 0 2024-02-28T16:26:38.122 INFO:tasks.workunit.client.0.smithi148.stdout:5/410: chown d1/d8/c10 117341 1 2024-02-28T16:26:38.123 INFO:tasks.workunit.client.0.smithi148.stdout:7/437: write d0/d9/d25/d47/d28/d2b/d6f/f7f [803463,104498] 0 2024-02-28T16:26:38.127 INFO:tasks.workunit.client.0.smithi148.stdout:6/396: creat d0/d4/f7a x:0 0 0 2024-02-28T16:26:38.128 INFO:tasks.workunit.client.0.smithi148.stdout:4/371: mknod d8/d21/d3d/d4d/d66/c83 0 2024-02-28T16:26:38.130 INFO:tasks.workunit.client.0.smithi148.stdout:1/389: creat d2/d5/d2b/d4a/f74 x:0 0 0 2024-02-28T16:26:38.132 INFO:tasks.workunit.client.0.smithi148.stdout:8/427: mknod d1/dd/c85 0 2024-02-28T16:26:38.133 INFO:tasks.workunit.client.0.smithi148.stdout:1/390: dread - d2/d3f/f71 zero size 2024-02-28T16:26:38.133 INFO:tasks.workunit.client.0.smithi148.stdout:6/397: write d0/d4/f3c [1641936,7626] 0 2024-02-28T16:26:38.134 INFO:tasks.workunit.client.0.smithi148.stdout:4/372: chown d8/df/f1b 787 1 2024-02-28T16:26:38.136 INFO:tasks.workunit.client.0.smithi148.stdout:0/556: getdents d1/d15/d27/d34/d5a/d9d/d5f/d93/d9b/da7 0 2024-02-28T16:26:38.137 INFO:tasks.workunit.client.0.smithi148.stdout:3/539: dwrite d1/db/d35/d70/d71/f83 [0,4194304] 0 2024-02-28T16:26:38.143 INFO:tasks.workunit.client.0.smithi148.stdout:4/373: chown d8/f12 4160772 1 2024-02-28T16:26:38.144 INFO:tasks.workunit.client.0.smithi148.stdout:0/557: write d1/d15/d8/f1d [3406554,118479] 0 2024-02-28T16:26:38.145 INFO:tasks.workunit.client.0.smithi148.stdout:7/438: creat d0/d9/d25/d47/d28/d2b/d3a/f8b x:0 0 0 2024-02-28T16:26:38.147 INFO:tasks.workunit.client.0.smithi148.stdout:7/439: readlink d0/d4/l17 0 2024-02-28T16:26:38.151 INFO:tasks.workunit.client.0.smithi148.stdout:4/374: write d8/df/f4a [884627,44394] 0 2024-02-28T16:26:38.155 INFO:tasks.workunit.client.0.smithi148.stdout:2/403: sync 2024-02-28T16:26:38.155 INFO:tasks.workunit.client.0.smithi148.stdout:9/392: sync 2024-02-28T16:26:38.157 INFO:tasks.workunit.client.0.smithi148.stdout:3/540: rmdir d1/d13/d19/d1b/d38/d7c 39 2024-02-28T16:26:38.160 INFO:tasks.workunit.client.0.smithi148.stdout:0/558: stat d1/d15/d27/d34/d5a/d6c/f75 0 2024-02-28T16:26:38.163 INFO:tasks.workunit.client.0.smithi148.stdout:8/428: rename d1/dd/d13/d68/l83 to d1/d3/l86 0 2024-02-28T16:26:38.164 INFO:tasks.workunit.client.0.smithi148.stdout:0/559: write d1/d15/d3d/f43 [2938706,95981] 0 2024-02-28T16:26:38.165 INFO:tasks.workunit.client.0.smithi148.stdout:6/398: dwrite d0/d22/f38 [8388608,4194304] 0 2024-02-28T16:26:38.167 INFO:tasks.workunit.client.0.smithi148.stdout:2/404: rename d0/dd/f40 to d0/dd/f82 0 2024-02-28T16:26:38.170 INFO:tasks.workunit.client.0.smithi148.stdout:6/399: fdatasync d0/d22/d27/d3e/f45 0 2024-02-28T16:26:38.174 INFO:tasks.workunit.client.0.smithi148.stdout:5/411: dread d1/d44/d65/f76 [0,4194304] 0 2024-02-28T16:26:38.179 INFO:tasks.workunit.client.0.smithi148.stdout:1/391: getdents d2/d5/d2b/d4a 0 2024-02-28T16:26:38.182 INFO:tasks.workunit.client.0.smithi148.stdout:0/560: readlink d1/d15/d27/d7a/l5d 0 2024-02-28T16:26:38.182 INFO:tasks.workunit.client.0.smithi148.stdout:2/405: symlink d0/d18/d20/l83 0 2024-02-28T16:26:38.182 INFO:tasks.workunit.client.0.smithi148.stdout:9/393: dwrite d7/d1c/d1f/f4a [0,4194304] 0 2024-02-28T16:26:38.184 INFO:tasks.workunit.client.0.smithi148.stdout:2/406: write d0/d1d/f70 [565286,93108] 0 2024-02-28T16:26:38.186 INFO:tasks.workunit.client.0.smithi148.stdout:3/541: unlink d1/db/d35/d52/f66 0 2024-02-28T16:26:38.186 INFO:tasks.workunit.client.0.smithi148.stdout:6/400: creat d0/d22/d27/d3e/f7b x:0 0 0 2024-02-28T16:26:38.187 INFO:tasks.workunit.client.0.smithi148.stdout:5/412: creat d1/db/d25/f7e x:0 0 0 2024-02-28T16:26:38.189 INFO:tasks.workunit.client.0.smithi148.stdout:6/401: chown d0/d22/d27/d66/f72 848117345 1 2024-02-28T16:26:38.189 INFO:tasks.workunit.client.0.smithi148.stdout:7/440: getdents d0/d4/d70 0 2024-02-28T16:26:38.190 INFO:tasks.workunit.client.0.smithi148.stdout:1/392: mkdir d2/d15/d62/d75 0 2024-02-28T16:26:38.190 INFO:tasks.workunit.client.0.smithi148.stdout:3/542: chown d1/d13/d19/d56/f73 85 1 2024-02-28T16:26:38.192 INFO:tasks.workunit.client.0.smithi148.stdout:5/413: chown d1/db/d25/f7e 918835 1 2024-02-28T16:26:38.194 INFO:tasks.workunit.client.0.smithi148.stdout:4/375: getdents d8/d21/d3d/d4d/d66 0 2024-02-28T16:26:38.194 INFO:tasks.workunit.client.0.smithi148.stdout:1/393: chown d2/f26 2723 1 2024-02-28T16:26:38.194 INFO:tasks.workunit.client.0.smithi148.stdout:5/414: stat d1/l58 0 2024-02-28T16:26:38.195 INFO:tasks.workunit.client.0.smithi148.stdout:6/402: write d0/d8/f6c [396393,100335] 0 2024-02-28T16:26:38.199 INFO:tasks.workunit.client.0.smithi148.stdout:3/543: chown d1/d13/d19/d88/f8c 39 1 2024-02-28T16:26:38.199 INFO:tasks.workunit.client.0.smithi148.stdout:7/441: chown d0/d9/d25/f2f 150 1 2024-02-28T16:26:38.200 INFO:tasks.workunit.client.0.smithi148.stdout:4/376: write d8/df/d17/d6a/f50 [4884466,61174] 0 2024-02-28T16:26:38.201 INFO:tasks.workunit.client.0.smithi148.stdout:9/394: creat d7/d1c/d59/d83/d88/f8a x:0 0 0 2024-02-28T16:26:38.203 INFO:tasks.workunit.client.0.smithi148.stdout:4/377: truncate d8/df/f4a 4273248 0 2024-02-28T16:26:38.204 INFO:tasks.workunit.client.0.smithi148.stdout:8/429: getdents d1/d3/d18/d5a/d60 0 2024-02-28T16:26:38.211 INFO:tasks.workunit.client.0.smithi148.stdout:1/394: dread d2/d5/d1a/f42 [0,4194304] 0 2024-02-28T16:26:38.212 INFO:tasks.workunit.client.0.smithi148.stdout:6/403: write d0/d4/d14/d59/f75 [1849732,45066] 0 2024-02-28T16:26:38.217 INFO:tasks.workunit.client.0.smithi148.stdout:3/544: symlink d1/db/d35/d70/d71/l9d 0 2024-02-28T16:26:38.218 INFO:tasks.workunit.client.0.smithi148.stdout:6/404: fdatasync d0/d22/d25/d76/f79 0 2024-02-28T16:26:38.222 INFO:tasks.workunit.client.0.smithi148.stdout:0/561: creat d1/d15/d27/d34/fba x:0 0 0 2024-02-28T16:26:38.222 INFO:tasks.workunit.client.0.smithi148.stdout:2/407: truncate d0/d1d/d52/d54/f7b 282388 0 2024-02-28T16:26:38.224 INFO:tasks.workunit.client.0.smithi148.stdout:4/378: symlink d8/d40/l84 0 2024-02-28T16:26:38.225 INFO:tasks.workunit.client.0.smithi148.stdout:0/562: dread - d1/d15/d8/f52 zero size 2024-02-28T16:26:38.226 INFO:tasks.workunit.client.0.smithi148.stdout:9/395: rename d7/dd/d26/c85 to d7/d43/c8b 0 2024-02-28T16:26:38.230 INFO:tasks.workunit.client.0.smithi148.stdout:7/442: dwrite d0/d9/d25/d47/d28/d2b/d3a/f8b [0,4194304] 0 2024-02-28T16:26:38.233 INFO:tasks.workunit.client.0.smithi148.stdout:6/405: mknod d0/d4/d1b/c7c 0 2024-02-28T16:26:38.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:37 smithi157 ceph-mon[38346]: pgmap v43: 65 pgs: 65 active+clean; 759 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 5.6 MiB/s rd, 83 MiB/s wr, 183 op/s 2024-02-28T16:26:38.238 INFO:tasks.workunit.client.0.smithi148.stdout:6/406: fsync d0/d22/d25/d3a/f70 0 2024-02-28T16:26:38.239 INFO:tasks.workunit.client.0.smithi148.stdout:3/545: mkdir d1/d13/d19/d32/d9e 0 2024-02-28T16:26:38.240 INFO:tasks.workunit.client.0.smithi148.stdout:9/396: creat d7/d1c/d32/d24/d78/f8c x:0 0 0 2024-02-28T16:26:38.244 INFO:tasks.workunit.client.0.smithi148.stdout:1/395: dread d2/d5/d1a/f3a [0,4194304] 0 2024-02-28T16:26:38.245 INFO:tasks.workunit.client.0.smithi148.stdout:2/408: mkdir d0/d1d/d52/d84 0 2024-02-28T16:26:38.247 INFO:tasks.workunit.client.0.smithi148.stdout:5/415: dwrite d1/d44/d65/f76 [0,4194304] 0 2024-02-28T16:26:38.255 INFO:tasks.workunit.client.0.smithi148.stdout:9/397: mkdir d7/d1c/d1f/d49/d8d 0 2024-02-28T16:26:38.260 INFO:tasks.workunit.client.0.smithi148.stdout:8/430: rename d1/dd/d54 to d1/dd/d13/d1a/d87 0 2024-02-28T16:26:38.262 INFO:tasks.workunit.client.0.smithi148.stdout:8/431: chown d1/dd/d13/d23 9022 1 2024-02-28T16:26:38.269 INFO:tasks.workunit.client.0.smithi148.stdout:0/563: dwrite d1/d15/d27/d34/d5a/d71/d74/fa9 [0,4194304] 0 2024-02-28T16:26:38.270 INFO:tasks.workunit.client.0.smithi148.stdout:3/546: creat d1/db/d35/d70/d8e/f9f x:0 0 0 2024-02-28T16:26:38.274 INFO:tasks.workunit.client.0.smithi148.stdout:0/564: stat d1/d15/d27/d34/d5a/c98 0 2024-02-28T16:26:38.274 INFO:tasks.workunit.client.0.smithi148.stdout:5/416: dread d1/d1a/f35 [0,4194304] 0 2024-02-28T16:26:38.275 INFO:tasks.workunit.client.0.smithi148.stdout:6/407: symlink d0/d22/d27/l7d 0 2024-02-28T16:26:38.278 INFO:tasks.workunit.client.0.smithi148.stdout:6/408: chown d0/d22/d27/l7d 445828 1 2024-02-28T16:26:38.279 INFO:tasks.workunit.client.0.smithi148.stdout:6/409: readlink d0/l40 0 2024-02-28T16:26:38.281 INFO:tasks.workunit.client.0.smithi148.stdout:7/443: dread d0/d9/d25/d47/d1c/d32/f3b [0,4194304] 0 2024-02-28T16:26:38.285 INFO:tasks.workunit.client.0.smithi148.stdout:8/432: dwrite d1/dd/d13/d1a/f3f [0,4194304] 0 2024-02-28T16:26:38.287 INFO:tasks.workunit.client.0.smithi148.stdout:8/433: fsync d1/d3/d18/d48/d22/d34/f73 0 2024-02-28T16:26:38.288 INFO:tasks.workunit.client.0.smithi148.stdout:4/379: truncate d8/f3f 1870934 0 2024-02-28T16:26:38.289 INFO:tasks.workunit.client.0.smithi148.stdout:8/434: fsync d1/d3/f80 0 2024-02-28T16:26:38.290 INFO:tasks.workunit.client.0.smithi148.stdout:1/396: mkdir d2/d15/d62/d75/d76 0 2024-02-28T16:26:38.292 INFO:tasks.workunit.client.0.smithi148.stdout:0/565: creat d1/d15/d27/fbb x:0 0 0 2024-02-28T16:26:38.294 INFO:tasks.workunit.client.0.smithi148.stdout:6/410: mknod d0/d22/d49/c7e 0 2024-02-28T16:26:38.295 INFO:tasks.workunit.client.0.smithi148.stdout:3/547: mkdir d1/da0 0 2024-02-28T16:26:38.297 INFO:tasks.workunit.client.0.smithi148.stdout:0/566: write d1/d15/d27/d34/d5a/d9d/d5f/f82 [4843779,89060] 0 2024-02-28T16:26:38.299 INFO:tasks.workunit.client.0.smithi148.stdout:5/417: symlink d1/d8/d20/l7f 0 2024-02-28T16:26:38.303 INFO:tasks.workunit.client.0.smithi148.stdout:2/409: rename d0/d18/d20/d73/d81 to d0/d1c/d85 0 2024-02-28T16:26:38.304 INFO:tasks.workunit.client.0.smithi148.stdout:1/397: creat d2/d5/d2b/d4a/f77 x:0 0 0 2024-02-28T16:26:38.304 INFO:tasks.workunit.client.0.smithi148.stdout:2/410: chown d0/dd/c7e 2 1 2024-02-28T16:26:38.305 INFO:tasks.workunit.client.0.smithi148.stdout:2/411: dread - d0/d9/d13/f80 zero size 2024-02-28T16:26:38.316 INFO:tasks.workunit.client.0.smithi148.stdout:6/411: rmdir d0/d4/d1b/d71 39 2024-02-28T16:26:38.318 INFO:tasks.workunit.client.0.smithi148.stdout:0/567: mkdir d1/d15/d27/d34/d5a/d71/d74/dbc 0 2024-02-28T16:26:38.321 INFO:tasks.workunit.client.0.smithi148.stdout:1/398: fdatasync d2/f26 0 2024-02-28T16:26:38.322 INFO:tasks.workunit.client.0.smithi148.stdout:4/380: dread d8/df/f4a [0,4194304] 0 2024-02-28T16:26:38.322 INFO:tasks.workunit.client.0.smithi148.stdout:4/381: stat d8/d71 0 2024-02-28T16:26:38.323 INFO:tasks.workunit.client.0.smithi148.stdout:1/399: chown d2/d5/d1a/f2c 37 1 2024-02-28T16:26:38.327 INFO:tasks.workunit.client.0.smithi148.stdout:1/400: dread d2/d5/d1a/f67 [0,4194304] 0 2024-02-28T16:26:38.339 INFO:tasks.workunit.client.0.smithi148.stdout:1/401: dwrite d2/d5/d40/f1b [0,4194304] 0 2024-02-28T16:26:38.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:37 smithi148 ceph-mon[28767]: pgmap v43: 65 pgs: 65 active+clean; 759 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 5.6 MiB/s rd, 83 MiB/s wr, 183 op/s 2024-02-28T16:26:38.580 INFO:tasks.workunit.client.0.smithi148.stdout:2/412: creat d0/dd/f86 x:0 0 0 2024-02-28T16:26:38.588 INFO:tasks.workunit.client.0.smithi148.stdout:5/418: dread d1/d8/d23/f52 [0,4194304] 0 2024-02-28T16:26:38.588 INFO:tasks.workunit.client.0.smithi148.stdout:9/398: rename d7/dd/d26/c7c to d7/d1c/d74/d68/d81/c8e 0 2024-02-28T16:26:38.589 INFO:tasks.workunit.client.0.smithi148.stdout:0/568: readlink d1/d15/d27/d34/d5a/d9d/d5f/l63 0 2024-02-28T16:26:38.601 INFO:tasks.workunit.client.0.smithi148.stdout:9/399: dread d7/d1c/f75 [0,4194304] 0 2024-02-28T16:26:38.603 INFO:tasks.workunit.client.0.smithi148.stdout:1/402: creat d2/d15/f78 x:0 0 0 2024-02-28T16:26:38.604 INFO:tasks.workunit.client.0.smithi148.stdout:8/435: dwrite d1/f1c [0,4194304] 0 2024-02-28T16:26:38.608 INFO:tasks.workunit.client.0.smithi148.stdout:2/413: dread d0/dd/f82 [0,4194304] 0 2024-02-28T16:26:38.614 INFO:tasks.workunit.client.0.smithi148.stdout:4/382: mkdir d8/d71/d85 0 2024-02-28T16:26:38.616 INFO:tasks.workunit.client.0.smithi148.stdout:1/403: mkdir d2/d15/d33/d79 0 2024-02-28T16:26:38.618 INFO:tasks.workunit.client.0.smithi148.stdout:7/444: dwrite d0/d9/d25/d47/d1c/d32/f3d [0,4194304] 0 2024-02-28T16:26:38.618 INFO:tasks.workunit.client.0.smithi148.stdout:8/436: truncate d1/f7 353379 0 2024-02-28T16:26:38.622 INFO:tasks.workunit.client.0.smithi148.stdout:9/400: rename d7/dd/d26/l29 to d7/dd/d26/l8f 0 2024-02-28T16:26:38.623 INFO:tasks.workunit.client.0.smithi148.stdout:0/569: dread d1/d15/d8/f30 [0,4194304] 0 2024-02-28T16:26:38.624 INFO:tasks.workunit.client.0.smithi148.stdout:5/419: dwrite d1/d44/d65/f76 [0,4194304] 0 2024-02-28T16:26:38.628 INFO:tasks.workunit.client.0.smithi148.stdout:2/414: rename d0/d1c/d49/f4b to d0/d1d/d52/d54/f87 0 2024-02-28T16:26:38.628 INFO:tasks.workunit.client.0.smithi148.stdout:9/401: fdatasync d7/d1c/d74/f50 0 2024-02-28T16:26:38.628 INFO:tasks.workunit.client.0.smithi148.stdout:1/404: creat d2/d5/d1a/f7a x:0 0 0 2024-02-28T16:26:38.630 INFO:tasks.workunit.client.0.smithi148.stdout:2/415: dread - d0/dd/f86 zero size 2024-02-28T16:26:38.634 INFO:tasks.workunit.client.0.smithi148.stdout:4/383: creat d8/df/d17/d6a/d6c/f86 x:0 0 0 2024-02-28T16:26:38.634 INFO:tasks.workunit.client.0.smithi148.stdout:1/405: read - d2/d5/d40/d7/f64 zero size 2024-02-28T16:26:38.635 INFO:tasks.workunit.client.0.smithi148.stdout:0/570: creat d1/d15/d27/fbd x:0 0 0 2024-02-28T16:26:38.638 INFO:tasks.workunit.client.0.smithi148.stdout:8/437: dread d1/dd/d13/d24/d3a/f69 [0,4194304] 0 2024-02-28T16:26:38.639 INFO:tasks.workunit.client.0.smithi148.stdout:1/406: stat d2/d5/d40/d7/fc 0 2024-02-28T16:26:38.641 INFO:tasks.workunit.client.0.smithi148.stdout:5/420: write d1/d8/d20/d31/f6c [3636240,84505] 0 2024-02-28T16:26:38.644 INFO:tasks.workunit.client.0.smithi148.stdout:4/384: chown d8/f12 15908842 1 2024-02-28T16:26:38.645 INFO:tasks.workunit.client.0.smithi148.stdout:8/438: chown d1/d3/d18/d5a/d60/f82 0 1 2024-02-28T16:26:38.656 INFO:tasks.workunit.client.0.smithi148.stdout:1/407: rename d2/d5/d2b/d4a/f5a to d2/d5/d2b/d4a/f7b 0 2024-02-28T16:26:38.659 INFO:tasks.workunit.client.0.smithi148.stdout:9/402: rmdir d7/d1c/d1f/d7e 0 2024-02-28T16:26:38.664 INFO:tasks.workunit.client.0.smithi148.stdout:8/439: creat d1/d3/d18/d48/d70/f88 x:0 0 0 2024-02-28T16:26:38.667 INFO:tasks.workunit.client.0.smithi148.stdout:8/440: fdatasync d1/f62 0 2024-02-28T16:26:38.671 INFO:tasks.workunit.client.0.smithi148.stdout:2/416: rename d0/d9/d13/f3c to d0/dd/f88 0 2024-02-28T16:26:38.674 INFO:tasks.workunit.client.0.smithi148.stdout:4/385: dwrite d8/d21/f56 [0,4194304] 0 2024-02-28T16:26:38.674 INFO:tasks.workunit.client.0.smithi148.stdout:1/408: symlink d2/d5/l7c 0 2024-02-28T16:26:38.679 INFO:tasks.workunit.client.0.smithi148.stdout:5/421: dwrite d1/f6f [0,4194304] 0 2024-02-28T16:26:38.679 INFO:tasks.workunit.client.0.smithi148.stdout:2/417: dread d0/d1d/d52/d54/f63 [0,4194304] 0 2024-02-28T16:26:38.682 INFO:tasks.workunit.client.0.smithi148.stdout:7/445: dwrite d0/d9/d25/d47/d1c/d32/f4e [0,4194304] 0 2024-02-28T16:26:38.684 INFO:tasks.workunit.client.0.smithi148.stdout:1/409: truncate d2/d5/d40/f27 989981 0 2024-02-28T16:26:38.684 INFO:tasks.workunit.client.0.smithi148.stdout:8/441: creat d1/dd/d13/d1a/d25/d50/f89 x:0 0 0 2024-02-28T16:26:38.687 INFO:tasks.workunit.client.0.smithi148.stdout:9/403: getdents d7/d1c/d32/d24 0 2024-02-28T16:26:38.687 INFO:tasks.workunit.client.0.smithi148.stdout:5/422: mkdir d1/d1a/d80 0 2024-02-28T16:26:38.688 INFO:tasks.workunit.client.0.smithi148.stdout:8/442: chown d1/dd/d13/d24/d3a/d49/d74 197394364 1 2024-02-28T16:26:38.688 INFO:tasks.workunit.client.0.smithi148.stdout:5/423: write d1/f6f [1983613,2519] 0 2024-02-28T16:26:38.689 INFO:tasks.workunit.client.0.smithi148.stdout:4/386: mknod d8/d21/d3d/d4d/c87 0 2024-02-28T16:26:38.690 INFO:tasks.workunit.client.0.smithi148.stdout:8/443: chown d1/dd/d13/d1a/d33 2432 1 2024-02-28T16:26:38.691 INFO:tasks.workunit.client.0.smithi148.stdout:5/424: stat d1/d8/d20/d31/c33 0 2024-02-28T16:26:38.692 INFO:tasks.workunit.client.0.smithi148.stdout:2/418: fsync d0/d18/d20/f33 0 2024-02-28T16:26:38.693 INFO:tasks.workunit.client.0.smithi148.stdout:2/419: read - d0/d66/d76/f7c zero size 2024-02-28T16:26:38.697 INFO:tasks.workunit.client.0.smithi148.stdout:7/446: rename d0/d9/d25/d47/d1c/c60 to d0/d4/c8c 0 2024-02-28T16:26:38.698 INFO:tasks.workunit.client.0.smithi148.stdout:7/447: chown d0/d18/c34 11002171 1 2024-02-28T16:26:38.702 INFO:tasks.workunit.client.0.smithi148.stdout:9/404: symlink d7/d1c/d32/d24/l90 0 2024-02-28T16:26:38.703 INFO:tasks.workunit.client.0.smithi148.stdout:9/405: chown d7/d1c/l57 679 1 2024-02-28T16:26:38.704 INFO:tasks.workunit.client.0.smithi148.stdout:4/387: creat d8/d21/d3d/f88 x:0 0 0 2024-02-28T16:26:38.704 INFO:tasks.workunit.client.0.smithi148.stdout:9/406: readlink d7/d1c/d1f/l2d 0 2024-02-28T16:26:38.708 INFO:tasks.workunit.client.0.smithi148.stdout:2/420: fdatasync d0/dd/d2b/f31 0 2024-02-28T16:26:38.711 INFO:tasks.workunit.client.0.smithi148.stdout:2/421: read - d0/d66/d76/f7c zero size 2024-02-28T16:26:38.717 INFO:tasks.workunit.client.0.smithi148.stdout:1/410: creat d2/d5/d40/f7d x:0 0 0 2024-02-28T16:26:38.717 INFO:tasks.workunit.client.0.smithi148.stdout:9/407: dread d7/d1c/d1f/f4a [0,4194304] 0 2024-02-28T16:26:38.718 INFO:tasks.workunit.client.0.smithi148.stdout:1/411: readlink d2/d3f/d46/l56 0 2024-02-28T16:26:38.721 INFO:tasks.workunit.client.0.smithi148.stdout:7/448: fdatasync d0/d9/d25/d47/f27 0 2024-02-28T16:26:38.723 INFO:tasks.workunit.client.0.smithi148.stdout:4/388: creat d8/df/f89 x:0 0 0 2024-02-28T16:26:38.727 INFO:tasks.workunit.client.0.smithi148.stdout:9/408: write d7/d1c/d32/d24/f38 [1121367,79792] 0 2024-02-28T16:26:38.727 INFO:tasks.workunit.client.0.smithi148.stdout:8/444: dwrite d1/dd/d13/d24/d3a/f69 [0,4194304] 0 2024-02-28T16:26:38.727 INFO:tasks.workunit.client.0.smithi148.stdout:7/449: stat d0/f13 0 2024-02-28T16:26:38.728 INFO:tasks.workunit.client.0.smithi148.stdout:1/412: truncate d2/d5/d2b/d4a/f77 790885 0 2024-02-28T16:26:38.728 INFO:tasks.workunit.client.0.smithi148.stdout:4/389: write d8/f14 [3171250,13468] 0 2024-02-28T16:26:38.733 INFO:tasks.workunit.client.0.smithi148.stdout:2/422: dwrite d0/d1c/f1f [0,4194304] 0 2024-02-28T16:26:38.741 INFO:tasks.workunit.client.0.smithi148.stdout:2/423: chown d0/dd/c61 675 1 2024-02-28T16:26:38.743 INFO:tasks.workunit.client.0.smithi148.stdout:8/445: rename d1/c1f to d1/dd/d51/d77/c8a 0 2024-02-28T16:26:38.748 INFO:tasks.workunit.client.0.smithi148.stdout:4/390: dwrite d8/f14 [0,4194304] 0 2024-02-28T16:26:38.748 INFO:tasks.workunit.client.0.smithi148.stdout:8/446: write d1/d3/d18/d48/d22/d34/f73 [117952,81922] 0 2024-02-28T16:26:38.756 INFO:tasks.workunit.client.0.smithi148.stdout:8/447: mknod d1/dd/d51/d77/c8b 0 2024-02-28T16:26:38.758 INFO:tasks.workunit.client.0.smithi148.stdout:4/391: write d8/d21/d3d/f88 [101675,49021] 0 2024-02-28T16:26:38.758 INFO:tasks.workunit.client.0.smithi148.stdout:8/448: fdatasync d1/dd/d13/d1a/f3f 0 2024-02-28T16:26:38.760 INFO:tasks.workunit.client.0.smithi148.stdout:8/449: chown d1/d3/d18/d5a/d60 2914098 1 2024-02-28T16:26:38.851 INFO:tasks.workunit.client.0.smithi148.stdout:4/392: creat d8/df/d17/d6a/f8a x:0 0 0 2024-02-28T16:26:38.856 INFO:tasks.workunit.client.0.smithi148.stdout:8/450: creat d1/d3/d18/d48/d70/f8c x:0 0 0 2024-02-28T16:26:38.862 INFO:tasks.workunit.client.0.smithi148.stdout:4/393: rmdir d8/d21/d3d 39 2024-02-28T16:26:38.895 INFO:tasks.workunit.client.0.smithi148.stdout:7/450: write d0/f2 [1389487,53972] 0 2024-02-28T16:26:38.899 INFO:tasks.workunit.client.0.smithi148.stdout:1/413: dwrite d2/f26 [0,4194304] 0 2024-02-28T16:26:38.905 INFO:tasks.workunit.client.0.smithi148.stdout:7/451: write d0/d9/d46/d65/f84 [587321,110682] 0 2024-02-28T16:26:38.906 INFO:tasks.workunit.client.0.smithi148.stdout:1/414: chown d2/c68 1648911 1 2024-02-28T16:26:38.907 INFO:tasks.workunit.client.0.smithi148.stdout:4/394: dwrite d8/f22 [0,4194304] 0 2024-02-28T16:26:38.912 INFO:tasks.workunit.client.0.smithi148.stdout:4/395: stat d8/df/d17/d6a/f50 0 2024-02-28T16:26:38.915 INFO:tasks.workunit.client.0.smithi148.stdout:7/452: mknod d0/d4/d70/c8d 0 2024-02-28T16:26:38.916 INFO:tasks.workunit.client.0.smithi148.stdout:4/396: chown d8/df/d1f/f4b 167 1 2024-02-28T16:26:38.918 INFO:tasks.workunit.client.0.smithi148.stdout:2/424: dwrite d0/d18/d20/f50 [0,4194304] 0 2024-02-28T16:26:38.920 INFO:tasks.workunit.client.0.smithi148.stdout:2/425: fsync d0/d1c/f5f 0 2024-02-28T16:26:38.924 INFO:tasks.workunit.client.0.smithi148.stdout:3/548: sync 2024-02-28T16:26:38.925 INFO:tasks.workunit.client.0.smithi148.stdout:6/412: sync 2024-02-28T16:26:38.933 INFO:tasks.workunit.client.0.smithi148.stdout:1/415: link d2/d5/d1a/f43 d2/d15/d62/f7e 0 2024-02-28T16:26:38.935 INFO:tasks.workunit.client.0.smithi148.stdout:1/416: chown d2/d15/d33/l57 1945 1 2024-02-28T16:26:38.938 INFO:tasks.workunit.client.0.smithi148.stdout:8/451: dwrite d1/f2e [0,4194304] 0 2024-02-28T16:26:38.939 INFO:tasks.workunit.client.0.smithi148.stdout:8/452: fsync d1/d3/f20 0 2024-02-28T16:26:38.941 INFO:tasks.workunit.client.0.smithi148.stdout:8/453: chown d1/dd/d13/d24/d3a/c4d 10 1 2024-02-28T16:26:38.945 INFO:tasks.workunit.client.0.smithi148.stdout:6/413: rename d0/d22/d25/d3a to d0/d22/d25/d76/d7f 0 2024-02-28T16:26:38.951 INFO:tasks.workunit.client.0.smithi148.stdout:3/549: dread d1/db/d45/f98 [0,4194304] 0 2024-02-28T16:26:38.953 INFO:tasks.workunit.client.0.smithi148.stdout:1/417: mknod d2/d15/d62/c7f 0 2024-02-28T16:26:38.955 INFO:tasks.workunit.client.0.smithi148.stdout:1/418: write d2/f6c [666511,129752] 0 2024-02-28T16:26:38.956 INFO:tasks.workunit.client.0.smithi148.stdout:7/453: creat d0/d9/f8e x:0 0 0 2024-02-28T16:26:38.959 INFO:tasks.workunit.client.0.smithi148.stdout:7/454: chown d0/d9/d25/d47/d1c/d32/f3b 9103 1 2024-02-28T16:26:38.961 INFO:tasks.workunit.client.0.smithi148.stdout:7/455: truncate d0/d9/f8e 350616 0 2024-02-28T16:26:38.961 INFO:tasks.workunit.client.0.smithi148.stdout:7/456: fsync d0/f71 0 2024-02-28T16:26:38.964 INFO:tasks.workunit.client.0.smithi148.stdout:8/454: rmdir d1/d3 39 2024-02-28T16:26:38.965 INFO:tasks.workunit.client.0.smithi148.stdout:4/397: link d8/d21/c2a d8/d71/c8b 0 2024-02-28T16:26:38.970 INFO:tasks.workunit.client.0.smithi148.stdout:6/414: unlink d0/d22/d25/d76/d7f/f41 0 2024-02-28T16:26:38.972 INFO:tasks.workunit.client.0.smithi148.stdout:0/571: sync 2024-02-28T16:26:38.972 INFO:tasks.workunit.client.0.smithi148.stdout:5/425: sync 2024-02-28T16:26:38.985 INFO:tasks.workunit.client.0.smithi148.stdout:8/455: dread d1/dd/d13/d1a/f44 [0,4194304] 0 2024-02-28T16:26:38.990 INFO:tasks.workunit.client.0.smithi148.stdout:5/426: dwrite d1/f43 [0,4194304] 0 2024-02-28T16:26:39.004 INFO:tasks.workunit.client.0.smithi148.stdout:7/457: stat d0/d9/d25/d47/d28/d2b/d3a/d49/l6c 0 2024-02-28T16:26:39.009 INFO:tasks.workunit.client.0.smithi148.stdout:2/426: getdents d0/d18/d20 0 2024-02-28T16:26:39.012 INFO:tasks.workunit.client.0.smithi148.stdout:6/415: rename d0/d22/d27/d66/f72 to d0/d22/d25/d76/f80 0 2024-02-28T16:26:39.014 INFO:tasks.workunit.client.0.smithi148.stdout:6/416: write d0/d8/f6c [13066,27353] 0 2024-02-28T16:26:39.017 INFO:tasks.workunit.client.0.smithi148.stdout:6/417: write d0/d22/d27/d3e/f7b [439729,8645] 0 2024-02-28T16:26:39.018 INFO:tasks.workunit.client.0.smithi148.stdout:0/572: symlink d1/d15/d27/d34/d5a/d71/d74/lbe 0 2024-02-28T16:26:39.020 INFO:tasks.workunit.client.0.smithi148.stdout:6/418: write d0/f4c [1136469,111785] 0 2024-02-28T16:26:39.026 INFO:tasks.workunit.client.0.smithi148.stdout:1/419: fdatasync d2/d5/d40/d8/f9 0 2024-02-28T16:26:39.026 INFO:tasks.workunit.client.0.smithi148.stdout:7/458: unlink d0/d4/c53 0 2024-02-28T16:26:39.029 INFO:tasks.workunit.client.0.smithi148.stdout:7/459: fdatasync d0/d9/d25/d47/f27 0 2024-02-28T16:26:39.030 INFO:tasks.workunit.client.0.smithi148.stdout:1/420: truncate d2/d5/d1a/f7a 667122 0 2024-02-28T16:26:39.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/427: symlink d1/d1a/d80/l81 0 2024-02-28T16:26:39.033 INFO:tasks.workunit.client.0.smithi148.stdout:3/550: dwrite d1/d13/d19/d56/f63 [0,4194304] 0 2024-02-28T16:26:39.034 INFO:tasks.workunit.client.0.smithi148.stdout:2/427: dread d0/d1d/f5c [4194304,4194304] 0 2024-02-28T16:26:39.034 INFO:tasks.workunit.client.0.smithi148.stdout:8/456: fsync d1/d3/d18/f31 0 2024-02-28T16:26:39.036 INFO:tasks.workunit.client.0.smithi148.stdout:5/428: write d1/f26 [2229934,112428] 0 2024-02-28T16:26:39.036 INFO:tasks.workunit.client.0.smithi148.stdout:1/421: dread d2/d5/d40/f27 [0,4194304] 0 2024-02-28T16:26:39.039 INFO:tasks.workunit.client.0.smithi148.stdout:6/419: rmdir d0/d4 39 2024-02-28T16:26:39.041 INFO:tasks.workunit.client.0.smithi148.stdout:9/409: sync 2024-02-28T16:26:39.044 INFO:tasks.workunit.client.0.smithi148.stdout:1/422: dread d2/d5/d40/d7/f47 [0,4194304] 0 2024-02-28T16:26:39.047 INFO:tasks.workunit.client.0.smithi148.stdout:1/423: chown d2/d5/d40/f1b 21 1 2024-02-28T16:26:39.054 INFO:tasks.workunit.client.0.smithi148.stdout:2/428: dwrite d0/dd/f5e [0,4194304] 0 2024-02-28T16:26:39.062 INFO:tasks.workunit.client.0.smithi148.stdout:9/410: dwrite d7/dd/f2e [0,4194304] 0 2024-02-28T16:26:39.065 INFO:tasks.workunit.client.0.smithi148.stdout:3/551: write d1/d13/d19/d1b/d38/d7c/f8d [719178,16034] 0 2024-02-28T16:26:39.069 INFO:tasks.workunit.client.0.smithi148.stdout:1/424: dwrite d2/d5/d40/f1b [0,4194304] 0 2024-02-28T16:26:39.072 INFO:tasks.workunit.client.0.smithi148.stdout:4/398: mkdir d8/d21/d3d/d8c 0 2024-02-28T16:26:39.083 INFO:tasks.workunit.client.0.smithi148.stdout:8/457: rename d1/dd/d13/d24/d3a/l56 to d1/dd/d13/d68/l8d 0 2024-02-28T16:26:39.087 INFO:tasks.workunit.client.0.smithi148.stdout:1/425: dread d2/f51 [4194304,4194304] 0 2024-02-28T16:26:39.092 INFO:tasks.workunit.client.0.smithi148.stdout:9/411: symlink d7/d1c/d74/d68/d81/l91 0 2024-02-28T16:26:39.092 INFO:tasks.workunit.client.0.smithi148.stdout:4/399: dread d8/df/d17/d6a/f50 [0,4194304] 0 2024-02-28T16:26:39.092 INFO:tasks.workunit.client.0.smithi148.stdout:3/552: write d1/d3f/f7f [310755,101237] 0 2024-02-28T16:26:39.092 INFO:tasks.workunit.client.0.smithi148.stdout:6/420: creat d0/d4/d14/f81 x:0 0 0 2024-02-28T16:26:39.092 INFO:tasks.workunit.client.0.smithi148.stdout:4/400: chown d8/d71/d85 4776486 1 2024-02-28T16:26:39.097 INFO:tasks.workunit.client.0.smithi148.stdout:7/460: link d0/d9/d25/d47/l33 d0/d9/d25/d47/d28/l8f 0 2024-02-28T16:26:39.098 INFO:tasks.workunit.client.0.smithi148.stdout:2/429: truncate d0/d9/d13/f16 3090334 0 2024-02-28T16:26:39.100 INFO:tasks.workunit.client.0.smithi148.stdout:2/430: fsync d0/d9/d13/d38/f6b 0 2024-02-28T16:26:39.100 INFO:tasks.workunit.client.0.smithi148.stdout:8/458: symlink d1/d3/l8e 0 2024-02-28T16:26:39.102 INFO:tasks.workunit.client.0.smithi148.stdout:2/431: chown d0/d18/c1a 5 1 2024-02-28T16:26:39.104 INFO:tasks.workunit.client.0.smithi148.stdout:8/459: stat d1/dd/d13/d1a/f3e 0 2024-02-28T16:26:39.105 INFO:tasks.workunit.client.0.smithi148.stdout:2/432: write d0/d66/d76/f7c [250282,47546] 0 2024-02-28T16:26:39.112 INFO:tasks.workunit.client.0.smithi148.stdout:4/401: creat d8/df/d17/d6a/f8d x:0 0 0 2024-02-28T16:26:39.115 INFO:tasks.workunit.client.0.smithi148.stdout:6/421: creat d0/d4/d14/f82 x:0 0 0 2024-02-28T16:26:39.120 INFO:tasks.workunit.client.0.smithi148.stdout:7/461: mknod d0/d9/d25/d47/d28/d2b/d6f/c90 0 2024-02-28T16:26:39.120 INFO:tasks.workunit.client.0.smithi148.stdout:2/433: mkdir d0/d18/d89 0 2024-02-28T16:26:39.121 INFO:tasks.workunit.client.0.smithi148.stdout:9/412: dread d7/d1c/d32/f54 [0,4194304] 0 2024-02-28T16:26:39.124 INFO:tasks.workunit.client.0.smithi148.stdout:8/460: creat d1/d3/d18/d5a/d60/f8f x:0 0 0 2024-02-28T16:26:39.124 INFO:tasks.workunit.client.0.smithi148.stdout:2/434: read - d0/d1d/d55/f74 zero size 2024-02-28T16:26:39.125 INFO:tasks.workunit.client.0.smithi148.stdout:0/573: dwrite d1/d4/fe [0,4194304] 0 2024-02-28T16:26:39.134 INFO:tasks.workunit.client.0.smithi148.stdout:8/461: mkdir d1/dd/d13/d24/d3a/d49/d90 0 2024-02-28T16:26:39.136 INFO:tasks.workunit.client.0.smithi148.stdout:6/422: symlink d0/d4/d1b/d71/l83 0 2024-02-28T16:26:39.141 INFO:tasks.workunit.client.0.smithi148.stdout:7/462: link d0/d9/d46/d65/f84 d0/d18/f91 0 2024-02-28T16:26:39.141 INFO:tasks.workunit.client.0.smithi148.stdout:9/413: mknod d7/d1c/d1f/d49/d8d/c92 0 2024-02-28T16:26:39.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/414: stat d7/d1c/d32/d24/d78/l7d 0 2024-02-28T16:26:39.143 INFO:tasks.workunit.client.0.smithi148.stdout:0/574: creat d1/d15/d27/d34/d5a/d9d/d5f/d93/d9b/fbf x:0 0 0 2024-02-28T16:26:39.143 INFO:tasks.workunit.client.0.smithi148.stdout:9/415: fdatasync d7/dd/f2b 0 2024-02-28T16:26:39.146 INFO:tasks.workunit.client.0.smithi148.stdout:8/462: mkdir d1/d3/d18/d48/d70/d75/d91 0 2024-02-28T16:26:39.148 INFO:tasks.workunit.client.0.smithi148.stdout:6/423: mknod d0/d4/d1b/d71/c84 0 2024-02-28T16:26:39.152 INFO:tasks.workunit.client.0.smithi148.stdout:5/429: truncate d1/f6f 2180419 0 2024-02-28T16:26:39.157 INFO:tasks.workunit.client.0.smithi148.stdout:9/416: dwrite d7/d1c/d74/f70 [0,4194304] 0 2024-02-28T16:26:39.175 INFO:tasks.workunit.client.0.smithi148.stdout:0/575: rename d1/d15/d27/d34/d5a/d9d/d4a/l69 to d1/d15/d27/d34/d5a/d71/d74/d7e/lc0 0 2024-02-28T16:26:39.175 INFO:tasks.workunit.client.0.smithi148.stdout:7/463: symlink d0/d9/d25/d47/d28/d2b/d3a/d6a/l92 0 2024-02-28T16:26:39.179 INFO:tasks.workunit.client.0.smithi148.stdout:6/424: creat d0/d22/d25/d76/f85 x:0 0 0 2024-02-28T16:26:39.185 INFO:tasks.workunit.client.0.smithi148.stdout:3/553: creat d1/db/fa1 x:0 0 0 2024-02-28T16:26:39.185 INFO:tasks.workunit.client.0.smithi148.stdout:0/576: read d1/d15/f2a [685344,127488] 0 2024-02-28T16:26:39.189 INFO:tasks.workunit.client.0.smithi148.stdout:0/577: chown d1/f24 84157 1 2024-02-28T16:26:39.190 INFO:tasks.workunit.client.0.smithi148.stdout:1/426: write d2/d5/d40/d8/f10 [596632,836] 0 2024-02-28T16:26:39.197 INFO:tasks.workunit.client.0.smithi148.stdout:9/417: creat d7/f93 x:0 0 0 2024-02-28T16:26:39.197 INFO:tasks.workunit.client.0.smithi148.stdout:3/554: write d1/d13/d19/d56/f6c [40520,54176] 0 2024-02-28T16:26:39.200 INFO:tasks.workunit.client.0.smithi148.stdout:0/578: rmdir d1/d15/d8 39 2024-02-28T16:26:39.202 INFO:tasks.workunit.client.0.smithi148.stdout:3/555: rmdir d1 39 2024-02-28T16:26:39.203 INFO:tasks.workunit.client.0.smithi148.stdout:4/402: write d8/d21/d3d/f52 [920771,28486] 0 2024-02-28T16:26:39.205 INFO:tasks.workunit.client.0.smithi148.stdout:9/418: rmdir d7/dd/d26 39 2024-02-28T16:26:39.209 INFO:tasks.workunit.client.0.smithi148.stdout:7/464: dwrite d0/d9/d25/d47/d1c/f31 [0,4194304] 0 2024-02-28T16:26:39.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/427: truncate d2/d5/d40/d7/f47 1543897 0 2024-02-28T16:26:39.215 INFO:tasks.workunit.client.0.smithi148.stdout:5/430: dread d1/db/d25/f1f [0,4194304] 0 2024-02-28T16:26:39.216 INFO:tasks.workunit.client.0.smithi148.stdout:0/579: creat d1/d8a/fc1 x:0 0 0 2024-02-28T16:26:39.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/425: dread d0/d22/d25/f4f [0,4194304] 0 2024-02-28T16:26:39.219 INFO:tasks.workunit.client.0.smithi148.stdout:3/556: fsync d1/d13/d19/d1b/d38/f82 0 2024-02-28T16:26:39.221 INFO:tasks.workunit.client.0.smithi148.stdout:2/435: dread d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:39.223 INFO:tasks.workunit.client.0.smithi148.stdout:1/428: truncate d2/d5/d40/d7/f6a 1004413 0 2024-02-28T16:26:39.230 INFO:tasks.workunit.client.0.smithi148.stdout:3/557: read d1/d13/d19/d1b/d38/d7c/f8d [377357,26857] 0 2024-02-28T16:26:39.233 INFO:tasks.workunit.client.0.smithi148.stdout:3/558: stat d1/d13/d19/d88/f97 0 2024-02-28T16:26:39.237 INFO:tasks.workunit.client.0.smithi148.stdout:3/559: readlink d1/d13/d19/d1b/l24 0 2024-02-28T16:26:39.241 INFO:tasks.workunit.client.0.smithi148.stdout:7/465: dwrite d0/d18/f2a [0,4194304] 0 2024-02-28T16:26:39.244 INFO:tasks.workunit.client.0.smithi148.stdout:4/403: mknod d8/d21/d7e/c8e 0 2024-02-28T16:26:39.249 INFO:tasks.workunit.client.0.smithi148.stdout:5/431: dwrite d1/d8/d20/d31/f39 [4194304,4194304] 0 2024-02-28T16:26:39.251 INFO:tasks.workunit.client.0.smithi148.stdout:6/426: symlink d0/d22/d27/d66/l86 0 2024-02-28T16:26:39.254 INFO:tasks.workunit.client.0.smithi148.stdout:2/436: truncate d0/d9/d13/f16 1246931 0 2024-02-28T16:26:39.255 INFO:tasks.workunit.client.0.smithi148.stdout:3/560: creat d1/d13/d19/d32/d41/fa2 x:0 0 0 2024-02-28T16:26:39.258 INFO:tasks.workunit.client.0.smithi148.stdout:0/580: stat d1/d15/d27/d34/d5a/d71/d80/fb1 0 2024-02-28T16:26:39.259 INFO:tasks.workunit.client.0.smithi148.stdout:4/404: creat d8/df/d5f/f8f x:0 0 0 2024-02-28T16:26:39.261 INFO:tasks.workunit.client.0.smithi148.stdout:5/432: creat d1/db/f82 x:0 0 0 2024-02-28T16:26:39.264 INFO:tasks.workunit.client.0.smithi148.stdout:1/429: dread d2/d5/d40/f16 [0,4194304] 0 2024-02-28T16:26:39.265 INFO:tasks.workunit.client.0.smithi148.stdout:9/419: rename d7/dd/f5e to d7/d1c/f94 0 2024-02-28T16:26:39.273 INFO:tasks.workunit.client.0.smithi148.stdout:5/433: truncate d1/db/d25/f7e 701747 0 2024-02-28T16:26:39.274 INFO:tasks.workunit.client.0.smithi148.stdout:2/437: link d0/d1d/f77 d0/d18/d89/f8a 0 2024-02-28T16:26:39.275 INFO:tasks.workunit.client.0.smithi148.stdout:2/438: chown d0/d1d/d55 108416 1 2024-02-28T16:26:39.277 INFO:tasks.workunit.client.0.smithi148.stdout:3/561: getdents d1/db/d35/d70/d9c 0 2024-02-28T16:26:39.278 INFO:tasks.workunit.client.0.smithi148.stdout:9/420: rmdir d7/d1c/d74 39 2024-02-28T16:26:39.288 INFO:tasks.workunit.client.0.smithi148.stdout:6/427: getdents d0/d22/d27/d66 0 2024-02-28T16:26:39.295 INFO:tasks.workunit.client.0.smithi148.stdout:7/466: truncate d0/d9/d4c/f6b 2983034 0 2024-02-28T16:26:39.297 INFO:tasks.workunit.client.0.smithi148.stdout:7/467: readlink d0/d9/l12 0 2024-02-28T16:26:39.298 INFO:tasks.workunit.client.0.smithi148.stdout:6/428: truncate d0/d22/d25/d76/f80 987575 0 2024-02-28T16:26:39.300 INFO:tasks.workunit.client.0.smithi148.stdout:1/430: creat d2/d5/d40/f80 x:0 0 0 2024-02-28T16:26:39.301 INFO:tasks.workunit.client.0.smithi148.stdout:3/562: symlink d1/db/d45/d80/la3 0 2024-02-28T16:26:39.305 INFO:tasks.workunit.client.0.smithi148.stdout:0/581: getdents d1/d15/d27/d34/d5a/d9d/d4a/d92 0 2024-02-28T16:26:39.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/405: dwrite d8/df/d17/f2c [0,4194304] 0 2024-02-28T16:26:39.310 INFO:tasks.workunit.client.0.smithi148.stdout:0/582: truncate d1/d8a/fc1 934267 0 2024-02-28T16:26:39.312 INFO:tasks.workunit.client.0.smithi148.stdout:4/406: write d8/df/d5f/f81 [727506,94882] 0 2024-02-28T16:26:39.313 INFO:tasks.workunit.client.0.smithi148.stdout:9/421: dread d7/d1c/d32/f1a [4194304,4194304] 0 2024-02-28T16:26:39.313 INFO:tasks.workunit.client.0.smithi148.stdout:1/431: rename d2/d5/d2b/f32 to d2/d5/d1a/f81 0 2024-02-28T16:26:39.313 INFO:tasks.workunit.client.0.smithi148.stdout:2/439: dread d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:39.314 INFO:tasks.workunit.client.0.smithi148.stdout:4/407: readlink d8/d40/l5e 0 2024-02-28T16:26:39.314 INFO:tasks.workunit.client.0.smithi148.stdout:6/429: mkdir d0/d22/d27/d66/d87 0 2024-02-28T16:26:39.319 INFO:tasks.workunit.client.0.smithi148.stdout:2/440: fsync d0/d9/d13/f80 0 2024-02-28T16:26:39.323 INFO:tasks.workunit.client.0.smithi148.stdout:1/432: read d2/d5/d1a/f24 [154507,11522] 0 2024-02-28T16:26:39.323 INFO:tasks.workunit.client.0.smithi148.stdout:6/430: mkdir d0/d22/d49/d88 0 2024-02-28T16:26:39.324 INFO:tasks.workunit.client.0.smithi148.stdout:0/583: mknod d1/d15/d3d/cc2 0 2024-02-28T16:26:39.327 INFO:tasks.workunit.client.0.smithi148.stdout:1/433: write d2/d15/f4d [3069159,63909] 0 2024-02-28T16:26:39.329 INFO:tasks.workunit.client.0.smithi148.stdout:3/563: creat d1/d13/d19/d1b/d38/fa4 x:0 0 0 2024-02-28T16:26:39.330 INFO:tasks.workunit.client.0.smithi148.stdout:9/422: mknod d7/d1c/d74/d68/c95 0 2024-02-28T16:26:39.332 INFO:tasks.workunit.client.0.smithi148.stdout:2/441: read d0/d1d/d52/d54/f7b [131049,106904] 0 2024-02-28T16:26:39.333 INFO:tasks.workunit.client.0.smithi148.stdout:6/431: mknod d0/d8/d21/c89 0 2024-02-28T16:26:39.334 INFO:tasks.workunit.client.0.smithi148.stdout:2/442: dread - d0/dd/f86 zero size 2024-02-28T16:26:39.334 INFO:tasks.workunit.client.0.smithi148.stdout:7/468: dwrite d0/d9/d25/d39/f44 [0,4194304] 0 2024-02-28T16:26:39.336 INFO:tasks.workunit.client.0.smithi148.stdout:1/434: unlink d2/d5/d40/d7/c70 0 2024-02-28T16:26:39.336 INFO:tasks.workunit.client.0.smithi148.stdout:2/443: stat d0/d18/d20/f50 0 2024-02-28T16:26:39.339 INFO:tasks.workunit.client.0.smithi148.stdout:3/564: mkdir d1/d3f/da5 0 2024-02-28T16:26:39.344 INFO:tasks.workunit.client.0.smithi148.stdout:6/432: write d0/d22/d25/f4b [319792,79601] 0 2024-02-28T16:26:39.348 INFO:tasks.workunit.client.0.smithi148.stdout:1/435: unlink d2/d15/d33/f49 0 2024-02-28T16:26:39.350 INFO:tasks.workunit.client.0.smithi148.stdout:4/408: getdents d8/d21/d3d 0 2024-02-28T16:26:39.351 INFO:tasks.workunit.client.0.smithi148.stdout:1/436: truncate d2/d15/f4d 5066012 0 2024-02-28T16:26:39.352 INFO:tasks.workunit.client.0.smithi148.stdout:4/409: read - d8/df/f89 zero size 2024-02-28T16:26:39.353 INFO:tasks.workunit.client.0.smithi148.stdout:7/469: creat d0/d9/d25/d47/d28/d2b/d3a/d49/f93 x:0 0 0 2024-02-28T16:26:39.357 INFO:tasks.workunit.client.0.smithi148.stdout:7/470: write d0/f13 [3182,10748] 0 2024-02-28T16:26:39.359 INFO:tasks.workunit.client.0.smithi148.stdout:4/410: symlink d8/d40/l90 0 2024-02-28T16:26:39.360 INFO:tasks.workunit.client.0.smithi148.stdout:0/584: link d1/d15/d27/d34/d5a/d9d/d4a/l77 d1/d15/d27/d34/d5a/d71/d74/dbc/lc3 0 2024-02-28T16:26:39.363 INFO:tasks.workunit.client.0.smithi148.stdout:1/437: getdents d2/d15/d62/d75/d76 0 2024-02-28T16:26:39.364 INFO:tasks.workunit.client.0.smithi148.stdout:4/411: mkdir d8/d37/d91 0 2024-02-28T16:26:39.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/444: getdents d0/d18/d20/d73 0 2024-02-28T16:26:39.366 INFO:tasks.workunit.client.0.smithi148.stdout:1/438: stat d2/l34 0 2024-02-28T16:26:39.374 INFO:tasks.workunit.client.0.smithi148.stdout:2/445: mkdir d0/d1c/d85/d8b 0 2024-02-28T16:26:39.378 INFO:tasks.workunit.client.0.smithi148.stdout:2/446: fsync d0/d18/f19 0 2024-02-28T16:26:39.378 INFO:tasks.workunit.client.0.smithi148.stdout:3/565: dwrite d1/d13/d19/d1b/d38/f8a [0,4194304] 0 2024-02-28T16:26:39.379 INFO:tasks.workunit.client.0.smithi148.stdout:9/423: dread d7/fb [0,4194304] 0 2024-02-28T16:26:39.379 INFO:tasks.workunit.client.0.smithi148.stdout:6/433: truncate d0/d22/d25/d76/f80 902846 0 2024-02-28T16:26:39.381 INFO:tasks.workunit.client.0.smithi148.stdout:7/471: dwrite d0/f76 [0,4194304] 0 2024-02-28T16:26:39.382 INFO:tasks.workunit.client.0.smithi148.stdout:4/412: link d8/d21/d3d/d4d/d72/f77 d8/df/d7c/f92 0 2024-02-28T16:26:39.383 INFO:tasks.workunit.client.0.smithi148.stdout:9/424: chown d7/f48 67027460 1 2024-02-28T16:26:39.387 INFO:tasks.workunit.client.0.smithi148.stdout:0/585: dwrite d1/d15/d27/fbb [0,4194304] 0 2024-02-28T16:26:39.387 INFO:tasks.workunit.client.0.smithi148.stdout:4/413: write d8/df/d17/d6a/f3a [1144756,3495] 0 2024-02-28T16:26:39.390 INFO:tasks.workunit.client.0.smithi148.stdout:6/434: mkdir d0/d4/d14/d8a 0 2024-02-28T16:26:39.392 INFO:tasks.workunit.client.0.smithi148.stdout:9/425: symlink d7/d1c/d59/l96 0 2024-02-28T16:26:39.393 INFO:tasks.workunit.client.0.smithi148.stdout:6/435: write d0/d10/f13 [2892292,115020] 0 2024-02-28T16:26:39.394 INFO:tasks.workunit.client.0.smithi148.stdout:9/426: write d7/d1c/d74/f70 [882433,44965] 0 2024-02-28T16:26:39.395 INFO:tasks.workunit.client.0.smithi148.stdout:9/427: dread - d7/f48 zero size 2024-02-28T16:26:39.401 INFO:tasks.workunit.client.0.smithi148.stdout:4/414: mknod d8/d21/d3d/d4d/c93 0 2024-02-28T16:26:39.407 INFO:tasks.workunit.client.0.smithi148.stdout:3/566: rename d1/d13/d19/d1b/f2a to d1/db/d45/d80/fa6 0 2024-02-28T16:26:39.411 INFO:tasks.workunit.client.0.smithi148.stdout:3/567: chown d1/db/d35/d70/d8e/f9f 185 1 2024-02-28T16:26:39.413 INFO:tasks.workunit.client.0.smithi148.stdout:0/586: fsync d1/d15/f78 0 2024-02-28T16:26:39.413 INFO:tasks.workunit.client.0.smithi148.stdout:9/428: dwrite d7/d1c/d59/f62 [0,4194304] 0 2024-02-28T16:26:39.423 INFO:tasks.workunit.client.0.smithi148.stdout:9/429: symlink d7/d1c/d59/l97 0 2024-02-28T16:26:39.425 INFO:tasks.workunit.client.0.smithi148.stdout:7/472: creat d0/d9/d25/d47/d28/d2b/d3a/f94 x:0 0 0 2024-02-28T16:26:39.433 INFO:tasks.workunit.client.0.smithi148.stdout:7/473: mknod d0/d9/d25/d47/d28/d2b/d3a/d49/c95 0 2024-02-28T16:26:39.433 INFO:tasks.workunit.client.0.smithi148.stdout:0/587: read d1/d15/d27/d34/d5a/d71/d74/fa9 [1590725,323] 0 2024-02-28T16:26:39.436 INFO:tasks.workunit.client.0.smithi148.stdout:0/588: write d1/d15/d27/fbb [4028964,123711] 0 2024-02-28T16:26:39.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/568: write d1/d13/f21 [2714539,83503] 0 2024-02-28T16:26:39.440 INFO:tasks.workunit.client.0.smithi148.stdout:6/436: dread d0/d4/fa [0,4194304] 0 2024-02-28T16:26:39.441 INFO:tasks.workunit.client.0.smithi148.stdout:9/430: link d7/d1c/d1f/l2d d7/d1c/d59/d83/l98 0 2024-02-28T16:26:39.446 INFO:tasks.workunit.client.0.smithi148.stdout:4/415: dwrite d8/df/d1f/f42 [0,4194304] 0 2024-02-28T16:26:39.447 INFO:tasks.workunit.client.0.smithi148.stdout:0/589: write d1/d15/d27/d34/d5a/d9d/d4a/f5b [3256687,124441] 0 2024-02-28T16:26:39.447 INFO:tasks.workunit.client.0.smithi148.stdout:3/569: symlink d1/db/d35/d70/la7 0 2024-02-28T16:26:39.448 INFO:tasks.workunit.client.0.smithi148.stdout:6/437: symlink d0/d22/l8b 0 2024-02-28T16:26:39.452 INFO:tasks.workunit.client.0.smithi148.stdout:4/416: mknod d8/d37/d91/c94 0 2024-02-28T16:26:39.453 INFO:tasks.workunit.client.0.smithi148.stdout:9/431: rename d7/dd/f2e to d7/d1c/f99 0 2024-02-28T16:26:39.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/570: write d1/d13/d19/d1b/d38/f8a [876875,11233] 0 2024-02-28T16:26:39.459 INFO:tasks.workunit.client.0.smithi148.stdout:3/571: truncate d1/db/d35/f92 87240 0 2024-02-28T16:26:39.460 INFO:tasks.workunit.client.0.smithi148.stdout:0/590: rmdir d1/d15/d27/d34/d5a/d71/d80/db6 39 2024-02-28T16:26:39.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/474: dread d0/f2 [0,4194304] 0 2024-02-28T16:26:39.466 INFO:tasks.workunit.client.0.smithi148.stdout:9/432: rename d7/fc to d7/d1c/f9a 0 2024-02-28T16:26:39.469 INFO:tasks.workunit.client.0.smithi148.stdout:9/433: fsync d7/d1c/f20 0 2024-02-28T16:26:39.474 INFO:tasks.workunit.client.0.smithi148.stdout:9/434: readlink d7/d1c/d32/d24/l90 0 2024-02-28T16:26:39.483 INFO:tasks.workunit.client.0.smithi148.stdout:4/417: dwrite d8/f14 [0,4194304] 0 2024-02-28T16:26:39.484 INFO:tasks.workunit.client.0.smithi148.stdout:9/435: rename d7/d1c/d1f/f33 to d7/d1c/d74/f9b 0 2024-02-28T16:26:39.484 INFO:tasks.workunit.client.0.smithi148.stdout:3/572: dwrite d1/db/f65 [0,4194304] 0 2024-02-28T16:26:39.484 INFO:tasks.workunit.client.0.smithi148.stdout:6/438: dwrite d0/d4/f3c [0,4194304] 0 2024-02-28T16:26:39.488 INFO:tasks.workunit.client.0.smithi148.stdout:3/573: stat d1/db/d45/f4d 0 2024-02-28T16:26:39.488 INFO:tasks.workunit.client.0.smithi148.stdout:9/436: readlink d7/dd/l3e 0 2024-02-28T16:26:39.489 INFO:tasks.workunit.client.0.smithi148.stdout:9/437: chown d7/d43/f60 1195969 1 2024-02-28T16:26:39.490 INFO:tasks.workunit.client.0.smithi148.stdout:4/418: mkdir d8/d21/d3d/d4d/d95 0 2024-02-28T16:26:39.493 INFO:tasks.workunit.client.0.smithi148.stdout:9/438: read d7/d1c/f20 [1437791,51014] 0 2024-02-28T16:26:39.496 INFO:tasks.workunit.client.0.smithi148.stdout:6/439: rename d0/d22/d27/c33 to d0/d8/c8c 0 2024-02-28T16:26:39.496 INFO:tasks.workunit.client.0.smithi148.stdout:4/419: dread d8/d21/f30 [0,4194304] 0 2024-02-28T16:26:39.498 INFO:tasks.workunit.client.0.smithi148.stdout:9/439: unlink d7/l9 0 2024-02-28T16:26:39.501 INFO:tasks.workunit.client.0.smithi148.stdout:4/420: write d8/df/d17/f1d [285638,119839] 0 2024-02-28T16:26:39.501 INFO:tasks.workunit.client.0.smithi148.stdout:9/440: mknod d7/d1c/d3d/c9c 0 2024-02-28T16:26:39.503 INFO:tasks.workunit.client.0.smithi148.stdout:4/421: chown d8/d37/d91 42773847 1 2024-02-28T16:26:39.503 INFO:tasks.workunit.client.0.smithi148.stdout:3/574: rename d1/d13/d19/f59 to d1/fa8 0 2024-02-28T16:26:39.505 INFO:tasks.workunit.client.0.smithi148.stdout:9/441: truncate d7/d1c/f20 5235535 0 2024-02-28T16:26:39.506 INFO:tasks.workunit.client.0.smithi148.stdout:3/575: fdatasync d1/d3f/f77 0 2024-02-28T16:26:39.510 INFO:tasks.workunit.client.0.smithi148.stdout:0/591: dread d1/d15/d3d/d67/f89 [0,4194304] 0 2024-02-28T16:26:39.518 INFO:tasks.workunit.client.0.smithi148.stdout:9/442: symlink d7/d1c/d3d/l9d 0 2024-02-28T16:26:39.520 INFO:tasks.workunit.client.0.smithi148.stdout:0/592: mkdir d1/d15/d27/d34/d5a/d9d/d5f/d93/d9b/dc4 0 2024-02-28T16:26:39.521 INFO:tasks.workunit.client.0.smithi148.stdout:3/576: mkdir d1/d3f/da5/da9 0 2024-02-28T16:26:39.523 INFO:tasks.workunit.client.0.smithi148.stdout:6/440: dread d0/d4/d14/d59/f75 [0,4194304] 0 2024-02-28T16:26:39.524 INFO:tasks.workunit.client.0.smithi148.stdout:3/577: fdatasync d1/d13/d19/d56/f5e 0 2024-02-28T16:26:39.527 INFO:tasks.workunit.client.0.smithi148.stdout:3/578: fsync d1/db/d35/d70/d71/f84 0 2024-02-28T16:26:39.527 INFO:tasks.workunit.client.0.smithi148.stdout:4/422: dwrite d8/f15 [0,4194304] 0 2024-02-28T16:26:39.528 INFO:tasks.workunit.client.0.smithi148.stdout:9/443: dread d7/d1c/d3d/f61 [0,4194304] 0 2024-02-28T16:26:39.529 INFO:tasks.workunit.client.0.smithi148.stdout:7/475: dread d0/d9/d25/d47/d28/d2b/d3a/f8b [0,4194304] 0 2024-02-28T16:26:39.531 INFO:tasks.workunit.client.0.smithi148.stdout:9/444: write d7/d1c/d59/f62 [4170829,28371] 0 2024-02-28T16:26:39.536 INFO:tasks.workunit.client.0.smithi148.stdout:9/445: creat d7/d1c/d74/f9e x:0 0 0 2024-02-28T16:26:39.536 INFO:tasks.workunit.client.0.smithi148.stdout:4/423: fsync d8/df/d1f/f3c 0 2024-02-28T16:26:39.540 INFO:tasks.workunit.client.0.smithi148.stdout:7/476: mkdir d0/d9/d25/d96 0 2024-02-28T16:26:39.542 INFO:tasks.workunit.client.0.smithi148.stdout:7/477: chown d0/d9/d25/d47/d28/d2b/d6f/d82 7 1 2024-02-28T16:26:39.544 INFO:tasks.workunit.client.0.smithi148.stdout:7/478: chown d0/d9/d25/d47/d28 28 1 2024-02-28T16:26:39.546 INFO:tasks.workunit.client.0.smithi148.stdout:3/579: dread d1/db/d45/f98 [0,4194304] 0 2024-02-28T16:26:39.551 INFO:tasks.workunit.client.0.smithi148.stdout:7/479: mkdir d0/d9/d25/d47/d28/d2b/d3a/d49/d97 0 2024-02-28T16:26:39.553 INFO:tasks.workunit.client.0.smithi148.stdout:4/424: getdents d8 0 2024-02-28T16:26:39.555 INFO:tasks.workunit.client.0.smithi148.stdout:7/480: stat d0/d9/d25/d47/d28/d2b/d3a 0 2024-02-28T16:26:39.555 INFO:tasks.workunit.client.0.smithi148.stdout:0/593: write d1/d4/f60 [1274745,75375] 0 2024-02-28T16:26:39.557 INFO:tasks.workunit.client.0.smithi148.stdout:4/425: write d8/d21/d3d/d4d/f58 [235933,13918] 0 2024-02-28T16:26:39.560 INFO:tasks.workunit.client.0.smithi148.stdout:7/481: fdatasync d0/d9/d25/d47/d28/d2b/d3a/d49/f51 0 2024-02-28T16:26:39.560 INFO:tasks.workunit.client.0.smithi148.stdout:3/580: dread d1/d13/d19/d1b/d38/d7c/f8d [0,4194304] 0 2024-02-28T16:26:39.562 INFO:tasks.workunit.client.0.smithi148.stdout:0/594: write d1/d15/d27/d34/d5a/d9d/d4a/f57 [1042290,55063] 0 2024-02-28T16:26:39.564 INFO:tasks.workunit.client.0.smithi148.stdout:9/446: dread d7/d1c/d74/f50 [0,4194304] 0 2024-02-28T16:26:39.565 INFO:tasks.workunit.client.0.smithi148.stdout:3/581: read d1/db/d45/f7d [4042111,8275] 0 2024-02-28T16:26:39.568 INFO:tasks.workunit.client.0.smithi148.stdout:0/595: dread d1/d4/f6e [8388608,4194304] 0 2024-02-28T16:26:39.569 INFO:tasks.workunit.client.0.smithi148.stdout:7/482: unlink d0/d9/c20 0 2024-02-28T16:26:39.572 INFO:tasks.workunit.client.0.smithi148.stdout:9/447: creat d7/d1c/d1f/d49/d6a/f9f x:0 0 0 2024-02-28T16:26:39.576 INFO:tasks.workunit.client.0.smithi148.stdout:0/596: mknod d1/d15/d27/d34/d5a/d71/d74/d7e/da4/cc5 0 2024-02-28T16:26:39.579 INFO:tasks.workunit.client.0.smithi148.stdout:9/448: mkdir d7/d1c/d1f/d49/da0 0 2024-02-28T16:26:39.591 INFO:tasks.workunit.client.0.smithi148.stdout:4/426: truncate d8/d21/d3d/d4d/f58 1567100 0 2024-02-28T16:26:39.591 INFO:tasks.workunit.client.0.smithi148.stdout:3/582: dread d1/d13/d19/d56/d5b/f68 [0,4194304] 0 2024-02-28T16:26:39.594 INFO:tasks.workunit.client.0.smithi148.stdout:7/483: getdents d0/d9/d25/d47/d28/d2b/d3a/d49 0 2024-02-28T16:26:39.595 INFO:tasks.workunit.client.0.smithi148.stdout:9/449: chown d7/dd/d26/c63 2995 1 2024-02-28T16:26:39.596 INFO:tasks.workunit.client.0.smithi148.stdout:7/484: stat d0/d4/f63 0 2024-02-28T16:26:39.602 INFO:tasks.workunit.client.0.smithi148.stdout:4/427: dread d8/df/d17/f1d [0,4194304] 0 2024-02-28T16:26:39.603 INFO:tasks.workunit.client.0.smithi148.stdout:7/485: creat d0/d9/d25/d47/d28/f98 x:0 0 0 2024-02-28T16:26:39.604 INFO:tasks.workunit.client.0.smithi148.stdout:4/428: stat d8/d21/d3d/f52 0 2024-02-28T16:26:39.606 INFO:tasks.workunit.client.0.smithi148.stdout:3/583: truncate d1/db/d45/f8b 2189335 0 2024-02-28T16:26:39.606 INFO:tasks.workunit.client.0.smithi148.stdout:0/597: dwrite d1/d15/f55 [0,4194304] 0 2024-02-28T16:26:39.609 INFO:tasks.workunit.client.0.smithi148.stdout:0/598: readlink d1/d15/d27/d34/d5a/d9d/d5f/d93/la6 0 2024-02-28T16:26:39.611 INFO:tasks.workunit.client.0.smithi148.stdout:3/584: truncate d1/d13/d19/d32/d41/fa2 191867 0 2024-02-28T16:26:39.612 INFO:tasks.workunit.client.0.smithi148.stdout:9/450: dread d7/d1c/d32/f1a [4194304,4194304] 0 2024-02-28T16:26:39.614 INFO:tasks.workunit.client.0.smithi148.stdout:7/486: symlink d0/d9/d25/d47/d28/d2b/d6f/d82/l99 0 2024-02-28T16:26:39.614 INFO:tasks.workunit.client.0.smithi148.stdout:4/429: creat d8/d40/d73/f96 x:0 0 0 2024-02-28T16:26:39.616 INFO:tasks.workunit.client.0.smithi148.stdout:3/585: chown d1/l4 205345 1 2024-02-28T16:26:39.619 INFO:tasks.workunit.client.0.smithi148.stdout:3/586: write d1/d13/d19/d1b/f44 [4057283,6573] 0 2024-02-28T16:26:39.620 INFO:tasks.workunit.client.0.smithi148.stdout:7/487: rename d0/d4/d70/f86 to d0/d9/f9a 0 2024-02-28T16:26:39.623 INFO:tasks.workunit.client.0.smithi148.stdout:7/488: mknod d0/d9/d4c/c9b 0 2024-02-28T16:26:39.628 INFO:tasks.workunit.client.0.smithi148.stdout:3/587: link d1/d13/d19/d32/d41/f60 d1/db/d45/faa 0 2024-02-28T16:26:39.628 INFO:tasks.workunit.client.0.smithi148.stdout:0/599: rename d1/d15/d27/d34/d5a/d9d/d5f/d93/d9b to d1/d15/d27/d7a/dc6 0 2024-02-28T16:26:39.631 INFO:tasks.workunit.client.0.smithi148.stdout:7/489: dread d0/d9/d46/f6e [0,4194304] 0 2024-02-28T16:26:39.635 INFO:tasks.workunit.client.0.smithi148.stdout:3/588: read d1/d13/d19/d32/f37 [7314658,79910] 0 2024-02-28T16:26:39.635 INFO:tasks.workunit.client.0.smithi148.stdout:0/600: stat d1/d15/d27/d7a/l58 0 2024-02-28T16:26:39.636 INFO:tasks.workunit.client.0.smithi148.stdout:9/451: dwrite d7/dd/d26/f69 [4194304,4194304] 0 2024-02-28T16:26:39.638 INFO:tasks.workunit.client.0.smithi148.stdout:9/452: chown d7/d1c/l57 124024 1 2024-02-28T16:26:39.639 INFO:tasks.workunit.client.0.smithi148.stdout:7/490: symlink d0/d9/d4c/l9c 0 2024-02-28T16:26:39.640 INFO:tasks.workunit.client.0.smithi148.stdout:7/491: fdatasync d0/d4/f63 0 2024-02-28T16:26:39.645 INFO:tasks.workunit.client.0.smithi148.stdout:0/601: mkdir d1/d15/d27/d34/d5a/d9d/dc7 0 2024-02-28T16:26:39.646 INFO:tasks.workunit.client.0.smithi148.stdout:9/453: fsync d7/fb 0 2024-02-28T16:26:39.647 INFO:tasks.workunit.client.0.smithi148.stdout:9/454: stat d7/d1c/d1f/l84 0 2024-02-28T16:26:39.650 INFO:tasks.workunit.client.0.smithi148.stdout:3/589: truncate d1/d13/f15 2273747 0 2024-02-28T16:26:39.651 INFO:tasks.workunit.client.0.smithi148.stdout:9/455: mknod d7/d1c/d59/d83/ca1 0 2024-02-28T16:26:39.653 INFO:tasks.workunit.client.0.smithi148.stdout:0/602: creat d1/d15/d27/d34/d5a/d71/d74/d7e/db7/fc8 x:0 0 0 2024-02-28T16:26:39.654 INFO:tasks.workunit.client.0.smithi148.stdout:3/590: write d1/d13/d19/d1b/d38/f82 [1767595,66111] 0 2024-02-28T16:26:39.655 INFO:tasks.workunit.client.0.smithi148.stdout:9/456: dread - d7/d1c/d32/d24/d78/f8c zero size 2024-02-28T16:26:39.658 INFO:tasks.workunit.client.0.smithi148.stdout:3/591: chown d1/db/d35/d70/d71/f83 5 1 2024-02-28T16:26:39.658 INFO:tasks.workunit.client.0.smithi148.stdout:7/492: dwrite d0/d9/d25/d47/d1c/f48 [0,4194304] 0 2024-02-28T16:26:39.660 INFO:tasks.workunit.client.0.smithi148.stdout:0/603: mkdir d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9 0 2024-02-28T16:26:39.662 INFO:tasks.workunit.client.0.smithi148.stdout:0/604: write d1/d4/d25/f61 [3918235,71306] 0 2024-02-28T16:26:39.668 INFO:tasks.workunit.client.0.smithi148.stdout:9/457: write d7/d1c/f34 [2298153,40685] 0 2024-02-28T16:26:39.670 INFO:tasks.workunit.client.0.smithi148.stdout:3/592: truncate d1/d13/d19/d1b/f5c 3105469 0 2024-02-28T16:26:39.671 INFO:tasks.workunit.client.0.smithi148.stdout:7/493: getdents d0/d9/d25/d39 0 2024-02-28T16:26:39.672 INFO:tasks.workunit.client.0.smithi148.stdout:9/458: mkdir d7/d1c/d32/d24/da2 0 2024-02-28T16:26:39.673 INFO:tasks.workunit.client.0.smithi148.stdout:3/593: creat d1/d13/d19/d32/d41/fab x:0 0 0 2024-02-28T16:26:39.674 INFO:tasks.workunit.client.0.smithi148.stdout:9/459: write d7/d1c/f20 [867940,44645] 0 2024-02-28T16:26:39.677 INFO:tasks.workunit.client.0.smithi148.stdout:9/460: write d7/f17 [3973030,41091] 0 2024-02-28T16:26:39.677 INFO:tasks.workunit.client.0.smithi148.stdout:7/494: truncate d0/d9/d25/d47/d28/d2b/d3a/f8b 4821163 0 2024-02-28T16:26:39.681 INFO:tasks.workunit.client.0.smithi148.stdout:3/594: rename d1/l25 to d1/d3f/lac 0 2024-02-28T16:26:39.682 INFO:tasks.workunit.client.0.smithi148.stdout:9/461: dread d7/d1c/d3d/f61 [0,4194304] 0 2024-02-28T16:26:39.685 INFO:tasks.workunit.client.0.smithi148.stdout:7/495: rename d0/d9/d25/d47/d28/d2b/d3a/f94 to d0/d9/d1b/f9d 0 2024-02-28T16:26:39.686 INFO:tasks.workunit.client.0.smithi148.stdout:3/595: symlink d1/db/d35/lad 0 2024-02-28T16:26:39.688 INFO:tasks.workunit.client.0.smithi148.stdout:3/596: fsync d1/db/d35/d70/d71/f83 0 2024-02-28T16:26:39.688 INFO:tasks.workunit.client.0.smithi148.stdout:7/496: dread d0/d9/d46/f6e [0,4194304] 0 2024-02-28T16:26:39.691 INFO:tasks.workunit.client.0.smithi148.stdout:3/597: write d1/db/d35/f6b [508775,91042] 0 2024-02-28T16:26:39.695 INFO:tasks.workunit.client.0.smithi148.stdout:7/497: unlink d0/d9/d25/d47/l22 0 2024-02-28T16:26:39.697 INFO:tasks.workunit.client.0.smithi148.stdout:7/498: readlink d0/d9/d25/l4b 0 2024-02-28T16:26:39.700 INFO:tasks.workunit.client.0.smithi148.stdout:9/462: dwrite d7/d1c/d32/d24/f65 [0,4194304] 0 2024-02-28T16:26:39.703 INFO:tasks.workunit.client.0.smithi148.stdout:9/463: chown d7/dd/d26/f69 43 1 2024-02-28T16:26:39.704 INFO:tasks.workunit.client.0.smithi148.stdout:0/605: dread d1/d15/d8/f30 [0,4194304] 0 2024-02-28T16:26:39.710 INFO:tasks.workunit.client.0.smithi148.stdout:9/464: symlink d7/d1c/d3d/la3 0 2024-02-28T16:26:39.714 INFO:tasks.workunit.client.0.smithi148.stdout:3/598: dwrite d1/d13/d19/d32/d41/fab [0,4194304] 0 2024-02-28T16:26:39.724 INFO:tasks.workunit.client.0.smithi148.stdout:3/599: unlink d1/l2f 0 2024-02-28T16:26:39.733 INFO:tasks.workunit.client.0.smithi148.stdout:7/499: dwrite d0/d9/d25/d47/d28/d2b/d5c/f85 [0,4194304] 0 2024-02-28T16:26:39.743 INFO:tasks.workunit.client.0.smithi148.stdout:3/600: dwrite d1/d13/d19/d88/f8c [0,4194304] 0 2024-02-28T16:26:39.753 INFO:tasks.workunit.client.0.smithi148.stdout:9/465: dread d7/d43/f60 [0,4194304] 0 2024-02-28T16:26:39.759 INFO:tasks.workunit.client.0.smithi148.stdout:9/466: creat d7/d1c/d59/fa4 x:0 0 0 2024-02-28T16:26:39.762 INFO:tasks.workunit.client.0.smithi148.stdout:9/467: fsync d7/d1c/d32/d24/f38 0 2024-02-28T16:26:39.764 INFO:tasks.workunit.client.0.smithi148.stdout:3/601: dwrite d1/db/d35/d52/f54 [0,4194304] 0 2024-02-28T16:26:39.766 INFO:tasks.workunit.client.0.smithi148.stdout:0/606: dread d1/d4/f6e [0,4194304] 0 2024-02-28T16:26:39.766 INFO:tasks.workunit.client.0.smithi148.stdout:7/500: write d0/d9/d4c/f6b [9674,62155] 0 2024-02-28T16:26:39.773 INFO:tasks.workunit.client.0.smithi148.stdout:3/602: creat d1/d13/d19/d56/fae x:0 0 0 2024-02-28T16:26:39.774 INFO:tasks.workunit.client.0.smithi148.stdout:7/501: write d0/d18/f79 [327192,116477] 0 2024-02-28T16:26:39.774 INFO:tasks.workunit.client.0.smithi148.stdout:0/607: symlink d1/d15/d27/d34/d5a/d9d/d5f/d93/lca 0 2024-02-28T16:26:39.776 INFO:tasks.workunit.client.0.smithi148.stdout:7/502: chown d0/d9/d25 21166128 1 2024-02-28T16:26:39.780 INFO:tasks.workunit.client.0.smithi148.stdout:9/468: link d7/d1c/l41 d7/d1c/d3d/la5 0 2024-02-28T16:26:39.784 INFO:tasks.workunit.client.0.smithi148.stdout:9/469: chown d7/d1c/f75 1 1 2024-02-28T16:26:39.786 INFO:tasks.workunit.client.0.smithi148.stdout:9/470: fdatasync d7/d1c/f34 0 2024-02-28T16:26:39.789 INFO:tasks.workunit.client.0.smithi148.stdout:9/471: write d7/d1c/d1f/d49/f5f [744343,84699] 0 2024-02-28T16:26:39.795 INFO:tasks.workunit.client.0.smithi148.stdout:9/472: creat d7/d1c/d1f/d49/d6a/fa6 x:0 0 0 2024-02-28T16:26:39.798 INFO:tasks.workunit.client.0.smithi148.stdout:7/503: dwrite d0/d9/d25/d47/d28/d2b/f69 [0,4194304] 0 2024-02-28T16:26:39.806 INFO:tasks.workunit.client.0.smithi148.stdout:9/473: dread d7/dd/d26/f5d [0,4194304] 0 2024-02-28T16:26:39.813 INFO:tasks.workunit.client.0.smithi148.stdout:0/608: dwrite d1/d4/f6e [0,4194304] 0 2024-02-28T16:26:39.816 INFO:tasks.workunit.client.0.smithi148.stdout:5/434: sync 2024-02-28T16:26:39.816 INFO:tasks.workunit.client.0.smithi148.stdout:8/463: sync 2024-02-28T16:26:39.817 INFO:tasks.workunit.client.0.smithi148.stdout:9/474: mkdir d7/d1c/d1f/d49/da7 0 2024-02-28T16:26:39.818 INFO:tasks.workunit.client.0.smithi148.stdout:8/464: stat d1/dd/d13/d1a/d25/d50 0 2024-02-28T16:26:39.821 INFO:tasks.workunit.client.0.smithi148.stdout:9/475: stat d7/d1c/d3d/l7b 0 2024-02-28T16:26:39.827 INFO:tasks.workunit.client.0.smithi148.stdout:8/465: unlink d1/dd/c4f 0 2024-02-28T16:26:39.827 INFO:tasks.workunit.client.0.smithi148.stdout:0/609: rename d1/d15/d3d/fa2 to d1/d15/d27/d7a/fcb 0 2024-02-28T16:26:39.833 INFO:tasks.workunit.client.0.smithi148.stdout:0/610: mknod d1/d15/d27/d7a/dc6/da7/ccc 0 2024-02-28T16:26:39.836 INFO:tasks.workunit.client.0.smithi148.stdout:8/466: getdents d1/d3/d18/d48/d70 0 2024-02-28T16:26:39.836 INFO:tasks.workunit.client.0.smithi148.stdout:9/476: dwrite d7/d1c/d32/d24/f65 [0,4194304] 0 2024-02-28T16:26:39.839 INFO:tasks.workunit.client.0.smithi148.stdout:0/611: write d1/d15/d27/d34/d5a/d9d/d5f/fa0 [1017325,103286] 0 2024-02-28T16:26:39.844 INFO:tasks.workunit.client.0.smithi148.stdout:9/477: mkdir d7/d43/da8 0 2024-02-28T16:26:39.844 INFO:tasks.workunit.client.0.smithi148.stdout:8/467: mknod d1/d3/d18/d48/d22/d55/c92 0 2024-02-28T16:26:39.845 INFO:tasks.workunit.client.0.smithi148.stdout:7/504: write d0/d9/d25/d47/f41 [1341470,62040] 0 2024-02-28T16:26:39.847 INFO:tasks.workunit.client.0.smithi148.stdout:0/612: mkdir d1/d15/d27/d34/d5a/dcd 0 2024-02-28T16:26:39.851 INFO:tasks.workunit.client.0.smithi148.stdout:0/613: dread - d1/d15/d27/d34/fb0 zero size 2024-02-28T16:26:39.851 INFO:tasks.workunit.client.0.smithi148.stdout:9/478: dread d7/dd/d26/f5d [0,4194304] 0 2024-02-28T16:26:39.855 INFO:tasks.workunit.client.0.smithi148.stdout:7/505: truncate d0/d9/d46/d65/f84 55969 0 2024-02-28T16:26:39.857 INFO:tasks.workunit.client.0.smithi148.stdout:9/479: symlink d7/d43/da8/la9 0 2024-02-28T16:26:39.862 INFO:tasks.workunit.client.0.smithi148.stdout:9/480: rmdir d7/d1c/d1f/d49/d6a 39 2024-02-28T16:26:39.863 INFO:tasks.workunit.client.0.smithi148.stdout:5/435: dwrite d1/d8/d23/f2d [0,4194304] 0 2024-02-28T16:26:39.866 INFO:tasks.workunit.client.0.smithi148.stdout:0/614: dread d1/d15/d27/d34/d5a/d6c/f75 [0,4194304] 0 2024-02-28T16:26:39.875 INFO:tasks.workunit.client.0.smithi148.stdout:9/481: getdents d7/d1c/d32 0 2024-02-28T16:26:39.880 INFO:tasks.workunit.client.0.smithi148.stdout:8/468: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:26:39.880 INFO:tasks.workunit.client.0.smithi148.stdout:9/482: mknod d7/d1c/d74/d6b/caa 0 2024-02-28T16:26:39.883 INFO:tasks.workunit.client.0.smithi148.stdout:8/469: fsync d1/d3/d18/d5a/d60/f6d 0 2024-02-28T16:26:39.885 INFO:tasks.workunit.client.0.smithi148.stdout:9/483: rename d7/fb to d7/d43/da8/fab 0 2024-02-28T16:26:39.892 INFO:tasks.workunit.client.0.smithi148.stdout:8/470: creat d1/dd/f93 x:0 0 0 2024-02-28T16:26:39.894 INFO:tasks.workunit.client.0.smithi148.stdout:5/436: dwrite d1/d8/f7b [0,4194304] 0 2024-02-28T16:26:39.895 INFO:tasks.workunit.client.0.smithi148.stdout:8/471: dread - d1/dd/f93 zero size 2024-02-28T16:26:39.905 INFO:tasks.workunit.client.0.smithi148.stdout:9/484: dwrite d7/f17 [0,4194304] 0 2024-02-28T16:26:39.915 INFO:tasks.workunit.client.0.smithi148.stdout:0/615: dread d1/d15/d27/d34/d5a/d9d/d4a/d92/fa8 [0,4194304] 0 2024-02-28T16:26:39.917 INFO:tasks.workunit.client.0.smithi148.stdout:8/472: write d1/f27 [655507,17120] 0 2024-02-28T16:26:39.922 INFO:tasks.workunit.client.0.smithi148.stdout:0/616: rename d1/d15/d27/fbd to d1/d8a/fce 0 2024-02-28T16:26:39.922 INFO:tasks.workunit.client.0.smithi148.stdout:5/437: truncate d1/d8/d20/d31/f39 4159686 0 2024-02-28T16:26:39.925 INFO:tasks.workunit.client.0.smithi148.stdout:9/485: truncate d7/d1c/d3d/f56 440095 0 2024-02-28T16:26:39.928 INFO:tasks.workunit.client.0.smithi148.stdout:5/438: creat d1/d44/d64/f83 x:0 0 0 2024-02-28T16:26:39.937 INFO:tasks.workunit.client.0.smithi148.stdout:9/486: write d7/d1c/d1f/d49/d6a/fa6 [237457,99507] 0 2024-02-28T16:26:39.951 INFO:tasks.workunit.client.0.smithi148.stdout:9/487: mkdir d7/d1c/d32/d24/dac 0 2024-02-28T16:26:39.952 INFO:tasks.workunit.client.0.smithi148.stdout:0/617: dwrite d1/d15/d27/d34/d5a/d9d/d4a/d92/f9f [0,4194304] 0 2024-02-28T16:26:39.952 INFO:tasks.workunit.client.0.smithi148.stdout:9/488: creat d7/d1c/d32/d24/fad x:0 0 0 2024-02-28T16:26:39.952 INFO:tasks.workunit.client.0.smithi148.stdout:8/473: dread d1/dd/d13/d24/d3a/f69 [0,4194304] 0 2024-02-28T16:26:39.955 INFO:tasks.workunit.client.0.smithi148.stdout:5/439: dread d1/d8/fa [0,4194304] 0 2024-02-28T16:26:39.955 INFO:tasks.workunit.client.0.smithi148.stdout:8/474: write d1/dd/d13/d1a/f3e [5151047,38229] 0 2024-02-28T16:26:39.960 INFO:tasks.workunit.client.0.smithi148.stdout:9/489: mkdir d7/d1c/d1f/d49/dae 0 2024-02-28T16:26:39.965 INFO:tasks.workunit.client.0.smithi148.stdout:0/618: getdents d1/d15/d27/d34/d5a/d71/d74/d7e 0 2024-02-28T16:26:39.966 INFO:tasks.workunit.client.0.smithi148.stdout:8/475: getdents d1/dd/d13/d68 0 2024-02-28T16:26:39.970 INFO:tasks.workunit.client.0.smithi148.stdout:0/619: fdatasync d1/d15/d27/f9e 0 2024-02-28T16:26:39.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/440: dwrite d1/d1a/f66 [4194304,4194304] 0 2024-02-28T16:26:39.973 INFO:tasks.workunit.client.0.smithi148.stdout:9/490: link d7/d1c/d74/f9b d7/faf 0 2024-02-28T16:26:39.976 INFO:tasks.workunit.client.0.smithi148.stdout:5/441: mkdir d1/d8/d20/d4e/d84 0 2024-02-28T16:26:39.976 INFO:tasks.workunit.client.0.smithi148.stdout:9/491: write d7/d1c/d32/d24/fad [649181,55212] 0 2024-02-28T16:26:39.977 INFO:tasks.workunit.client.0.smithi148.stdout:0/620: mknod d1/d15/d27/d34/ccf 0 2024-02-28T16:26:39.978 INFO:tasks.workunit.client.0.smithi148.stdout:5/442: write d1/d8/d23/f2d [4615472,72883] 0 2024-02-28T16:26:39.981 INFO:tasks.workunit.client.0.smithi148.stdout:9/492: creat d7/d1c/d1f/d49/d6a/fb0 x:0 0 0 2024-02-28T16:26:39.981 INFO:tasks.workunit.client.0.smithi148.stdout:5/443: stat d1/d8/d20/d31/f40 0 2024-02-28T16:26:39.983 INFO:tasks.workunit.client.0.smithi148.stdout:9/493: chown d7/d1c/d32/d24/da2 1882837 1 2024-02-28T16:26:39.986 INFO:tasks.workunit.client.0.smithi148.stdout:9/494: readlink d7/d1c/d1f/l2d 0 2024-02-28T16:26:39.989 INFO:tasks.workunit.client.0.smithi148.stdout:5/444: link d1/l58 d1/d8/d20/l85 0 2024-02-28T16:26:39.991 INFO:tasks.workunit.client.0.smithi148.stdout:9/495: rename d7/f48 to d7/d1c/d59/d83/fb1 0 2024-02-28T16:26:39.993 INFO:tasks.workunit.client.0.smithi148.stdout:8/476: truncate d1/f7 568764 0 2024-02-28T16:26:39.993 INFO:tasks.workunit.client.0.smithi148.stdout:8/477: stat d1/d3/f20 0 2024-02-28T16:26:39.994 INFO:tasks.workunit.client.0.smithi148.stdout:9/496: write d7/d1c/f94 [411088,99308] 0 2024-02-28T16:26:39.996 INFO:tasks.workunit.client.0.smithi148.stdout:5/445: rename d1/d8/fa to d1/db/d60/f86 0 2024-02-28T16:26:39.996 INFO:tasks.workunit.client.0.smithi148.stdout:9/497: stat d7/d1c/f99 0 2024-02-28T16:26:39.998 INFO:tasks.workunit.client.0.smithi148.stdout:9/498: chown d7/d1c/d1f/d49/d6a/fb0 320366 1 2024-02-28T16:26:40.000 INFO:tasks.workunit.client.0.smithi148.stdout:8/478: rename d1/dd/d13/d24/d3a/d49/l76 to d1/d3/d18/d48/d22/d55/l94 0 2024-02-28T16:26:40.001 INFO:tasks.workunit.client.0.smithi148.stdout:9/499: creat d7/d1c/d1f/d49/d6a/fb2 x:0 0 0 2024-02-28T16:26:40.003 INFO:tasks.workunit.client.0.smithi148.stdout:9/500: dread - d7/d1c/d59/d83/fb1 zero size 2024-02-28T16:26:40.003 INFO:tasks.workunit.client.0.smithi148.stdout:8/479: creat d1/dd/d13/d68/f95 x:0 0 0 2024-02-28T16:26:40.006 INFO:tasks.workunit.client.0.smithi148.stdout:8/480: creat d1/d3/d18/f96 x:0 0 0 2024-02-28T16:26:40.007 INFO:tasks.workunit.client.0.smithi148.stdout:5/446: dread d1/db/d25/f1f [0,4194304] 0 2024-02-28T16:26:40.009 INFO:tasks.workunit.client.0.smithi148.stdout:9/501: rename d7/d1c/d32/d24/l90 to d7/d1c/d74/d6b/lb3 0 2024-02-28T16:26:40.013 INFO:tasks.workunit.client.0.smithi148.stdout:9/502: unlink d7/d1c/d59/d83/f87 0 2024-02-28T16:26:40.019 INFO:tasks.workunit.client.0.smithi148.stdout:9/503: link d7/d1c/d1f/f4a d7/d1c/d74/d68/d81/fb4 0 2024-02-28T16:26:40.023 INFO:tasks.workunit.client.0.smithi148.stdout:9/504: read d7/f3c [2518461,96669] 0 2024-02-28T16:26:40.024 INFO:tasks.workunit.client.0.smithi148.stdout:5/447: dwrite d1/d1a/f5e [0,4194304] 0 2024-02-28T16:26:40.030 INFO:tasks.workunit.client.0.smithi148.stdout:8/481: dread d1/d3/f53 [0,4194304] 0 2024-02-28T16:26:40.031 INFO:tasks.workunit.client.0.smithi148.stdout:5/448: mkdir d1/db/d60/d7a/d87 0 2024-02-28T16:26:40.034 INFO:tasks.workunit.client.0.smithi148.stdout:8/482: stat d1/dd/d51/d77/c8a 0 2024-02-28T16:26:40.037 INFO:tasks.workunit.client.0.smithi148.stdout:8/483: mknod d1/dd/d13/d1a/d25/d50/c97 0 2024-02-28T16:26:40.042 INFO:tasks.workunit.client.0.smithi148.stdout:5/449: stat d1/d8/d20/l7f 0 2024-02-28T16:26:40.044 INFO:tasks.workunit.client.0.smithi148.stdout:8/484: creat d1/dd/d13/f98 x:0 0 0 2024-02-28T16:26:40.046 INFO:tasks.workunit.client.0.smithi148.stdout:5/450: creat d1/db/d60/d7a/f88 x:0 0 0 2024-02-28T16:26:40.047 INFO:tasks.workunit.client.0.smithi148.stdout:8/485: mknod d1/d3/d18/c99 0 2024-02-28T16:26:40.052 INFO:tasks.workunit.client.0.smithi148.stdout:5/451: unlink d1/d8/d23/f4f 0 2024-02-28T16:26:40.054 INFO:tasks.workunit.client.0.smithi148.stdout:9/505: rmdir d7/d1c/d59/d83 39 2024-02-28T16:26:40.055 INFO:tasks.workunit.client.0.smithi148.stdout:5/452: dread d1/d8/d20/d31/f4d [0,4194304] 0 2024-02-28T16:26:40.060 INFO:tasks.workunit.client.0.smithi148.stdout:9/506: dread - d7/d1c/d59/d83/d88/f8a zero size 2024-02-28T16:26:40.061 INFO:tasks.workunit.client.0.smithi148.stdout:5/453: mkdir d1/d8/d20/d31/d50/d89 0 2024-02-28T16:26:40.062 INFO:tasks.workunit.client.0.smithi148.stdout:5/454: fdatasync d1/db/f82 0 2024-02-28T16:26:40.063 INFO:tasks.workunit.client.0.smithi148.stdout:8/486: rmdir d1/dd/d13/d24/d3a/d49/d90 0 2024-02-28T16:26:40.064 INFO:tasks.workunit.client.0.smithi148.stdout:5/455: write d1/d1a/f5e [116998,71579] 0 2024-02-28T16:26:40.065 INFO:tasks.workunit.client.0.smithi148.stdout:9/507: mkdir d7/d1c/d1f/d49/d5c/db5 0 2024-02-28T16:26:40.067 INFO:tasks.workunit.client.0.smithi148.stdout:8/487: fsync d1/d3/d18/f5d 0 2024-02-28T16:26:40.070 INFO:tasks.workunit.client.0.smithi148.stdout:5/456: creat d1/d8/d20/d4e/d84/f8a x:0 0 0 2024-02-28T16:26:40.071 INFO:tasks.workunit.client.0.smithi148.stdout:8/488: mkdir d1/d3/d9a 0 2024-02-28T16:26:40.072 INFO:tasks.workunit.client.0.smithi148.stdout:9/508: mkdir d7/d1c/d32/d24/da2/db6 0 2024-02-28T16:26:40.076 INFO:tasks.workunit.client.0.smithi148.stdout:5/457: rename d1/d1a to d1/db/d60/d7a/d8b 0 2024-02-28T16:26:40.088 INFO:tasks.workunit.client.0.smithi148.stdout:9/509: dwrite d7/d1c/d1f/d49/d6a/fb0 [0,4194304] 0 2024-02-28T16:26:40.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/510: chown d7/d1c/d1f/c3f 56023505 1 2024-02-28T16:26:40.092 INFO:tasks.workunit.client.0.smithi148.stdout:9/511: readlink d7/d1c/d3d/l9d 0 2024-02-28T16:26:40.094 INFO:tasks.workunit.client.0.smithi148.stdout:5/458: dwrite d1/db/d60/d7a/d8b/f45 [0,4194304] 0 2024-02-28T16:26:40.096 INFO:tasks.workunit.client.0.smithi148.stdout:9/512: chown d7/d43/da8/fab 232955 1 2024-02-28T16:26:40.102 INFO:tasks.workunit.client.0.smithi148.stdout:8/489: dwrite d1/dd/d13/d24/d3a/d49/f4c [0,4194304] 0 2024-02-28T16:26:40.108 INFO:tasks.workunit.client.0.smithi148.stdout:8/490: mkdir d1/dd/d51/d9b 0 2024-02-28T16:26:40.110 INFO:tasks.workunit.client.0.smithi148.stdout:5/459: getdents d1/d44/d64 0 2024-02-28T16:26:40.111 INFO:tasks.workunit.client.0.smithi148.stdout:9/513: getdents d7/d1c/d1f/d49/d5c 0 2024-02-28T16:26:40.113 INFO:tasks.workunit.client.0.smithi148.stdout:9/514: chown d7/d1c/d59/d83/d88 2940 1 2024-02-28T16:26:40.114 INFO:tasks.workunit.client.0.smithi148.stdout:8/491: write d1/dd/d13/d1a/f3f [455869,15227] 0 2024-02-28T16:26:40.115 INFO:tasks.workunit.client.0.smithi148.stdout:8/492: stat d1/f27 0 2024-02-28T16:26:40.120 INFO:tasks.workunit.client.0.smithi148.stdout:9/515: rmdir d7/d1c/d1f/d49/d6a 39 2024-02-28T16:26:40.120 INFO:tasks.workunit.client.0.smithi148.stdout:5/460: read d1/d8/d20/d31/f4d [309751,126519] 0 2024-02-28T16:26:40.121 INFO:tasks.workunit.client.0.smithi148.stdout:8/493: mkdir d1/dd/d13/d1a/d33/d9c 0 2024-02-28T16:26:40.122 INFO:tasks.workunit.client.0.smithi148.stdout:5/461: write d1/d44/f59 [17111,46520] 0 2024-02-28T16:26:40.124 INFO:tasks.workunit.client.0.smithi148.stdout:9/516: dread d7/dd/d26/f5d [0,4194304] 0 2024-02-28T16:26:40.125 INFO:tasks.workunit.client.0.smithi148.stdout:5/462: read d1/db/d60/f86 [437194,10837] 0 2024-02-28T16:26:40.137 INFO:tasks.workunit.client.0.smithi148.stdout:8/494: dwrite d1/d3/d18/d5a/d60/f82 [0,4194304] 0 2024-02-28T16:26:40.140 INFO:tasks.workunit.client.0.smithi148.stdout:1/439: sync 2024-02-28T16:26:40.141 INFO:tasks.workunit.client.0.smithi148.stdout:8/495: symlink d1/d3/d18/d48/l9d 0 2024-02-28T16:26:40.147 INFO:tasks.workunit.client.0.smithi148.stdout:9/517: dwrite d7/dd/d26/f69 [4194304,4194304] 0 2024-02-28T16:26:40.147 INFO:tasks.workunit.client.0.smithi148.stdout:8/496: getdents d1/dd/d13/d1a/d25 0 2024-02-28T16:26:40.154 INFO:tasks.workunit.client.0.smithi148.stdout:9/518: truncate d7/f21 4001274 0 2024-02-28T16:26:40.155 INFO:tasks.workunit.client.0.smithi148.stdout:8/497: rename d1/f1c to d1/dd/d13/d23/f9e 0 2024-02-28T16:26:40.158 INFO:tasks.workunit.client.0.smithi148.stdout:1/440: link d2/d5/c39 d2/d15/d33/c82 0 2024-02-28T16:26:40.158 INFO:tasks.workunit.client.0.smithi148.stdout:9/519: chown d7/d1c/d32/d24/f2f 507476 1 2024-02-28T16:26:40.159 INFO:tasks.workunit.client.0.smithi148.stdout:8/498: creat d1/dd/d13/d24/d3a/d49/f9f x:0 0 0 2024-02-28T16:26:40.161 INFO:tasks.workunit.client.0.smithi148.stdout:9/520: creat d7/d1c/d1f/d49/d8d/fb7 x:0 0 0 2024-02-28T16:26:40.162 INFO:tasks.workunit.client.0.smithi148.stdout:5/463: dread d1/db/d25/f2e [0,4194304] 0 2024-02-28T16:26:40.180 INFO:tasks.workunit.client.0.smithi148.stdout:8/499: dwrite d1/dd/f93 [0,4194304] 0 2024-02-28T16:26:40.181 INFO:tasks.workunit.client.0.smithi148.stdout:9/521: dwrite d7/d1c/d74/f50 [0,4194304] 0 2024-02-28T16:26:40.183 INFO:tasks.workunit.client.0.smithi148.stdout:5/464: dwrite d1/db/f49 [0,4194304] 0 2024-02-28T16:26:40.190 INFO:tasks.workunit.client.0.smithi148.stdout:8/500: creat d1/dd/d13/d1a/d25/d50/fa0 x:0 0 0 2024-02-28T16:26:40.196 INFO:tasks.workunit.client.0.smithi148.stdout:5/465: mknod d1/db/d60/d7a/c8c 0 2024-02-28T16:26:40.199 INFO:tasks.workunit.client.0.smithi148.stdout:5/466: mknod d1/d8/d20/d4e/c8d 0 2024-02-28T16:26:40.200 INFO:tasks.workunit.client.0.smithi148.stdout:5/467: dread - d1/db/f82 zero size 2024-02-28T16:26:40.203 INFO:tasks.workunit.client.0.smithi148.stdout:9/522: dwrite d7/dd/d26/f69 [4194304,4194304] 0 2024-02-28T16:26:40.206 INFO:tasks.workunit.client.0.smithi148.stdout:9/523: fdatasync d7/d1c/d32/d24/d78/f8c 0 2024-02-28T16:26:40.220 INFO:tasks.workunit.client.0.smithi148.stdout:9/524: mkdir d7/d1c/d1f/d49/db8 0 2024-02-28T16:26:40.225 INFO:tasks.workunit.client.0.smithi148.stdout:9/525: getdents d7 0 2024-02-28T16:26:40.228 INFO:tasks.workunit.client.0.smithi148.stdout:9/526: read d7/d1c/d1f/d49/d6a/fa6 [111599,32886] 0 2024-02-28T16:26:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:39 smithi157 ceph-mon[38346]: pgmap v44: 65 pgs: 65 active+clean; 1.0 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 23 MiB/s rd, 139 MiB/s wr, 340 op/s 2024-02-28T16:26:40.237 INFO:tasks.workunit.client.0.smithi148.stdout:9/527: dread d7/d1c/d32/f1a [4194304,4194304] 0 2024-02-28T16:26:40.239 INFO:tasks.workunit.client.0.smithi148.stdout:9/528: fdatasync d7/d1c/d1f/d49/d6a/f9f 0 2024-02-28T16:26:40.250 INFO:tasks.workunit.client.0.smithi148.stdout:9/529: dwrite d7/d1c/d1f/f4a [4194304,4194304] 0 2024-02-28T16:26:40.254 INFO:tasks.workunit.client.0.smithi148.stdout:9/530: rmdir d7/d1c/d1f/d49/db8 0 2024-02-28T16:26:40.257 INFO:tasks.workunit.client.0.smithi148.stdout:9/531: creat d7/d1c/d32/d24/da2/db6/fb9 x:0 0 0 2024-02-28T16:26:40.297 INFO:tasks.workunit.client.0.smithi148.stdout:9/532: dread d7/d1c/f94 [0,4194304] 0 2024-02-28T16:26:40.298 INFO:tasks.workunit.client.0.smithi148.stdout:9/533: fsync d7/d1c/d1f/f4a 0 2024-02-28T16:26:40.299 INFO:tasks.workunit.client.0.smithi148.stdout:9/534: stat c5 0 2024-02-28T16:26:40.305 INFO:tasks.workunit.client.0.smithi148.stdout:9/535: rename d7/dd/c72 to d7/d1c/d32/d24/da2/cba 0 2024-02-28T16:26:40.307 INFO:tasks.workunit.client.0.smithi148.stdout:9/536: chown d7/d1c/d1f/d49/d6a/fb2 2369 1 2024-02-28T16:26:40.313 INFO:tasks.workunit.client.0.smithi148.stdout:9/537: link d7/d1c/d59/l6d d7/d1c/d32/d24/da2/db6/lbb 0 2024-02-28T16:26:40.320 INFO:tasks.workunit.client.0.smithi148.stdout:9/538: getdents d7/d1c/d1f/d49/d8d 0 2024-02-28T16:26:40.324 INFO:tasks.workunit.client.0.smithi148.stdout:9/539: mknod d7/d1c/d32/d24/da2/cbc 0 2024-02-28T16:26:40.365 INFO:tasks.workunit.client.0.smithi148.stdout:2/447: sync 2024-02-28T16:26:40.372 INFO:tasks.workunit.client.0.smithi148.stdout:2/448: write d0/d18/d20/f50 [3277726,82374] 0 2024-02-28T16:26:40.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:39 smithi148 ceph-mon[28767]: pgmap v44: 65 pgs: 65 active+clean; 1.0 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 23 MiB/s rd, 139 MiB/s wr, 340 op/s 2024-02-28T16:26:40.374 INFO:tasks.workunit.client.0.smithi148.stdout:9/540: truncate d7/d1c/f34 841517 0 2024-02-28T16:26:40.378 INFO:tasks.workunit.client.0.smithi148.stdout:2/449: unlink d0/dd/f5e 0 2024-02-28T16:26:40.380 INFO:tasks.workunit.client.0.smithi148.stdout:2/450: stat d0/dd/c6f 0 2024-02-28T16:26:40.381 INFO:tasks.workunit.client.0.smithi148.stdout:9/541: creat d7/d1c/d32/d24/da2/db6/fbd x:0 0 0 2024-02-28T16:26:40.383 INFO:tasks.workunit.client.0.smithi148.stdout:2/451: write d0/dd/d2b/f4f [536844,26407] 0 2024-02-28T16:26:40.389 INFO:tasks.workunit.client.0.smithi148.stdout:2/452: mknod d0/d1c/d49/c8c 0 2024-02-28T16:26:40.393 INFO:tasks.workunit.client.0.smithi148.stdout:9/542: creat d7/d1c/d32/d24/dac/fbe x:0 0 0 2024-02-28T16:26:40.420 INFO:tasks.workunit.client.0.smithi148.stdout:9/543: dwrite d7/d1c/d3d/f56 [0,4194304] 0 2024-02-28T16:26:40.423 INFO:tasks.workunit.client.0.smithi148.stdout:2/453: dread d0/d1c/f1f [0,4194304] 0 2024-02-28T16:26:40.430 INFO:tasks.workunit.client.0.smithi148.stdout:2/454: unlink d0/d9/d13/d38/l43 0 2024-02-28T16:26:40.433 INFO:tasks.workunit.client.0.smithi148.stdout:9/544: link d7/d1c/d59/d83/l98 d7/d1c/d32/d24/lbf 0 2024-02-28T16:26:40.436 INFO:tasks.workunit.client.0.smithi148.stdout:9/545: chown d7/d1c/d1f/d49/c51 10356 1 2024-02-28T16:26:40.442 INFO:tasks.workunit.client.0.smithi148.stdout:9/546: getdents d7/d1c/d1f/d49 0 2024-02-28T16:26:40.445 INFO:tasks.workunit.client.0.smithi148.stdout:9/547: creat d7/d43/fc0 x:0 0 0 2024-02-28T16:26:40.446 INFO:tasks.workunit.client.0.smithi148.stdout:2/455: dwrite d0/d59/f7f [0,4194304] 0 2024-02-28T16:26:40.452 INFO:tasks.workunit.client.0.smithi148.stdout:2/456: chown d0/d9/d13/f16 2386 1 2024-02-28T16:26:40.458 INFO:tasks.workunit.client.0.smithi148.stdout:2/457: link d0/dd/d2b/d36/l6d d0/d18/l8d 0 2024-02-28T16:26:40.459 INFO:tasks.workunit.client.0.smithi148.stdout:9/548: dread d7/d1c/d59/f62 [0,4194304] 0 2024-02-28T16:26:40.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/458: write d0/d1c/f4e [1573308,14] 0 2024-02-28T16:26:40.462 INFO:tasks.workunit.client.0.smithi148.stdout:2/459: truncate d0/d1d/f77 489476 0 2024-02-28T16:26:40.465 INFO:tasks.workunit.client.0.smithi148.stdout:2/460: creat d0/d18/f8e x:0 0 0 2024-02-28T16:26:40.467 INFO:tasks.workunit.client.0.smithi148.stdout:2/461: mkdir d0/d1c/d85/d8b/d8f 0 2024-02-28T16:26:40.471 INFO:tasks.workunit.client.0.smithi148.stdout:2/462: mknod d0/d1d/d52/d84/c90 0 2024-02-28T16:26:40.475 INFO:tasks.workunit.client.0.smithi148.stdout:9/549: dwrite d7/dd/d26/f5d [0,4194304] 0 2024-02-28T16:26:40.477 INFO:tasks.workunit.client.0.smithi148.stdout:9/550: write d7/d1c/d59/d83/d88/f8a [415497,51266] 0 2024-02-28T16:26:40.484 INFO:tasks.workunit.client.0.smithi148.stdout:9/551: getdents d7/dd 0 2024-02-28T16:26:40.486 INFO:tasks.workunit.client.0.smithi148.stdout:9/552: read d7/d1c/f99 [987677,98149] 0 2024-02-28T16:26:40.491 INFO:tasks.workunit.client.0.smithi148.stdout:9/553: rename d7/d1c/d32/d24/da2/db6 to d7/d1c/d32/d24/dc1 0 2024-02-28T16:26:40.494 INFO:tasks.workunit.client.0.smithi148.stdout:9/554: symlink d7/d1c/d32/d24/dc1/lc2 0 2024-02-28T16:26:40.496 INFO:tasks.workunit.client.0.smithi148.stdout:9/555: read - d7/d1c/d32/d24/dc1/fb9 zero size 2024-02-28T16:26:40.497 INFO:tasks.workunit.client.0.smithi148.stdout:9/556: chown d7/d1c/d32/d24/dc1 1587693 1 2024-02-28T16:26:40.498 INFO:tasks.workunit.client.0.smithi148.stdout:9/557: stat d7/d1c/d74/f50 0 2024-02-28T16:26:40.507 INFO:tasks.workunit.client.0.smithi148.stdout:9/558: dread d7/f17 [4194304,4194304] 0 2024-02-28T16:26:40.514 INFO:tasks.workunit.client.0.smithi148.stdout:2/463: dread d0/f27 [0,4194304] 0 2024-02-28T16:26:40.518 INFO:tasks.workunit.client.0.smithi148.stdout:2/464: symlink d0/d1d/d52/l91 0 2024-02-28T16:26:40.524 INFO:tasks.workunit.client.0.smithi148.stdout:9/559: dwrite d7/d43/fc0 [0,4194304] 0 2024-02-28T16:26:40.527 INFO:tasks.workunit.client.0.smithi148.stdout:9/560: creat d7/d1c/d59/d83/fc3 x:0 0 0 2024-02-28T16:26:40.535 INFO:tasks.workunit.client.0.smithi148.stdout:9/561: link d7/dd/d26/c63 d7/d1c/d59/cc4 0 2024-02-28T16:26:40.538 INFO:tasks.workunit.client.0.smithi148.stdout:9/562: write d7/d1c/d59/d83/fc3 [891301,105390] 0 2024-02-28T16:26:40.541 INFO:tasks.workunit.client.0.smithi148.stdout:6/441: sync 2024-02-28T16:26:40.545 INFO:tasks.workunit.client.0.smithi148.stdout:2/465: dwrite d0/d1d/d52/d54/f7b [0,4194304] 0 2024-02-28T16:26:40.546 INFO:tasks.workunit.client.0.smithi148.stdout:6/442: mknod d0/d4/d14/d8a/c8d 0 2024-02-28T16:26:40.548 INFO:tasks.workunit.client.0.smithi148.stdout:2/466: write d0/d1c/f1f [673948,121488] 0 2024-02-28T16:26:40.549 INFO:tasks.workunit.client.0.smithi148.stdout:6/443: write d0/d4/f11 [5012076,48754] 0 2024-02-28T16:26:40.551 INFO:tasks.workunit.client.0.smithi148.stdout:6/444: fsync d0/d22/d27/d3e/f7b 0 2024-02-28T16:26:40.555 INFO:tasks.workunit.client.0.smithi148.stdout:9/563: truncate d7/d1c/d1f/d49/d6a/fb0 1964341 0 2024-02-28T16:26:40.563 INFO:tasks.workunit.client.0.smithi148.stdout:9/564: creat d7/d1c/d1f/d49/d8d/fc5 x:0 0 0 2024-02-28T16:26:40.563 INFO:tasks.workunit.client.0.smithi148.stdout:2/467: dread d0/d18/f28 [4194304,4194304] 0 2024-02-28T16:26:40.563 INFO:tasks.workunit.client.0.smithi148.stdout:9/565: stat d7/d1c/d59/d83/d88 0 2024-02-28T16:26:40.567 INFO:tasks.workunit.client.0.smithi148.stdout:2/468: creat d0/d18/d20/f92 x:0 0 0 2024-02-28T16:26:40.567 INFO:tasks.workunit.client.0.smithi148.stdout:6/445: dwrite d0/d22/f38 [8388608,4194304] 0 2024-02-28T16:26:40.572 INFO:tasks.workunit.client.0.smithi148.stdout:2/469: unlink d0/dd/lf 0 2024-02-28T16:26:40.574 INFO:tasks.workunit.client.0.smithi148.stdout:6/446: mknod d0/d22/d27/c8e 0 2024-02-28T16:26:40.575 INFO:tasks.workunit.client.0.smithi148.stdout:2/470: fsync d0/d18/f19 0 2024-02-28T16:26:40.578 INFO:tasks.workunit.client.0.smithi148.stdout:2/471: dread - d0/d18/f8e zero size 2024-02-28T16:26:40.580 INFO:tasks.workunit.client.0.smithi148.stdout:6/447: creat d0/d8/d21/f8f x:0 0 0 2024-02-28T16:26:40.581 INFO:tasks.workunit.client.0.smithi148.stdout:9/566: dwrite d7/d1c/d74/f70 [0,4194304] 0 2024-02-28T16:26:40.586 INFO:tasks.workunit.client.0.smithi148.stdout:9/567: chown d7/dd/lf 0 1 2024-02-28T16:26:40.587 INFO:tasks.workunit.client.0.smithi148.stdout:2/472: symlink d0/dd/d2b/d36/l93 0 2024-02-28T16:26:40.587 INFO:tasks.workunit.client.0.smithi148.stdout:9/568: write d7/d1c/f94 [1171030,19971] 0 2024-02-28T16:26:40.588 INFO:tasks.workunit.client.0.smithi148.stdout:2/473: stat d0/d9/d13/d38/l41 0 2024-02-28T16:26:40.592 INFO:tasks.workunit.client.0.smithi148.stdout:2/474: mknod d0/dd/d2b/d36/c94 0 2024-02-28T16:26:40.595 INFO:tasks.workunit.client.0.smithi148.stdout:9/569: mkdir d7/d1c/d1f/d49/dae/dc6 0 2024-02-28T16:26:40.602 INFO:tasks.workunit.client.0.smithi148.stdout:6/448: dwrite d0/d22/d27/d3e/f7b [0,4194304] 0 2024-02-28T16:26:40.604 INFO:tasks.workunit.client.0.smithi148.stdout:9/570: truncate d7/d1c/d1f/d49/d6a/fa6 467566 0 2024-02-28T16:26:40.608 INFO:tasks.workunit.client.0.smithi148.stdout:9/571: mknod d7/d1c/d74/cc7 0 2024-02-28T16:26:40.612 INFO:tasks.workunit.client.0.smithi148.stdout:9/572: unlink d7/d1c/d32/d24/f38 0 2024-02-28T16:26:40.617 INFO:tasks.workunit.client.0.smithi148.stdout:9/573: getdents d7/dd 0 2024-02-28T16:26:40.624 INFO:tasks.workunit.client.0.smithi148.stdout:9/574: dread d7/dd/d26/f4d [0,4194304] 0 2024-02-28T16:26:40.626 INFO:tasks.workunit.client.0.smithi148.stdout:9/575: symlink d7/d1c/d59/d83/lc8 0 2024-02-28T16:26:40.639 INFO:tasks.workunit.client.0.smithi148.stdout:9/576: dwrite d7/d1c/d1f/d49/d6a/fb2 [0,4194304] 0 2024-02-28T16:26:40.645 INFO:tasks.workunit.client.0.smithi148.stdout:9/577: unlink d7/d1c/f94 0 2024-02-28T16:26:40.652 INFO:tasks.workunit.client.0.smithi148.stdout:9/578: truncate d7/d1c/d1f/d49/f4c 4066610 0 2024-02-28T16:26:40.653 INFO:tasks.workunit.client.0.smithi148.stdout:9/579: chown d7/d1c/d3d/f61 51519482 1 2024-02-28T16:26:40.655 INFO:tasks.workunit.client.0.smithi148.stdout:9/580: unlink d7/l6e 0 2024-02-28T16:26:40.658 INFO:tasks.workunit.client.0.smithi148.stdout:9/581: mkdir d7/d1c/d1f/d49/dae/dc9 0 2024-02-28T16:26:40.662 INFO:tasks.workunit.client.0.smithi148.stdout:9/582: creat d7/d1c/d1f/fca x:0 0 0 2024-02-28T16:26:40.663 INFO:tasks.workunit.client.0.smithi148.stdout:9/583: read d7/d43/f60 [854989,4598] 0 2024-02-28T16:26:40.667 INFO:tasks.workunit.client.0.smithi148.stdout:9/584: link d7/d1c/d32/d24/d78/l7d d7/d1c/d32/d24/da2/lcb 0 2024-02-28T16:26:40.668 INFO:tasks.workunit.client.0.smithi148.stdout:9/585: read - d7/d1c/d32/d24/dc1/fbd zero size 2024-02-28T16:26:40.670 INFO:tasks.workunit.client.0.smithi148.stdout:9/586: write d7/f3c [561103,129631] 0 2024-02-28T16:26:40.673 INFO:tasks.workunit.client.0.smithi148.stdout:9/587: mknod d7/d1c/d74/d68/ccc 0 2024-02-28T16:26:40.675 INFO:tasks.workunit.client.0.smithi148.stdout:9/588: mknod d7/d1c/d1f/ccd 0 2024-02-28T16:26:40.689 INFO:tasks.workunit.client.0.smithi148.stdout:9/589: dwrite d7/d1c/d59/d83/fc3 [0,4194304] 0 2024-02-28T16:26:40.690 INFO:tasks.workunit.client.0.smithi148.stdout:9/590: chown d7/d1c/d32 5 1 2024-02-28T16:26:40.694 INFO:tasks.workunit.client.0.smithi148.stdout:9/591: mknod d7/d1c/d1f/d49/dae/dc9/cce 0 2024-02-28T16:26:40.702 INFO:tasks.workunit.client.0.smithi148.stdout:9/592: truncate d7/d1c/d32/d24/f2f 97577 0 2024-02-28T16:26:40.709 INFO:tasks.workunit.client.0.smithi148.stdout:9/593: mkdir d7/d1c/d1f/d49/da7/dcf 0 2024-02-28T16:26:40.711 INFO:tasks.workunit.client.0.smithi148.stdout:9/594: creat d7/d43/fd0 x:0 0 0 2024-02-28T16:26:40.712 INFO:tasks.workunit.client.0.smithi148.stdout:9/595: stat d7/d43 0 2024-02-28T16:26:40.714 INFO:tasks.workunit.client.0.smithi148.stdout:3/603: sync 2024-02-28T16:26:40.714 INFO:tasks.workunit.client.0.smithi148.stdout:4/430: sync 2024-02-28T16:26:40.721 INFO:tasks.workunit.client.0.smithi148.stdout:4/431: truncate d8/df/d5f/f8f 480953 0 2024-02-28T16:26:40.721 INFO:tasks.workunit.client.0.smithi148.stdout:4/432: read d8/df/d1f/f3c [127169,45763] 0 2024-02-28T16:26:40.728 INFO:tasks.workunit.client.0.smithi148.stdout:3/604: unlink d1/c5a 0 2024-02-28T16:26:40.736 INFO:tasks.workunit.client.0.smithi148.stdout:3/605: creat d1/db/d35/d70/faf x:0 0 0 2024-02-28T16:26:40.740 INFO:tasks.workunit.client.0.smithi148.stdout:9/596: getdents d7/d1c/d3d 0 2024-02-28T16:26:40.744 INFO:tasks.workunit.client.0.smithi148.stdout:3/606: dread d1/db/d35/f6b [0,4194304] 0 2024-02-28T16:26:40.750 INFO:tasks.workunit.client.0.smithi148.stdout:4/433: dread d8/df/d1f/f42 [0,4194304] 0 2024-02-28T16:26:40.752 INFO:tasks.workunit.client.0.smithi148.stdout:4/434: write d8/d21/d3d/d4d/d66/f82 [588511,5142] 0 2024-02-28T16:26:40.753 INFO:tasks.workunit.client.0.smithi148.stdout:3/607: unlink d1/d13/d19/f79 0 2024-02-28T16:26:40.776 INFO:tasks.workunit.client.0.smithi148.stdout:9/597: write d7/f21 [2333617,31072] 0 2024-02-28T16:26:40.790 INFO:tasks.workunit.client.0.smithi148.stdout:9/598: truncate d7/d1c/f34 1497461 0 2024-02-28T16:26:40.790 INFO:tasks.workunit.client.0.smithi148.stdout:4/435: write d8/df/d7c/f92 [536300,31354] 0 2024-02-28T16:26:40.793 INFO:tasks.workunit.client.0.smithi148.stdout:9/599: fsync d7/d1c/d59/d83/d88/f8a 0 2024-02-28T16:26:40.795 INFO:tasks.workunit.client.0.smithi148.stdout:9/600: fsync d7/d1c/d1f/d49/f89 0 2024-02-28T16:26:40.796 INFO:tasks.workunit.client.0.smithi148.stdout:3/608: dread d1/d13/d19/d32/d41/f60 [0,4194304] 0 2024-02-28T16:26:40.801 INFO:tasks.workunit.client.0.smithi148.stdout:3/609: rename d1/db/d35/d70/d8e/f9f to d1/d13/d19/d32/fb0 0 2024-02-28T16:26:40.805 INFO:tasks.workunit.client.0.smithi148.stdout:3/610: creat d1/d13/d19/d32/d41/fb1 x:0 0 0 2024-02-28T16:26:40.809 INFO:tasks.workunit.client.0.smithi148.stdout:4/436: dwrite d8/f69 [0,4194304] 0 2024-02-28T16:26:40.812 INFO:tasks.workunit.client.0.smithi148.stdout:9/601: dwrite d7/d1c/f99 [4194304,4194304] 0 2024-02-28T16:26:40.815 INFO:tasks.workunit.client.0.smithi148.stdout:0/621: sync 2024-02-28T16:26:40.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/441: sync 2024-02-28T16:26:40.816 INFO:tasks.workunit.client.0.smithi148.stdout:7/506: sync 2024-02-28T16:26:40.816 INFO:tasks.workunit.client.0.smithi148.stdout:5/468: sync 2024-02-28T16:26:40.816 INFO:tasks.workunit.client.0.smithi148.stdout:9/602: symlink d7/dd/d26/ld1 0 2024-02-28T16:26:40.816 INFO:tasks.workunit.client.0.smithi148.stdout:8/501: sync 2024-02-28T16:26:40.817 INFO:tasks.workunit.client.0.smithi148.stdout:4/437: link d8/f26 d8/df/f97 0 2024-02-28T16:26:40.821 INFO:tasks.workunit.client.0.smithi148.stdout:7/507: stat d0/d9/d25/c78 0 2024-02-28T16:26:40.822 INFO:tasks.workunit.client.0.smithi148.stdout:8/502: creat d1/d3/d18/d48/d22/fa1 x:0 0 0 2024-02-28T16:26:40.822 INFO:tasks.workunit.client.0.smithi148.stdout:4/438: dread - d8/d21/d3d/f64 zero size 2024-02-28T16:26:40.822 INFO:tasks.workunit.client.0.smithi148.stdout:1/442: mkdir d2/d15/d83 0 2024-02-28T16:26:40.823 INFO:tasks.workunit.client.0.smithi148.stdout:9/603: chown d7/d1c/d32/d24/d78/f8c 0 1 2024-02-28T16:26:40.824 INFO:tasks.workunit.client.0.smithi148.stdout:5/469: dread d1/d8/d20/d31/f40 [0,4194304] 0 2024-02-28T16:26:40.824 INFO:tasks.workunit.client.0.smithi148.stdout:3/611: dread d1/db/d35/d52/f54 [0,4194304] 0 2024-02-28T16:26:40.825 INFO:tasks.workunit.client.0.smithi148.stdout:7/508: write d0/d9/d25/d47/d28/f98 [849304,2148] 0 2024-02-28T16:26:40.826 INFO:tasks.workunit.client.0.smithi148.stdout:0/622: symlink d1/d15/d27/d34/d5a/dcd/ld0 0 2024-02-28T16:26:40.828 INFO:tasks.workunit.client.0.smithi148.stdout:8/503: unlink d1/f2e 0 2024-02-28T16:26:40.830 INFO:tasks.workunit.client.0.smithi148.stdout:4/439: mkdir d8/d37/d98 0 2024-02-28T16:26:40.832 INFO:tasks.workunit.client.0.smithi148.stdout:9/604: mkdir d7/dd/dd2 0 2024-02-28T16:26:40.833 INFO:tasks.workunit.client.0.smithi148.stdout:5/470: chown d1/db/c4b 5486 1 2024-02-28T16:26:40.834 INFO:tasks.workunit.client.0.smithi148.stdout:8/504: truncate d1/dd/d13/d1a/d25/d50/f89 9153 0 2024-02-28T16:26:40.835 INFO:tasks.workunit.client.0.smithi148.stdout:1/443: unlink d2/d5/d40/d8/c4b 0 2024-02-28T16:26:40.837 INFO:tasks.workunit.client.0.smithi148.stdout:3/612: mknod d1/d13/d19/d94/cb2 0 2024-02-28T16:26:40.837 INFO:tasks.workunit.client.0.smithi148.stdout:8/505: chown d1/dd/d13/d1a/d25/d50/fa0 38 1 2024-02-28T16:26:40.841 INFO:tasks.workunit.client.0.smithi148.stdout:3/613: write d1/db/d35/d70/faf [171898,10906] 0 2024-02-28T16:26:40.841 INFO:tasks.workunit.client.0.smithi148.stdout:0/623: symlink d1/d15/d27/d34/d5a/d6c/ld1 0 2024-02-28T16:26:40.842 INFO:tasks.workunit.client.0.smithi148.stdout:8/506: write d1/dd/d13/d68/f95 [294777,21664] 0 2024-02-28T16:26:40.847 INFO:tasks.workunit.client.0.smithi148.stdout:9/605: write d7/d1c/d59/d83/fb1 [540472,26713] 0 2024-02-28T16:26:40.852 INFO:tasks.workunit.client.0.smithi148.stdout:9/606: stat d7/d1c/c3a 0 2024-02-28T16:26:40.853 INFO:tasks.workunit.client.0.smithi148.stdout:7/509: dwrite d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:40.854 INFO:tasks.workunit.client.0.smithi148.stdout:5/471: truncate d1/f6f 1234437 0 2024-02-28T16:26:40.857 INFO:tasks.workunit.client.0.smithi148.stdout:3/614: symlink d1/lb3 0 2024-02-28T16:26:40.857 INFO:tasks.workunit.client.0.smithi148.stdout:5/472: stat d1/d44/d65/f76 0 2024-02-28T16:26:40.861 INFO:tasks.workunit.client.0.smithi148.stdout:7/510: dread d0/d18/f91 [0,4194304] 0 2024-02-28T16:26:40.863 INFO:tasks.workunit.client.0.smithi148.stdout:8/507: dread d1/dd/d13/d1a/d87/f6b [0,4194304] 0 2024-02-28T16:26:40.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/449: sync 2024-02-28T16:26:40.870 INFO:tasks.workunit.client.0.smithi148.stdout:2/475: sync 2024-02-28T16:26:40.873 INFO:tasks.workunit.client.0.smithi148.stdout:2/476: write d0/d1c/f4e [2333214,100116] 0 2024-02-28T16:26:40.874 INFO:tasks.workunit.client.0.smithi148.stdout:0/624: link d1/d8a/fc1 d1/d15/d27/d34/fd2 0 2024-02-28T16:26:40.880 INFO:tasks.workunit.client.0.smithi148.stdout:5/473: dwrite d1/d8/d23/f2d [0,4194304] 0 2024-02-28T16:26:40.896 INFO:tasks.workunit.client.0.smithi148.stdout:8/508: mknod d1/dd/d13/ca2 0 2024-02-28T16:26:40.901 INFO:tasks.workunit.client.0.smithi148.stdout:0/625: creat d1/d15/d27/d7a/dc6/dc4/fd3 x:0 0 0 2024-02-28T16:26:40.902 INFO:tasks.workunit.client.0.smithi148.stdout:5/474: dwrite d1/db/f49 [0,4194304] 0 2024-02-28T16:26:40.903 INFO:tasks.workunit.client.0.smithi148.stdout:7/511: dread d0/d9/d25/d47/d1c/d32/f3d [0,4194304] 0 2024-02-28T16:26:40.907 INFO:tasks.workunit.client.0.smithi148.stdout:8/509: mkdir d1/dd/d13/d1a/d25/da3 0 2024-02-28T16:26:40.908 INFO:tasks.workunit.client.0.smithi148.stdout:6/450: dread d0/d22/f37 [0,4194304] 0 2024-02-28T16:26:40.908 INFO:tasks.workunit.client.0.smithi148.stdout:7/512: fdatasync d0/d9/d25/d47/d28/d2b/d3a/d49/f6d 0 2024-02-28T16:26:40.909 INFO:tasks.workunit.client.0.smithi148.stdout:0/626: creat d1/d15/d27/d34/d5a/d71/d74/fd4 x:0 0 0 2024-02-28T16:26:40.912 INFO:tasks.workunit.client.0.smithi148.stdout:5/475: mkdir d1/d8e 0 2024-02-28T16:26:40.913 INFO:tasks.workunit.client.0.smithi148.stdout:5/476: dread - d1/f55 zero size 2024-02-28T16:26:40.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/477: fdatasync d1/f2f 0 2024-02-28T16:26:40.916 INFO:tasks.workunit.client.0.smithi148.stdout:7/513: readlink d0/d9/d25/d47/d1c/d32/l40 0 2024-02-28T16:26:40.919 INFO:tasks.workunit.client.0.smithi148.stdout:5/478: write d1/db/f82 [1020353,2623] 0 2024-02-28T16:26:40.923 INFO:tasks.workunit.client.0.smithi148.stdout:6/451: creat d0/d22/d27/d66/d87/f90 x:0 0 0 2024-02-28T16:26:40.928 INFO:tasks.workunit.client.0.smithi148.stdout:0/627: dwrite d1/d15/d27/d34/d5a/d9d/d4a/d92/f9f [0,4194304] 0 2024-02-28T16:26:40.933 INFO:tasks.workunit.client.0.smithi148.stdout:5/479: symlink d1/db/d25/l8f 0 2024-02-28T16:26:40.938 INFO:tasks.workunit.client.0.smithi148.stdout:0/628: symlink d1/d15/d27/d34/d5a/d9d/d5f/ld5 0 2024-02-28T16:26:40.940 INFO:tasks.workunit.client.0.smithi148.stdout:6/452: link d0/d4/f3c d0/d22/d27/d66/d87/f91 0 2024-02-28T16:26:40.940 INFO:tasks.workunit.client.0.smithi148.stdout:1/444: dwrite d2/d5/d40/f27 [0,4194304] 0 2024-02-28T16:26:40.946 INFO:tasks.workunit.client.0.smithi148.stdout:4/440: dwrite d8/f33 [0,4194304] 0 2024-02-28T16:26:40.947 INFO:tasks.workunit.client.0.smithi148.stdout:7/514: truncate d0/d9/d25/d47/f27 877300 0 2024-02-28T16:26:40.948 INFO:tasks.workunit.client.0.smithi148.stdout:3/615: truncate d1/d13/d19/d1b/d38/f82 2635398 0 2024-02-28T16:26:40.953 INFO:tasks.workunit.client.0.smithi148.stdout:9/607: dwrite d7/d1c/d32/d24/f42 [4194304,4194304] 0 2024-02-28T16:26:40.957 INFO:tasks.workunit.client.0.smithi148.stdout:1/445: mknod d2/d15/d62/c84 0 2024-02-28T16:26:40.957 INFO:tasks.workunit.client.0.smithi148.stdout:9/608: write d7/d1c/d74/f70 [3289036,36374] 0 2024-02-28T16:26:40.962 INFO:tasks.workunit.client.0.smithi148.stdout:0/629: creat d1/d15/d27/d34/d5a/d9d/d5f/fd6 x:0 0 0 2024-02-28T16:26:40.964 INFO:tasks.workunit.client.0.smithi148.stdout:5/480: creat d1/d8/d20/d31/d50/d89/f90 x:0 0 0 2024-02-28T16:26:40.964 INFO:tasks.workunit.client.0.smithi148.stdout:6/453: symlink d0/d22/l92 0 2024-02-28T16:26:40.975 INFO:tasks.workunit.client.0.smithi148.stdout:4/441: dwrite d8/d21/d3d/d4d/f5c [0,4194304] 0 2024-02-28T16:26:40.982 INFO:tasks.workunit.client.0.smithi148.stdout:8/510: truncate d1/dd/f93 2802451 0 2024-02-28T16:26:40.985 INFO:tasks.workunit.client.0.smithi148.stdout:9/609: fdatasync d7/d1c/d32/d24/f2f 0 2024-02-28T16:26:40.989 INFO:tasks.workunit.client.0.smithi148.stdout:5/481: dwrite d1/d44/d65/f76 [0,4194304] 0 2024-02-28T16:26:40.989 INFO:tasks.workunit.client.0.smithi148.stdout:1/446: dread d2/d5/d40/f53 [0,4194304] 0 2024-02-28T16:26:40.989 INFO:tasks.workunit.client.0.smithi148.stdout:8/511: readlink d1/d3/d18/d48/l28 0 2024-02-28T16:26:40.992 INFO:tasks.workunit.client.0.smithi148.stdout:6/454: creat d0/d22/d49/d88/f93 x:0 0 0 2024-02-28T16:26:40.996 INFO:tasks.workunit.client.0.smithi148.stdout:7/515: rename d0/d9/d25/d47/d1c/f31 to d0/d9/d25/d47/d28/d2b/f9e 0 2024-02-28T16:26:41.002 INFO:tasks.workunit.client.0.smithi148.stdout:0/630: creat d1/fd7 x:0 0 0 2024-02-28T16:26:41.004 INFO:tasks.workunit.client.0.smithi148.stdout:0/631: chown d1/d15/d8/c2c 56631 1 2024-02-28T16:26:41.007 INFO:tasks.workunit.client.0.smithi148.stdout:1/447: chown d2/d15/d33/c82 21629442 1 2024-02-28T16:26:41.010 INFO:tasks.workunit.client.0.smithi148.stdout:5/482: dread d1/d8/d23/f52 [0,4194304] 0 2024-02-28T16:26:41.012 INFO:tasks.workunit.client.0.smithi148.stdout:0/632: read d1/d4/f60 [706751,22580] 0 2024-02-28T16:26:41.013 INFO:tasks.workunit.client.0.smithi148.stdout:5/483: write d1/db/f49 [61952,48999] 0 2024-02-28T16:26:41.014 INFO:tasks.workunit.client.0.smithi148.stdout:5/484: readlink d1/d44/d64/l53 0 2024-02-28T16:26:41.016 INFO:tasks.workunit.client.0.smithi148.stdout:5/485: chown d1/c24 30739488 1 2024-02-28T16:26:41.018 INFO:tasks.workunit.client.0.smithi148.stdout:5/486: write d1/db/d25/f7e [1424815,57574] 0 2024-02-28T16:26:41.019 INFO:tasks.workunit.client.0.smithi148.stdout:9/610: rename d7/dd/c5a to d7/cd3 0 2024-02-28T16:26:41.024 INFO:tasks.workunit.client.0.smithi148.stdout:5/487: read d1/f2f [1767828,54082] 0 2024-02-28T16:26:41.026 INFO:tasks.workunit.client.0.smithi148.stdout:3/616: dread d1/d13/f6f [0,4194304] 0 2024-02-28T16:26:41.027 INFO:tasks.workunit.client.0.smithi148.stdout:4/442: link d8/df/l31 d8/d71/l99 0 2024-02-28T16:26:41.031 INFO:tasks.workunit.client.0.smithi148.stdout:6/455: dwrite d0/d10/f13 [4194304,4194304] 0 2024-02-28T16:26:41.044 INFO:tasks.workunit.client.0.smithi148.stdout:8/512: rename d1/dd/d13/d24/d3a/d49/d74 to d1/d3/d18/d48/d70/d75/d84/da4 0 2024-02-28T16:26:41.045 INFO:tasks.workunit.client.0.smithi148.stdout:9/611: creat d7/d1c/d1f/d49/d5c/fd4 x:0 0 0 2024-02-28T16:26:41.046 INFO:tasks.workunit.client.0.smithi148.stdout:3/617: readlink d1/db/d35/l67 0 2024-02-28T16:26:41.101 INFO:tasks.workunit.client.0.smithi148.stdout:5/488: rename d1/d8/d20/d31/d50/d89/f90 to d1/d8/d20/d4e/d71/f91 0 2024-02-28T16:26:41.102 INFO:tasks.workunit.client.0.smithi148.stdout:1/448: rmdir d2/d15/d33/d79 0 2024-02-28T16:26:41.102 INFO:tasks.workunit.client.0.smithi148.stdout:6/456: link d0/d22/d27/f62 d0/d4/d14/d59/f94 0 2024-02-28T16:26:41.102 INFO:tasks.workunit.client.0.smithi148.stdout:9/612: unlink d7/d1c/d74/d6b/caa 0 2024-02-28T16:26:41.105 INFO:tasks.workunit.client.0.smithi148.stdout:0/633: dread d1/d15/d27/d34/f7c [0,4194304] 0 2024-02-28T16:26:41.107 INFO:tasks.workunit.client.0.smithi148.stdout:7/516: dread d0/d9/d25/d47/f29 [0,4194304] 0 2024-02-28T16:26:41.109 INFO:tasks.workunit.client.0.smithi148.stdout:8/513: dread d1/dd/d13/d1a/f42 [0,4194304] 0 2024-02-28T16:26:41.110 INFO:tasks.workunit.client.0.smithi148.stdout:3/618: dread d1/db/d35/f62 [0,4194304] 0 2024-02-28T16:26:41.112 INFO:tasks.workunit.client.0.smithi148.stdout:1/449: creat d2/d5/d40/d7/f85 x:0 0 0 2024-02-28T16:26:41.114 INFO:tasks.workunit.client.0.smithi148.stdout:0/634: symlink d1/d15/d27/d34/d5a/d9d/ld8 0 2024-02-28T16:26:41.116 INFO:tasks.workunit.client.0.smithi148.stdout:7/517: rmdir d0/d4 39 2024-02-28T16:26:41.119 INFO:tasks.workunit.client.0.smithi148.stdout:6/457: unlink d0/ce 0 2024-02-28T16:26:41.124 INFO:tasks.workunit.client.0.smithi148.stdout:7/518: creat d0/d9/d46/d65/f9f x:0 0 0 2024-02-28T16:26:41.128 INFO:tasks.workunit.client.0.smithi148.stdout:0/635: mknod d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/cd9 0 2024-02-28T16:26:41.129 INFO:tasks.workunit.client.0.smithi148.stdout:1/450: dwrite d2/d5/d40/f7d [0,4194304] 0 2024-02-28T16:26:41.129 INFO:tasks.workunit.client.0.smithi148.stdout:8/514: dread d1/f62 [0,4194304] 0 2024-02-28T16:26:41.131 INFO:tasks.workunit.client.0.smithi148.stdout:7/519: rmdir d0/d9/d1b 39 2024-02-28T16:26:41.131 INFO:tasks.workunit.client.0.smithi148.stdout:8/515: dread - d1/d3/d18/d48/d70/f8c zero size 2024-02-28T16:26:41.134 INFO:tasks.workunit.client.0.smithi148.stdout:5/489: getdents d1/d8/d20/d4e/d84 0 2024-02-28T16:26:41.136 INFO:tasks.workunit.client.0.smithi148.stdout:7/520: chown d0/d9/d25/d47/d28/d2b/d3a/d49/f51 4 1 2024-02-28T16:26:41.140 INFO:tasks.workunit.client.0.smithi148.stdout:6/458: symlink d0/d4/d1b/l95 0 2024-02-28T16:26:41.140 INFO:tasks.workunit.client.0.smithi148.stdout:9/613: rmdir d7 39 2024-02-28T16:26:41.142 INFO:tasks.workunit.client.0.smithi148.stdout:6/459: stat d0/d22/d27/l7d 0 2024-02-28T16:26:41.143 INFO:tasks.workunit.client.0.smithi148.stdout:7/521: dread d0/d18/f79 [0,4194304] 0 2024-02-28T16:26:41.143 INFO:tasks.workunit.client.0.smithi148.stdout:6/460: fsync d0/f4c 0 2024-02-28T16:26:41.145 INFO:tasks.workunit.client.0.smithi148.stdout:6/461: write d0/d8/f67 [923064,18414] 0 2024-02-28T16:26:41.147 INFO:tasks.workunit.client.0.smithi148.stdout:8/516: creat d1/dd/d13/d24/fa5 x:0 0 0 2024-02-28T16:26:41.151 INFO:tasks.workunit.client.0.smithi148.stdout:9/614: rename d7/d1c/d74/d68/ccc to d7/d1c/d74/d6b/cd5 0 2024-02-28T16:26:41.154 INFO:tasks.workunit.client.0.smithi148.stdout:7/522: rename d0/d9/d25/d47/d28/f98 to d0/d9/d25/d47/d1c/d32/fa0 0 2024-02-28T16:26:41.155 INFO:tasks.workunit.client.0.smithi148.stdout:6/462: mknod d0/d4/c96 0 2024-02-28T16:26:41.156 INFO:tasks.workunit.client.0.smithi148.stdout:7/523: read d0/d18/f79 [59629,67754] 0 2024-02-28T16:26:41.160 INFO:tasks.workunit.client.0.smithi148.stdout:8/517: rename d1/d3/d18/f96 to d1/dd/d13/d1a/d25/fa6 0 2024-02-28T16:26:41.166 INFO:tasks.workunit.client.0.smithi148.stdout:9/615: dwrite d7/d1c/d74/d68/d81/fb4 [0,4194304] 0 2024-02-28T16:26:41.168 INFO:tasks.workunit.client.0.smithi148.stdout:7/524: mknod d0/d9/d25/d47/d28/d74/ca1 0 2024-02-28T16:26:41.168 INFO:tasks.workunit.client.0.smithi148.stdout:9/616: fdatasync d7/d1c/d3d/f56 0 2024-02-28T16:26:41.172 INFO:tasks.workunit.client.0.smithi148.stdout:8/518: mkdir d1/da7 0 2024-02-28T16:26:41.172 INFO:tasks.workunit.client.0.smithi148.stdout:8/519: chown d1/d3/d18/d48/d70 32332695 1 2024-02-28T16:26:41.172 INFO:tasks.workunit.client.0.smithi148.stdout:6/463: getdents d0/d4/d1b/d71 0 2024-02-28T16:26:41.175 INFO:tasks.workunit.client.0.smithi148.stdout:8/520: creat d1/dd/d13/d1a/d33/fa8 x:0 0 0 2024-02-28T16:26:41.177 INFO:tasks.workunit.client.0.smithi148.stdout:7/525: getdents d0/d9/d25/d47/d28/d2b 0 2024-02-28T16:26:41.179 INFO:tasks.workunit.client.0.smithi148.stdout:8/521: write d1/d3/d18/d48/d22/f32 [1654597,68438] 0 2024-02-28T16:26:41.181 INFO:tasks.workunit.client.0.smithi148.stdout:7/526: write d0/d9/d25/d47/d1c/f48 [3860644,123888] 0 2024-02-28T16:26:41.190 INFO:tasks.workunit.client.0.smithi148.stdout:6/464: dread d0/d4/d1b/f47 [4194304,4194304] 0 2024-02-28T16:26:41.191 INFO:tasks.workunit.client.0.smithi148.stdout:6/465: readlink d0/d22/d27/l5e 0 2024-02-28T16:26:41.192 INFO:tasks.workunit.client.0.smithi148.stdout:8/522: dread d1/dd/f93 [0,4194304] 0 2024-02-28T16:26:41.192 INFO:tasks.workunit.client.0.smithi148.stdout:9/617: truncate d7/f3c 4068457 0 2024-02-28T16:26:41.195 INFO:tasks.workunit.client.0.smithi148.stdout:8/523: symlink d1/dd/d13/d23/la9 0 2024-02-28T16:26:41.197 INFO:tasks.workunit.client.0.smithi148.stdout:6/466: mkdir d0/d22/d49/d88/d97 0 2024-02-28T16:26:41.198 INFO:tasks.workunit.client.0.smithi148.stdout:8/524: chown d1/dd/d13/d24/c7a 0 1 2024-02-28T16:26:41.199 INFO:tasks.workunit.client.0.smithi148.stdout:6/467: chown d0/d8/d21/c89 340 1 2024-02-28T16:26:41.200 INFO:tasks.workunit.client.0.smithi148.stdout:7/527: dwrite d0/d9/d25/f7c [0,4194304] 0 2024-02-28T16:26:41.201 INFO:tasks.workunit.client.0.smithi148.stdout:7/528: stat d0/d18/f91 0 2024-02-28T16:26:41.206 INFO:tasks.workunit.client.0.smithi148.stdout:6/468: mknod d0/d22/d27/d66/d87/c98 0 2024-02-28T16:26:41.207 INFO:tasks.workunit.client.0.smithi148.stdout:8/525: creat d1/d3/d18/d48/d70/d75/d91/faa x:0 0 0 2024-02-28T16:26:41.209 INFO:tasks.workunit.client.0.smithi148.stdout:9/618: dwrite d7/d1c/d59/d83/d88/f8a [0,4194304] 0 2024-02-28T16:26:41.211 INFO:tasks.workunit.client.0.smithi148.stdout:6/469: fdatasync d0/d22/d27/d66/d87/f90 0 2024-02-28T16:26:41.211 INFO:tasks.workunit.client.0.smithi148.stdout:9/619: fdatasync d7/d1c/d32/d24/fad 0 2024-02-28T16:26:41.212 INFO:tasks.workunit.client.0.smithi148.stdout:8/526: dread d1/dd/d13/d1a/d25/d50/f89 [0,4194304] 0 2024-02-28T16:26:41.224 INFO:tasks.workunit.client.0.smithi148.stdout:9/620: creat d7/d1c/d3d/fd6 x:0 0 0 2024-02-28T16:26:41.226 INFO:tasks.workunit.client.0.smithi148.stdout:8/527: creat d1/d3/d18/d48/d70/d75/d91/fab x:0 0 0 2024-02-28T16:26:41.231 INFO:tasks.workunit.client.0.smithi148.stdout:6/470: dwrite d0/d8/f6c [0,4194304] 0 2024-02-28T16:26:41.234 INFO:tasks.workunit.client.0.smithi148.stdout:7/529: truncate d0/d9/d25/d47/d1c/d32/f3d 3332710 0 2024-02-28T16:26:41.249 INFO:tasks.workunit.client.0.smithi148.stdout:8/528: rename d1/d3/d18/f31 to d1/dd/d13/d1a/d25/da3/fac 0 2024-02-28T16:26:41.250 INFO:tasks.workunit.client.0.smithi148.stdout:6/471: symlink d0/d4/d14/d8a/l99 0 2024-02-28T16:26:41.252 INFO:tasks.workunit.client.0.smithi148.stdout:8/529: mkdir d1/dd/d51/dad 0 2024-02-28T16:26:41.253 INFO:tasks.workunit.client.0.smithi148.stdout:7/530: creat d0/d9/d25/d47/fa2 x:0 0 0 2024-02-28T16:26:41.254 INFO:tasks.workunit.client.0.smithi148.stdout:6/472: symlink d0/d22/l9a 0 2024-02-28T16:26:41.255 INFO:tasks.workunit.client.0.smithi148.stdout:7/531: write d0/d9/d25/d39/f44 [1926347,40008] 0 2024-02-28T16:26:41.256 INFO:tasks.workunit.client.0.smithi148.stdout:9/621: getdents d7/d1c/d32/d24/d78 0 2024-02-28T16:26:41.258 INFO:tasks.workunit.client.0.smithi148.stdout:2/477: sync 2024-02-28T16:26:41.259 INFO:tasks.workunit.client.0.smithi148.stdout:8/530: mkdir d1/dd/d51/dad/dae 0 2024-02-28T16:26:41.262 INFO:tasks.workunit.client.0.smithi148.stdout:7/532: fsync d0/d9/d25/d47/d28/d2b/d5c/f85 0 2024-02-28T16:26:41.263 INFO:tasks.workunit.client.0.smithi148.stdout:9/622: unlink d7/d1c/d74/f9e 0 2024-02-28T16:26:41.264 INFO:tasks.workunit.client.0.smithi148.stdout:2/478: unlink d0/d9/c4c 0 2024-02-28T16:26:41.267 INFO:tasks.workunit.client.0.smithi148.stdout:8/531: symlink d1/d3/d18/d48/d22/laf 0 2024-02-28T16:26:41.268 INFO:tasks.workunit.client.0.smithi148.stdout:6/473: dwrite d0/d8/f6c [0,4194304] 0 2024-02-28T16:26:41.338 INFO:tasks.workunit.client.0.smithi148.stdout:7/533: mknod d0/d9/d25/d47/d28/d2b/d3a/d49/ca3 0 2024-02-28T16:26:41.339 INFO:tasks.workunit.client.0.smithi148.stdout:2/479: write d0/dd/f82 [3612801,21477] 0 2024-02-28T16:26:41.342 INFO:tasks.workunit.client.0.smithi148.stdout:6/474: rmdir d0/d22/d49 39 2024-02-28T16:26:41.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/480: fsync d0/dd/f82 0 2024-02-28T16:26:41.357 INFO:tasks.workunit.client.0.smithi148.stdout:8/532: write d1/d3/f47 [351225,124757] 0 2024-02-28T16:26:41.360 INFO:tasks.workunit.client.0.smithi148.stdout:6/475: dwrite d0/f4c [0,4194304] 0 2024-02-28T16:26:41.363 INFO:tasks.workunit.client.0.smithi148.stdout:7/534: write d0/d9/d25/d47/f29 [533506,875] 0 2024-02-28T16:26:41.368 INFO:tasks.workunit.client.0.smithi148.stdout:8/533: chown d1/dd/d13/d1a/d25/d50/c97 83881605 1 2024-02-28T16:26:41.368 INFO:tasks.workunit.client.0.smithi148.stdout:9/623: dread d7/d1c/f9a [4194304,4194304] 0 2024-02-28T16:26:41.369 INFO:tasks.workunit.client.0.smithi148.stdout:2/481: mknod d0/d18/d89/c95 0 2024-02-28T16:26:41.372 INFO:tasks.workunit.client.0.smithi148.stdout:9/624: truncate d7/d1c/d1f/d49/d8d/fb7 873090 0 2024-02-28T16:26:41.373 INFO:tasks.workunit.client.0.smithi148.stdout:9/625: stat d7/d1c/d59/d83/lc8 0 2024-02-28T16:26:41.373 INFO:tasks.workunit.client.0.smithi148.stdout:8/534: rename d1/dd/d13/d24/d3a/c40 to d1/d3/d18/d48/d70/cb0 0 2024-02-28T16:26:41.378 INFO:tasks.workunit.client.0.smithi148.stdout:2/482: stat d0/dd/c6f 0 2024-02-28T16:26:41.378 INFO:tasks.workunit.client.0.smithi148.stdout:8/535: symlink d1/d3/d18/d5a/d60/lb1 0 2024-02-28T16:26:41.381 INFO:tasks.workunit.client.0.smithi148.stdout:7/535: rmdir d0/d9/d25/d47/d28/d2b/d77 0 2024-02-28T16:26:41.381 INFO:tasks.workunit.client.0.smithi148.stdout:8/536: write d1/d3/d18/d48/d22/d34/f73 [133557,88618] 0 2024-02-28T16:26:41.381 INFO:tasks.workunit.client.0.smithi148.stdout:6/476: link d0/d22/l54 d0/d22/d49/l9b 0 2024-02-28T16:26:41.386 INFO:tasks.workunit.client.0.smithi148.stdout:6/477: creat d0/d4/d14/d8a/f9c x:0 0 0 2024-02-28T16:26:41.389 INFO:tasks.workunit.client.0.smithi148.stdout:6/478: mkdir d0/d8/d21/d9d 0 2024-02-28T16:26:41.390 INFO:tasks.workunit.client.0.smithi148.stdout:9/626: dread d7/d1c/d1f/d49/d6a/fb0 [0,4194304] 0 2024-02-28T16:26:41.390 INFO:tasks.workunit.client.0.smithi148.stdout:8/537: dread d1/f7 [0,4194304] 0 2024-02-28T16:26:41.392 INFO:tasks.workunit.client.0.smithi148.stdout:6/479: rmdir d0/d22/d25 39 2024-02-28T16:26:41.393 INFO:tasks.workunit.client.0.smithi148.stdout:9/627: creat d7/d43/da8/fd7 x:0 0 0 2024-02-28T16:26:41.394 INFO:tasks.workunit.client.0.smithi148.stdout:8/538: creat d1/d3/d18/d48/d70/d75/d84/fb2 x:0 0 0 2024-02-28T16:26:41.398 INFO:tasks.workunit.client.0.smithi148.stdout:8/539: mkdir d1/dd/d51/d77/db3 0 2024-02-28T16:26:41.401 INFO:tasks.workunit.client.0.smithi148.stdout:9/628: rename d7/d1c/d1f/d49/d5c/db5 to d7/d1c/d1f/d49/dd8 0 2024-02-28T16:26:41.404 INFO:tasks.workunit.client.0.smithi148.stdout:8/540: creat d1/d3/d18/d48/d70/d75/d91/fb4 x:0 0 0 2024-02-28T16:26:41.406 INFO:tasks.workunit.client.0.smithi148.stdout:6/480: dwrite d0/d4/d14/f81 [0,4194304] 0 2024-02-28T16:26:41.409 INFO:tasks.workunit.client.0.smithi148.stdout:7/536: truncate d0/d9/d25/d47/d1c/f48 2473171 0 2024-02-28T16:26:41.409 INFO:tasks.workunit.client.0.smithi148.stdout:8/541: truncate d1/d3/d18/d48/d70/d75/d91/fab 785602 0 2024-02-28T16:26:41.410 INFO:tasks.workunit.client.0.smithi148.stdout:6/481: getdents d0/d4/d1b/d71 0 2024-02-28T16:26:41.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/482: chown d0/d4/d14/d59/f94 1871 1 2024-02-28T16:26:41.412 INFO:tasks.workunit.client.0.smithi148.stdout:8/542: unlink d1/d3/f6c 0 2024-02-28T16:26:41.413 INFO:tasks.workunit.client.0.smithi148.stdout:4/443: sync 2024-02-28T16:26:41.415 INFO:tasks.workunit.client.0.smithi148.stdout:7/537: readlink d0/d9/d25/d47/d28/d2b/d3a/l55 0 2024-02-28T16:26:41.420 INFO:tasks.workunit.client.0.smithi148.stdout:8/543: rename d1/dd/d13/d1a/l4a to d1/d3/d18/d48/d70/d75/d84/da4/lb5 0 2024-02-28T16:26:41.423 INFO:tasks.workunit.client.0.smithi148.stdout:7/538: rename d0/d4/c2d to d0/d9/d25/d47/d28/d2b/d5c/ca4 0 2024-02-28T16:26:41.432 INFO:tasks.workunit.client.0.smithi148.stdout:6/483: dread d0/d8/ff [0,4194304] 0 2024-02-28T16:26:41.434 INFO:tasks.workunit.client.0.smithi148.stdout:6/484: write d0/d22/f38 [3183824,42559] 0 2024-02-28T16:26:41.437 INFO:tasks.workunit.client.0.smithi148.stdout:8/544: dwrite d1/d3/d18/d48/d70/d75/d91/fb4 [0,4194304] 0 2024-02-28T16:26:41.446 INFO:tasks.workunit.client.0.smithi148.stdout:6/485: mkdir d0/d8/d21/d9d/d9e 0 2024-02-28T16:26:41.447 INFO:tasks.workunit.client.0.smithi148.stdout:4/444: write d8/f69 [5065225,69972] 0 2024-02-28T16:26:41.450 INFO:tasks.workunit.client.0.smithi148.stdout:9/629: creat d7/d1c/d1f/d49/dae/fd9 x:0 0 0 2024-02-28T16:26:41.455 INFO:tasks.workunit.client.0.smithi148.stdout:8/545: creat d1/dd/d13/d24/fb6 x:0 0 0 2024-02-28T16:26:41.458 INFO:tasks.workunit.client.0.smithi148.stdout:8/546: dread - d1/dd/d13/d1a/d25/fa6 zero size 2024-02-28T16:26:41.459 INFO:tasks.workunit.client.0.smithi148.stdout:9/630: symlink d7/d1c/d74/lda 0 2024-02-28T16:26:41.462 INFO:tasks.workunit.client.0.smithi148.stdout:4/445: read d8/df/f1b [489702,6317] 0 2024-02-28T16:26:41.468 INFO:tasks.workunit.client.0.smithi148.stdout:4/446: fsync d8/df/f4a 0 2024-02-28T16:26:41.469 INFO:tasks.workunit.client.0.smithi148.stdout:7/539: dread d0/d9/d25/d47/d1c/f48 [0,4194304] 0 2024-02-28T16:26:41.474 INFO:tasks.workunit.client.0.smithi148.stdout:9/631: dread d7/d43/fc0 [0,4194304] 0 2024-02-28T16:26:41.475 INFO:tasks.workunit.client.0.smithi148.stdout:7/540: mkdir d0/d4/d70/da5 0 2024-02-28T16:26:41.479 INFO:tasks.workunit.client.0.smithi148.stdout:8/547: dwrite d1/f27 [0,4194304] 0 2024-02-28T16:26:41.480 INFO:tasks.workunit.client.0.smithi148.stdout:7/541: fdatasync d0/d9/d25/d47/f68 0 2024-02-28T16:26:41.483 INFO:tasks.workunit.client.0.smithi148.stdout:6/486: dwrite d0/d22/d25/d76/d7f/f5c [0,4194304] 0 2024-02-28T16:26:41.483 INFO:tasks.workunit.client.0.smithi148.stdout:8/548: chown d1/f7 8 1 2024-02-28T16:26:41.483 INFO:tasks.workunit.client.0.smithi148.stdout:7/542: readlink d0/d9/d46/l5d 0 2024-02-28T16:26:41.483 INFO:tasks.workunit.client.0.smithi148.stdout:9/632: truncate d7/d1c/d1f/d49/dae/fd9 903522 0 2024-02-28T16:26:41.489 INFO:tasks.workunit.client.0.smithi148.stdout:4/447: dread d8/f14 [0,4194304] 0 2024-02-28T16:26:41.491 INFO:tasks.workunit.client.0.smithi148.stdout:8/549: creat d1/d3/d18/d48/d70/d75/d84/fb7 x:0 0 0 2024-02-28T16:26:41.493 INFO:tasks.workunit.client.0.smithi148.stdout:4/448: readlink d8/df/d17/l61 0 2024-02-28T16:26:41.496 INFO:tasks.workunit.client.0.smithi148.stdout:6/487: truncate d0/d4/f3c 2568287 0 2024-02-28T16:26:41.499 INFO:tasks.workunit.client.0.smithi148.stdout:4/449: creat d8/d37/d91/f9a x:0 0 0 2024-02-28T16:26:41.500 INFO:tasks.workunit.client.0.smithi148.stdout:7/543: creat d0/d9/d25/fa6 x:0 0 0 2024-02-28T16:26:41.501 INFO:tasks.workunit.client.0.smithi148.stdout:9/633: dwrite d7/d1c/d1f/f4a [4194304,4194304] 0 2024-02-28T16:26:41.501 INFO:tasks.workunit.client.0.smithi148.stdout:6/488: creat d0/d22/d25/d76/f9f x:0 0 0 2024-02-28T16:26:41.504 INFO:tasks.workunit.client.0.smithi148.stdout:8/550: creat d1/dd/d13/fb8 x:0 0 0 2024-02-28T16:26:41.504 INFO:tasks.workunit.client.0.smithi148.stdout:9/634: stat d7/d1c/d59/cc4 0 2024-02-28T16:26:41.508 INFO:tasks.workunit.client.0.smithi148.stdout:7/544: rmdir d0/d9/d25/d47/d28/d2b/d6f 39 2024-02-28T16:26:41.510 INFO:tasks.workunit.client.0.smithi148.stdout:9/635: chown d7/d1c/d1f/d49/d8d/fc5 61450 1 2024-02-28T16:26:41.511 INFO:tasks.workunit.client.0.smithi148.stdout:8/551: rename d1/dd/c85 to d1/d3/d18/d48/d70/d75/d84/cb9 0 2024-02-28T16:26:41.516 INFO:tasks.workunit.client.0.smithi148.stdout:7/545: read d0/d9/d25/d47/d28/d2b/f69 [63146,44662] 0 2024-02-28T16:26:41.517 INFO:tasks.workunit.client.0.smithi148.stdout:8/552: creat d1/d3/fba x:0 0 0 2024-02-28T16:26:41.519 INFO:tasks.workunit.client.0.smithi148.stdout:4/450: dwrite d8/f14 [0,4194304] 0 2024-02-28T16:26:41.520 INFO:tasks.workunit.client.0.smithi148.stdout:9/636: rename d7/d1c/d74/d68/d81 to d7/d1c/d74/d6b/ddb 0 2024-02-28T16:26:41.527 INFO:tasks.workunit.client.0.smithi148.stdout:7/546: rename d0/d9/d25/d47/d28/d2b/d3a/d49/l6c to d0/d9/d25/d47/d28/d2b/la7 0 2024-02-28T16:26:41.530 INFO:tasks.workunit.client.0.smithi148.stdout:7/547: read d0/f2 [186243,78557] 0 2024-02-28T16:26:41.533 INFO:tasks.workunit.client.0.smithi148.stdout:7/548: read d0/d9/d25/d47/d28/d2b/f69 [78015,22571] 0 2024-02-28T16:26:41.534 INFO:tasks.workunit.client.0.smithi148.stdout:4/451: dwrite d8/f22 [0,4194304] 0 2024-02-28T16:26:41.536 INFO:tasks.workunit.client.0.smithi148.stdout:7/549: truncate d0/d9/d46/f6e 1821225 0 2024-02-28T16:26:41.537 INFO:tasks.workunit.client.0.smithi148.stdout:9/637: dwrite d7/d1c/d3d/fd6 [0,4194304] 0 2024-02-28T16:26:41.556 INFO:tasks.workunit.client.0.smithi148.stdout:4/452: dwrite d8/df/d17/d6a/f8d [0,4194304] 0 2024-02-28T16:26:41.559 INFO:tasks.workunit.client.0.smithi148.stdout:7/550: fsync d0/d9/d25/d47/d28/d2b/d3a/f8b 0 2024-02-28T16:26:41.559 INFO:tasks.workunit.client.0.smithi148.stdout:4/453: read - d8/d37/d91/f9a zero size 2024-02-28T16:26:41.561 INFO:tasks.workunit.client.0.smithi148.stdout:7/551: chown d0/d9/d25/d47/f29 2030713 1 2024-02-28T16:26:41.563 INFO:tasks.workunit.client.0.smithi148.stdout:4/454: fdatasync d8/df/f34 0 2024-02-28T16:26:41.564 INFO:tasks.workunit.client.0.smithi148.stdout:7/552: stat d0/d9/d25/d47/d28/d2b/d6f 0 2024-02-28T16:26:41.567 INFO:tasks.workunit.client.0.smithi148.stdout:4/455: truncate d8/df/d7c/f92 1259674 0 2024-02-28T16:26:41.568 INFO:tasks.workunit.client.0.smithi148.stdout:4/456: chown d8/d40 809 1 2024-02-28T16:26:41.568 INFO:tasks.workunit.client.0.smithi148.stdout:7/553: chown d0/d9/d25/d47/d1c/d32/c81 6 1 2024-02-28T16:26:41.571 INFO:tasks.workunit.client.0.smithi148.stdout:7/554: creat d0/d9/d4c/fa8 x:0 0 0 2024-02-28T16:26:41.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/457: rename d8/f78 to d8/d21/d3d/f9b 0 2024-02-28T16:26:41.580 INFO:tasks.workunit.client.0.smithi148.stdout:4/458: mknod d8/d21/d3d/d4d/d72/c9c 0 2024-02-28T16:26:41.580 INFO:tasks.workunit.client.0.smithi148.stdout:4/459: getdents d8/df/d1f 0 2024-02-28T16:26:41.584 INFO:tasks.workunit.client.0.smithi148.stdout:4/460: truncate d8/df/d5f/f8f 855895 0 2024-02-28T16:26:41.585 INFO:tasks.workunit.client.0.smithi148.stdout:9/638: dread d7/d1c/d74/f50 [0,4194304] 0 2024-02-28T16:26:41.588 INFO:tasks.workunit.client.0.smithi148.stdout:7/555: dwrite d0/d9/d46/f6e [0,4194304] 0 2024-02-28T16:26:41.593 INFO:tasks.workunit.client.0.smithi148.stdout:7/556: mknod d0/d9/d25/ca9 0 2024-02-28T16:26:41.596 INFO:tasks.workunit.client.0.smithi148.stdout:7/557: write d0/d9/f8e [253487,115122] 0 2024-02-28T16:26:41.597 INFO:tasks.workunit.client.0.smithi148.stdout:4/461: dread d8/d40/d73/f7a [0,4194304] 0 2024-02-28T16:26:41.603 INFO:tasks.workunit.client.0.smithi148.stdout:9/639: dwrite d7/d1c/d32/d24/fad [0,4194304] 0 2024-02-28T16:26:41.609 INFO:tasks.workunit.client.0.smithi148.stdout:4/462: dread d8/f33 [0,4194304] 0 2024-02-28T16:26:41.613 INFO:tasks.workunit.client.0.smithi148.stdout:7/558: dwrite d0/d9/f8e [0,4194304] 0 2024-02-28T16:26:41.619 INFO:tasks.workunit.client.0.smithi148.stdout:4/463: rename d8/d37/f4f to d8/df/d17/d6a/f9d 0 2024-02-28T16:26:41.625 INFO:tasks.workunit.client.0.smithi148.stdout:9/640: dwrite d7/d1c/d32/d24/f42 [4194304,4194304] 0 2024-02-28T16:26:41.631 INFO:tasks.workunit.client.0.smithi148.stdout:9/641: creat d7/d1c/d32/d24/dac/fdc x:0 0 0 2024-02-28T16:26:41.636 INFO:tasks.workunit.client.0.smithi148.stdout:9/642: mkdir d7/d43/ddd 0 2024-02-28T16:26:41.637 INFO:tasks.workunit.client.0.smithi148.stdout:7/559: dwrite d0/d9/d46/f6e [0,4194304] 0 2024-02-28T16:26:41.641 INFO:tasks.workunit.client.0.smithi148.stdout:4/464: dread d8/df/d17/f1d [0,4194304] 0 2024-02-28T16:26:41.646 INFO:tasks.workunit.client.0.smithi148.stdout:4/465: dread d8/df/f36 [0,4194304] 0 2024-02-28T16:26:41.647 INFO:tasks.workunit.client.0.smithi148.stdout:3/619: sync 2024-02-28T16:26:41.652 INFO:tasks.workunit.client.0.smithi148.stdout:3/620: mkdir d1/d13/d19/d56/d5b/db4 0 2024-02-28T16:26:41.653 INFO:tasks.workunit.client.0.smithi148.stdout:7/560: dread d0/d9/f8e [0,4194304] 0 2024-02-28T16:26:41.655 INFO:tasks.workunit.client.0.smithi148.stdout:4/466: truncate d8/d21/d3d/f4c 465446 0 2024-02-28T16:26:41.658 INFO:tasks.workunit.client.0.smithi148.stdout:9/643: truncate d7/d1c/d32/f1a 2239791 0 2024-02-28T16:26:41.661 INFO:tasks.workunit.client.0.smithi148.stdout:7/561: rename d0/d9/d25/d39/f44 to d0/d9/d25/d47/d1c/d32/faa 0 2024-02-28T16:26:41.664 INFO:tasks.workunit.client.0.smithi148.stdout:4/467: symlink d8/d21/d3d/d8c/l9e 0 2024-02-28T16:26:41.667 INFO:tasks.workunit.client.0.smithi148.stdout:4/468: rmdir d8/df/d7c 39 2024-02-28T16:26:41.671 INFO:tasks.workunit.client.0.smithi148.stdout:4/469: write d8/d37/d91/f9a [635323,121646] 0 2024-02-28T16:26:41.671 INFO:tasks.workunit.client.0.smithi148.stdout:9/644: link d7/d1c/d74/d6b/lb3 d7/d1c/d59/lde 0 2024-02-28T16:26:41.674 INFO:tasks.workunit.client.0.smithi148.stdout:4/470: fdatasync d8/df/d5f/f81 0 2024-02-28T16:26:41.676 INFO:tasks.workunit.client.0.smithi148.stdout:9/645: symlink d7/d1c/d74/ldf 0 2024-02-28T16:26:41.679 INFO:tasks.workunit.client.0.smithi148.stdout:7/562: dread d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:41.681 INFO:tasks.workunit.client.0.smithi148.stdout:9/646: write d7/d1c/d32/d24/f42 [5951031,100147] 0 2024-02-28T16:26:41.683 INFO:tasks.workunit.client.0.smithi148.stdout:7/563: mknod d0/d9/d46/cab 0 2024-02-28T16:26:41.684 INFO:tasks.workunit.client.0.smithi148.stdout:9/647: readlink d7/d1c/l7a 0 2024-02-28T16:26:41.688 INFO:tasks.workunit.client.0.smithi148.stdout:7/564: write d0/d9/d4c/fa8 [175666,25067] 0 2024-02-28T16:26:41.696 INFO:tasks.workunit.client.0.smithi148.stdout:7/565: rename d0/d9/d25/d47/f68 to d0/d9/d25/d47/d28/d74/fac 0 2024-02-28T16:26:41.700 INFO:tasks.workunit.client.0.smithi148.stdout:9/648: fsync d7/d1c/d32/f1a 0 2024-02-28T16:26:41.707 INFO:tasks.workunit.client.0.smithi148.stdout:9/649: mkdir d7/d43/de0 0 2024-02-28T16:26:41.709 INFO:tasks.workunit.client.0.smithi148.stdout:7/566: dread d0/d9/d25/f7c [0,4194304] 0 2024-02-28T16:26:41.710 INFO:tasks.workunit.client.0.smithi148.stdout:9/650: symlink d7/d1c/d32/d24/dac/le1 0 2024-02-28T16:26:41.712 INFO:tasks.workunit.client.0.smithi148.stdout:7/567: write d0/f76 [2598184,127844] 0 2024-02-28T16:26:41.713 INFO:tasks.workunit.client.0.smithi148.stdout:0/636: sync 2024-02-28T16:26:41.715 INFO:tasks.workunit.client.0.smithi148.stdout:9/651: chown d7/d1c/d1f/f4a 6072988 1 2024-02-28T16:26:41.718 INFO:tasks.workunit.client.0.smithi148.stdout:3/621: dread d1/d13/d19/d1b/d38/f8a [0,4194304] 0 2024-02-28T16:26:41.722 INFO:tasks.workunit.client.0.smithi148.stdout:7/568: chown d0/d9/d25/d47/d28/d74/ca1 198 1 2024-02-28T16:26:41.723 INFO:tasks.workunit.client.0.smithi148.stdout:9/652: creat d7/d1c/d74/d6b/fe2 x:0 0 0 2024-02-28T16:26:41.723 INFO:tasks.workunit.client.0.smithi148.stdout:0/637: chown d1/d15/d27/d7a/lb9 526 1 2024-02-28T16:26:41.725 INFO:tasks.workunit.client.0.smithi148.stdout:4/471: dwrite d8/d21/f54 [0,4194304] 0 2024-02-28T16:26:41.728 INFO:tasks.workunit.client.0.smithi148.stdout:4/472: dread - d8/d40/d73/f96 zero size 2024-02-28T16:26:41.729 INFO:tasks.workunit.client.0.smithi148.stdout:7/569: dread d0/d9/d4c/fa8 [0,4194304] 0 2024-02-28T16:26:41.732 INFO:tasks.workunit.client.0.smithi148.stdout:3/622: mkdir d1/db5 0 2024-02-28T16:26:41.732 INFO:tasks.workunit.client.0.smithi148.stdout:3/623: readlink d1/db/d35/lad 0 2024-02-28T16:26:41.742 INFO:tasks.workunit.client.0.smithi148.stdout:7/570: mkdir d0/d9/d25/d47/d28/d2b/d3a/d49/dad 0 2024-02-28T16:26:41.746 INFO:tasks.workunit.client.0.smithi148.stdout:9/653: creat d7/d1c/fe3 x:0 0 0 2024-02-28T16:26:41.748 INFO:tasks.workunit.client.0.smithi148.stdout:4/473: getdents d8/d71/d85 0 2024-02-28T16:26:41.751 INFO:tasks.workunit.client.0.smithi148.stdout:7/571: mknod d0/d9/d25/d47/d28/cae 0 2024-02-28T16:26:41.752 INFO:tasks.workunit.client.0.smithi148.stdout:0/638: dread d1/d15/f78 [0,4194304] 0 2024-02-28T16:26:41.753 INFO:tasks.workunit.client.0.smithi148.stdout:9/654: mkdir d7/d1c/d59/d83/de4 0 2024-02-28T16:26:41.757 INFO:tasks.workunit.client.0.smithi148.stdout:4/474: mkdir d8/df/d9f 0 2024-02-28T16:26:41.757 INFO:tasks.workunit.client.0.smithi148.stdout:3/624: dwrite d1/d13/d19/d56/f5e [4194304,4194304] 0 2024-02-28T16:26:41.763 INFO:tasks.workunit.client.0.smithi148.stdout:0/639: creat d1/d15/d27/d34/d5a/d9d/d4a/fda x:0 0 0 2024-02-28T16:26:41.768 INFO:tasks.workunit.client.0.smithi148.stdout:3/625: fsync d1/db/d35/f6b 0 2024-02-28T16:26:41.771 INFO:tasks.workunit.client.0.smithi148.stdout:0/640: read d1/d15/d27/fb8 [2528499,118611] 0 2024-02-28T16:26:41.775 INFO:tasks.workunit.client.0.smithi148.stdout:3/626: unlink d1/d13/d19/d32/d41/fb1 0 2024-02-28T16:26:41.776 INFO:tasks.workunit.client.0.smithi148.stdout:4/475: dread d8/df/d17/d6a/f8d [0,4194304] 0 2024-02-28T16:26:41.782 INFO:tasks.workunit.client.0.smithi148.stdout:7/572: dread d0/d9/d25/d47/d28/d2b/d3a/f8b [0,4194304] 0 2024-02-28T16:26:41.789 INFO:tasks.workunit.client.0.smithi148.stdout:2/483: sync 2024-02-28T16:26:41.789 INFO:tasks.workunit.client.0.smithi148.stdout:5/490: sync 2024-02-28T16:26:41.789 INFO:tasks.workunit.client.0.smithi148.stdout:8/553: sync 2024-02-28T16:26:41.789 INFO:tasks.workunit.client.0.smithi148.stdout:6/489: sync 2024-02-28T16:26:41.789 INFO:tasks.workunit.client.0.smithi148.stdout:1/451: sync 2024-02-28T16:26:41.789 INFO:tasks.workunit.client.0.smithi148.stdout:4/476: dread d8/f15 [0,4194304] 0 2024-02-28T16:26:41.790 INFO:tasks.workunit.client.0.smithi148.stdout:0/641: creat d1/d15/d27/d34/d5a/d71/d80/fdb x:0 0 0 2024-02-28T16:26:41.794 INFO:tasks.workunit.client.0.smithi148.stdout:8/554: chown d1/d3/d18/d48/d22/d34/l58 140099596 1 2024-02-28T16:26:41.799 INFO:tasks.workunit.client.0.smithi148.stdout:2/484: dread d0/dd/d2b/f4f [0,4194304] 0 2024-02-28T16:26:41.806 INFO:tasks.workunit.client.0.smithi148.stdout:8/555: rename d1/dd/d13/d24/c7a to d1/dd/d13/d1a/d25/cbb 0 2024-02-28T16:26:41.810 INFO:tasks.workunit.client.0.smithi148.stdout:4/477: getdents d8/df/d1f 0 2024-02-28T16:26:41.813 INFO:tasks.workunit.client.0.smithi148.stdout:7/573: dwrite d0/d18/f79 [0,4194304] 0 2024-02-28T16:26:41.816 INFO:tasks.workunit.client.0.smithi148.stdout:9/655: write d7/d1c/d1f/d49/f4c [3795580,97965] 0 2024-02-28T16:26:41.816 INFO:tasks.workunit.client.0.smithi148.stdout:5/491: dwrite d1/d44/f59 [0,4194304] 0 2024-02-28T16:26:41.820 INFO:tasks.workunit.client.0.smithi148.stdout:0/642: mkdir d1/d15/d3d/d67/daf/ddc 0 2024-02-28T16:26:41.820 INFO:tasks.workunit.client.0.smithi148.stdout:6/490: dwrite d0/d4/d14/f82 [0,4194304] 0 2024-02-28T16:26:41.823 INFO:tasks.workunit.client.0.smithi148.stdout:5/492: truncate d1/f2f 4999607 0 2024-02-28T16:26:41.823 INFO:tasks.workunit.client.0.smithi148.stdout:1/452: dwrite d2/d15/f4d [4194304,4194304] 0 2024-02-28T16:26:41.834 INFO:tasks.workunit.client.0.smithi148.stdout:4/478: fsync d8/d40/d73/f7a 0 2024-02-28T16:26:41.841 INFO:tasks.workunit.client.0.smithi148.stdout:8/556: mkdir d1/d3/d18/d48/d22/d34/dbc 0 2024-02-28T16:26:41.857 INFO:tasks.workunit.client.0.smithi148.stdout:7/574: read - d0/d9/d25/d47/d28/f35 zero size 2024-02-28T16:26:41.857 INFO:tasks.workunit.client.0.smithi148.stdout:1/453: creat d2/d5/d40/d8/f86 x:0 0 0 2024-02-28T16:26:41.860 INFO:tasks.workunit.client.0.smithi148.stdout:3/627: dwrite d1/fa8 [0,4194304] 0 2024-02-28T16:26:41.863 INFO:tasks.workunit.client.0.smithi148.stdout:4/479: dwrite d8/df/d17/f2c [0,4194304] 0 2024-02-28T16:26:41.864 INFO:tasks.workunit.client.0.smithi148.stdout:3/628: chown d1/d13/d19/d32/d41/fab 364845 1 2024-02-28T16:26:41.865 INFO:tasks.workunit.client.0.smithi148.stdout:6/491: dread d0/d22/d27/f62 [0,4194304] 0 2024-02-28T16:26:41.866 INFO:tasks.workunit.client.0.smithi148.stdout:4/480: chown d8/d21/f2d 0 1 2024-02-28T16:26:41.869 INFO:tasks.workunit.client.0.smithi148.stdout:3/629: dread d1/d13/d19/d88/f99 [0,4194304] 0 2024-02-28T16:26:41.881 INFO:tasks.workunit.client.0.smithi148.stdout:9/656: creat d7/d1c/d1f/fe5 x:0 0 0 2024-02-28T16:26:41.887 INFO:tasks.workunit.client.0.smithi148.stdout:2/485: dwrite d0/d1d/f34 [4194304,4194304] 0 2024-02-28T16:26:41.890 INFO:tasks.workunit.client.0.smithi148.stdout:4/481: symlink d8/d37/la0 0 2024-02-28T16:26:41.899 INFO:tasks.workunit.client.0.smithi148.stdout:5/493: getdents d1/d44/d64 0 2024-02-28T16:26:41.901 INFO:tasks.workunit.client.0.smithi148.stdout:1/454: symlink d2/d5/d40/l87 0 2024-02-28T16:26:41.902 INFO:tasks.workunit.client.0.smithi148.stdout:0/643: truncate d1/d15/d27/d34/d5a/d71/d74/f8b 171188 0 2024-02-28T16:26:41.904 INFO:tasks.workunit.client.0.smithi148.stdout:1/455: write d2/d5/d1a/f67 [1326785,103372] 0 2024-02-28T16:26:41.906 INFO:tasks.workunit.client.0.smithi148.stdout:7/575: write d0/d9/f1a [5426185,56999] 0 2024-02-28T16:26:41.914 INFO:tasks.workunit.client.0.smithi148.stdout:4/482: creat d8/d21/d3d/d4d/d72/fa1 x:0 0 0 2024-02-28T16:26:41.916 INFO:tasks.workunit.client.0.smithi148.stdout:5/494: mkdir d1/d8/d20/d4e/d84/d92 0 2024-02-28T16:26:41.928 INFO:tasks.workunit.client.0.smithi148.stdout:3/630: dwrite d1/d13/d19/d1b/d38/d7c/f8d [0,4194304] 0 2024-02-28T16:26:41.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/456: dread d2/d5/d1a/f43 [0,4194304] 0 2024-02-28T16:26:41.931 INFO:tasks.workunit.client.0.smithi148.stdout:6/492: write d0/d22/d25/f36 [845191,113763] 0 2024-02-28T16:26:41.932 INFO:tasks.workunit.client.0.smithi148.stdout:2/486: truncate d0/dd/d2b/f31 4231714 0 2024-02-28T16:26:41.933 INFO:tasks.workunit.client.0.smithi148.stdout:0/644: dread d1/d4/d25/f2e [0,4194304] 0 2024-02-28T16:26:41.936 INFO:tasks.workunit.client.0.smithi148.stdout:5/495: fdatasync d1/db/d25/f2e 0 2024-02-28T16:26:41.940 INFO:tasks.workunit.client.0.smithi148.stdout:9/657: creat d7/d1c/fe6 x:0 0 0 2024-02-28T16:26:41.944 INFO:tasks.workunit.client.0.smithi148.stdout:3/631: mkdir d1/d13/d19/d94/db6 0 2024-02-28T16:26:41.946 INFO:tasks.workunit.client.0.smithi148.stdout:3/632: chown d1/db/d35/d70/c76 72 1 2024-02-28T16:26:41.946 INFO:tasks.workunit.client.0.smithi148.stdout:1/457: creat d2/d15/d62/d75/f88 x:0 0 0 2024-02-28T16:26:41.948 INFO:tasks.workunit.client.0.smithi148.stdout:3/633: chown d1/db/d35/d70/l86 2 1 2024-02-28T16:26:41.950 INFO:tasks.workunit.client.0.smithi148.stdout:3/634: read d1/db/f65 [440019,52095] 0 2024-02-28T16:26:41.956 INFO:tasks.workunit.client.0.smithi148.stdout:0/645: rmdir d1/d15/d27/d34/d5a/d6c 39 2024-02-28T16:26:41.958 INFO:tasks.workunit.client.0.smithi148.stdout:7/576: getdents d0/d9/d25/d47/d28/d2b/d80 0 2024-02-28T16:26:41.962 INFO:tasks.workunit.client.0.smithi148.stdout:1/458: rmdir d2/d5/d40/d7 39 2024-02-28T16:26:41.963 INFO:tasks.workunit.client.0.smithi148.stdout:7/577: read d0/d9/d25/d47/d28/d74/fac [2555720,109665] 0 2024-02-28T16:26:41.970 INFO:tasks.workunit.client.0.smithi148.stdout:2/487: unlink d0/d9/d13/d38/l2d 0 2024-02-28T16:26:41.972 INFO:tasks.workunit.client.0.smithi148.stdout:2/488: fdatasync d0/d18/d20/f50 0 2024-02-28T16:26:41.973 INFO:tasks.workunit.client.0.smithi148.stdout:9/658: mkdir d7/d43/de0/de7 0 2024-02-28T16:26:41.977 INFO:tasks.workunit.client.0.smithi148.stdout:6/493: creat d0/d4/d1b/fa0 x:0 0 0 2024-02-28T16:26:41.979 INFO:tasks.workunit.client.0.smithi148.stdout:6/494: dread - d0/d4/d14/d8a/f9c zero size 2024-02-28T16:26:41.979 INFO:tasks.workunit.client.0.smithi148.stdout:4/483: getdents d8/d21/d3d/d4d/d72 0 2024-02-28T16:26:41.988 INFO:tasks.workunit.client.0.smithi148.stdout:0/646: dwrite d1/d15/d8/f30 [0,4194304] 0 2024-02-28T16:26:41.988 INFO:tasks.workunit.client.0.smithi148.stdout:1/459: mkdir d2/d15/d83/d89 0 2024-02-28T16:26:41.988 INFO:tasks.workunit.client.0.smithi148.stdout:1/460: stat d2/d5/d2b/c5c 0 2024-02-28T16:26:41.988 INFO:tasks.workunit.client.0.smithi148.stdout:9/659: creat d7/d1c/d32/d24/dac/fe8 x:0 0 0 2024-02-28T16:26:41.989 INFO:tasks.workunit.client.0.smithi148.stdout:0/647: fdatasync d1/d15/d27/d7a/dc6/dc4/fd3 0 2024-02-28T16:26:41.991 INFO:tasks.workunit.client.0.smithi148.stdout:1/461: read - d2/d15/d62/d75/f88 zero size 2024-02-28T16:26:41.992 INFO:tasks.workunit.client.0.smithi148.stdout:0/648: write d1/d15/d27/d34/f6d [563614,17331] 0 2024-02-28T16:26:41.994 INFO:tasks.workunit.client.0.smithi148.stdout:4/484: dread d8/d21/f56 [0,4194304] 0 2024-02-28T16:26:41.997 INFO:tasks.workunit.client.0.smithi148.stdout:6/495: dwrite d0/d22/f37 [0,4194304] 0 2024-02-28T16:26:41.997 INFO:tasks.workunit.client.0.smithi148.stdout:5/496: rename d1/d8/d20/l85 to d1/l93 0 2024-02-28T16:26:41.999 INFO:tasks.workunit.client.0.smithi148.stdout:5/497: write d1/db/d60/d7a/f88 [1031087,22028] 0 2024-02-28T16:26:42.000 INFO:tasks.workunit.client.0.smithi148.stdout:2/489: mkdir d0/d1c/d85/d96 0 2024-02-28T16:26:42.003 INFO:tasks.workunit.client.0.smithi148.stdout:0/649: readlink l0 0 2024-02-28T16:26:42.004 INFO:tasks.workunit.client.0.smithi148.stdout:1/462: creat d2/d5/d1a/f8a x:0 0 0 2024-02-28T16:26:42.005 INFO:tasks.workunit.client.0.smithi148.stdout:3/635: write d1/d13/d19/d1b/d38/f82 [3317341,113398] 0 2024-02-28T16:26:42.008 INFO:tasks.workunit.client.0.smithi148.stdout:4/485: chown d8/df/d17/d6a/f9d 154696613 1 2024-02-28T16:26:42.019 INFO:tasks.workunit.client.0.smithi148.stdout:5/498: dwrite d1/d44/d64/f5d [0,4194304] 0 2024-02-28T16:26:42.021 INFO:tasks.workunit.client.0.smithi148.stdout:0/650: rename d1/d4 to d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/ddd 0 2024-02-28T16:26:42.022 INFO:tasks.workunit.client.0.smithi148.stdout:3/636: creat d1/db/d35/d70/d8e/fb7 x:0 0 0 2024-02-28T16:26:42.024 INFO:tasks.workunit.client.0.smithi148.stdout:2/490: symlink d0/d9/l97 0 2024-02-28T16:26:42.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/660: link d7/d1c/f34 d7/d1c/d32/d24/dc1/fe9 0 2024-02-28T16:26:42.031 INFO:tasks.workunit.client.0.smithi148.stdout:5/499: chown d1/d8/d20/d4e/d71/f73 83000156 1 2024-02-28T16:26:42.033 INFO:tasks.workunit.client.0.smithi148.stdout:7/578: dwrite d0/d9/d1b/f62 [0,4194304] 0 2024-02-28T16:26:42.036 INFO:tasks.workunit.client.0.smithi148.stdout:0/651: creat d1/d15/d27/d34/d5a/dcd/fde x:0 0 0 2024-02-28T16:26:42.039 INFO:tasks.workunit.client.0.smithi148.stdout:9/661: write d7/d1c/d32/d24/f42 [3079134,123713] 0 2024-02-28T16:26:42.039 INFO:tasks.workunit.client.0.smithi148.stdout:6/496: dwrite d0/d4/d1b/f1f [0,4194304] 0 2024-02-28T16:26:42.042 INFO:tasks.workunit.client.0.smithi148.stdout:5/500: truncate d1/d8/d20/d31/f40 1818862 0 2024-02-28T16:26:42.049 INFO:tasks.workunit.client.0.smithi148.stdout:0/652: chown d1/d15/d27/d34/c99 301736632 1 2024-02-28T16:26:42.052 INFO:tasks.workunit.client.0.smithi148.stdout:6/497: truncate d0/d22/d25/d76/f85 197585 0 2024-02-28T16:26:42.056 INFO:tasks.workunit.client.0.smithi148.stdout:4/486: truncate d8/d40/f75 757473 0 2024-02-28T16:26:42.057 INFO:tasks.workunit.client.0.smithi148.stdout:3/637: dwrite d1/db/d35/f92 [0,4194304] 0 2024-02-28T16:26:42.060 INFO:tasks.workunit.client.0.smithi148.stdout:5/501: unlink d1/db/f82 0 2024-02-28T16:26:42.062 INFO:tasks.workunit.client.0.smithi148.stdout:4/487: truncate d8/d21/d3d/f88 181316 0 2024-02-28T16:26:42.064 INFO:tasks.workunit.client.0.smithi148.stdout:2/491: write d0/d18/d89/f8a [1411569,21184] 0 2024-02-28T16:26:42.064 INFO:tasks.workunit.client.0.smithi148.stdout:3/638: stat d1/db/d35/d70/d8e/fb7 0 2024-02-28T16:26:42.071 INFO:tasks.workunit.client.0.smithi148.stdout:4/488: stat d8/d21/c70 0 2024-02-28T16:26:42.074 INFO:tasks.workunit.client.0.smithi148.stdout:3/639: write d1/d3f/f7f [868648,27525] 0 2024-02-28T16:26:42.074 INFO:tasks.workunit.client.0.smithi148.stdout:8/557: sync 2024-02-28T16:26:42.074 INFO:tasks.workunit.client.0.smithi148.stdout:7/579: dwrite d0/d9/d25/d47/f41 [0,4194304] 0 2024-02-28T16:26:42.078 INFO:tasks.workunit.client.0.smithi148.stdout:5/502: unlink d1/d8/d20/d31/d50/c57 0 2024-02-28T16:26:42.081 INFO:tasks.workunit.client.0.smithi148.stdout:3/640: read d1/d13/d19/d1b/d38/d7c/f8d [800642,123978] 0 2024-02-28T16:26:42.082 INFO:tasks.workunit.client.0.smithi148.stdout:5/503: write d1/db/d60/d7a/d8b/f45 [689491,34838] 0 2024-02-28T16:26:42.084 INFO:tasks.workunit.client.0.smithi148.stdout:6/498: creat d0/d4/fa1 x:0 0 0 2024-02-28T16:26:42.084 INFO:tasks.workunit.client.0.smithi148.stdout:3/641: dread d1/d3f/f77 [0,4194304] 0 2024-02-28T16:26:42.088 INFO:tasks.workunit.client.0.smithi148.stdout:3/642: fsync d1/d13/d19/d56/f63 0 2024-02-28T16:26:42.090 INFO:tasks.workunit.client.0.smithi148.stdout:1/463: dread d2/d5/d1a/f2c [0,4194304] 0 2024-02-28T16:26:42.090 INFO:tasks.workunit.client.0.smithi148.stdout:6/499: write d0/d22/d25/d76/f85 [717387,25357] 0 2024-02-28T16:26:42.092 INFO:tasks.workunit.client.0.smithi148.stdout:4/489: write d8/df/d17/f1d [101508,12805] 0 2024-02-28T16:26:42.096 INFO:tasks.workunit.client.0.smithi148.stdout:7/580: creat d0/d9/d25/d47/d28/d2b/d3a/d49/faf x:0 0 0 2024-02-28T16:26:42.098 INFO:tasks.workunit.client.0.smithi148.stdout:9/662: dread d7/d1c/f45 [0,4194304] 0 2024-02-28T16:26:42.102 INFO:tasks.workunit.client.0.smithi148.stdout:0/653: getdents d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9 0 2024-02-28T16:26:42.109 INFO:tasks.workunit.client.0.smithi148.stdout:8/558: mknod d1/dd/d51/d9b/cbd 0 2024-02-28T16:26:42.111 INFO:tasks.workunit.client.0.smithi148.stdout:3/643: rmdir d1/d13/d19 39 2024-02-28T16:26:42.113 INFO:tasks.workunit.client.0.smithi148.stdout:6/500: fdatasync d0/d4/d1b/f47 0 2024-02-28T16:26:42.115 INFO:tasks.workunit.client.0.smithi148.stdout:2/492: dwrite d0/dd/f88 [0,4194304] 0 2024-02-28T16:26:42.118 INFO:tasks.workunit.client.0.smithi148.stdout:7/581: dwrite d0/d9/d25/d47/d28/d2b/d3a/f8b [0,4194304] 0 2024-02-28T16:26:42.118 INFO:tasks.workunit.client.0.smithi148.stdout:4/490: rename d8/f3f to d8/df/d17/d6a/d6c/fa2 0 2024-02-28T16:26:42.122 INFO:tasks.workunit.client.0.smithi148.stdout:2/493: stat d0/d9/d13/d38/d3a/f4a 0 2024-02-28T16:26:42.122 INFO:tasks.workunit.client.0.smithi148.stdout:9/663: creat d7/d43/da8/fea x:0 0 0 2024-02-28T16:26:42.122 INFO:tasks.workunit.client.0.smithi148.stdout:1/464: dread d2/d5/d40/f3d [0,4194304] 0 2024-02-28T16:26:42.123 INFO:tasks.workunit.client.0.smithi148.stdout:0/654: mkdir d1/d15/d27/d34/d5a/d9d/ddf 0 2024-02-28T16:26:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:41 smithi148 ceph-mon[28767]: pgmap v45: 65 pgs: 65 active+clean; 1.0 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 23 MiB/s rd, 125 MiB/s wr, 278 op/s 2024-02-28T16:26:42.132 INFO:tasks.workunit.client.0.smithi148.stdout:8/559: mknod d1/dd/d13/d24/d3a/d49/cbe 0 2024-02-28T16:26:42.132 INFO:tasks.workunit.client.0.smithi148.stdout:6/501: mkdir d0/d4/d14/d8a/da2 0 2024-02-28T16:26:42.137 INFO:tasks.workunit.client.0.smithi148.stdout:1/465: mkdir d2/d15/d8b 0 2024-02-28T16:26:42.142 INFO:tasks.workunit.client.0.smithi148.stdout:4/491: mkdir d8/df/da3 0 2024-02-28T16:26:42.142 INFO:tasks.workunit.client.0.smithi148.stdout:5/504: getdents d1/d8/d20/d31 0 2024-02-28T16:26:42.144 INFO:tasks.workunit.client.0.smithi148.stdout:8/560: read d1/d3/d18/d5a/d60/f6d [1664211,52291] 0 2024-02-28T16:26:42.144 INFO:tasks.workunit.client.0.smithi148.stdout:1/466: read d2/d5/d1a/f67 [226732,44219] 0 2024-02-28T16:26:42.149 INFO:tasks.workunit.client.0.smithi148.stdout:3/644: dwrite d1/d13/d19/d56/f6c [0,4194304] 0 2024-02-28T16:26:42.150 INFO:tasks.workunit.client.0.smithi148.stdout:4/492: mknod d8/d21/d3d/d4d/d72/ca4 0 2024-02-28T16:26:42.152 INFO:tasks.workunit.client.0.smithi148.stdout:2/494: dread d0/d66/d76/f7c [0,4194304] 0 2024-02-28T16:26:42.161 INFO:tasks.workunit.client.0.smithi148.stdout:0/655: dwrite d1/d15/d27/d34/d5a/d71/d74/d7e/db7/fc8 [0,4194304] 0 2024-02-28T16:26:42.161 INFO:tasks.workunit.client.0.smithi148.stdout:1/467: chown d2/d5/d40/d7/f6e 235171 1 2024-02-28T16:26:42.167 INFO:tasks.workunit.client.0.smithi148.stdout:8/561: rename d1/dd/d13/d1a/d33/d9c to d1/d3/d18/d5a/dbf 0 2024-02-28T16:26:42.171 INFO:tasks.workunit.client.0.smithi148.stdout:9/664: dwrite d7/f17 [0,4194304] 0 2024-02-28T16:26:42.175 INFO:tasks.workunit.client.0.smithi148.stdout:4/493: write d8/df/d17/d6a/f8d [3633273,7397] 0 2024-02-28T16:26:42.180 INFO:tasks.workunit.client.0.smithi148.stdout:6/502: link d0/d22/l2f d0/d22/d27/d3e/d52/la3 0 2024-02-28T16:26:42.185 INFO:tasks.workunit.client.0.smithi148.stdout:5/505: creat d1/f94 x:0 0 0 2024-02-28T16:26:42.189 INFO:tasks.workunit.client.0.smithi148.stdout:5/506: dread - d1/f55 zero size 2024-02-28T16:26:42.190 INFO:tasks.workunit.client.0.smithi148.stdout:0/656: fsync d1/d15/d27/d34/d5a/d6c/f88 0 2024-02-28T16:26:42.196 INFO:tasks.workunit.client.0.smithi148.stdout:6/503: mknod d0/d4/d14/ca4 0 2024-02-28T16:26:42.196 INFO:tasks.workunit.client.0.smithi148.stdout:9/665: mkdir d7/d1c/deb 0 2024-02-28T16:26:42.197 INFO:tasks.workunit.client.0.smithi148.stdout:1/468: link d2/d5/d1a/l22 d2/d3f/l8c 0 2024-02-28T16:26:42.199 INFO:tasks.workunit.client.0.smithi148.stdout:0/657: chown d1/d15/d27/d7a/l58 17 1 2024-02-28T16:26:42.199 INFO:tasks.workunit.client.0.smithi148.stdout:4/494: link d8/f15 d8/d21/d3d/d4d/d72/fa5 0 2024-02-28T16:26:42.206 INFO:tasks.workunit.client.0.smithi148.stdout:4/495: dread - d8/df/d17/d6a/f9d zero size 2024-02-28T16:26:42.207 INFO:tasks.workunit.client.0.smithi148.stdout:5/507: getdents d1/db 0 2024-02-28T16:26:42.207 INFO:tasks.workunit.client.0.smithi148.stdout:8/562: dwrite d1/d3/d18/d48/d22/f32 [4194304,4194304] 0 2024-02-28T16:26:42.207 INFO:tasks.workunit.client.0.smithi148.stdout:9/666: dread - d7/d1c/d1f/d49/f89 zero size 2024-02-28T16:26:42.207 INFO:tasks.workunit.client.0.smithi148.stdout:0/658: fsync d1/d15/d8/f30 0 2024-02-28T16:26:42.211 INFO:tasks.workunit.client.0.smithi148.stdout:6/504: rename d0/d22/d27/c8e to d0/d4/d14/d8a/ca5 0 2024-02-28T16:26:42.211 INFO:tasks.workunit.client.0.smithi148.stdout:2/495: dwrite d0/d18/d20/f33 [0,4194304] 0 2024-02-28T16:26:42.212 INFO:tasks.workunit.client.0.smithi148.stdout:5/508: mknod d1/d8/d20/d4e/d71/c95 0 2024-02-28T16:26:42.214 INFO:tasks.workunit.client.0.smithi148.stdout:3/645: dwrite d1/d13/d19/f33 [0,4194304] 0 2024-02-28T16:26:42.217 INFO:tasks.workunit.client.0.smithi148.stdout:0/659: readlink d1/d15/d27/d34/d5a/d9d/d5f/ld5 0 2024-02-28T16:26:42.219 INFO:tasks.workunit.client.0.smithi148.stdout:9/667: mknod d7/d43/cec 0 2024-02-28T16:26:42.219 INFO:tasks.workunit.client.0.smithi148.stdout:8/563: creat d1/dd/d13/d68/fc0 x:0 0 0 2024-02-28T16:26:42.220 INFO:tasks.workunit.client.0.smithi148.stdout:6/505: rmdir d0/d22/d27/d66 39 2024-02-28T16:26:42.221 INFO:tasks.workunit.client.0.smithi148.stdout:2/496: chown d0/d1d/d52/l91 191322 1 2024-02-28T16:26:42.233 INFO:tasks.workunit.client.0.smithi148.stdout:3/646: creat d1/d13/d19/fb8 x:0 0 0 2024-02-28T16:26:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:41 smithi157 ceph-mon[38346]: pgmap v45: 65 pgs: 65 active+clean; 1.0 GiB data, 4.6 GiB used, 532 GiB / 536 GiB avail; 23 MiB/s rd, 125 MiB/s wr, 278 op/s 2024-02-28T16:26:42.238 INFO:tasks.workunit.client.0.smithi148.stdout:5/509: dread d1/db/d60/d7a/f88 [0,4194304] 0 2024-02-28T16:26:42.238 INFO:tasks.workunit.client.0.smithi148.stdout:6/506: chown d0/d4/d14/d8a/f9c 612846 1 2024-02-28T16:26:42.240 INFO:tasks.workunit.client.0.smithi148.stdout:5/510: fsync d1/f26 0 2024-02-28T16:26:42.244 INFO:tasks.workunit.client.0.smithi148.stdout:1/469: dwrite d2/d5/d40/d7/f85 [0,4194304] 0 2024-02-28T16:26:42.248 INFO:tasks.workunit.client.0.smithi148.stdout:3/647: creat d1/db/d35/d70/fb9 x:0 0 0 2024-02-28T16:26:42.252 INFO:tasks.workunit.client.0.smithi148.stdout:3/648: readlink d1/lb3 0 2024-02-28T16:26:42.254 INFO:tasks.workunit.client.0.smithi148.stdout:2/497: truncate d0/d1d/f5c 1038869 0 2024-02-28T16:26:42.265 INFO:tasks.workunit.client.0.smithi148.stdout:1/470: symlink d2/d5/d2b/d4a/l8d 0 2024-02-28T16:26:42.266 INFO:tasks.workunit.client.0.smithi148.stdout:8/564: dwrite d1/d3/d18/d48/d70/d75/d84/fb2 [0,4194304] 0 2024-02-28T16:26:42.266 INFO:tasks.workunit.client.0.smithi148.stdout:0/660: link d1/d15/f55 d1/d15/d27/d34/d5a/fe0 0 2024-02-28T16:26:42.272 INFO:tasks.workunit.client.0.smithi148.stdout:6/507: rename d0/d22/d25/d76/f9f to d0/d22/fa6 0 2024-02-28T16:26:42.283 INFO:tasks.workunit.client.0.smithi148.stdout:8/565: creat d1/dd/d13/d68/fc1 x:0 0 0 2024-02-28T16:26:42.283 INFO:tasks.workunit.client.0.smithi148.stdout:3/649: dwrite d1/db/d35/d70/d8e/fb7 [0,4194304] 0 2024-02-28T16:26:42.285 INFO:tasks.workunit.client.0.smithi148.stdout:2/498: link d0/d18/d89/f8a d0/d18/d89/f98 0 2024-02-28T16:26:42.285 INFO:tasks.workunit.client.0.smithi148.stdout:1/471: dwrite d2/d5/d40/d7/f85 [0,4194304] 0 2024-02-28T16:26:42.287 INFO:tasks.workunit.client.0.smithi148.stdout:8/566: fdatasync d1/d3/d18/d5a/d60/f8f 0 2024-02-28T16:26:42.290 INFO:tasks.workunit.client.0.smithi148.stdout:0/661: creat d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/ddd/fe1 x:0 0 0 2024-02-28T16:26:42.293 INFO:tasks.workunit.client.0.smithi148.stdout:5/511: write d1/db/d25/f1f [3584631,116904] 0 2024-02-28T16:26:42.297 INFO:tasks.workunit.client.0.smithi148.stdout:3/650: creat d1/d13/d19/d32/d41/fba x:0 0 0 2024-02-28T16:26:42.297 INFO:tasks.workunit.client.0.smithi148.stdout:0/662: dread - d1/d15/d27/d34/d5a/d71/d80/fdb zero size 2024-02-28T16:26:42.298 INFO:tasks.workunit.client.0.smithi148.stdout:5/512: chown d1/db/f49 220274 1 2024-02-28T16:26:42.308 INFO:tasks.workunit.client.0.smithi148.stdout:0/663: write d1/d15/d27/d34/d5a/d71/d74/d7e/db7/fc8 [1410496,52562] 0 2024-02-28T16:26:42.313 INFO:tasks.workunit.client.0.smithi148.stdout:9/668: dwrite d7/d1c/d1f/d49/d6a/fa6 [0,4194304] 0 2024-02-28T16:26:42.313 INFO:tasks.workunit.client.0.smithi148.stdout:8/567: mkdir d1/da7/dc2 0 2024-02-28T16:26:42.315 INFO:tasks.workunit.client.0.smithi148.stdout:0/664: write d1/d15/d27/d34/d5a/d9d/d5f/fa0 [724277,35227] 0 2024-02-28T16:26:42.319 INFO:tasks.workunit.client.0.smithi148.stdout:9/669: fsync d7/d1c/d1f/d49/f89 0 2024-02-28T16:26:42.319 INFO:tasks.workunit.client.0.smithi148.stdout:1/472: dread d2/d15/f30 [0,4194304] 0 2024-02-28T16:26:42.319 INFO:tasks.workunit.client.0.smithi148.stdout:0/665: dread - d1/d15/d27/d34/fba zero size 2024-02-28T16:26:42.319 INFO:tasks.workunit.client.0.smithi148.stdout:5/513: dread d1/db/d25/f7e [0,4194304] 0 2024-02-28T16:26:42.324 INFO:tasks.workunit.client.0.smithi148.stdout:6/508: write d0/d22/d49/f5a [1384045,33959] 0 2024-02-28T16:26:42.326 INFO:tasks.workunit.client.0.smithi148.stdout:3/651: symlink d1/db/d35/d70/d9c/lbb 0 2024-02-28T16:26:42.327 INFO:tasks.workunit.client.0.smithi148.stdout:8/568: creat d1/d3/d18/fc3 x:0 0 0 2024-02-28T16:26:42.334 INFO:tasks.workunit.client.0.smithi148.stdout:9/670: creat d7/d1c/d74/d6b/fed x:0 0 0 2024-02-28T16:26:42.334 INFO:tasks.workunit.client.0.smithi148.stdout:5/514: mkdir d1/d8/d20/d4e/d96 0 2024-02-28T16:26:42.337 INFO:tasks.workunit.client.0.smithi148.stdout:0/666: mknod d1/d15/d27/d34/d5a/d71/d74/d7e/da4/ce2 0 2024-02-28T16:26:42.338 INFO:tasks.workunit.client.0.smithi148.stdout:3/652: mkdir d1/d13/d19/dbc 0 2024-02-28T16:26:42.340 INFO:tasks.workunit.client.0.smithi148.stdout:2/499: dwrite d0/d1d/d52/d54/f63 [0,4194304] 0 2024-02-28T16:26:42.340 INFO:tasks.workunit.client.0.smithi148.stdout:3/653: chown d1/d13/d19/d88/f99 0 1 2024-02-28T16:26:42.343 INFO:tasks.workunit.client.0.smithi148.stdout:1/473: creat d2/d15/d62/d75/d76/f8e x:0 0 0 2024-02-28T16:26:42.343 INFO:tasks.workunit.client.0.smithi148.stdout:8/569: stat d1/dd/d13/d68/l63 0 2024-02-28T16:26:42.345 INFO:tasks.workunit.client.0.smithi148.stdout:6/509: symlink d0/d4/d1b/la7 0 2024-02-28T16:26:42.346 INFO:tasks.workunit.client.0.smithi148.stdout:1/474: dread - d2/d3f/f71 zero size 2024-02-28T16:26:42.347 INFO:tasks.workunit.client.0.smithi148.stdout:6/510: dread - d0/d4/f7a zero size 2024-02-28T16:26:42.348 INFO:tasks.workunit.client.0.smithi148.stdout:2/500: rename d0/d9/c65 to d0/d18/d20/d73/c99 0 2024-02-28T16:26:42.349 INFO:tasks.workunit.client.0.smithi148.stdout:8/570: fdatasync d1/f7f 0 2024-02-28T16:26:42.350 INFO:tasks.workunit.client.0.smithi148.stdout:2/501: fdatasync d0/d18/f8e 0 2024-02-28T16:26:42.352 INFO:tasks.workunit.client.0.smithi148.stdout:3/654: symlink d1/db/d35/lbd 0 2024-02-28T16:26:42.355 INFO:tasks.workunit.client.0.smithi148.stdout:3/655: write d1/db/fa1 [273417,76948] 0 2024-02-28T16:26:42.356 INFO:tasks.workunit.client.0.smithi148.stdout:1/475: rmdir d2/d15/d62 39 2024-02-28T16:26:42.357 INFO:tasks.workunit.client.0.smithi148.stdout:3/656: read - d1/d13/d19/fb8 zero size 2024-02-28T16:26:42.360 INFO:tasks.workunit.client.0.smithi148.stdout:6/511: symlink d0/d8/d21/la8 0 2024-02-28T16:26:42.362 INFO:tasks.workunit.client.0.smithi148.stdout:2/502: rename d0/d1d/d52/d54 to d0/d18/d9a 0 2024-02-28T16:26:42.367 INFO:tasks.workunit.client.0.smithi148.stdout:5/515: write d1/d8/d20/d31/f39 [1084206,19087] 0 2024-02-28T16:26:42.369 INFO:tasks.workunit.client.0.smithi148.stdout:0/667: getdents d1/d15/d27/d34/d5a/d6c 0 2024-02-28T16:26:42.370 INFO:tasks.workunit.client.0.smithi148.stdout:3/657: mknod d1/db/d35/d70/d9c/cbe 0 2024-02-28T16:26:42.376 INFO:tasks.workunit.client.0.smithi148.stdout:0/668: truncate d1/d15/d27/d34/d5a/dcd/fde 607923 0 2024-02-28T16:26:42.378 INFO:tasks.workunit.client.0.smithi148.stdout:6/512: dwrite d0/d4/d14/f82 [0,4194304] 0 2024-02-28T16:26:42.379 INFO:tasks.workunit.client.0.smithi148.stdout:9/671: truncate d7/d1c/d1f/d49/f5f 3505135 0 2024-02-28T16:26:42.389 INFO:tasks.workunit.client.0.smithi148.stdout:8/571: link d1/d3/d18/c99 d1/dd/d51/d9b/cc4 0 2024-02-28T16:26:42.392 INFO:tasks.workunit.client.0.smithi148.stdout:1/476: creat d2/d15/f8f x:0 0 0 2024-02-28T16:26:42.392 INFO:tasks.workunit.client.0.smithi148.stdout:3/658: write d1/d13/d19/d1b/d38/f43 [2498164,60822] 0 2024-02-28T16:26:42.393 INFO:tasks.workunit.client.0.smithi148.stdout:5/516: symlink d1/db/d60/d7a/d87/l97 0 2024-02-28T16:26:42.395 INFO:tasks.workunit.client.0.smithi148.stdout:6/513: mknod d0/d22/d49/d88/ca9 0 2024-02-28T16:26:42.401 INFO:tasks.workunit.client.0.smithi148.stdout:9/672: chown d7/d1c/d32/d24/lbf 203 1 2024-02-28T16:26:42.401 INFO:tasks.workunit.client.0.smithi148.stdout:5/517: rmdir d1/d8/d23 39 2024-02-28T16:26:42.402 INFO:tasks.workunit.client.0.smithi148.stdout:6/514: unlink d0/l40 0 2024-02-28T16:26:42.402 INFO:tasks.workunit.client.0.smithi148.stdout:9/673: write d7/d1c/d1f/d49/d8d/fc5 [732058,86460] 0 2024-02-28T16:26:42.404 INFO:tasks.workunit.client.0.smithi148.stdout:2/503: getdents d0/d1d/d55 0 2024-02-28T16:26:42.405 INFO:tasks.workunit.client.0.smithi148.stdout:3/659: read d1/d13/f17 [8381888,9900] 0 2024-02-28T16:26:42.406 INFO:tasks.workunit.client.0.smithi148.stdout:8/572: symlink d1/dd/d13/lc5 0 2024-02-28T16:26:42.414 INFO:tasks.workunit.client.0.smithi148.stdout:3/660: dread - d1/d13/d19/d1b/d38/fa4 zero size 2024-02-28T16:26:42.415 INFO:tasks.workunit.client.0.smithi148.stdout:0/669: dwrite d1/d15/d3d/d67/f89 [0,4194304] 0 2024-02-28T16:26:42.415 INFO:tasks.workunit.client.0.smithi148.stdout:2/504: truncate d0/d18/d9a/f87 5203085 0 2024-02-28T16:26:42.416 INFO:tasks.workunit.client.0.smithi148.stdout:8/573: write d1/d3/f47 [297100,21078] 0 2024-02-28T16:26:42.416 INFO:tasks.workunit.client.0.smithi148.stdout:6/515: truncate d0/d4/d1b/fa0 782114 0 2024-02-28T16:26:42.417 INFO:tasks.workunit.client.0.smithi148.stdout:1/477: dwrite d2/d5/d1a/f8a [0,4194304] 0 2024-02-28T16:26:42.418 INFO:tasks.workunit.client.0.smithi148.stdout:9/674: creat d7/d1c/d1f/d49/da7/fee x:0 0 0 2024-02-28T16:26:42.420 INFO:tasks.workunit.client.0.smithi148.stdout:5/518: write d1/d8/d20/d31/f39 [361849,30611] 0 2024-02-28T16:26:42.421 INFO:tasks.workunit.client.0.smithi148.stdout:8/574: fdatasync d1/f62 0 2024-02-28T16:26:42.439 INFO:tasks.workunit.client.0.smithi148.stdout:9/675: write d7/d1c/d74/f50 [4638287,88667] 0 2024-02-28T16:26:42.441 INFO:tasks.workunit.client.0.smithi148.stdout:8/575: unlink d1/d3/d18/d48/d70/d75/d91/faa 0 2024-02-28T16:26:42.446 INFO:tasks.workunit.client.0.smithi148.stdout:1/478: write d2/d5/d2b/d4a/f55 [566806,29182] 0 2024-02-28T16:26:42.450 INFO:tasks.workunit.client.0.smithi148.stdout:9/676: symlink d7/d1c/d32/d24/lef 0 2024-02-28T16:26:42.454 INFO:tasks.workunit.client.0.smithi148.stdout:3/661: dwrite d1/d13/d19/d1b/f44 [0,4194304] 0 2024-02-28T16:26:42.456 INFO:tasks.workunit.client.0.smithi148.stdout:1/479: chown d2/d5/d40/f6d 72960 1 2024-02-28T16:26:42.456 INFO:tasks.workunit.client.0.smithi148.stdout:5/519: dwrite d1/f26 [12582912,4194304] 0 2024-02-28T16:26:42.457 INFO:tasks.workunit.client.0.smithi148.stdout:0/670: dwrite d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/ddd/d25/f50 [4194304,4194304] 0 2024-02-28T16:26:42.458 INFO:tasks.workunit.client.0.smithi148.stdout:9/677: mknod d7/d1c/d3d/cf0 0 2024-02-28T16:26:42.460 INFO:tasks.workunit.client.0.smithi148.stdout:8/576: truncate d1/dd/d13/d24/d3a/d49/f9f 979076 0 2024-02-28T16:26:42.464 INFO:tasks.workunit.client.0.smithi148.stdout:5/520: mkdir d1/db/d60/d7a/d98 0 2024-02-28T16:26:42.467 INFO:tasks.workunit.client.0.smithi148.stdout:5/521: chown d1/d8/d20/d31/c33 4 1 2024-02-28T16:26:42.472 INFO:tasks.workunit.client.0.smithi148.stdout:8/577: rename d1/dd/d51/dad to d1/dd/d51/d9b/dc6 0 2024-02-28T16:26:42.473 INFO:tasks.workunit.client.0.smithi148.stdout:1/480: dread d2/d5/d40/d7/f6a [0,4194304] 0 2024-02-28T16:26:42.478 INFO:tasks.workunit.client.0.smithi148.stdout:2/505: dread d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:42.485 INFO:tasks.workunit.client.0.smithi148.stdout:1/481: rename d2/d5/d2b/l6b to d2/d25/l90 0 2024-02-28T16:26:42.487 INFO:tasks.workunit.client.0.smithi148.stdout:2/506: creat d0/d1c/d49/f9b x:0 0 0 2024-02-28T16:26:42.488 INFO:tasks.workunit.client.0.smithi148.stdout:0/671: dwrite d1/fd7 [0,4194304] 0 2024-02-28T16:26:42.499 INFO:tasks.workunit.client.0.smithi148.stdout:5/522: dwrite d1/f94 [0,4194304] 0 2024-02-28T16:26:42.503 INFO:tasks.workunit.client.0.smithi148.stdout:1/482: rename d2/d5/d1a to d2/d5/d40/d7/d91 0 2024-02-28T16:26:42.506 INFO:tasks.workunit.client.0.smithi148.stdout:0/672: mkdir d1/d15/d27/d34/d5a/d71/d74/d7e/db7/de3 0 2024-02-28T16:26:42.510 INFO:tasks.workunit.client.0.smithi148.stdout:1/483: read d2/d5/d40/d7/d91/f42 [1064401,44722] 0 2024-02-28T16:26:42.512 INFO:tasks.workunit.client.0.smithi148.stdout:2/507: dwrite d0/d1c/f4e [0,4194304] 0 2024-02-28T16:26:42.514 INFO:tasks.workunit.client.0.smithi148.stdout:8/578: dread d1/d3/f53 [0,4194304] 0 2024-02-28T16:26:42.518 INFO:tasks.workunit.client.0.smithi148.stdout:3/662: truncate d1/d3f/f7f 202129 0 2024-02-28T16:26:42.521 INFO:tasks.workunit.client.0.smithi148.stdout:9/678: truncate d7/faf 43647 0 2024-02-28T16:26:42.522 INFO:tasks.workunit.client.0.smithi148.stdout:0/673: rename d1/d15/d27/f9e to d1/d15/d27/d34/d5a/d71/d74/d7e/db7/de3/fe4 0 2024-02-28T16:26:42.534 INFO:tasks.workunit.client.0.smithi148.stdout:2/508: mkdir d0/d1d/d52/d9c 0 2024-02-28T16:26:42.535 INFO:tasks.workunit.client.0.smithi148.stdout:1/484: creat d2/d15/d62/d75/d76/f92 x:0 0 0 2024-02-28T16:26:42.536 INFO:tasks.workunit.client.0.smithi148.stdout:0/674: stat d1/d15/d27/d34/d5a/d71/d74/f8b 0 2024-02-28T16:26:42.539 INFO:tasks.workunit.client.0.smithi148.stdout:8/579: truncate d1/d3/f1e 411694 0 2024-02-28T16:26:42.539 INFO:tasks.workunit.client.0.smithi148.stdout:2/509: fsync d0/d9/d13/d38/f6b 0 2024-02-28T16:26:42.540 INFO:tasks.workunit.client.0.smithi148.stdout:9/679: chown d7/d1c/d1f/d49/c51 1065774 1 2024-02-28T16:26:42.545 INFO:tasks.workunit.client.0.smithi148.stdout:5/523: dread d1/f5f [0,4194304] 0 2024-02-28T16:26:42.547 INFO:tasks.workunit.client.0.smithi148.stdout:8/580: symlink d1/d3/d18/d5a/d60/lc7 0 2024-02-28T16:26:42.548 INFO:tasks.workunit.client.0.smithi148.stdout:8/581: dread - d1/dd/d13/d68/fc0 zero size 2024-02-28T16:26:42.551 INFO:tasks.workunit.client.0.smithi148.stdout:2/510: rename d0/dd/d2b to d0/d1c/d85/d8b/d8f/d9d 0 2024-02-28T16:26:42.554 INFO:tasks.workunit.client.0.smithi148.stdout:9/680: mkdir d7/d43/ddd/df1 0 2024-02-28T16:26:42.558 INFO:tasks.workunit.client.0.smithi148.stdout:5/524: chown d1/l58 1484 1 2024-02-28T16:26:42.561 INFO:tasks.workunit.client.0.smithi148.stdout:1/485: dwrite d2/d5/d40/d7/d91/f8a [4194304,4194304] 0 2024-02-28T16:26:42.566 INFO:tasks.workunit.client.0.smithi148.stdout:0/675: link d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/ddd/f6e d1/d15/d27/d34/d5a/dcd/fe5 0 2024-02-28T16:26:42.569 INFO:tasks.workunit.client.0.smithi148.stdout:5/525: creat d1/db/d60/d7a/d87/f99 x:0 0 0 2024-02-28T16:26:42.571 INFO:tasks.workunit.client.0.smithi148.stdout:3/663: write d1/db/d45/f8b [952792,99201] 0 2024-02-28T16:26:42.572 INFO:tasks.workunit.client.0.smithi148.stdout:9/681: creat d7/d1c/d1f/d49/dd8/ff2 x:0 0 0 2024-02-28T16:26:42.575 INFO:tasks.workunit.client.0.smithi148.stdout:0/676: write d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/ddd/fe [3117381,10102] 0 2024-02-28T16:26:42.577 INFO:tasks.workunit.client.0.smithi148.stdout:2/511: creat d0/d9/f9e x:0 0 0 2024-02-28T16:26:42.577 INFO:tasks.workunit.client.0.smithi148.stdout:8/582: dwrite d1/d3/d18/d48/d22/d55/f6a [0,4194304] 0 2024-02-28T16:26:42.585 INFO:tasks.workunit.client.0.smithi148.stdout:2/512: write d0/d9/d13/f80 [127989,92552] 0 2024-02-28T16:26:42.587 INFO:tasks.workunit.client.0.smithi148.stdout:9/682: mkdir d7/d43/ddd/df1/df3 0 2024-02-28T16:26:42.590 INFO:tasks.workunit.client.0.smithi148.stdout:8/583: unlink d1/dd/l52 0 2024-02-28T16:26:42.591 INFO:tasks.workunit.client.0.smithi148.stdout:1/486: link d2/d5/d40/d7/d91/f67 d2/d5/f93 0 2024-02-28T16:26:42.594 INFO:tasks.workunit.client.0.smithi148.stdout:9/683: fdatasync d7/d1c/d59/d83/fb1 0 2024-02-28T16:26:42.597 INFO:tasks.workunit.client.0.smithi148.stdout:5/526: link d1/d8/d20/d4e/d71/c95 d1/db/d60/d7a/c9a 0 2024-02-28T16:26:42.598 INFO:tasks.workunit.client.0.smithi148.stdout:1/487: dread - d2/d5/d40/d7/f6e zero size 2024-02-28T16:26:42.598 INFO:tasks.workunit.client.0.smithi148.stdout:3/664: getdents d1/d13/d19/d1b 0 2024-02-28T16:26:42.609 INFO:tasks.workunit.client.0.smithi148.stdout:9/684: truncate d7/d1c/d59/d83/d88/f8a 5059963 0 2024-02-28T16:26:42.612 INFO:tasks.workunit.client.0.smithi148.stdout:0/677: dwrite d1/d15/d27/d7a/dc6/dc4/fd3 [0,4194304] 0 2024-02-28T16:26:42.613 INFO:tasks.workunit.client.0.smithi148.stdout:5/527: truncate d1/d8/d20/d4e/d71/f91 172141 0 2024-02-28T16:26:42.619 INFO:tasks.workunit.client.0.smithi148.stdout:2/513: dwrite d0/d1d/d55/f74 [0,4194304] 0 2024-02-28T16:26:42.624 INFO:tasks.workunit.client.0.smithi148.stdout:9/685: getdents d7/d43/ddd/df1/df3 0 2024-02-28T16:26:42.625 INFO:tasks.workunit.client.0.smithi148.stdout:0/678: chown d1/d15/d27/d34/d5a/d9d/d5f/lb4 440 1 2024-02-28T16:26:42.636 INFO:tasks.workunit.client.0.smithi148.stdout:3/665: dwrite d1/db/d35/d70/faf [0,4194304] 0 2024-02-28T16:26:42.637 INFO:tasks.workunit.client.0.smithi148.stdout:0/679: truncate d1/d15/d27/d34/d5a/d9d/d4a/fda 690098 0 2024-02-28T16:26:42.639 INFO:tasks.workunit.client.0.smithi148.stdout:5/528: write d1/f6f [1092957,9627] 0 2024-02-28T16:26:42.640 INFO:tasks.workunit.client.0.smithi148.stdout:1/488: truncate d2/d5/d40/d7/d91/f3a 307289 0 2024-02-28T16:26:42.641 INFO:tasks.workunit.client.0.smithi148.stdout:2/514: dread d0/d18/d89/f8a [0,4194304] 0 2024-02-28T16:26:42.643 INFO:tasks.workunit.client.0.smithi148.stdout:3/666: getdents d1/db5 0 2024-02-28T16:26:42.646 INFO:tasks.workunit.client.0.smithi148.stdout:0/680: mkdir d1/d15/d27/d34/d5a/d71/de6 0 2024-02-28T16:26:42.646 INFO:tasks.workunit.client.0.smithi148.stdout:9/686: write d7/f17 [61801,27459] 0 2024-02-28T16:26:42.649 INFO:tasks.workunit.client.0.smithi148.stdout:2/515: read d0/f10 [3999746,59073] 0 2024-02-28T16:26:42.651 INFO:tasks.workunit.client.0.smithi148.stdout:1/489: mknod d2/d5/d40/d7/d91/c94 0 2024-02-28T16:26:42.653 INFO:tasks.workunit.client.0.smithi148.stdout:0/681: dread - d1/d15/d27/d34/d5a/d71/d80/fdb zero size 2024-02-28T16:26:42.654 INFO:tasks.workunit.client.0.smithi148.stdout:2/516: write d0/d18/f8e [283018,20437] 0 2024-02-28T16:26:42.655 INFO:tasks.workunit.client.0.smithi148.stdout:3/667: mkdir d1/d13/d19/d32/d9e/dbf 0 2024-02-28T16:26:42.659 INFO:tasks.workunit.client.0.smithi148.stdout:9/687: symlink d7/d1c/d32/d24/da2/lf4 0 2024-02-28T16:26:42.661 INFO:tasks.workunit.client.0.smithi148.stdout:2/517: symlink d0/d1c/d85/d8b/d8f/l9f 0 2024-02-28T16:26:42.662 INFO:tasks.workunit.client.0.smithi148.stdout:5/529: write d1/db/d60/d7a/d8b/f42 [1041684,47709] 0 2024-02-28T16:26:42.663 INFO:tasks.workunit.client.0.smithi148.stdout:1/490: truncate d2/d5/d40/f16 4172692 0 2024-02-28T16:26:42.669 INFO:tasks.workunit.client.0.smithi148.stdout:2/518: mknod d0/d18/d9a/ca0 0 2024-02-28T16:26:42.679 INFO:tasks.workunit.client.0.smithi148.stdout:0/682: link d1/d15/d27/d7a/dc6/da7/ccc d1/d15/d27/d34/d5a/d71/d74/d7e/db7/ce7 0 2024-02-28T16:26:42.681 INFO:tasks.workunit.client.0.smithi148.stdout:1/491: creat d2/d5/f95 x:0 0 0 2024-02-28T16:26:42.691 INFO:tasks.workunit.client.0.smithi148.stdout:9/688: dwrite d7/d1c/d74/f9b [0,4194304] 0 2024-02-28T16:26:42.693 INFO:tasks.workunit.client.0.smithi148.stdout:5/530: dwrite d1/d8/d20/d31/f6c [0,4194304] 0 2024-02-28T16:26:42.694 INFO:tasks.workunit.client.0.smithi148.stdout:2/519: dwrite d0/d1d/f34 [0,4194304] 0 2024-02-28T16:26:42.697 INFO:tasks.workunit.client.0.smithi148.stdout:2/520: dread - d0/dd/f86 zero size 2024-02-28T16:26:42.698 INFO:tasks.workunit.client.0.smithi148.stdout:9/689: truncate d7/d1c/d1f/d49/f89 950026 0 2024-02-28T16:26:42.699 INFO:tasks.workunit.client.0.smithi148.stdout:2/521: fdatasync d0/d1c/f1f 0 2024-02-28T16:26:42.700 INFO:tasks.workunit.client.0.smithi148.stdout:3/668: dread d1/d13/d19/d88/f8c [0,4194304] 0 2024-02-28T16:26:42.701 INFO:tasks.workunit.client.0.smithi148.stdout:9/690: fdatasync d7/d1c/d59/fa4 0 2024-02-28T16:26:42.707 INFO:tasks.workunit.client.0.smithi148.stdout:5/531: mknod d1/db/d60/d7a/d8b/d80/c9b 0 2024-02-28T16:26:42.712 INFO:tasks.workunit.client.0.smithi148.stdout:9/691: rmdir d7/d1c/d32/d24/da2 39 2024-02-28T16:26:42.716 INFO:tasks.workunit.client.0.smithi148.stdout:5/532: creat d1/d44/d64/f9c x:0 0 0 2024-02-28T16:26:42.723 INFO:tasks.workunit.client.0.smithi148.stdout:3/669: rmdir d1/d13/d19/dbc 0 2024-02-28T16:26:42.724 INFO:tasks.workunit.client.0.smithi148.stdout:0/683: write d1/d15/d27/d34/d5a/f66 [1085475,92236] 0 2024-02-28T16:26:42.726 INFO:tasks.workunit.client.0.smithi148.stdout:2/522: dwrite d0/d9/d13/d38/f6b [0,4194304] 0 2024-02-28T16:26:42.735 INFO:tasks.workunit.client.0.smithi148.stdout:9/692: getdents d7/d43/da8 0 2024-02-28T16:26:42.743 INFO:tasks.workunit.client.0.smithi148.stdout:1/492: dwrite d2/d5/d40/d7/d91/f24 [0,4194304] 0 2024-02-28T16:26:42.743 INFO:tasks.workunit.client.0.smithi148.stdout:9/693: write d7/d1c/d3d/fd6 [3467053,33513] 0 2024-02-28T16:26:42.745 INFO:tasks.workunit.client.0.smithi148.stdout:0/684: creat d1/d15/d27/d34/d5a/d9d/fe8 x:0 0 0 2024-02-28T16:26:42.748 INFO:tasks.workunit.client.0.smithi148.stdout:1/493: chown d2/d15/f8f 2006942215 1 2024-02-28T16:26:42.749 INFO:tasks.workunit.client.0.smithi148.stdout:7/582: sync 2024-02-28T16:26:42.749 INFO:tasks.workunit.client.0.smithi148.stdout:4/496: sync 2024-02-28T16:26:42.751 INFO:tasks.workunit.client.0.smithi148.stdout:5/533: dwrite d1/f26 [4194304,4194304] 0 2024-02-28T16:26:42.752 INFO:tasks.workunit.client.0.smithi148.stdout:9/694: read d7/d1c/d32/f1a [1739492,75200] 0 2024-02-28T16:26:42.757 INFO:tasks.workunit.client.0.smithi148.stdout:3/670: getdents d1/d13/d19/d1b/d38/d9b 0 2024-02-28T16:26:42.759 INFO:tasks.workunit.client.0.smithi148.stdout:4/497: truncate d8/d21/d3d/d4d/d72/f77 2239847 0 2024-02-28T16:26:42.760 INFO:tasks.workunit.client.0.smithi148.stdout:9/695: read d7/d1c/f20 [5134588,70374] 0 2024-02-28T16:26:42.761 INFO:tasks.workunit.client.0.smithi148.stdout:9/696: fsync d7/d1c/d74/f70 0 2024-02-28T16:26:42.764 INFO:tasks.workunit.client.0.smithi148.stdout:2/523: dwrite d0/d59/f7f [0,4194304] 0 2024-02-28T16:26:42.764 INFO:tasks.workunit.client.0.smithi148.stdout:9/697: write d7/d1c/d74/d6b/fed [559680,15202] 0 2024-02-28T16:26:42.767 INFO:tasks.workunit.client.0.smithi148.stdout:1/494: creat d2/d25/f96 x:0 0 0 2024-02-28T16:26:42.769 INFO:tasks.workunit.client.0.smithi148.stdout:9/698: write d7/d43/da8/fea [431459,61847] 0 2024-02-28T16:26:42.836 INFO:tasks.workunit.client.0.smithi148.stdout:1/495: creat d2/d3f/f97 x:0 0 0 2024-02-28T16:26:42.836 INFO:tasks.workunit.client.0.smithi148.stdout:7/583: symlink d0/d4/d70/da5/lb0 0 2024-02-28T16:26:42.836 INFO:tasks.workunit.client.0.smithi148.stdout:9/699: mknod d7/d1c/d1f/d49/dd8/cf5 0 2024-02-28T16:26:42.837 INFO:tasks.workunit.client.0.smithi148.stdout:4/498: creat d8/df/da3/fa6 x:0 0 0 2024-02-28T16:26:42.838 INFO:tasks.workunit.client.0.smithi148.stdout:5/534: link d1/f41 d1/db/d60/d7a/f9d 0 2024-02-28T16:26:42.841 INFO:tasks.workunit.client.0.smithi148.stdout:5/535: chown d1/d8/d20/d31/d50 161 1 2024-02-28T16:26:42.843 INFO:tasks.workunit.client.0.smithi148.stdout:9/700: read d7/d1c/d74/f70 [87136,102600] 0 2024-02-28T16:26:42.843 INFO:tasks.workunit.client.0.smithi148.stdout:4/499: symlink d8/df/la7 0 2024-02-28T16:26:42.846 INFO:tasks.workunit.client.0.smithi148.stdout:9/701: dread - d7/d1c/d1f/fca zero size 2024-02-28T16:26:42.852 INFO:tasks.workunit.client.0.smithi148.stdout:2/524: dwrite d0/dd/f82 [0,4194304] 0 2024-02-28T16:26:42.853 INFO:tasks.workunit.client.0.smithi148.stdout:4/500: rename d8/df/d1f/f3c to d8/fa8 0 2024-02-28T16:26:42.855 INFO:tasks.workunit.client.0.smithi148.stdout:0/685: dread d1/d15/d27/d34/d5a/d71/d74/d7e/db7/de3/fe4 [0,4194304] 0 2024-02-28T16:26:42.857 INFO:tasks.workunit.client.0.smithi148.stdout:4/501: chown d8/df/l29 69662 1 2024-02-28T16:26:42.858 INFO:tasks.workunit.client.0.smithi148.stdout:0/686: stat d1/d15/d27/d7a 0 2024-02-28T16:26:42.858 INFO:tasks.workunit.client.0.smithi148.stdout:9/702: symlink d7/d1c/d1f/d49/dae/dc9/lf6 0 2024-02-28T16:26:42.859 INFO:tasks.workunit.client.0.smithi148.stdout:5/536: dread d1/f6f [0,4194304] 0 2024-02-28T16:26:42.859 INFO:tasks.workunit.client.0.smithi148.stdout:2/525: mknod d0/d18/d89/ca1 0 2024-02-28T16:26:42.859 INFO:tasks.workunit.client.0.smithi148.stdout:1/496: dwrite d2/d5/d40/f27 [4194304,4194304] 0 2024-02-28T16:26:42.862 INFO:tasks.workunit.client.0.smithi148.stdout:4/502: unlink d8/df/c27 0 2024-02-28T16:26:42.863 INFO:tasks.workunit.client.0.smithi148.stdout:9/703: chown d7/d1c/d3d/la3 5 1 2024-02-28T16:26:42.863 INFO:tasks.workunit.client.0.smithi148.stdout:2/526: readlink d0/d1d/d52/l91 0 2024-02-28T16:26:42.867 INFO:tasks.workunit.client.0.smithi148.stdout:1/497: write d2/d5/d40/d7/f38 [216873,119956] 0 2024-02-28T16:26:42.873 INFO:tasks.workunit.client.0.smithi148.stdout:4/503: creat d8/d21/d3d/d4d/d66/fa9 x:0 0 0 2024-02-28T16:26:42.873 INFO:tasks.workunit.client.0.smithi148.stdout:5/537: rmdir d1/d8/d23 39 2024-02-28T16:26:42.874 INFO:tasks.workunit.client.0.smithi148.stdout:9/704: creat d7/d1c/d74/d6b/ddb/ff7 x:0 0 0 2024-02-28T16:26:42.874 INFO:tasks.workunit.client.0.smithi148.stdout:2/527: mkdir d0/da2 0 2024-02-28T16:26:42.877 INFO:tasks.workunit.client.0.smithi148.stdout:0/687: creat d1/d15/d27/d34/fe9 x:0 0 0 2024-02-28T16:26:42.880 INFO:tasks.workunit.client.0.smithi148.stdout:4/504: mknod d8/df/d7c/caa 0 2024-02-28T16:26:42.882 INFO:tasks.workunit.client.0.smithi148.stdout:5/538: creat d1/db/d60/d7a/d8b/f9e x:0 0 0 2024-02-28T16:26:42.883 INFO:tasks.workunit.client.0.smithi148.stdout:9/705: dread d7/d1c/d1f/d49/f89 [0,4194304] 0 2024-02-28T16:26:42.884 INFO:tasks.workunit.client.0.smithi148.stdout:5/539: write d1/f55 [75544,100712] 0 2024-02-28T16:26:42.886 INFO:tasks.workunit.client.0.smithi148.stdout:0/688: mknod d1/d15/d27/d34/d5a/d71/d74/d7e/cea 0 2024-02-28T16:26:42.889 INFO:tasks.workunit.client.0.smithi148.stdout:0/689: dread - d1/d15/d27/d34/d5a/d71/d74/d7e/da4/fab zero size 2024-02-28T16:26:42.890 INFO:tasks.workunit.client.0.smithi148.stdout:9/706: readlink d7/d1c/d59/l6d 0 2024-02-28T16:26:42.891 INFO:tasks.workunit.client.0.smithi148.stdout:5/540: dread - d1/db/d25/f69 zero size 2024-02-28T16:26:42.892 INFO:tasks.workunit.client.0.smithi148.stdout:1/498: dread d2/d5/d40/d7/d91/f8a [0,4194304] 0 2024-02-28T16:26:42.892 INFO:tasks.workunit.client.0.smithi148.stdout:0/690: write d1/d8a/faa [360406,35629] 0 2024-02-28T16:26:42.895 INFO:tasks.workunit.client.0.smithi148.stdout:1/499: rmdir d2/d5/d2b 39 2024-02-28T16:26:42.897 INFO:tasks.workunit.client.0.smithi148.stdout:0/691: creat d1/d15/d3d/feb x:0 0 0 2024-02-28T16:26:42.900 INFO:tasks.workunit.client.0.smithi148.stdout:5/541: getdents d1/d44/d64 0 2024-02-28T16:26:42.903 INFO:tasks.workunit.client.0.smithi148.stdout:1/500: rename d2/l34 to d2/d5/d40/l98 0 2024-02-28T16:26:42.905 INFO:tasks.workunit.client.0.smithi148.stdout:5/542: symlink d1/d8/d20/d4e/d96/l9f 0 2024-02-28T16:26:42.909 INFO:tasks.workunit.client.0.smithi148.stdout:5/543: symlink d1/d8/d20/d31/d50/la0 0 2024-02-28T16:26:42.914 INFO:tasks.workunit.client.0.smithi148.stdout:0/692: dwrite d1/d15/d27/d34/f6d [0,4194304] 0 2024-02-28T16:26:42.914 INFO:tasks.workunit.client.0.smithi148.stdout:5/544: write d1/f6f [944144,122373] 0 2024-02-28T16:26:42.915 INFO:tasks.workunit.client.0.smithi148.stdout:1/501: getdents d2/d25 0 2024-02-28T16:26:42.915 INFO:tasks.workunit.client.0.smithi148.stdout:6/516: sync 2024-02-28T16:26:42.919 INFO:tasks.workunit.client.0.smithi148.stdout:6/517: write d0/d8/d21/f8f [762650,70853] 0 2024-02-28T16:26:42.920 INFO:tasks.workunit.client.0.smithi148.stdout:6/518: chown d0/d22/d27 362 1 2024-02-28T16:26:42.923 INFO:tasks.workunit.client.0.smithi148.stdout:5/545: symlink d1/d8/d20/d31/la1 0 2024-02-28T16:26:42.924 INFO:tasks.workunit.client.0.smithi148.stdout:1/502: mkdir d2/d5/d40/d7/d99 0 2024-02-28T16:26:42.925 INFO:tasks.workunit.client.0.smithi148.stdout:1/503: readlink l1 0 2024-02-28T16:26:43.039 INFO:tasks.workunit.client.0.smithi148.stdout:5/546: dread d1/d8/d23/f52 [0,4194304] 0 2024-02-28T16:26:43.040 INFO:tasks.workunit.client.0.smithi148.stdout:7/584: write d0/d9/d25/d47/f58 [2098217,88027] 0 2024-02-28T16:26:43.045 INFO:tasks.workunit.client.0.smithi148.stdout:1/504: write d2/d5/d40/d7/f6a [607263,128553] 0 2024-02-28T16:26:43.045 INFO:tasks.workunit.client.0.smithi148.stdout:0/693: dwrite d1/d15/d27/d34/fba [0,4194304] 0 2024-02-28T16:26:43.050 INFO:tasks.workunit.client.0.smithi148.stdout:5/547: mknod d1/db/d60/d7a/d98/ca2 0 2024-02-28T16:26:43.053 INFO:tasks.workunit.client.0.smithi148.stdout:0/694: symlink d1/d15/d27/d7a/dc6/da7/lec 0 2024-02-28T16:26:43.054 INFO:tasks.workunit.client.0.smithi148.stdout:6/519: dwrite d0/d4/d1b/f1f [4194304,4194304] 0 2024-02-28T16:26:43.056 INFO:tasks.workunit.client.0.smithi148.stdout:6/520: dread - d0/d4/d14/d8a/f9c zero size 2024-02-28T16:26:43.058 INFO:tasks.workunit.client.0.smithi148.stdout:1/505: rename d2/d5/d40/d8/c50 to d2/d15/d62/d75/c9a 0 2024-02-28T16:26:43.061 INFO:tasks.workunit.client.0.smithi148.stdout:0/695: write d1/d15/d27/fb8 [2699300,117676] 0 2024-02-28T16:26:43.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/521: chown d0/d4/d14/d8a/l99 83 1 2024-02-28T16:26:43.064 INFO:tasks.workunit.client.0.smithi148.stdout:1/506: chown d2/d5/d40/d7/f64 5388 1 2024-02-28T16:26:43.068 INFO:tasks.workunit.client.0.smithi148.stdout:7/585: dread d0/d9/d25/d47/f58 [0,4194304] 0 2024-02-28T16:26:43.070 INFO:tasks.workunit.client.0.smithi148.stdout:1/507: creat d2/d3f/d46/f9b x:0 0 0 2024-02-28T16:26:43.070 INFO:tasks.workunit.client.0.smithi148.stdout:1/508: chown d2/d15 6 1 2024-02-28T16:26:43.075 INFO:tasks.workunit.client.0.smithi148.stdout:5/548: rename d1/db/d60/d7a/d8b/f66 to d1/d8/fa3 0 2024-02-28T16:26:43.079 INFO:tasks.workunit.client.0.smithi148.stdout:7/586: symlink d0/lb1 0 2024-02-28T16:26:43.081 INFO:tasks.workunit.client.0.smithi148.stdout:1/509: dread d2/d5/d2b/d4a/f77 [0,4194304] 0 2024-02-28T16:26:43.083 INFO:tasks.workunit.client.0.smithi148.stdout:5/549: mknod d1/d8/d20/d4e/d84/ca4 0 2024-02-28T16:26:43.087 INFO:tasks.workunit.client.0.smithi148.stdout:7/587: read d0/d4/f15 [1430391,125701] 0 2024-02-28T16:26:43.089 INFO:tasks.workunit.client.0.smithi148.stdout:5/550: creat d1/d44/fa5 x:0 0 0 2024-02-28T16:26:43.089 INFO:tasks.workunit.client.0.smithi148.stdout:7/588: chown d0/d9/d25/d47/d28/d74 102898 1 2024-02-28T16:26:43.094 INFO:tasks.workunit.client.0.smithi148.stdout:7/589: mknod d0/d9/d46/d65/cb2 0 2024-02-28T16:26:43.096 INFO:tasks.workunit.client.0.smithi148.stdout:6/522: dwrite d0/d22/d49/f6b [0,4194304] 0 2024-02-28T16:26:43.100 INFO:tasks.workunit.client.0.smithi148.stdout:7/590: rmdir d0/d9/d25/d47/d28/d2b 39 2024-02-28T16:26:43.100 INFO:tasks.workunit.client.0.smithi148.stdout:8/584: sync 2024-02-28T16:26:43.102 INFO:tasks.workunit.client.0.smithi148.stdout:6/523: unlink d0/d4/d14/d59/l60 0 2024-02-28T16:26:43.104 INFO:tasks.workunit.client.0.smithi148.stdout:6/524: chown d0/d4/d14/c53 25 1 2024-02-28T16:26:43.105 INFO:tasks.workunit.client.0.smithi148.stdout:8/585: rmdir d1/d3/d18/d48/d70/d75/d84/da4 39 2024-02-28T16:26:43.106 INFO:tasks.workunit.client.0.smithi148.stdout:1/510: dread d2/d5/f93 [0,4194304] 0 2024-02-28T16:26:43.107 INFO:tasks.workunit.client.0.smithi148.stdout:6/525: dread - d0/d22/d25/d76/d7f/f70 zero size 2024-02-28T16:26:43.108 INFO:tasks.workunit.client.0.smithi148.stdout:5/551: dwrite d1/f26 [4194304,4194304] 0 2024-02-28T16:26:43.109 INFO:tasks.workunit.client.0.smithi148.stdout:7/591: unlink d0/d9/d25/d47/l33 0 2024-02-28T16:26:43.110 INFO:tasks.workunit.client.0.smithi148.stdout:5/552: chown d1/f43 27 1 2024-02-28T16:26:43.113 INFO:tasks.workunit.client.0.smithi148.stdout:8/586: chown d1/dd/d13/d1a/d25/da3/fac 183987 1 2024-02-28T16:26:43.115 INFO:tasks.workunit.client.0.smithi148.stdout:7/592: mknod d0/d4/d70/da5/cb3 0 2024-02-28T16:26:43.115 INFO:tasks.workunit.client.0.smithi148.stdout:1/511: write d2/d5/d40/d8/f61 [121056,76081] 0 2024-02-28T16:26:43.115 INFO:tasks.workunit.client.0.smithi148.stdout:6/526: read d0/d4/d14/f28 [5091946,52995] 0 2024-02-28T16:26:43.120 INFO:tasks.workunit.client.0.smithi148.stdout:5/553: link d1/db/l37 d1/d8/d23/la6 0 2024-02-28T16:26:43.125 INFO:tasks.workunit.client.0.smithi148.stdout:1/512: fsync d2/d5/d40/d7/fc 0 2024-02-28T16:26:43.126 INFO:tasks.workunit.client.0.smithi148.stdout:6/527: creat d0/d22/d25/d76/d7f/faa x:0 0 0 2024-02-28T16:26:43.126 INFO:tasks.workunit.client.0.smithi148.stdout:0/696: dread d1/d15/d27/d34/d5a/dcd/fe5 [4194304,4194304] 0 2024-02-28T16:26:43.127 INFO:tasks.workunit.client.0.smithi148.stdout:5/554: creat d1/d8/d20/d4e/d84/fa7 x:0 0 0 2024-02-28T16:26:43.132 INFO:tasks.workunit.client.0.smithi148.stdout:7/593: write d0/d9/d25/d47/d28/d2b/f69 [870363,27417] 0 2024-02-28T16:26:43.135 INFO:tasks.workunit.client.0.smithi148.stdout:6/528: creat d0/d4/d14/d8a/fab x:0 0 0 2024-02-28T16:26:43.137 INFO:tasks.workunit.client.0.smithi148.stdout:7/594: truncate d0/d9/d25/d47/d1c/d32/f4e 1897756 0 2024-02-28T16:26:43.138 INFO:tasks.workunit.client.0.smithi148.stdout:1/513: mkdir d2/d9c 0 2024-02-28T16:26:43.140 INFO:tasks.workunit.client.0.smithi148.stdout:5/555: creat d1/db/d60/fa8 x:0 0 0 2024-02-28T16:26:43.149 INFO:tasks.workunit.client.0.smithi148.stdout:8/587: truncate d1/d3/d18/d48/d70/d75/d84/fb2 3668266 0 2024-02-28T16:26:43.149 INFO:tasks.workunit.client.0.smithi148.stdout:1/514: mkdir d2/d3f/d9d 0 2024-02-28T16:26:43.157 INFO:tasks.workunit.client.0.smithi148.stdout:1/515: symlink d2/d5/d40/d7/d91/l9e 0 2024-02-28T16:26:43.159 INFO:tasks.workunit.client.0.smithi148.stdout:0/697: link d1/d15/d27/d34/d5a/d9d/c4f d1/d15/d27/d34/d5a/dcd/ced 0 2024-02-28T16:26:43.162 INFO:tasks.workunit.client.0.smithi148.stdout:8/588: mknod d1/d3/d18/d5a/dbf/cc8 0 2024-02-28T16:26:43.164 INFO:tasks.workunit.client.0.smithi148.stdout:6/529: dread d0/d22/d25/d76/d7f/f5c [0,4194304] 0 2024-02-28T16:26:43.165 INFO:tasks.workunit.client.0.smithi148.stdout:8/589: fsync d1/dd/d13/d24/d3a/d49/f9f 0 2024-02-28T16:26:43.169 INFO:tasks.workunit.client.0.smithi148.stdout:1/516: rename d2/d5/d40/d8/f36 to d2/d3f/d46/f9f 0 2024-02-28T16:26:43.170 INFO:tasks.workunit.client.0.smithi148.stdout:1/517: stat d2/d5/d40/d7/f64 0 2024-02-28T16:26:43.171 INFO:tasks.workunit.client.0.smithi148.stdout:8/590: mknod d1/d3/d18/d48/d70/d75/cc9 0 2024-02-28T16:26:43.172 INFO:tasks.workunit.client.0.smithi148.stdout:6/530: creat d0/d4/d1b/d71/fac x:0 0 0 2024-02-28T16:26:43.173 INFO:tasks.workunit.client.0.smithi148.stdout:5/556: getdents d1/db/d60/d7a/d8b/d80 0 2024-02-28T16:26:43.176 INFO:tasks.workunit.client.0.smithi148.stdout:7/595: rename d0/d9/d46/d65 to d0/d9/d25/d47/d28/d2b/d3a/d6a/db4 0 2024-02-28T16:26:43.178 INFO:tasks.workunit.client.0.smithi148.stdout:8/591: dread d1/d3/f47 [0,4194304] 0 2024-02-28T16:26:43.180 INFO:tasks.workunit.client.0.smithi148.stdout:1/518: truncate d2/f51 11865826 0 2024-02-28T16:26:43.182 INFO:tasks.workunit.client.0.smithi148.stdout:7/596: truncate d0/d9/d25/d47/d1c/d32/fa0 1647560 0 2024-02-28T16:26:43.182 INFO:tasks.workunit.client.0.smithi148.stdout:1/519: write d2/d5/d40/f7d [4076076,31374] 0 2024-02-28T16:26:43.184 INFO:tasks.workunit.client.0.smithi148.stdout:5/557: unlink d1/d44/d64/f83 0 2024-02-28T16:26:43.187 INFO:tasks.workunit.client.0.smithi148.stdout:8/592: write d1/dd/d13/d24/d3a/d49/f57 [267052,68002] 0 2024-02-28T16:26:43.191 INFO:tasks.workunit.client.0.smithi148.stdout:7/597: unlink d0/d9/d25/d47/d1c/c24 0 2024-02-28T16:26:43.192 INFO:tasks.workunit.client.0.smithi148.stdout:1/520: truncate d2/d5/d40/f53 12778 0 2024-02-28T16:26:43.194 INFO:tasks.workunit.client.0.smithi148.stdout:6/531: getdents d0/d22/d25 0 2024-02-28T16:26:43.196 INFO:tasks.workunit.client.0.smithi148.stdout:1/521: creat d2/d3f/fa0 x:0 0 0 2024-02-28T16:26:43.198 INFO:tasks.workunit.client.0.smithi148.stdout:1/522: chown d2/d5/f95 117115907 1 2024-02-28T16:26:43.199 INFO:tasks.workunit.client.0.smithi148.stdout:0/698: dwrite d1/d15/f2a [0,4194304] 0 2024-02-28T16:26:43.201 INFO:tasks.workunit.client.0.smithi148.stdout:5/558: truncate d1/d8/d20/d31/f4d 789930 0 2024-02-28T16:26:43.203 INFO:tasks.workunit.client.0.smithi148.stdout:0/699: chown d1/d15/d27/d34/d5a/d6c/f88 29648 1 2024-02-28T16:26:43.206 INFO:tasks.workunit.client.0.smithi148.stdout:1/523: rename d2/d15/f8f to d2/d25/fa1 0 2024-02-28T16:26:43.207 INFO:tasks.workunit.client.0.smithi148.stdout:5/559: mknod d1/db/ca9 0 2024-02-28T16:26:43.212 INFO:tasks.workunit.client.0.smithi148.stdout:7/598: dwrite d0/d9/d25/f7c [0,4194304] 0 2024-02-28T16:26:43.215 INFO:tasks.workunit.client.0.smithi148.stdout:0/700: fsync d1/f41 0 2024-02-28T16:26:43.219 INFO:tasks.workunit.client.0.smithi148.stdout:1/524: creat d2/d5/d2b/d4a/fa2 x:0 0 0 2024-02-28T16:26:43.220 INFO:tasks.workunit.client.0.smithi148.stdout:6/532: link d0/d22/d27/l56 d0/d4/lad 0 2024-02-28T16:26:43.223 INFO:tasks.workunit.client.0.smithi148.stdout:0/701: readlink d1/d15/d27/d34/d5a/d71/d80/l85 0 2024-02-28T16:26:43.224 INFO:tasks.workunit.client.0.smithi148.stdout:5/560: write d1/d8/d20/d31/f6c [2655942,26769] 0 2024-02-28T16:26:43.228 INFO:tasks.workunit.client.0.smithi148.stdout:1/525: unlink d2/d25/fa1 0 2024-02-28T16:26:43.235 INFO:tasks.workunit.client.0.smithi148.stdout:5/561: symlink d1/db/d60/d7a/d98/laa 0 2024-02-28T16:26:43.235 INFO:tasks.workunit.client.0.smithi148.stdout:0/702: mkdir d1/d15/d3d/d67/dee 0 2024-02-28T16:26:43.235 INFO:tasks.workunit.client.0.smithi148.stdout:7/599: rename d0/d18/c88 to d0/d9/d25/d47/d28/cb5 0 2024-02-28T16:26:43.238 INFO:tasks.workunit.client.0.smithi148.stdout:0/703: write d1/d15/d27/d34/d5a/d6c/f75 [1797947,90488] 0 2024-02-28T16:26:43.250 INFO:tasks.workunit.client.0.smithi148.stdout:6/533: dwrite d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:43.252 INFO:tasks.workunit.client.0.smithi148.stdout:5/562: mknod d1/db/cab 0 2024-02-28T16:26:43.253 INFO:tasks.workunit.client.0.smithi148.stdout:1/526: mkdir d2/d15/d8b/da3 0 2024-02-28T16:26:43.257 INFO:tasks.workunit.client.0.smithi148.stdout:7/600: symlink d0/d9/d25/d47/d28/lb6 0 2024-02-28T16:26:43.262 INFO:tasks.workunit.client.0.smithi148.stdout:5/563: getdents d1/d8 0 2024-02-28T16:26:43.265 INFO:tasks.workunit.client.0.smithi148.stdout:5/564: write d1/f2f [4672812,46033] 0 2024-02-28T16:26:43.267 INFO:tasks.workunit.client.0.smithi148.stdout:1/527: rename d2/d5/d40/d8/f61 to d2/d5/d40/d7/fa4 0 2024-02-28T16:26:43.271 INFO:tasks.workunit.client.0.smithi148.stdout:5/565: creat d1/db/d60/fac x:0 0 0 2024-02-28T16:26:43.282 INFO:tasks.workunit.client.0.smithi148.stdout:1/528: dread d2/d5/d40/d7/d91/f8a [4194304,4194304] 0 2024-02-28T16:26:43.282 INFO:tasks.workunit.client.0.smithi148.stdout:7/601: dwrite d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:43.285 INFO:tasks.workunit.client.0.smithi148.stdout:7/602: stat d0/d9/d25/d39/f54 0 2024-02-28T16:26:43.289 INFO:tasks.workunit.client.0.smithi148.stdout:7/603: fdatasync d0/f71 0 2024-02-28T16:26:43.294 INFO:tasks.workunit.client.0.smithi148.stdout:6/534: dread d0/f4c [0,4194304] 0 2024-02-28T16:26:43.294 INFO:tasks.workunit.client.0.smithi148.stdout:0/704: dread d1/d15/d3d/f65 [0,4194304] 0 2024-02-28T16:26:43.295 INFO:tasks.workunit.client.0.smithi148.stdout:7/604: chown d0/l14 3 1 2024-02-28T16:26:43.295 INFO:tasks.workunit.client.0.smithi148.stdout:5/566: write d1/f5f [183111,62842] 0 2024-02-28T16:26:43.298 INFO:tasks.workunit.client.0.smithi148.stdout:6/535: mkdir d0/d22/d49/dae 0 2024-02-28T16:26:43.300 INFO:tasks.workunit.client.0.smithi148.stdout:6/536: chown d0/l2d 119 1 2024-02-28T16:26:43.301 INFO:tasks.workunit.client.0.smithi148.stdout:7/605: mkdir d0/d9/d25/d96/db7 0 2024-02-28T16:26:43.302 INFO:tasks.workunit.client.0.smithi148.stdout:6/537: readlink d0/d4/d1b/l2c 0 2024-02-28T16:26:43.307 INFO:tasks.workunit.client.0.smithi148.stdout:2/528: sync 2024-02-28T16:26:43.307 INFO:tasks.workunit.client.0.smithi148.stdout:3/671: sync 2024-02-28T16:26:43.310 INFO:tasks.workunit.client.0.smithi148.stdout:6/538: creat d0/d22/faf x:0 0 0 2024-02-28T16:26:43.314 INFO:tasks.workunit.client.0.smithi148.stdout:3/672: rmdir d1 39 2024-02-28T16:26:43.319 INFO:tasks.workunit.client.0.smithi148.stdout:1/529: dread d2/d5/d40/d7/f12 [0,4194304] 0 2024-02-28T16:26:43.320 INFO:tasks.workunit.client.0.smithi148.stdout:7/606: rename d0/d9/d25/d47/d28/d74 to d0/d9/d25/d47/db8 0 2024-02-28T16:26:43.322 INFO:tasks.workunit.client.0.smithi148.stdout:3/673: mknod d1/db/d35/d52/cc0 0 2024-02-28T16:26:43.325 INFO:tasks.workunit.client.0.smithi148.stdout:1/530: write d2/d15/f78 [739737,58216] 0 2024-02-28T16:26:43.334 INFO:tasks.workunit.client.0.smithi148.stdout:6/539: dwrite d0/d22/d49/d88/f93 [0,4194304] 0 2024-02-28T16:26:43.334 INFO:tasks.workunit.client.0.smithi148.stdout:0/705: dread d1/d15/d27/d34/d5a/d9d/d4a/d92/fa8 [0,4194304] 0 2024-02-28T16:26:43.338 INFO:tasks.workunit.client.0.smithi148.stdout:3/674: truncate d1/d13/f21 1787690 0 2024-02-28T16:26:43.341 INFO:tasks.workunit.client.0.smithi148.stdout:7/607: dread d0/d9/d25/d47/d28/d2b/d3a/d6a/db4/f84 [0,4194304] 0 2024-02-28T16:26:43.341 INFO:tasks.workunit.client.0.smithi148.stdout:2/529: dwrite d0/d18/d89/f8a [0,4194304] 0 2024-02-28T16:26:43.344 INFO:tasks.workunit.client.0.smithi148.stdout:1/531: creat d2/d5/d40/fa5 x:0 0 0 2024-02-28T16:26:43.344 INFO:tasks.workunit.client.0.smithi148.stdout:5/567: dread d1/db/d60/d7a/d8b/f5e [0,4194304] 0 2024-02-28T16:26:43.348 INFO:tasks.workunit.client.0.smithi148.stdout:6/540: truncate d0/d4/d14/d8a/fab 587750 0 2024-02-28T16:26:43.348 INFO:tasks.workunit.client.0.smithi148.stdout:1/532: chown d2/d5/d40/f27 17 1 2024-02-28T16:26:43.351 INFO:tasks.workunit.client.0.smithi148.stdout:5/568: dread d1/d8/d23/f52 [0,4194304] 0 2024-02-28T16:26:43.355 INFO:tasks.workunit.client.0.smithi148.stdout:1/533: unlink d2/d5/d40/d7/f64 0 2024-02-28T16:26:43.357 INFO:tasks.workunit.client.0.smithi148.stdout:9/707: sync 2024-02-28T16:26:43.357 INFO:tasks.workunit.client.0.smithi148.stdout:4/505: sync 2024-02-28T16:26:43.358 INFO:tasks.workunit.client.0.smithi148.stdout:5/569: write d1/db/d60/fac [929831,8505] 0 2024-02-28T16:26:43.366 INFO:tasks.workunit.client.0.smithi148.stdout:2/530: truncate d0/d1c/d85/d8b/d8f/d9d/f31 1531569 0 2024-02-28T16:26:43.366 INFO:tasks.workunit.client.0.smithi148.stdout:1/534: dread - d2/d15/d62/f65 zero size 2024-02-28T16:26:43.367 INFO:tasks.workunit.client.0.smithi148.stdout:0/706: dwrite d1/d15/d3d/feb [0,4194304] 0 2024-02-28T16:26:43.368 INFO:tasks.workunit.client.0.smithi148.stdout:1/535: readlink d2/l59 0 2024-02-28T16:26:43.373 INFO:tasks.workunit.client.0.smithi148.stdout:2/531: write d0/d18/d20/f33 [1447295,66914] 0 2024-02-28T16:26:43.374 INFO:tasks.workunit.client.0.smithi148.stdout:9/708: mknod d7/d1c/d1f/d49/d5c/cf8 0 2024-02-28T16:26:43.375 INFO:tasks.workunit.client.0.smithi148.stdout:4/506: symlink d8/df/d9f/lab 0 2024-02-28T16:26:43.377 INFO:tasks.workunit.client.0.smithi148.stdout:0/707: mknod d1/d15/d27/cef 0 2024-02-28T16:26:43.380 INFO:tasks.workunit.client.0.smithi148.stdout:3/675: dwrite d1/d13/d19/f28 [0,4194304] 0 2024-02-28T16:26:43.389 INFO:tasks.workunit.client.0.smithi148.stdout:4/507: chown d8/d40/c63 126119417 1 2024-02-28T16:26:43.394 INFO:tasks.workunit.client.0.smithi148.stdout:7/608: dwrite d0/d9/d25/f7c [0,4194304] 0 2024-02-28T16:26:43.396 INFO:tasks.workunit.client.0.smithi148.stdout:2/532: unlink d0/d1c/d85/d8b/d8f/d9d/d36/c56 0 2024-02-28T16:26:43.396 INFO:tasks.workunit.client.0.smithi148.stdout:6/541: dwrite d0/d4/d14/d8a/fab [0,4194304] 0 2024-02-28T16:26:43.398 INFO:tasks.workunit.client.0.smithi148.stdout:8/593: sync 2024-02-28T16:26:43.400 INFO:tasks.workunit.client.0.smithi148.stdout:2/533: fsync d0/d1d/d55/f74 0 2024-02-28T16:26:43.408 INFO:tasks.workunit.client.0.smithi148.stdout:5/570: dwrite d1/db/f49 [0,4194304] 0 2024-02-28T16:26:43.411 INFO:tasks.workunit.client.0.smithi148.stdout:0/708: read - d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/ddd/f90 zero size 2024-02-28T16:26:43.416 INFO:tasks.workunit.client.0.smithi148.stdout:4/508: rename d8/df/l31 to d8/d37/d98/lac 0 2024-02-28T16:26:43.425 INFO:tasks.workunit.client.0.smithi148.stdout:5/571: write d1/db/f49 [905461,8938] 0 2024-02-28T16:26:43.427 INFO:tasks.workunit.client.0.smithi148.stdout:6/542: symlink d0/d22/d27/d66/lb0 0 2024-02-28T16:26:43.428 INFO:tasks.workunit.client.0.smithi148.stdout:1/536: dwrite d2/d3f/d46/f9b [0,4194304] 0 2024-02-28T16:26:43.429 INFO:tasks.workunit.client.0.smithi148.stdout:2/534: mkdir d0/d1d/d52/da3 0 2024-02-28T16:26:43.431 INFO:tasks.workunit.client.0.smithi148.stdout:9/709: dwrite d7/d1c/d3d/f61 [0,4194304] 0 2024-02-28T16:26:43.434 INFO:tasks.workunit.client.0.smithi148.stdout:2/535: fsync d0/d59/f7f 0 2024-02-28T16:26:43.436 INFO:tasks.workunit.client.0.smithi148.stdout:8/594: rename d1/dd/d13/d68/f95 to d1/dd/d13/d1a/d25/d50/fca 0 2024-02-28T16:26:43.442 INFO:tasks.workunit.client.0.smithi148.stdout:7/609: creat d0/d9/d25/fb9 x:0 0 0 2024-02-28T16:26:43.447 INFO:tasks.workunit.client.0.smithi148.stdout:4/509: mkdir d8/d21/d3d/d4d/d66/dad 0 2024-02-28T16:26:43.449 INFO:tasks.workunit.client.0.smithi148.stdout:3/676: dwrite d1/d13/f15 [0,4194304] 0 2024-02-28T16:26:43.455 INFO:tasks.workunit.client.0.smithi148.stdout:4/510: write d8/d21/d3d/d4d/f5c [4525821,84978] 0 2024-02-28T16:26:43.455 INFO:tasks.workunit.client.0.smithi148.stdout:7/610: creat d0/d9/d1b/fba x:0 0 0 2024-02-28T16:26:43.457 INFO:tasks.workunit.client.0.smithi148.stdout:0/709: mkdir d1/d15/d27/d34/d5a/d71/d80/df0 0 2024-02-28T16:26:43.460 INFO:tasks.workunit.client.0.smithi148.stdout:1/537: mknod d2/d3f/d9d/ca6 0 2024-02-28T16:26:43.464 INFO:tasks.workunit.client.0.smithi148.stdout:2/536: dread d0/d1d/f70 [0,4194304] 0 2024-02-28T16:26:43.467 INFO:tasks.workunit.client.0.smithi148.stdout:8/595: dwrite d1/f62 [0,4194304] 0 2024-02-28T16:26:43.472 INFO:tasks.workunit.client.0.smithi148.stdout:5/572: getdents d1/db/d60/d7a/d87 0 2024-02-28T16:26:43.473 INFO:tasks.workunit.client.0.smithi148.stdout:6/543: link d0/d4/f3c d0/d22/d27/d66/fb1 0 2024-02-28T16:26:43.473 INFO:tasks.workunit.client.0.smithi148.stdout:4/511: dread d8/d21/f67 [0,4194304] 0 2024-02-28T16:26:43.474 INFO:tasks.workunit.client.0.smithi148.stdout:1/538: mkdir d2/d5/d2b/da7 0 2024-02-28T16:26:43.479 INFO:tasks.workunit.client.0.smithi148.stdout:1/539: write d2/d5/d40/d7/f38 [200525,17915] 0 2024-02-28T16:26:43.486 INFO:tasks.workunit.client.0.smithi148.stdout:2/537: fdatasync d0/d9/d13/d38/d3a/f4a 0 2024-02-28T16:26:43.491 INFO:tasks.workunit.client.0.smithi148.stdout:3/677: dwrite d1/d13/f1e [0,4194304] 0 2024-02-28T16:26:43.497 INFO:tasks.workunit.client.0.smithi148.stdout:5/573: mkdir d1/db/d60/d7a/d8b/dad 0 2024-02-28T16:26:43.497 INFO:tasks.workunit.client.0.smithi148.stdout:4/512: creat d8/d21/d3d/d8c/fae x:0 0 0 2024-02-28T16:26:43.504 INFO:tasks.workunit.client.0.smithi148.stdout:7/611: getdents d0/d9/d25/d47/d28/d2b 0 2024-02-28T16:26:43.510 INFO:tasks.workunit.client.0.smithi148.stdout:1/540: readlink d2/d3f/l8c 0 2024-02-28T16:26:43.515 INFO:tasks.workunit.client.0.smithi148.stdout:1/541: chown d2/d5/l7c 8834 1 2024-02-28T16:26:43.515 INFO:tasks.workunit.client.0.smithi148.stdout:3/678: dwrite d1/d13/d19/d32/d41/fab [0,4194304] 0 2024-02-28T16:26:43.518 INFO:tasks.workunit.client.0.smithi148.stdout:6/544: dread d0/d4/d1b/f1f [0,4194304] 0 2024-02-28T16:26:43.520 INFO:tasks.workunit.client.0.smithi148.stdout:9/710: link d7/d1c/d32/d24/da2/cba d7/d1c/d74/cf9 0 2024-02-28T16:26:43.521 INFO:tasks.workunit.client.0.smithi148.stdout:2/538: creat d0/d1c/d49/fa4 x:0 0 0 2024-02-28T16:26:43.528 INFO:tasks.workunit.client.0.smithi148.stdout:2/539: truncate d0/d1d/d55/f74 4967469 0 2024-02-28T16:26:43.530 INFO:tasks.workunit.client.0.smithi148.stdout:3/679: mkdir d1/db/d45/d80/dc1 0 2024-02-28T16:26:43.531 INFO:tasks.workunit.client.0.smithi148.stdout:6/545: creat d0/d4/d1b/d71/fb2 x:0 0 0 2024-02-28T16:26:43.537 INFO:tasks.workunit.client.0.smithi148.stdout:6/546: write d0/d8/f67 [1365851,91153] 0 2024-02-28T16:26:43.537 INFO:tasks.workunit.client.0.smithi148.stdout:4/513: truncate d8/f33 320966 0 2024-02-28T16:26:43.537 INFO:tasks.workunit.client.0.smithi148.stdout:2/540: unlink d0/dd/f86 0 2024-02-28T16:26:43.539 INFO:tasks.workunit.client.0.smithi148.stdout:6/547: dread - d0/d22/fa6 zero size 2024-02-28T16:26:43.545 INFO:tasks.workunit.client.0.smithi148.stdout:6/548: chown d0/d22/d25 2 1 2024-02-28T16:26:43.545 INFO:tasks.workunit.client.0.smithi148.stdout:1/542: creat d2/d9c/fa8 x:0 0 0 2024-02-28T16:26:43.545 INFO:tasks.workunit.client.0.smithi148.stdout:0/710: truncate d1/d15/d27/d34/d5a/dcd/fe5 1763953 0 2024-02-28T16:26:43.549 INFO:tasks.workunit.client.0.smithi148.stdout:1/543: chown d2/d5/l66 10738 1 2024-02-28T16:26:43.549 INFO:tasks.workunit.client.0.smithi148.stdout:4/514: mknod d8/df/d9f/caf 0 2024-02-28T16:26:43.549 INFO:tasks.workunit.client.0.smithi148.stdout:5/574: dwrite d1/db/d60/d7a/d8b/f5e [0,4194304] 0 2024-02-28T16:26:43.558 INFO:tasks.workunit.client.0.smithi148.stdout:7/612: write d0/d9/d25/d47/d28/d2b/d3a/d6a/db4/f84 [719350,83383] 0 2024-02-28T16:26:43.558 INFO:tasks.workunit.client.0.smithi148.stdout:3/680: rmdir d1/db/d45/d80/dc1 0 2024-02-28T16:26:43.561 INFO:tasks.workunit.client.0.smithi148.stdout:8/596: dread d1/f27 [0,4194304] 0 2024-02-28T16:26:43.562 INFO:tasks.workunit.client.0.smithi148.stdout:2/541: rmdir d0/d18/d20/d5d 0 2024-02-28T16:26:43.563 INFO:tasks.workunit.client.0.smithi148.stdout:7/613: write d0/f76 [3340105,111111] 0 2024-02-28T16:26:43.566 INFO:tasks.workunit.client.0.smithi148.stdout:4/515: rename d8/df/d7c to d8/d21/d3d/d8c/db0 0 2024-02-28T16:26:43.571 INFO:tasks.workunit.client.0.smithi148.stdout:9/711: dwrite d7/d1c/d59/d83/fc3 [0,4194304] 0 2024-02-28T16:26:43.572 INFO:tasks.workunit.client.0.smithi148.stdout:7/614: write d0/d9/d25/fb9 [1022672,72312] 0 2024-02-28T16:26:43.573 INFO:tasks.workunit.client.0.smithi148.stdout:5/575: symlink d1/db/d60/d7a/d8b/dad/lae 0 2024-02-28T16:26:43.574 INFO:tasks.workunit.client.0.smithi148.stdout:3/681: mknod d1/d13/d19/d56/d5b/cc2 0 2024-02-28T16:26:43.584 INFO:tasks.workunit.client.0.smithi148.stdout:1/544: rename d2/d5/d40/d8/f86 to d2/d15/d62/d75/d76/fa9 0 2024-02-28T16:26:43.584 INFO:tasks.workunit.client.0.smithi148.stdout:5/576: truncate d1/d44/fa5 889239 0 2024-02-28T16:26:43.584 INFO:tasks.workunit.client.0.smithi148.stdout:6/549: dwrite d0/f4c [4194304,4194304] 0 2024-02-28T16:26:43.588 INFO:tasks.workunit.client.0.smithi148.stdout:0/711: dread d1/d15/d27/d34/d5a/d71/d80/fb1 [0,4194304] 0 2024-02-28T16:26:43.588 INFO:tasks.workunit.client.0.smithi148.stdout:3/682: read d1/db/fa1 [306310,62946] 0 2024-02-28T16:26:43.590 INFO:tasks.workunit.client.0.smithi148.stdout:9/712: symlink d7/d43/ddd/lfa 0 2024-02-28T16:26:43.600 INFO:tasks.workunit.client.0.smithi148.stdout:7/615: creat d0/d9/d25/d47/d28/d2b/d6f/fbb x:0 0 0 2024-02-28T16:26:43.604 INFO:tasks.workunit.client.0.smithi148.stdout:7/616: fdatasync d0/d9/f1a 0 2024-02-28T16:26:43.604 INFO:tasks.workunit.client.0.smithi148.stdout:8/597: creat d1/fcb x:0 0 0 2024-02-28T16:26:43.604 INFO:tasks.workunit.client.0.smithi148.stdout:6/550: symlink d0/d8/d21/d9d/lb3 0 2024-02-28T16:26:43.607 INFO:tasks.workunit.client.0.smithi148.stdout:9/713: creat d7/d1c/d74/d68/ffb x:0 0 0 2024-02-28T16:26:43.610 INFO:tasks.workunit.client.0.smithi148.stdout:8/598: dread - d1/dd/d13/d24/fb6 zero size 2024-02-28T16:26:43.611 INFO:tasks.workunit.client.0.smithi148.stdout:4/516: dwrite d8/d21/d3d/d4d/d66/fa9 [0,4194304] 0 2024-02-28T16:26:43.613 INFO:tasks.workunit.client.0.smithi148.stdout:3/683: fdatasync d1/db/d35/f47 0 2024-02-28T16:26:43.614 INFO:tasks.workunit.client.0.smithi148.stdout:2/542: dread d0/d18/f28 [0,4194304] 0 2024-02-28T16:26:43.615 INFO:tasks.workunit.client.0.smithi148.stdout:6/551: truncate d0/d4/d1b/fa0 1733521 0 2024-02-28T16:26:43.619 INFO:tasks.workunit.client.0.smithi148.stdout:9/714: fdatasync d7/d1c/d1f/d49/d8d/fb7 0 2024-02-28T16:26:43.619 INFO:tasks.workunit.client.0.smithi148.stdout:2/543: fdatasync d0/d9/d13/d38/f6b 0 2024-02-28T16:26:43.624 INFO:tasks.workunit.client.0.smithi148.stdout:6/552: write d0/d4/d14/f81 [1373566,2546] 0 2024-02-28T16:26:43.624 INFO:tasks.workunit.client.0.smithi148.stdout:1/545: dwrite d2/d15/d62/d75/f88 [0,4194304] 0 2024-02-28T16:26:43.624 INFO:tasks.workunit.client.0.smithi148.stdout:5/577: mknod d1/d8/d20/d31/caf 0 2024-02-28T16:26:43.628 INFO:tasks.workunit.client.0.smithi148.stdout:9/715: fsync d7/d1c/d32/d24/dac/fdc 0 2024-02-28T16:26:43.633 INFO:tasks.workunit.client.0.smithi148.stdout:9/716: fdatasync d7/d1c/d1f/d49/f4c 0 2024-02-28T16:26:43.635 INFO:tasks.workunit.client.0.smithi148.stdout:9/717: write d7/d1c/d74/d6b/ddb/ff7 [170928,16693] 0 2024-02-28T16:26:43.638 INFO:tasks.workunit.client.0.smithi148.stdout:9/718: dread - d7/d1c/d1f/d49/d6a/f9f zero size 2024-02-28T16:26:43.638 INFO:tasks.workunit.client.0.smithi148.stdout:8/599: mkdir d1/d3/d18/d48/d70/d75/d91/dcc 0 2024-02-28T16:26:43.641 INFO:tasks.workunit.client.0.smithi148.stdout:9/719: chown d7/d1c/d1f/d49/d5c/l79 216 1 2024-02-28T16:26:43.642 INFO:tasks.workunit.client.0.smithi148.stdout:3/684: creat d1/db/d35/d52/fc3 x:0 0 0 2024-02-28T16:26:43.643 INFO:tasks.workunit.client.0.smithi148.stdout:8/600: dread - d1/d3/d18/d48/d70/d75/d84/fb7 zero size 2024-02-28T16:26:43.647 INFO:tasks.workunit.client.0.smithi148.stdout:3/685: chown d1/d13/d19/d56/d5b 171 1 2024-02-28T16:26:43.647 INFO:tasks.workunit.client.0.smithi148.stdout:6/553: mkdir d0/d4/d1b/d71/db4 0 2024-02-28T16:26:43.653 INFO:tasks.workunit.client.0.smithi148.stdout:8/601: stat d1/d3/d18/d48/d70/d75/f81 0 2024-02-28T16:26:43.656 INFO:tasks.workunit.client.0.smithi148.stdout:1/546: mkdir d2/d15/d83/d89/daa 0 2024-02-28T16:26:43.659 INFO:tasks.workunit.client.0.smithi148.stdout:2/544: rename d0/d1d/l2a to d0/d1d/d52/la5 0 2024-02-28T16:26:43.664 INFO:tasks.workunit.client.0.smithi148.stdout:8/602: mknod d1/dd/d13/d1a/d25/d50/ccd 0 2024-02-28T16:26:43.671 INFO:tasks.workunit.client.0.smithi148.stdout:0/712: dwrite d1/d15/d8/f52 [0,4194304] 0 2024-02-28T16:26:43.671 INFO:tasks.workunit.client.0.smithi148.stdout:8/603: write d1/d3/d18/d48/d70/f8c [267633,126026] 0 2024-02-28T16:26:43.678 INFO:tasks.workunit.client.0.smithi148.stdout:2/545: unlink d0/d18/d89/c95 0 2024-02-28T16:26:43.678 INFO:tasks.workunit.client.0.smithi148.stdout:6/554: getdents d0/d22/d25 0 2024-02-28T16:26:43.681 INFO:tasks.workunit.client.0.smithi148.stdout:9/720: dwrite d7/d1c/d32/d24/dac/fbe [0,4194304] 0 2024-02-28T16:26:43.681 INFO:tasks.workunit.client.0.smithi148.stdout:7/617: truncate d0/f76 3912956 0 2024-02-28T16:26:43.683 INFO:tasks.workunit.client.0.smithi148.stdout:2/546: fdatasync d0/d18/d89/f98 0 2024-02-28T16:26:43.703 INFO:tasks.workunit.client.0.smithi148.stdout:5/578: truncate d1/d44/f59 3256172 0 2024-02-28T16:26:43.705 INFO:tasks.workunit.client.0.smithi148.stdout:2/547: unlink d0/d1c/d85/d8b/d8f/d9d/c57 0 2024-02-28T16:26:43.708 INFO:tasks.workunit.client.0.smithi148.stdout:0/713: dread d1/d15/d27/d34/d5a/d9d/d5f/fa0 [0,4194304] 0 2024-02-28T16:26:43.709 INFO:tasks.workunit.client.0.smithi148.stdout:6/555: creat d0/d22/d49/d88/d97/fb5 x:0 0 0 2024-02-28T16:26:43.710 INFO:tasks.workunit.client.0.smithi148.stdout:3/686: truncate d1/d13/d19/d32/d41/fab 2363594 0 2024-02-28T16:26:43.713 INFO:tasks.workunit.client.0.smithi148.stdout:2/548: chown d0/d1d/d52/da3 7 1 2024-02-28T16:26:43.720 INFO:tasks.workunit.client.0.smithi148.stdout:8/604: dwrite d1/d3/d18/d5a/d60/f8f [0,4194304] 0 2024-02-28T16:26:43.720 INFO:tasks.workunit.client.0.smithi148.stdout:0/714: chown d1/d15/d27/d34/d5a/d71/d74/d7e/da4/dc9/cd9 21 1 2024-02-28T16:26:43.729 INFO:tasks.workunit.client.0.smithi148.stdout:4/517: dwrite d8/d21/f56 [0,4194304] 0 2024-02-28T16:26:43.729 INFO:tasks.workunit.client.0.smithi148.stdout:7/618: dread d0/d9/d25/d47/f27 [0,4194304] 0 2024-02-28T16:26:43.732 INFO:tasks.workunit.client.0.smithi148.stdout:5/579: rename d1/db/d60/d7a/c8c to d1/db/d60/cb0 0 2024-02-28T16:26:43.733 INFO:tasks.workunit.client.0.smithi148.stdout:8/605: chown d1/d3/f20 180 1 2024-02-28T16:26:43.752 INFO:tasks.workunit.client.0.smithi148.stdout:5/580: write d1/db/f49 [1479503,7256] 0 2024-02-28T16:26:43.758 INFO:tasks.workunit.client.0.smithi148.stdout:1/547: dwrite d2/d5/d40/d7/d91/f81 [0,4194304] 0 2024-02-28T16:26:43.761 INFO:tasks.workunit.client.0.smithi148.stdout:6/556: dwrite d0/d8/d21/f8f [0,4194304] 0 2024-02-28T16:26:43.764 INFO:tasks.workunit.client.0.smithi148.stdout:4/518: symlink d8/d21/d3d/d4d/lb1 0 2024-02-28T16:26:43.768 INFO:tasks.workunit.client.0.smithi148.stdout:0/715: fdatasync d1/d15/d27/d34/d5a/dcd/fe5 0 2024-02-28T16:26:43.771 INFO:tasks.workunit.client.0.smithi148.stdout:0/716: fsync d1/d15/d3d/d67/f89 0 2024-02-28T16:26:43.773 INFO:tasks.workunit.client.0.smithi148.stdout:2/549: write d0/f10 [1302179,15885] 0 2024-02-28T16:26:43.777 INFO:tasks.workunit.client.0.smithi148.stdout:7/619: dwrite d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:43.780 INFO:tasks.workunit.client.0.smithi148.stdout:3/687: mkdir d1/d3f/da5/da9/dc4 0 2024-02-28T16:26:43.783 INFO:tasks.workunit.client.0.smithi148.stdout:1/548: dwrite d2/f6c [0,4194304] 0 2024-02-28T16:26:43.786 INFO:tasks.workunit.client.0.smithi148.stdout:3/688: chown d1/d13/d19/d1b/d38/d7c 338 1 2024-02-28T16:26:43.787 INFO:tasks.workunit.client.0.smithi148.stdout:8/606: creat d1/d3/d18/d48/d22/d34/fce x:0 0 0 2024-02-28T16:26:43.792 INFO:tasks.workunit.client.0.smithi148.stdout:8/607: write d1/d3/d18/d48/d22/d55/f6a [9264629,71030] 0 2024-02-28T16:26:43.795 INFO:tasks.workunit.client.0.smithi148.stdout:6/557: write d0/d4/d14/d59/f94 [4109241,110920] 0 2024-02-28T16:26:43.796 INFO:tasks.workunit.client.0.smithi148.stdout:8/608: chown d1/dd/d51/d77/l78 744 1 2024-02-28T16:26:43.797 INFO:tasks.workunit.client.0.smithi148.stdout:4/519: mkdir d8/d37/d91/db2 0 2024-02-28T16:26:43.799 INFO:tasks.workunit.client.0.smithi148.stdout:4/520: fdatasync d8/d21/f54 0 2024-02-28T16:26:43.807 INFO:tasks.workunit.client.0.smithi148.stdout:0/717: rename d1/d15/d27/d34/d5a/d71/d74 to d1/d15/d27/d7a/dc6/da7/df1 0 2024-02-28T16:26:43.810 INFO:tasks.workunit.client.0.smithi148.stdout:7/620: write d0/d9/d25/d47/d1c/d32/fa0 [1938837,98775] 0 2024-02-28T16:26:43.811 INFO:tasks.workunit.client.0.smithi148.stdout:3/689: dwrite d1/d13/d19/d32/d41/fba [0,4194304] 0 2024-02-28T16:26:43.814 INFO:tasks.workunit.client.0.smithi148.stdout:1/549: creat d2/d5/d40/d7/d91/fab x:0 0 0 2024-02-28T16:26:43.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/550: write d2/d3f/f71 [892654,41639] 0 2024-02-28T16:26:43.819 INFO:tasks.workunit.client.0.smithi148.stdout:1/551: chown d2/d5/d40/d7/fa4 3224 1 2024-02-28T16:26:43.820 INFO:tasks.workunit.client.0.smithi148.stdout:6/558: creat d0/d22/d49/d88/d97/fb6 x:0 0 0 2024-02-28T16:26:43.829 INFO:tasks.workunit.client.0.smithi148.stdout:4/521: mknod d8/d37/cb3 0 2024-02-28T16:26:43.835 INFO:tasks.workunit.client.0.smithi148.stdout:7/621: symlink d0/d18/lbc 0 2024-02-28T16:26:43.838 INFO:tasks.workunit.client.0.smithi148.stdout:6/559: chown d0/d8/c1c 940763 1 2024-02-28T16:26:43.839 INFO:tasks.workunit.client.0.smithi148.stdout:1/552: unlink d2/d5/d2b/d4a/f77 0 2024-02-28T16:26:43.843 INFO:tasks.workunit.client.0.smithi148.stdout:2/550: creat d0/d9/fa6 x:0 0 0 2024-02-28T16:26:43.844 INFO:tasks.workunit.client.0.smithi148.stdout:4/522: fdatasync d8/d21/f24 0 2024-02-28T16:26:43.848 INFO:tasks.workunit.client.0.smithi148.stdout:7/622: rename d0/d9/d25/d47/d28/d2b/d3a/d6a/l92 to d0/d9/d25/d47/d28/d2b/d3a/d49/d97/lbd 0 2024-02-28T16:26:43.849 INFO:tasks.workunit.client.0.smithi148.stdout:7/623: fdatasync d0/d9/d25/d47/d28/d2b/d3a/f8b 0 2024-02-28T16:26:43.852 INFO:tasks.workunit.client.0.smithi148.stdout:1/553: creat d2/d3f/fac x:0 0 0 2024-02-28T16:26:43.853 INFO:tasks.workunit.client.0.smithi148.stdout:8/609: creat d1/dd/d13/d1a/fcf x:0 0 0 2024-02-28T16:26:43.854 INFO:tasks.workunit.client.0.smithi148.stdout:2/551: mknod d0/d18/d20/d73/ca7 0 2024-02-28T16:26:43.856 INFO:tasks.workunit.client.0.smithi148.stdout:0/718: creat d1/ff2 x:0 0 0 2024-02-28T16:26:43.857 INFO:tasks.workunit.client.0.smithi148.stdout:4/523: mknod d8/df/d17/cb4 0 2024-02-28T16:26:43.863 INFO:tasks.workunit.client.0.smithi148.stdout:7/624: rename d0/d9/d25/f42 to d0/d9/d25/d47/d28/d2b/d3a/d6a/fbe 0 2024-02-28T16:26:43.865 INFO:tasks.workunit.client.0.smithi148.stdout:2/552: symlink d0/d1d/d52/d84/la8 0 2024-02-28T16:26:43.868 INFO:tasks.workunit.client.0.smithi148.stdout:7/625: fdatasync d0/d9/d25/d47/d28/d2b/d3a/d49/f6d 0 2024-02-28T16:26:43.869 INFO:tasks.workunit.client.0.smithi148.stdout:4/524: rmdir d8/df/d17 39 2024-02-28T16:26:43.870 INFO:tasks.workunit.client.0.smithi148.stdout:8/610: dwrite d1/d3/d18/d48/d70/f88 [0,4194304] 0 2024-02-28T16:26:43.876 INFO:tasks.workunit.client.0.smithi148.stdout:0/719: mkdir d1/df3 0 2024-02-28T16:26:43.880 INFO:tasks.workunit.client.0.smithi148.stdout:2/553: creat d0/d1c/d85/d8b/d8f/fa9 x:0 0 0 2024-02-28T16:26:43.882 INFO:tasks.workunit.client.0.smithi148.stdout:7/626: mkdir d0/d9/d25/d47/d1c/dbf 0 2024-02-28T16:26:43.883 INFO:tasks.workunit.client.0.smithi148.stdout:6/560: getdents d0/d8/d21/d9d 0 2024-02-28T16:26:43.885 INFO:tasks.workunit.client.0.smithi148.stdout:4/525: creat d8/df/d5f/fb5 x:0 0 0 2024-02-28T16:26:43.887 INFO:tasks.workunit.client.0.smithi148.stdout:8/611: write d1/dd/d13/d23/f9e [1624175,108723] 0 2024-02-28T16:26:43.888 INFO:tasks.workunit.client.0.smithi148.stdout:0/720: creat d1/d15/d27/d34/d5a/d9d/d5f/ff4 x:0 0 0 2024-02-28T16:26:43.888 INFO:tasks.workunit.client.0.smithi148.stdout:4/526: write d8/d21/d3d/f88 [199351,81362] 0 2024-02-28T16:26:43.890 INFO:tasks.workunit.client.0.smithi148.stdout:7/627: mkdir d0/d4/d70/da5/dc0 0 2024-02-28T16:26:43.893 INFO:tasks.workunit.client.0.smithi148.stdout:7/628: write d0/d9/d25/fa6 [37877,51665] 0 2024-02-28T16:26:43.895 INFO:tasks.workunit.client.0.smithi148.stdout:4/527: fdatasync d8/f12 0 2024-02-28T16:26:43.897 INFO:tasks.workunit.client.0.smithi148.stdout:6/561: fsync d0/d22/d27/d66/fb1 0 2024-02-28T16:26:43.898 INFO:tasks.workunit.client.0.smithi148.stdout:0/721: truncate d1/d15/d27/d34/d5a/dcd/fe5 1365001 0 2024-02-28T16:26:43.899 INFO:tasks.workunit.client.0.smithi148.stdout:4/528: truncate d8/d40/d73/f96 115709 0 2024-02-28T16:26:43.952 INFO:tasks.workunit.client.0.smithi148.stdout:0/722: fsync d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f50 0 2024-02-28T16:26:43.954 INFO:tasks.workunit.client.0.smithi148.stdout:7/629: rename d0/d9/d25/d47/d28/d2b/d6f/fbb to d0/d4/d70/da5/fc1 0 2024-02-28T16:26:43.956 INFO:tasks.workunit.client.0.smithi148.stdout:2/554: dread d0/d1c/d85/d8b/d8f/d9d/f31 [0,4194304] 0 2024-02-28T16:26:43.957 INFO:tasks.workunit.client.0.smithi148.stdout:6/562: mknod d0/d4/d14/cb7 0 2024-02-28T16:26:43.959 INFO:tasks.workunit.client.0.smithi148.stdout:7/630: write d0/d9/d46/f6e [1119156,7257] 0 2024-02-28T16:26:43.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/612: creat d1/fd0 x:0 0 0 2024-02-28T16:26:43.963 INFO:tasks.workunit.client.0.smithi148.stdout:1/554: dwrite d2/d15/f35 [0,4194304] 0 2024-02-28T16:26:43.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/631: chown d0/d9/d25/d47/f27 10551742 1 2024-02-28T16:26:43.968 INFO:tasks.workunit.client.0.smithi148.stdout:8/613: chown d1/d3/d18/d5a/dbf/cc8 3 1 2024-02-28T16:26:43.973 INFO:tasks.workunit.client.0.smithi148.stdout:1/555: read d2/d5/d40/d7/f47 [1000401,90045] 0 2024-02-28T16:26:43.975 INFO:tasks.workunit.client.0.smithi148.stdout:1/556: stat d2/d5/c39 0 2024-02-28T16:26:43.976 INFO:tasks.workunit.client.0.smithi148.stdout:2/555: write d0/d18/d9a/f87 [976885,88036] 0 2024-02-28T16:26:43.977 INFO:tasks.workunit.client.0.smithi148.stdout:2/556: readlink d0/d1c/d6e/l71 0 2024-02-28T16:26:43.979 INFO:tasks.workunit.client.0.smithi148.stdout:7/632: creat d0/d9/d25/d39/fc2 x:0 0 0 2024-02-28T16:26:43.980 INFO:tasks.workunit.client.0.smithi148.stdout:2/557: chown d0/d18/c1a 87821 1 2024-02-28T16:26:44.010 INFO:tasks.workunit.client.0.smithi148.stdout:6/563: dread d0/d8/f67 [0,4194304] 0 2024-02-28T16:26:44.031 INFO:tasks.workunit.client.0.smithi148.stdout:6/564: dwrite d0/d22/d49/f6b [4194304,4194304] 0 2024-02-28T16:26:44.041 INFO:tasks.workunit.client.0.smithi148.stdout:4/529: link d8/l16 d8/d71/lb6 0 2024-02-28T16:26:44.045 INFO:tasks.workunit.client.0.smithi148.stdout:4/530: write d8/d21/d3d/d8c/db0/f92 [2948926,44470] 0 2024-02-28T16:26:44.048 INFO:tasks.workunit.client.0.smithi148.stdout:2/558: symlink d0/d1c/d85/d8b/laa 0 2024-02-28T16:26:44.057 INFO:tasks.workunit.client.0.smithi148.stdout:4/531: mknod d8/d37/d98/cb7 0 2024-02-28T16:26:44.066 INFO:tasks.workunit.client.0.smithi148.stdout:0/723: dwrite d1/d8a/f97 [0,4194304] 0 2024-02-28T16:26:44.069 INFO:tasks.workunit.client.0.smithi148.stdout:0/724: truncate d1/d15/f2a 4987082 0 2024-02-28T16:26:44.071 INFO:tasks.workunit.client.0.smithi148.stdout:4/532: mknod d8/d71/d85/cb8 0 2024-02-28T16:26:44.073 INFO:tasks.workunit.client.0.smithi148.stdout:4/533: chown d8/d37/l76 215962 1 2024-02-28T16:26:44.094 INFO:tasks.workunit.client.0.smithi148.stdout:6/565: dread d0/f16 [0,4194304] 0 2024-02-28T16:26:44.107 INFO:tasks.workunit.client.0.smithi148.stdout:1/557: rename d2/d5/d2b/d4a to d2/d5/d2b/da7/dad 0 2024-02-28T16:26:44.111 INFO:tasks.workunit.client.0.smithi148.stdout:1/558: fsync d2/d5/d40/d7/f6e 0 2024-02-28T16:26:44.113 INFO:tasks.workunit.client.0.smithi148.stdout:1/559: fdatasync d2/d9c/fa8 0 2024-02-28T16:26:44.117 INFO:tasks.workunit.client.0.smithi148.stdout:6/566: dwrite d0/d4/d14/d8a/fab [0,4194304] 0 2024-02-28T16:26:44.123 INFO:tasks.workunit.client.0.smithi148.stdout:4/534: rename d8/d37/d98/lac to d8/d40/lb9 0 2024-02-28T16:26:44.125 INFO:tasks.workunit.client.0.smithi148.stdout:4/535: rename d8/d37/d91 to d8/d37/d91/dba 22 2024-02-28T16:26:44.125 INFO:tasks.workunit.client.0.smithi148.stdout:1/560: fdatasync d2/d5/d40/f53 0 2024-02-28T16:26:44.129 INFO:tasks.workunit.client.0.smithi148.stdout:2/559: unlink d0/d9/c6c 0 2024-02-28T16:26:44.135 INFO:tasks.workunit.client.0.smithi148.stdout:7/633: creat d0/d9/d25/d47/d28/d2b/d3a/fc3 x:0 0 0 2024-02-28T16:26:44.138 INFO:tasks.workunit.client.0.smithi148.stdout:1/561: creat d2/d5/d40/d7/fae x:0 0 0 2024-02-28T16:26:44.140 INFO:tasks.workunit.client.0.smithi148.stdout:2/560: creat d0/dd/fab x:0 0 0 2024-02-28T16:26:44.146 INFO:tasks.workunit.client.0.smithi148.stdout:6/567: getdents d0/d4/d1b/d71 0 2024-02-28T16:26:44.147 INFO:tasks.workunit.client.0.smithi148.stdout:2/561: fsync d0/d1c/d85/d8b/d8f/d9d/f31 0 2024-02-28T16:26:44.155 INFO:tasks.workunit.client.0.smithi148.stdout:1/562: fdatasync d2/d3f/d46/f9f 0 2024-02-28T16:26:44.161 INFO:tasks.workunit.client.0.smithi148.stdout:6/568: dread d0/d22/d25/f4b [0,4194304] 0 2024-02-28T16:26:44.166 INFO:tasks.workunit.client.0.smithi148.stdout:2/562: dwrite d0/d18/f8e [0,4194304] 0 2024-02-28T16:26:44.168 INFO:tasks.workunit.client.0.smithi148.stdout:2/563: stat d0/d18/d20/d46/f53 0 2024-02-28T16:26:44.170 INFO:tasks.workunit.client.0.smithi148.stdout:1/563: chown d2/d5/d40/f16 103327 1 2024-02-28T16:26:44.171 INFO:tasks.workunit.client.0.smithi148.stdout:2/564: write d0/d18/f19 [581001,14370] 0 2024-02-28T16:26:44.172 INFO:tasks.workunit.client.0.smithi148.stdout:7/634: getdents d0/d18 0 2024-02-28T16:26:44.174 INFO:tasks.workunit.client.0.smithi148.stdout:6/569: creat d0/d4/d14/d8a/fb8 x:0 0 0 2024-02-28T16:26:44.175 INFO:tasks.workunit.client.0.smithi148.stdout:1/564: truncate d2/d15/f35 4971817 0 2024-02-28T16:26:44.179 INFO:tasks.workunit.client.0.smithi148.stdout:1/565: write d2/d3f/fac [626017,81702] 0 2024-02-28T16:26:44.191 INFO:tasks.workunit.client.0.smithi148.stdout:1/566: creat d2/d5/d40/d7/d99/faf x:0 0 0 2024-02-28T16:26:44.193 INFO:tasks.workunit.client.0.smithi148.stdout:1/567: chown d2/d5/l7c 104543383 1 2024-02-28T16:26:44.197 INFO:tasks.workunit.client.0.smithi148.stdout:0/725: dwrite d1/d15/d8/f1d [0,4194304] 0 2024-02-28T16:26:44.198 INFO:tasks.workunit.client.0.smithi148.stdout:2/565: symlink d0/lac 0 2024-02-28T16:26:44.200 INFO:tasks.workunit.client.0.smithi148.stdout:2/566: write d0/d1c/f1f [854954,37556] 0 2024-02-28T16:26:44.200 INFO:tasks.workunit.client.0.smithi148.stdout:1/568: mkdir d2/d15/d8b/db0 0 2024-02-28T16:26:44.201 INFO:tasks.workunit.client.0.smithi148.stdout:8/614: creat d1/d3/d18/d48/fd1 x:0 0 0 2024-02-28T16:26:44.203 INFO:tasks.workunit.client.0.smithi148.stdout:0/726: truncate d1/d15/d27/d34/fe9 918826 0 2024-02-28T16:26:44.207 INFO:tasks.workunit.client.0.smithi148.stdout:8/615: chown d1/d3/d18/d5a/d60/f82 440033008 1 2024-02-28T16:26:44.208 INFO:tasks.workunit.client.0.smithi148.stdout:2/567: unlink d0/d18/c1a 0 2024-02-28T16:26:44.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/569: mkdir d2/d15/d83/d89/daa/db1 0 2024-02-28T16:26:44.211 INFO:tasks.workunit.client.0.smithi148.stdout:8/616: write d1/f27 [927611,2619] 0 2024-02-28T16:26:44.213 INFO:tasks.workunit.client.0.smithi148.stdout:2/568: mknod d0/d1d/d55/cad 0 2024-02-28T16:26:44.215 INFO:tasks.workunit.client.0.smithi148.stdout:2/569: dread - d0/d1c/d49/f9b zero size 2024-02-28T16:26:44.217 INFO:tasks.workunit.client.0.smithi148.stdout:1/570: rename d2/d5/d40/d7/f47 to d2/d3f/fb2 0 2024-02-28T16:26:44.225 INFO:tasks.workunit.client.0.smithi148.stdout:1/571: symlink d2/d15/d83/d89/daa/lb3 0 2024-02-28T16:26:44.227 INFO:tasks.workunit.client.0.smithi148.stdout:8/617: truncate d1/d3/d18/d48/d70/d75/d84/fb2 2334399 0 2024-02-28T16:26:44.233 INFO:tasks.workunit.client.0.smithi148.stdout:1/572: creat d2/d15/d8b/da3/fb4 x:0 0 0 2024-02-28T16:26:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:43 smithi157 ceph-mon[38346]: pgmap v46: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 43 MiB/s rd, 184 MiB/s wr, 403 op/s 2024-02-28T16:26:44.239 INFO:tasks.workunit.client.0.smithi148.stdout:4/536: write d8/df/d17/d6a/f9d [417612,116499] 0 2024-02-28T16:26:44.240 INFO:tasks.workunit.client.0.smithi148.stdout:2/570: dwrite d0/d18/d9a/f63 [0,4194304] 0 2024-02-28T16:26:44.244 INFO:tasks.workunit.client.0.smithi148.stdout:0/727: dread d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/fc8 [0,4194304] 0 2024-02-28T16:26:44.247 INFO:tasks.workunit.client.0.smithi148.stdout:9/721: sync 2024-02-28T16:26:44.248 INFO:tasks.workunit.client.0.smithi148.stdout:9/722: chown d7/d1c/d74/d68 8124 1 2024-02-28T16:26:44.254 INFO:tasks.workunit.client.0.smithi148.stdout:6/570: write d0/f6e [538420,47288] 0 2024-02-28T16:26:44.255 INFO:tasks.workunit.client.0.smithi148.stdout:6/571: chown d0/d4/d1b/d71/db4 0 1 2024-02-28T16:26:44.256 INFO:tasks.workunit.client.0.smithi148.stdout:7/635: write d0/d9/d25/d47/d1c/f23 [2823201,12663] 0 2024-02-28T16:26:44.260 INFO:tasks.workunit.client.0.smithi148.stdout:1/573: fsync d2/d5/d40/d7/fa4 0 2024-02-28T16:26:44.264 INFO:tasks.workunit.client.0.smithi148.stdout:9/723: fsync d7/d1c/f75 0 2024-02-28T16:26:44.267 INFO:tasks.workunit.client.0.smithi148.stdout:9/724: truncate d7/d1c/d32/d24/dac/fdc 229313 0 2024-02-28T16:26:44.272 INFO:tasks.workunit.client.0.smithi148.stdout:0/728: creat d1/d15/ff5 x:0 0 0 2024-02-28T16:26:44.277 INFO:tasks.workunit.client.0.smithi148.stdout:9/725: link d7/d1c/l31 d7/d1c/lfc 0 2024-02-28T16:26:44.282 INFO:tasks.workunit.client.0.smithi148.stdout:0/729: creat d1/d15/d3d/d67/daf/ddc/ff6 x:0 0 0 2024-02-28T16:26:44.284 INFO:tasks.workunit.client.0.smithi148.stdout:9/726: creat d7/d43/de0/ffd x:0 0 0 2024-02-28T16:26:44.286 INFO:tasks.workunit.client.0.smithi148.stdout:8/618: write d1/d3/d18/d48/d70/f72 [904605,25852] 0 2024-02-28T16:26:44.289 INFO:tasks.workunit.client.0.smithi148.stdout:0/730: fdatasync d1/d15/d27/d34/d5a/d9d/d4a/fda 0 2024-02-28T16:26:44.289 INFO:tasks.workunit.client.0.smithi148.stdout:1/574: dread d2/d5/d2b/da7/dad/f7b [0,4194304] 0 2024-02-28T16:26:44.290 INFO:tasks.workunit.client.0.smithi148.stdout:9/727: fsync d7/d1c/d32/d24/d78/f8c 0 2024-02-28T16:26:44.291 INFO:tasks.workunit.client.0.smithi148.stdout:4/537: dread d8/df/d17/f1d [0,4194304] 0 2024-02-28T16:26:44.293 INFO:tasks.workunit.client.0.smithi148.stdout:2/571: write d0/d9/d13/f16 [1792655,34167] 0 2024-02-28T16:26:44.296 INFO:tasks.workunit.client.0.smithi148.stdout:9/728: chown d7/d1c/d1f/d49/d6a/c76 7 1 2024-02-28T16:26:44.298 INFO:tasks.workunit.client.0.smithi148.stdout:8/619: creat d1/d3/d18/d48/d70/d75/d91/dcc/fd2 x:0 0 0 2024-02-28T16:26:44.299 INFO:tasks.workunit.client.0.smithi148.stdout:1/575: write d2/d5/d40/d7/d91/f42 [249539,94400] 0 2024-02-28T16:26:44.300 INFO:tasks.workunit.client.0.smithi148.stdout:4/538: creat d8/d21/d7e/fbb x:0 0 0 2024-02-28T16:26:44.302 INFO:tasks.workunit.client.0.smithi148.stdout:2/572: creat d0/d9/d13/d38/d3a/fae x:0 0 0 2024-02-28T16:26:44.305 INFO:tasks.workunit.client.0.smithi148.stdout:2/573: stat d0/lac 0 2024-02-28T16:26:44.306 INFO:tasks.workunit.client.0.smithi148.stdout:6/572: dread d0/d22/d27/f62 [0,4194304] 0 2024-02-28T16:26:44.309 INFO:tasks.workunit.client.0.smithi148.stdout:8/620: dread d1/dd/d13/d24/d3a/d49/f9f [0,4194304] 0 2024-02-28T16:26:44.313 INFO:tasks.workunit.client.0.smithi148.stdout:0/731: dwrite d1/d15/d3d/d67/f89 [0,4194304] 0 2024-02-28T16:26:44.316 INFO:tasks.workunit.client.0.smithi148.stdout:9/729: dwrite d7/d1c/d1f/d49/d6a/f9f [0,4194304] 0 2024-02-28T16:26:44.317 INFO:tasks.workunit.client.0.smithi148.stdout:0/732: chown d1/d15/d27/d7a/dc6/da7/df1/d7e/cea 21051690 1 2024-02-28T16:26:44.317 INFO:tasks.workunit.client.0.smithi148.stdout:4/539: unlink d8/d21/d3d/d4d/lb1 0 2024-02-28T16:26:44.318 INFO:tasks.workunit.client.0.smithi148.stdout:0/733: chown l0 255115190 1 2024-02-28T16:26:44.324 INFO:tasks.workunit.client.0.smithi148.stdout:8/621: rename d1/f27 to d1/dd/d51/d9b/fd3 0 2024-02-28T16:26:44.326 INFO:tasks.workunit.client.0.smithi148.stdout:9/730: symlink d7/d1c/d1f/d49/dae/dc9/lfe 0 2024-02-28T16:26:44.326 INFO:tasks.workunit.client.0.smithi148.stdout:8/622: readlink d1/d3/l8e 0 2024-02-28T16:26:44.331 INFO:tasks.workunit.client.0.smithi148.stdout:2/574: truncate d0/f27 2300628 0 2024-02-28T16:26:44.331 INFO:tasks.workunit.client.0.smithi148.stdout:4/540: write d8/d21/f30 [788134,4716] 0 2024-02-28T16:26:44.334 INFO:tasks.workunit.client.0.smithi148.stdout:8/623: truncate d1/dd/d13/d1a/d25/da3/fac 9739 0 2024-02-28T16:26:44.335 INFO:tasks.workunit.client.0.smithi148.stdout:0/734: truncate d1/d15/d27/d34/fba 5241432 0 2024-02-28T16:26:44.339 INFO:tasks.workunit.client.0.smithi148.stdout:6/573: getdents d0/d4/d1b 0 2024-02-28T16:26:44.343 INFO:tasks.workunit.client.0.smithi148.stdout:3/690: sync 2024-02-28T16:26:44.343 INFO:tasks.workunit.client.0.smithi148.stdout:5/581: sync 2024-02-28T16:26:44.343 INFO:tasks.workunit.client.0.smithi148.stdout:9/731: mknod d7/d1c/cff 0 2024-02-28T16:26:44.344 INFO:tasks.workunit.client.0.smithi148.stdout:1/576: dwrite d2/d5/d40/d7/d91/f8a [4194304,4194304] 0 2024-02-28T16:26:44.345 INFO:tasks.workunit.client.0.smithi148.stdout:6/574: fdatasync d0/d22/d25/f36 0 2024-02-28T16:26:44.345 INFO:tasks.workunit.client.0.smithi148.stdout:2/575: truncate d0/d9/d13/d38/d3a/fae 719834 0 2024-02-28T16:26:44.346 INFO:tasks.workunit.client.0.smithi148.stdout:0/735: mkdir d1/d15/d27/d34/d5a/d9d/dc7/df7 0 2024-02-28T16:26:44.348 INFO:tasks.workunit.client.0.smithi148.stdout:5/582: symlink d1/d44/d64/lb1 0 2024-02-28T16:26:44.348 INFO:tasks.workunit.client.0.smithi148.stdout:2/576: read d0/d18/f8e [532299,44132] 0 2024-02-28T16:26:44.349 INFO:tasks.workunit.client.0.smithi148.stdout:3/691: chown d1/db/d35/d70/l86 0 1 2024-02-28T16:26:44.351 INFO:tasks.workunit.client.0.smithi148.stdout:5/583: chown d1/d8 0 1 2024-02-28T16:26:44.354 INFO:tasks.workunit.client.0.smithi148.stdout:0/736: rename d1/d15/d27/d34/d5a/d9d to d1/d15/d27/d34/d5a/d9d/df8 22 2024-02-28T16:26:44.356 INFO:tasks.workunit.client.0.smithi148.stdout:6/575: creat d0/d22/d25/d76/fb9 x:0 0 0 2024-02-28T16:26:44.356 INFO:tasks.workunit.client.0.smithi148.stdout:1/577: write d2/d5/d40/d7/d91/f67 [1033489,46137] 0 2024-02-28T16:26:44.357 INFO:tasks.workunit.client.0.smithi148.stdout:9/732: mkdir d7/d1c/d1f/d49/dae/dc9/d100 0 2024-02-28T16:26:44.358 INFO:tasks.workunit.client.0.smithi148.stdout:5/584: dread d1/d8/d20/d4e/d71/f91 [0,4194304] 0 2024-02-28T16:26:44.368 INFO:tasks.workunit.client.0.smithi148.stdout:0/737: write d1/d8a/fce [82047,108589] 0 2024-02-28T16:26:44.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/576: readlink d0/d22/d27/l39 0 2024-02-28T16:26:44.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:43 smithi148 ceph-mon[28767]: pgmap v46: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 43 MiB/s rd, 184 MiB/s wr, 403 op/s 2024-02-28T16:26:44.374 INFO:tasks.workunit.client.0.smithi148.stdout:0/738: fsync d1/d15/d27/d7a/dc6/da7/df1/fd4 0 2024-02-28T16:26:44.377 INFO:tasks.workunit.client.0.smithi148.stdout:0/739: chown d1/d8a/faa 620 1 2024-02-28T16:26:44.385 INFO:tasks.workunit.client.0.smithi148.stdout:5/585: dwrite d1/f6f [0,4194304] 0 2024-02-28T16:26:44.386 INFO:tasks.workunit.client.0.smithi148.stdout:0/740: write d1/d15/d27/d34/d5a/d9d/d5f/fd6 [658501,113319] 0 2024-02-28T16:26:44.396 INFO:tasks.workunit.client.0.smithi148.stdout:3/692: dwrite d1/d13/d19/d56/f73 [0,4194304] 0 2024-02-28T16:26:44.400 INFO:tasks.workunit.client.0.smithi148.stdout:5/586: mkdir d1/db/d60/d7a/db2 0 2024-02-28T16:26:44.402 INFO:tasks.workunit.client.0.smithi148.stdout:3/693: rmdir d1/d3f 39 2024-02-28T16:26:44.410 INFO:tasks.workunit.client.0.smithi148.stdout:2/577: dwrite d0/f27 [0,4194304] 0 2024-02-28T16:26:44.412 INFO:tasks.workunit.client.0.smithi148.stdout:1/578: dread d2/d5/d40/d8/f21 [8388608,4194304] 0 2024-02-28T16:26:44.419 INFO:tasks.workunit.client.0.smithi148.stdout:6/577: dread d0/d22/d25/d76/d7f/f5c [0,4194304] 0 2024-02-28T16:26:44.420 INFO:tasks.workunit.client.0.smithi148.stdout:1/579: symlink d2/d15/d33/lb5 0 2024-02-28T16:26:44.423 INFO:tasks.workunit.client.0.smithi148.stdout:8/624: dread d1/dd/d13/d24/d3a/f69 [0,4194304] 0 2024-02-28T16:26:44.426 INFO:tasks.workunit.client.0.smithi148.stdout:3/694: link d1/d13/d19/d1b/d38/f43 d1/d13/d19/d94/fc5 0 2024-02-28T16:26:44.426 INFO:tasks.workunit.client.0.smithi148.stdout:0/741: dwrite d1/d15/d27/d34/d5a/d9d/d4a/d92/fa8 [0,4194304] 0 2024-02-28T16:26:44.427 INFO:tasks.workunit.client.0.smithi148.stdout:2/578: creat d0/d1d/d52/d9c/faf x:0 0 0 2024-02-28T16:26:44.433 INFO:tasks.workunit.client.0.smithi148.stdout:1/580: creat d2/d5/d40/d7/fb6 x:0 0 0 2024-02-28T16:26:44.434 INFO:tasks.workunit.client.0.smithi148.stdout:3/695: chown d1/d13/d19/d1b/d38/fa4 5362991 1 2024-02-28T16:26:44.439 INFO:tasks.workunit.client.0.smithi148.stdout:1/581: creat d2/d15/d62/fb7 x:0 0 0 2024-02-28T16:26:44.445 INFO:tasks.workunit.client.0.smithi148.stdout:8/625: rename d1/dd/d13/d1a/d25/cbb to d1/dd/d13/d24/d3a/cd4 0 2024-02-28T16:26:44.452 INFO:tasks.workunit.client.0.smithi148.stdout:5/587: dwrite d1/db/d25/f3a [0,4194304] 0 2024-02-28T16:26:44.454 INFO:tasks.workunit.client.0.smithi148.stdout:6/578: write d0/d10/f6f [456962,34917] 0 2024-02-28T16:26:44.454 INFO:tasks.workunit.client.0.smithi148.stdout:2/579: write d0/d1c/f5f [1365670,16900] 0 2024-02-28T16:26:44.456 INFO:tasks.workunit.client.0.smithi148.stdout:8/626: mknod d1/d3/d9a/cd5 0 2024-02-28T16:26:44.460 INFO:tasks.workunit.client.0.smithi148.stdout:8/627: stat d1/d3/c11 0 2024-02-28T16:26:44.460 INFO:tasks.workunit.client.0.smithi148.stdout:1/582: rename d2/d15/d33/l57 to d2/d5/d40/lb8 0 2024-02-28T16:26:44.465 INFO:tasks.workunit.client.0.smithi148.stdout:0/742: truncate d1/d15/d27/d34/d5a/d9d/d4a/d92/fa8 2799443 0 2024-02-28T16:26:44.468 INFO:tasks.workunit.client.0.smithi148.stdout:8/628: unlink d1/d3/d18/f5d 0 2024-02-28T16:26:44.471 INFO:tasks.workunit.client.0.smithi148.stdout:6/579: rmdir d0/d8/d21/d9d/d9e 0 2024-02-28T16:26:44.471 INFO:tasks.workunit.client.0.smithi148.stdout:3/696: dwrite d1/d13/f69 [0,4194304] 0 2024-02-28T16:26:44.476 INFO:tasks.workunit.client.0.smithi148.stdout:0/743: readlink d1/d15/d27/d7a/l51 0 2024-02-28T16:26:44.477 INFO:tasks.workunit.client.0.smithi148.stdout:2/580: link d0/d18/d20/l3f d0/d9/d13/lb0 0 2024-02-28T16:26:44.479 INFO:tasks.workunit.client.0.smithi148.stdout:2/581: read - d0/d9/f9e zero size 2024-02-28T16:26:44.485 INFO:tasks.workunit.client.0.smithi148.stdout:0/744: write d1/d15/d27/d34/f7c [2853574,102963] 0 2024-02-28T16:26:44.490 INFO:tasks.workunit.client.0.smithi148.stdout:5/588: dwrite d1/db/d25/f2e [0,4194304] 0 2024-02-28T16:26:44.496 INFO:tasks.workunit.client.0.smithi148.stdout:1/583: dwrite d2/d5/d40/d7/f6e [0,4194304] 0 2024-02-28T16:26:44.507 INFO:tasks.workunit.client.0.smithi148.stdout:1/584: chown d2/d15/d62/c7f 1013112 1 2024-02-28T16:26:44.507 INFO:tasks.workunit.client.0.smithi148.stdout:5/589: fsync d1/d44/d64/f4c 0 2024-02-28T16:26:44.513 INFO:tasks.workunit.client.0.smithi148.stdout:6/580: dwrite d0/d10/f13 [0,4194304] 0 2024-02-28T16:26:44.515 INFO:tasks.workunit.client.0.smithi148.stdout:1/585: write d2/d5/d40/d7/f6a [885031,118837] 0 2024-02-28T16:26:44.516 INFO:tasks.workunit.client.0.smithi148.stdout:3/697: dread d1/d13/f1e [0,4194304] 0 2024-02-28T16:26:44.522 INFO:tasks.workunit.client.0.smithi148.stdout:8/629: dwrite d1/d3/d18/d48/fd1 [0,4194304] 0 2024-02-28T16:26:44.525 INFO:tasks.workunit.client.0.smithi148.stdout:5/590: mknod d1/db/d60/d7a/d98/cb3 0 2024-02-28T16:26:44.527 INFO:tasks.workunit.client.0.smithi148.stdout:1/586: write d2/d5/d40/d7/d91/f24 [2849061,97165] 0 2024-02-28T16:26:44.530 INFO:tasks.workunit.client.0.smithi148.stdout:8/630: dread - d1/d3/f80 zero size 2024-02-28T16:26:44.533 INFO:tasks.workunit.client.0.smithi148.stdout:2/582: dwrite d0/d1c/d85/d8b/d8f/fa9 [0,4194304] 0 2024-02-28T16:26:44.537 INFO:tasks.workunit.client.0.smithi148.stdout:6/581: rename d0/d4/d1b to d0/d4/dba 0 2024-02-28T16:26:44.540 INFO:tasks.workunit.client.0.smithi148.stdout:2/583: chown d0/d18/d20/d73/c99 8 1 2024-02-28T16:26:44.544 INFO:tasks.workunit.client.0.smithi148.stdout:6/582: write d0/d4/d14/d8a/fb8 [4728,10091] 0 2024-02-28T16:26:44.550 INFO:tasks.workunit.client.0.smithi148.stdout:6/583: truncate d0/d22/d25/d76/fb9 78790 0 2024-02-28T16:26:44.551 INFO:tasks.workunit.client.0.smithi148.stdout:2/584: rename d0/d18/d20/f33 to d0/d9/d13/d38/d3a/fb1 0 2024-02-28T16:26:44.554 INFO:tasks.workunit.client.0.smithi148.stdout:6/584: write d0/d4/dba/fa0 [103035,109353] 0 2024-02-28T16:26:44.559 INFO:tasks.workunit.client.0.smithi148.stdout:2/585: unlink d0/dd/f82 0 2024-02-28T16:26:44.561 INFO:tasks.workunit.client.0.smithi148.stdout:3/698: dread d1/d13/d19/d1b/d38/f43 [0,4194304] 0 2024-02-28T16:26:44.561 INFO:tasks.workunit.client.0.smithi148.stdout:0/745: dread d1/d15/f55 [0,4194304] 0 2024-02-28T16:26:44.563 INFO:tasks.workunit.client.0.smithi148.stdout:3/699: chown d1/d13/d19/d32/d41 726010419 1 2024-02-28T16:26:44.565 INFO:tasks.workunit.client.0.smithi148.stdout:6/585: symlink d0/d22/d25/lbb 0 2024-02-28T16:26:44.566 INFO:tasks.workunit.client.0.smithi148.stdout:2/586: symlink d0/d1d/lb2 0 2024-02-28T16:26:44.571 INFO:tasks.workunit.client.0.smithi148.stdout:2/587: write d0/d1c/f5f [2057488,57133] 0 2024-02-28T16:26:44.572 INFO:tasks.workunit.client.0.smithi148.stdout:6/586: creat d0/d22/d27/d3e/fbc x:0 0 0 2024-02-28T16:26:44.573 INFO:tasks.workunit.client.0.smithi148.stdout:1/587: dwrite d2/d5/d40/d8/f9 [0,4194304] 0 2024-02-28T16:26:44.583 INFO:tasks.workunit.client.0.smithi148.stdout:2/588: rmdir d0/d1d/d52/d9c 39 2024-02-28T16:26:44.585 INFO:tasks.workunit.client.0.smithi148.stdout:8/631: dread d1/d3/f20 [0,4194304] 0 2024-02-28T16:26:44.586 INFO:tasks.workunit.client.0.smithi148.stdout:2/589: readlink d0/d1d/lb2 0 2024-02-28T16:26:44.586 INFO:tasks.workunit.client.0.smithi148.stdout:3/700: dread d1/d13/d19/d1b/f5c [0,4194304] 0 2024-02-28T16:26:44.588 INFO:tasks.workunit.client.0.smithi148.stdout:8/632: fsync d1/dd/d13/d24/fb6 0 2024-02-28T16:26:44.589 INFO:tasks.workunit.client.0.smithi148.stdout:0/746: getdents d1/d15/d27/d7a/dc6/da7/df1/dbc 0 2024-02-28T16:26:44.590 INFO:tasks.workunit.client.0.smithi148.stdout:8/633: readlink d1/d3/l8e 0 2024-02-28T16:26:44.593 INFO:tasks.workunit.client.0.smithi148.stdout:2/590: rename d0/d18/d89 to d0/d9/d13/d38/d3a/db3 0 2024-02-28T16:26:44.595 INFO:tasks.workunit.client.0.smithi148.stdout:0/747: rmdir d1/d15/d27/d34/d5a/d6c 39 2024-02-28T16:26:44.599 INFO:tasks.workunit.client.0.smithi148.stdout:3/701: rmdir d1/d13/d19/d56/d5b/db4 0 2024-02-28T16:26:44.602 INFO:tasks.workunit.client.0.smithi148.stdout:3/702: stat d1/db/d35/f62 0 2024-02-28T16:26:44.613 INFO:tasks.workunit.client.0.smithi148.stdout:0/748: creat d1/d15/d27/d34/ff9 x:0 0 0 2024-02-28T16:26:44.616 INFO:tasks.workunit.client.0.smithi148.stdout:6/587: write d0/d22/d27/d66/d87/f91 [3033948,123128] 0 2024-02-28T16:26:44.622 INFO:tasks.workunit.client.0.smithi148.stdout:8/634: dwrite d1/dd/d13/d1a/d25/d50/fca [0,4194304] 0 2024-02-28T16:26:44.623 INFO:tasks.workunit.client.0.smithi148.stdout:6/588: write d0/d4/d14/d8a/f9c [304602,102950] 0 2024-02-28T16:26:44.625 INFO:tasks.workunit.client.0.smithi148.stdout:0/749: chown d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/l36 945306 1 2024-02-28T16:26:44.628 INFO:tasks.workunit.client.0.smithi148.stdout:1/588: dwrite d2/d15/d62/f7e [0,4194304] 0 2024-02-28T16:26:44.629 INFO:tasks.workunit.client.0.smithi148.stdout:6/589: truncate d0/d4/fa1 508694 0 2024-02-28T16:26:44.630 INFO:tasks.workunit.client.0.smithi148.stdout:1/589: stat d2/f6c 0 2024-02-28T16:26:44.632 INFO:tasks.workunit.client.0.smithi148.stdout:8/635: rename d1/dd/d13/d1a/f3e to d1/dd/d51/d9b/fd6 0 2024-02-28T16:26:44.632 INFO:tasks.workunit.client.0.smithi148.stdout:3/703: dwrite d1/db/f22 [0,4194304] 0 2024-02-28T16:26:44.634 INFO:tasks.workunit.client.0.smithi148.stdout:6/590: write d0/d4/dba/d71/fac [342625,121882] 0 2024-02-28T16:26:44.636 INFO:tasks.workunit.client.0.smithi148.stdout:0/750: rename d1/d15/d27/d7a to d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/dfa 22 2024-02-28T16:26:44.637 INFO:tasks.workunit.client.0.smithi148.stdout:1/590: mknod d2/d15/cb9 0 2024-02-28T16:26:44.639 INFO:tasks.workunit.client.0.smithi148.stdout:6/591: mkdir d0/d22/d27/d66/dbd 0 2024-02-28T16:26:44.642 INFO:tasks.workunit.client.0.smithi148.stdout:2/591: dread d0/d18/d9a/f7b [0,4194304] 0 2024-02-28T16:26:44.643 INFO:tasks.workunit.client.0.smithi148.stdout:2/592: write d0/d9/f9e [431971,105348] 0 2024-02-28T16:26:44.645 INFO:tasks.workunit.client.0.smithi148.stdout:0/751: creat d1/d15/d3d/ffb x:0 0 0 2024-02-28T16:26:44.646 INFO:tasks.workunit.client.0.smithi148.stdout:6/592: symlink d0/d22/d25/d76/lbe 0 2024-02-28T16:26:44.663 INFO:tasks.workunit.client.0.smithi148.stdout:8/636: link d1/d3/d18/d48/d70/d75/d91/fab d1/d3/d18/d48/d70/d75/d84/fd7 0 2024-02-28T16:26:44.663 INFO:tasks.workunit.client.0.smithi148.stdout:6/593: write d0/d4/d14/d59/f75 [4157922,34238] 0 2024-02-28T16:26:44.663 INFO:tasks.workunit.client.0.smithi148.stdout:0/752: symlink d1/d15/d27/d7a/dc6/da7/df1/dbc/lfc 0 2024-02-28T16:26:44.666 INFO:tasks.workunit.client.0.smithi148.stdout:8/637: dread d1/f7 [0,4194304] 0 2024-02-28T16:26:44.670 INFO:tasks.workunit.client.0.smithi148.stdout:0/753: write d1/d15/f55 [2309106,63865] 0 2024-02-28T16:26:44.671 INFO:tasks.workunit.client.0.smithi148.stdout:1/591: dread d2/d5/d40/d8/f10 [0,4194304] 0 2024-02-28T16:26:44.673 INFO:tasks.workunit.client.0.smithi148.stdout:3/704: dwrite d1/db/d35/f62 [0,4194304] 0 2024-02-28T16:26:44.673 INFO:tasks.workunit.client.0.smithi148.stdout:2/593: dread d0/d18/f8e [0,4194304] 0 2024-02-28T16:26:44.678 INFO:tasks.workunit.client.0.smithi148.stdout:0/754: truncate d1/d15/f55 4932324 0 2024-02-28T16:26:44.678 INFO:tasks.workunit.client.0.smithi148.stdout:3/705: dread - d1/d13/d19/d1b/d38/fa4 zero size 2024-02-28T16:26:44.678 INFO:tasks.workunit.client.0.smithi148.stdout:1/592: mkdir d2/d5/d40/d7/dba 0 2024-02-28T16:26:44.682 INFO:tasks.workunit.client.0.smithi148.stdout:1/593: symlink d2/d3f/d46/lbb 0 2024-02-28T16:26:44.689 INFO:tasks.workunit.client.0.smithi148.stdout:1/594: unlink d2/d5/l66 0 2024-02-28T16:26:44.691 INFO:tasks.workunit.client.0.smithi148.stdout:6/594: truncate d0/d22/f37 1469820 0 2024-02-28T16:26:44.693 INFO:tasks.workunit.client.0.smithi148.stdout:0/755: rename d1/d15/d27/d34/d5a/d71/d80/db6/c94 to d1/d15/d27/d7a/dc6/da7/df1/d7e/cfd 0 2024-02-28T16:26:44.694 INFO:tasks.workunit.client.0.smithi148.stdout:1/595: mknod d2/d15/d62/cbc 0 2024-02-28T16:26:44.700 INFO:tasks.workunit.client.0.smithi148.stdout:0/756: unlink d1/d8a/faa 0 2024-02-28T16:26:44.700 INFO:tasks.workunit.client.0.smithi148.stdout:1/596: truncate d2/d5/d40/f80 293244 0 2024-02-28T16:26:44.703 INFO:tasks.workunit.client.0.smithi148.stdout:3/706: write d1/db/fa1 [358875,126072] 0 2024-02-28T16:26:44.705 INFO:tasks.workunit.client.0.smithi148.stdout:8/638: dwrite d1/f7 [0,4194304] 0 2024-02-28T16:26:44.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/597: dread d2/d5/d2b/da7/dad/f7b [0,4194304] 0 2024-02-28T16:26:44.708 INFO:tasks.workunit.client.0.smithi148.stdout:0/757: unlink d1/d15/d27/d34/d5a/dcd/fde 0 2024-02-28T16:26:44.719 INFO:tasks.workunit.client.0.smithi148.stdout:8/639: mknod d1/d3/d18/d5a/dbf/cd8 0 2024-02-28T16:26:44.719 INFO:tasks.workunit.client.0.smithi148.stdout:6/595: write d0/d22/d25/d76/f79 [703820,101642] 0 2024-02-28T16:26:44.724 INFO:tasks.workunit.client.0.smithi148.stdout:6/596: stat d0/d22/c35 0 2024-02-28T16:26:44.725 INFO:tasks.workunit.client.0.smithi148.stdout:6/597: readlink d0/d4/dba/la7 0 2024-02-28T16:26:44.727 INFO:tasks.workunit.client.0.smithi148.stdout:1/598: link d2/d5/d2b/da7/dad/l8d d2/d15/d62/d75/d76/lbd 0 2024-02-28T16:26:44.729 INFO:tasks.workunit.client.0.smithi148.stdout:6/598: dread - d0/d22/d25/d76/d7f/f70 zero size 2024-02-28T16:26:44.729 INFO:tasks.workunit.client.0.smithi148.stdout:1/599: chown d2/d3f/d9d/ca6 52 1 2024-02-28T16:26:44.730 INFO:tasks.workunit.client.0.smithi148.stdout:0/758: rename d1/d15/d27/d34/d5a/d9d/d5f/fd6 to d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/ffe 0 2024-02-28T16:26:44.734 INFO:tasks.workunit.client.0.smithi148.stdout:0/759: stat d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9 0 2024-02-28T16:26:44.736 INFO:tasks.workunit.client.0.smithi148.stdout:8/640: getdents d1/dd/d13/d1a 0 2024-02-28T16:26:44.737 INFO:tasks.workunit.client.0.smithi148.stdout:1/600: creat d2/d15/fbe x:0 0 0 2024-02-28T16:26:44.740 INFO:tasks.workunit.client.0.smithi148.stdout:0/760: stat d1/d15/d27/d7a/fcb 0 2024-02-28T16:26:44.740 INFO:tasks.workunit.client.0.smithi148.stdout:3/707: dwrite d1/d13/d19/d1b/f1f [4194304,4194304] 0 2024-02-28T16:26:44.742 INFO:tasks.workunit.client.0.smithi148.stdout:3/708: readlink d1/d13/d19/l4c 0 2024-02-28T16:26:44.743 INFO:tasks.workunit.client.0.smithi148.stdout:8/641: read d1/d3/d18/d5a/d60/f8f [3413489,92381] 0 2024-02-28T16:26:44.745 INFO:tasks.workunit.client.0.smithi148.stdout:8/642: readlink d1/dd/d13/d68/l63 0 2024-02-28T16:26:44.749 INFO:tasks.workunit.client.0.smithi148.stdout:0/761: symlink d1/d15/d27/d34/d5a/d9d/ddf/lff 0 2024-02-28T16:26:44.749 INFO:tasks.workunit.client.0.smithi148.stdout:3/709: read d1/d13/f17 [6164042,84166] 0 2024-02-28T16:26:44.750 INFO:tasks.workunit.client.0.smithi148.stdout:8/643: truncate d1/d3/d18/d48/d70/f88 4829483 0 2024-02-28T16:26:44.751 INFO:tasks.workunit.client.0.smithi148.stdout:1/601: link d2/d3f/d9d/ca6 d2/d5/d40/d7/d91/cbf 0 2024-02-28T16:26:44.757 INFO:tasks.workunit.client.0.smithi148.stdout:0/762: mknod d1/c100 0 2024-02-28T16:26:44.768 INFO:tasks.workunit.client.0.smithi148.stdout:3/710: getdents d1/db/d35/d70/d8e 0 2024-02-28T16:26:44.768 INFO:tasks.workunit.client.0.smithi148.stdout:1/602: dwrite d2/d9c/fa8 [0,4194304] 0 2024-02-28T16:26:44.773 INFO:tasks.workunit.client.0.smithi148.stdout:8/644: getdents d1/d3/d18/d48/d22/d34 0 2024-02-28T16:26:44.779 INFO:tasks.workunit.client.0.smithi148.stdout:1/603: unlink d2/d15/d33/l44 0 2024-02-28T16:26:44.787 INFO:tasks.workunit.client.0.smithi148.stdout:1/604: creat d2/d5/d40/d7/dba/fc0 x:0 0 0 2024-02-28T16:26:44.788 INFO:tasks.workunit.client.0.smithi148.stdout:0/763: write d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f6a [590214,60363] 0 2024-02-28T16:26:44.792 INFO:tasks.workunit.client.0.smithi148.stdout:1/605: mknod d2/d15/d83/cc1 0 2024-02-28T16:26:44.798 INFO:tasks.workunit.client.0.smithi148.stdout:8/645: dwrite d1/dd/d13/d1a/d25/fa6 [0,4194304] 0 2024-02-28T16:26:44.799 INFO:tasks.workunit.client.0.smithi148.stdout:1/606: write d2/d5/d2b/da7/dad/f7b [271992,77171] 0 2024-02-28T16:26:44.815 INFO:tasks.workunit.client.0.smithi148.stdout:1/607: dread d2/d5/d40/d7/d91/f42 [0,4194304] 0 2024-02-28T16:26:44.815 INFO:tasks.workunit.client.0.smithi148.stdout:8/646: symlink d1/dd/d51/d9b/dc6/dae/ld9 0 2024-02-28T16:26:44.818 INFO:tasks.workunit.client.0.smithi148.stdout:8/647: readlink d1/dd/d13/d1a/d25/d50/l64 0 2024-02-28T16:26:44.820 INFO:tasks.workunit.client.0.smithi148.stdout:1/608: mkdir d2/d15/d8b/da3/dc2 0 2024-02-28T16:26:44.821 INFO:tasks.workunit.client.0.smithi148.stdout:0/764: dread d1/d15/d27/d34/d5a/d9d/d4a/d92/f9f [0,4194304] 0 2024-02-28T16:26:44.832 INFO:tasks.workunit.client.0.smithi148.stdout:0/765: symlink d1/d15/d27/d34/d5a/d71/d80/df0/l101 0 2024-02-28T16:26:44.836 INFO:tasks.workunit.client.0.smithi148.stdout:0/766: creat d1/d15/d27/d7a/dc6/da7/df1/dbc/f102 x:0 0 0 2024-02-28T16:26:44.842 INFO:tasks.workunit.client.0.smithi148.stdout:0/767: creat d1/d15/d27/d34/d5a/d9d/dc7/df7/f103 x:0 0 0 2024-02-28T16:26:44.844 INFO:tasks.workunit.client.0.smithi148.stdout:0/768: write d1/d15/d27/fbb [5145474,22500] 0 2024-02-28T16:26:44.845 INFO:tasks.workunit.client.0.smithi148.stdout:8/648: write d1/dd/d13/d1a/d25/da3/fac [502136,118474] 0 2024-02-28T16:26:44.845 INFO:tasks.workunit.client.0.smithi148.stdout:0/769: chown d1/d15/d27/fb8 25 1 2024-02-28T16:26:44.849 INFO:tasks.workunit.client.0.smithi148.stdout:0/770: write d1/d15/d27/d34/d5a/d9d/dc7/df7/f103 [279835,114340] 0 2024-02-28T16:26:44.850 INFO:tasks.workunit.client.0.smithi148.stdout:8/649: mknod d1/dd/d13/d1a/d87/cda 0 2024-02-28T16:26:44.851 INFO:tasks.workunit.client.0.smithi148.stdout:1/609: truncate d2/d5/d40/d7/f6e 3361814 0 2024-02-28T16:26:44.851 INFO:tasks.workunit.client.0.smithi148.stdout:1/610: stat d2 0 2024-02-28T16:26:44.855 INFO:tasks.workunit.client.0.smithi148.stdout:1/611: mknod d2/d9c/cc3 0 2024-02-28T16:26:44.856 INFO:tasks.workunit.client.0.smithi148.stdout:1/612: write d2/d3f/fa0 [883583,31300] 0 2024-02-28T16:26:44.857 INFO:tasks.workunit.client.0.smithi148.stdout:0/771: rename d1/d15/d27/d7a/dc6/da7/df1/lbe to d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/l104 0 2024-02-28T16:26:44.861 INFO:tasks.workunit.client.0.smithi148.stdout:1/613: read - d2/f41 zero size 2024-02-28T16:26:44.863 INFO:tasks.workunit.client.0.smithi148.stdout:1/614: write d2/d15/d62/d75/f88 [3015896,110577] 0 2024-02-28T16:26:44.869 INFO:tasks.workunit.client.0.smithi148.stdout:1/615: write d2/d15/d8b/da3/fb4 [627772,81701] 0 2024-02-28T16:26:44.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/650: write d1/dd/d13/d68/f30 [1652378,74583] 0 2024-02-28T16:26:44.872 INFO:tasks.workunit.client.0.smithi148.stdout:1/616: symlink d2/d15/d8b/db0/lc4 0 2024-02-28T16:26:44.880 INFO:tasks.workunit.client.0.smithi148.stdout:8/651: symlink d1/dd/d51/d9b/dc6/dae/ldb 0 2024-02-28T16:26:44.889 INFO:tasks.workunit.client.0.smithi148.stdout:0/772: dread d1/d15/d27/fbb [0,4194304] 0 2024-02-28T16:26:44.890 INFO:tasks.workunit.client.0.smithi148.stdout:1/617: dread d2/d15/d33/f63 [0,4194304] 0 2024-02-28T16:26:44.894 INFO:tasks.workunit.client.0.smithi148.stdout:0/773: creat d1/df3/f105 x:0 0 0 2024-02-28T16:26:44.895 INFO:tasks.workunit.client.0.smithi148.stdout:0/774: dread - d1/df3/f105 zero size 2024-02-28T16:26:44.898 INFO:tasks.workunit.client.0.smithi148.stdout:0/775: fsync d1/d15/d27/d7a/dc6/da7/df1/dbc/f102 0 2024-02-28T16:26:44.899 INFO:tasks.workunit.client.0.smithi148.stdout:8/652: dwrite d1/d3/f47 [0,4194304] 0 2024-02-28T16:26:44.904 INFO:tasks.workunit.client.0.smithi148.stdout:8/653: unlink d1/d3/d9a/cd5 0 2024-02-28T16:26:44.906 INFO:tasks.workunit.client.0.smithi148.stdout:0/776: write d1/d15/d27/d7a/dc6/fbf [120356,39474] 0 2024-02-28T16:26:44.907 INFO:tasks.workunit.client.0.smithi148.stdout:8/654: fsync d1/dd/d13/d1a/d25/fa6 0 2024-02-28T16:26:44.912 INFO:tasks.workunit.client.0.smithi148.stdout:0/777: creat d1/d15/d3d/d67/dee/f106 x:0 0 0 2024-02-28T16:26:44.913 INFO:tasks.workunit.client.0.smithi148.stdout:0/778: chown d1/d15/d8/f52 2173 1 2024-02-28T16:26:44.916 INFO:tasks.workunit.client.0.smithi148.stdout:8/655: getdents d1/d3/d18/d48/d70/d75/d91/dcc 0 2024-02-28T16:26:44.920 INFO:tasks.workunit.client.0.smithi148.stdout:8/656: mknod d1/dd/d13/d1a/d33/cdc 0 2024-02-28T16:26:44.926 INFO:tasks.workunit.client.0.smithi148.stdout:0/779: dread d1/d15/d27/d34/d5a/d9d/d4a/d92/f9f [0,4194304] 0 2024-02-28T16:26:44.931 INFO:tasks.workunit.client.0.smithi148.stdout:0/780: mknod d1/d15/d27/d7a/c107 0 2024-02-28T16:26:44.937 INFO:tasks.workunit.client.0.smithi148.stdout:8/657: dwrite d1/d3/d18/d48/ff [4194304,4194304] 0 2024-02-28T16:26:44.939 INFO:tasks.workunit.client.0.smithi148.stdout:8/658: truncate d1/fcb 777325 0 2024-02-28T16:26:44.940 INFO:tasks.workunit.client.0.smithi148.stdout:8/659: read - d1/fd0 zero size 2024-02-28T16:26:44.942 INFO:tasks.workunit.client.0.smithi148.stdout:1/618: dread d2/d5/d40/d7/fc [4194304,4194304] 0 2024-02-28T16:26:44.943 INFO:tasks.workunit.client.0.smithi148.stdout:8/660: chown d1/d3/d18/d48/d22/d55/c92 19 1 2024-02-28T16:26:44.946 INFO:tasks.workunit.client.0.smithi148.stdout:8/661: creat d1/dd/d13/d1a/d33/fdd x:0 0 0 2024-02-28T16:26:44.949 INFO:tasks.workunit.client.0.smithi148.stdout:0/781: dread d1/d15/d27/d34/d5a/dcd/fe5 [0,4194304] 0 2024-02-28T16:26:44.951 INFO:tasks.workunit.client.0.smithi148.stdout:8/662: creat d1/dd/d13/d24/d3a/d49/fde x:0 0 0 2024-02-28T16:26:44.953 INFO:tasks.workunit.client.0.smithi148.stdout:1/619: dread d2/d3f/fa0 [0,4194304] 0 2024-02-28T16:26:44.956 INFO:tasks.workunit.client.0.smithi148.stdout:0/782: write d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f61 [1346599,129121] 0 2024-02-28T16:26:44.959 INFO:tasks.workunit.client.0.smithi148.stdout:8/663: rename d1/dd/d13/d23 to d1/d3/d18/d48/d70/d75/d91/dcc/ddf 0 2024-02-28T16:26:44.962 INFO:tasks.workunit.client.0.smithi148.stdout:0/783: mknod d1/d15/d27/d34/d5a/d71/c108 0 2024-02-28T16:26:44.967 INFO:tasks.workunit.client.0.smithi148.stdout:0/784: unlink d1/d15/d27/d34/d5a/d9d/c48 0 2024-02-28T16:26:44.968 INFO:tasks.workunit.client.0.smithi148.stdout:8/664: dread d1/dd/d13/d24/d3a/d49/f57 [0,4194304] 0 2024-02-28T16:26:44.971 INFO:tasks.workunit.client.0.smithi148.stdout:1/620: dwrite d2/d5/d40/f27 [4194304,4194304] 0 2024-02-28T16:26:44.972 INFO:tasks.workunit.client.0.smithi148.stdout:0/785: creat d1/d15/d27/d34/d5a/d71/d80/df0/f109 x:0 0 0 2024-02-28T16:26:44.973 INFO:tasks.workunit.client.0.smithi148.stdout:8/665: creat d1/fe0 x:0 0 0 2024-02-28T16:26:44.979 INFO:tasks.workunit.client.0.smithi148.stdout:8/666: creat d1/dd/d13/d24/d3a/d49/fe1 x:0 0 0 2024-02-28T16:26:44.980 INFO:tasks.workunit.client.0.smithi148.stdout:1/621: creat d2/d5/d40/d7/d91/fc5 x:0 0 0 2024-02-28T16:26:44.981 INFO:tasks.workunit.client.0.smithi148.stdout:8/667: chown d1/dd/d13/d68/l63 44 1 2024-02-28T16:26:44.985 INFO:tasks.workunit.client.0.smithi148.stdout:0/786: truncate d1/d15/d27/d34/d5a/d6c/f88 8214530 0 2024-02-28T16:26:44.989 INFO:tasks.workunit.client.0.smithi148.stdout:8/668: creat d1/d3/d18/d48/d22/fe2 x:0 0 0 2024-02-28T16:26:44.991 INFO:tasks.workunit.client.0.smithi148.stdout:8/669: write d1/d3/d18/fc3 [872594,118108] 0 2024-02-28T16:26:44.991 INFO:tasks.workunit.client.0.smithi148.stdout:1/622: rename d2/d15/d62/d75/d76/lbd to d2/d15/d62/lc6 0 2024-02-28T16:26:44.993 INFO:tasks.workunit.client.0.smithi148.stdout:8/670: fdatasync d1/d3/d18/d48/d22/fe2 0 2024-02-28T16:26:44.993 INFO:tasks.workunit.client.0.smithi148.stdout:0/787: creat d1/d15/d27/d34/d5a/d9d/d4a/f10a x:0 0 0 2024-02-28T16:26:45.000 INFO:tasks.workunit.client.0.smithi148.stdout:8/671: rmdir d1/dd/d51/d77/db3 0 2024-02-28T16:26:45.004 INFO:tasks.workunit.client.0.smithi148.stdout:8/672: symlink d1/dd/d13/d68/le3 0 2024-02-28T16:26:45.008 INFO:tasks.workunit.client.0.smithi148.stdout:1/623: dwrite d2/d15/d62/f7e [0,4194304] 0 2024-02-28T16:26:45.009 INFO:tasks.workunit.client.0.smithi148.stdout:8/673: truncate d1/dd/d13/d1a/d25/d50/fca 4388676 0 2024-02-28T16:26:45.012 INFO:tasks.workunit.client.0.smithi148.stdout:1/624: truncate d2/d5/d40/d7/d91/f42 2149796 0 2024-02-28T16:26:45.016 INFO:tasks.workunit.client.0.smithi148.stdout:0/788: dwrite d1/f24 [4194304,4194304] 0 2024-02-28T16:26:45.019 INFO:tasks.workunit.client.0.smithi148.stdout:1/625: unlink d2/d5/d2b/c73 0 2024-02-28T16:26:45.021 INFO:tasks.workunit.client.0.smithi148.stdout:0/789: unlink d1/d15/d8/c2c 0 2024-02-28T16:26:45.022 INFO:tasks.workunit.client.0.smithi148.stdout:0/790: stat d1/d15/d3d/f43 0 2024-02-28T16:26:45.023 INFO:tasks.workunit.client.0.smithi148.stdout:1/626: truncate d2/d5/d40/f6d 2132427 0 2024-02-28T16:26:45.027 INFO:tasks.workunit.client.0.smithi148.stdout:8/674: dwrite d1/d3/d18/d5a/d60/f82 [0,4194304] 0 2024-02-28T16:26:45.031 INFO:tasks.workunit.client.0.smithi148.stdout:8/675: write d1/dd/d13/d24/fa5 [483510,38713] 0 2024-02-28T16:26:45.033 INFO:tasks.workunit.client.0.smithi148.stdout:8/676: fdatasync d1/dd/d13/d68/fc0 0 2024-02-28T16:26:45.033 INFO:tasks.workunit.client.0.smithi148.stdout:0/791: fsync d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f2e 0 2024-02-28T16:26:45.039 INFO:tasks.workunit.client.0.smithi148.stdout:8/677: creat d1/da7/dc2/fe4 x:0 0 0 2024-02-28T16:26:45.039 INFO:tasks.workunit.client.0.smithi148.stdout:0/792: rmdir d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3 39 2024-02-28T16:26:45.040 INFO:tasks.workunit.client.0.smithi148.stdout:8/678: readlink d1/dd/d13/d24/l2a 0 2024-02-28T16:26:45.043 INFO:tasks.workunit.client.0.smithi148.stdout:8/679: readlink d1/dd/d13/d68/l8d 0 2024-02-28T16:26:45.048 INFO:tasks.workunit.client.0.smithi148.stdout:0/793: rename d1/d15/d27/d34/d5a/d9d/d5f/l63 to d1/d15/d3d/d67/daf/l10b 0 2024-02-28T16:26:45.063 INFO:tasks.workunit.client.0.smithi148.stdout:1/627: dwrite d2/d5/d40/d8/f21 [4194304,4194304] 0 2024-02-28T16:26:45.071 INFO:tasks.workunit.client.0.smithi148.stdout:1/628: creat d2/d5/d2b/da7/dad/fc7 x:0 0 0 2024-02-28T16:26:45.072 INFO:tasks.workunit.client.0.smithi148.stdout:1/629: stat d2/d5/d40/d7/d91/c94 0 2024-02-28T16:26:45.088 INFO:tasks.workunit.client.0.smithi148.stdout:1/630: dwrite d2/f6c [0,4194304] 0 2024-02-28T16:26:45.091 INFO:tasks.workunit.client.0.smithi148.stdout:8/680: dwrite d1/d3/f20 [0,4194304] 0 2024-02-28T16:26:45.093 INFO:tasks.workunit.client.0.smithi148.stdout:0/794: dwrite d1/d15/d27/d34/d5a/d9d/f6b [0,4194304] 0 2024-02-28T16:26:45.096 INFO:tasks.workunit.client.0.smithi148.stdout:1/631: rmdir d2/d15 39 2024-02-28T16:26:45.098 INFO:tasks.workunit.client.0.smithi148.stdout:0/795: mknod d1/d15/d3d/d67/c10c 0 2024-02-28T16:26:45.104 INFO:tasks.workunit.client.0.smithi148.stdout:1/632: creat d2/d5/fc8 x:0 0 0 2024-02-28T16:26:45.106 INFO:tasks.workunit.client.0.smithi148.stdout:1/633: read - d2/d5/d40/d7/d91/fc5 zero size 2024-02-28T16:26:45.110 INFO:tasks.workunit.client.0.smithi148.stdout:8/681: write d1/d3/f1e [809101,115165] 0 2024-02-28T16:26:45.116 INFO:tasks.workunit.client.0.smithi148.stdout:8/682: getdents d1 0 2024-02-28T16:26:45.118 INFO:tasks.workunit.client.0.smithi148.stdout:0/796: dwrite d1/d8a/fce [0,4194304] 0 2024-02-28T16:26:45.119 INFO:tasks.workunit.client.0.smithi148.stdout:8/683: write d1/d3/d18/d48/d22/fa1 [98645,48354] 0 2024-02-28T16:26:45.124 INFO:tasks.workunit.client.0.smithi148.stdout:8/684: mkdir d1/d3/de5 0 2024-02-28T16:26:45.129 INFO:tasks.workunit.client.0.smithi148.stdout:8/685: truncate d1/dd/d13/d24/d3a/f59 1125607 0 2024-02-28T16:26:45.132 INFO:tasks.workunit.client.0.smithi148.stdout:8/686: mkdir d1/d3/d18/d5a/d60/de6 0 2024-02-28T16:26:45.138 INFO:tasks.workunit.client.0.smithi148.stdout:0/797: dread d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f2e [0,4194304] 0 2024-02-28T16:26:45.141 INFO:tasks.workunit.client.0.smithi148.stdout:0/798: fsync d1/d15/d27/d34/d5a/dcd/fe5 0 2024-02-28T16:26:45.145 INFO:tasks.workunit.client.0.smithi148.stdout:0/799: mknod d1/d15/d27/d34/d5a/d9d/d4a/c10d 0 2024-02-28T16:26:45.146 INFO:tasks.workunit.client.0.smithi148.stdout:0/800: stat d1/d15/d3d/f65 0 2024-02-28T16:26:45.158 INFO:tasks.workunit.client.0.smithi148.stdout:0/801: dread d1/d15/d27/d34/d5a/d9d/d4a/d92/fa8 [0,4194304] 0 2024-02-28T16:26:45.163 INFO:tasks.workunit.client.0.smithi148.stdout:0/802: rename d1/d15/d8/c8e to d1/d15/d27/d34/d5a/d71/d80/c10e 0 2024-02-28T16:26:45.164 INFO:tasks.workunit.client.0.smithi148.stdout:0/803: stat d1/d15/d27 0 2024-02-28T16:26:45.165 INFO:tasks.workunit.client.0.smithi148.stdout:0/804: fdatasync d1/d15/d27/d34/d5a/d9d/d5f/ff4 0 2024-02-28T16:26:45.167 INFO:tasks.workunit.client.0.smithi148.stdout:0/805: write d1/d15/d8/f1d [5212740,102363] 0 2024-02-28T16:26:45.168 INFO:tasks.workunit.client.0.smithi148.stdout:0/806: fdatasync d1/d15/d3d/ffb 0 2024-02-28T16:26:45.173 INFO:tasks.workunit.client.0.smithi148.stdout:0/807: creat d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/f10f x:0 0 0 2024-02-28T16:26:45.176 INFO:tasks.workunit.client.0.smithi148.stdout:0/808: rmdir d1/d15/d3d 39 2024-02-28T16:26:45.181 INFO:tasks.workunit.client.0.smithi148.stdout:0/809: fdatasync d1/d15/d3d/f65 0 2024-02-28T16:26:45.185 INFO:tasks.workunit.client.0.smithi148.stdout:0/810: getdents d1/d15/d27/d34/d5a/d9d/d4a/d92 0 2024-02-28T16:26:45.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/811: readlink d1/d15/d27/d7a/lb9 0 2024-02-28T16:26:45.187 INFO:tasks.workunit.client.0.smithi148.stdout:0/812: readlink d1/d15/d27/d7a/lb9 0 2024-02-28T16:26:45.191 INFO:tasks.workunit.client.0.smithi148.stdout:0/813: rename d1/d15/d27/d34/d5a/d9d/ddf to d1/d15/d27/d7a/dc6/dc4/d110 0 2024-02-28T16:26:45.194 INFO:tasks.workunit.client.0.smithi148.stdout:0/814: chown d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/cd9 0 1 2024-02-28T16:26:45.197 INFO:tasks.workunit.client.0.smithi148.stdout:0/815: getdents d1/d8a 0 2024-02-28T16:26:45.203 INFO:tasks.workunit.client.0.smithi148.stdout:0/816: link d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/fe d1/d15/d3d/d67/f111 0 2024-02-28T16:26:45.205 INFO:tasks.workunit.client.0.smithi148.stdout:0/817: fdatasync d1/d15/d3d/f65 0 2024-02-28T16:26:45.213 INFO:tasks.workunit.client.0.smithi148.stdout:0/818: truncate d1/d15/d27/d34/d5a/d9d/d5f/fa0 41537 0 2024-02-28T16:26:45.215 INFO:tasks.workunit.client.0.smithi148.stdout:0/819: rmdir d1/d15/d8 39 2024-02-28T16:26:45.220 INFO:tasks.workunit.client.0.smithi148.stdout:0/820: mknod d1/d15/d27/d34/c112 0 2024-02-28T16:26:45.227 INFO:tasks.workunit.client.0.smithi148.stdout:0/821: rename d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/l104 to d1/d15/d27/d34/d5a/d6c/l113 0 2024-02-28T16:26:45.230 INFO:tasks.workunit.client.0.smithi148.stdout:0/822: creat d1/d15/d27/d7a/dc6/da7/f114 x:0 0 0 2024-02-28T16:26:45.234 INFO:tasks.workunit.client.0.smithi148.stdout:0/823: mknod d1/d15/d27/d34/d5a/d71/d80/db6/c115 0 2024-02-28T16:26:45.249 INFO:tasks.workunit.client.0.smithi148.stdout:0/824: write d1/d15/d27/d34/d5a/d6c/f75 [4728458,18433] 0 2024-02-28T16:26:45.259 INFO:tasks.workunit.client.0.smithi148.stdout:0/825: rmdir d1/d15/d27/d7a/dc6/da7/df1 39 2024-02-28T16:26:45.261 INFO:tasks.workunit.client.0.smithi148.stdout:0/826: chown d1/d15/d27/d7a/dc6/dc4/d110/lff 346 1 2024-02-28T16:26:45.267 INFO:tasks.workunit.client.0.smithi148.stdout:0/827: truncate d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/f10f 319905 0 2024-02-28T16:26:45.268 INFO:tasks.workunit.client.0.smithi148.stdout:0/828: chown d1/c100 204268143 1 2024-02-28T16:26:45.277 INFO:tasks.workunit.client.0.smithi148.stdout:0/829: link d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/c17 d1/d15/d3d/c116 0 2024-02-28T16:26:45.281 INFO:tasks.workunit.client.0.smithi148.stdout:0/830: symlink d1/d15/d27/d7a/dc6/da7/df1/d7e/l117 0 2024-02-28T16:26:45.292 INFO:tasks.workunit.client.0.smithi148.stdout:0/831: getdents d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd 0 2024-02-28T16:26:45.296 INFO:tasks.workunit.client.0.smithi148.stdout:0/832: readlink d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/l53 0 2024-02-28T16:26:45.301 INFO:tasks.workunit.client.0.smithi148.stdout:0/833: truncate d1/d15/d27/d34/d5a/d9d/d4a/d92/f9f 5054138 0 2024-02-28T16:26:45.303 INFO:tasks.workunit.client.0.smithi148.stdout:7/636: sync 2024-02-28T16:26:45.304 INFO:tasks.workunit.client.0.smithi148.stdout:4/541: sync 2024-02-28T16:26:45.311 INFO:tasks.workunit.client.0.smithi148.stdout:7/637: creat d0/d9/d25/d47/d28/d2b/d3a/fc4 x:0 0 0 2024-02-28T16:26:45.313 INFO:tasks.workunit.client.0.smithi148.stdout:7/638: chown d0/f36 208713 1 2024-02-28T16:26:45.314 INFO:tasks.workunit.client.0.smithi148.stdout:4/542: link d8/d21/d7e/fbb d8/d21/fbc 0 2024-02-28T16:26:45.316 INFO:tasks.workunit.client.0.smithi148.stdout:7/639: write d0/d9/d1b/fba [355205,4753] 0 2024-02-28T16:26:45.318 INFO:tasks.workunit.client.0.smithi148.stdout:4/543: mkdir d8/d37/d98/dbd 0 2024-02-28T16:26:45.321 INFO:tasks.workunit.client.0.smithi148.stdout:0/834: dwrite d1/fd7 [0,4194304] 0 2024-02-28T16:26:45.325 INFO:tasks.workunit.client.0.smithi148.stdout:7/640: read d0/f1d [2252012,120165] 0 2024-02-28T16:26:45.327 INFO:tasks.workunit.client.0.smithi148.stdout:0/835: chown d1/d15/d3d/d67/dee/f106 357 1 2024-02-28T16:26:45.328 INFO:tasks.workunit.client.0.smithi148.stdout:7/641: fdatasync d0/d9/d25/d47/d28/d2b/d3a/d49/f6d 0 2024-02-28T16:26:45.331 INFO:tasks.workunit.client.0.smithi148.stdout:0/836: rmdir d1/d15/d27/d7a/dc6/da7/df1/d7e/db7 39 2024-02-28T16:26:45.333 INFO:tasks.workunit.client.0.smithi148.stdout:7/642: symlink d0/d9/d25/d96/lc5 0 2024-02-28T16:26:45.336 INFO:tasks.workunit.client.0.smithi148.stdout:0/837: symlink d1/d15/d27/d34/d5a/d9d/dc7/df7/l118 0 2024-02-28T16:26:45.338 INFO:tasks.workunit.client.0.smithi148.stdout:0/838: chown d1/d15/d27/d7a/dc6 14412382 1 2024-02-28T16:26:45.342 INFO:tasks.workunit.client.0.smithi148.stdout:4/544: dread d8/df/d1f/f42 [0,4194304] 0 2024-02-28T16:26:45.343 INFO:tasks.workunit.client.0.smithi148.stdout:0/839: write d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/fe4 [4014394,69856] 0 2024-02-28T16:26:45.347 INFO:tasks.workunit.client.0.smithi148.stdout:7/643: write d0/d9/d46/f7a [618762,11340] 0 2024-02-28T16:26:45.348 INFO:tasks.workunit.client.0.smithi148.stdout:0/840: creat d1/d15/d27/d7a/dc6/dc4/d110/f119 x:0 0 0 2024-02-28T16:26:45.349 INFO:tasks.workunit.client.0.smithi148.stdout:0/841: write d1/d15/d3d/ffb [968558,12427] 0 2024-02-28T16:26:45.352 INFO:tasks.workunit.client.0.smithi148.stdout:7/644: creat d0/d9/d25/d47/d28/d2b/d3a/d49/d97/fc6 x:0 0 0 2024-02-28T16:26:45.359 INFO:tasks.workunit.client.0.smithi148.stdout:7/645: write d0/d9/d25/d47/d28/d2b/d3a/d49/f51 [1848878,87273] 0 2024-02-28T16:26:45.364 INFO:tasks.workunit.client.0.smithi148.stdout:4/545: dread d8/df/d5f/f7b [0,4194304] 0 2024-02-28T16:26:45.366 INFO:tasks.workunit.client.0.smithi148.stdout:4/546: write d8/df/da3/fa6 [716455,30622] 0 2024-02-28T16:26:45.370 INFO:tasks.workunit.client.0.smithi148.stdout:4/547: symlink d8/d21/d3d/d8c/db0/lbe 0 2024-02-28T16:26:45.374 INFO:tasks.workunit.client.0.smithi148.stdout:0/842: dread d1/d15/d27/d34/d5a/d9d/d4a/f57 [0,4194304] 0 2024-02-28T16:26:45.374 INFO:tasks.workunit.client.0.smithi148.stdout:7/646: dread d0/d9/d25/d47/d28/d2b/d3a/d6a/fbe [0,4194304] 0 2024-02-28T16:26:45.375 INFO:tasks.workunit.client.0.smithi148.stdout:4/548: rename d8/d21/d7e/c8e to d8/d21/d3d/d4d/d66/dad/cbf 0 2024-02-28T16:26:45.377 INFO:tasks.workunit.client.0.smithi148.stdout:7/647: fsync d0/d9/d25/d47/d1c/d32/faa 0 2024-02-28T16:26:45.378 INFO:tasks.workunit.client.0.smithi148.stdout:4/549: write d8/d21/d3d/d4d/f5c [4603046,111727] 0 2024-02-28T16:26:45.381 INFO:tasks.workunit.client.0.smithi148.stdout:0/843: rename d1/d15/d3d/d67/c10c to d1/d15/d27/d7a/dc6/dc4/d110/c11a 0 2024-02-28T16:26:45.381 INFO:tasks.workunit.client.0.smithi148.stdout:7/648: mkdir d0/d9/d4c/dc7 0 2024-02-28T16:26:45.382 INFO:tasks.workunit.client.0.smithi148.stdout:4/550: creat d8/d40/d73/fc0 x:0 0 0 2024-02-28T16:26:45.385 INFO:tasks.workunit.client.0.smithi148.stdout:4/551: creat d8/d40/fc1 x:0 0 0 2024-02-28T16:26:45.390 INFO:tasks.workunit.client.0.smithi148.stdout:7/649: rename d0/d9/d25/d47/db8 to d0/dc8 0 2024-02-28T16:26:45.390 INFO:tasks.workunit.client.0.smithi148.stdout:0/844: getdents d1/d15/d27/d7a/dc6/da7/df1/d7e/db7 0 2024-02-28T16:26:45.392 INFO:tasks.workunit.client.0.smithi148.stdout:0/845: write d1/d15/d27/fb8 [8248684,44268] 0 2024-02-28T16:26:45.393 INFO:tasks.workunit.client.0.smithi148.stdout:0/846: stat d1/d15 0 2024-02-28T16:26:45.397 INFO:tasks.workunit.client.0.smithi148.stdout:0/847: chown d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f2e 81141524 1 2024-02-28T16:26:45.405 INFO:tasks.workunit.client.0.smithi148.stdout:7/650: dwrite d0/d9/d46/f7a [0,4194304] 0 2024-02-28T16:26:45.410 INFO:tasks.workunit.client.0.smithi148.stdout:7/651: truncate d0/d9/d25/d47/d28/d2b/d3a/d49/faf 178124 0 2024-02-28T16:26:45.413 INFO:tasks.workunit.client.0.smithi148.stdout:7/652: rename d0/d9 to d0/d9/d25/d47/d28/d2b/d6f/d82/dc9 22 2024-02-28T16:26:45.418 INFO:tasks.workunit.client.0.smithi148.stdout:7/653: link d0/d9/d4c/fa8 d0/d9/d25/d96/fca 0 2024-02-28T16:26:45.418 INFO:tasks.workunit.client.0.smithi148.stdout:0/848: dwrite d1/d15/d27/d34/d5a/d9d/f76 [0,4194304] 0 2024-02-28T16:26:45.421 INFO:tasks.workunit.client.0.smithi148.stdout:7/654: creat d0/d9/d25/d47/d28/d2b/d3a/d49/d97/fcb x:0 0 0 2024-02-28T16:26:45.433 INFO:tasks.workunit.client.0.smithi148.stdout:9/733: sync 2024-02-28T16:26:45.441 INFO:tasks.workunit.client.0.smithi148.stdout:9/734: write d7/d1c/d32/f1a [3106969,23968] 0 2024-02-28T16:26:45.442 INFO:tasks.workunit.client.0.smithi148.stdout:9/735: fdatasync d7/d1c/d59/d83/fc3 0 2024-02-28T16:26:45.457 INFO:tasks.workunit.client.0.smithi148.stdout:9/736: dwrite d7/d43/f60 [0,4194304] 0 2024-02-28T16:26:45.476 INFO:tasks.workunit.client.0.smithi148.stdout:9/737: dwrite d7/d1c/d74/f9b [4194304,4194304] 0 2024-02-28T16:26:45.478 INFO:tasks.workunit.client.0.smithi148.stdout:9/738: chown d7/d1c/d74/d68 27031 1 2024-02-28T16:26:45.482 INFO:tasks.workunit.client.0.smithi148.stdout:0/849: fsync d1/d15/d27/d34/d5a/d9d/f76 0 2024-02-28T16:26:45.492 INFO:tasks.workunit.client.0.smithi148.stdout:9/739: truncate d7/f21 3444495 0 2024-02-28T16:26:45.496 INFO:tasks.workunit.client.0.smithi148.stdout:9/740: write d7/d1c/d1f/d49/dae/fd9 [8633,39595] 0 2024-02-28T16:26:45.499 INFO:tasks.workunit.client.0.smithi148.stdout:0/850: dwrite d1/d8a/fce [0,4194304] 0 2024-02-28T16:26:45.502 INFO:tasks.workunit.client.0.smithi148.stdout:9/741: getdents d7/d1c/d59/d83/d88 0 2024-02-28T16:26:45.505 INFO:tasks.workunit.client.0.smithi148.stdout:0/851: unlink d1/d15/d27/d34/d5a/d9d/d4a/l77 0 2024-02-28T16:26:45.506 INFO:tasks.workunit.client.0.smithi148.stdout:9/742: chown d7/d1c/d74/d6b/l77 836 1 2024-02-28T16:26:45.519 INFO:tasks.workunit.client.0.smithi148.stdout:9/743: write d7/d1c/d32/d24/dc1/fe9 [1399747,105803] 0 2024-02-28T16:26:45.525 INFO:tasks.workunit.client.0.smithi148.stdout:0/852: dwrite d1/d15/d27/d34/d5a/d9d/d4a/fda [0,4194304] 0 2024-02-28T16:26:45.537 INFO:tasks.workunit.client.0.smithi148.stdout:0/853: rename d1/d15/d27/fbb to d1/d15/d27/d34/d5a/dcd/f11b 0 2024-02-28T16:26:45.540 INFO:tasks.workunit.client.0.smithi148.stdout:0/854: creat d1/d15/d3d/d67/daf/f11c x:0 0 0 2024-02-28T16:26:45.542 INFO:tasks.workunit.client.0.smithi148.stdout:0/855: chown d1/d15/d27/d34/d5a/d9d/f76 14349 1 2024-02-28T16:26:45.543 INFO:tasks.workunit.client.0.smithi148.stdout:9/744: truncate d7/d1c/d59/d83/d88/f8a 1679430 0 2024-02-28T16:26:45.544 INFO:tasks.workunit.client.0.smithi148.stdout:9/745: chown d7/d1c/d59 9076079 1 2024-02-28T16:26:45.566 INFO:tasks.workunit.client.0.smithi148.stdout:0/856: dread d1/d15/d27/d34/f6d [0,4194304] 0 2024-02-28T16:26:45.570 INFO:tasks.workunit.client.0.smithi148.stdout:0/857: creat d1/d15/d27/d7a/f11d x:0 0 0 2024-02-28T16:26:45.575 INFO:tasks.workunit.client.0.smithi148.stdout:0/858: getdents d1/d15 0 2024-02-28T16:26:45.581 INFO:tasks.workunit.client.0.smithi148.stdout:0/859: creat d1/d15/d27/d7a/f11e x:0 0 0 2024-02-28T16:26:45.587 INFO:tasks.workunit.client.0.smithi148.stdout:0/860: write d1/d15/d27/d34/fb0 [778458,33499] 0 2024-02-28T16:26:45.590 INFO:tasks.workunit.client.0.smithi148.stdout:0/861: mknod d1/d8a/c11f 0 2024-02-28T16:26:45.594 INFO:tasks.workunit.client.0.smithi148.stdout:0/862: symlink d1/d15/d27/d34/d5a/d71/d80/l120 0 2024-02-28T16:26:45.603 INFO:tasks.workunit.client.0.smithi148.stdout:0/863: write d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/f90 [264700,118724] 0 2024-02-28T16:26:45.616 INFO:tasks.workunit.client.0.smithi148.stdout:0/864: dwrite d1/d15/d27/d7a/f4e [0,4194304] 0 2024-02-28T16:26:45.622 INFO:tasks.workunit.client.0.smithi148.stdout:0/865: creat d1/d15/d27/d7a/dc6/da7/f121 x:0 0 0 2024-02-28T16:26:45.626 INFO:tasks.workunit.client.0.smithi148.stdout:0/866: symlink d1/d15/d27/d34/d5a/d71/l122 0 2024-02-28T16:26:45.630 INFO:tasks.workunit.client.0.smithi148.stdout:0/867: mknod d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/c123 0 2024-02-28T16:26:45.635 INFO:tasks.workunit.client.0.smithi148.stdout:0/868: dread d1/d15/f2a [4194304,4194304] 0 2024-02-28T16:26:45.637 INFO:tasks.workunit.client.0.smithi148.stdout:0/869: write d1/d15/d27/d7a/f4e [904389,1314] 0 2024-02-28T16:26:45.639 INFO:tasks.workunit.client.0.smithi148.stdout:1/634: sync 2024-02-28T16:26:45.639 INFO:tasks.workunit.client.0.smithi148.stdout:8/687: sync 2024-02-28T16:26:45.639 INFO:tasks.workunit.client.0.smithi148.stdout:5/591: sync 2024-02-28T16:26:45.639 INFO:tasks.workunit.client.0.smithi148.stdout:6/599: sync 2024-02-28T16:26:45.639 INFO:tasks.workunit.client.0.smithi148.stdout:3/711: sync 2024-02-28T16:26:45.639 INFO:tasks.workunit.client.0.smithi148.stdout:2/594: sync 2024-02-28T16:26:45.640 INFO:tasks.workunit.client.0.smithi148.stdout:3/712: stat d1/d13/d19 0 2024-02-28T16:26:45.642 INFO:tasks.workunit.client.0.smithi148.stdout:1/635: stat d2/d15/d33/f63 0 2024-02-28T16:26:45.645 INFO:tasks.workunit.client.0.smithi148.stdout:6/600: truncate d0/d22/d27/f62 8797058 0 2024-02-28T16:26:45.646 INFO:tasks.workunit.client.0.smithi148.stdout:1/636: chown d2/d5/d40/d7/f6a 8272 1 2024-02-28T16:26:45.648 INFO:tasks.workunit.client.0.smithi148.stdout:1/637: write d2/f6c [4541054,6979] 0 2024-02-28T16:26:45.649 INFO:tasks.workunit.client.0.smithi148.stdout:3/713: mknod d1/d3f/da5/cc6 0 2024-02-28T16:26:45.651 INFO:tasks.workunit.client.0.smithi148.stdout:6/601: read d0/d4/d14/d8a/fb8 [6712,42639] 0 2024-02-28T16:26:45.653 INFO:tasks.workunit.client.0.smithi148.stdout:1/638: symlink d2/d5/d40/d7/d99/lc9 0 2024-02-28T16:26:45.654 INFO:tasks.workunit.client.0.smithi148.stdout:1/639: readlink d2/d5/l7c 0 2024-02-28T16:26:45.658 INFO:tasks.workunit.client.0.smithi148.stdout:6/602: truncate d0/d22/d27/d3e/f45 652319 0 2024-02-28T16:26:45.660 INFO:tasks.workunit.client.0.smithi148.stdout:2/595: dwrite d0/f27 [0,4194304] 0 2024-02-28T16:26:45.665 INFO:tasks.workunit.client.0.smithi148.stdout:0/870: dread d1/d15/d27/d7a/fcb [0,4194304] 0 2024-02-28T16:26:45.704 INFO:tasks.workunit.client.0.smithi148.stdout:6/603: dread d0/d4/d14/d8a/fab [0,4194304] 0 2024-02-28T16:26:45.718 INFO:tasks.workunit.client.0.smithi148.stdout:6/604: dwrite d0/d22/d27/d3e/fbc [0,4194304] 0 2024-02-28T16:26:45.732 INFO:tasks.workunit.client.0.smithi148.stdout:8/688: write d1/dd/d13/d1a/f44 [647710,62136] 0 2024-02-28T16:26:45.736 INFO:tasks.workunit.client.0.smithi148.stdout:0/871: unlink d1/d15/d3d/d67/daf/l10b 0 2024-02-28T16:26:45.736 INFO:tasks.workunit.client.0.smithi148.stdout:8/689: chown d1/dd/d13/d1a/d87/f6b 0 1 2024-02-28T16:26:45.744 INFO:tasks.workunit.client.0.smithi148.stdout:1/640: write d2/f41 [725427,74687] 0 2024-02-28T16:26:45.746 INFO:tasks.workunit.client.0.smithi148.stdout:6/605: dwrite d0/d22/faf [0,4194304] 0 2024-02-28T16:26:45.751 INFO:tasks.workunit.client.0.smithi148.stdout:6/606: chown d0/d22/d25/d76/d7f/c5d 6043167 1 2024-02-28T16:26:45.751 INFO:tasks.workunit.client.0.smithi148.stdout:2/596: dwrite d0/d66/d76/f7c [0,4194304] 0 2024-02-28T16:26:45.752 INFO:tasks.workunit.client.0.smithi148.stdout:0/872: dread d1/d15/d27/d34/fb0 [0,4194304] 0 2024-02-28T16:26:45.758 INFO:tasks.workunit.client.0.smithi148.stdout:8/690: getdents d1/d3/d18/d5a/d60 0 2024-02-28T16:26:45.761 INFO:tasks.workunit.client.0.smithi148.stdout:0/873: creat d1/d15/d27/d34/d5a/dcd/f124 x:0 0 0 2024-02-28T16:26:45.762 INFO:tasks.workunit.client.0.smithi148.stdout:8/691: fdatasync d1/d3/d18/d48/d70/d75/d91/dcc/ddf/f9e 0 2024-02-28T16:26:45.764 INFO:tasks.workunit.client.0.smithi148.stdout:6/607: mknod d0/d8/cbf 0 2024-02-28T16:26:45.812 INFO:tasks.workunit.client.0.smithi148.stdout:4/552: sync 2024-02-28T16:26:45.813 INFO:tasks.workunit.client.0.smithi148.stdout:8/692: creat d1/d3/d9a/fe7 x:0 0 0 2024-02-28T16:26:45.818 INFO:tasks.workunit.client.0.smithi148.stdout:4/553: symlink d8/df/d17/d6a/d6c/lc2 0 2024-02-28T16:26:45.818 INFO:tasks.workunit.client.0.smithi148.stdout:8/693: readlink d1/d3/d18/d48/d70/d75/d91/dcc/ddf/la9 0 2024-02-28T16:26:45.821 INFO:tasks.workunit.client.0.smithi148.stdout:4/554: stat d8/d21/d3d/f88 0 2024-02-28T16:26:45.823 INFO:tasks.workunit.client.0.smithi148.stdout:8/694: chown d1/d3/d18/d48/l9d 15 1 2024-02-28T16:26:45.824 INFO:tasks.workunit.client.0.smithi148.stdout:1/641: dwrite d2/d5/d40/f6d [0,4194304] 0 2024-02-28T16:26:45.825 INFO:tasks.workunit.client.0.smithi148.stdout:6/608: dwrite d0/d22/fa6 [0,4194304] 0 2024-02-28T16:26:45.829 INFO:tasks.workunit.client.0.smithi148.stdout:4/555: rename d8/d37/d98 to d8/d40/dc3 0 2024-02-28T16:26:45.834 INFO:tasks.workunit.client.0.smithi148.stdout:8/695: mkdir d1/d3/d18/d48/d70/d75/d91/dcc/de8 0 2024-02-28T16:26:45.837 INFO:tasks.workunit.client.0.smithi148.stdout:1/642: write d2/d5/d40/d7/d91/f67 [1349366,63837] 0 2024-02-28T16:26:45.840 INFO:tasks.workunit.client.0.smithi148.stdout:6/609: creat d0/d4/d14/d59/fc0 x:0 0 0 2024-02-28T16:26:45.843 INFO:tasks.workunit.client.0.smithi148.stdout:6/610: chown d0/d22/l8b 2329 1 2024-02-28T16:26:45.844 INFO:tasks.workunit.client.0.smithi148.stdout:6/611: chown d0/d8 101929467 1 2024-02-28T16:26:45.847 INFO:tasks.workunit.client.0.smithi148.stdout:1/643: rename d2/d5/d40/d7/d91/f42 to d2/d3f/fca 0 2024-02-28T16:26:45.851 INFO:tasks.workunit.client.0.smithi148.stdout:8/696: fdatasync d1/d3/d18/f2b 0 2024-02-28T16:26:45.853 INFO:tasks.workunit.client.0.smithi148.stdout:1/644: dread d2/d5/d40/d7/d91/f67 [0,4194304] 0 2024-02-28T16:26:45.855 INFO:tasks.workunit.client.0.smithi148.stdout:8/697: write d1/d3/d18/d48/d70/d75/d91/dcc/fd2 [795584,49628] 0 2024-02-28T16:26:45.857 INFO:tasks.workunit.client.0.smithi148.stdout:4/556: creat d8/d21/fc4 x:0 0 0 2024-02-28T16:26:45.858 INFO:tasks.workunit.client.0.smithi148.stdout:8/698: write d1/dd/d13/d1a/d25/fa6 [1968507,18868] 0 2024-02-28T16:26:45.865 INFO:tasks.workunit.client.0.smithi148.stdout:1/645: symlink d2/d9c/lcb 0 2024-02-28T16:26:45.866 INFO:tasks.workunit.client.0.smithi148.stdout:4/557: creat d8/d37/d91/fc5 x:0 0 0 2024-02-28T16:26:45.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/699: symlink d1/dd/d51/d9b/dc6/dae/le9 0 2024-02-28T16:26:45.873 INFO:tasks.workunit.client.0.smithi148.stdout:6/612: creat d0/d22/fc1 x:0 0 0 2024-02-28T16:26:45.877 INFO:tasks.workunit.client.0.smithi148.stdout:0/874: truncate d1/d15/d3d/ffb 211523 0 2024-02-28T16:26:45.880 INFO:tasks.workunit.client.0.smithi148.stdout:4/558: dwrite d8/d21/d3d/d4d/d72/fa5 [0,4194304] 0 2024-02-28T16:26:45.881 INFO:tasks.workunit.client.0.smithi148.stdout:1/646: mkdir d2/d5/d40/dcc 0 2024-02-28T16:26:45.885 INFO:tasks.workunit.client.0.smithi148.stdout:8/700: symlink d1/d3/de5/lea 0 2024-02-28T16:26:45.887 INFO:tasks.workunit.client.0.smithi148.stdout:0/875: rename d1/d15/d27/d34/fb0 to d1/d15/d27/d7a/dc6/dc4/d110/f125 0 2024-02-28T16:26:45.890 INFO:tasks.workunit.client.0.smithi148.stdout:4/559: creat d8/d37/fc6 x:0 0 0 2024-02-28T16:26:45.896 INFO:tasks.workunit.client.0.smithi148.stdout:8/701: mkdir d1/dd/d13/d1a/d25/da3/deb 0 2024-02-28T16:26:45.898 INFO:tasks.workunit.client.0.smithi148.stdout:0/876: mknod d1/d15/d3d/d67/c126 0 2024-02-28T16:26:45.900 INFO:tasks.workunit.client.0.smithi148.stdout:4/560: creat d8/d71/d85/fc7 x:0 0 0 2024-02-28T16:26:45.906 INFO:tasks.workunit.client.0.smithi148.stdout:8/702: rmdir d1/d3/d18/d5a/dbf 39 2024-02-28T16:26:45.909 INFO:tasks.workunit.client.0.smithi148.stdout:6/613: link d0/d22/d27/d3e/d52/la3 d0/d4/d14/d59/lc2 0 2024-02-28T16:26:45.914 INFO:tasks.workunit.client.0.smithi148.stdout:8/703: mknod d1/dd/d51/d9b/dc6/dae/cec 0 2024-02-28T16:26:45.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/647: write d2/d5/d40/f53 [610218,103337] 0 2024-02-28T16:26:45.930 INFO:tasks.workunit.client.0.smithi148.stdout:7/655: sync 2024-02-28T16:26:45.931 INFO:tasks.workunit.client.0.smithi148.stdout:8/704: dwrite d1/f7f [0,4194304] 0 2024-02-28T16:26:45.937 INFO:tasks.workunit.client.0.smithi148.stdout:0/877: truncate d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f61 1923234 0 2024-02-28T16:26:45.941 INFO:tasks.workunit.client.0.smithi148.stdout:0/878: creat d1/d15/d3d/d67/daf/f127 x:0 0 0 2024-02-28T16:26:45.942 INFO:tasks.workunit.client.0.smithi148.stdout:6/614: truncate d0/d22/d49/d88/f93 662015 0 2024-02-28T16:26:45.948 INFO:tasks.workunit.client.0.smithi148.stdout:0/879: symlink d1/d15/d27/l128 0 2024-02-28T16:26:45.950 INFO:tasks.workunit.client.0.smithi148.stdout:1/648: dwrite d2/d5/d2b/da7/dad/fa2 [0,4194304] 0 2024-02-28T16:26:45.951 INFO:tasks.workunit.client.0.smithi148.stdout:7/656: dwrite d0/d9/d25/d47/fa2 [0,4194304] 0 2024-02-28T16:26:45.954 INFO:tasks.workunit.client.0.smithi148.stdout:1/649: fdatasync d2/d5/d40/d7/d91/f81 0 2024-02-28T16:26:45.958 INFO:tasks.workunit.client.0.smithi148.stdout:1/650: stat d2/d5/d40/d7/dba 0 2024-02-28T16:26:45.960 INFO:tasks.workunit.client.0.smithi148.stdout:7/657: unlink d0/d9/d25/d47/d28/d2b/c72 0 2024-02-28T16:26:45.969 INFO:tasks.workunit.client.0.smithi148.stdout:0/880: link d1/d15/d27/d34/f6d d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/f129 0 2024-02-28T16:26:45.976 INFO:tasks.workunit.client.0.smithi148.stdout:6/615: dwrite d0/d4/d14/f82 [0,4194304] 0 2024-02-28T16:26:45.976 INFO:tasks.workunit.client.0.smithi148.stdout:7/658: getdents d0/d9/d25/d47 0 2024-02-28T16:26:45.979 INFO:tasks.workunit.client.0.smithi148.stdout:7/659: readlink d0/d9/l21 0 2024-02-28T16:26:45.982 INFO:tasks.workunit.client.0.smithi148.stdout:0/881: creat d1/d15/d27/d7a/dc6/f12a x:0 0 0 2024-02-28T16:26:45.985 INFO:tasks.workunit.client.0.smithi148.stdout:6/616: creat d0/d22/d25/d76/d7f/fc3 x:0 0 0 2024-02-28T16:26:45.988 INFO:tasks.workunit.client.0.smithi148.stdout:1/651: dwrite d2/d5/d2b/da7/dad/fc7 [0,4194304] 0 2024-02-28T16:26:45.997 INFO:tasks.workunit.client.0.smithi148.stdout:6/617: symlink d0/d22/d49/d88/d97/lc4 0 2024-02-28T16:26:46.004 INFO:tasks.workunit.client.0.smithi148.stdout:1/652: mkdir d2/d5/d40/d8/dcd 0 2024-02-28T16:26:46.007 INFO:tasks.workunit.client.0.smithi148.stdout:6/618: unlink d0/d22/d25/f36 0 2024-02-28T16:26:46.009 INFO:tasks.workunit.client.0.smithi148.stdout:7/660: rmdir d0/d9/d25/d47/d28/d2b/d6f/d82 39 2024-02-28T16:26:46.009 INFO:tasks.workunit.client.0.smithi148.stdout:6/619: fdatasync d0/d22/d49/d88/d97/fb6 0 2024-02-28T16:26:46.012 INFO:tasks.workunit.client.0.smithi148.stdout:7/661: write d0/d9/d25/f7c [1269263,119724] 0 2024-02-28T16:26:46.014 INFO:tasks.workunit.client.0.smithi148.stdout:6/620: read d0/f6e [488487,84659] 0 2024-02-28T16:26:46.021 INFO:tasks.workunit.client.0.smithi148.stdout:1/653: dread d2/d5/d40/f27 [4194304,4194304] 0 2024-02-28T16:26:46.023 INFO:tasks.workunit.client.0.smithi148.stdout:0/882: dwrite d1/d15/f78 [0,4194304] 0 2024-02-28T16:26:46.025 INFO:tasks.workunit.client.0.smithi148.stdout:6/621: link d0/d4/lad d0/d22/d25/d76/lc5 0 2024-02-28T16:26:46.026 INFO:tasks.workunit.client.0.smithi148.stdout:0/883: truncate d1/d15/d8/f52 4519429 0 2024-02-28T16:26:46.027 INFO:tasks.workunit.client.0.smithi148.stdout:1/654: mknod d2/d15/d8b/da3/dc2/cce 0 2024-02-28T16:26:46.029 INFO:tasks.workunit.client.0.smithi148.stdout:6/622: readlink d0/d22/d49/l9b 0 2024-02-28T16:26:46.032 INFO:tasks.workunit.client.0.smithi148.stdout:0/884: creat d1/d15/d27/f12b x:0 0 0 2024-02-28T16:26:46.033 INFO:tasks.workunit.client.0.smithi148.stdout:1/655: dread d2/d5/d40/d8/f10 [0,4194304] 0 2024-02-28T16:26:46.035 INFO:tasks.workunit.client.0.smithi148.stdout:6/623: mkdir d0/d22/d27/d66/d87/dc6 0 2024-02-28T16:26:46.037 INFO:tasks.workunit.client.0.smithi148.stdout:6/624: dread - d0/d22/d49/d88/d97/fb5 zero size 2024-02-28T16:26:46.038 INFO:tasks.workunit.client.0.smithi148.stdout:0/885: unlink d1/d8a/l9a 0 2024-02-28T16:26:46.041 INFO:tasks.workunit.client.0.smithi148.stdout:1/656: rename d2/d15/d62 to d2/d3f/dcf 0 2024-02-28T16:26:46.042 INFO:tasks.workunit.client.0.smithi148.stdout:0/886: creat d1/d15/d3d/d67/daf/f12c x:0 0 0 2024-02-28T16:26:46.043 INFO:tasks.workunit.client.0.smithi148.stdout:1/657: write d2/d3f/dcf/f7e [3986445,14253] 0 2024-02-28T16:26:46.048 INFO:tasks.workunit.client.0.smithi148.stdout:7/662: truncate d0/d9/d25/d47/d1c/d32/fa0 1276 0 2024-02-28T16:26:46.050 INFO:tasks.workunit.client.0.smithi148.stdout:0/887: creat d1/d15/d27/d34/d5a/d71/d80/df0/f12d x:0 0 0 2024-02-28T16:26:46.052 INFO:tasks.workunit.client.0.smithi148.stdout:1/658: rename d2/d3f/dcf/d75/d76/f92 to d2/d3f/d46/fd0 0 2024-02-28T16:26:46.052 INFO:tasks.workunit.client.0.smithi148.stdout:0/888: dread - d1/d15/d3d/d67/daf/ddc/ff6 zero size 2024-02-28T16:26:46.056 INFO:tasks.workunit.client.0.smithi148.stdout:1/659: rmdir d2/d9c 39 2024-02-28T16:26:46.056 INFO:tasks.workunit.client.0.smithi148.stdout:1/660: chown d2 55 1 2024-02-28T16:26:46.059 INFO:tasks.workunit.client.0.smithi148.stdout:1/661: rmdir d2/d3f/d9d 39 2024-02-28T16:26:46.060 INFO:tasks.workunit.client.0.smithi148.stdout:1/662: chown d2/f41 1 1 2024-02-28T16:26:46.063 INFO:tasks.workunit.client.0.smithi148.stdout:6/625: truncate d0/d22/d25/d76/f79 52873 0 2024-02-28T16:26:46.065 INFO:tasks.workunit.client.0.smithi148.stdout:1/663: truncate d2/d15/d8b/da3/fb4 1558110 0 2024-02-28T16:26:46.066 INFO:tasks.workunit.client.0.smithi148.stdout:7/663: dwrite d0/d18/f79 [4194304,4194304] 0 2024-02-28T16:26:46.069 INFO:tasks.workunit.client.0.smithi148.stdout:1/664: write d2/d5/d40/d8/f21 [3548473,88614] 0 2024-02-28T16:26:46.071 INFO:tasks.workunit.client.0.smithi148.stdout:0/889: write d1/d15/d3d/ffb [1149668,31222] 0 2024-02-28T16:26:46.076 INFO:tasks.workunit.client.0.smithi148.stdout:0/890: read d1/d15/f55 [2121594,22189] 0 2024-02-28T16:26:46.082 INFO:tasks.workunit.client.0.smithi148.stdout:7/664: getdents d0/d9/d25 0 2024-02-28T16:26:46.085 INFO:tasks.workunit.client.0.smithi148.stdout:1/665: getdents d2/d15/d8b/db0 0 2024-02-28T16:26:46.087 INFO:tasks.workunit.client.0.smithi148.stdout:0/891: mknod d1/d15/d27/d34/d5a/d71/c12e 0 2024-02-28T16:26:46.088 INFO:tasks.workunit.client.0.smithi148.stdout:1/666: chown d2/d25/l58 1397 1 2024-02-28T16:26:46.088 INFO:tasks.workunit.client.0.smithi148.stdout:6/626: dwrite d0/d22/d27/f62 [8388608,4194304] 0 2024-02-28T16:26:46.095 INFO:tasks.workunit.client.0.smithi148.stdout:0/892: mknod d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/c12f 0 2024-02-28T16:26:46.095 INFO:tasks.workunit.client.0.smithi148.stdout:7/665: getdents d0/d9/d25/d47/d1c 0 2024-02-28T16:26:46.098 INFO:tasks.workunit.client.0.smithi148.stdout:7/666: stat d0/dc8/ca1 0 2024-02-28T16:26:46.100 INFO:tasks.workunit.client.0.smithi148.stdout:6/627: creat d0/d22/d27/fc7 x:0 0 0 2024-02-28T16:26:46.102 INFO:tasks.workunit.client.0.smithi148.stdout:0/893: dread d1/d15/d27/d7a/dc6/dc4/d110/f125 [0,4194304] 0 2024-02-28T16:26:46.103 INFO:tasks.workunit.client.0.smithi148.stdout:1/667: dread d2/d3f/d46/f9f [0,4194304] 0 2024-02-28T16:26:46.105 INFO:tasks.workunit.client.0.smithi148.stdout:0/894: read d1/d15/d27/d34/d5a/dcd/f11b [2805956,74162] 0 2024-02-28T16:26:46.107 INFO:tasks.workunit.client.0.smithi148.stdout:1/668: creat d2/d15/d8b/da3/dc2/fd1 x:0 0 0 2024-02-28T16:26:46.108 INFO:tasks.workunit.client.0.smithi148.stdout:6/628: link d0/d4/dba/fa0 d0/d4/d14/d8a/da2/fc8 0 2024-02-28T16:26:46.119 INFO:tasks.workunit.client.0.smithi148.stdout:2/597: sync 2024-02-28T16:26:46.119 INFO:tasks.workunit.client.0.smithi148.stdout:3/714: sync 2024-02-28T16:26:46.119 INFO:tasks.workunit.client.0.smithi148.stdout:9/746: sync 2024-02-28T16:26:46.119 INFO:tasks.workunit.client.0.smithi148.stdout:5/592: sync 2024-02-28T16:26:46.120 INFO:tasks.workunit.client.0.smithi148.stdout:0/895: write d1/d15/d27/d34/d5a/d9d/d4a/f57 [1917399,108683] 0 2024-02-28T16:26:46.125 INFO:tasks.workunit.client.0.smithi148.stdout:9/747: dread - d7/d1c/d1f/d49/dd8/ff2 zero size 2024-02-28T16:26:46.126 INFO:tasks.workunit.client.0.smithi148.stdout:0/896: readlink d1/d15/d27/d7a/lb9 0 2024-02-28T16:26:46.127 INFO:tasks.workunit.client.0.smithi148.stdout:6/629: dwrite d0/d22/d27/d3e/f7b [0,4194304] 0 2024-02-28T16:26:46.129 INFO:tasks.workunit.client.0.smithi148.stdout:5/593: truncate d1/db/d60/fa8 753961 0 2024-02-28T16:26:46.131 INFO:tasks.workunit.client.0.smithi148.stdout:6/630: chown d0/d4/d14 39 1 2024-02-28T16:26:46.132 INFO:tasks.workunit.client.0.smithi148.stdout:2/598: truncate d0/d1d/d52/d9c/faf 211112 0 2024-02-28T16:26:46.132 INFO:tasks.workunit.client.0.smithi148.stdout:1/669: dwrite d2/d3f/dcf/d75/d76/fa9 [0,4194304] 0 2024-02-28T16:26:46.132 INFO:tasks.workunit.client.0.smithi148.stdout:9/748: mknod d7/d1c/d59/c101 0 2024-02-28T16:26:46.135 INFO:tasks.workunit.client.0.smithi148.stdout:5/594: write d1/d8/d20/d31/f6c [766971,7569] 0 2024-02-28T16:26:46.136 INFO:tasks.workunit.client.0.smithi148.stdout:6/631: creat d0/d4/d14/d8a/fc9 x:0 0 0 2024-02-28T16:26:46.137 INFO:tasks.workunit.client.0.smithi148.stdout:1/670: unlink d2/d5/d40/d7/fc 0 2024-02-28T16:26:46.141 INFO:tasks.workunit.client.0.smithi148.stdout:2/599: creat d0/d1c/d85/d96/fb4 x:0 0 0 2024-02-28T16:26:46.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/749: getdents d7/dd 0 2024-02-28T16:26:46.142 INFO:tasks.workunit.client.0.smithi148.stdout:5/595: chown d1/d8/d20/d31/la1 2 1 2024-02-28T16:26:46.147 INFO:tasks.workunit.client.0.smithi148.stdout:6/632: truncate d0/d22/d25/f4f 1302122 0 2024-02-28T16:26:46.153 INFO:tasks.workunit.client.0.smithi148.stdout:2/600: mkdir d0/d1d/d52/d9c/db5 0 2024-02-28T16:26:46.155 INFO:tasks.workunit.client.0.smithi148.stdout:5/596: rename d1/db/d60/d7a/d8b/c21 to d1/d8/d23/cb4 0 2024-02-28T16:26:46.159 INFO:tasks.workunit.client.0.smithi148.stdout:3/715: dwrite d1/d13/d19/d1b/d38/f43 [0,4194304] 0 2024-02-28T16:26:46.161 INFO:tasks.workunit.client.0.smithi148.stdout:0/897: link d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/f2e d1/d15/d27/d34/f130 0 2024-02-28T16:26:46.164 INFO:tasks.workunit.client.0.smithi148.stdout:6/633: rename d0/d4/dba/d71/fb2 to d0/d8/d21/d9d/fca 0 2024-02-28T16:26:46.165 INFO:tasks.workunit.client.0.smithi148.stdout:5/597: mknod d1/d8/cb5 0 2024-02-28T16:26:46.167 INFO:tasks.workunit.client.0.smithi148.stdout:2/601: unlink d0/l4 0 2024-02-28T16:26:46.170 INFO:tasks.workunit.client.0.smithi148.stdout:1/671: dwrite d2/d5/fc8 [0,4194304] 0 2024-02-28T16:26:46.172 INFO:tasks.workunit.client.0.smithi148.stdout:5/598: chown d1/db/d60/fac 356831 1 2024-02-28T16:26:46.172 INFO:tasks.workunit.client.0.smithi148.stdout:6/634: write d0/d4/f7a [121192,4461] 0 2024-02-28T16:26:46.175 INFO:tasks.workunit.client.0.smithi148.stdout:9/750: getdents d7/d1c/d74/d6b 0 2024-02-28T16:26:46.176 INFO:tasks.workunit.client.0.smithi148.stdout:9/751: chown d7/d43/ddd/df1/df3 95028045 1 2024-02-28T16:26:46.179 INFO:tasks.workunit.client.0.smithi148.stdout:2/602: symlink d0/d1d/d52/d9c/lb6 0 2024-02-28T16:26:46.187 INFO:tasks.workunit.client.0.smithi148.stdout:2/603: unlink d0/d1c/d85/d8b/d8f/d9d/f31 0 2024-02-28T16:26:46.189 INFO:tasks.workunit.client.0.smithi148.stdout:2/604: write d0/dd/fab [125462,126683] 0 2024-02-28T16:26:46.190 INFO:tasks.workunit.client.0.smithi148.stdout:3/716: getdents d1 0 2024-02-28T16:26:46.196 INFO:tasks.workunit.client.0.smithi148.stdout:0/898: truncate d1/d15/d27/d34/f130 1068868 0 2024-02-28T16:26:46.197 INFO:tasks.workunit.client.0.smithi148.stdout:1/672: creat d2/d15/fd2 x:0 0 0 2024-02-28T16:26:46.199 INFO:tasks.workunit.client.0.smithi148.stdout:6/635: creat d0/d8/fcb x:0 0 0 2024-02-28T16:26:46.202 INFO:tasks.workunit.client.0.smithi148.stdout:3/717: creat d1/db/d45/d80/fc7 x:0 0 0 2024-02-28T16:26:46.204 INFO:tasks.workunit.client.0.smithi148.stdout:2/605: creat d0/d18/d20/d73/fb7 x:0 0 0 2024-02-28T16:26:46.208 INFO:tasks.workunit.client.0.smithi148.stdout:1/673: creat d2/d3f/dcf/d75/d76/fd3 x:0 0 0 2024-02-28T16:26:46.209 INFO:tasks.workunit.client.0.smithi148.stdout:0/899: mkdir d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/d131 0 2024-02-28T16:26:46.210 INFO:tasks.workunit.client.0.smithi148.stdout:0/900: fsync d1/d15/d27/d34/d5a/d6c/f88 0 2024-02-28T16:26:46.216 INFO:tasks.workunit.client.0.smithi148.stdout:5/599: dread d1/d8/d23/f52 [0,4194304] 0 2024-02-28T16:26:46.216 INFO:tasks.workunit.client.0.smithi148.stdout:6/636: fsync d0/d8/fcb 0 2024-02-28T16:26:46.218 INFO:tasks.workunit.client.0.smithi148.stdout:1/674: unlink d2/d3f/d46/f9f 0 2024-02-28T16:26:46.218 INFO:tasks.workunit.client.0.smithi148.stdout:6/637: write d0/d22/faf [1994824,8460] 0 2024-02-28T16:26:46.222 INFO:tasks.workunit.client.0.smithi148.stdout:9/752: truncate d7/d1c/d32/f54 5362584 0 2024-02-28T16:26:46.232 INFO:tasks.workunit.client.0.smithi148.stdout:5/600: chown d1/d8/c11 0 1 2024-02-28T16:26:46.236 INFO:tasks.workunit.client.0.smithi148.stdout:1/675: unlink d2/d5/d40/d7/d91/fc5 0 2024-02-28T16:26:46.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:45 smithi157 ceph-mon[38346]: pgmap v47: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 116 MiB/s wr, 281 op/s 2024-02-28T16:26:46.240 INFO:tasks.workunit.client.0.smithi148.stdout:1/676: write d2/d15/fd2 [201762,34407] 0 2024-02-28T16:26:46.242 INFO:tasks.workunit.client.0.smithi148.stdout:9/753: symlink d7/d1c/d1f/d49/d5c/l102 0 2024-02-28T16:26:46.247 INFO:tasks.workunit.client.0.smithi148.stdout:2/606: rename d0/f27 to d0/d1c/d85/d8b/d8f/d9d/fb8 0 2024-02-28T16:26:46.248 INFO:tasks.workunit.client.0.smithi148.stdout:3/718: truncate d1/d13/d19/d56/f6c 4147207 0 2024-02-28T16:26:46.251 INFO:tasks.workunit.client.0.smithi148.stdout:6/638: dread d0/d8/ff [0,4194304] 0 2024-02-28T16:26:46.252 INFO:tasks.workunit.client.0.smithi148.stdout:9/754: read d7/d1c/d1f/d49/d6a/fa6 [1575321,48373] 0 2024-02-28T16:26:46.253 INFO:tasks.workunit.client.0.smithi148.stdout:0/901: dread d1/d15/d27/d34/fba [0,4194304] 0 2024-02-28T16:26:46.254 INFO:tasks.workunit.client.0.smithi148.stdout:9/755: chown d7/dd/d26/c63 1623 1 2024-02-28T16:26:46.265 INFO:tasks.workunit.client.0.smithi148.stdout:3/719: creat d1/db/d45/d80/fc8 x:0 0 0 2024-02-28T16:26:46.265 INFO:tasks.workunit.client.0.smithi148.stdout:4/561: sync 2024-02-28T16:26:46.265 INFO:tasks.workunit.client.0.smithi148.stdout:8/705: sync 2024-02-28T16:26:46.267 INFO:tasks.workunit.client.0.smithi148.stdout:6/639: mkdir d0/d22/d25/dcc 0 2024-02-28T16:26:46.267 INFO:tasks.workunit.client.0.smithi148.stdout:8/706: dread - d1/fd0 zero size 2024-02-28T16:26:46.267 INFO:tasks.workunit.client.0.smithi148.stdout:4/562: write d8/f22 [2359010,35309] 0 2024-02-28T16:26:46.268 INFO:tasks.workunit.client.0.smithi148.stdout:9/756: mknod d7/d1c/d1f/d49/dd8/c103 0 2024-02-28T16:26:46.270 INFO:tasks.workunit.client.0.smithi148.stdout:6/640: write d0/d22/d27/fc7 [463497,73126] 0 2024-02-28T16:26:46.271 INFO:tasks.workunit.client.0.smithi148.stdout:0/902: creat d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/f132 x:0 0 0 2024-02-28T16:26:46.272 INFO:tasks.workunit.client.0.smithi148.stdout:1/677: mknod d2/d5/d40/dcc/cd4 0 2024-02-28T16:26:46.274 INFO:tasks.workunit.client.0.smithi148.stdout:6/641: dread - d0/d22/d49/d88/d97/fb6 zero size 2024-02-28T16:26:46.279 INFO:tasks.workunit.client.0.smithi148.stdout:3/720: write d1/d13/d19/d32/fb0 [282366,9821] 0 2024-02-28T16:26:46.279 INFO:tasks.workunit.client.0.smithi148.stdout:8/707: symlink d1/dd/d13/d1a/d25/led 0 2024-02-28T16:26:46.281 INFO:tasks.workunit.client.0.smithi148.stdout:4/563: mkdir d8/d21/d3d/dc8 0 2024-02-28T16:26:46.282 INFO:tasks.workunit.client.0.smithi148.stdout:9/757: creat d7/d1c/d74/d68/f104 x:0 0 0 2024-02-28T16:26:46.283 INFO:tasks.workunit.client.0.smithi148.stdout:9/758: readlink d7/d1c/l7a 0 2024-02-28T16:26:46.285 INFO:tasks.workunit.client.0.smithi148.stdout:2/607: creat d0/fb9 x:0 0 0 2024-02-28T16:26:46.286 INFO:tasks.workunit.client.0.smithi148.stdout:1/678: creat d2/d5/d40/d7/fd5 x:0 0 0 2024-02-28T16:26:46.288 INFO:tasks.workunit.client.0.smithi148.stdout:2/608: chown d0/d18/d20/c7d 1 1 2024-02-28T16:26:46.291 INFO:tasks.workunit.client.0.smithi148.stdout:8/708: symlink d1/dd/d51/d9b/lee 0 2024-02-28T16:26:46.293 INFO:tasks.workunit.client.0.smithi148.stdout:3/721: rename d1/db/d35/lad to d1/d13/d19/d1b/d38/d7c/lc9 0 2024-02-28T16:26:46.296 INFO:tasks.workunit.client.0.smithi148.stdout:9/759: creat d7/d1c/d74/d6b/f105 x:0 0 0 2024-02-28T16:26:46.299 INFO:tasks.workunit.client.0.smithi148.stdout:5/601: getdents d1/d8/d20/d4e/d84 0 2024-02-28T16:26:46.299 INFO:tasks.workunit.client.0.smithi148.stdout:1/679: mkdir d2/d5/d2b/da7/dd6 0 2024-02-28T16:26:46.306 INFO:tasks.workunit.client.0.smithi148.stdout:6/642: link d0/d22/d27/l39 d0/d22/d49/dae/lcd 0 2024-02-28T16:26:46.309 INFO:tasks.workunit.client.0.smithi148.stdout:6/643: fsync d0/d4/d14/d59/f94 0 2024-02-28T16:26:46.314 INFO:tasks.workunit.client.0.smithi148.stdout:9/760: dwrite d7/d1c/d59/d83/fb1 [0,4194304] 0 2024-02-28T16:26:46.314 INFO:tasks.workunit.client.0.smithi148.stdout:6/644: write d0/d4/fa1 [1241127,54627] 0 2024-02-28T16:26:46.317 INFO:tasks.workunit.client.0.smithi148.stdout:1/680: dread d2/d15/d33/f63 [0,4194304] 0 2024-02-28T16:26:46.320 INFO:tasks.workunit.client.0.smithi148.stdout:6/645: dread - d0/d4/d14/d59/fc0 zero size 2024-02-28T16:26:46.321 INFO:tasks.workunit.client.0.smithi148.stdout:8/709: rmdir d1/d3/d18/d48/d70/d75/d91/dcc/de8 0 2024-02-28T16:26:46.324 INFO:tasks.workunit.client.0.smithi148.stdout:5/602: dwrite d1/d44/d64/f9c [0,4194304] 0 2024-02-28T16:26:46.324 INFO:tasks.workunit.client.0.smithi148.stdout:4/564: dread d8/d21/d3d/d4d/d66/fa9 [0,4194304] 0 2024-02-28T16:26:46.330 INFO:tasks.workunit.client.0.smithi148.stdout:2/609: getdents d0/d18 0 2024-02-28T16:26:46.333 INFO:tasks.workunit.client.0.smithi148.stdout:0/903: dwrite d1/d15/d27/d34/d5a/d71/d80/db6/f95 [0,4194304] 0 2024-02-28T16:26:46.340 INFO:tasks.workunit.client.0.smithi148.stdout:3/722: link d1/d13/f6f d1/d13/d19/d1b/d38/fca 0 2024-02-28T16:26:46.342 INFO:tasks.workunit.client.0.smithi148.stdout:6/646: fdatasync d0/d22/d25/f4b 0 2024-02-28T16:26:46.343 INFO:tasks.workunit.client.0.smithi148.stdout:5/603: mknod d1/db/d60/cb6 0 2024-02-28T16:26:46.343 INFO:tasks.workunit.client.0.smithi148.stdout:0/904: chown d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/d25/l36 309 1 2024-02-28T16:26:46.346 INFO:tasks.workunit.client.0.smithi148.stdout:2/610: fsync d0/d9/d13/d38/d3a/fb1 0 2024-02-28T16:26:46.347 INFO:tasks.workunit.client.0.smithi148.stdout:5/604: readlink d1/l13 0 2024-02-28T16:26:46.348 INFO:tasks.workunit.client.0.smithi148.stdout:8/710: symlink d1/dd/d13/d24/d3a/lef 0 2024-02-28T16:26:46.351 INFO:tasks.workunit.client.0.smithi148.stdout:1/681: dwrite d2/f6c [0,4194304] 0 2024-02-28T16:26:46.355 INFO:tasks.workunit.client.0.smithi148.stdout:4/565: getdents d8/d37/d91 0 2024-02-28T16:26:46.361 INFO:tasks.workunit.client.0.smithi148.stdout:0/905: creat d1/d15/d27/d34/d5a/d9d/dc7/f133 x:0 0 0 2024-02-28T16:26:46.362 INFO:tasks.workunit.client.0.smithi148.stdout:2/611: symlink d0/d9/d13/d38/lba 0 2024-02-28T16:26:46.363 INFO:tasks.workunit.client.0.smithi148.stdout:0/906: stat d1/d15/d27/d34/d5a/d71 0 2024-02-28T16:26:46.365 INFO:tasks.workunit.client.0.smithi148.stdout:3/723: rename d1/db/fa1 to d1/d13/fcb 0 2024-02-28T16:26:46.367 INFO:tasks.workunit.client.0.smithi148.stdout:7/667: sync 2024-02-28T16:26:46.368 INFO:tasks.workunit.client.0.smithi148.stdout:6/647: dread d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:46.370 INFO:tasks.workunit.client.0.smithi148.stdout:1/682: creat d2/d15/d33/fd7 x:0 0 0 2024-02-28T16:26:46.371 INFO:tasks.workunit.client.0.smithi148.stdout:6/648: readlink d0/d4/d14/d8a/l99 0 2024-02-28T16:26:46.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:45 smithi148 ceph-mon[28767]: pgmap v47: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 116 MiB/s wr, 281 op/s 2024-02-28T16:26:46.375 INFO:tasks.workunit.client.0.smithi148.stdout:9/761: write d7/d1c/d59/d83/d88/f8a [696425,110869] 0 2024-02-28T16:26:46.379 INFO:tasks.workunit.client.0.smithi148.stdout:0/907: dread d1/d15/f78 [0,4194304] 0 2024-02-28T16:26:46.403 INFO:tasks.workunit.client.0.smithi148.stdout:1/683: mkdir d2/d5/d40/d8/dd8 0 2024-02-28T16:26:46.404 INFO:tasks.workunit.client.0.smithi148.stdout:9/762: rmdir d7/d43/ddd 39 2024-02-28T16:26:46.405 INFO:tasks.workunit.client.0.smithi148.stdout:4/566: truncate d8/d37/d91/f9a 436664 0 2024-02-28T16:26:46.406 INFO:tasks.workunit.client.0.smithi148.stdout:3/724: link d1/d13/d19/d56/f5e d1/d13/d19/d56/fcc 0 2024-02-28T16:26:46.410 INFO:tasks.workunit.client.0.smithi148.stdout:3/725: dread d1/d3f/f77 [0,4194304] 0 2024-02-28T16:26:46.414 INFO:tasks.workunit.client.0.smithi148.stdout:8/711: dread d1/d3/d18/d48/d70/d75/d84/fb2 [0,4194304] 0 2024-02-28T16:26:46.417 INFO:tasks.workunit.client.0.smithi148.stdout:7/668: creat d0/d9/d25/d47/d28/fcc x:0 0 0 2024-02-28T16:26:46.417 INFO:tasks.workunit.client.0.smithi148.stdout:5/605: dread d1/d8/fa3 [12582912,4194304] 0 2024-02-28T16:26:46.421 INFO:tasks.workunit.client.0.smithi148.stdout:0/908: dread d1/d15/d27/d34/d5a/d71/d80/db6/f95 [0,4194304] 0 2024-02-28T16:26:46.423 INFO:tasks.workunit.client.0.smithi148.stdout:3/726: mknod d1/ccd 0 2024-02-28T16:26:46.425 INFO:tasks.workunit.client.0.smithi148.stdout:1/684: write d2/d5/d40/d8/f10 [1154249,88387] 0 2024-02-28T16:26:46.426 INFO:tasks.workunit.client.0.smithi148.stdout:1/685: read - d2/d15/fbe zero size 2024-02-28T16:26:46.429 INFO:tasks.workunit.client.0.smithi148.stdout:1/686: fdatasync d2/d3f/dcf/f7e 0 2024-02-28T16:26:46.430 INFO:tasks.workunit.client.0.smithi148.stdout:7/669: chown d0/d9/d25/d47/d28/d2b/d5c 53 1 2024-02-28T16:26:46.432 INFO:tasks.workunit.client.0.smithi148.stdout:6/649: dwrite d0/d10/f13 [0,4194304] 0 2024-02-28T16:26:46.432 INFO:tasks.workunit.client.0.smithi148.stdout:9/763: write d7/faf [3346781,121580] 0 2024-02-28T16:26:46.438 INFO:tasks.workunit.client.0.smithi148.stdout:0/909: unlink d1/d8a/fc1 0 2024-02-28T16:26:46.438 INFO:tasks.workunit.client.0.smithi148.stdout:4/567: truncate d8/f69 3478179 0 2024-02-28T16:26:46.441 INFO:tasks.workunit.client.0.smithi148.stdout:4/568: read d8/d21/f54 [3625678,116953] 0 2024-02-28T16:26:46.443 INFO:tasks.workunit.client.0.smithi148.stdout:7/670: mkdir d0/d18/dcd 0 2024-02-28T16:26:46.444 INFO:tasks.workunit.client.0.smithi148.stdout:7/671: stat d0/f13 0 2024-02-28T16:26:46.445 INFO:tasks.workunit.client.0.smithi148.stdout:6/650: write d0/d22/d25/d76/d7f/f5c [933612,32622] 0 2024-02-28T16:26:46.448 INFO:tasks.workunit.client.0.smithi148.stdout:0/910: creat d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/f134 x:0 0 0 2024-02-28T16:26:46.450 INFO:tasks.workunit.client.0.smithi148.stdout:1/687: symlink d2/d5/d40/d8/dcd/ld9 0 2024-02-28T16:26:46.452 INFO:tasks.workunit.client.0.smithi148.stdout:4/569: mknod d8/d21/d3d/d4d/cc9 0 2024-02-28T16:26:46.454 INFO:tasks.workunit.client.0.smithi148.stdout:0/911: dread - d1/d15/d3d/d67/dee/f106 zero size 2024-02-28T16:26:46.455 INFO:tasks.workunit.client.0.smithi148.stdout:9/764: mkdir d7/d1c/d59/d83/de4/d106 0 2024-02-28T16:26:46.457 INFO:tasks.workunit.client.0.smithi148.stdout:0/912: readlink d1/d15/d27/la3 0 2024-02-28T16:26:46.458 INFO:tasks.workunit.client.0.smithi148.stdout:6/651: symlink d0/d22/d49/d88/d97/lce 0 2024-02-28T16:26:46.459 INFO:tasks.workunit.client.0.smithi148.stdout:5/606: truncate d1/db/d60/d7a/f88 213505 0 2024-02-28T16:26:46.461 INFO:tasks.workunit.client.0.smithi148.stdout:9/765: write d7/d1c/d32/f1a [3462472,107471] 0 2024-02-28T16:26:46.461 INFO:tasks.workunit.client.0.smithi148.stdout:3/727: mkdir d1/d13/dce 0 2024-02-28T16:26:46.462 INFO:tasks.workunit.client.0.smithi148.stdout:1/688: dread d2/d5/d2b/da7/dad/f7b [0,4194304] 0 2024-02-28T16:26:46.462 INFO:tasks.workunit.client.0.smithi148.stdout:8/712: dread d1/dd/d13/d1a/f3f [0,4194304] 0 2024-02-28T16:26:46.465 INFO:tasks.workunit.client.0.smithi148.stdout:5/607: write d1/d44/d64/f9c [4227058,127639] 0 2024-02-28T16:26:46.467 INFO:tasks.workunit.client.0.smithi148.stdout:1/689: read - d2/d3f/f97 zero size 2024-02-28T16:26:46.468 INFO:tasks.workunit.client.0.smithi148.stdout:5/608: chown d1/d8/d23 21247 1 2024-02-28T16:26:46.470 INFO:tasks.workunit.client.0.smithi148.stdout:1/690: write d2/d3f/f71 [292073,115299] 0 2024-02-28T16:26:46.471 INFO:tasks.workunit.client.0.smithi148.stdout:0/913: truncate d1/d15/f78 4152671 0 2024-02-28T16:26:46.472 INFO:tasks.workunit.client.0.smithi148.stdout:6/652: creat d0/d4/dba/fcf x:0 0 0 2024-02-28T16:26:46.474 INFO:tasks.workunit.client.0.smithi148.stdout:3/728: creat d1/d13/d19/d88/fcf x:0 0 0 2024-02-28T16:26:46.476 INFO:tasks.workunit.client.0.smithi148.stdout:7/672: write d0/d4/f15 [3199843,69168] 0 2024-02-28T16:26:46.477 INFO:tasks.workunit.client.0.smithi148.stdout:9/766: truncate d7/d43/fd0 222066 0 2024-02-28T16:26:46.479 INFO:tasks.workunit.client.0.smithi148.stdout:8/713: mknod d1/dd/d13/d1a/d25/d50/cf0 0 2024-02-28T16:26:46.484 INFO:tasks.workunit.client.0.smithi148.stdout:5/609: creat d1/db/d60/d7a/d8b/fb7 x:0 0 0 2024-02-28T16:26:46.487 INFO:tasks.workunit.client.0.smithi148.stdout:1/691: truncate d2/d5/d40/d7/d91/f7a 1308817 0 2024-02-28T16:26:46.491 INFO:tasks.workunit.client.0.smithi148.stdout:4/570: creat d8/df/fca x:0 0 0 2024-02-28T16:26:46.492 INFO:tasks.workunit.client.0.smithi148.stdout:7/673: stat d0/f76 0 2024-02-28T16:26:46.494 INFO:tasks.workunit.client.0.smithi148.stdout:9/767: mknod d7/d1c/d1f/d49/d6a/c107 0 2024-02-28T16:26:46.495 INFO:tasks.workunit.client.0.smithi148.stdout:8/714: rmdir d1/dd/d13/d1a 39 2024-02-28T16:26:46.498 INFO:tasks.workunit.client.0.smithi148.stdout:5/610: creat d1/d44/fb8 x:0 0 0 2024-02-28T16:26:46.499 INFO:tasks.workunit.client.0.smithi148.stdout:6/653: fsync d0/d4/dba/f1f 0 2024-02-28T16:26:46.502 INFO:tasks.workunit.client.0.smithi148.stdout:0/914: dread - d1/d15/d27/d34/d5a/d71/d80/df0/f109 zero size 2024-02-28T16:26:46.502 INFO:tasks.workunit.client.0.smithi148.stdout:5/611: truncate d1/db/d60/d7a/d87/f99 779425 0 2024-02-28T16:26:46.505 INFO:tasks.workunit.client.0.smithi148.stdout:4/571: unlink d8/d37/d91/c94 0 2024-02-28T16:26:46.507 INFO:tasks.workunit.client.0.smithi148.stdout:4/572: write d8/d21/d3d/d8c/fae [542630,88266] 0 2024-02-28T16:26:46.509 INFO:tasks.workunit.client.0.smithi148.stdout:9/768: mkdir d7/d1c/d1f/d49/d8d/d108 0 2024-02-28T16:26:46.512 INFO:tasks.workunit.client.0.smithi148.stdout:6/654: chown d0/d22/d49/dae/lcd 0 1 2024-02-28T16:26:46.516 INFO:tasks.workunit.client.0.smithi148.stdout:0/915: rename d1/d15/d27/d7a/dc6/f12a to d1/d15/d27/f135 0 2024-02-28T16:26:46.518 INFO:tasks.workunit.client.0.smithi148.stdout:7/674: symlink d0/d9/lce 0 2024-02-28T16:26:46.519 INFO:tasks.workunit.client.0.smithi148.stdout:4/573: mknod d8/d40/dc3/ccb 0 2024-02-28T16:26:46.521 INFO:tasks.workunit.client.0.smithi148.stdout:8/715: fdatasync d1/dd/d13/d1a/d25/d50/f89 0 2024-02-28T16:26:46.522 INFO:tasks.workunit.client.0.smithi148.stdout:4/574: write d8/df/d5f/f81 [915230,97264] 0 2024-02-28T16:26:46.524 INFO:tasks.workunit.client.0.smithi148.stdout:4/575: chown d8/df/d5f/f79 4003 1 2024-02-28T16:26:46.525 INFO:tasks.workunit.client.0.smithi148.stdout:1/692: write d2/d5/d40/d7/d91/f3a [833995,5997] 0 2024-02-28T16:26:46.532 INFO:tasks.workunit.client.0.smithi148.stdout:7/675: creat d0/d4/d70/fcf x:0 0 0 2024-02-28T16:26:46.533 INFO:tasks.workunit.client.0.smithi148.stdout:9/769: getdents d7/dd/dd2 0 2024-02-28T16:26:46.535 INFO:tasks.workunit.client.0.smithi148.stdout:8/716: creat d1/dd/d51/d9b/dc6/ff1 x:0 0 0 2024-02-28T16:26:46.535 INFO:tasks.workunit.client.0.smithi148.stdout:4/576: rmdir d8/d21/d3d/d4d/d66/dad 39 2024-02-28T16:26:46.536 INFO:tasks.workunit.client.0.smithi148.stdout:8/717: dread - d1/dd/d13/fb8 zero size 2024-02-28T16:26:46.537 INFO:tasks.workunit.client.0.smithi148.stdout:1/693: creat d2/d3f/dcf/d75/fda x:0 0 0 2024-02-28T16:26:46.540 INFO:tasks.workunit.client.0.smithi148.stdout:0/916: mkdir d1/d15/d27/d34/d5a/d9d/d4a/d92/d136 0 2024-02-28T16:26:46.541 INFO:tasks.workunit.client.0.smithi148.stdout:0/917: dread - d1/d15/d27/d7a/dc6/da7/f114 zero size 2024-02-28T16:26:46.545 INFO:tasks.workunit.client.0.smithi148.stdout:4/577: rename d8/f22 to d8/df/d5f/fcc 0 2024-02-28T16:26:46.545 INFO:tasks.workunit.client.0.smithi148.stdout:5/612: link d1/d8/d20/d31/c33 d1/db/d60/d7a/d8b/dad/cb9 0 2024-02-28T16:26:46.548 INFO:tasks.workunit.client.0.smithi148.stdout:6/655: getdents d0 0 2024-02-28T16:26:46.551 INFO:tasks.workunit.client.0.smithi148.stdout:9/770: dwrite d7/d1c/d74/d68/f104 [0,4194304] 0 2024-02-28T16:26:46.553 INFO:tasks.workunit.client.0.smithi148.stdout:0/918: mknod d1/d15/d3d/d67/daf/ddc/c137 0 2024-02-28T16:26:46.557 INFO:tasks.workunit.client.0.smithi148.stdout:8/718: link d1/d3/d18/d48/d70/f72 d1/d3/d9a/ff2 0 2024-02-28T16:26:46.558 INFO:tasks.workunit.client.0.smithi148.stdout:4/578: creat d8/d21/d3d/d8c/db0/fcd x:0 0 0 2024-02-28T16:26:46.561 INFO:tasks.workunit.client.0.smithi148.stdout:6/656: creat d0/d8/d21/fd0 x:0 0 0 2024-02-28T16:26:46.562 INFO:tasks.workunit.client.0.smithi148.stdout:7/676: write d0/f76 [2381937,104560] 0 2024-02-28T16:26:46.562 INFO:tasks.workunit.client.0.smithi148.stdout:8/719: dread d1/d3/d18/d48/d70/d75/d91/fab [0,4194304] 0 2024-02-28T16:26:46.564 INFO:tasks.workunit.client.0.smithi148.stdout:8/720: chown d1/dd/f93 183238788 1 2024-02-28T16:26:46.564 INFO:tasks.workunit.client.0.smithi148.stdout:0/919: symlink d1/d15/d27/d34/d5a/d6c/l138 0 2024-02-28T16:26:46.566 INFO:tasks.workunit.client.0.smithi148.stdout:8/721: write d1/f7 [5034668,48795] 0 2024-02-28T16:26:46.568 INFO:tasks.workunit.client.0.smithi148.stdout:1/694: getdents d2/d15/d83 0 2024-02-28T16:26:46.569 INFO:tasks.workunit.client.0.smithi148.stdout:8/722: stat d1/dd/d13/d24/fa5 0 2024-02-28T16:26:46.569 INFO:tasks.workunit.client.0.smithi148.stdout:0/920: chown d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/fe 0 1 2024-02-28T16:26:46.570 INFO:tasks.workunit.client.0.smithi148.stdout:9/771: symlink d7/d1c/d1f/d49/dae/dc9/d100/l109 0 2024-02-28T16:26:46.571 INFO:tasks.workunit.client.0.smithi148.stdout:8/723: write d1/fe0 [844553,126297] 0 2024-02-28T16:26:46.572 INFO:tasks.workunit.client.0.smithi148.stdout:6/657: mknod d0/d22/d27/d66/d87/dc6/cd1 0 2024-02-28T16:26:46.574 INFO:tasks.workunit.client.0.smithi148.stdout:1/695: creat d2/d5/d40/dcc/fdb x:0 0 0 2024-02-28T16:26:46.575 INFO:tasks.workunit.client.0.smithi148.stdout:8/724: rmdir d1/dd/d51 39 2024-02-28T16:26:46.578 INFO:tasks.workunit.client.0.smithi148.stdout:1/696: readlink d2/d3f/d46/l56 0 2024-02-28T16:26:46.578 INFO:tasks.workunit.client.0.smithi148.stdout:8/725: dread - d1/fd0 zero size 2024-02-28T16:26:46.578 INFO:tasks.workunit.client.0.smithi148.stdout:6/658: write d0/d4/d14/d8a/fc9 [770601,7245] 0 2024-02-28T16:26:46.578 INFO:tasks.workunit.client.0.smithi148.stdout:0/921: symlink d1/d15/d27/d34/d5a/d71/d80/l139 0 2024-02-28T16:26:46.580 INFO:tasks.workunit.client.0.smithi148.stdout:1/697: chown d2/d5/d2b/da7/dd6 74 1 2024-02-28T16:26:46.583 INFO:tasks.workunit.client.0.smithi148.stdout:9/772: rename d7/d1c/d74/d6b/ddb/fb4 to d7/d1c/d1f/d49/dd8/f10a 0 2024-02-28T16:26:46.585 INFO:tasks.workunit.client.0.smithi148.stdout:8/726: readlink d1/dd/d51/d9b/lee 0 2024-02-28T16:26:46.587 INFO:tasks.workunit.client.0.smithi148.stdout:0/922: unlink d1/d15/d27/d7a/fcb 0 2024-02-28T16:26:46.590 INFO:tasks.workunit.client.0.smithi148.stdout:1/698: mkdir d2/d3f/dcf/d75/d76/ddc 0 2024-02-28T16:26:46.595 INFO:tasks.workunit.client.0.smithi148.stdout:4/579: dwrite d8/f12 [8388608,4194304] 0 2024-02-28T16:26:46.596 INFO:tasks.workunit.client.0.smithi148.stdout:8/727: truncate d1/d3/d18/d48/d22/d34/f65 1506083 0 2024-02-28T16:26:46.599 INFO:tasks.workunit.client.0.smithi148.stdout:8/728: chown d1/d3/d18/d48/d70/d75/d91/dcc/ddf/f9e 1 1 2024-02-28T16:26:46.600 INFO:tasks.workunit.client.0.smithi148.stdout:9/773: mkdir d7/d1c/d32/d24/d10b 0 2024-02-28T16:26:46.600 INFO:tasks.workunit.client.0.smithi148.stdout:6/659: creat d0/d8/fd2 x:0 0 0 2024-02-28T16:26:46.602 INFO:tasks.workunit.client.0.smithi148.stdout:0/923: mknod d1/d15/d27/d34/d5a/d71/d80/c13a 0 2024-02-28T16:26:46.603 INFO:tasks.workunit.client.0.smithi148.stdout:0/924: stat d1/d15/ff5 0 2024-02-28T16:26:46.603 INFO:tasks.workunit.client.0.smithi148.stdout:4/580: fdatasync d8/d21/fbc 0 2024-02-28T16:26:46.607 INFO:tasks.workunit.client.0.smithi148.stdout:9/774: write d7/d43/fc0 [3808490,34825] 0 2024-02-28T16:26:46.612 INFO:tasks.workunit.client.0.smithi148.stdout:4/581: creat d8/d37/d91/fce x:0 0 0 2024-02-28T16:26:46.617 INFO:tasks.workunit.client.0.smithi148.stdout:6/660: creat d0/d4/dba/d71/fd3 x:0 0 0 2024-02-28T16:26:46.620 INFO:tasks.workunit.client.0.smithi148.stdout:4/582: read d8/d21/d3d/d4d/f5c [1737555,56478] 0 2024-02-28T16:26:46.622 INFO:tasks.workunit.client.0.smithi148.stdout:0/925: mknod d1/d15/d27/d7a/c13b 0 2024-02-28T16:26:46.623 INFO:tasks.workunit.client.0.smithi148.stdout:9/775: dread d7/d1c/d1f/d49/d8d/fc5 [0,4194304] 0 2024-02-28T16:26:46.634 INFO:tasks.workunit.client.0.smithi148.stdout:8/729: getdents d1/dd/d51 0 2024-02-28T16:26:46.637 INFO:tasks.workunit.client.0.smithi148.stdout:0/926: symlink d1/d15/d27/d34/d5a/d9d/d5f/d93/l13c 0 2024-02-28T16:26:46.716 INFO:tasks.workunit.client.0.smithi148.stdout:0/927: unlink d1/d15/d3d/d67/f89 0 2024-02-28T16:26:46.719 INFO:tasks.workunit.client.0.smithi148.stdout:9/776: write d7/dd/f2b [578481,115448] 0 2024-02-28T16:26:46.719 INFO:tasks.workunit.client.0.smithi148.stdout:1/699: dwrite d2/d5/d40/d7/d91/f7a [0,4194304] 0 2024-02-28T16:26:46.719 INFO:tasks.workunit.client.0.smithi148.stdout:6/661: truncate d0/d8/f6c 2756119 0 2024-02-28T16:26:46.725 INFO:tasks.workunit.client.0.smithi148.stdout:6/662: stat d0/d22/d27/d66/d87 0 2024-02-28T16:26:46.726 INFO:tasks.workunit.client.0.smithi148.stdout:8/730: dwrite d1/fcb [0,4194304] 0 2024-02-28T16:26:46.727 INFO:tasks.workunit.client.0.smithi148.stdout:0/928: dread - d1/d15/d27/d34/d5a/d9d/d5f/ff4 zero size 2024-02-28T16:26:46.728 INFO:tasks.workunit.client.0.smithi148.stdout:9/777: dread - d7/d1c/d1f/d49/da7/fee zero size 2024-02-28T16:26:46.730 INFO:tasks.workunit.client.0.smithi148.stdout:9/778: stat d7/d43 0 2024-02-28T16:26:46.731 INFO:tasks.workunit.client.0.smithi148.stdout:1/700: unlink d2/d3f/dcf/cbc 0 2024-02-28T16:26:46.733 INFO:tasks.workunit.client.0.smithi148.stdout:9/779: stat d7/d1c/d3d/cf0 0 2024-02-28T16:26:46.736 INFO:tasks.workunit.client.0.smithi148.stdout:8/731: creat d1/d3/d18/d48/d70/d75/d91/dcc/ddf/ff3 x:0 0 0 2024-02-28T16:26:46.737 INFO:tasks.workunit.client.0.smithi148.stdout:1/701: chown d2/d5/d40/d7/fa4 2 1 2024-02-28T16:26:46.739 INFO:tasks.workunit.client.0.smithi148.stdout:1/702: fdatasync d2/d3f/f97 0 2024-02-28T16:26:46.739 INFO:tasks.workunit.client.0.smithi148.stdout:8/732: stat d1/dd/d13/d24/d3a/d49 0 2024-02-28T16:26:46.739 INFO:tasks.workunit.client.0.smithi148.stdout:4/583: dwrite d8/d21/d3d/f64 [0,4194304] 0 2024-02-28T16:26:46.742 INFO:tasks.workunit.client.0.smithi148.stdout:6/663: link d0/c68 d0/d22/d49/dae/cd4 0 2024-02-28T16:26:46.747 INFO:tasks.workunit.client.0.smithi148.stdout:1/703: getdents d2/d5/d2b/da7/dd6 0 2024-02-28T16:26:46.748 INFO:tasks.workunit.client.0.smithi148.stdout:1/704: readlink l1 0 2024-02-28T16:26:46.751 INFO:tasks.workunit.client.0.smithi148.stdout:4/584: dread d8/d21/f67 [0,4194304] 0 2024-02-28T16:26:46.751 INFO:tasks.workunit.client.0.smithi148.stdout:0/929: link d1/d15/d27/d34/d5a/l70 d1/d15/d27/d34/d5a/d6c/l13d 0 2024-02-28T16:26:46.756 INFO:tasks.workunit.client.0.smithi148.stdout:6/664: rename d0/d22/d25/d76/d7f/faa to d0/d4/dba/fd5 0 2024-02-28T16:26:46.761 INFO:tasks.workunit.client.0.smithi148.stdout:0/930: fdatasync d1/d15/f55 0 2024-02-28T16:26:46.767 INFO:tasks.workunit.client.0.smithi148.stdout:9/780: dwrite d7/d1c/d59/fa4 [0,4194304] 0 2024-02-28T16:26:46.769 INFO:tasks.workunit.client.0.smithi148.stdout:6/665: fsync d0/d4/d14/d8a/fab 0 2024-02-28T16:26:46.774 INFO:tasks.workunit.client.0.smithi148.stdout:0/931: write d1/d15/d8/f1d [5988943,5381] 0 2024-02-28T16:26:46.775 INFO:tasks.workunit.client.0.smithi148.stdout:4/585: chown d8/d21/d3d/d4d/d66/dad/cbf 108288 1 2024-02-28T16:26:46.776 INFO:tasks.workunit.client.0.smithi148.stdout:8/733: dwrite d1/dd/d51/d9b/fd6 [0,4194304] 0 2024-02-28T16:26:46.781 INFO:tasks.workunit.client.0.smithi148.stdout:0/932: stat d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/fe4 0 2024-02-28T16:26:46.782 INFO:tasks.workunit.client.0.smithi148.stdout:9/781: unlink d7/d1c/d59/d83/fc3 0 2024-02-28T16:26:46.782 INFO:tasks.workunit.client.0.smithi148.stdout:1/705: dwrite d2/d15/d8b/da3/fb4 [0,4194304] 0 2024-02-28T16:26:46.783 INFO:tasks.workunit.client.0.smithi148.stdout:8/734: chown d1/d3/d18/d48/d22/d55/l5b 446186792 1 2024-02-28T16:26:46.799 INFO:tasks.workunit.client.0.smithi148.stdout:0/933: creat d1/d8a/f13e x:0 0 0 2024-02-28T16:26:46.801 INFO:tasks.workunit.client.0.smithi148.stdout:4/586: dread d8/d21/d3d/d4d/f4e [0,4194304] 0 2024-02-28T16:26:46.802 INFO:tasks.workunit.client.0.smithi148.stdout:6/666: creat d0/d22/d27/d66/dbd/fd6 x:0 0 0 2024-02-28T16:26:46.805 INFO:tasks.workunit.client.0.smithi148.stdout:4/587: write d8/d71/d85/fc7 [947262,30948] 0 2024-02-28T16:26:46.805 INFO:tasks.workunit.client.0.smithi148.stdout:6/667: readlink d0/d22/d25/lbb 0 2024-02-28T16:26:46.806 INFO:tasks.workunit.client.0.smithi148.stdout:4/588: chown d8/d37/d91 13242411 1 2024-02-28T16:26:46.809 INFO:tasks.workunit.client.0.smithi148.stdout:9/782: mknod d7/d43/ddd/df1/c10c 0 2024-02-28T16:26:46.814 INFO:tasks.workunit.client.0.smithi148.stdout:0/934: read d1/d15/d27/d34/f6d [3828242,109659] 0 2024-02-28T16:26:46.818 INFO:tasks.workunit.client.0.smithi148.stdout:4/589: dread d8/d21/d3d/f88 [0,4194304] 0 2024-02-28T16:26:46.819 INFO:tasks.workunit.client.0.smithi148.stdout:9/783: fsync d7/d1c/d1f/d49/dd8/f10a 0 2024-02-28T16:26:46.820 INFO:tasks.workunit.client.0.smithi148.stdout:4/590: write d8/d21/d3d/d8c/db0/fcd [219034,107325] 0 2024-02-28T16:26:46.823 INFO:tasks.workunit.client.0.smithi148.stdout:4/591: readlink d8/df/d17/d6a/l51 0 2024-02-28T16:26:46.825 INFO:tasks.workunit.client.0.smithi148.stdout:0/935: symlink d1/d15/d3d/d67/daf/ddc/l13f 0 2024-02-28T16:26:46.834 INFO:tasks.workunit.client.0.smithi148.stdout:9/784: mkdir d7/d1c/d74/d68/d10d 0 2024-02-28T16:26:46.834 INFO:tasks.workunit.client.0.smithi148.stdout:8/735: write d1/d3/d9a/ff2 [4432313,34387] 0 2024-02-28T16:26:46.837 INFO:tasks.workunit.client.0.smithi148.stdout:8/736: write d1/f7f [2547873,97469] 0 2024-02-28T16:26:46.843 INFO:tasks.workunit.client.0.smithi148.stdout:9/785: stat d7/dd/d26/c4b 0 2024-02-28T16:26:46.850 INFO:tasks.workunit.client.0.smithi148.stdout:0/936: dwrite d1/d15/d27/d7a/dc6/da7/f114 [0,4194304] 0 2024-02-28T16:26:46.854 INFO:tasks.workunit.client.0.smithi148.stdout:1/706: dwrite d2/d5/d40/d7/f6e [0,4194304] 0 2024-02-28T16:26:46.855 INFO:tasks.workunit.client.0.smithi148.stdout:2/612: sync 2024-02-28T16:26:46.855 INFO:tasks.workunit.client.0.smithi148.stdout:4/592: dread d8/d21/f55 [0,4194304] 0 2024-02-28T16:26:46.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/737: dread d1/dd/d13/d1a/f4b [0,4194304] 0 2024-02-28T16:26:46.875 INFO:tasks.workunit.client.0.smithi148.stdout:6/668: dwrite d0/d22/d25/d76/f79 [0,4194304] 0 2024-02-28T16:26:46.875 INFO:tasks.workunit.client.0.smithi148.stdout:2/613: symlink d0/d18/d9a/lbb 0 2024-02-28T16:26:46.882 INFO:tasks.workunit.client.0.smithi148.stdout:9/786: write d7/d1c/d1f/d49/d6a/fa6 [4465538,24991] 0 2024-02-28T16:26:46.884 INFO:tasks.workunit.client.0.smithi148.stdout:1/707: dwrite d2/d5/d2b/da7/dad/fa2 [0,4194304] 0 2024-02-28T16:26:46.888 INFO:tasks.workunit.client.0.smithi148.stdout:8/738: mkdir d1/dd/d51/d77/df4 0 2024-02-28T16:26:46.891 INFO:tasks.workunit.client.0.smithi148.stdout:3/729: sync 2024-02-28T16:26:46.892 INFO:tasks.workunit.client.0.smithi148.stdout:7/677: sync 2024-02-28T16:26:46.892 INFO:tasks.workunit.client.0.smithi148.stdout:5/613: sync 2024-02-28T16:26:46.892 INFO:tasks.workunit.client.0.smithi148.stdout:2/614: creat d0/d9/d13/d38/d3a/fbc x:0 0 0 2024-02-28T16:26:46.896 INFO:tasks.workunit.client.0.smithi148.stdout:2/615: chown d0/d9/d13/d38/f3e 1757 1 2024-02-28T16:26:46.899 INFO:tasks.workunit.client.0.smithi148.stdout:6/669: rename d0/d22/d27/l5e to d0/d8/d21/d9d/ld7 0 2024-02-28T16:26:46.904 INFO:tasks.workunit.client.0.smithi148.stdout:9/787: fsync d7/d1c/d1f/d49/d8d/fc5 0 2024-02-28T16:26:46.909 INFO:tasks.workunit.client.0.smithi148.stdout:4/593: write d8/d21/d3d/f52 [918385,58662] 0 2024-02-28T16:26:46.909 INFO:tasks.workunit.client.0.smithi148.stdout:4/594: chown d8/df/d17/d6a/d6c 4075 1 2024-02-28T16:26:46.912 INFO:tasks.workunit.client.0.smithi148.stdout:8/739: unlink d1/d3/d18/d48/d22/fe2 0 2024-02-28T16:26:46.912 INFO:tasks.workunit.client.0.smithi148.stdout:4/595: write d8/df/da3/fa6 [837772,170] 0 2024-02-28T16:26:46.914 INFO:tasks.workunit.client.0.smithi148.stdout:8/740: read d1/fcb [3175600,76835] 0 2024-02-28T16:26:46.916 INFO:tasks.workunit.client.0.smithi148.stdout:4/596: write d8/d21/f54 [2944546,86109] 0 2024-02-28T16:26:46.920 INFO:tasks.workunit.client.0.smithi148.stdout:8/741: read - d1/dd/d13/d1a/d33/fdd zero size 2024-02-28T16:26:46.921 INFO:tasks.workunit.client.0.smithi148.stdout:8/742: chown d1/d3/d18 7993647 1 2024-02-28T16:26:46.926 INFO:tasks.workunit.client.0.smithi148.stdout:0/937: getdents d1/d15/d3d/d67 0 2024-02-28T16:26:46.929 INFO:tasks.workunit.client.0.smithi148.stdout:5/614: dread d1/f6f [0,4194304] 0 2024-02-28T16:26:46.929 INFO:tasks.workunit.client.0.smithi148.stdout:1/708: write d2/f26 [862589,129216] 0 2024-02-28T16:26:46.931 INFO:tasks.workunit.client.0.smithi148.stdout:0/938: read d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/fc8 [3582923,88023] 0 2024-02-28T16:26:47.002 INFO:tasks.workunit.client.0.smithi148.stdout:2/616: truncate d0/d18/f28 4370061 0 2024-02-28T16:26:47.004 INFO:tasks.workunit.client.0.smithi148.stdout:6/670: symlink d0/d22/d49/dae/ld8 0 2024-02-28T16:26:47.005 INFO:tasks.workunit.client.0.smithi148.stdout:2/617: read d0/dd/f88 [115194,46262] 0 2024-02-28T16:26:47.012 INFO:tasks.workunit.client.0.smithi148.stdout:5/615: fdatasync d1/d8/fa3 0 2024-02-28T16:26:47.014 INFO:tasks.workunit.client.0.smithi148.stdout:1/709: symlink d2/d5/d40/dcc/ldd 0 2024-02-28T16:26:47.016 INFO:tasks.workunit.client.0.smithi148.stdout:0/939: rmdir d1/d15/d27/d34/d5a/d9d/d5f/d93 39 2024-02-28T16:26:47.030 INFO:tasks.workunit.client.0.smithi148.stdout:9/788: truncate d7/d1c/d32/d24/fad 874639 0 2024-02-28T16:26:47.032 INFO:tasks.workunit.client.0.smithi148.stdout:6/671: mknod d0/d8/d21/d9d/cd9 0 2024-02-28T16:26:47.032 INFO:tasks.workunit.client.0.smithi148.stdout:9/789: fdatasync d7/dd/f2b 0 2024-02-28T16:26:47.034 INFO:tasks.workunit.client.0.smithi148.stdout:0/940: dwrite d1/d15/d3d/ffb [0,4194304] 0 2024-02-28T16:26:47.034 INFO:tasks.workunit.client.0.smithi148.stdout:6/672: chown d0/d22/d27/l7d 13236578 1 2024-02-28T16:26:47.037 INFO:tasks.workunit.client.0.smithi148.stdout:6/673: write d0/d4/d14/f81 [2604079,49952] 0 2024-02-28T16:26:47.038 INFO:tasks.workunit.client.0.smithi148.stdout:3/730: creat d1/db/fd0 x:0 0 0 2024-02-28T16:26:47.038 INFO:tasks.workunit.client.0.smithi148.stdout:0/941: read - d1/d15/d27/d7a/dc6/da7/f121 zero size 2024-02-28T16:26:47.040 INFO:tasks.workunit.client.0.smithi148.stdout:0/942: chown d1/d15/d27/f12b 52306 1 2024-02-28T16:26:47.041 INFO:tasks.workunit.client.0.smithi148.stdout:3/731: rename d1/db/d35/d52 to d1/db/d35/d52/dd1 22 2024-02-28T16:26:47.042 INFO:tasks.workunit.client.0.smithi148.stdout:5/616: symlink d1/d44/d65/lba 0 2024-02-28T16:26:47.044 INFO:tasks.workunit.client.0.smithi148.stdout:1/710: mknod d2/d5/d40/d7/d91/cde 0 2024-02-28T16:26:47.050 INFO:tasks.workunit.client.0.smithi148.stdout:8/743: truncate d1/d3/f47 4174720 0 2024-02-28T16:26:47.051 INFO:tasks.workunit.client.0.smithi148.stdout:7/678: link d0/lb1 d0/d9/d25/d47/d28/d2b/d3a/d6a/ld0 0 2024-02-28T16:26:47.052 INFO:tasks.workunit.client.0.smithi148.stdout:9/790: dwrite d7/d1c/d32/d24/dac/fe8 [0,4194304] 0 2024-02-28T16:26:47.055 INFO:tasks.workunit.client.0.smithi148.stdout:8/744: read - d1/dd/d13/d24/d3a/d49/fe1 zero size 2024-02-28T16:26:47.056 INFO:tasks.workunit.client.0.smithi148.stdout:2/618: mknod d0/d1c/cbd 0 2024-02-28T16:26:47.057 INFO:tasks.workunit.client.0.smithi148.stdout:6/674: dwrite d0/d22/d49/d88/d97/fb5 [0,4194304] 0 2024-02-28T16:26:47.057 INFO:tasks.workunit.client.0.smithi148.stdout:7/679: truncate d0/d9/d25/d47/f58 2738013 0 2024-02-28T16:26:47.059 INFO:tasks.workunit.client.0.smithi148.stdout:5/617: mkdir d1/db/d60/d7a/dbb 0 2024-02-28T16:26:47.060 INFO:tasks.workunit.client.0.smithi148.stdout:1/711: creat d2/d3f/d46/fdf x:0 0 0 2024-02-28T16:26:47.062 INFO:tasks.workunit.client.0.smithi148.stdout:1/712: fsync d2/f41 0 2024-02-28T16:26:47.062 INFO:tasks.workunit.client.0.smithi148.stdout:7/680: chown d0/d18/f79 30495876 1 2024-02-28T16:26:47.066 INFO:tasks.workunit.client.0.smithi148.stdout:5/618: truncate d1/db/d60/d7a/d8b/f9e 895747 0 2024-02-28T16:26:47.069 INFO:tasks.workunit.client.0.smithi148.stdout:6/675: dread d0/d22/d25/f4b [0,4194304] 0 2024-02-28T16:26:47.069 INFO:tasks.workunit.client.0.smithi148.stdout:2/619: truncate d0/d1c/d85/d8b/d8f/d9d/f4f 1388919 0 2024-02-28T16:26:47.070 INFO:tasks.workunit.client.0.smithi148.stdout:0/943: creat d1/d15/d27/d34/d5a/d9d/d4a/d92/d136/f140 x:0 0 0 2024-02-28T16:26:47.071 INFO:tasks.workunit.client.0.smithi148.stdout:2/620: write d0/d18/f19 [260922,61947] 0 2024-02-28T16:26:47.075 INFO:tasks.workunit.client.0.smithi148.stdout:6/676: write d0/d4/f7a [783695,50996] 0 2024-02-28T16:26:47.079 INFO:tasks.workunit.client.0.smithi148.stdout:9/791: creat d7/d1c/d74/d68/d10d/f10e x:0 0 0 2024-02-28T16:26:47.081 INFO:tasks.workunit.client.0.smithi148.stdout:9/792: fdatasync d7/d1c/d32/f1a 0 2024-02-28T16:26:47.091 INFO:tasks.workunit.client.0.smithi148.stdout:7/681: dread d0/d9/d25/d47/f27 [0,4194304] 0 2024-02-28T16:26:47.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/621: symlink d0/d1c/d85/d8b/lbe 0 2024-02-28T16:26:47.105 INFO:tasks.workunit.client.0.smithi148.stdout:1/713: rename d2/c5e to d2/d5/d40/d7/dba/ce0 0 2024-02-28T16:26:47.106 INFO:tasks.workunit.client.0.smithi148.stdout:9/793: dwrite d7/d1c/d74/d6b/ddb/ff7 [0,4194304] 0 2024-02-28T16:26:47.110 INFO:tasks.workunit.client.0.smithi148.stdout:9/794: chown d7/d1c/d74/d6b/ddb/ff7 1 1 2024-02-28T16:26:47.116 INFO:tasks.workunit.client.0.smithi148.stdout:7/682: fdatasync d0/f13 0 2024-02-28T16:26:47.120 INFO:tasks.workunit.client.0.smithi148.stdout:1/714: fdatasync d2/d3f/d46/fd0 0 2024-02-28T16:26:47.121 INFO:tasks.workunit.client.0.smithi148.stdout:8/745: getdents d1/d3/d18/d48/d22 0 2024-02-28T16:26:47.122 INFO:tasks.workunit.client.0.smithi148.stdout:0/944: dread d1/fd7 [0,4194304] 0 2024-02-28T16:26:47.123 INFO:tasks.workunit.client.0.smithi148.stdout:5/619: creat d1/d8/fbc x:0 0 0 2024-02-28T16:26:47.124 INFO:tasks.workunit.client.0.smithi148.stdout:8/746: readlink d1/dd/d13/d1a/d25/d50/l64 0 2024-02-28T16:26:47.127 INFO:tasks.workunit.client.0.smithi148.stdout:2/622: chown d0/d1d/d52/da3 181 1 2024-02-28T16:26:47.132 INFO:tasks.workunit.client.0.smithi148.stdout:9/795: dread d7/d1c/d59/d83/d88/f8a [0,4194304] 0 2024-02-28T16:26:47.134 INFO:tasks.workunit.client.0.smithi148.stdout:1/715: symlink d2/d5/d40/d7/d99/le1 0 2024-02-28T16:26:47.143 INFO:tasks.workunit.client.0.smithi148.stdout:6/677: getdents d0/d22/d27/d66/dbd 0 2024-02-28T16:26:47.145 INFO:tasks.workunit.client.0.smithi148.stdout:9/796: mknod d7/d1c/d74/c10f 0 2024-02-28T16:26:47.146 INFO:tasks.workunit.client.0.smithi148.stdout:8/747: dwrite d1/dd/d51/d9b/fd6 [0,4194304] 0 2024-02-28T16:26:47.150 INFO:tasks.workunit.client.0.smithi148.stdout:0/945: dwrite d1/d15/d27/d34/d5a/d6c/f88 [4194304,4194304] 0 2024-02-28T16:26:47.164 INFO:tasks.workunit.client.0.smithi148.stdout:8/748: mkdir d1/d3/d18/d48/d70/d75/d91/dcc/ddf/df5 0 2024-02-28T16:26:47.167 INFO:tasks.workunit.client.0.smithi148.stdout:0/946: fdatasync d1/d15/d27/d34/d5a/dcd/f11b 0 2024-02-28T16:26:47.168 INFO:tasks.workunit.client.0.smithi148.stdout:6/678: unlink d0/d4/l78 0 2024-02-28T16:26:47.171 INFO:tasks.workunit.client.0.smithi148.stdout:8/749: write d1/d3/d18/d48/d70/f72 [4714492,22848] 0 2024-02-28T16:26:47.176 INFO:tasks.workunit.client.0.smithi148.stdout:9/797: dwrite d7/d43/de0/ffd [0,4194304] 0 2024-02-28T16:26:47.182 INFO:tasks.workunit.client.0.smithi148.stdout:7/683: write d0/d9/d25/d47/d1c/d32/fa0 [852031,42629] 0 2024-02-28T16:26:47.186 INFO:tasks.workunit.client.0.smithi148.stdout:8/750: symlink d1/dd/d13/d24/d3a/lf6 0 2024-02-28T16:26:47.187 INFO:tasks.workunit.client.0.smithi148.stdout:1/716: dread d2/d15/f4d [0,4194304] 0 2024-02-28T16:26:47.188 INFO:tasks.workunit.client.0.smithi148.stdout:1/717: chown d2 174515 1 2024-02-28T16:26:47.193 INFO:tasks.workunit.client.0.smithi148.stdout:5/620: write d1/d8/d20/d31/d50/f56 [1577449,116600] 0 2024-02-28T16:26:47.198 INFO:tasks.workunit.client.0.smithi148.stdout:4/597: sync 2024-02-28T16:26:47.201 INFO:tasks.workunit.client.0.smithi148.stdout:2/623: dwrite d0/d1d/f5c [0,4194304] 0 2024-02-28T16:26:47.203 INFO:tasks.workunit.client.0.smithi148.stdout:1/718: rename d2/d5/d2b to d2/d5/d40/d8/dd8/de2 0 2024-02-28T16:26:47.205 INFO:tasks.workunit.client.0.smithi148.stdout:4/598: fdatasync d8/d37/d91/fce 0 2024-02-28T16:26:47.207 INFO:tasks.workunit.client.0.smithi148.stdout:6/679: truncate d0/d22/d27/d3e/f7b 1795242 0 2024-02-28T16:26:47.207 INFO:tasks.workunit.client.0.smithi148.stdout:1/719: chown d2/d5/d40/d7/d91/f81 96916 1 2024-02-28T16:26:47.208 INFO:tasks.workunit.client.0.smithi148.stdout:9/798: creat d7/d1c/d32/d24/f110 x:0 0 0 2024-02-28T16:26:47.211 INFO:tasks.workunit.client.0.smithi148.stdout:1/720: dread - d2/d3f/dcf/f65 zero size 2024-02-28T16:26:47.211 INFO:tasks.workunit.client.0.smithi148.stdout:5/621: mknod d1/d8e/cbd 0 2024-02-28T16:26:47.211 INFO:tasks.workunit.client.0.smithi148.stdout:0/947: truncate d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/fc8 2213366 0 2024-02-28T16:26:47.213 INFO:tasks.workunit.client.0.smithi148.stdout:2/624: mkdir d0/d1c/d85/d96/dbf 0 2024-02-28T16:26:47.217 INFO:tasks.workunit.client.0.smithi148.stdout:8/751: dwrite d1/dd/d13/d1a/d25/fa6 [0,4194304] 0 2024-02-28T16:26:47.218 INFO:tasks.workunit.client.0.smithi148.stdout:4/599: rename d8/d21/l6e to d8/d21/d3d/d8c/lcf 0 2024-02-28T16:26:47.222 INFO:tasks.workunit.client.0.smithi148.stdout:4/600: readlink d8/l9 0 2024-02-28T16:26:47.228 INFO:tasks.workunit.client.0.smithi148.stdout:5/622: mkdir d1/d8/d20/d31/d50/dbe 0 2024-02-28T16:26:47.232 INFO:tasks.workunit.client.0.smithi148.stdout:4/601: mkdir d8/d21/d3d/d4d/dd0 0 2024-02-28T16:26:47.234 INFO:tasks.workunit.client.0.smithi148.stdout:0/948: creat d1/d15/d27/d34/d5a/f141 x:0 0 0 2024-02-28T16:26:47.235 INFO:tasks.workunit.client.0.smithi148.stdout:7/684: dwrite d0/f13 [0,4194304] 0 2024-02-28T16:26:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:46 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:47.241 INFO:tasks.workunit.client.0.smithi148.stdout:8/752: creat d1/dd/d13/ff7 x:0 0 0 2024-02-28T16:26:47.244 INFO:tasks.workunit.client.0.smithi148.stdout:5/623: creat d1/db/d60/d7a/dbb/fbf x:0 0 0 2024-02-28T16:26:47.246 INFO:tasks.workunit.client.0.smithi148.stdout:1/721: dread d2/f6c [0,4194304] 0 2024-02-28T16:26:47.253 INFO:tasks.workunit.client.0.smithi148.stdout:0/949: mknod d1/d15/d3d/d67/daf/c142 0 2024-02-28T16:26:47.256 INFO:tasks.workunit.client.0.smithi148.stdout:2/625: dwrite d0/d9/d13/d38/d3a/db3/f98 [0,4194304] 0 2024-02-28T16:26:47.271 INFO:tasks.workunit.client.0.smithi148.stdout:9/799: dwrite d7/d1c/d3d/f56 [0,4194304] 0 2024-02-28T16:26:47.272 INFO:tasks.workunit.client.0.smithi148.stdout:3/732: sync 2024-02-28T16:26:47.277 INFO:tasks.workunit.client.0.smithi148.stdout:6/680: dwrite d0/d22/d25/f4f [0,4194304] 0 2024-02-28T16:26:47.277 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:46 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:26:47.282 INFO:tasks.workunit.client.0.smithi148.stdout:9/800: fdatasync d7/d1c/d32/d24/f110 0 2024-02-28T16:26:47.282 INFO:tasks.workunit.client.0.smithi148.stdout:6/681: chown d0/d22/d25/d76/d7f 1089274 1 2024-02-28T16:26:47.289 INFO:tasks.workunit.client.0.smithi148.stdout:4/602: dwrite d8/df/d17/d6a/f50 [0,4194304] 0 2024-02-28T16:26:47.294 INFO:tasks.workunit.client.0.smithi148.stdout:7/685: dread d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:47.301 INFO:tasks.workunit.client.0.smithi148.stdout:0/950: mkdir d1/d15/d27/d34/d5a/d9d/d4a/d143 0 2024-02-28T16:26:47.304 INFO:tasks.workunit.client.0.smithi148.stdout:3/733: mknod d1/db/d35/d70/d9c/cd2 0 2024-02-28T16:26:47.306 INFO:tasks.workunit.client.0.smithi148.stdout:3/734: write d1/db/d35/d70/fb9 [216133,49897] 0 2024-02-28T16:26:47.308 INFO:tasks.workunit.client.0.smithi148.stdout:4/603: truncate d8/d21/d7e/fbb 319637 0 2024-02-28T16:26:47.309 INFO:tasks.workunit.client.0.smithi148.stdout:8/753: stat d1/d3/d18/d48/d70/d75/d84/da4/lb5 0 2024-02-28T16:26:47.310 INFO:tasks.workunit.client.0.smithi148.stdout:3/735: readlink d1/d13/d19/l4c 0 2024-02-28T16:26:47.311 INFO:tasks.workunit.client.0.smithi148.stdout:5/624: mknod d1/d44/d64/d63/cc0 0 2024-02-28T16:26:47.313 INFO:tasks.workunit.client.0.smithi148.stdout:8/754: chown d1/dd/f93 0 1 2024-02-28T16:26:47.314 INFO:tasks.workunit.client.0.smithi148.stdout:0/951: creat d1/df3/f144 x:0 0 0 2024-02-28T16:26:47.320 INFO:tasks.workunit.client.0.smithi148.stdout:2/626: dwrite d0/d1d/f77 [4194304,4194304] 0 2024-02-28T16:26:47.322 INFO:tasks.workunit.client.0.smithi148.stdout:2/627: read d0/d18/d9a/f7b [3180430,29714] 0 2024-02-28T16:26:47.323 INFO:tasks.workunit.client.0.smithi148.stdout:5/625: rmdir d1/db/d60/d7a/d98 39 2024-02-28T16:26:47.332 INFO:tasks.workunit.client.0.smithi148.stdout:8/755: mknod d1/dd/d13/d68/cf8 0 2024-02-28T16:26:47.332 INFO:tasks.workunit.client.0.smithi148.stdout:6/682: link d0/d8/d21/d9d/lb3 d0/d22/d27/d3e/lda 0 2024-02-28T16:26:47.332 INFO:tasks.workunit.client.0.smithi148.stdout:6/683: chown d0/d22/d27/d3e 0 1 2024-02-28T16:26:47.335 INFO:tasks.workunit.client.0.smithi148.stdout:2/628: mknod d0/d1d/d52/d84/cc0 0 2024-02-28T16:26:47.341 INFO:tasks.workunit.client.0.smithi148.stdout:6/684: dread - d0/d22/f65 zero size 2024-02-28T16:26:47.342 INFO:tasks.workunit.client.0.smithi148.stdout:4/604: link d8/df/f89 d8/d40/d73/fd1 0 2024-02-28T16:26:47.342 INFO:tasks.workunit.client.0.smithi148.stdout:7/686: getdents d0/d9/d25/d47/d28 0 2024-02-28T16:26:47.415 INFO:tasks.workunit.client.0.smithi148.stdout:5/626: creat d1/db/d60/d7a/fc1 x:0 0 0 2024-02-28T16:26:47.416 INFO:tasks.workunit.client.0.smithi148.stdout:4/605: write d8/d21/d3d/f9b [1820375,41865] 0 2024-02-28T16:26:47.419 INFO:tasks.workunit.client.0.smithi148.stdout:7/687: chown d0/d9/d25/f7e 214025389 1 2024-02-28T16:26:47.419 INFO:tasks.workunit.client.0.smithi148.stdout:0/952: dwrite d1/fd7 [4194304,4194304] 0 2024-02-28T16:26:47.421 INFO:tasks.workunit.client.0.smithi148.stdout:3/736: truncate d1/d13/f15 2349439 0 2024-02-28T16:26:47.423 INFO:tasks.workunit.client.0.smithi148.stdout:9/801: write d7/d1c/d32/d24/fad [952542,99637] 0 2024-02-28T16:26:47.424 INFO:tasks.workunit.client.0.smithi148.stdout:6/685: mknod d0/d8/cdb 0 2024-02-28T16:26:47.431 INFO:tasks.workunit.client.0.smithi148.stdout:0/953: symlink d1/d15/d3d/d67/daf/l145 0 2024-02-28T16:26:47.435 INFO:tasks.workunit.client.0.smithi148.stdout:2/629: dwrite d0/d9/d13/d38/d3a/db3/f8a [8388608,4194304] 0 2024-02-28T16:26:47.436 INFO:tasks.workunit.client.0.smithi148.stdout:3/737: truncate d1/d13/f1e 5042236 0 2024-02-28T16:26:47.442 INFO:tasks.workunit.client.0.smithi148.stdout:1/722: dwrite d2/d15/d33/f63 [0,4194304] 0 2024-02-28T16:26:47.443 INFO:tasks.workunit.client.0.smithi148.stdout:9/802: truncate d7/d1c/d1f/d49/da7/fee 134999 0 2024-02-28T16:26:47.454 INFO:tasks.workunit.client.0.smithi148.stdout:3/738: creat d1/db/d35/d70/fd3 x:0 0 0 2024-02-28T16:26:47.457 INFO:tasks.workunit.client.0.smithi148.stdout:4/606: dwrite d8/d40/d73/f7a [0,4194304] 0 2024-02-28T16:26:47.459 INFO:tasks.workunit.client.0.smithi148.stdout:7/688: rename d0/d9/d46/c64 to d0/d9/d25/d47/d28/d2b/cd1 0 2024-02-28T16:26:47.459 INFO:tasks.workunit.client.0.smithi148.stdout:9/803: truncate d7/d1c/f75 1198301 0 2024-02-28T16:26:47.464 INFO:tasks.workunit.client.0.smithi148.stdout:0/954: rename d1/d15/d27/d34/d5a/d71/c86 to d1/d15/d3d/d67/daf/c146 0 2024-02-28T16:26:47.470 INFO:tasks.workunit.client.0.smithi148.stdout:9/804: creat d7/d43/ddd/f111 x:0 0 0 2024-02-28T16:26:47.473 INFO:tasks.workunit.client.0.smithi148.stdout:6/686: write d0/d22/d27/d3e/f45 [901942,22084] 0 2024-02-28T16:26:47.474 INFO:tasks.workunit.client.0.smithi148.stdout:7/689: mknod d0/d9/d25/d47/d1c/dbf/cd2 0 2024-02-28T16:26:47.477 INFO:tasks.workunit.client.0.smithi148.stdout:5/627: dread d1/d8/f7b [0,4194304] 0 2024-02-28T16:26:47.477 INFO:tasks.workunit.client.0.smithi148.stdout:7/690: fdatasync d0/f13 0 2024-02-28T16:26:47.480 INFO:tasks.workunit.client.0.smithi148.stdout:1/723: dwrite d2/d15/f78 [0,4194304] 0 2024-02-28T16:26:47.481 INFO:tasks.workunit.client.0.smithi148.stdout:5/628: chown d1/f55 1537 1 2024-02-28T16:26:47.482 INFO:tasks.workunit.client.0.smithi148.stdout:9/805: dread d7/d1c/d1f/d49/da7/fee [0,4194304] 0 2024-02-28T16:26:47.484 INFO:tasks.workunit.client.0.smithi148.stdout:6/687: symlink d0/d22/d49/d88/d97/ldc 0 2024-02-28T16:26:47.487 INFO:tasks.workunit.client.0.smithi148.stdout:1/724: dread - d2/d5/d40/fa5 zero size 2024-02-28T16:26:47.487 INFO:tasks.workunit.client.0.smithi148.stdout:2/630: dread d0/d1c/f1f [0,4194304] 0 2024-02-28T16:26:47.493 INFO:tasks.workunit.client.0.smithi148.stdout:7/691: read d0/d9/d25/d47/d28/d2b/d3a/d6a/db4/f84 [65880,45802] 0 2024-02-28T16:26:47.493 INFO:tasks.workunit.client.0.smithi148.stdout:6/688: write d0/d4/d14/f81 [1159015,60841] 0 2024-02-28T16:26:47.494 INFO:tasks.workunit.client.0.smithi148.stdout:2/631: write d0/d1c/d49/f9b [338702,57596] 0 2024-02-28T16:26:47.499 INFO:tasks.workunit.client.0.smithi148.stdout:1/725: fsync d2/d5/d40/d7/f38 0 2024-02-28T16:26:47.499 INFO:tasks.workunit.client.0.smithi148.stdout:5/629: rmdir d1/d44/d65 39 2024-02-28T16:26:47.508 INFO:tasks.workunit.client.0.smithi148.stdout:0/955: dwrite d1/d15/d27/d7a/dc6/da7/df1/fd4 [0,4194304] 0 2024-02-28T16:26:47.508 INFO:tasks.workunit.client.0.smithi148.stdout:2/632: mknod d0/d1c/cc1 0 2024-02-28T16:26:47.508 INFO:tasks.workunit.client.0.smithi148.stdout:1/726: write d2/d15/d8b/da3/dc2/fd1 [212246,23332] 0 2024-02-28T16:26:47.508 INFO:tasks.workunit.client.0.smithi148.stdout:4/607: dwrite d8/d21/d3d/d4d/f5c [0,4194304] 0 2024-02-28T16:26:47.509 INFO:tasks.workunit.client.0.smithi148.stdout:6/689: mknod d0/d22/d25/d76/cdd 0 2024-02-28T16:26:47.516 INFO:tasks.workunit.client.0.smithi148.stdout:2/633: write d0/d1c/f5f [156382,112305] 0 2024-02-28T16:26:47.516 INFO:tasks.workunit.client.0.smithi148.stdout:1/727: stat d2/d15/c5f 0 2024-02-28T16:26:47.518 INFO:tasks.workunit.client.0.smithi148.stdout:4/608: chown d8/f33 992 1 2024-02-28T16:26:47.528 INFO:tasks.workunit.client.0.smithi148.stdout:9/806: write d7/d43/fd0 [56866,112328] 0 2024-02-28T16:26:47.530 INFO:tasks.workunit.client.0.smithi148.stdout:3/739: dread d1/db/d35/f92 [0,4194304] 0 2024-02-28T16:26:47.532 INFO:tasks.workunit.client.0.smithi148.stdout:6/690: creat d0/d22/d27/d66/d87/fde x:0 0 0 2024-02-28T16:26:47.533 INFO:tasks.workunit.client.0.smithi148.stdout:3/740: dread - d1/d13/d19/fb8 zero size 2024-02-28T16:26:47.533 INFO:tasks.workunit.client.0.smithi148.stdout:2/634: creat d0/d1c/d85/fc2 x:0 0 0 2024-02-28T16:26:47.537 INFO:tasks.workunit.client.0.smithi148.stdout:7/692: write d0/d9/d25/d47/d28/d2b/d5c/f85 [54428,83232] 0 2024-02-28T16:26:47.541 INFO:tasks.workunit.client.0.smithi148.stdout:9/807: mkdir d7/d1c/d1f/d49/dae/dc9/d100/d112 0 2024-02-28T16:26:47.544 INFO:tasks.workunit.client.0.smithi148.stdout:5/630: getdents d1/d8 0 2024-02-28T16:26:47.546 INFO:tasks.workunit.client.0.smithi148.stdout:0/956: dwrite d1/d15/d27/d34/d5a/d71/d80/df0/f12d [0,4194304] 0 2024-02-28T16:26:47.548 INFO:tasks.workunit.client.0.smithi148.stdout:6/691: rmdir d0/d22/d27/d66/d87/dc6 39 2024-02-28T16:26:47.549 INFO:tasks.workunit.client.0.smithi148.stdout:2/635: write d0/d9/d13/f80 [616574,10310] 0 2024-02-28T16:26:47.549 INFO:tasks.workunit.client.0.smithi148.stdout:4/609: truncate d8/d37/d91/f9a 774075 0 2024-02-28T16:26:47.550 INFO:tasks.workunit.client.0.smithi148.stdout:7/693: write d0/d9/d25/fb9 [1693577,99323] 0 2024-02-28T16:26:47.552 INFO:tasks.workunit.client.0.smithi148.stdout:3/741: symlink d1/db/ld4 0 2024-02-28T16:26:47.553 INFO:tasks.workunit.client.0.smithi148.stdout:1/728: dwrite d2/d3f/dcf/d75/d76/fa9 [0,4194304] 0 2024-02-28T16:26:47.556 INFO:tasks.workunit.client.0.smithi148.stdout:9/808: mkdir d7/d43/ddd/df1/d113 0 2024-02-28T16:26:47.562 INFO:tasks.workunit.client.0.smithi148.stdout:8/756: sync 2024-02-28T16:26:47.569 INFO:tasks.workunit.client.0.smithi148.stdout:0/957: mkdir d1/d15/d27/d34/d5a/d9d/d147 0 2024-02-28T16:26:47.569 INFO:tasks.workunit.client.0.smithi148.stdout:6/692: rename d0/d22/d49/c7e to d0/d22/d25/d76/cdf 0 2024-02-28T16:26:47.572 INFO:tasks.workunit.client.0.smithi148.stdout:9/809: symlink d7/dd/d26/l114 0 2024-02-28T16:26:47.572 INFO:tasks.workunit.client.0.smithi148.stdout:0/958: read d1/d15/d27/d34/d5a/d9d/f6b [2035089,13774] 0 2024-02-28T16:26:47.573 INFO:tasks.workunit.client.0.smithi148.stdout:4/610: unlink d8/d71/lb6 0 2024-02-28T16:26:47.577 INFO:tasks.workunit.client.0.smithi148.stdout:1/729: creat d2/d5/d40/d8/dd8/de2/da7/dd6/fe3 x:0 0 0 2024-02-28T16:26:47.577 INFO:tasks.workunit.client.0.smithi148.stdout:8/757: truncate d1/d3/d18/d48/d70/d75/d84/fb2 2397023 0 2024-02-28T16:26:47.583 INFO:tasks.workunit.client.0.smithi148.stdout:6/693: dread d0/f6e [0,4194304] 0 2024-02-28T16:26:47.583 INFO:tasks.workunit.client.0.smithi148.stdout:7/694: getdents d0/d9/d25/d47/d28/d2b/d3a/d6a 0 2024-02-28T16:26:47.583 INFO:tasks.workunit.client.0.smithi148.stdout:1/730: stat d2/d15/d8b/db0/lc4 0 2024-02-28T16:26:47.584 INFO:tasks.workunit.client.0.smithi148.stdout:2/636: link d0/d1d/c75 d0/d59/cc3 0 2024-02-28T16:26:47.584 INFO:tasks.workunit.client.0.smithi148.stdout:0/959: stat d1/d15/d3d/d67/daf/ddc/l13f 0 2024-02-28T16:26:47.587 INFO:tasks.workunit.client.0.smithi148.stdout:6/694: fsync d0/d22/fa6 0 2024-02-28T16:26:47.590 INFO:tasks.workunit.client.0.smithi148.stdout:4/611: rmdir d8/d21/d3d/d8c/db0 39 2024-02-28T16:26:47.591 INFO:tasks.workunit.client.0.smithi148.stdout:6/695: fdatasync d0/d22/d27/d66/d87/fde 0 2024-02-28T16:26:47.593 INFO:tasks.workunit.client.0.smithi148.stdout:4/612: fsync d8/d21/d3d/f9b 0 2024-02-28T16:26:47.599 INFO:tasks.workunit.client.0.smithi148.stdout:1/731: symlink d2/d15/d8b/le4 0 2024-02-28T16:26:47.604 INFO:tasks.workunit.client.0.smithi148.stdout:7/695: unlink d0/d9/d25/d47/d28/f35 0 2024-02-28T16:26:47.609 INFO:tasks.workunit.client.0.smithi148.stdout:5/631: write d1/db/d60/d7a/f9d [983308,62410] 0 2024-02-28T16:26:47.610 INFO:tasks.workunit.client.0.smithi148.stdout:3/742: dread d1/db/d45/f7d [0,4194304] 0 2024-02-28T16:26:47.616 INFO:tasks.workunit.client.0.smithi148.stdout:6/696: dwrite d0/d8/d21/f8f [0,4194304] 0 2024-02-28T16:26:47.623 INFO:tasks.workunit.client.0.smithi148.stdout:9/810: dread d7/d1c/d32/f1a [0,4194304] 0 2024-02-28T16:26:47.624 INFO:tasks.workunit.client.0.smithi148.stdout:0/960: mkdir d1/d15/d27/d7a/dc6/da7/df1/d7e/d148 0 2024-02-28T16:26:47.624 INFO:tasks.workunit.client.0.smithi148.stdout:1/732: dwrite d2/d3f/dcf/d75/d76/fa9 [0,4194304] 0 2024-02-28T16:26:47.630 INFO:tasks.workunit.client.0.smithi148.stdout:1/733: write d2/d5/d40/f80 [1216735,20593] 0 2024-02-28T16:26:47.631 INFO:tasks.workunit.client.0.smithi148.stdout:8/758: write d1/d3/f80 [285172,84960] 0 2024-02-28T16:26:47.632 INFO:tasks.workunit.client.0.smithi148.stdout:1/734: fdatasync d2/f51 0 2024-02-28T16:26:47.635 INFO:tasks.workunit.client.0.smithi148.stdout:3/743: rmdir d1/d13/d19/d94 39 2024-02-28T16:26:47.638 INFO:tasks.workunit.client.0.smithi148.stdout:0/961: write d1/d15/d27/d34/d5a/d9d/d5f/ff4 [1030770,118710] 0 2024-02-28T16:26:47.639 INFO:tasks.workunit.client.0.smithi148.stdout:4/613: creat d8/d21/d3d/d8c/db0/fd2 x:0 0 0 2024-02-28T16:26:47.639 INFO:tasks.workunit.client.0.smithi148.stdout:8/759: chown d1/dd/d13/d68/f36 11 1 2024-02-28T16:26:47.655 INFO:tasks.workunit.client.0.smithi148.stdout:5/632: dwrite d1/db/d25/f7e [0,4194304] 0 2024-02-28T16:26:47.664 INFO:tasks.workunit.client.0.smithi148.stdout:1/735: symlink d2/d15/d83/d89/daa/le5 0 2024-02-28T16:26:47.673 INFO:tasks.workunit.client.0.smithi148.stdout:9/811: mknod d7/d1c/d1f/d49/dae/dc9/d100/d112/c115 0 2024-02-28T16:26:47.675 INFO:tasks.workunit.client.0.smithi148.stdout:6/697: truncate d0/d4/d14/f81 937231 0 2024-02-28T16:26:47.677 INFO:tasks.workunit.client.0.smithi148.stdout:9/812: chown d7/d1c/d1f/d49/d5c/l79 456725 1 2024-02-28T16:26:47.678 INFO:tasks.workunit.client.0.smithi148.stdout:8/760: creat d1/dd/d13/d1a/d87/ff9 x:0 0 0 2024-02-28T16:26:47.678 INFO:tasks.workunit.client.0.smithi148.stdout:5/633: dread d1/d8/f7b [0,4194304] 0 2024-02-28T16:26:47.680 INFO:tasks.workunit.client.0.smithi148.stdout:2/637: getdents d0/d1c/d85/d8b/d8f/d9d 0 2024-02-28T16:26:47.683 INFO:tasks.workunit.client.0.smithi148.stdout:7/696: dread - d0/d9/d25/d47/d28/d2b/d3a/d49/d97/fcb zero size 2024-02-28T16:26:47.686 INFO:tasks.workunit.client.0.smithi148.stdout:9/813: truncate d7/d43/ddd/f111 400232 0 2024-02-28T16:26:47.687 INFO:tasks.workunit.client.0.smithi148.stdout:2/638: write d0/d59/f7f [1551109,112594] 0 2024-02-28T16:26:47.689 INFO:tasks.workunit.client.0.smithi148.stdout:5/634: mkdir d1/db/d25/dc2 0 2024-02-28T16:26:47.690 INFO:tasks.workunit.client.0.smithi148.stdout:0/962: rmdir d1/d15/d27/d34/d5a/d9d/d147 0 2024-02-28T16:26:47.691 INFO:tasks.workunit.client.0.smithi148.stdout:9/814: chown d7/d1c/d74/c73 232 1 2024-02-28T16:26:47.692 INFO:tasks.workunit.client.0.smithi148.stdout:3/744: getdents d1/d13/d19/d88 0 2024-02-28T16:26:47.693 INFO:tasks.workunit.client.0.smithi148.stdout:1/736: dwrite d2/d5/d40/d8/f9 [0,4194304] 0 2024-02-28T16:26:47.693 INFO:tasks.workunit.client.0.smithi148.stdout:2/639: unlink d0/d1c/cbd 0 2024-02-28T16:26:47.696 INFO:tasks.workunit.client.0.smithi148.stdout:2/640: fsync d0/d1c/d49/f9b 0 2024-02-28T16:26:47.701 INFO:tasks.workunit.client.0.smithi148.stdout:0/963: mknod d1/d15/c149 0 2024-02-28T16:26:47.706 INFO:tasks.workunit.client.0.smithi148.stdout:5/635: chown d1/db/d60/d7a/d8b/dad/cb9 2749 1 2024-02-28T16:26:47.711 INFO:tasks.workunit.client.0.smithi148.stdout:2/641: symlink d0/d1c/d6e/lc4 0 2024-02-28T16:26:47.711 INFO:tasks.workunit.client.0.smithi148.stdout:6/698: dwrite d0/d4/dba/fd5 [0,4194304] 0 2024-02-28T16:26:47.712 INFO:tasks.workunit.client.0.smithi148.stdout:2/642: chown d0/d18/d20 447492793 1 2024-02-28T16:26:47.715 INFO:tasks.workunit.client.0.smithi148.stdout:9/815: mkdir d7/d1c/d1f/d49/d116 0 2024-02-28T16:26:47.716 INFO:tasks.workunit.client.0.smithi148.stdout:8/761: dwrite d1/dd/d13/d68/fc0 [0,4194304] 0 2024-02-28T16:26:47.722 INFO:tasks.workunit.client.0.smithi148.stdout:1/737: mknod d2/d15/d83/d89/daa/db1/ce6 0 2024-02-28T16:26:47.724 INFO:tasks.workunit.client.0.smithi148.stdout:2/643: creat d0/d18/d20/d46/fc5 x:0 0 0 2024-02-28T16:26:47.728 INFO:tasks.workunit.client.0.smithi148.stdout:9/816: rename d7/d43/da8/fea to d7/d1c/d3d/f117 0 2024-02-28T16:26:47.731 INFO:tasks.workunit.client.0.smithi148.stdout:2/644: read d0/f10 [3926120,11642] 0 2024-02-28T16:26:47.733 INFO:tasks.workunit.client.0.smithi148.stdout:8/762: mknod d1/dd/d51/d9b/dc6/dae/cfa 0 2024-02-28T16:26:47.743 INFO:tasks.workunit.client.0.smithi148.stdout:9/817: dread - d7/d1c/fe3 zero size 2024-02-28T16:26:47.745 INFO:tasks.workunit.client.0.smithi148.stdout:0/964: write d1/d15/d27/d7a/f11e [786806,106265] 0 2024-02-28T16:26:47.746 INFO:tasks.workunit.client.0.smithi148.stdout:2/645: rename d0/dd/c7e to d0/d1d/d52/d9c/db5/cc6 0 2024-02-28T16:26:47.747 INFO:tasks.workunit.client.0.smithi148.stdout:1/738: mkdir d2/d15/de7 0 2024-02-28T16:26:47.751 INFO:tasks.workunit.client.0.smithi148.stdout:3/745: dread d1/d13/d19/d1b/d38/fca [0,4194304] 0 2024-02-28T16:26:47.751 INFO:tasks.workunit.client.0.smithi148.stdout:5/636: dread d1/f26 [4194304,4194304] 0 2024-02-28T16:26:47.751 INFO:tasks.workunit.client.0.smithi148.stdout:9/818: write d7/dd/d26/f69 [3345245,48178] 0 2024-02-28T16:26:47.753 INFO:tasks.workunit.client.0.smithi148.stdout:6/699: dwrite d0/d22/d27/f62 [0,4194304] 0 2024-02-28T16:26:47.753 INFO:tasks.workunit.client.0.smithi148.stdout:0/965: write d1/d15/d27/d34/d5a/f66 [3564848,36111] 0 2024-02-28T16:26:47.758 INFO:tasks.workunit.client.0.smithi148.stdout:0/966: stat d1/d15/d27/d34/d5a/d71/d80/l120 0 2024-02-28T16:26:47.765 INFO:tasks.workunit.client.0.smithi148.stdout:1/739: rename d2/d3f/dcf/d75/d76/fa9 to d2/d15/d8b/db0/fe8 0 2024-02-28T16:26:47.766 INFO:tasks.workunit.client.0.smithi148.stdout:9/819: unlink d7/d1c/f75 0 2024-02-28T16:26:47.770 INFO:tasks.workunit.client.0.smithi148.stdout:8/763: dread d1/dd/d13/d1a/f3f [0,4194304] 0 2024-02-28T16:26:47.771 INFO:tasks.workunit.client.0.smithi148.stdout:5/637: creat d1/d8/d20/fc3 x:0 0 0 2024-02-28T16:26:47.773 INFO:tasks.workunit.client.0.smithi148.stdout:0/967: mknod d1/d15/d27/d34/d5a/d9d/dc7/df7/c14a 0 2024-02-28T16:26:47.777 INFO:tasks.workunit.client.0.smithi148.stdout:1/740: unlink d2/d5/d40/d7/d91/l20 0 2024-02-28T16:26:47.779 INFO:tasks.workunit.client.0.smithi148.stdout:0/968: chown d1/d15/d27/d34/d5a/d71/d80/c13a 91980525 1 2024-02-28T16:26:47.782 INFO:tasks.workunit.client.0.smithi148.stdout:8/764: creat d1/d3/de5/ffb x:0 0 0 2024-02-28T16:26:47.782 INFO:tasks.workunit.client.0.smithi148.stdout:1/741: dread - d2/d5/d40/d7/d99/faf zero size 2024-02-28T16:26:47.786 INFO:tasks.workunit.client.0.smithi148.stdout:0/969: rmdir d1/d8a 39 2024-02-28T16:26:47.786 INFO:tasks.workunit.client.0.smithi148.stdout:6/700: dwrite d0/d4/d14/d59/f75 [0,4194304] 0 2024-02-28T16:26:47.788 INFO:tasks.workunit.client.0.smithi148.stdout:6/701: write d0/d10/f6f [432152,24865] 0 2024-02-28T16:26:47.791 INFO:tasks.workunit.client.0.smithi148.stdout:6/702: chown d0/d22/d25/d76/d7f 55947 1 2024-02-28T16:26:47.791 INFO:tasks.workunit.client.0.smithi148.stdout:5/638: creat d1/d8/d20/d4e/d84/d92/fc4 x:0 0 0 2024-02-28T16:26:47.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/765: creat d1/dd/d51/d9b/ffc x:0 0 0 2024-02-28T16:26:47.799 INFO:tasks.workunit.client.0.smithi148.stdout:1/742: symlink d2/d15/de7/le9 0 2024-02-28T16:26:47.802 INFO:tasks.workunit.client.0.smithi148.stdout:5/639: creat d1/db/fc5 x:0 0 0 2024-02-28T16:26:47.804 INFO:tasks.workunit.client.0.smithi148.stdout:8/766: read d1/d3/d18/d5a/d60/f82 [3424753,42998] 0 2024-02-28T16:26:47.804 INFO:tasks.workunit.client.0.smithi148.stdout:6/703: unlink d0/d4/d14/ca4 0 2024-02-28T16:26:47.805 INFO:tasks.workunit.client.0.smithi148.stdout:5/640: write d1/db/d25/f7e [80460,125195] 0 2024-02-28T16:26:47.809 INFO:tasks.workunit.client.0.smithi148.stdout:0/970: write d1/d15/d27/d7a/dc6/da7/df1/dbc/f102 [601242,129392] 0 2024-02-28T16:26:47.810 INFO:tasks.workunit.client.0.smithi148.stdout:2/646: truncate d0/d59/f7f 2405962 0 2024-02-28T16:26:47.812 INFO:tasks.workunit.client.0.smithi148.stdout:1/743: creat d2/d5/d40/dcc/fea x:0 0 0 2024-02-28T16:26:47.813 INFO:tasks.workunit.client.0.smithi148.stdout:2/647: rename d0/d1c to d0/d1c/d85/d8b/d8f/d9d/dc7 22 2024-02-28T16:26:47.817 INFO:tasks.workunit.client.0.smithi148.stdout:6/704: mknod d0/d8/d21/ce0 0 2024-02-28T16:26:47.819 INFO:tasks.workunit.client.0.smithi148.stdout:3/746: truncate d1/d13/d19/d1b/f1f 3753649 0 2024-02-28T16:26:47.820 INFO:tasks.workunit.client.0.smithi148.stdout:8/767: symlink d1/dd/d51/d9b/dc6/lfd 0 2024-02-28T16:26:47.820 INFO:tasks.workunit.client.0.smithi148.stdout:3/747: stat d1/d13/f6f 0 2024-02-28T16:26:47.823 INFO:tasks.workunit.client.0.smithi148.stdout:3/748: fsync d1/d13/d19/d32/fb0 0 2024-02-28T16:26:47.826 INFO:tasks.workunit.client.0.smithi148.stdout:0/971: readlink d1/d15/d27/d7a/l5c 0 2024-02-28T16:26:47.828 INFO:tasks.workunit.client.0.smithi148.stdout:0/972: fsync d1/d15/d27/d34/d5a/d9d/dc7/df7/f103 0 2024-02-28T16:26:47.829 INFO:tasks.workunit.client.0.smithi148.stdout:2/648: creat d0/d1d/d52/d9c/fc8 x:0 0 0 2024-02-28T16:26:47.832 INFO:tasks.workunit.client.0.smithi148.stdout:6/705: rename d0/d22/d49/dae/ld8 to d0/d4/dba/d71/le1 0 2024-02-28T16:26:47.834 INFO:tasks.workunit.client.0.smithi148.stdout:6/706: chown d0/d8/d21/c64 505133345 1 2024-02-28T16:26:47.837 INFO:tasks.workunit.client.0.smithi148.stdout:6/707: chown d0/d22/d27/d66/d87/fde 106 1 2024-02-28T16:26:47.839 INFO:tasks.workunit.client.0.smithi148.stdout:8/768: rmdir d1/dd/d13/d24 39 2024-02-28T16:26:47.847 INFO:tasks.workunit.client.0.smithi148.stdout:1/744: creat d2/d3f/dcf/d75/d76/ddc/feb x:0 0 0 2024-02-28T16:26:47.854 INFO:tasks.workunit.client.0.smithi148.stdout:0/973: dread d1/d15/d27/d34/d5a/d9d/d4a/d92/fa8 [0,4194304] 0 2024-02-28T16:26:47.858 INFO:tasks.workunit.client.0.smithi148.stdout:1/745: mknod d2/d15/d8b/da3/dc2/cec 0 2024-02-28T16:26:47.860 INFO:tasks.workunit.client.0.smithi148.stdout:1/746: fdatasync d2/d5/d40/d7/d91/f8a 0 2024-02-28T16:26:47.861 INFO:tasks.workunit.client.0.smithi148.stdout:2/649: dread d0/d66/d76/f7c [0,4194304] 0 2024-02-28T16:26:47.865 INFO:tasks.workunit.client.0.smithi148.stdout:5/641: getdents d1/d8/d23 0 2024-02-28T16:26:47.867 INFO:tasks.workunit.client.0.smithi148.stdout:6/708: mknod d0/d8/ce2 0 2024-02-28T16:26:47.871 INFO:tasks.workunit.client.0.smithi148.stdout:8/769: dread d1/d3/d18/d48/d70/d75/d84/fb2 [0,4194304] 0 2024-02-28T16:26:47.873 INFO:tasks.workunit.client.0.smithi148.stdout:2/650: mkdir d0/d1c/d85/d8b/d8f/dc9 0 2024-02-28T16:26:47.877 INFO:tasks.workunit.client.0.smithi148.stdout:5/642: rename d1/ld to d1/db/d60/lc6 0 2024-02-28T16:26:47.878 INFO:tasks.workunit.client.0.smithi148.stdout:1/747: dwrite d2/d3f/d46/fdf [0,4194304] 0 2024-02-28T16:26:47.878 INFO:tasks.workunit.client.0.smithi148.stdout:3/749: dwrite d1/d13/d19/d88/f97 [0,4194304] 0 2024-02-28T16:26:47.881 INFO:tasks.workunit.client.0.smithi148.stdout:5/643: chown d1/f55 5 1 2024-02-28T16:26:47.882 INFO:tasks.workunit.client.0.smithi148.stdout:6/709: mknod d0/d22/d25/d76/d7f/ce3 0 2024-02-28T16:26:47.886 INFO:tasks.workunit.client.0.smithi148.stdout:2/651: dread - d0/d18/d20/f92 zero size 2024-02-28T16:26:47.890 INFO:tasks.workunit.client.0.smithi148.stdout:1/748: creat d2/d5/d40/d8/dcd/fed x:0 0 0 2024-02-28T16:26:47.895 INFO:tasks.workunit.client.0.smithi148.stdout:8/770: symlink d1/dd/d51/d77/df4/lfe 0 2024-02-28T16:26:47.895 INFO:tasks.workunit.client.0.smithi148.stdout:1/749: read d2/d3f/dcf/f7e [1518687,51609] 0 2024-02-28T16:26:47.898 INFO:tasks.workunit.client.0.smithi148.stdout:5/644: link d1/db/d60/fac d1/d8/d20/d4e/fc7 0 2024-02-28T16:26:47.899 INFO:tasks.workunit.client.0.smithi148.stdout:5/645: write d1/db/d25/f3a [164901,7688] 0 2024-02-28T16:26:47.905 INFO:tasks.workunit.client.0.smithi148.stdout:3/750: rename d1/l2 to d1/d3f/da5/ld5 0 2024-02-28T16:26:47.908 INFO:tasks.workunit.client.0.smithi148.stdout:3/751: write d1/d13/d19/d1b/f44 [3815299,34704] 0 2024-02-28T16:26:47.909 INFO:tasks.workunit.client.0.smithi148.stdout:1/750: creat d2/d15/d8b/fee x:0 0 0 2024-02-28T16:26:47.910 INFO:tasks.workunit.client.0.smithi148.stdout:1/751: chown d2/d3f/dcf/c84 115465 1 2024-02-28T16:26:47.917 INFO:tasks.workunit.client.0.smithi148.stdout:2/652: rename d0/d9/d13/d38/d3a/db3/f98 to d0/d1d/d52/d9c/fca 0 2024-02-28T16:26:47.923 INFO:tasks.workunit.client.0.smithi148.stdout:8/771: mkdir d1/d3/d18/d5a/dbf/dff 0 2024-02-28T16:26:47.925 INFO:tasks.workunit.client.0.smithi148.stdout:1/752: write d2/d9c/fa8 [4026967,48383] 0 2024-02-28T16:26:47.926 INFO:tasks.workunit.client.0.smithi148.stdout:5/646: symlink d1/lc8 0 2024-02-28T16:26:47.928 INFO:tasks.workunit.client.0.smithi148.stdout:1/753: fdatasync d2/d5/d40/d7/d91/f24 0 2024-02-28T16:26:47.929 INFO:tasks.workunit.client.0.smithi148.stdout:6/710: dread d0/d22/d25/d76/f79 [0,4194304] 0 2024-02-28T16:26:47.932 INFO:tasks.workunit.client.0.smithi148.stdout:2/653: symlink d0/d18/d20/d73/lcb 0 2024-02-28T16:26:47.934 INFO:tasks.workunit.client.0.smithi148.stdout:3/752: symlink d1/d13/d19/d32/ld6 0 2024-02-28T16:26:47.934 INFO:tasks.workunit.client.0.smithi148.stdout:6/711: write d0/d22/d25/d76/d7f/f5c [4388423,62341] 0 2024-02-28T16:26:47.939 INFO:tasks.workunit.client.0.smithi148.stdout:6/712: write d0/d4/d14/d59/f75 [2765496,43525] 0 2024-02-28T16:26:47.945 INFO:tasks.workunit.client.0.smithi148.stdout:1/754: dwrite d2/d15/fd2 [0,4194304] 0 2024-02-28T16:26:47.947 INFO:tasks.workunit.client.0.smithi148.stdout:5/647: rename d1/db/d60/d7a/d8b/dad/cb9 to d1/d44/d64/cc9 0 2024-02-28T16:26:47.949 INFO:tasks.workunit.client.0.smithi148.stdout:2/654: write d0/d1d/f77 [11268709,22681] 0 2024-02-28T16:26:47.951 INFO:tasks.workunit.client.0.smithi148.stdout:5/648: dread d1/db/d60/fa8 [0,4194304] 0 2024-02-28T16:26:47.952 INFO:tasks.workunit.client.0.smithi148.stdout:2/655: truncate d0/d1c/d49/f9b 1140635 0 2024-02-28T16:26:47.952 INFO:tasks.workunit.client.0.smithi148.stdout:5/649: stat d1/db/d25/f2e 0 2024-02-28T16:26:47.952 INFO:tasks.workunit.client.0.smithi148.stdout:2/656: stat d0/fb9 0 2024-02-28T16:26:47.956 INFO:tasks.workunit.client.0.smithi148.stdout:3/753: dread d1/d13/d19/d32/d41/fa2 [0,4194304] 0 2024-02-28T16:26:47.959 INFO:tasks.workunit.client.0.smithi148.stdout:6/713: creat d0/d4/d14/d8a/fe4 x:0 0 0 2024-02-28T16:26:47.960 INFO:tasks.workunit.client.0.smithi148.stdout:1/755: unlink d2/d5/d40/d7/l72 0 2024-02-28T16:26:47.964 INFO:tasks.workunit.client.0.smithi148.stdout:5/650: fsync d1/d8/d23/f2d 0 2024-02-28T16:26:47.971 INFO:tasks.workunit.client.0.smithi148.stdout:8/772: rmdir d1/dd/d13/d1a/d25/da3/deb 0 2024-02-28T16:26:47.982 INFO:tasks.workunit.client.0.smithi148.stdout:5/651: dwrite d1/f41 [0,4194304] 0 2024-02-28T16:26:47.982 INFO:tasks.workunit.client.0.smithi148.stdout:8/773: symlink d1/d3/d18/d48/d70/l100 0 2024-02-28T16:26:47.983 INFO:tasks.workunit.client.0.smithi148.stdout:2/657: dwrite d0/d18/d9a/f7b [0,4194304] 0 2024-02-28T16:26:47.984 INFO:tasks.workunit.client.0.smithi148.stdout:1/756: link d2/d5/d40/d7/l2a d2/d5/d40/dcc/lef 0 2024-02-28T16:26:47.989 INFO:tasks.workunit.client.0.smithi148.stdout:2/658: write d0/d9/d13/f16 [1934883,88954] 0 2024-02-28T16:26:47.989 INFO:tasks.workunit.client.0.smithi148.stdout:1/757: fdatasync d2/d15/d8b/da3/dc2/fd1 0 2024-02-28T16:26:47.989 INFO:tasks.workunit.client.0.smithi148.stdout:5/652: chown d1/db/d60/d7a/d8b/l34 2071609 1 2024-02-28T16:26:47.993 INFO:tasks.workunit.client.0.smithi148.stdout:5/653: chown d1/d44/d65/f76 157579 1 2024-02-28T16:26:47.994 INFO:tasks.workunit.client.0.smithi148.stdout:8/774: read - d1/dd/d13/d24/d3a/d49/f7d zero size 2024-02-28T16:26:47.994 INFO:tasks.workunit.client.0.smithi148.stdout:1/758: read d2/d5/d40/d8/f9 [2838382,114034] 0 2024-02-28T16:26:47.996 INFO:tasks.workunit.client.0.smithi148.stdout:2/659: mkdir d0/d1c/dcc 0 2024-02-28T16:26:47.999 INFO:tasks.workunit.client.0.smithi148.stdout:1/759: creat d2/d15/de7/ff0 x:0 0 0 2024-02-28T16:26:47.999 INFO:tasks.workunit.client.0.smithi148.stdout:8/775: dread - d1/dd/d13/d24/d3a/f5c zero size 2024-02-28T16:26:48.003 INFO:tasks.workunit.client.0.smithi148.stdout:2/660: creat d0/d9/d13/fcd x:0 0 0 2024-02-28T16:26:48.004 INFO:tasks.workunit.client.0.smithi148.stdout:5/654: creat d1/fca x:0 0 0 2024-02-28T16:26:48.005 INFO:tasks.workunit.client.0.smithi148.stdout:5/655: fdatasync d1/d44/d64/f9c 0 2024-02-28T16:26:48.006 INFO:tasks.workunit.client.0.smithi148.stdout:8/776: fsync d1/dd/d13/d1a/f42 0 2024-02-28T16:26:48.010 INFO:tasks.workunit.client.0.smithi148.stdout:6/714: write d0/d22/f65 [950657,124445] 0 2024-02-28T16:26:48.011 INFO:tasks.workunit.client.0.smithi148.stdout:2/661: getdents d0/d1c/d85/d96/dbf 0 2024-02-28T16:26:48.014 INFO:tasks.workunit.client.0.smithi148.stdout:8/777: write d1/dd/d51/d9b/fd6 [2804484,2647] 0 2024-02-28T16:26:48.015 INFO:tasks.workunit.client.0.smithi148.stdout:1/760: getdents d2/d5/d40/d8 0 2024-02-28T16:26:48.017 INFO:tasks.workunit.client.0.smithi148.stdout:3/754: dwrite d1/d13/f17 [4194304,4194304] 0 2024-02-28T16:26:48.020 INFO:tasks.workunit.client.0.smithi148.stdout:1/761: write d2/d5/d40/d7/fa4 [1377901,113128] 0 2024-02-28T16:26:48.022 INFO:tasks.workunit.client.0.smithi148.stdout:6/715: chown d0/d22/l2f 11 1 2024-02-28T16:26:48.032 INFO:tasks.workunit.client.0.smithi148.stdout:1/762: mknod d2/d5/d40/d7/cf1 0 2024-02-28T16:26:48.032 INFO:tasks.workunit.client.0.smithi148.stdout:5/656: link d1/d8/d20/d4e/d71/f73 d1/d8/d20/fcb 0 2024-02-28T16:26:48.033 INFO:tasks.workunit.client.0.smithi148.stdout:2/662: creat d0/d1d/d52/fce x:0 0 0 2024-02-28T16:26:48.034 INFO:tasks.workunit.client.0.smithi148.stdout:3/755: mknod d1/da0/cd7 0 2024-02-28T16:26:48.034 INFO:tasks.workunit.client.0.smithi148.stdout:4/614: sync 2024-02-28T16:26:48.041 INFO:tasks.workunit.client.0.smithi148.stdout:2/663: dread d0/d1d/d52/d9c/faf [0,4194304] 0 2024-02-28T16:26:48.042 INFO:tasks.workunit.client.0.smithi148.stdout:6/716: rename d0/c68 to d0/d4/dba/ce5 0 2024-02-28T16:26:48.044 INFO:tasks.workunit.client.0.smithi148.stdout:1/763: creat d2/d5/d40/ff2 x:0 0 0 2024-02-28T16:26:48.045 INFO:tasks.workunit.client.0.smithi148.stdout:8/778: dwrite d1/d3/d18/d5a/d60/f8f [4194304,4194304] 0 2024-02-28T16:26:48.046 INFO:tasks.workunit.client.0.smithi148.stdout:1/764: stat d2/d5/fc8 0 2024-02-28T16:26:48.052 INFO:tasks.workunit.client.0.smithi148.stdout:3/756: truncate d1/db/d35/f92 2250723 0 2024-02-28T16:26:48.052 INFO:tasks.workunit.client.0.smithi148.stdout:4/615: rename d8/df to d8/d40/dc3/dd3 0 2024-02-28T16:26:48.053 INFO:tasks.workunit.client.0.smithi148.stdout:2/664: unlink d0/d1c/d6e/l71 0 2024-02-28T16:26:48.053 INFO:tasks.workunit.client.0.smithi148.stdout:5/657: dread d1/db/d60/fac [0,4194304] 0 2024-02-28T16:26:48.055 INFO:tasks.workunit.client.0.smithi148.stdout:2/665: readlink d0/d18/l45 0 2024-02-28T16:26:48.057 INFO:tasks.workunit.client.0.smithi148.stdout:8/779: mkdir d1/d3/d18/d5a/d60/d101 0 2024-02-28T16:26:48.062 INFO:tasks.workunit.client.0.smithi148.stdout:1/765: creat d2/d15/d8b/da3/ff3 x:0 0 0 2024-02-28T16:26:48.067 INFO:tasks.workunit.client.0.smithi148.stdout:2/666: truncate d0/d1d/d52/d9c/fc8 544638 0 2024-02-28T16:26:48.073 INFO:tasks.workunit.client.0.smithi148.stdout:2/667: creat d0/d18/d20/fcf x:0 0 0 2024-02-28T16:26:48.075 INFO:tasks.workunit.client.0.smithi148.stdout:8/780: truncate d1/d3/d18/d48/d70/d75/d91/fab 375932 0 2024-02-28T16:26:48.080 INFO:tasks.workunit.client.0.smithi148.stdout:2/668: write d0/d1c/d49/fa4 [1017542,3891] 0 2024-02-28T16:26:48.082 INFO:tasks.workunit.client.0.smithi148.stdout:5/658: dwrite d1/db/f49 [0,4194304] 0 2024-02-28T16:26:48.085 INFO:tasks.workunit.client.0.smithi148.stdout:8/781: mkdir d1/dd/d51/d102 0 2024-02-28T16:26:48.086 INFO:tasks.workunit.client.0.smithi148.stdout:1/766: dread d2/d3f/fb2 [0,4194304] 0 2024-02-28T16:26:48.088 INFO:tasks.workunit.client.0.smithi148.stdout:5/659: write d1/db/d60/d7a/d87/f99 [320466,126929] 0 2024-02-28T16:26:48.088 INFO:tasks.workunit.client.0.smithi148.stdout:4/616: write d8/d21/d7e/fbb [1049496,61420] 0 2024-02-28T16:26:48.094 INFO:tasks.workunit.client.0.smithi148.stdout:5/660: dread d1/d8/d20/d4e/d71/f91 [0,4194304] 0 2024-02-28T16:26:48.097 INFO:tasks.workunit.client.0.smithi148.stdout:3/757: dread d1/db/d45/f98 [0,4194304] 0 2024-02-28T16:26:48.100 INFO:tasks.workunit.client.0.smithi148.stdout:5/661: dread d1/d44/fa5 [0,4194304] 0 2024-02-28T16:26:48.100 INFO:tasks.workunit.client.0.smithi148.stdout:4/617: mkdir d8/d21/d3d/d4d/dd0/dd4 0 2024-02-28T16:26:48.101 INFO:tasks.workunit.client.0.smithi148.stdout:8/782: read d1/dd/d13/d24/d3a/d49/f4c [2047793,103513] 0 2024-02-28T16:26:48.105 INFO:tasks.workunit.client.0.smithi148.stdout:6/717: dread d0/d22/fa6 [0,4194304] 0 2024-02-28T16:26:48.106 INFO:tasks.workunit.client.0.smithi148.stdout:4/618: mkdir d8/d37/dd5 0 2024-02-28T16:26:48.106 INFO:tasks.workunit.client.0.smithi148.stdout:8/783: chown d1/dd/d13/d1a/d33 16325 1 2024-02-28T16:26:48.106 INFO:tasks.workunit.client.0.smithi148.stdout:5/662: readlink d1/db/d60/d7a/d8b/d80/l81 0 2024-02-28T16:26:48.108 INFO:tasks.workunit.client.0.smithi148.stdout:1/767: dwrite d2/d5/d40/d7/d91/f43 [0,4194304] 0 2024-02-28T16:26:48.110 INFO:tasks.workunit.client.0.smithi148.stdout:3/758: mkdir d1/d13/d19/d94/db6/dd8 0 2024-02-28T16:26:48.112 INFO:tasks.workunit.client.0.smithi148.stdout:8/784: symlink d1/d3/d18/d5a/dbf/l103 0 2024-02-28T16:26:48.117 INFO:tasks.workunit.client.0.smithi148.stdout:3/759: mkdir d1/d13/d19/d1b/dd9 0 2024-02-28T16:26:48.118 INFO:tasks.workunit.client.0.smithi148.stdout:1/768: chown d2/d3f/dcf/lc6 34 1 2024-02-28T16:26:48.119 INFO:tasks.workunit.client.0.smithi148.stdout:0/974: sync 2024-02-28T16:26:48.119 INFO:tasks.workunit.client.0.smithi148.stdout:9/820: sync 2024-02-28T16:26:48.120 INFO:tasks.workunit.client.0.smithi148.stdout:2/669: dread d0/d59/f7f [0,4194304] 0 2024-02-28T16:26:48.120 INFO:tasks.workunit.client.0.smithi148.stdout:7/697: sync 2024-02-28T16:26:48.121 INFO:tasks.workunit.client.0.smithi148.stdout:1/769: fdatasync d2/d3f/dcf/d75/d76/fd3 0 2024-02-28T16:26:48.132 INFO:tasks.workunit.client.0.smithi148.stdout:9/821: fsync d7/d1c/d74/f53 0 2024-02-28T16:26:48.135 INFO:tasks.workunit.client.0.smithi148.stdout:6/718: dwrite d0/d22/d25/f4b [0,4194304] 0 2024-02-28T16:26:48.139 INFO:tasks.workunit.client.0.smithi148.stdout:5/663: dwrite d1/d8/d20/d31/f39 [0,4194304] 0 2024-02-28T16:26:48.142 INFO:tasks.workunit.client.0.smithi148.stdout:0/975: truncate d1/f19 1878921 0 2024-02-28T16:26:48.148 INFO:tasks.workunit.client.0.smithi148.stdout:3/760: truncate d1/fa8 1357869 0 2024-02-28T16:26:48.149 INFO:tasks.workunit.client.0.smithi148.stdout:9/822: dread - d7/d1c/d74/d6b/fe2 zero size 2024-02-28T16:26:48.149 INFO:tasks.workunit.client.0.smithi148.stdout:6/719: symlink d0/d8/d21/d9d/le6 0 2024-02-28T16:26:48.150 INFO:tasks.workunit.client.0.smithi148.stdout:8/785: link d1/dd/d13/d1a/d25/d50/fa0 d1/dd/f104 0 2024-02-28T16:26:48.151 INFO:tasks.workunit.client.0.smithi148.stdout:5/664: creat d1/db/d60/d7a/dbb/fcc x:0 0 0 2024-02-28T16:26:48.152 INFO:tasks.workunit.client.0.smithi148.stdout:1/770: dwrite d2/d5/d40/d7/d91/f7a [0,4194304] 0 2024-02-28T16:26:48.153 INFO:tasks.workunit.client.0.smithi148.stdout:4/619: dwrite d8/d40/dc3/dd3/f4a [0,4194304] 0 2024-02-28T16:26:48.160 INFO:tasks.workunit.client.0.smithi148.stdout:1/771: chown d2/d3f/dcf 1 1 2024-02-28T16:26:48.161 INFO:tasks.workunit.client.0.smithi148.stdout:7/698: rename d0/d9/d4c/dc7 to d0/d9/d25/d47/d28/d2b/d6f/dd3 0 2024-02-28T16:26:48.162 INFO:tasks.workunit.client.0.smithi148.stdout:8/786: chown d1/dd/d13/d24/d3a/d49/fe1 315068322 1 2024-02-28T16:26:48.171 INFO:tasks.workunit.client.0.smithi148.stdout:3/761: read d1/d13/d19/d56/fcc [4587177,8514] 0 2024-02-28T16:26:48.173 INFO:tasks.workunit.client.0.smithi148.stdout:0/976: rename d1/d15/d27/d7a/dc6/da7/lec to d1/d15/d3d/l14b 0 2024-02-28T16:26:48.182 INFO:tasks.workunit.client.0.smithi148.stdout:2/670: dread d0/dd/f88 [0,4194304] 0 2024-02-28T16:26:48.185 INFO:tasks.workunit.client.0.smithi148.stdout:1/772: dwrite d2/d25/f96 [0,4194304] 0 2024-02-28T16:26:48.187 INFO:tasks.workunit.client.0.smithi148.stdout:8/787: creat d1/da7/dc2/f105 x:0 0 0 2024-02-28T16:26:48.188 INFO:tasks.workunit.client.0.smithi148.stdout:4/620: truncate d8/d40/dc3/dd3/d17/d6a/f8a 401315 0 2024-02-28T16:26:48.190 INFO:tasks.workunit.client.0.smithi148.stdout:7/699: dread d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:48.191 INFO:tasks.workunit.client.0.smithi148.stdout:8/788: chown d1/dd/d51/d77/l78 0 1 2024-02-28T16:26:48.198 INFO:tasks.workunit.client.0.smithi148.stdout:1/773: creat d2/d5/d40/dcc/ff4 x:0 0 0 2024-02-28T16:26:48.199 INFO:tasks.workunit.client.0.smithi148.stdout:0/977: dread d1/d15/d27/d34/d5a/d71/d80/fb1 [0,4194304] 0 2024-02-28T16:26:48.199 INFO:tasks.workunit.client.0.smithi148.stdout:9/823: write d7/d1c/fe6 [426771,78040] 0 2024-02-28T16:26:48.210 INFO:tasks.workunit.client.0.smithi148.stdout:9/824: chown d7/d43/ddd/df1/c10c 15 1 2024-02-28T16:26:48.213 INFO:tasks.workunit.client.0.smithi148.stdout:5/665: dwrite d1/db/d60/f86 [0,4194304] 0 2024-02-28T16:26:48.222 INFO:tasks.workunit.client.0.smithi148.stdout:6/720: rename d0/d4/d14/l19 to d0/d4/d14/d8a/da2/le7 0 2024-02-28T16:26:48.222 INFO:tasks.workunit.client.0.smithi148.stdout:2/671: mknod d0/d1c/dcc/cd0 0 2024-02-28T16:26:48.232 INFO:tasks.workunit.client.0.smithi148.stdout:8/789: creat d1/d3/d18/d48/d70/d75/d91/dcc/ddf/f106 x:0 0 0 2024-02-28T16:26:48.233 INFO:tasks.workunit.client.0.smithi148.stdout:5/666: dwrite d1/fca [0,4194304] 0 2024-02-28T16:26:48.236 INFO:tasks.workunit.client.0.smithi148.stdout:8/790: write d1/dd/d13/d1a/fcf [303593,41334] 0 2024-02-28T16:26:48.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:47 smithi157 ceph-mon[38346]: pgmap v48: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 116 MiB/s wr, 281 op/s 2024-02-28T16:26:48.240 INFO:tasks.workunit.client.0.smithi148.stdout:8/791: fdatasync d1/dd/d13/d24/d3a/d49/f9f 0 2024-02-28T16:26:48.243 INFO:tasks.workunit.client.0.smithi148.stdout:7/700: rmdir d0/d9/d25/d47/d28/d2b/d6f 39 2024-02-28T16:26:48.247 INFO:tasks.workunit.client.0.smithi148.stdout:1/774: fsync d2/d5/d40/d8/dd8/de2/da7/dad/f74 0 2024-02-28T16:26:48.259 INFO:tasks.workunit.client.0.smithi148.stdout:3/762: rename d1/d13/d19/d32/d41 to d1/d3f/da5/dda 0 2024-02-28T16:26:48.265 INFO:tasks.workunit.client.0.smithi148.stdout:8/792: dwrite d1/fd0 [0,4194304] 0 2024-02-28T16:26:48.265 INFO:tasks.workunit.client.0.smithi148.stdout:5/667: unlink d1/db/d60/d7a/d87/f99 0 2024-02-28T16:26:48.273 INFO:tasks.workunit.client.0.smithi148.stdout:4/621: dwrite d8/d40/dc3/dd3/f97 [4194304,4194304] 0 2024-02-28T16:26:48.276 INFO:tasks.workunit.client.0.smithi148.stdout:1/775: mknod d2/d3f/dcf/d75/cf5 0 2024-02-28T16:26:48.285 INFO:tasks.workunit.client.0.smithi148.stdout:8/793: dwrite d1/fd0 [0,4194304] 0 2024-02-28T16:26:48.288 INFO:tasks.workunit.client.0.smithi148.stdout:8/794: write d1/d3/d18/fc3 [843647,125969] 0 2024-02-28T16:26:48.294 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:47 smithi148 ceph-mon[28767]: pgmap v48: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 37 MiB/s rd, 116 MiB/s wr, 281 op/s 2024-02-28T16:26:48.304 INFO:tasks.workunit.client.0.smithi148.stdout:2/672: dread d0/d18/d20/d46/f53 [0,4194304] 0 2024-02-28T16:26:48.305 INFO:tasks.workunit.client.0.smithi148.stdout:2/673: readlink d0/d9/d13/d38/l5b 0 2024-02-28T16:26:48.307 INFO:tasks.workunit.client.0.smithi148.stdout:9/825: mkdir d7/d1c/d59/d83/de4/d106/d118 0 2024-02-28T16:26:48.313 INFO:tasks.workunit.client.0.smithi148.stdout:6/721: symlink d0/d22/d25/dcc/le8 0 2024-02-28T16:26:48.313 INFO:tasks.workunit.client.0.smithi148.stdout:7/701: mkdir d0/d9/d25/d96/db7/dd4 0 2024-02-28T16:26:48.317 INFO:tasks.workunit.client.0.smithi148.stdout:7/702: chown d0/d9/d25/d47/d1c/d32/f4e 3 1 2024-02-28T16:26:48.320 INFO:tasks.workunit.client.0.smithi148.stdout:1/776: symlink d2/d3f/dcf/d75/d76/ddc/lf6 0 2024-02-28T16:26:48.328 INFO:tasks.workunit.client.0.smithi148.stdout:0/978: getdents d1/d15/d27/d34/d5a/d71/d80/db6 0 2024-02-28T16:26:48.331 INFO:tasks.workunit.client.0.smithi148.stdout:4/622: creat d8/d37/d91/db2/fd6 x:0 0 0 2024-02-28T16:26:48.331 INFO:tasks.workunit.client.0.smithi148.stdout:2/674: dread d0/d9/d13/f16 [0,4194304] 0 2024-02-28T16:26:48.333 INFO:tasks.workunit.client.0.smithi148.stdout:8/795: mknod d1/d3/d18/d5a/d60/de6/c107 0 2024-02-28T16:26:48.333 INFO:tasks.workunit.client.0.smithi148.stdout:3/763: dread d1/d13/d19/d1b/f44 [0,4194304] 0 2024-02-28T16:26:48.333 INFO:tasks.workunit.client.0.smithi148.stdout:0/979: write d1/d15/d27/d7a/f11e [27219,15431] 0 2024-02-28T16:26:48.335 INFO:tasks.workunit.client.0.smithi148.stdout:4/623: dread - d8/d40/d73/fc0 zero size 2024-02-28T16:26:48.335 INFO:tasks.workunit.client.0.smithi148.stdout:6/722: mkdir d0/d4/dba/de9 0 2024-02-28T16:26:48.338 INFO:tasks.workunit.client.0.smithi148.stdout:3/764: stat d1/d13/d19/d1b/d38/fa4 0 2024-02-28T16:26:48.338 INFO:tasks.workunit.client.0.smithi148.stdout:1/777: mknod d2/d15/d8b/db0/cf7 0 2024-02-28T16:26:48.341 INFO:tasks.workunit.client.0.smithi148.stdout:7/703: mkdir d0/dd5 0 2024-02-28T16:26:48.342 INFO:tasks.workunit.client.0.smithi148.stdout:3/765: chown d1/ccd 1977941 1 2024-02-28T16:26:48.344 INFO:tasks.workunit.client.0.smithi148.stdout:8/796: mkdir d1/dd/d13/d24/d3a/d49/d108 0 2024-02-28T16:26:48.347 INFO:tasks.workunit.client.0.smithi148.stdout:0/980: symlink d1/d15/d27/d34/d5a/d9d/d4a/l14c 0 2024-02-28T16:26:48.348 INFO:tasks.workunit.client.0.smithi148.stdout:8/797: write d1/dd/d13/d1a/f44 [4149895,127366] 0 2024-02-28T16:26:48.349 INFO:tasks.workunit.client.0.smithi148.stdout:2/675: unlink d0/c79 0 2024-02-28T16:26:48.352 INFO:tasks.workunit.client.0.smithi148.stdout:1/778: creat d2/d5/d40/d8/dcd/ff8 x:0 0 0 2024-02-28T16:26:48.360 INFO:tasks.workunit.client.0.smithi148.stdout:8/798: creat d1/d3/d18/f109 x:0 0 0 2024-02-28T16:26:48.361 INFO:tasks.workunit.client.0.smithi148.stdout:7/704: dwrite d0/d18/f79 [4194304,4194304] 0 2024-02-28T16:26:48.368 INFO:tasks.workunit.client.0.smithi148.stdout:4/624: creat d8/d21/d3d/d8c/fd7 x:0 0 0 2024-02-28T16:26:48.368 INFO:tasks.workunit.client.0.smithi148.stdout:2/676: dwrite d0/d1d/f5c [0,4194304] 0 2024-02-28T16:26:48.371 INFO:tasks.workunit.client.0.smithi148.stdout:1/779: symlink d2/d3f/d46/lf9 0 2024-02-28T16:26:48.373 INFO:tasks.workunit.client.0.smithi148.stdout:6/723: rename d0/d4/fa to d0/d22/fea 0 2024-02-28T16:26:48.379 INFO:tasks.workunit.client.0.smithi148.stdout:6/724: fsync d0/d4/d14/d8a/da2/fc8 0 2024-02-28T16:26:48.381 INFO:tasks.workunit.client.0.smithi148.stdout:0/981: creat d1/d15/d27/d34/f14d x:0 0 0 2024-02-28T16:26:48.385 INFO:tasks.workunit.client.0.smithi148.stdout:8/799: creat d1/dd/d13/d24/d3a/d49/d108/f10a x:0 0 0 2024-02-28T16:26:48.386 INFO:tasks.workunit.client.0.smithi148.stdout:0/982: dread - d1/d15/d27/d34/d5a/d9d/dc7/f133 zero size 2024-02-28T16:26:48.390 INFO:tasks.workunit.client.0.smithi148.stdout:8/800: fdatasync d1/d3/d18/d48/fd1 0 2024-02-28T16:26:48.392 INFO:tasks.workunit.client.0.smithi148.stdout:0/983: write d1/d15/d27/d7a/f11e [1668740,129854] 0 2024-02-28T16:26:48.397 INFO:tasks.workunit.client.0.smithi148.stdout:5/668: dwrite d1/d8/d20/d31/f4d [0,4194304] 0 2024-02-28T16:26:48.400 INFO:tasks.workunit.client.0.smithi148.stdout:0/984: chown d1/d15/d27/d34/d5a/d71/d80/l139 14092 1 2024-02-28T16:26:48.402 INFO:tasks.workunit.client.0.smithi148.stdout:5/669: dread - d1/d8/fbc zero size 2024-02-28T16:26:48.409 INFO:tasks.workunit.client.0.smithi148.stdout:3/766: rename d1/d13/d19/d1b/d38/d7c/f8d to d1/d13/fdb 0 2024-02-28T16:26:48.411 INFO:tasks.workunit.client.0.smithi148.stdout:6/725: link d0/d22/fa6 d0/d22/d49/dae/feb 0 2024-02-28T16:26:48.412 INFO:tasks.workunit.client.0.smithi148.stdout:8/801: truncate d1/dd/d13/d1a/d25/d50/f89 998154 0 2024-02-28T16:26:48.418 INFO:tasks.workunit.client.0.smithi148.stdout:6/726: dread d0/d10/f6f [0,4194304] 0 2024-02-28T16:26:48.426 INFO:tasks.workunit.client.0.smithi148.stdout:1/780: write d2/d5/d40/d7/d91/f2c [394812,78762] 0 2024-02-28T16:26:48.432 INFO:tasks.workunit.client.0.smithi148.stdout:7/705: rename d0/c56 to d0/d9/d25/d47/cd6 0 2024-02-28T16:26:48.439 INFO:tasks.workunit.client.0.smithi148.stdout:0/985: rename d1/d15/d27/d7a/l5d to d1/d15/d3d/d67/daf/l14e 0 2024-02-28T16:26:48.442 INFO:tasks.workunit.client.0.smithi148.stdout:5/670: getdents d1/db/d60/d7a 0 2024-02-28T16:26:48.445 INFO:tasks.workunit.client.0.smithi148.stdout:2/677: dwrite d0/d1d/f34 [0,4194304] 0 2024-02-28T16:26:48.448 INFO:tasks.workunit.client.0.smithi148.stdout:7/706: mknod d0/d9/d25/d47/d28/d2b/d3a/d6a/cd7 0 2024-02-28T16:26:48.448 INFO:tasks.workunit.client.0.smithi148.stdout:6/727: fsync d0/d22/d49/dae/feb 0 2024-02-28T16:26:48.450 INFO:tasks.workunit.client.0.smithi148.stdout:3/767: dread d1/d13/d19/d88/f8c [0,4194304] 0 2024-02-28T16:26:48.451 INFO:tasks.workunit.client.0.smithi148.stdout:6/728: write d0/f4c [4468204,72330] 0 2024-02-28T16:26:48.452 INFO:tasks.workunit.client.0.smithi148.stdout:1/781: link d2/d5/d40/d7/dba/ce0 d2/d5/d40/d8/dd8/de2/da7/dd6/cfa 0 2024-02-28T16:26:48.454 INFO:tasks.workunit.client.0.smithi148.stdout:5/671: rename d1/d44/d64/f4c to d1/db/d60/d7a/dbb/fcd 0 2024-02-28T16:26:48.459 INFO:tasks.workunit.client.0.smithi148.stdout:7/707: creat d0/d9/d25/d47/fd8 x:0 0 0 2024-02-28T16:26:48.462 INFO:tasks.workunit.client.0.smithi148.stdout:3/768: creat d1/d13/d19/d1b/fdc x:0 0 0 2024-02-28T16:26:48.464 INFO:tasks.workunit.client.0.smithi148.stdout:6/729: write d0/d22/d25/d76/f79 [2699967,42897] 0 2024-02-28T16:26:48.464 INFO:tasks.workunit.client.0.smithi148.stdout:8/802: dwrite d1/d3/fba [0,4194304] 0 2024-02-28T16:26:48.465 INFO:tasks.workunit.client.0.smithi148.stdout:1/782: mknod d2/d5/d40/d8/dcd/cfb 0 2024-02-28T16:26:48.467 INFO:tasks.workunit.client.0.smithi148.stdout:2/678: symlink d0/d1c/d85/d96/dbf/ld1 0 2024-02-28T16:26:48.469 INFO:tasks.workunit.client.0.smithi148.stdout:5/672: chown d1/db/ce 13289373 1 2024-02-28T16:26:48.471 INFO:tasks.workunit.client.0.smithi148.stdout:1/783: readlink d2/d5/d40/d7/d91/l22 0 2024-02-28T16:26:48.472 INFO:tasks.workunit.client.0.smithi148.stdout:5/673: chown d1/db/d60/d7a/d87 2858 1 2024-02-28T16:26:48.474 INFO:tasks.workunit.client.0.smithi148.stdout:7/708: fdatasync d0/d9/d25/d47/f58 0 2024-02-28T16:26:48.474 INFO:tasks.workunit.client.0.smithi148.stdout:1/784: chown d2/d5/d40/d8/dcd/cfb 2010 1 2024-02-28T16:26:48.478 INFO:tasks.workunit.client.0.smithi148.stdout:1/785: chown d2/d5/d40/d8/l4e 1 1 2024-02-28T16:26:48.478 INFO:tasks.workunit.client.0.smithi148.stdout:3/769: rename d1/d13/fdb to d1/d3f/da5/da9/fdd 0 2024-02-28T16:26:48.479 INFO:tasks.workunit.client.0.smithi148.stdout:7/709: write d0/d9/d25/d47/d1c/d32/faa [2172747,42014] 0 2024-02-28T16:26:48.485 INFO:tasks.workunit.client.0.smithi148.stdout:6/730: mknod d0/d4/dba/de9/cec 0 2024-02-28T16:26:48.487 INFO:tasks.workunit.client.0.smithi148.stdout:6/731: readlink d0/d22/d27/l63 0 2024-02-28T16:26:48.487 INFO:tasks.workunit.client.0.smithi148.stdout:1/786: dread d2/d5/d40/f3d [0,4194304] 0 2024-02-28T16:26:48.488 INFO:tasks.workunit.client.0.smithi148.stdout:8/803: rename d1/d3/d18/d5a/d60/lc7 to d1/dd/d13/d1a/l10b 0 2024-02-28T16:26:48.489 INFO:tasks.workunit.client.0.smithi148.stdout:0/986: write d1/f19 [2841447,130328] 0 2024-02-28T16:26:48.493 INFO:tasks.workunit.client.0.smithi148.stdout:2/679: mknod d0/da2/cd2 0 2024-02-28T16:26:48.493 INFO:tasks.workunit.client.0.smithi148.stdout:1/787: readlink d2/d3f/d46/lf9 0 2024-02-28T16:26:48.496 INFO:tasks.workunit.client.0.smithi148.stdout:8/804: chown d1/d3/d18/d48/d22/f32 28 1 2024-02-28T16:26:48.497 INFO:tasks.workunit.client.0.smithi148.stdout:3/770: creat d1/db5/fde x:0 0 0 2024-02-28T16:26:48.499 INFO:tasks.workunit.client.0.smithi148.stdout:1/788: write d2/d3f/fb2 [1734044,3172] 0 2024-02-28T16:26:48.507 INFO:tasks.workunit.client.0.smithi148.stdout:7/710: dwrite d0/d9/d25/d47/d28/d2b/d3a/fc3 [0,4194304] 0 2024-02-28T16:26:48.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/680: rename d0/d1d/d52/d9c to d0/d18/d20/dd3 0 2024-02-28T16:26:48.511 INFO:tasks.workunit.client.0.smithi148.stdout:6/732: dwrite d0/d10/f13 [0,4194304] 0 2024-02-28T16:26:48.515 INFO:tasks.workunit.client.0.smithi148.stdout:6/733: write d0/d22/d25/d76/d7f/f5c [3185181,66822] 0 2024-02-28T16:26:48.518 INFO:tasks.workunit.client.0.smithi148.stdout:0/987: getdents d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9 0 2024-02-28T16:26:48.520 INFO:tasks.workunit.client.0.smithi148.stdout:8/805: creat d1/d3/d18/d48/d70/d75/d91/dcc/ddf/df5/f10c x:0 0 0 2024-02-28T16:26:48.523 INFO:tasks.workunit.client.0.smithi148.stdout:7/711: rename d0/f76 to d0/d9/d25/d47/d28/d2b/d6f/dd3/fd9 0 2024-02-28T16:26:48.526 INFO:tasks.workunit.client.0.smithi148.stdout:8/806: write d1/d3/d18/f109 [934826,100829] 0 2024-02-28T16:26:48.526 INFO:tasks.workunit.client.0.smithi148.stdout:0/988: write d1/d15/d3d/d67/daf/ddc/ff6 [96033,92988] 0 2024-02-28T16:26:48.528 INFO:tasks.workunit.client.0.smithi148.stdout:7/712: fdatasync d0/d9/d4c/fa8 0 2024-02-28T16:26:48.530 INFO:tasks.workunit.client.0.smithi148.stdout:1/789: dwrite d2/d5/d40/d8/dd8/de2/da7/dad/fc7 [0,4194304] 0 2024-02-28T16:26:48.533 INFO:tasks.workunit.client.0.smithi148.stdout:8/807: stat d1/d3/d18/d48/d22/d34/l58 0 2024-02-28T16:26:48.535 INFO:tasks.workunit.client.0.smithi148.stdout:0/989: write d1/d15/d27/d7a/f11d [433990,36313] 0 2024-02-28T16:26:48.539 INFO:tasks.workunit.client.0.smithi148.stdout:1/790: write d2/d5/d40/f27 [3351249,56842] 0 2024-02-28T16:26:48.540 INFO:tasks.workunit.client.0.smithi148.stdout:8/808: chown d1/d3/d18/d5a/dbf/cc8 1430 1 2024-02-28T16:26:48.547 INFO:tasks.workunit.client.0.smithi148.stdout:0/990: mknod d1/d15/d27/d34/d5a/d6c/c14f 0 2024-02-28T16:26:48.547 INFO:tasks.workunit.client.0.smithi148.stdout:3/771: dwrite d1/db/d45/f4d [0,4194304] 0 2024-02-28T16:26:48.554 INFO:tasks.workunit.client.0.smithi148.stdout:1/791: write d2/d5/d40/d8/dd8/de2/da7/dd6/fe3 [906830,97941] 0 2024-02-28T16:26:48.560 INFO:tasks.workunit.client.0.smithi148.stdout:8/809: creat d1/dd/f10d x:0 0 0 2024-02-28T16:26:48.561 INFO:tasks.workunit.client.0.smithi148.stdout:7/713: dread d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:48.561 INFO:tasks.workunit.client.0.smithi148.stdout:0/991: dread - d1/d15/d27/d7a/dc6/da7/df1/d7e/db7/de3/f134 zero size 2024-02-28T16:26:48.568 INFO:tasks.workunit.client.0.smithi148.stdout:6/734: dread d0/d8/f6c [0,4194304] 0 2024-02-28T16:26:48.568 INFO:tasks.workunit.client.0.smithi148.stdout:3/772: link d1/db/d35/d70/d9c/cd2 d1/d3f/da5/da9/dc4/cdf 0 2024-02-28T16:26:48.568 INFO:tasks.workunit.client.0.smithi148.stdout:8/810: dread - d1/d3/d18/d48/d70/d75/d91/dcc/ddf/f106 zero size 2024-02-28T16:26:48.569 INFO:tasks.workunit.client.0.smithi148.stdout:7/714: fsync d0/d9/d25/d47/d1c/d32/fa0 0 2024-02-28T16:26:48.570 INFO:tasks.workunit.client.0.smithi148.stdout:6/735: chown d0/d4/d14/d8a/l99 337170282 1 2024-02-28T16:26:48.572 INFO:tasks.workunit.client.0.smithi148.stdout:3/773: chown d1/db/d35/d70/d9c/cbe 7925030 1 2024-02-28T16:26:48.574 INFO:tasks.workunit.client.0.smithi148.stdout:1/792: dread d2/d5/d40/f80 [0,4194304] 0 2024-02-28T16:26:48.575 INFO:tasks.workunit.client.0.smithi148.stdout:8/811: rmdir d1/d3/d18/d48/d70/d75 39 2024-02-28T16:26:48.578 INFO:tasks.workunit.client.0.smithi148.stdout:7/715: symlink d0/d9/d25/lda 0 2024-02-28T16:26:48.578 INFO:tasks.workunit.client.0.smithi148.stdout:8/812: write d1/dd/d13/d24/d3a/d49/f9f [1177014,53651] 0 2024-02-28T16:26:48.586 INFO:tasks.workunit.client.0.smithi148.stdout:3/774: unlink d1/db/d35/d70/faf 0 2024-02-28T16:26:48.588 INFO:tasks.workunit.client.0.smithi148.stdout:3/775: readlink d1/db/d35/d70/l86 0 2024-02-28T16:26:48.594 INFO:tasks.workunit.client.0.smithi148.stdout:0/992: getdents d1/d15/d3d/d67/daf 0 2024-02-28T16:26:48.596 INFO:tasks.workunit.client.0.smithi148.stdout:7/716: chown d0/c1e 44 1 2024-02-28T16:26:48.599 INFO:tasks.workunit.client.0.smithi148.stdout:1/793: dwrite d2/d5/d40/d7/d91/f43 [4194304,4194304] 0 2024-02-28T16:26:48.601 INFO:tasks.workunit.client.0.smithi148.stdout:3/776: dread - d1/db/d35/d70/f87 zero size 2024-02-28T16:26:48.601 INFO:tasks.workunit.client.0.smithi148.stdout:0/993: stat d1/d15/d27/d7a/dc6/da7/df1/dbc 0 2024-02-28T16:26:48.602 INFO:tasks.workunit.client.0.smithi148.stdout:5/674: dread d1/d44/d65/f76 [0,4194304] 0 2024-02-28T16:26:48.605 INFO:tasks.workunit.client.0.smithi148.stdout:8/813: mknod d1/dd/d13/d24/d3a/c10e 0 2024-02-28T16:26:48.608 INFO:tasks.workunit.client.0.smithi148.stdout:6/736: getdents d0/d4/d14 0 2024-02-28T16:26:48.609 INFO:tasks.workunit.client.0.smithi148.stdout:0/994: readlink d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/lc 0 2024-02-28T16:26:48.609 INFO:tasks.workunit.client.0.smithi148.stdout:3/777: mknod d1/db5/ce0 0 2024-02-28T16:26:48.610 INFO:tasks.workunit.client.0.smithi148.stdout:6/737: stat d0/d22/l9a 0 2024-02-28T16:26:48.612 INFO:tasks.workunit.client.0.smithi148.stdout:5/675: creat d1/d44/d65/fce x:0 0 0 2024-02-28T16:26:48.612 INFO:tasks.workunit.client.0.smithi148.stdout:3/778: stat d1/d13/d19/l27 0 2024-02-28T16:26:48.617 INFO:tasks.workunit.client.0.smithi148.stdout:6/738: fsync d0/d22/d27/f62 0 2024-02-28T16:26:48.617 INFO:tasks.workunit.client.0.smithi148.stdout:5/676: chown d1/d8/d20/d4e/d71/l7d 3 1 2024-02-28T16:26:48.619 INFO:tasks.workunit.client.0.smithi148.stdout:8/814: dread d1/d3/d18/d48/d70/f8c [0,4194304] 0 2024-02-28T16:26:48.620 INFO:tasks.workunit.client.0.smithi148.stdout:3/779: unlink d1/da0/cd7 0 2024-02-28T16:26:48.640 INFO:tasks.workunit.client.0.smithi148.stdout:1/794: dwrite d2/d3f/fa0 [0,4194304] 0 2024-02-28T16:26:48.643 INFO:tasks.workunit.client.0.smithi148.stdout:7/717: dread d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:48.644 INFO:tasks.workunit.client.0.smithi148.stdout:8/815: rmdir d1/d3/d18/d5a/d60/d101 0 2024-02-28T16:26:48.645 INFO:tasks.workunit.client.0.smithi148.stdout:1/795: fdatasync d2/d3f/fac 0 2024-02-28T16:26:48.653 INFO:tasks.workunit.client.0.smithi148.stdout:0/995: dwrite d1/d15/d27/d34/d5a/f141 [0,4194304] 0 2024-02-28T16:26:48.657 INFO:tasks.workunit.client.0.smithi148.stdout:8/816: symlink d1/d3/d9a/l10f 0 2024-02-28T16:26:48.657 INFO:tasks.workunit.client.0.smithi148.stdout:6/739: link d0/d22/d27/d66/d87/dc6/cd1 d0/d22/d25/d76/ced 0 2024-02-28T16:26:48.659 INFO:tasks.workunit.client.0.smithi148.stdout:5/677: dwrite d1/db/d60/d7a/d8b/f9e [0,4194304] 0 2024-02-28T16:26:48.667 INFO:tasks.workunit.client.0.smithi148.stdout:5/678: write d1/d8/fbc [642002,127689] 0 2024-02-28T16:26:48.669 INFO:tasks.workunit.client.0.smithi148.stdout:8/817: symlink d1/dd/d13/d68/l110 0 2024-02-28T16:26:48.672 INFO:tasks.workunit.client.0.smithi148.stdout:8/818: dread - d1/d3/d9a/fe7 zero size 2024-02-28T16:26:48.683 INFO:tasks.workunit.client.0.smithi148.stdout:6/740: dwrite d0/d22/d49/f6b [4194304,4194304] 0 2024-02-28T16:26:48.684 INFO:tasks.workunit.client.0.smithi148.stdout:7/718: fsync d0/d9/d25/d47/d28/d2b/d3a/d6a/fbe 0 2024-02-28T16:26:48.687 INFO:tasks.workunit.client.0.smithi148.stdout:5/679: dwrite d1/d8/d20/d31/f6c [0,4194304] 0 2024-02-28T16:26:48.691 INFO:tasks.workunit.client.0.smithi148.stdout:7/719: dread - d0/d9/d25/d47/d28/d2b/d3a/d49/d97/fc6 zero size 2024-02-28T16:26:48.691 INFO:tasks.workunit.client.0.smithi148.stdout:5/680: chown d1/l93 71821 1 2024-02-28T16:26:48.692 INFO:tasks.workunit.client.0.smithi148.stdout:7/720: stat d0/d9/d1b/c3e 0 2024-02-28T16:26:48.695 INFO:tasks.workunit.client.0.smithi148.stdout:1/796: rename d2/d5/d40/d8/dd8/de2/da7/dd6/cfa to d2/d25/cfc 0 2024-02-28T16:26:48.698 INFO:tasks.workunit.client.0.smithi148.stdout:5/681: write d1/db/d60/d7a/d8b/f9e [2507428,23282] 0 2024-02-28T16:26:48.699 INFO:tasks.workunit.client.0.smithi148.stdout:1/797: stat d2/d5/d40/dcc/fea 0 2024-02-28T16:26:48.701 INFO:tasks.workunit.client.0.smithi148.stdout:3/780: write d1/db/d35/d70/d8e/fb7 [3472843,24153] 0 2024-02-28T16:26:48.708 INFO:tasks.workunit.client.0.smithi148.stdout:6/741: dwrite d0/d22/d49/d88/d97/fb5 [4194304,4194304] 0 2024-02-28T16:26:48.714 INFO:tasks.workunit.client.0.smithi148.stdout:1/798: symlink d2/d25/lfd 0 2024-02-28T16:26:48.723 INFO:tasks.workunit.client.0.smithi148.stdout:5/682: creat d1/d8/d20/d31/d50/dbe/fcf x:0 0 0 2024-02-28T16:26:48.724 INFO:tasks.workunit.client.0.smithi148.stdout:1/799: fsync d2/d5/d40/d8/f9 0 2024-02-28T16:26:48.729 INFO:tasks.workunit.client.0.smithi148.stdout:0/996: rename d1/d15/d27/d34/d5a/d71/d80/db6/c115 to d1/d15/d27/d34/d5a/d71/d80/c150 0 2024-02-28T16:26:48.733 INFO:tasks.workunit.client.0.smithi148.stdout:6/742: mknod d0/d4/dba/d71/db4/cee 0 2024-02-28T16:26:48.742 INFO:tasks.workunit.client.0.smithi148.stdout:5/683: creat d1/db/d60/d7a/d8b/d80/fd0 x:0 0 0 2024-02-28T16:26:48.743 INFO:tasks.workunit.client.0.smithi148.stdout:1/800: mkdir d2/d5/d40/d8/dd8/dfe 0 2024-02-28T16:26:48.745 INFO:tasks.workunit.client.0.smithi148.stdout:1/801: fsync d2/d5/d40/d7/d91/f43 0 2024-02-28T16:26:48.747 INFO:tasks.workunit.client.0.smithi148.stdout:7/721: rename d0/f13 to d0/d9/d25/d47/d28/d2b/d3a/d49/d97/fdb 0 2024-02-28T16:26:48.747 INFO:tasks.workunit.client.0.smithi148.stdout:3/781: link d1/d13/d19/d1b/d38/fca d1/d13/d19/d94/fe1 0 2024-02-28T16:26:48.751 INFO:tasks.workunit.client.0.smithi148.stdout:1/802: truncate d2/d15/d8b/da3/ff3 506239 0 2024-02-28T16:26:48.752 INFO:tasks.workunit.client.0.smithi148.stdout:1/803: readlink d2/d25/l3b 0 2024-02-28T16:26:48.759 INFO:tasks.workunit.client.0.smithi148.stdout:1/804: rename d2/d3f/d46/fdf to d2/d25/fff 0 2024-02-28T16:26:48.766 INFO:tasks.workunit.client.0.smithi148.stdout:6/743: getdents d0/d22/d27/d66 0 2024-02-28T16:26:48.770 INFO:tasks.workunit.client.0.smithi148.stdout:3/782: dwrite d1/d13/f17 [0,4194304] 0 2024-02-28T16:26:48.772 INFO:tasks.workunit.client.0.smithi148.stdout:7/722: dwrite d0/d9/d25/d47/f58 [0,4194304] 0 2024-02-28T16:26:48.773 INFO:tasks.workunit.client.0.smithi148.stdout:1/805: unlink d2/d5/d40/d7/d99/lc9 0 2024-02-28T16:26:48.774 INFO:tasks.workunit.client.0.smithi148.stdout:1/806: chown d2/d3f 12729 1 2024-02-28T16:26:48.778 INFO:tasks.workunit.client.0.smithi148.stdout:5/684: dread d1/d44/d64/f9c [0,4194304] 0 2024-02-28T16:26:48.784 INFO:tasks.workunit.client.0.smithi148.stdout:0/997: truncate d1/d15/d27/d34/d5a/d9d/d4a/f57 3754222 0 2024-02-28T16:26:48.790 INFO:tasks.workunit.client.0.smithi148.stdout:6/744: dwrite d0/d22/d27/d66/d87/f91 [0,4194304] 0 2024-02-28T16:26:48.791 INFO:tasks.workunit.client.0.smithi148.stdout:3/783: symlink d1/le2 0 2024-02-28T16:26:48.794 INFO:tasks.workunit.client.0.smithi148.stdout:3/784: readlink d1/d13/d19/l6d 0 2024-02-28T16:26:48.794 INFO:tasks.workunit.client.0.smithi148.stdout:6/745: write d0/d22/d27/d3e/fbc [1681541,8389] 0 2024-02-28T16:26:48.805 INFO:tasks.workunit.client.0.smithi148.stdout:6/746: creat d0/d22/d49/d88/d97/fef x:0 0 0 2024-02-28T16:26:48.809 INFO:tasks.workunit.client.0.smithi148.stdout:3/785: symlink d1/d13/d19/d56/d5b/le3 0 2024-02-28T16:26:48.812 INFO:tasks.workunit.client.0.smithi148.stdout:7/723: link d0/c52 d0/d9/d25/d47/d28/d2b/d3a/d49/d97/cdc 0 2024-02-28T16:26:48.814 INFO:tasks.workunit.client.0.smithi148.stdout:1/807: dwrite d2/d25/fff [0,4194304] 0 2024-02-28T16:26:48.814 INFO:tasks.workunit.client.0.smithi148.stdout:3/786: creat d1/db/d35/d70/d9c/fe4 x:0 0 0 2024-02-28T16:26:48.822 INFO:tasks.workunit.client.0.smithi148.stdout:7/724: unlink d0/d18/f2a 0 2024-02-28T16:26:48.835 INFO:tasks.workunit.client.0.smithi148.stdout:0/998: write d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/dc9/ddd/f60 [1591147,78805] 0 2024-02-28T16:26:48.837 INFO:tasks.workunit.client.0.smithi148.stdout:1/808: write d2/d15/d8b/db0/fe8 [2262387,95693] 0 2024-02-28T16:26:48.838 INFO:tasks.workunit.client.0.smithi148.stdout:3/787: mknod d1/d13/d19/ce5 0 2024-02-28T16:26:48.840 INFO:tasks.workunit.client.0.smithi148.stdout:3/788: chown d1/d13 59 1 2024-02-28T16:26:48.841 INFO:tasks.workunit.client.0.smithi148.stdout:7/725: mkdir d0/d9/d25/d47/d28/ddd 0 2024-02-28T16:26:48.841 INFO:tasks.workunit.client.0.smithi148.stdout:5/685: dread d1/f94 [0,4194304] 0 2024-02-28T16:26:48.842 INFO:tasks.workunit.client.0.smithi148.stdout:7/726: readlink d0/d9/d1b/l37 0 2024-02-28T16:26:48.856 INFO:tasks.workunit.client.0.smithi148.stdout:6/747: write d0/d4/d14/d8a/da2/fc8 [458539,73423] 0 2024-02-28T16:26:48.872 INFO:tasks.workunit.client.0.smithi148.stdout:1/809: creat d2/d5/d40/d8/dd8/de2/da7/dad/f100 x:0 0 0 2024-02-28T16:26:48.874 INFO:tasks.workunit.client.0.smithi148.stdout:1/810: dread - d2/d15/d8b/fee zero size 2024-02-28T16:26:48.875 INFO:tasks.workunit.client.0.smithi148.stdout:7/727: write d0/d9/d25/d47/d28/d2b/d3a/fc4 [139263,31991] 0 2024-02-28T16:26:48.877 INFO:tasks.workunit.client.0.smithi148.stdout:6/748: symlink d0/d4/dba/d71/db4/lf0 0 2024-02-28T16:26:48.882 INFO:tasks.workunit.client.0.smithi148.stdout:1/811: read d2/d5/d40/d8/dd8/de2/da7/dad/f7b [189721,20745] 0 2024-02-28T16:26:48.884 INFO:tasks.workunit.client.0.smithi148.stdout:1/812: chown d2/d3f/l8c 446365 1 2024-02-28T16:26:48.885 INFO:tasks.workunit.client.0.smithi148.stdout:7/728: chown d0/d9/d25/d47/d28/d2b/la7 367505 1 2024-02-28T16:26:48.887 INFO:tasks.workunit.client.0.smithi148.stdout:6/749: creat d0/d4/d14/d8a/ff1 x:0 0 0 2024-02-28T16:26:48.890 INFO:tasks.workunit.client.0.smithi148.stdout:1/813: mknod d2/d5/d40/d8/dd8/c101 0 2024-02-28T16:26:48.894 INFO:tasks.workunit.client.0.smithi148.stdout:6/750: symlink d0/d22/d25/d76/lf2 0 2024-02-28T16:26:48.896 INFO:tasks.workunit.client.0.smithi148.stdout:7/729: fdatasync d0/d9/d25/d47/d28/d2b/f9e 0 2024-02-28T16:26:48.897 INFO:tasks.workunit.client.0.smithi148.stdout:0/999: dwrite d1/d15/d27/d7a/dc6/da7/df1/d7e/da4/f129 [0,4194304] 0 2024-02-28T16:26:48.898 INFO:tasks.workunit.client.0.smithi148.stdout:1/814: dread d2/d5/d40/f80 [0,4194304] 0 2024-02-28T16:26:48.898 INFO:tasks.workunit.client.0.smithi148.stdout:7/730: readlink d0/d4/d70/da5/lb0 0 2024-02-28T16:26:48.900 INFO:tasks.workunit.client.0.smithi148.stdout:3/789: dwrite d1/d13/d19/d56/d5b/f68 [0,4194304] 0 2024-02-28T16:26:48.902 INFO:tasks.workunit.client.0.smithi148.stdout:1/815: write d2/d15/fd2 [3445222,104314] 0 2024-02-28T16:26:48.903 INFO:tasks.workunit.client.0.smithi148.stdout:7/731: chown d0/d9/d25/d47/d1c/d32/fa0 227 1 2024-02-28T16:26:48.904 INFO:tasks.workunit.client.0.smithi148.stdout:3/790: chown d1/d13/d19/f33 100 1 2024-02-28T16:26:48.917 INFO:tasks.workunit.client.0.smithi148.stdout:3/791: link d1/db/d35/d70/d8e/fb7 d1/d13/d19/d32/fe6 0 2024-02-28T16:26:48.921 INFO:tasks.workunit.client.0.smithi148.stdout:3/792: creat d1/da0/fe7 x:0 0 0 2024-02-28T16:26:48.924 INFO:tasks.workunit.client.0.smithi148.stdout:3/793: chown d1/d13/d19/d88/f99 1054373 1 2024-02-28T16:26:48.954 INFO:tasks.workunit.client.0.smithi148.stdout:3/794: dread d1/d13/d19/d1b/d38/fca [0,4194304] 0 2024-02-28T16:26:48.958 INFO:tasks.workunit.client.0.smithi148.stdout:3/795: symlink d1/d13/d19/d32/d9e/le8 0 2024-02-28T16:26:48.962 INFO:tasks.workunit.client.0.smithi148.stdout:1/816: dwrite d2/d5/d40/f1b [0,4194304] 0 2024-02-28T16:26:48.963 INFO:tasks.workunit.client.0.smithi148.stdout:7/732: dwrite d0/d9/d25/d47/f27 [0,4194304] 0 2024-02-28T16:26:48.966 INFO:tasks.workunit.client.0.smithi148.stdout:3/796: mkdir d1/d13/d19/d56/d5b/de9 0 2024-02-28T16:26:48.968 INFO:tasks.workunit.client.0.smithi148.stdout:1/817: creat d2/d5/d40/d8/dd8/f102 x:0 0 0 2024-02-28T16:26:48.968 INFO:tasks.workunit.client.0.smithi148.stdout:3/797: stat d1/db/d35/d70/d71/l9d 0 2024-02-28T16:26:48.969 INFO:tasks.workunit.client.0.smithi148.stdout:7/733: write d0/d9/d25/d47/d1c/d32/faa [2702653,121247] 0 2024-02-28T16:26:48.971 INFO:tasks.workunit.client.0.smithi148.stdout:7/734: stat d0/d9/d25/d47/d28 0 2024-02-28T16:26:48.972 INFO:tasks.workunit.client.0.smithi148.stdout:3/798: mknod d1/d13/d19/d56/d5b/cea 0 2024-02-28T16:26:48.974 INFO:tasks.workunit.client.0.smithi148.stdout:1/818: getdents d2/d5/d40/d8/dd8/dfe 0 2024-02-28T16:26:48.974 INFO:tasks.workunit.client.0.smithi148.stdout:3/799: chown d1/d3f/da5/da9/dc4 760 1 2024-02-28T16:26:48.980 INFO:tasks.workunit.client.0.smithi148.stdout:7/735: creat d0/d9/d25/d47/fde x:0 0 0 2024-02-28T16:26:48.981 INFO:tasks.workunit.client.0.smithi148.stdout:1/819: truncate d2/d5/d40/d7/d99/faf 685134 0 2024-02-28T16:26:49.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:49 smithi148 ceph-mon[28767]: pgmap v49: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 57 MiB/s rd, 170 MiB/s wr, 420 op/s 2024-02-28T16:26:49.131 INFO:tasks.workunit.client.0.smithi148.stdout:1/820: write d2/d5/d40/d7/f12 [3359775,81189] 0 2024-02-28T16:26:49.144 INFO:tasks.workunit.client.0.smithi148.stdout:3/800: dwrite d1/fa8 [0,4194304] 0 2024-02-28T16:26:49.150 INFO:tasks.workunit.client.0.smithi148.stdout:3/801: mkdir d1/d13/d19/d88/deb 0 2024-02-28T16:26:49.154 INFO:tasks.workunit.client.0.smithi148.stdout:3/802: creat d1/db/d35/d70/d71/fec x:0 0 0 2024-02-28T16:26:49.158 INFO:tasks.workunit.client.0.smithi148.stdout:7/736: rename d0/d9/d25/d47 to d0/d9/d25/d96/ddf 0 2024-02-28T16:26:49.163 INFO:tasks.workunit.client.0.smithi148.stdout:7/737: read d0/d9/d1b/fba [119956,33476] 0 2024-02-28T16:26:49.168 INFO:tasks.workunit.client.0.smithi148.stdout:7/738: mkdir d0/dd5/de0 0 2024-02-28T16:26:49.173 INFO:tasks.workunit.client.0.smithi148.stdout:7/739: mknod d0/d9/d25/d96/ddf/d28/d2b/d5c/ce1 0 2024-02-28T16:26:49.175 INFO:tasks.workunit.client.0.smithi148.stdout:7/740: mkdir d0/dd5/de2 0 2024-02-28T16:26:49.179 INFO:tasks.workunit.client.0.smithi148.stdout:3/803: dread d1/d13/d19/d56/f73 [0,4194304] 0 2024-02-28T16:26:49.181 INFO:tasks.workunit.client.0.smithi148.stdout:3/804: read d1/db/d45/f4d [1249067,111844] 0 2024-02-28T16:26:49.185 INFO:tasks.workunit.client.0.smithi148.stdout:7/741: truncate d0/d9/d25/d96/ddf/d1c/d32/fa0 858112 0 2024-02-28T16:26:49.192 INFO:tasks.workunit.client.0.smithi148.stdout:7/742: mknod d0/dc8/ce3 0 2024-02-28T16:26:49.194 INFO:tasks.workunit.client.0.smithi148.stdout:7/743: stat d0/d4/d70/c87 0 2024-02-28T16:26:49.196 INFO:tasks.workunit.client.0.smithi148.stdout:7/744: chown d0/d9/d46/cab 6029902 1 2024-02-28T16:26:49.196 INFO:tasks.workunit.client.0.smithi148.stdout:1/821: dread d2/d5/d40/d8/f21 [0,4194304] 0 2024-02-28T16:26:49.202 INFO:tasks.workunit.client.0.smithi148.stdout:1/822: creat d2/d3f/dcf/d75/d76/f103 x:0 0 0 2024-02-28T16:26:49.209 INFO:tasks.workunit.client.0.smithi148.stdout:3/805: dwrite d1/d13/d19/d1b/d38/f82 [0,4194304] 0 2024-02-28T16:26:49.217 INFO:tasks.workunit.client.0.smithi148.stdout:7/745: dread d0/d9/d25/fb9 [0,4194304] 0 2024-02-28T16:26:49.220 INFO:tasks.workunit.client.0.smithi148.stdout:3/806: write d1/db/d35/f6b [452178,106568] 0 2024-02-28T16:26:49.222 INFO:tasks.workunit.client.0.smithi148.stdout:1/823: dwrite d2/d15/d8b/da3/dc2/fd1 [0,4194304] 0 2024-02-28T16:26:49.227 INFO:tasks.workunit.client.0.smithi148.stdout:3/807: fdatasync d1/db/d45/f4d 0 2024-02-28T16:26:49.235 INFO:tasks.workunit.client.0.smithi148.stdout:1/824: link d2/d5/c39 d2/d15/de7/c104 0 2024-02-28T16:26:49.236 INFO:tasks.workunit.client.0.smithi148.stdout:3/808: symlink d1/db/d45/d80/led 0 2024-02-28T16:26:49.238 INFO:tasks.workunit.client.0.smithi148.stdout:3/809: chown d1/d13/d19/d94/cb2 454 1 2024-02-28T16:26:49.239 INFO:tasks.workunit.client.0.smithi148.stdout:1/825: write d2/d5/d40/f80 [1681635,20778] 0 2024-02-28T16:26:49.240 INFO:tasks.workunit.client.0.smithi148.stdout:3/810: chown d1/d13/fcb 245 1 2024-02-28T16:26:49.240 INFO:tasks.workunit.client.0.smithi148.stdout:7/746: dwrite d0/d9/f8e [0,4194304] 0 2024-02-28T16:26:49.243 INFO:tasks.workunit.client.0.smithi148.stdout:1/826: chown d2/d15/d8b/db0 7 1 2024-02-28T16:26:49.246 INFO:tasks.workunit.client.0.smithi148.stdout:7/747: stat d0/d4/l5e 0 2024-02-28T16:26:49.249 INFO:tasks.workunit.client.0.smithi148.stdout:1/827: mkdir d2/d5/d40/d8/dcd/d105 0 2024-02-28T16:26:49.251 INFO:tasks.workunit.client.0.smithi148.stdout:1/828: write d2/d5/fc8 [3281510,41845] 0 2024-02-28T16:26:49.252 INFO:tasks.workunit.client.0.smithi148.stdout:7/748: chown d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/db4/f9f 17469961 1 2024-02-28T16:26:49.276 INFO:tasks.workunit.client.0.smithi148.stdout:3/811: dwrite d1/db/d35/d70/f87 [0,4194304] 0 2024-02-28T16:26:49.277 INFO:tasks.workunit.client.0.smithi148.stdout:9/826: sync 2024-02-28T16:26:49.279 INFO:tasks.workunit.client.0.smithi148.stdout:9/827: chown d7/d1c/d1f/l84 27756 1 2024-02-28T16:26:49.279 INFO:tasks.workunit.client.0.smithi148.stdout:3/812: chown d1/d13/d19/d56/d5b/cea 0 1 2024-02-28T16:26:49.298 INFO:tasks.workunit.client.0.smithi148.stdout:1/829: link d2/f51 d2/d3f/dcf/d75/d76/f106 0 2024-02-28T16:26:49.300 INFO:tasks.workunit.client.0.smithi148.stdout:1/830: stat d2/d3f/dcf/d75/d76/fd3 0 2024-02-28T16:26:49.310 INFO:tasks.workunit.client.0.smithi148.stdout:3/813: dread d1/db/d45/f8b [0,4194304] 0 2024-02-28T16:26:49.314 INFO:tasks.workunit.client.0.smithi148.stdout:3/814: mknod d1/d13/cee 0 2024-02-28T16:26:49.315 INFO:tasks.workunit.client.0.smithi148.stdout:9/828: write d7/d1c/d59/f62 [560990,24709] 0 2024-02-28T16:26:49.321 INFO:tasks.workunit.client.0.smithi148.stdout:1/831: dwrite d2/d5/d40/d7/d99/faf [0,4194304] 0 2024-02-28T16:26:49.321 INFO:tasks.workunit.client.0.smithi148.stdout:3/815: unlink d1/d13/d19/d1b/f1f 0 2024-02-28T16:26:49.326 INFO:tasks.workunit.client.0.smithi148.stdout:9/829: mkdir d7/d1c/d32/d119 0 2024-02-28T16:26:49.339 INFO:tasks.workunit.client.0.smithi148.stdout:3/816: link d1/db/d45/f4d d1/da0/fef 0 2024-02-28T16:26:49.340 INFO:tasks.workunit.client.0.smithi148.stdout:3/817: fsync d1/db/fd0 0 2024-02-28T16:26:49.341 INFO:tasks.workunit.client.0.smithi148.stdout:1/832: dwrite d2/d5/d40/d7/f6e [4194304,4194304] 0 2024-02-28T16:26:49.344 INFO:tasks.workunit.client.0.smithi148.stdout:3/818: chown d1/db5/fde 3 1 2024-02-28T16:26:49.344 INFO:tasks.workunit.client.0.smithi148.stdout:1/833: fdatasync d2/d5/d40/fa5 0 2024-02-28T16:26:49.347 INFO:tasks.workunit.client.0.smithi148.stdout:3/819: creat d1/db/d45/d80/ff0 x:0 0 0 2024-02-28T16:26:49.348 INFO:tasks.workunit.client.0.smithi148.stdout:1/834: rmdir d2/d15/d8b/db0 39 2024-02-28T16:26:49.349 INFO:tasks.workunit.client.0.smithi148.stdout:9/830: write d7/d1c/d1f/d49/d6a/fb0 [2954619,124839] 0 2024-02-28T16:26:49.351 INFO:tasks.workunit.client.0.smithi148.stdout:3/820: rmdir d1/d3f/da5/dda 39 2024-02-28T16:26:49.355 INFO:tasks.workunit.client.0.smithi148.stdout:9/831: write d7/d1c/d32/d24/dc1/fe9 [1419563,6583] 0 2024-02-28T16:26:49.362 INFO:tasks.workunit.client.0.smithi148.stdout:3/821: creat d1/d3f/da5/dda/ff1 x:0 0 0 2024-02-28T16:26:49.362 INFO:tasks.workunit.client.0.smithi148.stdout:1/835: rename d2/d3f/dcf/d75/d76/ddc/lf6 to d2/d5/d40/d8/dd8/dfe/l107 0 2024-02-28T16:26:49.368 INFO:tasks.workunit.client.0.smithi148.stdout:1/836: rename d2/d5/d40/d8/f9 to d2/d5/d40/d8/dd8/dfe/f108 0 2024-02-28T16:26:49.371 INFO:tasks.workunit.client.0.smithi148.stdout:3/822: truncate d1/d13/d19/d56/f6c 1741667 0 2024-02-28T16:26:49.378 INFO:tasks.workunit.client.0.smithi148.stdout:9/832: dwrite d7/d1c/d32/d24/dac/fe8 [4194304,4194304] 0 2024-02-28T16:26:49.386 INFO:tasks.workunit.client.0.smithi148.stdout:3/823: write d1/db/f65 [4122684,18963] 0 2024-02-28T16:26:49.387 INFO:tasks.workunit.client.0.smithi148.stdout:1/837: dwrite d2/d3f/dcf/f7e [4194304,4194304] 0 2024-02-28T16:26:49.393 INFO:tasks.workunit.client.0.smithi148.stdout:3/824: unlink d1/db/c90 0 2024-02-28T16:26:49.393 INFO:tasks.workunit.client.0.smithi148.stdout:1/838: creat d2/d5/d40/d8/dd8/f109 x:0 0 0 2024-02-28T16:26:49.396 INFO:tasks.workunit.client.0.smithi148.stdout:1/839: write d2/d25/f96 [4864879,124405] 0 2024-02-28T16:26:49.399 INFO:tasks.workunit.client.0.smithi148.stdout:1/840: write d2/d5/d40/f53 [1686000,57784] 0 2024-02-28T16:26:49.402 INFO:tasks.workunit.client.0.smithi148.stdout:1/841: chown d2/d5/d40/d7/f12 1 1 2024-02-28T16:26:49.418 INFO:tasks.workunit.client.0.smithi148.stdout:1/842: truncate d2/d3f/dcf/d75/f88 3454268 0 2024-02-28T16:26:49.422 INFO:tasks.workunit.client.0.smithi148.stdout:9/833: dread d7/d1c/d59/fa4 [0,4194304] 0 2024-02-28T16:26:49.424 INFO:tasks.workunit.client.0.smithi148.stdout:1/843: read d2/d5/d40/d7/d91/f7a [1825136,48771] 0 2024-02-28T16:26:49.425 INFO:tasks.workunit.client.0.smithi148.stdout:3/825: dwrite d1/d13/f3b [0,4194304] 0 2024-02-28T16:26:49.428 INFO:tasks.workunit.client.0.smithi148.stdout:9/834: truncate d7/d1c/d1f/fe5 916315 0 2024-02-28T16:26:49.428 INFO:tasks.workunit.client.0.smithi148.stdout:1/844: write d2/d5/d40/d7/f6a [1580539,109071] 0 2024-02-28T16:26:49.438 INFO:tasks.workunit.client.0.smithi148.stdout:9/835: link d7/f21 d7/d43/da8/f11a 0 2024-02-28T16:26:49.443 INFO:tasks.workunit.client.0.smithi148.stdout:9/836: truncate d7/d1c/d32/d24/f110 905154 0 2024-02-28T16:26:49.445 INFO:tasks.workunit.client.0.smithi148.stdout:1/845: dwrite d2/d3f/dcf/f7e [4194304,4194304] 0 2024-02-28T16:26:49.448 INFO:tasks.workunit.client.0.smithi148.stdout:9/837: dread d7/d1c/d32/d24/f2f [0,4194304] 0 2024-02-28T16:26:49.451 INFO:tasks.workunit.client.0.smithi148.stdout:1/846: creat d2/d9c/f10a x:0 0 0 2024-02-28T16:26:49.454 INFO:tasks.workunit.client.0.smithi148.stdout:9/838: creat d7/d43/da8/f11b x:0 0 0 2024-02-28T16:26:49.454 INFO:tasks.workunit.client.0.smithi148.stdout:1/847: write d2/d5/d40/f27 [3825420,1727] 0 2024-02-28T16:26:49.456 INFO:tasks.workunit.client.0.smithi148.stdout:6/751: sync 2024-02-28T16:26:49.457 INFO:tasks.workunit.client.0.smithi148.stdout:2/681: sync 2024-02-28T16:26:49.457 INFO:tasks.workunit.client.0.smithi148.stdout:4/625: sync 2024-02-28T16:26:49.457 INFO:tasks.workunit.client.0.smithi148.stdout:8/819: sync 2024-02-28T16:26:49.457 INFO:tasks.workunit.client.0.smithi148.stdout:5/686: sync 2024-02-28T16:26:49.460 INFO:tasks.workunit.client.0.smithi148.stdout:9/839: chown d7/d1c/d59/l97 1576 1 2024-02-28T16:26:49.460 INFO:tasks.workunit.client.0.smithi148.stdout:1/848: write d2/d5/d40/d7/d91/f67 [3760936,49609] 0 2024-02-28T16:26:49.465 INFO:tasks.workunit.client.0.smithi148.stdout:4/626: mknod d8/d37/d91/cd8 0 2024-02-28T16:26:49.465 INFO:tasks.workunit.client.0.smithi148.stdout:8/820: stat d1/dd/d13/d24/d3a/lf6 0 2024-02-28T16:26:49.469 INFO:tasks.workunit.client.0.smithi148.stdout:3/826: dwrite d1/db/d45/f98 [0,4194304] 0 2024-02-28T16:26:49.471 INFO:tasks.workunit.client.0.smithi148.stdout:3/827: chown d1/db/d45/faa 74295197 1 2024-02-28T16:26:49.479 INFO:tasks.workunit.client.0.smithi148.stdout:2/682: truncate d0/d1c/d85/d96/fb4 920228 0 2024-02-28T16:26:49.480 INFO:tasks.workunit.client.0.smithi148.stdout:2/683: stat d0/d59 0 2024-02-28T16:26:49.483 INFO:tasks.workunit.client.0.smithi148.stdout:2/684: write d0/dd/fab [406659,63207] 0 2024-02-28T16:26:49.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:49 smithi157 ceph-mon[38346]: pgmap v49: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 57 MiB/s rd, 170 MiB/s wr, 420 op/s 2024-02-28T16:26:49.489 INFO:tasks.workunit.client.0.smithi148.stdout:4/627: mkdir d8/d40/dc3/dd3/d17/dd9 0 2024-02-28T16:26:49.489 INFO:tasks.workunit.client.0.smithi148.stdout:2/685: chown d0/d1c/d6e/lc4 36042535 1 2024-02-28T16:26:49.493 INFO:tasks.workunit.client.0.smithi148.stdout:9/840: mknod d7/d1c/d1f/d49/dae/c11c 0 2024-02-28T16:26:49.494 INFO:tasks.workunit.client.0.smithi148.stdout:1/849: dwrite d2/d5/d40/f1b [4194304,4194304] 0 2024-02-28T16:26:49.503 INFO:tasks.workunit.client.0.smithi148.stdout:8/821: dwrite d1/dd/d13/d68/f30 [0,4194304] 0 2024-02-28T16:26:49.507 INFO:tasks.workunit.client.0.smithi148.stdout:6/752: dwrite d0/d8/ff [0,4194304] 0 2024-02-28T16:26:49.511 INFO:tasks.workunit.client.0.smithi148.stdout:1/850: mkdir d2/d25/d10b 0 2024-02-28T16:26:49.512 INFO:tasks.workunit.client.0.smithi148.stdout:4/628: dwrite d8/d40/fc1 [0,4194304] 0 2024-02-28T16:26:49.517 INFO:tasks.workunit.client.0.smithi148.stdout:1/851: chown d2/d5/d40/d8/dcd/d105 22 1 2024-02-28T16:26:49.518 INFO:tasks.workunit.client.0.smithi148.stdout:4/629: write d8/d21/d3d/f64 [2827503,69908] 0 2024-02-28T16:26:49.523 INFO:tasks.workunit.client.0.smithi148.stdout:7/749: sync 2024-02-28T16:26:49.528 INFO:tasks.workunit.client.0.smithi148.stdout:8/822: unlink d1/dd/f93 0 2024-02-28T16:26:49.528 INFO:tasks.workunit.client.0.smithi148.stdout:9/841: fdatasync d7/d1c/d32/d24/dc1/fbd 0 2024-02-28T16:26:49.531 INFO:tasks.workunit.client.0.smithi148.stdout:3/828: write d1/d13/d19/d88/f99 [994199,45109] 0 2024-02-28T16:26:49.536 INFO:tasks.workunit.client.0.smithi148.stdout:6/753: fdatasync d0/d10/f6f 0 2024-02-28T16:26:49.536 INFO:tasks.workunit.client.0.smithi148.stdout:8/823: readlink d1/d3/d18/d48/d22/d55/l5b 0 2024-02-28T16:26:49.538 INFO:tasks.workunit.client.0.smithi148.stdout:5/687: dwrite d1/f94 [0,4194304] 0 2024-02-28T16:26:49.541 INFO:tasks.workunit.client.0.smithi148.stdout:3/829: stat d1/d3f/da5/da9/fdd 0 2024-02-28T16:26:49.542 INFO:tasks.workunit.client.0.smithi148.stdout:5/688: readlink d1/d8/d20/d31/la1 0 2024-02-28T16:26:49.545 INFO:tasks.workunit.client.0.smithi148.stdout:5/689: write d1/db/d60/d7a/d8b/fb7 [415571,47037] 0 2024-02-28T16:26:49.551 INFO:tasks.workunit.client.0.smithi148.stdout:4/630: mkdir d8/d40/dc3/dd3/d17/d6a/d6c/dda 0 2024-02-28T16:26:49.553 INFO:tasks.workunit.client.0.smithi148.stdout:4/631: dread - d8/d40/dc3/dd3/fca zero size 2024-02-28T16:26:49.562 INFO:tasks.workunit.client.0.smithi148.stdout:9/842: creat d7/d1c/d1f/d49/dae/dc9/f11d x:0 0 0 2024-02-28T16:26:49.567 INFO:tasks.workunit.client.0.smithi148.stdout:7/750: unlink d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/f6d 0 2024-02-28T16:26:49.572 INFO:tasks.workunit.client.0.smithi148.stdout:3/830: dwrite d1/db/d45/f98 [4194304,4194304] 0 2024-02-28T16:26:49.575 INFO:tasks.workunit.client.0.smithi148.stdout:6/754: mknod d0/d4/d14/d59/cf3 0 2024-02-28T16:26:49.579 INFO:tasks.workunit.client.0.smithi148.stdout:4/632: dwrite d8/d21/d3d/f9b [0,4194304] 0 2024-02-28T16:26:49.580 INFO:tasks.workunit.client.0.smithi148.stdout:1/852: mkdir d2/d25/d10b/d10c 0 2024-02-28T16:26:49.585 INFO:tasks.workunit.client.0.smithi148.stdout:2/686: truncate d0/d66/d76/f7c 2661048 0 2024-02-28T16:26:49.586 INFO:tasks.workunit.client.0.smithi148.stdout:5/690: write d1/f6f [1493557,13830] 0 2024-02-28T16:26:49.588 INFO:tasks.workunit.client.0.smithi148.stdout:9/843: chown d7/d1c/d1f/d49/d8d 2141 1 2024-02-28T16:26:49.592 INFO:tasks.workunit.client.0.smithi148.stdout:8/824: dread d1/d3/d18/d48/d70/d75/d91/fab [0,4194304] 0 2024-02-28T16:26:49.593 INFO:tasks.workunit.client.0.smithi148.stdout:6/755: readlink d0/d8/d21/d9d/lb3 0 2024-02-28T16:26:49.594 INFO:tasks.workunit.client.0.smithi148.stdout:1/853: creat d2/d5/d40/d8/dd8/de2/da7/dd6/f10d x:0 0 0 2024-02-28T16:26:49.595 INFO:tasks.workunit.client.0.smithi148.stdout:2/687: mkdir d0/d66/dd4 0 2024-02-28T16:26:49.596 INFO:tasks.workunit.client.0.smithi148.stdout:1/854: dread - d2/d3f/dcf/f65 zero size 2024-02-28T16:26:49.600 INFO:tasks.workunit.client.0.smithi148.stdout:7/751: mkdir d0/d9/d25/d96/ddf/d28/d2b/d6f/de4 0 2024-02-28T16:26:49.601 INFO:tasks.workunit.client.0.smithi148.stdout:9/844: read d7/dd/d26/f5d [3535495,114443] 0 2024-02-28T16:26:49.608 INFO:tasks.workunit.client.0.smithi148.stdout:6/756: mknod d0/d22/d49/d88/cf4 0 2024-02-28T16:26:49.610 INFO:tasks.workunit.client.0.smithi148.stdout:6/757: write d0/d4/d14/d8a/fc9 [319181,66817] 0 2024-02-28T16:26:49.615 INFO:tasks.workunit.client.0.smithi148.stdout:7/752: symlink d0/d9/le5 0 2024-02-28T16:26:49.615 INFO:tasks.workunit.client.0.smithi148.stdout:6/758: fdatasync d0/d8/fcb 0 2024-02-28T16:26:49.617 INFO:tasks.workunit.client.0.smithi148.stdout:2/688: dread d0/d59/f7f [0,4194304] 0 2024-02-28T16:26:49.620 INFO:tasks.workunit.client.0.smithi148.stdout:4/633: getdents d8/d21/d3d/d4d/d72 0 2024-02-28T16:26:49.625 INFO:tasks.workunit.client.0.smithi148.stdout:9/845: fsync d7/d1c/d1f/d49/d5c/fd4 0 2024-02-28T16:26:49.627 INFO:tasks.workunit.client.0.smithi148.stdout:6/759: dread d0/d4/fa1 [0,4194304] 0 2024-02-28T16:26:49.639 INFO:tasks.workunit.client.0.smithi148.stdout:4/634: symlink d8/d21/d3d/d8c/db0/ldb 0 2024-02-28T16:26:49.644 INFO:tasks.workunit.client.0.smithi148.stdout:9/846: mknod d7/d1c/d32/d24/dac/c11e 0 2024-02-28T16:26:49.648 INFO:tasks.workunit.client.0.smithi148.stdout:5/691: dwrite d1/d44/d65/f76 [0,4194304] 0 2024-02-28T16:26:49.650 INFO:tasks.workunit.client.0.smithi148.stdout:1/855: getdents d2/d15/de7 0 2024-02-28T16:26:49.653 INFO:tasks.workunit.client.0.smithi148.stdout:6/760: creat d0/d4/dba/de9/ff5 x:0 0 0 2024-02-28T16:26:49.656 INFO:tasks.workunit.client.0.smithi148.stdout:2/689: creat d0/d66/dd4/fd5 x:0 0 0 2024-02-28T16:26:49.657 INFO:tasks.workunit.client.0.smithi148.stdout:3/831: dwrite d1/db/d35/f92 [0,4194304] 0 2024-02-28T16:26:49.660 INFO:tasks.workunit.client.0.smithi148.stdout:8/825: rename d1/dd/d13/d1a/d25/c79 to d1/dd/d13/d1a/c111 0 2024-02-28T16:26:49.662 INFO:tasks.workunit.client.0.smithi148.stdout:9/847: creat d7/d1c/d74/d68/d10d/f11f x:0 0 0 2024-02-28T16:26:49.665 INFO:tasks.workunit.client.0.smithi148.stdout:5/692: creat d1/d8/d20/d31/d50/fd1 x:0 0 0 2024-02-28T16:26:49.667 INFO:tasks.workunit.client.0.smithi148.stdout:5/693: chown d1/db/d25/dc2 994044 1 2024-02-28T16:26:49.671 INFO:tasks.workunit.client.0.smithi148.stdout:7/753: dread d0/d9/d1b/f62 [0,4194304] 0 2024-02-28T16:26:49.674 INFO:tasks.workunit.client.0.smithi148.stdout:5/694: truncate d1/db/d60/d7a/dbb/fbf 442165 0 2024-02-28T16:26:49.675 INFO:tasks.workunit.client.0.smithi148.stdout:1/856: rename d2/d15/d33/fd7 to d2/d15/d8b/da3/f10e 0 2024-02-28T16:26:49.675 INFO:tasks.workunit.client.0.smithi148.stdout:8/826: creat d1/dd/d13/d1a/d25/da3/f112 x:0 0 0 2024-02-28T16:26:49.676 INFO:tasks.workunit.client.0.smithi148.stdout:3/832: dread - d1/db/d35/d70/d71/f84 zero size 2024-02-28T16:26:49.689 INFO:tasks.workunit.client.0.smithi148.stdout:8/827: symlink d1/dd/d13/d1a/d25/d50/l113 0 2024-02-28T16:26:49.690 INFO:tasks.workunit.client.0.smithi148.stdout:1/857: mkdir d2/d5/d40/d8/dd8/de2/d10f 0 2024-02-28T16:26:49.693 INFO:tasks.workunit.client.0.smithi148.stdout:1/858: stat d2/d15/d8b/da3/dc2/cce 0 2024-02-28T16:26:49.703 INFO:tasks.workunit.client.0.smithi148.stdout:2/690: dread d0/d18/d9a/f63 [0,4194304] 0 2024-02-28T16:26:49.703 INFO:tasks.workunit.client.0.smithi148.stdout:1/859: symlink d2/d5/d40/d7/d99/l110 0 2024-02-28T16:26:49.706 INFO:tasks.workunit.client.0.smithi148.stdout:5/695: dwrite d1/db/d60/d7a/fc1 [0,4194304] 0 2024-02-28T16:26:49.710 INFO:tasks.workunit.client.0.smithi148.stdout:7/754: rename d0/d9/d25/d96/ddf/d28/d2b/d5c/ca4 to d0/d9/d25/d39/ce6 0 2024-02-28T16:26:49.718 INFO:tasks.workunit.client.0.smithi148.stdout:2/691: readlink d0/d1c/d85/d8b/d8f/d9d/d36/l72 0 2024-02-28T16:26:49.727 INFO:tasks.workunit.client.0.smithi148.stdout:2/692: write d0/d18/d20/dd3/fc8 [921550,15061] 0 2024-02-28T16:26:49.734 INFO:tasks.workunit.client.0.smithi148.stdout:3/833: dread d1/d13/f15 [0,4194304] 0 2024-02-28T16:26:49.740 INFO:tasks.workunit.client.0.smithi148.stdout:5/696: dwrite d1/db/d25/f7e [0,4194304] 0 2024-02-28T16:26:49.743 INFO:tasks.workunit.client.0.smithi148.stdout:4/635: dwrite d8/d40/dc3/dd3/d5f/f8f [0,4194304] 0 2024-02-28T16:26:49.743 INFO:tasks.workunit.client.0.smithi148.stdout:9/848: write d7/d1c/d32/d24/f2f [442824,71765] 0 2024-02-28T16:26:49.744 INFO:tasks.workunit.client.0.smithi148.stdout:8/828: dread d1/d3/f20 [0,4194304] 0 2024-02-28T16:26:49.744 INFO:tasks.workunit.client.0.smithi148.stdout:5/697: dread - d1/db/fc5 zero size 2024-02-28T16:26:49.746 INFO:tasks.workunit.client.0.smithi148.stdout:4/636: readlink d8/d21/d3d/d8c/l9e 0 2024-02-28T16:26:49.751 INFO:tasks.workunit.client.0.smithi148.stdout:5/698: fdatasync d1/db/d60/d7a/d8b/d80/fd0 0 2024-02-28T16:26:49.752 INFO:tasks.workunit.client.0.smithi148.stdout:4/637: write d8/f14 [493663,125717] 0 2024-02-28T16:26:49.754 INFO:tasks.workunit.client.0.smithi148.stdout:1/860: rename l1 to d2/d3f/l111 0 2024-02-28T16:26:49.762 INFO:tasks.workunit.client.0.smithi148.stdout:2/693: write d0/d18/d9a/f87 [414616,98081] 0 2024-02-28T16:26:49.768 INFO:tasks.workunit.client.0.smithi148.stdout:8/829: unlink d1/dd/d13/d68/f30 0 2024-02-28T16:26:49.769 INFO:tasks.workunit.client.0.smithi148.stdout:1/861: truncate d2/d3f/dcf/d75/d76/fd3 290696 0 2024-02-28T16:26:49.769 INFO:tasks.workunit.client.0.smithi148.stdout:6/761: dwrite d0/d22/d49/d88/f93 [0,4194304] 0 2024-02-28T16:26:49.773 INFO:tasks.workunit.client.0.smithi148.stdout:5/699: symlink d1/d8/d20/d4e/d71/ld2 0 2024-02-28T16:26:49.774 INFO:tasks.workunit.client.0.smithi148.stdout:3/834: creat d1/d13/d19/d1b/d38/ff2 x:0 0 0 2024-02-28T16:26:49.778 INFO:tasks.workunit.client.0.smithi148.stdout:7/755: dwrite d0/f36 [0,4194304] 0 2024-02-28T16:26:49.780 INFO:tasks.workunit.client.0.smithi148.stdout:9/849: creat d7/d1c/d1f/d49/f120 x:0 0 0 2024-02-28T16:26:49.781 INFO:tasks.workunit.client.0.smithi148.stdout:3/835: chown d1/d13/l2e 98 1 2024-02-28T16:26:49.795 INFO:tasks.workunit.client.0.smithi148.stdout:8/830: mknod d1/d3/d18/d48/d22/d34/c114 0 2024-02-28T16:26:49.798 INFO:tasks.workunit.client.0.smithi148.stdout:9/850: chown d7/d1c/d1f/d49/da7 733 1 2024-02-28T16:26:49.799 INFO:tasks.workunit.client.0.smithi148.stdout:5/700: dwrite d1/d8/d20/d4e/d84/d92/fc4 [0,4194304] 0 2024-02-28T16:26:49.802 INFO:tasks.workunit.client.0.smithi148.stdout:1/862: mknod d2/d5/d40/d8/dd8/de2/d10f/c112 0 2024-02-28T16:26:49.804 INFO:tasks.workunit.client.0.smithi148.stdout:4/638: getdents d8/d40/dc3/dd3/d17 0 2024-02-28T16:26:49.806 INFO:tasks.workunit.client.0.smithi148.stdout:1/863: readlink d2/d5/d40/d7/d99/l110 0 2024-02-28T16:26:49.806 INFO:tasks.workunit.client.0.smithi148.stdout:3/836: mknod d1/d13/dce/cf3 0 2024-02-28T16:26:49.809 INFO:tasks.workunit.client.0.smithi148.stdout:8/831: fsync d1/dd/d13/d1a/d87/f6b 0 2024-02-28T16:26:49.816 INFO:tasks.workunit.client.0.smithi148.stdout:5/701: rename d1/db/d60/d7a/f88 to d1/db/d60/d7a/dbb/fd3 0 2024-02-28T16:26:49.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/864: creat d2/d3f/dcf/f113 x:0 0 0 2024-02-28T16:26:49.816 INFO:tasks.workunit.client.0.smithi148.stdout:6/762: dread d0/f6e [0,4194304] 0 2024-02-28T16:26:49.819 INFO:tasks.workunit.client.0.smithi148.stdout:5/702: fsync d1/d8/fbc 0 2024-02-28T16:26:49.820 INFO:tasks.workunit.client.0.smithi148.stdout:8/832: mkdir d1/dd/d13/d1a/d115 0 2024-02-28T16:26:49.824 INFO:tasks.workunit.client.0.smithi148.stdout:8/833: fsync d1/fd0 0 2024-02-28T16:26:49.830 INFO:tasks.workunit.client.0.smithi148.stdout:9/851: dread d7/d1c/d59/fa4 [0,4194304] 0 2024-02-28T16:26:49.830 INFO:tasks.workunit.client.0.smithi148.stdout:8/834: readlink d1/dd/d51/d9b/dc6/dae/ld9 0 2024-02-28T16:26:49.831 INFO:tasks.workunit.client.0.smithi148.stdout:3/837: rename d1/d13/d19/d32/fb0 to d1/d13/d19/d1b/dd9/ff4 0 2024-02-28T16:26:49.834 INFO:tasks.workunit.client.0.smithi148.stdout:9/852: chown d7/d43/da8/f11b 8684827 1 2024-02-28T16:26:49.839 INFO:tasks.workunit.client.0.smithi148.stdout:6/763: creat d0/d22/d27/d66/ff6 x:0 0 0 2024-02-28T16:26:49.842 INFO:tasks.workunit.client.0.smithi148.stdout:2/694: write d0/d9/d13/d38/f6b [3207960,19567] 0 2024-02-28T16:26:49.844 INFO:tasks.workunit.client.0.smithi148.stdout:9/853: dread d7/d43/fd0 [0,4194304] 0 2024-02-28T16:26:49.848 INFO:tasks.workunit.client.0.smithi148.stdout:1/865: mkdir d2/d5/d40/d7/d99/d114 0 2024-02-28T16:26:49.849 INFO:tasks.workunit.client.0.smithi148.stdout:9/854: chown d7/d43/ddd/df1/d113 8893 1 2024-02-28T16:26:49.857 INFO:tasks.workunit.client.0.smithi148.stdout:4/639: write d8/d40/dc3/dd3/d17/d6a/f3a [137047,13069] 0 2024-02-28T16:26:49.860 INFO:tasks.workunit.client.0.smithi148.stdout:4/640: truncate d8/fa8 878286 0 2024-02-28T16:26:49.872 INFO:tasks.workunit.client.0.smithi148.stdout:7/756: dwrite d0/d9/d4c/fa8 [0,4194304] 0 2024-02-28T16:26:49.875 INFO:tasks.workunit.client.0.smithi148.stdout:6/764: dwrite d0/d4/f7a [0,4194304] 0 2024-02-28T16:26:49.878 INFO:tasks.workunit.client.0.smithi148.stdout:6/765: readlink d0/d4/d14/d8a/l99 0 2024-02-28T16:26:49.881 INFO:tasks.workunit.client.0.smithi148.stdout:3/838: dread d1/d13/d19/d1b/f44 [0,4194304] 0 2024-02-28T16:26:49.908 INFO:tasks.workunit.client.0.smithi148.stdout:7/757: creat d0/d4/fe7 x:0 0 0 2024-02-28T16:26:49.912 INFO:tasks.workunit.client.0.smithi148.stdout:9/855: creat d7/d43/de0/de7/f121 x:0 0 0 2024-02-28T16:26:49.920 INFO:tasks.workunit.client.0.smithi148.stdout:5/703: dwrite d1/d8/d20/d4e/d84/f8a [0,4194304] 0 2024-02-28T16:26:49.925 INFO:tasks.workunit.client.0.smithi148.stdout:9/856: truncate d7/d1c/d59/d83/d88/f8a 2712735 0 2024-02-28T16:26:49.931 INFO:tasks.workunit.client.0.smithi148.stdout:7/758: creat d0/d9/d25/d96/ddf/d28/d2b/d5c/fe8 x:0 0 0 2024-02-28T16:26:49.933 INFO:tasks.workunit.client.0.smithi148.stdout:2/695: dwrite d0/d66/d76/f7c [0,4194304] 0 2024-02-28T16:26:49.936 INFO:tasks.workunit.client.0.smithi148.stdout:8/835: getdents d1/dd/d13 0 2024-02-28T16:26:49.938 INFO:tasks.workunit.client.0.smithi148.stdout:5/704: rmdir d1/db 39 2024-02-28T16:26:49.944 INFO:tasks.workunit.client.0.smithi148.stdout:1/866: link d2/d5/d40/dcc/lef d2/d5/d40/d8/l115 0 2024-02-28T16:26:49.949 INFO:tasks.workunit.client.0.smithi148.stdout:1/867: chown d2/d5/d40/f27 1858251 1 2024-02-28T16:26:49.957 INFO:tasks.workunit.client.0.smithi148.stdout:4/641: truncate d8/d40/dc3/dd3/d5f/f8f 178619 0 2024-02-28T16:26:49.963 INFO:tasks.workunit.client.0.smithi148.stdout:3/839: dwrite d1/d13/f6f [0,4194304] 0 2024-02-28T16:26:49.963 INFO:tasks.workunit.client.0.smithi148.stdout:7/759: mknod d0/d9/d25/d96/ddf/d1c/ce9 0 2024-02-28T16:26:49.965 INFO:tasks.workunit.client.0.smithi148.stdout:2/696: fdatasync d0/d9/f21 0 2024-02-28T16:26:49.969 INFO:tasks.workunit.client.0.smithi148.stdout:7/760: chown d0/d9/d25/d96/ddf/d28/d2b/d5c/ce1 3150 1 2024-02-28T16:26:49.970 INFO:tasks.workunit.client.0.smithi148.stdout:8/836: write d1/dd/d13/d1a/d33/fdd [922686,43127] 0 2024-02-28T16:26:49.984 INFO:tasks.workunit.client.0.smithi148.stdout:6/766: getdents d0/d22/d27/d66/d87 0 2024-02-28T16:26:49.994 INFO:tasks.workunit.client.0.smithi148.stdout:3/840: mkdir d1/db/d45/d80/df5 0 2024-02-28T16:26:49.997 INFO:tasks.workunit.client.0.smithi148.stdout:3/841: write d1/d3f/f77 [1037676,50774] 0 2024-02-28T16:26:50.001 INFO:tasks.workunit.client.0.smithi148.stdout:9/857: dwrite d7/d1c/d32/d24/dc1/fbd [0,4194304] 0 2024-02-28T16:26:50.003 INFO:tasks.workunit.client.0.smithi148.stdout:3/842: dread - d1/d13/d19/d1b/fdc zero size 2024-02-28T16:26:50.010 INFO:tasks.workunit.client.0.smithi148.stdout:7/761: rename d0/d9/d25/d96/ddf/d28/d2b/d5c/ce1 to d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/cea 0 2024-02-28T16:26:50.011 INFO:tasks.workunit.client.0.smithi148.stdout:8/837: read d1/d3/d18/d48/d70/d75/d91/fb4 [2242210,11942] 0 2024-02-28T16:26:50.013 INFO:tasks.workunit.client.0.smithi148.stdout:6/767: readlink d0/d4/dba/d71/le1 0 2024-02-28T16:26:50.013 INFO:tasks.workunit.client.0.smithi148.stdout:7/762: truncate d0/d9/d1b/fba 810974 0 2024-02-28T16:26:50.014 INFO:tasks.workunit.client.0.smithi148.stdout:6/768: chown d0/d10/f6f 1816315905 1 2024-02-28T16:26:50.016 INFO:tasks.workunit.client.0.smithi148.stdout:2/697: symlink d0/d1d/ld6 0 2024-02-28T16:26:50.023 INFO:tasks.workunit.client.0.smithi148.stdout:1/868: creat d2/d5/f116 x:0 0 0 2024-02-28T16:26:50.027 INFO:tasks.workunit.client.0.smithi148.stdout:9/858: mknod d7/d1c/d1f/d49/d5c/c122 0 2024-02-28T16:26:50.032 INFO:tasks.workunit.client.0.smithi148.stdout:3/843: symlink d1/d13/d19/d94/db6/lf6 0 2024-02-28T16:26:50.043 INFO:tasks.workunit.client.0.smithi148.stdout:8/838: rename d1/d3/d18/d5a/dbf/cd8 to d1/d3/d18/d48/d70/d75/d91/dcc/ddf/c116 0 2024-02-28T16:26:50.046 INFO:tasks.workunit.client.0.smithi148.stdout:4/642: dwrite d8/d40/d73/f96 [0,4194304] 0 2024-02-28T16:26:50.050 INFO:tasks.workunit.client.0.smithi148.stdout:2/698: creat d0/d18/d9a/fd7 x:0 0 0 2024-02-28T16:26:50.050 INFO:tasks.workunit.client.0.smithi148.stdout:6/769: dread d0/d22/d25/f4b [0,4194304] 0 2024-02-28T16:26:50.057 INFO:tasks.workunit.client.0.smithi148.stdout:1/869: dread d2/d5/d40/d7/d91/f81 [0,4194304] 0 2024-02-28T16:26:50.070 INFO:tasks.workunit.client.0.smithi148.stdout:3/844: symlink d1/d13/d19/d94/db6/lf7 0 2024-02-28T16:26:50.073 INFO:tasks.workunit.client.0.smithi148.stdout:1/870: dread d2/d5/d40/d8/f10 [0,4194304] 0 2024-02-28T16:26:50.078 INFO:tasks.workunit.client.0.smithi148.stdout:8/839: creat d1/dd/d13/d1a/d87/f117 x:0 0 0 2024-02-28T16:26:50.078 INFO:tasks.workunit.client.0.smithi148.stdout:2/699: creat d0/d66/fd8 x:0 0 0 2024-02-28T16:26:50.082 INFO:tasks.workunit.client.0.smithi148.stdout:2/700: write d0/d18/f19 [1065552,101435] 0 2024-02-28T16:26:50.091 INFO:tasks.workunit.client.0.smithi148.stdout:9/859: creat d7/d1c/d1f/d49/da7/dcf/f123 x:0 0 0 2024-02-28T16:26:50.097 INFO:tasks.workunit.client.0.smithi148.stdout:4/643: creat d8/d21/d3d/d4d/dd0/dd4/fdc x:0 0 0 2024-02-28T16:26:50.103 INFO:tasks.workunit.client.0.smithi148.stdout:3/845: dread d1/d13/d19/d88/f8c [0,4194304] 0 2024-02-28T16:26:50.103 INFO:tasks.workunit.client.0.smithi148.stdout:8/840: mkdir d1/d3/d18/d48/d70/d75/d118 0 2024-02-28T16:26:50.105 INFO:tasks.workunit.client.0.smithi148.stdout:3/846: read - d1/db/d45/d80/fc7 zero size 2024-02-28T16:26:50.107 INFO:tasks.workunit.client.0.smithi148.stdout:7/763: truncate d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/d97/fdb 1374416 0 2024-02-28T16:26:50.110 INFO:tasks.workunit.client.0.smithi148.stdout:5/705: link d1/db/d60/d7a/d8b/dad/lae d1/d44/d65/ld4 0 2024-02-28T16:26:50.113 INFO:tasks.workunit.client.0.smithi148.stdout:1/871: write d2/d5/d40/f3d [2033732,28466] 0 2024-02-28T16:26:50.117 INFO:tasks.workunit.client.0.smithi148.stdout:3/847: unlink d1/d3f/c6a 0 2024-02-28T16:26:50.118 INFO:tasks.workunit.client.0.smithi148.stdout:1/872: chown d2/d3f/dcf/c7f 202 1 2024-02-28T16:26:50.119 INFO:tasks.workunit.client.0.smithi148.stdout:8/841: read d1/d3/d18/d5a/d60/f6d [2728985,66872] 0 2024-02-28T16:26:50.123 INFO:tasks.workunit.client.0.smithi148.stdout:8/842: chown d1/d3/d18/d5a/d60/lb1 724910 1 2024-02-28T16:26:50.126 INFO:tasks.workunit.client.0.smithi148.stdout:8/843: stat d1/dd/d13/d1a/d25/d50/c97 0 2024-02-28T16:26:50.126 INFO:tasks.workunit.client.0.smithi148.stdout:6/770: link d0/d22/d49/dae/cd4 d0/cf7 0 2024-02-28T16:26:50.128 INFO:tasks.workunit.client.0.smithi148.stdout:7/764: mkdir d0/d9/deb 0 2024-02-28T16:26:50.135 INFO:tasks.workunit.client.0.smithi148.stdout:8/844: creat d1/d3/f119 x:0 0 0 2024-02-28T16:26:50.140 INFO:tasks.workunit.client.0.smithi148.stdout:8/845: chown d1/fd0 134414292 1 2024-02-28T16:26:50.142 INFO:tasks.workunit.client.0.smithi148.stdout:9/860: dwrite d7/d1c/d3d/fd6 [0,4194304] 0 2024-02-28T16:26:50.147 INFO:tasks.workunit.client.0.smithi148.stdout:3/848: creat d1/d13/d19/ff8 x:0 0 0 2024-02-28T16:26:50.147 INFO:tasks.workunit.client.0.smithi148.stdout:4/644: dread d8/d40/dc3/dd3/d1f/f42 [0,4194304] 0 2024-02-28T16:26:50.147 INFO:tasks.workunit.client.0.smithi148.stdout:8/846: stat d1/dd/d13/d68 0 2024-02-28T16:26:50.147 INFO:tasks.workunit.client.0.smithi148.stdout:7/765: mkdir d0/dd5/de2/dec 0 2024-02-28T16:26:50.148 INFO:tasks.workunit.client.0.smithi148.stdout:2/701: write d0/d18/f28 [501142,72248] 0 2024-02-28T16:26:50.150 INFO:tasks.workunit.client.0.smithi148.stdout:3/849: dread - d1/d13/d19/d1b/fdc zero size 2024-02-28T16:26:50.158 INFO:tasks.workunit.client.0.smithi148.stdout:4/645: mknod d8/d40/d73/cdd 0 2024-02-28T16:26:50.160 INFO:tasks.workunit.client.0.smithi148.stdout:1/873: dwrite d2/d3f/dcf/d75/d76/ddc/feb [0,4194304] 0 2024-02-28T16:26:50.160 INFO:tasks.workunit.client.0.smithi148.stdout:6/771: dwrite d0/d22/d27/d66/d87/f91 [4194304,4194304] 0 2024-02-28T16:26:50.163 INFO:tasks.workunit.client.0.smithi148.stdout:8/847: chown d1/dd/d13/d1a/c38 185044514 1 2024-02-28T16:26:50.163 INFO:tasks.workunit.client.0.smithi148.stdout:2/702: write d0/d9/d13/d38/d3a/fb1 [3255008,95013] 0 2024-02-28T16:26:50.167 INFO:tasks.workunit.client.0.smithi148.stdout:6/772: write d0/d4/f11 [552506,49190] 0 2024-02-28T16:26:50.169 INFO:tasks.workunit.client.0.smithi148.stdout:9/861: rename d7/d1c/d32/f54 to d7/d1c/d59/d83/de4/f124 0 2024-02-28T16:26:50.170 INFO:tasks.workunit.client.0.smithi148.stdout:6/773: stat d0/d4/d14/d8a/fab 0 2024-02-28T16:26:50.172 INFO:tasks.workunit.client.0.smithi148.stdout:3/850: creat d1/d13/d19/d88/deb/ff9 x:0 0 0 2024-02-28T16:26:50.177 INFO:tasks.workunit.client.0.smithi148.stdout:2/703: mknod d0/d9/d13/d38/d3a/db3/cd9 0 2024-02-28T16:26:50.179 INFO:tasks.workunit.client.0.smithi148.stdout:7/766: read d0/d9/d25/d96/ddf/f41 [1025477,52469] 0 2024-02-28T16:26:50.181 INFO:tasks.workunit.client.0.smithi148.stdout:1/874: creat d2/d5/d40/d8/dd8/de2/f117 x:0 0 0 2024-02-28T16:26:50.181 INFO:tasks.workunit.client.0.smithi148.stdout:9/862: symlink d7/d1c/d3d/l125 0 2024-02-28T16:26:50.184 INFO:tasks.workunit.client.0.smithi148.stdout:8/848: fdatasync d1/dd/d13/d1a/d25/d50/fa0 0 2024-02-28T16:26:50.188 INFO:tasks.workunit.client.0.smithi148.stdout:2/704: mkdir d0/d1c/d85/d8b/dda 0 2024-02-28T16:26:50.191 INFO:tasks.workunit.client.0.smithi148.stdout:6/774: rename d0/d4/dba/la7 to d0/d22/d27/d3e/d52/lf8 0 2024-02-28T16:26:50.196 INFO:tasks.workunit.client.0.smithi148.stdout:3/851: dwrite d1/d13/d19/d88/deb/ff9 [0,4194304] 0 2024-02-28T16:26:50.204 INFO:tasks.workunit.client.0.smithi148.stdout:1/875: unlink d2/d25/l58 0 2024-02-28T16:26:50.210 INFO:tasks.workunit.client.0.smithi148.stdout:1/876: dread - d2/d5/d40/d8/dd8/de2/f117 zero size 2024-02-28T16:26:50.212 INFO:tasks.workunit.client.0.smithi148.stdout:2/705: rename d0/d18/d20/d73/lcb to d0/d9/d13/d38/d3a/db3/ldb 0 2024-02-28T16:26:50.216 INFO:tasks.workunit.client.0.smithi148.stdout:9/863: creat d7/d1c/d1f/f126 x:0 0 0 2024-02-28T16:26:50.222 INFO:tasks.workunit.client.0.smithi148.stdout:4/646: dread d8/f26 [0,4194304] 0 2024-02-28T16:26:50.224 INFO:tasks.workunit.client.0.smithi148.stdout:7/767: symlink d0/d9/d25/d96/db7/dd4/led 0 2024-02-28T16:26:50.233 INFO:tasks.workunit.client.0.smithi148.stdout:2/706: symlink d0/d18/d9a/ldc 0 2024-02-28T16:26:50.235 INFO:tasks.workunit.client.0.smithi148.stdout:7/768: read d0/f1d [2449637,70865] 0 2024-02-28T16:26:50.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:50 smithi157 ceph-mon[38346]: mgrmap e26: smithi157.cmcxzj(active, since 92s), standbys: smithi148.gelspy 2024-02-28T16:26:50.239 INFO:tasks.workunit.client.0.smithi148.stdout:3/852: rename d1/db/d35/d70/d71 to d1/d13/d19/d32/d9e/dfa 0 2024-02-28T16:26:50.240 INFO:tasks.workunit.client.0.smithi148.stdout:9/864: creat d7/d1c/d1f/d49/d5c/f127 x:0 0 0 2024-02-28T16:26:50.242 INFO:tasks.workunit.client.0.smithi148.stdout:9/865: chown d7/d1c/d1f/l84 12126 1 2024-02-28T16:26:50.245 INFO:tasks.workunit.client.0.smithi148.stdout:3/853: truncate d1/d13/d19/d1b/d38/f82 4735170 0 2024-02-28T16:26:50.245 INFO:tasks.workunit.client.0.smithi148.stdout:5/706: write d1/db/d60/d7a/dbb/fd3 [648299,128596] 0 2024-02-28T16:26:50.248 INFO:tasks.workunit.client.0.smithi148.stdout:1/877: symlink d2/l118 0 2024-02-28T16:26:50.249 INFO:tasks.workunit.client.0.smithi148.stdout:5/707: truncate d1/db/d60/fac 1792892 0 2024-02-28T16:26:50.250 INFO:tasks.workunit.client.0.smithi148.stdout:2/707: write d0/dd/f88 [239350,31488] 0 2024-02-28T16:26:50.253 INFO:tasks.workunit.client.0.smithi148.stdout:3/854: fsync d1/d13/d19/d56/fae 0 2024-02-28T16:26:50.253 INFO:tasks.workunit.client.0.smithi148.stdout:2/708: write d0/d18/d9a/f87 [992334,11917] 0 2024-02-28T16:26:50.257 INFO:tasks.workunit.client.0.smithi148.stdout:9/866: creat d7/d1c/d32/d24/d10b/f128 x:0 0 0 2024-02-28T16:26:50.261 INFO:tasks.workunit.client.0.smithi148.stdout:2/709: dread d0/d1c/d85/d96/fb4 [0,4194304] 0 2024-02-28T16:26:50.262 INFO:tasks.workunit.client.0.smithi148.stdout:5/708: mkdir d1/d8/d20/d4e/d71/dd5 0 2024-02-28T16:26:50.265 INFO:tasks.workunit.client.0.smithi148.stdout:2/710: write d0/d9/d13/d38/f6b [3771054,102331] 0 2024-02-28T16:26:50.276 INFO:tasks.workunit.client.0.smithi148.stdout:9/867: creat d7/d43/ddd/df1/f129 x:0 0 0 2024-02-28T16:26:50.281 INFO:tasks.workunit.client.0.smithi148.stdout:4/647: dread d8/d40/d73/f7a [0,4194304] 0 2024-02-28T16:26:50.281 INFO:tasks.workunit.client.0.smithi148.stdout:3/855: dread d1/db/d45/d80/fa6 [0,4194304] 0 2024-02-28T16:26:50.296 INFO:tasks.workunit.client.0.smithi148.stdout:8/849: dwrite d1/d3/d18/d48/d70/d75/d91/fab [0,4194304] 0 2024-02-28T16:26:50.299 INFO:tasks.workunit.client.0.smithi148.stdout:7/769: write d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/db4/f84 [868769,46697] 0 2024-02-28T16:26:50.317 INFO:tasks.workunit.client.0.smithi148.stdout:7/770: dwrite d0/d9/d25/d96/ddf/fde [0,4194304] 0 2024-02-28T16:26:50.326 INFO:tasks.workunit.client.0.smithi148.stdout:2/711: fsync d0/d18/d20/dd3/faf 0 2024-02-28T16:26:50.326 INFO:tasks.workunit.client.0.smithi148.stdout:9/868: creat d7/dd/d26/f12a x:0 0 0 2024-02-28T16:26:50.327 INFO:tasks.workunit.client.0.smithi148.stdout:1/878: getdents d2/d5/d40/d8/dd8/de2/da7 0 2024-02-28T16:26:50.329 INFO:tasks.workunit.client.0.smithi148.stdout:4/648: rmdir d8/d40/dc3/dd3/da3 39 2024-02-28T16:26:50.331 INFO:tasks.workunit.client.0.smithi148.stdout:1/879: dread - d2/d3f/f97 zero size 2024-02-28T16:26:50.332 INFO:tasks.workunit.client.0.smithi148.stdout:8/850: dread - d1/dd/d13/d24/d3a/d49/fde zero size 2024-02-28T16:26:50.334 INFO:tasks.workunit.client.0.smithi148.stdout:1/880: readlink d2/l18 0 2024-02-28T16:26:50.339 INFO:tasks.workunit.client.0.smithi148.stdout:7/771: unlink d0/d9/d46/f6e 0 2024-02-28T16:26:50.339 INFO:tasks.workunit.client.0.smithi148.stdout:5/709: rename d1/d44/fb8 to d1/d8/d20/fd6 0 2024-02-28T16:26:50.340 INFO:tasks.workunit.client.0.smithi148.stdout:7/772: chown d0/d4 39 1 2024-02-28T16:26:50.340 INFO:tasks.workunit.client.0.smithi148.stdout:2/712: mkdir d0/d18/d20/ddd 0 2024-02-28T16:26:50.348 INFO:tasks.workunit.client.0.smithi148.stdout:2/713: fdatasync d0/d9/d13/d38/d3a/f4a 0 2024-02-28T16:26:50.348 INFO:tasks.workunit.client.0.smithi148.stdout:3/856: getdents d1/d13/d19 0 2024-02-28T16:26:50.351 INFO:tasks.workunit.client.0.smithi148.stdout:1/881: link d2/d3f/dcf/d75/d76/ddc/feb d2/d15/d8b/da3/dc2/f119 0 2024-02-28T16:26:50.363 INFO:tasks.workunit.client.0.smithi148.stdout:1/882: unlink d2/l59 0 2024-02-28T16:26:50.372 INFO:tasks.workunit.client.0.smithi148.stdout:4/649: dwrite d8/d40/dc3/dd3/fca [0,4194304] 0 2024-02-28T16:26:50.373 INFO:tasks.workunit.client.0.smithi148.stdout:5/710: dwrite d1/db/d25/f7e [0,4194304] 0 2024-02-28T16:26:50.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:50 smithi148 ceph-mon[28767]: mgrmap e26: smithi157.cmcxzj(active, since 92s), standbys: smithi148.gelspy 2024-02-28T16:26:50.376 INFO:tasks.workunit.client.0.smithi148.stdout:5/711: readlink d1/db/d25/l79 0 2024-02-28T16:26:50.387 INFO:tasks.workunit.client.0.smithi148.stdout:5/712: fdatasync d1/f43 0 2024-02-28T16:26:50.390 INFO:tasks.workunit.client.0.smithi148.stdout:9/869: dread d7/d1c/f9a [4194304,4194304] 0 2024-02-28T16:26:50.393 INFO:tasks.workunit.client.0.smithi148.stdout:5/713: write d1/d8/d20/d31/f4d [2492326,58463] 0 2024-02-28T16:26:50.398 INFO:tasks.workunit.client.0.smithi148.stdout:5/714: dread - d1/d44/d65/fce zero size 2024-02-28T16:26:50.401 INFO:tasks.workunit.client.0.smithi148.stdout:7/773: dread d0/d9/d25/f2f [0,4194304] 0 2024-02-28T16:26:50.404 INFO:tasks.workunit.client.0.smithi148.stdout:2/714: dread d0/d18/d9a/f7b [0,4194304] 0 2024-02-28T16:26:50.409 INFO:tasks.workunit.client.0.smithi148.stdout:3/857: dread d1/d3f/da5/dda/f60 [0,4194304] 0 2024-02-28T16:26:50.409 INFO:tasks.workunit.client.0.smithi148.stdout:2/715: readlink d0/d1c/d85/d8b/d8f/d9d/l42 0 2024-02-28T16:26:50.410 INFO:tasks.workunit.client.0.smithi148.stdout:4/650: dwrite d8/d40/dc3/dd3/d17/d6a/f50 [0,4194304] 0 2024-02-28T16:26:50.416 INFO:tasks.workunit.client.0.smithi148.stdout:3/858: truncate d1/da0/fe7 937576 0 2024-02-28T16:26:50.417 INFO:tasks.workunit.client.0.smithi148.stdout:7/774: creat d0/d9/d25/d39/fee x:0 0 0 2024-02-28T16:26:50.421 INFO:tasks.workunit.client.0.smithi148.stdout:3/859: write d1/d13/d19/d94/fe1 [2040350,85071] 0 2024-02-28T16:26:50.423 INFO:tasks.workunit.client.0.smithi148.stdout:2/716: dread d0/d59/f7f [0,4194304] 0 2024-02-28T16:26:50.428 INFO:tasks.workunit.client.0.smithi148.stdout:1/883: rename d2/d5/d40/lb8 to d2/d15/l11a 0 2024-02-28T16:26:50.430 INFO:tasks.workunit.client.0.smithi148.stdout:4/651: truncate d8/d21/d3d/f88 72895 0 2024-02-28T16:26:50.437 INFO:tasks.workunit.client.0.smithi148.stdout:8/851: truncate d1/d3/d18/d48/d22/fa1 29 0 2024-02-28T16:26:50.438 INFO:tasks.workunit.client.0.smithi148.stdout:3/860: rmdir d1 39 2024-02-28T16:26:50.439 INFO:tasks.workunit.client.0.smithi148.stdout:7/775: creat d0/d18/fef x:0 0 0 2024-02-28T16:26:50.441 INFO:tasks.workunit.client.0.smithi148.stdout:8/852: chown d1/dd/d13/fb8 439843 1 2024-02-28T16:26:50.442 INFO:tasks.workunit.client.0.smithi148.stdout:2/717: creat d0/d18/fde x:0 0 0 2024-02-28T16:26:50.444 INFO:tasks.workunit.client.0.smithi148.stdout:8/853: stat d1/d3/d18/d48/d22/d55/l5b 0 2024-02-28T16:26:50.446 INFO:tasks.workunit.client.0.smithi148.stdout:8/854: chown d1/dd/d51/d9b/lee 125440 1 2024-02-28T16:26:50.453 INFO:tasks.workunit.client.0.smithi148.stdout:4/652: unlink d8/d21/d3d/f6f 0 2024-02-28T16:26:50.455 INFO:tasks.workunit.client.0.smithi148.stdout:2/718: dread d0/d18/f19 [0,4194304] 0 2024-02-28T16:26:50.456 INFO:tasks.workunit.client.0.smithi148.stdout:1/884: dwrite d2/d15/d33/f63 [0,4194304] 0 2024-02-28T16:26:50.458 INFO:tasks.workunit.client.0.smithi148.stdout:4/653: write d8/d40/dc3/dd3/d5f/f81 [140526,34919] 0 2024-02-28T16:26:50.462 INFO:tasks.workunit.client.0.smithi148.stdout:2/719: read d0/d1c/d49/fa4 [877671,49187] 0 2024-02-28T16:26:50.462 INFO:tasks.workunit.client.0.smithi148.stdout:4/654: write d8/d21/d3d/f52 [1149036,69758] 0 2024-02-28T16:26:50.464 INFO:tasks.workunit.client.0.smithi148.stdout:7/776: unlink d0/d9/f9a 0 2024-02-28T16:26:50.472 INFO:tasks.workunit.client.0.smithi148.stdout:3/861: fdatasync d1/d13/d19/d56/fcc 0 2024-02-28T16:26:50.475 INFO:tasks.workunit.client.0.smithi148.stdout:1/885: stat d2/d15/d8b/db0/lc4 0 2024-02-28T16:26:50.482 INFO:tasks.workunit.client.0.smithi148.stdout:4/655: unlink d8/d21/d3d/d8c/db0/ldb 0 2024-02-28T16:26:50.495 INFO:tasks.workunit.client.0.smithi148.stdout:1/886: symlink d2/d5/d40/d8/l11b 0 2024-02-28T16:26:50.498 INFO:tasks.workunit.client.0.smithi148.stdout:5/715: truncate d1/d8/d20/d31/f39 3419359 0 2024-02-28T16:26:50.502 INFO:tasks.workunit.client.0.smithi148.stdout:2/720: rename d0/d1c/d85/d8b/d8f/d9d/d36/c4d to d0/d1c/d85/d8b/d8f/d9d/d36/cdf 0 2024-02-28T16:26:50.508 INFO:tasks.workunit.client.0.smithi148.stdout:8/855: getdents d1/dd/d13/d1a/d25/da3 0 2024-02-28T16:26:50.508 INFO:tasks.workunit.client.0.smithi148.stdout:1/887: rename d2/d5/d40/f16 to d2/d5/d40/d8/dd8/de2/d10f/f11c 0 2024-02-28T16:26:50.509 INFO:tasks.workunit.client.0.smithi148.stdout:5/716: truncate d1/f43 1615647 0 2024-02-28T16:26:50.510 INFO:tasks.workunit.client.0.smithi148.stdout:1/888: fsync d2/d5/d40/d8/dd8/f109 0 2024-02-28T16:26:50.510 INFO:tasks.workunit.client.0.smithi148.stdout:3/862: rmdir d1/d13/d19/d32/d9e/dbf 0 2024-02-28T16:26:50.513 INFO:tasks.workunit.client.0.smithi148.stdout:3/863: write d1/d13/d19/d1b/d38/fca [4914319,20692] 0 2024-02-28T16:26:50.513 INFO:tasks.workunit.client.0.smithi148.stdout:1/889: write d2/d5/d40/dcc/ff4 [730094,59515] 0 2024-02-28T16:26:50.528 INFO:tasks.workunit.client.0.smithi148.stdout:2/721: unlink d0/d1d/d55/f74 0 2024-02-28T16:26:50.530 INFO:tasks.workunit.client.0.smithi148.stdout:3/864: mkdir d1/d13/d19/d1b/d38/d7c/dfb 0 2024-02-28T16:26:50.533 INFO:tasks.workunit.client.0.smithi148.stdout:1/890: creat d2/d5/d40/d7/d99/f11d x:0 0 0 2024-02-28T16:26:50.535 INFO:tasks.workunit.client.0.smithi148.stdout:4/656: getdents d8/d21/d3d/d8c/db0 0 2024-02-28T16:26:50.537 INFO:tasks.workunit.client.0.smithi148.stdout:2/722: creat d0/d18/d9a/fe0 x:0 0 0 2024-02-28T16:26:50.541 INFO:tasks.workunit.client.0.smithi148.stdout:4/657: dread - d8/d37/d91/fc5 zero size 2024-02-28T16:26:50.542 INFO:tasks.workunit.client.0.smithi148.stdout:8/856: dread d1/dd/d13/d24/d3a/d49/f4c [0,4194304] 0 2024-02-28T16:26:50.544 INFO:tasks.workunit.client.0.smithi148.stdout:5/717: creat d1/fd7 x:0 0 0 2024-02-28T16:26:50.546 INFO:tasks.workunit.client.0.smithi148.stdout:7/777: dwrite d0/d9/d25/d39/fc2 [0,4194304] 0 2024-02-28T16:26:50.550 INFO:tasks.workunit.client.0.smithi148.stdout:2/723: creat d0/d18/d20/dd3/fe1 x:0 0 0 2024-02-28T16:26:50.550 INFO:tasks.workunit.client.0.smithi148.stdout:5/718: fdatasync d1/db/d60/f86 0 2024-02-28T16:26:50.555 INFO:tasks.workunit.client.0.smithi148.stdout:5/719: dread - d1/d8/d20/fd6 zero size 2024-02-28T16:26:50.556 INFO:tasks.workunit.client.0.smithi148.stdout:1/891: link d2/d25/fff d2/d5/d40/d7/dba/f11e 0 2024-02-28T16:26:50.565 INFO:tasks.workunit.client.0.smithi148.stdout:8/857: symlink d1/d3/d18/d48/d70/d75/d91/l11a 0 2024-02-28T16:26:50.567 INFO:tasks.workunit.client.0.smithi148.stdout:2/724: creat d0/d1c/d85/fe2 x:0 0 0 2024-02-28T16:26:50.567 INFO:tasks.workunit.client.0.smithi148.stdout:8/858: chown d1/dd/d13/d68/le3 4 1 2024-02-28T16:26:50.568 INFO:tasks.workunit.client.0.smithi148.stdout:8/859: chown d1/dd/d13/d1a/d25 87 1 2024-02-28T16:26:50.576 INFO:tasks.workunit.client.0.smithi148.stdout:5/720: rmdir d1/d44 39 2024-02-28T16:26:50.578 INFO:tasks.workunit.client.0.smithi148.stdout:5/721: write d1/d8/d20/d31/f6c [1454516,112989] 0 2024-02-28T16:26:50.579 INFO:tasks.workunit.client.0.smithi148.stdout:2/725: truncate d0/d18/d20/f92 773720 0 2024-02-28T16:26:50.581 INFO:tasks.workunit.client.0.smithi148.stdout:8/860: truncate d1/dd/d13/d24/d3a/f59 846037 0 2024-02-28T16:26:50.583 INFO:tasks.workunit.client.0.smithi148.stdout:1/892: mknod d2/d3f/c11f 0 2024-02-28T16:26:50.585 INFO:tasks.workunit.client.0.smithi148.stdout:5/722: truncate d1/d8/d23/f52 1001001 0 2024-02-28T16:26:50.586 INFO:tasks.workunit.client.0.smithi148.stdout:2/726: truncate d0/d9/d13/fcd 969155 0 2024-02-28T16:26:50.587 INFO:tasks.workunit.client.0.smithi148.stdout:1/893: readlink d2/d15/d83/d89/daa/le5 0 2024-02-28T16:26:50.589 INFO:tasks.workunit.client.0.smithi148.stdout:3/865: dwrite d1/db/d45/d80/fa6 [0,4194304] 0 2024-02-28T16:26:50.593 INFO:tasks.workunit.client.0.smithi148.stdout:8/861: creat d1/d3/d18/d48/d22/d55/f11b x:0 0 0 2024-02-28T16:26:50.600 INFO:tasks.workunit.client.0.smithi148.stdout:8/862: rmdir d1/d3/d18/d5a/d60/de6 39 2024-02-28T16:26:50.603 INFO:tasks.workunit.client.0.smithi148.stdout:1/894: dread d2/d5/d40/d8/dd8/de2/da7/dad/f55 [0,4194304] 0 2024-02-28T16:26:50.607 INFO:tasks.workunit.client.0.smithi148.stdout:5/723: getdents d1/db/d25 0 2024-02-28T16:26:50.609 INFO:tasks.workunit.client.0.smithi148.stdout:8/863: truncate d1/dd/f104 934285 0 2024-02-28T16:26:50.611 INFO:tasks.workunit.client.0.smithi148.stdout:1/895: mkdir d2/d5/d40/d7/d91/d120 0 2024-02-28T16:26:50.619 INFO:tasks.workunit.client.0.smithi148.stdout:1/896: write d2/d5/d40/d7/d91/f7a [4588723,50410] 0 2024-02-28T16:26:50.623 INFO:tasks.workunit.client.0.smithi148.stdout:5/724: rename d1/d8/d20/d31/d50 to d1/d8/d20/dd8 0 2024-02-28T16:26:50.628 INFO:tasks.workunit.client.0.smithi148.stdout:2/727: dread d0/d9/f47 [0,4194304] 0 2024-02-28T16:26:50.630 INFO:tasks.workunit.client.0.smithi148.stdout:5/725: unlink d1/db/cab 0 2024-02-28T16:26:50.630 INFO:tasks.workunit.client.0.smithi148.stdout:2/728: chown d0/d18/f28 1088937103 1 2024-02-28T16:26:50.633 INFO:tasks.workunit.client.0.smithi148.stdout:1/897: link d2/d5/d40/ff2 d2/d9c/f121 0 2024-02-28T16:26:50.636 INFO:tasks.workunit.client.0.smithi148.stdout:2/729: unlink d0/d1c/f5f 0 2024-02-28T16:26:50.637 INFO:tasks.workunit.client.0.smithi148.stdout:1/898: read d2/d5/d40/d7/fa4 [1022652,126186] 0 2024-02-28T16:26:50.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/726: mkdir d1/db/d60/d7a/db2/dd9 0 2024-02-28T16:26:50.641 INFO:tasks.workunit.client.0.smithi148.stdout:8/864: dread d1/dd/d13/d1a/f44 [0,4194304] 0 2024-02-28T16:26:50.641 INFO:tasks.workunit.client.0.smithi148.stdout:5/727: readlink d1/db/l3e 0 2024-02-28T16:26:50.642 INFO:tasks.workunit.client.0.smithi148.stdout:1/899: mknod d2/d5/d40/d7/c122 0 2024-02-28T16:26:50.644 INFO:tasks.workunit.client.0.smithi148.stdout:2/730: creat d0/d1d/d52/fe3 x:0 0 0 2024-02-28T16:26:50.646 INFO:tasks.workunit.client.0.smithi148.stdout:1/900: mkdir d2/d15/d8b/db0/d123 0 2024-02-28T16:26:50.647 INFO:tasks.workunit.client.0.smithi148.stdout:5/728: mknod d1/db/d60/d7a/d8b/cda 0 2024-02-28T16:26:50.648 INFO:tasks.workunit.client.0.smithi148.stdout:1/901: stat d2/d5/d40/d8/dd8/de2/da7/dad/f100 0 2024-02-28T16:26:50.649 INFO:tasks.workunit.client.0.smithi148.stdout:5/729: chown d1/db/d60/d7a/db2 2603 1 2024-02-28T16:26:50.650 INFO:tasks.workunit.client.0.smithi148.stdout:2/731: rename d0/d9/d13/d38/d3a/fae to d0/dd/fe4 0 2024-02-28T16:26:50.652 INFO:tasks.workunit.client.0.smithi148.stdout:5/730: chown d1/d44/c72 123359 1 2024-02-28T16:26:50.652 INFO:tasks.workunit.client.0.smithi148.stdout:1/902: readlink d2/d5/d40/d8/l115 0 2024-02-28T16:26:50.653 INFO:tasks.workunit.client.0.smithi148.stdout:2/732: mkdir d0/d18/d20/dd3/db5/de5 0 2024-02-28T16:26:50.655 INFO:tasks.workunit.client.0.smithi148.stdout:5/731: mkdir d1/d8/d20/d4e/d96/ddb 0 2024-02-28T16:26:50.656 INFO:tasks.workunit.client.0.smithi148.stdout:1/903: chown d2/d5/d40/d8/dd8/de2/da7/dad/f55 6 1 2024-02-28T16:26:50.659 INFO:tasks.workunit.client.0.smithi148.stdout:8/865: dwrite d1/d3/f119 [0,4194304] 0 2024-02-28T16:26:50.660 INFO:tasks.workunit.client.0.smithi148.stdout:1/904: truncate d2/d3f/f97 904856 0 2024-02-28T16:26:50.661 INFO:tasks.workunit.client.0.smithi148.stdout:8/866: stat d1/dd/d51/d77 0 2024-02-28T16:26:50.661 INFO:tasks.workunit.client.0.smithi148.stdout:2/733: rename d0/d1d/f70 to d0/d9/d13/d38/d3a/fe6 0 2024-02-28T16:26:50.667 INFO:tasks.workunit.client.0.smithi148.stdout:2/734: mkdir d0/d18/de7 0 2024-02-28T16:26:50.669 INFO:tasks.workunit.client.0.smithi148.stdout:8/867: unlink d1/dd/d13/d68/fc1 0 2024-02-28T16:26:50.671 INFO:tasks.workunit.client.0.smithi148.stdout:8/868: stat d1/dd/d13/d24/d3a/c10e 0 2024-02-28T16:26:50.673 INFO:tasks.workunit.client.0.smithi148.stdout:2/735: creat d0/d1c/d85/d96/dbf/fe8 x:0 0 0 2024-02-28T16:26:50.677 INFO:tasks.workunit.client.0.smithi148.stdout:8/869: creat d1/dd/d13/d1a/d25/f11c x:0 0 0 2024-02-28T16:26:50.679 INFO:tasks.workunit.client.0.smithi148.stdout:2/736: creat d0/d66/d76/fe9 x:0 0 0 2024-02-28T16:26:50.679 INFO:tasks.workunit.client.0.smithi148.stdout:1/905: dwrite d2/d9c/fa8 [0,4194304] 0 2024-02-28T16:26:50.682 INFO:tasks.workunit.client.0.smithi148.stdout:1/906: readlink d2/d3f/d46/lbb 0 2024-02-28T16:26:50.684 INFO:tasks.workunit.client.0.smithi148.stdout:8/870: symlink d1/d3/d18/d5a/d60/de6/l11d 0 2024-02-28T16:26:50.687 INFO:tasks.workunit.client.0.smithi148.stdout:1/907: creat d2/d3f/dcf/d75/f124 x:0 0 0 2024-02-28T16:26:50.689 INFO:tasks.workunit.client.0.smithi148.stdout:2/737: mknod d0/d18/d20/dd3/db5/de5/cea 0 2024-02-28T16:26:50.690 INFO:tasks.workunit.client.0.smithi148.stdout:2/738: stat d0/d1c/d49/c8c 0 2024-02-28T16:26:50.692 INFO:tasks.workunit.client.0.smithi148.stdout:8/871: creat d1/dd/d13/f11e x:0 0 0 2024-02-28T16:26:50.694 INFO:tasks.workunit.client.0.smithi148.stdout:1/908: rmdir d2/d15/d33 39 2024-02-28T16:26:50.703 INFO:tasks.workunit.client.0.smithi148.stdout:5/732: dwrite d1/d8/d20/d4e/d84/fa7 [0,4194304] 0 2024-02-28T16:26:50.708 INFO:tasks.workunit.client.0.smithi148.stdout:1/909: rename d2/d5/f93 to d2/d3f/f125 0 2024-02-28T16:26:50.713 INFO:tasks.workunit.client.0.smithi148.stdout:5/733: mkdir d1/d44/d65/ddc 0 2024-02-28T16:26:50.713 INFO:tasks.workunit.client.0.smithi148.stdout:2/739: dread d0/d9/f9e [0,4194304] 0 2024-02-28T16:26:50.716 INFO:tasks.workunit.client.0.smithi148.stdout:8/872: rename d1/d3/d18/d48/fd1 to d1/dd/d51/d9b/dc6/f11f 0 2024-02-28T16:26:50.720 INFO:tasks.workunit.client.0.smithi148.stdout:5/734: mkdir d1/d44/d64/ddd 0 2024-02-28T16:26:50.724 INFO:tasks.workunit.client.0.smithi148.stdout:2/740: rmdir d0/d18/de7 0 2024-02-28T16:26:50.726 INFO:tasks.workunit.client.0.smithi148.stdout:5/735: creat d1/d8/d20/d4e/d84/d92/fde x:0 0 0 2024-02-28T16:26:50.729 INFO:tasks.workunit.client.0.smithi148.stdout:5/736: chown d1/d8/d20/dd8/c7c 11086 1 2024-02-28T16:26:50.731 INFO:tasks.workunit.client.0.smithi148.stdout:2/741: rename d0/d1d/d52/fe3 to d0/d1d/d55/feb 0 2024-02-28T16:26:50.732 INFO:tasks.workunit.client.0.smithi148.stdout:8/873: dread d1/d3/d18/d48/d22/d34/f65 [0,4194304] 0 2024-02-28T16:26:50.733 INFO:tasks.workunit.client.0.smithi148.stdout:1/910: dwrite d2/d3f/f125 [4194304,4194304] 0 2024-02-28T16:26:50.736 INFO:tasks.workunit.client.0.smithi148.stdout:8/874: mkdir d1/d3/d18/d120 0 2024-02-28T16:26:50.738 INFO:tasks.workunit.client.0.smithi148.stdout:1/911: write d2/d5/d40/d8/dd8/de2/da7/dad/fa2 [2820258,64468] 0 2024-02-28T16:26:50.739 INFO:tasks.workunit.client.0.smithi148.stdout:8/875: mknod d1/d3/de5/c121 0 2024-02-28T16:26:50.746 INFO:tasks.workunit.client.0.smithi148.stdout:1/912: creat d2/d15/d83/d89/daa/db1/f126 x:0 0 0 2024-02-28T16:26:50.750 INFO:tasks.workunit.client.0.smithi148.stdout:5/737: dwrite d1/d8/fa3 [0,4194304] 0 2024-02-28T16:26:50.757 INFO:tasks.workunit.client.0.smithi148.stdout:2/742: dwrite d0/dd/fab [0,4194304] 0 2024-02-28T16:26:50.765 INFO:tasks.workunit.client.0.smithi148.stdout:5/738: creat d1/db/d60/d7a/d98/fdf x:0 0 0 2024-02-28T16:26:50.770 INFO:tasks.workunit.client.0.smithi148.stdout:1/913: dwrite d2/d3f/fa0 [0,4194304] 0 2024-02-28T16:26:50.857 INFO:tasks.workunit.client.0.smithi148.stdout:2/743: mknod d0/d9/d13/d38/cec 0 2024-02-28T16:26:50.858 INFO:tasks.workunit.client.0.smithi148.stdout:8/876: getdents d1/dd/d13/d1a/d25 0 2024-02-28T16:26:50.859 INFO:tasks.workunit.client.0.smithi148.stdout:2/744: chown d0/d1c/d49 2773 1 2024-02-28T16:26:50.864 INFO:tasks.workunit.client.0.smithi148.stdout:1/914: rename d2/d15/d83/d89/daa/lb3 to d2/d15/d8b/db0/d123/l127 0 2024-02-28T16:26:50.870 INFO:tasks.workunit.client.0.smithi148.stdout:5/739: mkdir d1/db/d60/d7a/d87/de0 0 2024-02-28T16:26:50.872 INFO:tasks.workunit.client.0.smithi148.stdout:2/745: fsync d0/d1c/d85/d8b/d8f/d9d/fb8 0 2024-02-28T16:26:50.879 INFO:tasks.workunit.client.0.smithi148.stdout:8/877: unlink d1/dd/d13/d68/cf8 0 2024-02-28T16:26:50.881 INFO:tasks.workunit.client.0.smithi148.stdout:5/740: mkdir d1/db/d60/d7a/d98/de1 0 2024-02-28T16:26:50.883 INFO:tasks.workunit.client.0.smithi148.stdout:5/741: dread - d1/d8/d20/fd6 zero size 2024-02-28T16:26:50.889 INFO:tasks.workunit.client.0.smithi148.stdout:2/746: unlink d0/d9/d13/d38/l41 0 2024-02-28T16:26:50.895 INFO:tasks.workunit.client.0.smithi148.stdout:8/878: symlink d1/d3/d18/d5a/d60/l122 0 2024-02-28T16:26:50.904 INFO:tasks.workunit.client.0.smithi148.stdout:8/879: rename d1/dd/d51/d77/l78 to d1/d3/d18/d48/d22/d34/l123 0 2024-02-28T16:26:50.904 INFO:tasks.workunit.client.0.smithi148.stdout:1/915: dwrite d2/d5/d40/d7/dba/f11e [0,4194304] 0 2024-02-28T16:26:50.908 INFO:tasks.workunit.client.0.smithi148.stdout:5/742: write d1/db/d25/f69 [609857,56441] 0 2024-02-28T16:26:50.914 INFO:tasks.workunit.client.0.smithi148.stdout:1/916: rename d2/d5/d40/d7/d91/fab to d2/d15/d83/d89/daa/f128 0 2024-02-28T16:26:50.918 INFO:tasks.workunit.client.0.smithi148.stdout:8/880: creat d1/dd/d13/d24/d3a/d49/f124 x:0 0 0 2024-02-28T16:26:50.924 INFO:tasks.workunit.client.0.smithi148.stdout:8/881: rmdir d1/d3/d18/d5a/d60/de6 39 2024-02-28T16:26:50.925 INFO:tasks.workunit.client.0.smithi148.stdout:2/747: dwrite d0/d9/f9e [0,4194304] 0 2024-02-28T16:26:50.927 INFO:tasks.workunit.client.0.smithi148.stdout:8/882: read - d1/d3/d9a/fe7 zero size 2024-02-28T16:26:50.929 INFO:tasks.workunit.client.0.smithi148.stdout:2/748: chown d0/d9/d13/d38/l5b 3 1 2024-02-28T16:26:50.930 INFO:tasks.workunit.client.0.smithi148.stdout:2/749: chown d0/d1c/dcc 10342045 1 2024-02-28T16:26:50.936 INFO:tasks.workunit.client.0.smithi148.stdout:1/917: dwrite d2/d5/d40/f53 [0,4194304] 0 2024-02-28T16:26:50.938 INFO:tasks.workunit.client.0.smithi148.stdout:2/750: mknod d0/d1c/dcc/ced 0 2024-02-28T16:26:50.942 INFO:tasks.workunit.client.0.smithi148.stdout:5/743: dread d1/d8/d20/dd8/f56 [0,4194304] 0 2024-02-28T16:26:50.942 INFO:tasks.workunit.client.0.smithi148.stdout:1/918: write d2/d5/d40/d8/dd8/f109 [464159,98189] 0 2024-02-28T16:26:50.948 INFO:tasks.workunit.client.0.smithi148.stdout:5/744: readlink d1/d44/d65/lba 0 2024-02-28T16:26:50.953 INFO:tasks.workunit.client.0.smithi148.stdout:1/919: mkdir d2/d3f/dcf/d129 0 2024-02-28T16:26:50.960 INFO:tasks.workunit.client.0.smithi148.stdout:2/751: rename d0/d18/d20/d46 to d0/d1d/dee 0 2024-02-28T16:26:50.968 INFO:tasks.workunit.client.0.smithi148.stdout:2/752: creat d0/d1c/d85/d8b/fef x:0 0 0 2024-02-28T16:26:50.970 INFO:tasks.workunit.client.0.smithi148.stdout:1/920: dwrite d2/d5/d40/d7/d91/f3a [0,4194304] 0 2024-02-28T16:26:50.975 INFO:tasks.workunit.client.0.smithi148.stdout:1/921: mknod d2/d9c/c12a 0 2024-02-28T16:26:50.977 INFO:tasks.workunit.client.0.smithi148.stdout:1/922: readlink d2/d5/d40/d7/l2a 0 2024-02-28T16:26:50.986 INFO:tasks.workunit.client.0.smithi148.stdout:8/883: dwrite d1/d3/d18/f2b [0,4194304] 0 2024-02-28T16:26:50.992 INFO:tasks.workunit.client.0.smithi148.stdout:8/884: chown d1/dd/d13/d1a/d25/da3/fac 292499733 1 2024-02-28T16:26:50.993 INFO:tasks.workunit.client.0.smithi148.stdout:1/923: link d2/d15/d8b/da3/dc2/f119 d2/d5/d40/d8/f12b 0 2024-02-28T16:26:50.994 INFO:tasks.workunit.client.0.smithi148.stdout:1/924: dread - d2/d5/d40/dcc/fdb zero size 2024-02-28T16:26:50.997 INFO:tasks.workunit.client.0.smithi148.stdout:5/745: truncate d1/d8/d20/d31/f4d 1142769 0 2024-02-28T16:26:50.999 INFO:tasks.workunit.client.0.smithi148.stdout:5/746: chown d1/db/f27 284723 1 2024-02-28T16:26:51.002 INFO:tasks.workunit.client.0.smithi148.stdout:5/747: chown d1/db/d60/d7a/d8b/f42 6907 1 2024-02-28T16:26:51.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/885: link d1/d3/d18/c6e d1/dd/d51/d9b/dc6/c125 0 2024-02-28T16:26:51.015 INFO:tasks.workunit.client.0.smithi148.stdout:1/925: dwrite d2/d15/d83/d89/daa/db1/f126 [0,4194304] 0 2024-02-28T16:26:51.020 INFO:tasks.workunit.client.0.smithi148.stdout:5/748: rename d1/d8/d20/fcb to d1/d8/d20/d4e/d84/fe2 0 2024-02-28T16:26:51.021 INFO:tasks.workunit.client.0.smithi148.stdout:5/749: write d1/f94 [42012,54861] 0 2024-02-28T16:26:51.026 INFO:tasks.workunit.client.0.smithi148.stdout:1/926: read d2/d5/d40/d7/f6e [5791580,10785] 0 2024-02-28T16:26:51.034 INFO:tasks.workunit.client.0.smithi148.stdout:2/753: dread d0/d1c/d85/d8b/d8f/fa9 [0,4194304] 0 2024-02-28T16:26:51.042 INFO:tasks.workunit.client.0.smithi148.stdout:1/927: dwrite d2/d3f/dcf/f7e [0,4194304] 0 2024-02-28T16:26:51.044 INFO:tasks.workunit.client.0.smithi148.stdout:5/750: rmdir d1/db/d25/dc2 0 2024-02-28T16:26:51.045 INFO:tasks.workunit.client.0.smithi148.stdout:1/928: write d2/d3f/f125 [3731101,62747] 0 2024-02-28T16:26:51.049 INFO:tasks.workunit.client.0.smithi148.stdout:1/929: write d2/d3f/f71 [813200,84254] 0 2024-02-28T16:26:51.051 INFO:tasks.workunit.client.0.smithi148.stdout:5/751: creat d1/db/d25/fe3 x:0 0 0 2024-02-28T16:26:51.052 INFO:tasks.workunit.client.0.smithi148.stdout:8/886: dwrite d1/dd/d13/d24/fb6 [0,4194304] 0 2024-02-28T16:26:51.057 INFO:tasks.workunit.client.0.smithi148.stdout:1/930: rmdir d2/d5/d40/d8/dd8/dfe 39 2024-02-28T16:26:51.062 INFO:tasks.workunit.client.0.smithi148.stdout:8/887: dread d1/d3/d18/d48/d22/fa1 [0,4194304] 0 2024-02-28T16:26:51.062 INFO:tasks.workunit.client.0.smithi148.stdout:5/752: rename d1/d8/c11 to d1/db/d60/d7a/d87/ce4 0 2024-02-28T16:26:51.066 INFO:tasks.workunit.client.0.smithi148.stdout:2/754: write d0/d18/f19 [1346346,119626] 0 2024-02-28T16:26:51.068 INFO:tasks.workunit.client.0.smithi148.stdout:8/888: stat d1/d3/d18/d48/d70/d75/d91/fb4 0 2024-02-28T16:26:51.071 INFO:tasks.workunit.client.0.smithi148.stdout:8/889: fdatasync d1/dd/d13/d1a/d87/f117 0 2024-02-28T16:26:51.072 INFO:tasks.workunit.client.0.smithi148.stdout:6/775: sync 2024-02-28T16:26:51.072 INFO:tasks.workunit.client.0.smithi148.stdout:9/870: sync 2024-02-28T16:26:51.073 INFO:tasks.workunit.client.0.smithi148.stdout:1/931: dread d2/d3f/fa0 [0,4194304] 0 2024-02-28T16:26:51.074 INFO:tasks.workunit.client.0.smithi148.stdout:5/753: creat d1/db/d60/d7a/d87/fe5 x:0 0 0 2024-02-28T16:26:51.077 INFO:tasks.workunit.client.0.smithi148.stdout:2/755: truncate d0/d1c/d85/d8b/d8f/fa9 2908297 0 2024-02-28T16:26:51.090 INFO:tasks.workunit.client.0.smithi148.stdout:9/871: creat d7/d1c/d1f/d49/dae/dc6/f12b x:0 0 0 2024-02-28T16:26:51.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/756: rmdir d0/d1c/d85/d8b/d8f/d9d 39 2024-02-28T16:26:51.095 INFO:tasks.workunit.client.0.smithi148.stdout:2/757: write d0/d18/f19 [1272206,92082] 0 2024-02-28T16:26:51.098 INFO:tasks.workunit.client.0.smithi148.stdout:9/872: creat d7/d43/de0/f12c x:0 0 0 2024-02-28T16:26:51.099 INFO:tasks.workunit.client.0.smithi148.stdout:2/758: chown d0/d9/d13/d38/f3e 1 1 2024-02-28T16:26:51.106 INFO:tasks.workunit.client.0.smithi148.stdout:5/754: write d1/d8/d23/f52 [229468,71472] 0 2024-02-28T16:26:51.116 INFO:tasks.workunit.client.0.smithi148.stdout:1/932: dwrite d2/d5/d40/d7/f85 [0,4194304] 0 2024-02-28T16:26:51.116 INFO:tasks.workunit.client.0.smithi148.stdout:8/890: dwrite d1/d3/d18/d5a/d60/f82 [0,4194304] 0 2024-02-28T16:26:51.117 INFO:tasks.workunit.client.0.smithi148.stdout:5/755: symlink d1/d8/d20/d4e/d71/le6 0 2024-02-28T16:26:51.119 INFO:tasks.workunit.client.0.smithi148.stdout:2/759: getdents d0/d18/d20/dd3 0 2024-02-28T16:26:51.122 INFO:tasks.workunit.client.0.smithi148.stdout:6/776: dwrite d0/d22/d27/d3e/f7b [0,4194304] 0 2024-02-28T16:26:51.130 INFO:tasks.workunit.client.0.smithi148.stdout:2/760: mkdir d0/d18/d20/dd3/db5/de5/df0 0 2024-02-28T16:26:51.131 INFO:tasks.workunit.client.0.smithi148.stdout:6/777: mkdir d0/d4/d14/d59/df9 0 2024-02-28T16:26:51.133 INFO:tasks.workunit.client.0.smithi148.stdout:9/873: dwrite d7/d1c/d74/d6b/fed [0,4194304] 0 2024-02-28T16:26:51.134 INFO:tasks.workunit.client.0.smithi148.stdout:1/933: rename d2/d5/d40/d8/dd8/de2/da7/dad to d2/d5/d40/d7/d99/d12c 0 2024-02-28T16:26:51.138 INFO:tasks.workunit.client.0.smithi148.stdout:1/934: write d2/d15/d83/d89/daa/db1/f126 [313211,63717] 0 2024-02-28T16:26:51.139 INFO:tasks.workunit.client.0.smithi148.stdout:6/778: creat d0/d22/d27/d3e/ffa x:0 0 0 2024-02-28T16:26:51.141 INFO:tasks.workunit.client.0.smithi148.stdout:9/874: truncate d7/d1c/d74/d6b/f105 95961 0 2024-02-28T16:26:51.147 INFO:tasks.workunit.client.0.smithi148.stdout:6/779: creat d0/d4/dba/d71/ffb x:0 0 0 2024-02-28T16:26:51.150 INFO:tasks.workunit.client.0.smithi148.stdout:9/875: mkdir d7/d43/ddd/df1/df3/d12d 0 2024-02-28T16:26:51.158 INFO:tasks.workunit.client.0.smithi148.stdout:5/756: dwrite d1/f6f [0,4194304] 0 2024-02-28T16:26:51.167 INFO:tasks.workunit.client.0.smithi148.stdout:9/876: rmdir d7/d1c/d59/d83/de4/d106 39 2024-02-28T16:26:51.169 INFO:tasks.workunit.client.0.smithi148.stdout:7/778: sync 2024-02-28T16:26:51.171 INFO:tasks.workunit.client.0.smithi148.stdout:3/866: sync 2024-02-28T16:26:51.172 INFO:tasks.workunit.client.0.smithi148.stdout:2/761: write d0/d9/d13/d38/d3a/fe6 [705635,82695] 0 2024-02-28T16:26:51.174 INFO:tasks.workunit.client.0.smithi148.stdout:9/877: chown d7/d1c/d59/d83/de4/d106/d118 347 1 2024-02-28T16:26:51.174 INFO:tasks.workunit.client.0.smithi148.stdout:4/658: sync 2024-02-28T16:26:51.178 INFO:tasks.workunit.client.0.smithi148.stdout:3/867: fsync d1/db/d45/f98 0 2024-02-28T16:26:51.183 INFO:tasks.workunit.client.0.smithi148.stdout:8/891: dwrite d1/dd/d13/f98 [0,4194304] 0 2024-02-28T16:26:51.186 INFO:tasks.workunit.client.0.smithi148.stdout:9/878: chown d7/d1c/d1f/d49/dae/dc9/d100 51481126 1 2024-02-28T16:26:51.188 INFO:tasks.workunit.client.0.smithi148.stdout:2/762: creat d0/d9/d13/d38/d3a/db3/ff1 x:0 0 0 2024-02-28T16:26:51.190 INFO:tasks.workunit.client.0.smithi148.stdout:3/868: symlink d1/d13/d19/d94/lfc 0 2024-02-28T16:26:51.195 INFO:tasks.workunit.client.0.smithi148.stdout:5/757: dread d1/f43 [0,4194304] 0 2024-02-28T16:26:51.195 INFO:tasks.workunit.client.0.smithi148.stdout:6/780: dread d0/d4/dba/fa0 [0,4194304] 0 2024-02-28T16:26:51.195 INFO:tasks.workunit.client.0.smithi148.stdout:4/659: rename d8/d21/d3d/d4d/c93 to d8/d21/d3d/d4d/cde 0 2024-02-28T16:26:51.197 INFO:tasks.workunit.client.0.smithi148.stdout:8/892: rename d1/d3/d18/d48/d22 to d1/d3/d18/d120/d126 0 2024-02-28T16:26:51.199 INFO:tasks.workunit.client.0.smithi148.stdout:6/781: stat d0/d22/d49/d88/d97/lc4 0 2024-02-28T16:26:51.199 INFO:tasks.workunit.client.0.smithi148.stdout:3/869: fdatasync d1/db/d35/d52/f93 0 2024-02-28T16:26:51.200 INFO:tasks.workunit.client.0.smithi148.stdout:4/660: stat d8/d40/dc3/dd3/d17/d6a/d6c 0 2024-02-28T16:26:51.200 INFO:tasks.workunit.client.0.smithi148.stdout:1/935: dread d2/d25/f96 [0,4194304] 0 2024-02-28T16:26:51.205 INFO:tasks.workunit.client.0.smithi148.stdout:9/879: rename d7/d1c/d59/d83/de4/d106/d118 to d7/d1c/d1f/d49/d8d/d108/d12e 0 2024-02-28T16:26:51.208 INFO:tasks.workunit.client.0.smithi148.stdout:8/893: write d1/dd/d13/d1a/d25/da3/f112 [53928,23921] 0 2024-02-28T16:26:51.208 INFO:tasks.workunit.client.0.smithi148.stdout:6/782: creat d0/d4/d14/ffc x:0 0 0 2024-02-28T16:26:51.208 INFO:tasks.workunit.client.0.smithi148.stdout:1/936: truncate d2/d3f/d46/fd0 882250 0 2024-02-28T16:26:51.211 INFO:tasks.workunit.client.0.smithi148.stdout:5/758: dread d1/f41 [4194304,4194304] 0 2024-02-28T16:26:51.211 INFO:tasks.workunit.client.0.smithi148.stdout:9/880: mknod d7/d1c/d74/d6b/ddb/c12f 0 2024-02-28T16:26:51.211 INFO:tasks.workunit.client.0.smithi148.stdout:8/894: chown d1/dd/d13/d24/d3a/d49/f7d 266499 1 2024-02-28T16:26:51.215 INFO:tasks.workunit.client.0.smithi148.stdout:6/783: chown d0/d22/d27/d3e/d52/lf8 226079 1 2024-02-28T16:26:51.220 INFO:tasks.workunit.client.0.smithi148.stdout:4/661: getdents d8/d40/dc3/dd3/d17/d6a 0 2024-02-28T16:26:51.222 INFO:tasks.workunit.client.0.smithi148.stdout:3/870: dwrite d1/d13/d19/d32/d9e/dfa/fec [0,4194304] 0 2024-02-28T16:26:51.231 INFO:tasks.workunit.client.0.smithi148.stdout:1/937: dwrite d2/d5/d40/d8/dd8/f109 [0,4194304] 0 2024-02-28T16:26:51.236 INFO:tasks.workunit.client.0.smithi148.stdout:2/763: write d0/d18/d9a/f63 [62728,82513] 0 2024-02-28T16:26:51.237 INFO:tasks.workunit.client.0.smithi148.stdout:7/779: dread d0/d9/d25/d96/fca [0,4194304] 0 2024-02-28T16:26:51.238 INFO:tasks.workunit.client.0.smithi148.stdout:5/759: mkdir d1/db/d60/d7a/dbb/de7 0 2024-02-28T16:26:51.244 INFO:tasks.workunit.client.0.smithi148.stdout:5/760: write d1/d8/d20/dd8/dbe/fcf [705758,13076] 0 2024-02-28T16:26:51.245 INFO:tasks.workunit.client.0.smithi148.stdout:4/662: mknod d8/d21/d3d/d4d/d95/cdf 0 2024-02-28T16:26:51.248 INFO:tasks.workunit.client.0.smithi148.stdout:9/881: write d7/d43/da8/f11a [2783165,75196] 0 2024-02-28T16:26:51.251 INFO:tasks.workunit.client.0.smithi148.stdout:6/784: rename d0/d22/d27/d66/dbd to d0/d8/dfd 0 2024-02-28T16:26:51.254 INFO:tasks.workunit.client.0.smithi148.stdout:7/780: mkdir d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/df0 0 2024-02-28T16:26:51.255 INFO:tasks.workunit.client.0.smithi148.stdout:9/882: write d7/d1c/d32/d24/dc1/fe9 [1016081,116931] 0 2024-02-28T16:26:51.257 INFO:tasks.workunit.client.0.smithi148.stdout:4/663: creat d8/d40/dc3/dd3/d17/fe0 x:0 0 0 2024-02-28T16:26:51.259 INFO:tasks.workunit.client.0.smithi148.stdout:5/761: rename d1/d8/d20/l7f to d1/db/d60/d7a/d8b/d80/le8 0 2024-02-28T16:26:51.260 INFO:tasks.workunit.client.0.smithi148.stdout:1/938: link d2/d5/d40/dcc/ldd d2/d3f/l12d 0 2024-02-28T16:26:51.260 INFO:tasks.workunit.client.0.smithi148.stdout:3/871: dread d1/db/d35/f47 [0,4194304] 0 2024-02-28T16:26:51.261 INFO:tasks.workunit.client.0.smithi148.stdout:9/883: rename d7/d1c to d7/d1c/d74/d6b/d130 22 2024-02-28T16:26:51.263 INFO:tasks.workunit.client.0.smithi148.stdout:4/664: creat d8/fe1 x:0 0 0 2024-02-28T16:26:51.264 INFO:tasks.workunit.client.0.smithi148.stdout:7/781: symlink d0/d9/deb/lf1 0 2024-02-28T16:26:51.268 INFO:tasks.workunit.client.0.smithi148.stdout:2/764: dwrite d0/d18/f19 [0,4194304] 0 2024-02-28T16:26:51.269 INFO:tasks.workunit.client.0.smithi148.stdout:6/785: getdents d0/d22/d27/d66/d87/dc6 0 2024-02-28T16:26:51.273 INFO:tasks.workunit.client.0.smithi148.stdout:2/765: chown d0/d1c/d49/f9b 338787 1 2024-02-28T16:26:51.273 INFO:tasks.workunit.client.0.smithi148.stdout:5/762: symlink d1/db/d60/d7a/d8b/d80/le9 0 2024-02-28T16:26:51.274 INFO:tasks.workunit.client.0.smithi148.stdout:2/766: stat d0/d18/d9a/f7b 0 2024-02-28T16:26:51.283 INFO:tasks.workunit.client.0.smithi148.stdout:1/939: dread d2/d3f/fac [0,4194304] 0 2024-02-28T16:26:51.284 INFO:tasks.workunit.client.0.smithi148.stdout:2/767: write d0/fb9 [763394,42539] 0 2024-02-28T16:26:51.284 INFO:tasks.workunit.client.0.smithi148.stdout:3/872: creat d1/d13/d19/d56/d5b/ffd x:0 0 0 2024-02-28T16:26:51.287 INFO:tasks.workunit.client.0.smithi148.stdout:3/873: fsync d1/db/d45/d80/fa6 0 2024-02-28T16:26:51.288 INFO:tasks.workunit.client.0.smithi148.stdout:6/786: read d0/d4/dba/f1f [5927755,94675] 0 2024-02-28T16:26:51.303 INFO:tasks.workunit.client.0.smithi148.stdout:9/884: dwrite d7/d1c/f99 [4194304,4194304] 0 2024-02-28T16:26:51.305 INFO:tasks.workunit.client.0.smithi148.stdout:9/885: readlink d7/d1c/d1f/d49/d5c/l79 0 2024-02-28T16:26:51.318 INFO:tasks.workunit.client.0.smithi148.stdout:5/763: mkdir d1/d8/d20/d4e/d96/ddb/dea 0 2024-02-28T16:26:51.320 INFO:tasks.workunit.client.0.smithi148.stdout:1/940: unlink d2/d15/c5f 0 2024-02-28T16:26:51.320 INFO:tasks.workunit.client.0.smithi148.stdout:9/886: dread d7/d1c/f34 [0,4194304] 0 2024-02-28T16:26:51.321 INFO:tasks.workunit.client.0.smithi148.stdout:5/764: write d1/fd7 [484952,100122] 0 2024-02-28T16:26:51.322 INFO:tasks.workunit.client.0.smithi148.stdout:3/874: mkdir d1/d13/d19/d94/db6/dd8/dfe 0 2024-02-28T16:26:51.324 INFO:tasks.workunit.client.0.smithi148.stdout:3/875: stat d1/db/d45/f96 0 2024-02-28T16:26:51.325 INFO:tasks.workunit.client.0.smithi148.stdout:5/765: truncate d1/d8/d23/f52 1359325 0 2024-02-28T16:26:51.326 INFO:tasks.workunit.client.0.smithi148.stdout:7/782: getdents d0/d9/d25/d96/ddf/d28/d2b/d3a 0 2024-02-28T16:26:51.327 INFO:tasks.workunit.client.0.smithi148.stdout:3/876: chown d1/d13/d19/d56/f5e 3740 1 2024-02-28T16:26:51.327 INFO:tasks.workunit.client.0.smithi148.stdout:5/766: read - d1/db/fc5 zero size 2024-02-28T16:26:51.327 INFO:tasks.workunit.client.0.smithi148.stdout:9/887: mknod d7/d1c/d32/c131 0 2024-02-28T16:26:51.330 INFO:tasks.workunit.client.0.smithi148.stdout:9/888: write d7/d1c/d1f/f126 [1010474,78976] 0 2024-02-28T16:26:51.331 INFO:tasks.workunit.client.0.smithi148.stdout:3/877: chown d1/db/d45/f4d 262997435 1 2024-02-28T16:26:51.334 INFO:tasks.workunit.client.0.smithi148.stdout:9/889: chown d7/d1c/d1f/d49/d6a/fa6 1018308829 1 2024-02-28T16:26:51.338 INFO:tasks.workunit.client.0.smithi148.stdout:7/783: creat d0/dd5/de0/ff2 x:0 0 0 2024-02-28T16:26:51.338 INFO:tasks.workunit.client.0.smithi148.stdout:1/941: dread d2/d5/d40/d7/f6a [0,4194304] 0 2024-02-28T16:26:51.342 INFO:tasks.workunit.client.0.smithi148.stdout:9/890: mkdir d7/d43/ddd/df1/d132 0 2024-02-28T16:26:51.344 INFO:tasks.workunit.client.0.smithi148.stdout:1/942: unlink d2/d9c/c12a 0 2024-02-28T16:26:51.349 INFO:tasks.workunit.client.0.smithi148.stdout:1/943: fdatasync d2/d15/d33/f63 0 2024-02-28T16:26:51.361 INFO:tasks.workunit.client.0.smithi148.stdout:5/767: dread d1/d8/d20/d4e/d84/f8a [0,4194304] 0 2024-02-28T16:26:51.362 INFO:tasks.workunit.client.0.smithi148.stdout:3/878: dread d1/d13/d19/d88/deb/ff9 [0,4194304] 0 2024-02-28T16:26:51.372 INFO:tasks.workunit.client.0.smithi148.stdout:3/879: truncate d1/d13/d19/fb8 985342 0 2024-02-28T16:26:51.373 INFO:tasks.workunit.client.0.smithi148.stdout:2/768: dwrite d0/d18/d20/dd3/faf [0,4194304] 0 2024-02-28T16:26:51.374 INFO:tasks.workunit.client.0.smithi148.stdout:9/891: dread d7/dd/f2b [0,4194304] 0 2024-02-28T16:26:51.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:51 smithi148 ceph-mon[28767]: pgmap v50: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 40 MiB/s rd, 113 MiB/s wr, 263 op/s 2024-02-28T16:26:51.378 INFO:tasks.workunit.client.0.smithi148.stdout:1/944: write d2/d3f/dcf/f65 [34972,65083] 0 2024-02-28T16:26:51.388 INFO:tasks.workunit.client.0.smithi148.stdout:3/880: creat d1/d13/d19/d32/fff x:0 0 0 2024-02-28T16:26:51.390 INFO:tasks.workunit.client.0.smithi148.stdout:5/768: dwrite d1/d8/d20/d4e/d71/f91 [0,4194304] 0 2024-02-28T16:26:51.394 INFO:tasks.workunit.client.0.smithi148.stdout:9/892: link d7/d43/da8/fab d7/d1c/d1f/d49/d5c/f133 0 2024-02-28T16:26:51.396 INFO:tasks.workunit.client.0.smithi148.stdout:3/881: unlink d1/d13/d19/d56/d5b/cea 0 2024-02-28T16:26:51.396 INFO:tasks.workunit.client.0.smithi148.stdout:9/893: chown d7/d1c/d3d 5223153 1 2024-02-28T16:26:51.402 INFO:tasks.workunit.client.0.smithi148.stdout:5/769: fdatasync d1/d8/d20/d4e/d71/f73 0 2024-02-28T16:26:51.405 INFO:tasks.workunit.client.0.smithi148.stdout:3/882: mkdir d1/d13/d19/d1b/d38/d9b/d100 0 2024-02-28T16:26:51.406 INFO:tasks.workunit.client.0.smithi148.stdout:1/945: getdents d2/d5/d40/d8/dd8/de2/da7/dd6 0 2024-02-28T16:26:51.409 INFO:tasks.workunit.client.0.smithi148.stdout:2/769: dwrite d0/d9/d13/fcd [0,4194304] 0 2024-02-28T16:26:51.413 INFO:tasks.workunit.client.0.smithi148.stdout:9/894: link d7/d1c/d3d/l9d d7/d1c/d1f/d49/d8d/l134 0 2024-02-28T16:26:51.414 INFO:tasks.workunit.client.0.smithi148.stdout:2/770: readlink d0/d1c/d85/d8b/lbe 0 2024-02-28T16:26:51.415 INFO:tasks.workunit.client.0.smithi148.stdout:5/770: rename d1/d44/d64/f5d to d1/d8/d20/d4e/d71/feb 0 2024-02-28T16:26:51.417 INFO:tasks.workunit.client.0.smithi148.stdout:5/771: fsync d1/d8/d20/fc3 0 2024-02-28T16:26:51.419 INFO:tasks.workunit.client.0.smithi148.stdout:2/771: write d0/d9/d13/d38/d3a/db3/ff1 [553897,6487] 0 2024-02-28T16:26:51.420 INFO:tasks.workunit.client.0.smithi148.stdout:9/895: creat d7/d1c/d74/d68/f135 x:0 0 0 2024-02-28T16:26:51.423 INFO:tasks.workunit.client.0.smithi148.stdout:2/772: chown d0/d18/d20/dd3/fca 452 1 2024-02-28T16:26:51.425 INFO:tasks.workunit.client.0.smithi148.stdout:1/946: rename d2/d5/d40/d7/f85 to d2/d3f/f12e 0 2024-02-28T16:26:51.433 INFO:tasks.workunit.client.0.smithi148.stdout:5/772: rename d1/db/d60/d7a/d8b/cda to d1/d8/d23/cec 0 2024-02-28T16:26:51.438 INFO:tasks.workunit.client.0.smithi148.stdout:5/773: readlink d1/d8/d20/d31/la1 0 2024-02-28T16:26:51.438 INFO:tasks.workunit.client.0.smithi148.stdout:1/947: link d2/d9c/f10a d2/d15/d8b/db0/d123/f12f 0 2024-02-28T16:26:51.440 INFO:tasks.workunit.client.0.smithi148.stdout:1/948: fsync d2/d3f/dcf/d75/fda 0 2024-02-28T16:26:51.445 INFO:tasks.workunit.client.0.smithi148.stdout:1/949: write d2/d15/f4d [1527893,40298] 0 2024-02-28T16:26:51.447 INFO:tasks.workunit.client.0.smithi148.stdout:9/896: write d7/d1c/d1f/d49/f89 [1337626,129720] 0 2024-02-28T16:26:51.448 INFO:tasks.workunit.client.0.smithi148.stdout:2/773: dwrite d0/d9/d13/d38/d3a/fb1 [0,4194304] 0 2024-02-28T16:26:51.456 INFO:tasks.workunit.client.0.smithi148.stdout:9/897: unlink d7/d1c/d74/d6b/ddb/l91 0 2024-02-28T16:26:51.459 INFO:tasks.workunit.client.0.smithi148.stdout:2/774: rename d0/d9/d13/d38/d3a/db3/cd9 to d0/d1d/dee/cf2 0 2024-02-28T16:26:51.462 INFO:tasks.workunit.client.0.smithi148.stdout:9/898: rename d7/d1c/d59/cc4 to d7/d1c/d1f/d49/dae/dc9/c136 0 2024-02-28T16:26:51.467 INFO:tasks.workunit.client.0.smithi148.stdout:1/950: dread d2/d5/d40/d7/dba/f11e [0,4194304] 0 2024-02-28T16:26:51.469 INFO:tasks.workunit.client.0.smithi148.stdout:9/899: truncate d7/d1c/d1f/f4a 4876688 0 2024-02-28T16:26:51.469 INFO:tasks.workunit.client.0.smithi148.stdout:1/951: fdatasync d2/d5/d40/f6d 0 2024-02-28T16:26:51.474 INFO:tasks.workunit.client.0.smithi148.stdout:2/775: dread d0/d1c/d85/d8b/d8f/fa9 [0,4194304] 0 2024-02-28T16:26:51.478 INFO:tasks.workunit.client.0.smithi148.stdout:1/952: rmdir d2/d3f/dcf/d129 0 2024-02-28T16:26:51.481 INFO:tasks.workunit.client.0.smithi148.stdout:1/953: write d2/d5/d40/d7/d91/f2c [856967,75686] 0 2024-02-28T16:26:51.483 INFO:tasks.workunit.client.0.smithi148.stdout:2/776: dread d0/dd/fe4 [0,4194304] 0 2024-02-28T16:26:51.483 INFO:tasks.workunit.client.0.smithi148.stdout:1/954: readlink d2/d15/d83/d89/daa/le5 0 2024-02-28T16:26:51.485 INFO:tasks.workunit.client.0.smithi148.stdout:1/955: readlink d2/d5/l7c 0 2024-02-28T16:26:51.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:51 smithi157 ceph-mon[38346]: pgmap v50: 65 pgs: 65 active+clean; 1.6 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 40 MiB/s rd, 113 MiB/s wr, 263 op/s 2024-02-28T16:26:51.488 INFO:tasks.workunit.client.0.smithi148.stdout:9/900: truncate d7/f21 1256007 0 2024-02-28T16:26:51.491 INFO:tasks.workunit.client.0.smithi148.stdout:1/956: symlink d2/d25/d10b/d10c/l130 0 2024-02-28T16:26:51.494 INFO:tasks.workunit.client.0.smithi148.stdout:1/957: write d2/d3f/fa0 [3412305,51791] 0 2024-02-28T16:26:51.497 INFO:tasks.workunit.client.0.smithi148.stdout:9/901: rename d7/d1c/d1f/d49/da7/dcf/f123 to d7/d1c/d32/d24/dac/f137 0 2024-02-28T16:26:51.497 INFO:tasks.workunit.client.0.smithi148.stdout:1/958: read d2/d5/d40/d7/dba/f11e [2804699,12013] 0 2024-02-28T16:26:51.498 INFO:tasks.workunit.client.0.smithi148.stdout:2/777: rename d0/d1c/d85/d8b/d8f/d9d to d0/d1c/d85/d8b/d8f/df3 0 2024-02-28T16:26:51.500 INFO:tasks.workunit.client.0.smithi148.stdout:2/778: fsync d0/d1d/d52/fce 0 2024-02-28T16:26:51.512 INFO:tasks.workunit.client.0.smithi148.stdout:2/779: dread d0/d18/d9a/f7b [0,4194304] 0 2024-02-28T16:26:51.518 INFO:tasks.workunit.client.0.smithi148.stdout:2/780: rename d0/dd/c6f to d0/d1c/d85/cf4 0 2024-02-28T16:26:51.520 INFO:tasks.workunit.client.0.smithi148.stdout:9/902: dwrite d7/d1c/d74/d6b/fed [0,4194304] 0 2024-02-28T16:26:51.525 INFO:tasks.workunit.client.0.smithi148.stdout:1/959: dwrite d2/d15/f35 [0,4194304] 0 2024-02-28T16:26:51.526 INFO:tasks.workunit.client.0.smithi148.stdout:1/960: fsync d2/d3f/f71 0 2024-02-28T16:26:51.530 INFO:tasks.workunit.client.0.smithi148.stdout:2/781: write d0/d9/fa6 [640599,122829] 0 2024-02-28T16:26:51.535 INFO:tasks.workunit.client.0.smithi148.stdout:2/782: stat d0/d1c/d85/d8b/d8f/df3/d36/c94 0 2024-02-28T16:26:51.538 INFO:tasks.workunit.client.0.smithi148.stdout:2/783: read d0/d59/f7f [215350,67366] 0 2024-02-28T16:26:51.540 INFO:tasks.workunit.client.0.smithi148.stdout:2/784: fsync d0/d1c/d85/fe2 0 2024-02-28T16:26:51.543 INFO:tasks.workunit.client.0.smithi148.stdout:9/903: dwrite d7/d1c/d32/d24/dac/f137 [0,4194304] 0 2024-02-28T16:26:51.544 INFO:tasks.workunit.client.0.smithi148.stdout:2/785: write d0/d9/d13/d38/d3a/db3/ff1 [319501,91498] 0 2024-02-28T16:26:51.549 INFO:tasks.workunit.client.0.smithi148.stdout:2/786: readlink d0/d1c/d85/d8b/laa 0 2024-02-28T16:26:51.550 INFO:tasks.workunit.client.0.smithi148.stdout:9/904: write d7/d1c/d3d/fd6 [3255294,87331] 0 2024-02-28T16:26:51.553 INFO:tasks.workunit.client.0.smithi148.stdout:1/961: dwrite d2/d3f/dcf/d75/d76/f8e [0,4194304] 0 2024-02-28T16:26:51.553 INFO:tasks.workunit.client.0.smithi148.stdout:9/905: fsync d7/d43/de0/f12c 0 2024-02-28T16:26:51.556 INFO:tasks.workunit.client.0.smithi148.stdout:1/962: fsync d2/d5/d40/d7/d99/d12c/fa2 0 2024-02-28T16:26:51.556 INFO:tasks.workunit.client.0.smithi148.stdout:9/906: chown d7/f3c 3583 1 2024-02-28T16:26:51.560 INFO:tasks.workunit.client.0.smithi148.stdout:2/787: rename d0/d1d/d55/cad to d0/d1d/cf5 0 2024-02-28T16:26:51.563 INFO:tasks.workunit.client.0.smithi148.stdout:2/788: mknod d0/d1c/dcc/cf6 0 2024-02-28T16:26:51.566 INFO:tasks.workunit.client.0.smithi148.stdout:9/907: rmdir d7/d43/ddd/df1/df3/d12d 0 2024-02-28T16:26:51.570 INFO:tasks.workunit.client.0.smithi148.stdout:2/789: mknod d0/d1c/cf7 0 2024-02-28T16:26:51.574 INFO:tasks.workunit.client.0.smithi148.stdout:2/790: symlink d0/dd/lf8 0 2024-02-28T16:26:51.582 INFO:tasks.workunit.client.0.smithi148.stdout:2/791: getdents d0/d18/d20/dd3 0 2024-02-28T16:26:51.582 INFO:tasks.workunit.client.0.smithi148.stdout:1/963: dwrite d2/d15/d8b/db0/d123/f12f [0,4194304] 0 2024-02-28T16:26:51.585 INFO:tasks.workunit.client.0.smithi148.stdout:9/908: write d7/d1c/d1f/d49/d5c/f133 [4243356,118850] 0 2024-02-28T16:26:51.591 INFO:tasks.workunit.client.0.smithi148.stdout:2/792: rename d0/d18/d20/l3f to d0/d66/d76/lf9 0 2024-02-28T16:26:51.595 INFO:tasks.workunit.client.0.smithi148.stdout:9/909: dread d7/d1c/d32/d24/dc1/fe9 [0,4194304] 0 2024-02-28T16:26:51.605 INFO:tasks.workunit.client.0.smithi148.stdout:1/964: dwrite d2/d15/fbe [0,4194304] 0 2024-02-28T16:26:51.608 INFO:tasks.workunit.client.0.smithi148.stdout:1/965: fsync d2/d3f/d46/fd0 0 2024-02-28T16:26:51.611 INFO:tasks.workunit.client.0.smithi148.stdout:1/966: readlink d2/d3f/l8c 0 2024-02-28T16:26:51.617 INFO:tasks.workunit.client.0.smithi148.stdout:2/793: dwrite d0/d18/d20/d73/fb7 [0,4194304] 0 2024-02-28T16:26:51.617 INFO:tasks.workunit.client.0.smithi148.stdout:1/967: write d2/d3f/dcf/f113 [35211,125653] 0 2024-02-28T16:26:51.628 INFO:tasks.workunit.client.0.smithi148.stdout:1/968: mknod d2/d15/d8b/da3/c131 0 2024-02-28T16:26:51.632 INFO:tasks.workunit.client.0.smithi148.stdout:2/794: symlink d0/d1d/d52/da3/lfa 0 2024-02-28T16:26:51.632 INFO:tasks.workunit.client.0.smithi148.stdout:1/969: write d2/d15/d8b/db0/d123/f12f [4954767,33748] 0 2024-02-28T16:26:51.635 INFO:tasks.workunit.client.0.smithi148.stdout:9/910: dread d7/d1c/d74/f50 [0,4194304] 0 2024-02-28T16:26:51.641 INFO:tasks.workunit.client.0.smithi148.stdout:1/970: getdents d2/d25/d10b 0 2024-02-28T16:26:51.647 INFO:tasks.workunit.client.0.smithi148.stdout:2/795: dread d0/d18/d20/d73/fb7 [0,4194304] 0 2024-02-28T16:26:51.648 INFO:tasks.workunit.client.0.smithi148.stdout:1/971: dread d2/d5/d40/d7/f6a [0,4194304] 0 2024-02-28T16:26:51.651 INFO:tasks.workunit.client.0.smithi148.stdout:1/972: fdatasync d2/d5/d40/d8/dcd/ff8 0 2024-02-28T16:26:51.652 INFO:tasks.workunit.client.0.smithi148.stdout:9/911: dwrite d7/d1c/d3d/f56 [4194304,4194304] 0 2024-02-28T16:26:51.660 INFO:tasks.workunit.client.0.smithi148.stdout:9/912: mkdir d7/d1c/d3d/d138 0 2024-02-28T16:26:51.667 INFO:tasks.workunit.client.0.smithi148.stdout:2/796: dwrite d0/d18/d20/dd3/fc8 [0,4194304] 0 2024-02-28T16:26:51.670 INFO:tasks.workunit.client.0.smithi148.stdout:2/797: symlink d0/d1c/d85/lfb 0 2024-02-28T16:26:51.672 INFO:tasks.workunit.client.0.smithi148.stdout:2/798: chown d0/d9/d13/d38/d3a/l3d 20598 1 2024-02-28T16:26:51.679 INFO:tasks.workunit.client.0.smithi148.stdout:9/913: dwrite d7/d1c/d1f/d49/f120 [0,4194304] 0 2024-02-28T16:26:51.705 INFO:tasks.workunit.client.0.smithi148.stdout:9/914: truncate d7/d43/de0/ffd 5115510 0 2024-02-28T16:26:51.707 INFO:tasks.workunit.client.0.smithi148.stdout:9/915: chown d7/dd/d26/f4d 2711321 1 2024-02-28T16:26:51.708 INFO:tasks.workunit.client.1.smithi157.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T16:26:51.711 INFO:tasks.workunit.client.0.smithi148.stdout:2/799: dwrite d0/dd/f88 [0,4194304] 0 2024-02-28T16:26:51.711 INFO:tasks.workunit.client.0.smithi148.stdout:9/916: creat d7/d1c/d1f/d49/d116/f139 x:0 0 0 2024-02-28T16:26:51.715 INFO:tasks.workunit.client.0.smithi148.stdout:9/917: mknod d7/d1c/d74/d6b/ddb/c13a 0 2024-02-28T16:26:51.722 INFO:tasks.workunit.client.0.smithi148.stdout:9/918: getdents d7/d43/ddd/df1 0 2024-02-28T16:26:51.724 INFO:tasks.workunit.client.0.smithi148.stdout:9/919: fsync d7/d1c/f45 0 2024-02-28T16:26:51.730 INFO:tasks.workunit.client.0.smithi148.stdout:2/800: dwrite d0/d18/f8e [0,4194304] 0 2024-02-28T16:26:51.734 INFO:tasks.workunit.client.0.smithi148.stdout:9/920: rename d7/d1c/d59/c101 to d7/d1c/d1f/d49/c13b 0 2024-02-28T16:26:51.736 INFO:tasks.workunit.client.0.smithi148.stdout:2/801: write d0/d9/d13/f16 [1547130,120898] 0 2024-02-28T16:26:51.737 INFO:tasks.workunit.client.0.smithi148.stdout:9/921: rmdir d7/d1c/d74/d68/d10d 39 2024-02-28T16:26:51.738 INFO:tasks.workunit.client.1.smithi157.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:26:51.738 INFO:tasks.workunit.client.1.smithi157.stderr:+ make 2024-02-28T16:26:51.738 INFO:tasks.workunit.client.0.smithi148.stdout:9/922: readlink d7/d1c/d74/lda 0 2024-02-28T16:26:51.739 INFO:tasks.workunit.client.0.smithi148.stdout:2/802: creat d0/d1c/d85/d96/ffc x:0 0 0 2024-02-28T16:26:51.742 INFO:tasks.workunit.client.0.smithi148.stdout:2/803: chown d0/d1d/c22 49827 1 2024-02-28T16:26:51.743 INFO:tasks.workunit.client.0.smithi148.stdout:9/923: creat d7/d1c/d32/d24/f13c x:0 0 0 2024-02-28T16:26:51.745 INFO:tasks.workunit.client.0.smithi148.stdout:9/924: dread d7/d1c/d74/d6b/f105 [0,4194304] 0 2024-02-28T16:26:51.747 INFO:tasks.workunit.client.0.smithi148.stdout:2/804: unlink d0/d1d/l78 0 2024-02-28T16:26:51.748 INFO:tasks.workunit.client.0.smithi148.stdout:9/925: mknod d7/d1c/d32/d24/dc1/c13d 0 2024-02-28T16:26:51.749 INFO:tasks.workunit.client.0.smithi148.stdout:2/805: getdents d0/d18/d20/ddd 0 2024-02-28T16:26:51.753 INFO:tasks.workunit.client.0.smithi148.stdout:2/806: truncate d0/d1c/d85/d96/ffc 809234 0 2024-02-28T16:26:51.754 INFO:tasks.workunit.client.0.smithi148.stdout:9/926: rename d7/d1c/d59/l6d to d7/d43/ddd/df1/d113/l13e 0 2024-02-28T16:26:51.766 INFO:tasks.workunit.client.0.smithi148.stdout:2/807: truncate d0/d1c/f1f 3686873 0 2024-02-28T16:26:51.772 INFO:tasks.workunit.client.0.smithi148.stdout:9/927: dwrite d7/d1c/d1f/d49/d6a/f9f [0,4194304] 0 2024-02-28T16:26:51.776 INFO:tasks.workunit.client.0.smithi148.stdout:9/928: symlink d7/d1c/d1f/d49/dae/dc9/d100/l13f 0 2024-02-28T16:26:51.778 INFO:tasks.workunit.client.0.smithi148.stdout:9/929: dread - d7/d1c/d74/d68/f135 zero size 2024-02-28T16:26:51.783 INFO:tasks.workunit.client.0.smithi148.stdout:9/930: mknod d7/d43/ddd/df1/df3/c140 0 2024-02-28T16:26:51.785 INFO:tasks.workunit.client.0.smithi148.stdout:9/931: chown d7/d1c/d1f/d49/da7/fee 653745 1 2024-02-28T16:26:51.796 INFO:tasks.workunit.client.0.smithi148.stdout:2/808: dread d0/d1c/f4e [0,4194304] 0 2024-02-28T16:26:51.840 INFO:tasks.workunit.client.0.smithi148.stdout:8/895: sync 2024-02-28T16:26:51.845 INFO:tasks.workunit.client.0.smithi148.stdout:2/809: symlink d0/d1c/d85/d96/dbf/lfd 0 2024-02-28T16:26:51.848 INFO:tasks.workunit.client.0.smithi148.stdout:8/896: creat d1/dd/d51/d9b/f127 x:0 0 0 2024-02-28T16:26:51.850 INFO:tasks.workunit.client.0.smithi148.stdout:2/810: rmdir d0/d1c/d6e 39 2024-02-28T16:26:51.853 INFO:tasks.workunit.client.0.smithi148.stdout:2/811: dread - d0/d1c/d85/fc2 zero size 2024-02-28T16:26:51.856 INFO:tasks.workunit.client.0.smithi148.stdout:8/897: rename d1/d3/d18/d5a/d60/lb1 to d1/d3/l128 0 2024-02-28T16:26:51.856 INFO:tasks.workunit.client.0.smithi148.stdout:2/812: write d0/d9/d13/f16 [1270810,8850] 0 2024-02-28T16:26:51.856 INFO:tasks.workunit.client.1.smithi157.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T16:26:51.857 INFO:tasks.workunit.client.0.smithi148.stdout:8/898: chown d1/dd/d13/d24/d3a/f69 514787 1 2024-02-28T16:26:51.859 INFO:tasks.workunit.client.0.smithi148.stdout:8/899: fsync d1/dd/d13/d68/fc0 0 2024-02-28T16:26:51.860 INFO:tasks.workunit.client.0.smithi148.stdout:2/813: readlink d0/d1d/d52/la5 0 2024-02-28T16:26:51.865 INFO:tasks.workunit.client.0.smithi148.stdout:8/900: dread - d1/d3/d18/d120/d126/d34/fce zero size 2024-02-28T16:26:51.872 INFO:tasks.workunit.client.0.smithi148.stdout:8/901: truncate d1/dd/d13/d1a/d87/f6b 1496509 0 2024-02-28T16:26:51.877 INFO:tasks.workunit.client.0.smithi148.stdout:8/902: mkdir d1/d3/d18/d120/d126/d34/d129 0 2024-02-28T16:26:51.881 INFO:tasks.workunit.client.0.smithi148.stdout:8/903: unlink d1/d3/d18/d48/d70/f88 0 2024-02-28T16:26:51.882 INFO:tasks.workunit.client.0.smithi148.stdout:8/904: fsync d1/f7 0 2024-02-28T16:26:51.886 INFO:tasks.workunit.client.0.smithi148.stdout:2/814: write d0/d1c/d85/d96/fb4 [1029717,3324] 0 2024-02-28T16:26:51.887 INFO:tasks.workunit.client.0.smithi148.stdout:8/905: symlink d1/l12a 0 2024-02-28T16:26:51.892 INFO:tasks.workunit.client.0.smithi148.stdout:2/815: mknod d0/d1d/d52/da3/cfe 0 2024-02-28T16:26:51.894 INFO:tasks.workunit.client.0.smithi148.stdout:2/816: chown d0/d1c/d85/d96/fb4 66139 1 2024-02-28T16:26:51.902 INFO:tasks.workunit.client.0.smithi148.stdout:2/817: mknod d0/d1c/d6e/cff 0 2024-02-28T16:26:51.904 INFO:tasks.workunit.client.0.smithi148.stdout:2/818: write d0/d1c/d85/d8b/fef [714024,92446] 0 2024-02-28T16:26:51.917 INFO:tasks.workunit.client.0.smithi148.stdout:2/819: link d0/d9/d13/d38/d3a/fb1 d0/d1d/f100 0 2024-02-28T16:26:51.922 INFO:tasks.workunit.client.0.smithi148.stdout:2/820: mknod d0/d1c/d85/d8b/dda/c101 0 2024-02-28T16:26:51.928 INFO:tasks.workunit.client.0.smithi148.stdout:2/821: unlink d0/d1d/l37 0 2024-02-28T16:26:51.932 INFO:tasks.workunit.client.0.smithi148.stdout:2/822: symlink d0/d1d/d52/d84/l102 0 2024-02-28T16:26:51.934 INFO:tasks.workunit.client.0.smithi148.stdout:8/906: dwrite d1/d3/f4 [0,4194304] 0 2024-02-28T16:26:51.938 INFO:tasks.workunit.client.0.smithi148.stdout:2/823: mkdir d0/d1c/d85/d8b/d8f/df3/d103 0 2024-02-28T16:26:51.944 INFO:tasks.workunit.client.0.smithi148.stdout:8/907: mknod d1/dd/d13/d24/d3a/c12b 0 2024-02-28T16:26:51.946 INFO:tasks.workunit.client.0.smithi148.stdout:8/908: chown d1/dd/d13/d24/l2a 15814 1 2024-02-28T16:26:51.950 INFO:tasks.workunit.client.0.smithi148.stdout:8/909: creat d1/da7/f12c x:0 0 0 2024-02-28T16:26:51.955 INFO:tasks.workunit.client.0.smithi148.stdout:8/910: write d1/d3/d18/d48/d70/d75/d91/dcc/ddf/ff3 [643592,62024] 0 2024-02-28T16:26:51.960 INFO:tasks.workunit.client.0.smithi148.stdout:8/911: rename d1/dd/d51/d77/c8b to d1/d3/d18/d120/d126/d34/dbc/c12d 0 2024-02-28T16:26:51.963 INFO:tasks.workunit.client.0.smithi148.stdout:8/912: truncate d1/dd/d13/d68/fc0 4596899 0 2024-02-28T16:26:51.975 INFO:tasks.workunit.client.0.smithi148.stdout:2/824: write d0/d59/f7f [1187122,75340] 0 2024-02-28T16:26:51.979 INFO:tasks.workunit.client.0.smithi148.stdout:2/825: mkdir d0/d1c/d85/d96/dbf/d104 0 2024-02-28T16:26:51.999 INFO:tasks.workunit.client.0.smithi148.stdout:2/826: dread d0/d66/d76/f7c [0,4194304] 0 2024-02-28T16:26:52.001 INFO:tasks.workunit.client.0.smithi148.stdout:2/827: chown d0/d18/d20/f50 11478 1 2024-02-28T16:26:52.005 INFO:tasks.workunit.client.0.smithi148.stdout:2/828: read d0/d1c/d85/d96/fb4 [236167,3742] 0 2024-02-28T16:26:52.010 INFO:tasks.workunit.client.0.smithi148.stdout:2/829: link d0/d9/f21 d0/d9/f105 0 2024-02-28T16:26:52.067 INFO:tasks.workunit.client.0.smithi148.stdout:4/665: sync 2024-02-28T16:26:52.077 INFO:tasks.workunit.client.0.smithi148.stdout:4/666: creat d8/d40/dc3/dd3/d17/d6a/d6c/fe2 x:0 0 0 2024-02-28T16:26:52.080 INFO:tasks.workunit.client.0.smithi148.stdout:4/667: fsync d8/d40/d73/fc0 0 2024-02-28T16:26:52.087 INFO:tasks.workunit.client.0.smithi148.stdout:4/668: mkdir d8/d40/dc3/dbd/de3 0 2024-02-28T16:26:52.099 INFO:tasks.workunit.client.0.smithi148.stdout:2/830: dwrite d0/d9/d13/fcd [0,4194304] 0 2024-02-28T16:26:52.101 INFO:tasks.workunit.client.0.smithi148.stdout:4/669: write d8/d40/dc3/dd3/d5f/f7b [965672,102428] 0 2024-02-28T16:26:52.103 INFO:tasks.workunit.client.0.smithi148.stdout:2/831: write d0/d18/d20/dd3/fca [6855488,22085] 0 2024-02-28T16:26:52.114 INFO:tasks.workunit.client.0.smithi148.stdout:2/832: link d0/d1d/ld6 d0/d1d/d55/l106 0 2024-02-28T16:26:52.121 INFO:tasks.workunit.client.0.smithi148.stdout:2/833: truncate d0/d1c/f4e 2532194 0 2024-02-28T16:26:52.123 INFO:tasks.workunit.client.0.smithi148.stdout:2/834: write d0/d18/f19 [1985936,40216] 0 2024-02-28T16:26:52.131 INFO:tasks.workunit.client.0.smithi148.stdout:2/835: mkdir d0/d1c/d85/d96/dbf/d107 0 2024-02-28T16:26:52.132 INFO:tasks.workunit.client.0.smithi148.stdout:4/670: dwrite d8/d21/d3d/f9b [0,4194304] 0 2024-02-28T16:26:52.135 INFO:tasks.workunit.client.0.smithi148.stdout:2/836: creat d0/d18/d20/dd3/f108 x:0 0 0 2024-02-28T16:26:52.136 INFO:tasks.workunit.client.0.smithi148.stdout:4/671: readlink d8/d21/d3d/d8c/lcf 0 2024-02-28T16:26:52.154 INFO:tasks.workunit.client.0.smithi148.stdout:2/837: dwrite d0/d18/d9a/f7b [0,4194304] 0 2024-02-28T16:26:52.165 INFO:tasks.workunit.client.0.smithi148.stdout:2/838: truncate d0/f10 111664 0 2024-02-28T16:26:52.166 INFO:tasks.workunit.client.0.smithi148.stdout:2/839: fsync d0/d1d/d52/fce 0 2024-02-28T16:26:52.170 INFO:tasks.workunit.client.0.smithi148.stdout:2/840: mkdir d0/d18/d20/dd3/d109 0 2024-02-28T16:26:52.176 INFO:tasks.workunit.client.0.smithi148.stdout:2/841: symlink d0/d1c/d85/d8b/d8f/df3/l10a 0 2024-02-28T16:26:52.181 INFO:tasks.workunit.client.0.smithi148.stdout:2/842: mkdir d0/d9/d13/d38/d3a/d10b 0 2024-02-28T16:26:52.185 INFO:tasks.workunit.client.0.smithi148.stdout:2/843: mknod d0/d18/d20/dd3/d109/c10c 0 2024-02-28T16:26:52.205 INFO:tasks.workunit.client.0.smithi148.stdout:2/844: dwrite d0/d1c/d85/d96/ffc [0,4194304] 0 2024-02-28T16:26:52.212 INFO:tasks.workunit.client.0.smithi148.stdout:2/845: mknod d0/d1c/d85/d96/c10d 0 2024-02-28T16:26:52.222 INFO:tasks.workunit.client.0.smithi148.stdout:2/846: truncate d0/d1c/d85/d8b/d8f/df3/fb8 962282 0 2024-02-28T16:26:52.224 INFO:tasks.workunit.client.0.smithi148.stdout:2/847: fsync d0/d9/d13/f80 0 2024-02-28T16:26:52.231 INFO:tasks.workunit.client.0.smithi148.stdout:2/848: rename d0/d1d/dee to d0/d1c/dcc/d10e 0 2024-02-28T16:26:52.233 INFO:tasks.workunit.client.0.smithi148.stdout:2/849: mkdir d0/dd/d10f 0 2024-02-28T16:26:52.237 INFO:tasks.workunit.client.0.smithi148.stdout:2/850: creat d0/d9/d13/f110 x:0 0 0 2024-02-28T16:26:52.239 INFO:tasks.workunit.client.0.smithi148.stdout:2/851: symlink d0/d66/l111 0 2024-02-28T16:26:52.241 INFO:tasks.workunit.client.0.smithi148.stdout:2/852: dread - d0/d1c/d85/d96/dbf/fe8 zero size 2024-02-28T16:26:52.244 INFO:tasks.workunit.client.0.smithi148.stdout:2/853: chown d0/d1c/d85/d8b/d8f 2528 1 2024-02-28T16:26:52.246 INFO:tasks.workunit.client.0.smithi148.stdout:6/787: sync 2024-02-28T16:26:52.248 INFO:tasks.workunit.client.0.smithi148.stdout:6/788: chown d0/d4/dba/d71/fac 3663397 1 2024-02-28T16:26:52.251 INFO:tasks.workunit.client.0.smithi148.stdout:6/789: rmdir d0/d8 39 2024-02-28T16:26:52.254 INFO:tasks.workunit.client.0.smithi148.stdout:2/854: dread d0/d9/d13/d38/d3a/db3/ff1 [0,4194304] 0 2024-02-28T16:26:52.257 INFO:tasks.workunit.client.0.smithi148.stdout:6/790: symlink d0/d4/d14/lfe 0 2024-02-28T16:26:52.266 INFO:tasks.workunit.client.0.smithi148.stdout:6/791: symlink d0/d8/lff 0 2024-02-28T16:26:52.268 INFO:tasks.workunit.client.0.smithi148.stdout:6/792: creat d0/d4/d14/f100 x:0 0 0 2024-02-28T16:26:52.271 INFO:tasks.workunit.client.0.smithi148.stdout:6/793: creat d0/d22/d27/d66/f101 x:0 0 0 2024-02-28T16:26:52.274 INFO:tasks.workunit.client.0.smithi148.stdout:6/794: write d0/d22/d27/f62 [8217700,130872] 0 2024-02-28T16:26:52.277 INFO:tasks.workunit.client.0.smithi148.stdout:6/795: chown d0/f6e 18772692 1 2024-02-28T16:26:52.279 INFO:tasks.workunit.client.0.smithi148.stdout:2/855: dwrite d0/d18/d20/f92 [0,4194304] 0 2024-02-28T16:26:52.310 INFO:tasks.workunit.client.0.smithi148.stdout:6/796: link d0/d4/dba/fd5 d0/d8/d21/d9d/f102 0 2024-02-28T16:26:52.311 INFO:tasks.workunit.client.0.smithi148.stdout:2/856: symlink d0/d66/d76/l112 0 2024-02-28T16:26:52.313 INFO:tasks.workunit.client.0.smithi148.stdout:6/797: chown d0/d4/dba/fcf 41248950 1 2024-02-28T16:26:52.313 INFO:tasks.workunit.client.0.smithi148.stdout:2/857: write d0/fb9 [1539800,124956] 0 2024-02-28T16:26:52.314 INFO:tasks.workunit.client.0.smithi148.stdout:2/858: stat d0/d1c/d85/d8b/d8f/df3 0 2024-02-28T16:26:52.315 INFO:tasks.workunit.client.0.smithi148.stdout:6/798: unlink d0/d8/d21/c64 0 2024-02-28T16:26:52.316 INFO:tasks.workunit.client.0.smithi148.stdout:2/859: truncate d0/d18/d9a/fd7 542140 0 2024-02-28T16:26:52.322 INFO:tasks.workunit.client.0.smithi148.stdout:2/860: link d0/d18/d20/l83 d0/dd/d10f/l113 0 2024-02-28T16:26:52.322 INFO:tasks.workunit.client.0.smithi148.stdout:6/799: dread d0/d4/dba/d71/fac [0,4194304] 0 2024-02-28T16:26:52.325 INFO:tasks.workunit.client.0.smithi148.stdout:2/861: mkdir d0/d1c/d114 0 2024-02-28T16:26:52.328 INFO:tasks.workunit.client.0.smithi148.stdout:6/800: rename d0/d4/dba/de9/ff5 to d0/d22/d25/f103 0 2024-02-28T16:26:52.329 INFO:tasks.workunit.client.0.smithi148.stdout:2/862: creat d0/d1c/d85/d8b/d8f/dc9/f115 x:0 0 0 2024-02-28T16:26:52.331 INFO:tasks.workunit.client.0.smithi148.stdout:6/801: creat d0/d8/d21/d9d/f104 x:0 0 0 2024-02-28T16:26:52.331 INFO:tasks.workunit.client.0.smithi148.stdout:2/863: write d0/d1d/f77 [12588358,18494] 0 2024-02-28T16:26:52.335 INFO:tasks.workunit.client.0.smithi148.stdout:6/802: symlink d0/d4/d14/d8a/da2/l105 0 2024-02-28T16:26:52.336 INFO:tasks.workunit.client.0.smithi148.stdout:2/864: symlink d0/d18/d20/dd3/db5/l116 0 2024-02-28T16:26:52.342 INFO:tasks.workunit.client.0.smithi148.stdout:6/803: rename d0/d22/d25/d76/cdf to d0/d4/d14/d59/df9/c106 0 2024-02-28T16:26:52.342 INFO:tasks.workunit.client.0.smithi148.stdout:7/784: sync 2024-02-28T16:26:52.369 INFO:tasks.workunit.client.0.smithi148.stdout:6/804: rename d0/d4/d14/d8a to d0/d22/d49/d88/d107 0 2024-02-28T16:26:52.372 INFO:tasks.workunit.client.0.smithi148.stdout:6/805: fdatasync d0/d22/d49/f6b 0 2024-02-28T16:26:52.372 INFO:tasks.workunit.client.0.smithi148.stdout:7/785: write d0/d4/f63 [2272040,128722] 0 2024-02-28T16:26:52.376 INFO:tasks.workunit.client.0.smithi148.stdout:6/806: creat d0/d22/d27/d66/f108 x:0 0 0 2024-02-28T16:26:52.378 INFO:tasks.workunit.client.0.smithi148.stdout:7/786: chown d0/d9/d25/d96/ddf/d28/d2b/l30 6820 1 2024-02-28T16:26:52.381 INFO:tasks.workunit.client.0.smithi148.stdout:6/807: truncate d0/d4/dba/d71/ffb 44052 0 2024-02-28T16:26:52.382 INFO:tasks.workunit.client.0.smithi148.stdout:7/787: read d0/d9/f1a [3731218,123044] 0 2024-02-28T16:26:52.384 INFO:tasks.workunit.client.0.smithi148.stdout:2/865: dwrite d0/d1c/d85/d8b/d8f/fa9 [0,4194304] 0 2024-02-28T16:26:52.384 INFO:tasks.workunit.client.0.smithi148.stdout:6/808: dread - d0/d4/d14/ffc zero size 2024-02-28T16:26:52.386 INFO:tasks.workunit.client.0.smithi148.stdout:7/788: fsync d0/d9/d25/d96/ddf/d28/d2b/d3a/fc4 0 2024-02-28T16:26:52.386 INFO:tasks.workunit.client.0.smithi148.stdout:6/809: stat d0/d4/l3b 0 2024-02-28T16:26:52.403 INFO:tasks.workunit.client.0.smithi148.stdout:8/913: sync 2024-02-28T16:26:52.403 INFO:tasks.workunit.client.0.smithi148.stdout:4/672: sync 2024-02-28T16:26:52.403 INFO:tasks.workunit.client.0.smithi148.stdout:1/973: sync 2024-02-28T16:26:52.403 INFO:tasks.workunit.client.0.smithi148.stdout:3/883: sync 2024-02-28T16:26:52.404 INFO:tasks.workunit.client.0.smithi148.stdout:5/774: sync 2024-02-28T16:26:52.404 INFO:tasks.workunit.client.0.smithi148.stdout:9/932: sync 2024-02-28T16:26:52.411 INFO:tasks.workunit.client.0.smithi148.stdout:2/866: dwrite d0/d1c/d85/d96/fb4 [0,4194304] 0 2024-02-28T16:26:52.413 INFO:tasks.workunit.client.0.smithi148.stdout:6/810: dwrite d0/d22/d25/d76/f80 [0,4194304] 0 2024-02-28T16:26:52.413 INFO:tasks.workunit.client.0.smithi148.stdout:8/914: chown d1/d3/d18/d120/d126/d34/d129 800059809 1 2024-02-28T16:26:52.413 INFO:tasks.workunit.client.0.smithi148.stdout:4/673: read - d8/d21/d3d/d4d/dd0/dd4/fdc zero size 2024-02-28T16:26:52.414 INFO:tasks.workunit.client.0.smithi148.stdout:3/884: write d1/d3f/da5/da9/fdd [1044415,76494] 0 2024-02-28T16:26:52.418 INFO:tasks.workunit.client.0.smithi148.stdout:5/775: mkdir d1/d8/d20/d4e/d84/d92/ded 0 2024-02-28T16:26:52.419 INFO:tasks.workunit.client.0.smithi148.stdout:2/867: fsync d0/d1d/f77 0 2024-02-28T16:26:52.419 INFO:tasks.workunit.client.0.smithi148.stdout:1/974: write d2/d5/d40/d7/f38 [4707949,75431] 0 2024-02-28T16:26:52.420 INFO:tasks.workunit.client.0.smithi148.stdout:6/811: chown d0/d8/f6c 103223212 1 2024-02-28T16:26:52.422 INFO:tasks.workunit.client.0.smithi148.stdout:4/674: mkdir d8/de4 0 2024-02-28T16:26:52.425 INFO:tasks.workunit.client.0.smithi148.stdout:6/812: readlink d0/d22/d25/dcc/le8 0 2024-02-28T16:26:52.428 INFO:tasks.workunit.client.0.smithi148.stdout:1/975: symlink d2/d5/d40/d8/l132 0 2024-02-28T16:26:52.429 INFO:tasks.workunit.client.0.smithi148.stdout:8/915: read d1/d3/f53 [244730,52784] 0 2024-02-28T16:26:52.430 INFO:tasks.workunit.client.0.smithi148.stdout:9/933: link d7/d1c/f20 d7/d1c/d59/d83/de4/d106/f141 0 2024-02-28T16:26:52.432 INFO:tasks.workunit.client.0.smithi148.stdout:9/934: fsync d7/d1c/d1f/f126 0 2024-02-28T16:26:52.433 INFO:tasks.workunit.client.0.smithi148.stdout:6/813: creat d0/d8/dfd/f109 x:0 0 0 2024-02-28T16:26:52.437 INFO:tasks.workunit.client.0.smithi148.stdout:1/976: fdatasync d2/d9c/f121 0 2024-02-28T16:26:52.440 INFO:tasks.workunit.client.0.smithi148.stdout:3/885: dwrite d1/d13/f3b [0,4194304] 0 2024-02-28T16:26:52.447 INFO:tasks.workunit.client.0.smithi148.stdout:2/868: dread d0/dd/f88 [0,4194304] 0 2024-02-28T16:26:52.448 INFO:tasks.workunit.client.0.smithi148.stdout:6/814: creat d0/d22/d27/d3e/d52/f10a x:0 0 0 2024-02-28T16:26:52.449 INFO:tasks.workunit.client.0.smithi148.stdout:1/977: symlink d2/d15/d33/l133 0 2024-02-28T16:26:52.449 INFO:tasks.workunit.client.0.smithi148.stdout:4/675: getdents d8/d37/d91/db2 0 2024-02-28T16:26:52.455 INFO:tasks.workunit.client.0.smithi148.stdout:4/676: chown d8/d37/l44 1765782 1 2024-02-28T16:26:52.456 INFO:tasks.workunit.client.0.smithi148.stdout:3/886: rename d1/d13/f78 to d1/d3f/f101 0 2024-02-28T16:26:52.459 INFO:tasks.workunit.client.0.smithi148.stdout:9/935: dread d7/d1c/d32/d24/fad [0,4194304] 0 2024-02-28T16:26:52.460 INFO:tasks.workunit.client.0.smithi148.stdout:2/869: creat d0/d18/d20/dd3/f117 x:0 0 0 2024-02-28T16:26:52.466 INFO:tasks.workunit.client.0.smithi148.stdout:3/887: write d1/d13/f17 [68246,76986] 0 2024-02-28T16:26:52.467 INFO:tasks.workunit.client.0.smithi148.stdout:3/888: chown d1/le2 210033793 1 2024-02-28T16:26:52.467 INFO:tasks.workunit.client.0.smithi148.stdout:9/936: chown d7/d1c/d1f/d49/d6a/fb2 1643847 1 2024-02-28T16:26:52.469 INFO:tasks.workunit.client.0.smithi148.stdout:6/815: rmdir d0/d8/dfd 39 2024-02-28T16:26:52.474 INFO:tasks.workunit.client.0.smithi148.stdout:3/889: symlink d1/d13/d19/d32/d9e/l102 0 2024-02-28T16:26:52.483 INFO:tasks.workunit.client.0.smithi148.stdout:6/816: mknod d0/d10/c10b 0 2024-02-28T16:26:52.484 INFO:tasks.workunit.client.0.smithi148.stdout:7/789: dread d0/d9/d25/d96/ddf/d28/d2b/f69 [0,4194304] 0 2024-02-28T16:26:52.487 INFO:tasks.workunit.client.0.smithi148.stdout:1/978: dwrite d2/d5/d40/d7/d99/d12c/fa2 [0,4194304] 0 2024-02-28T16:26:52.489 INFO:tasks.workunit.client.0.smithi148.stdout:5/776: dread d1/f2f [0,4194304] 0 2024-02-28T16:26:52.492 INFO:tasks.workunit.client.0.smithi148.stdout:1/979: fsync d2/d5/d40/f53 0 2024-02-28T16:26:52.497 INFO:tasks.workunit.client.0.smithi148.stdout:8/916: dread d1/f7 [0,4194304] 0 2024-02-28T16:26:52.503 INFO:tasks.workunit.client.0.smithi148.stdout:5/777: mkdir d1/db/d60/d7a/d87/de0/dee 0 2024-02-28T16:26:52.504 INFO:tasks.workunit.client.0.smithi148.stdout:1/980: creat d2/d3f/dcf/d75/d76/f134 x:0 0 0 2024-02-28T16:26:52.511 INFO:tasks.workunit.client.0.smithi148.stdout:9/937: dwrite d7/f17 [0,4194304] 0 2024-02-28T16:26:52.512 INFO:tasks.workunit.client.0.smithi148.stdout:6/817: dread d0/d22/d49/f5a [0,4194304] 0 2024-02-28T16:26:52.514 INFO:tasks.workunit.client.0.smithi148.stdout:5/778: creat d1/d8/d23/fef x:0 0 0 2024-02-28T16:26:52.516 INFO:tasks.workunit.client.0.smithi148.stdout:2/870: dwrite d0/d1c/dcc/d10e/f53 [0,4194304] 0 2024-02-28T16:26:52.516 INFO:tasks.workunit.client.0.smithi148.stdout:9/938: readlink d7/dd/lf 0 2024-02-28T16:26:52.521 INFO:tasks.workunit.client.0.smithi148.stdout:1/981: mkdir d2/d25/d10b/d10c/d135 0 2024-02-28T16:26:52.521 INFO:tasks.workunit.client.0.smithi148.stdout:2/871: stat d0/dd/c1b 0 2024-02-28T16:26:52.521 INFO:tasks.workunit.client.0.smithi148.stdout:6/818: creat d0/d22/d49/d88/d107/f10c x:0 0 0 2024-02-28T16:26:52.526 INFO:tasks.workunit.client.0.smithi148.stdout:3/890: dwrite d1/db/d45/f4d [0,4194304] 0 2024-02-28T16:26:52.526 INFO:tasks.workunit.client.0.smithi148.stdout:9/939: unlink d7/c6c 0 2024-02-28T16:26:52.526 INFO:tasks.workunit.client.0.smithi148.stdout:4/677: dread d8/d40/dc3/dd3/f4a [0,4194304] 0 2024-02-28T16:26:52.526 INFO:tasks.workunit.client.0.smithi148.stdout:8/917: mknod d1/d3/d18/d48/d70/d75/d118/c12e 0 2024-02-28T16:26:52.527 INFO:tasks.workunit.client.0.smithi148.stdout:2/872: unlink d0/d1d/d52/fce 0 2024-02-28T16:26:52.532 INFO:tasks.workunit.client.0.smithi148.stdout:5/779: rename d1/d44/d64 to d1/db/d60/df0 0 2024-02-28T16:26:52.537 INFO:tasks.workunit.client.0.smithi148.stdout:5/780: fdatasync d1/f94 0 2024-02-28T16:26:52.542 INFO:tasks.workunit.client.0.smithi148.stdout:8/918: rename d1/d3/l86 to d1/dd/d13/d1a/d33/l12f 0 2024-02-28T16:26:52.547 INFO:tasks.workunit.client.0.smithi148.stdout:2/873: mkdir d0/d9/d118 0 2024-02-28T16:26:52.548 INFO:tasks.workunit.client.0.smithi148.stdout:3/891: mkdir d1/d3f/da5/da9/dc4/d103 0 2024-02-28T16:26:52.548 INFO:tasks.workunit.client.0.smithi148.stdout:5/781: symlink d1/db/d60/d7a/d87/lf1 0 2024-02-28T16:26:52.552 INFO:tasks.workunit.client.0.smithi148.stdout:4/678: rename d8/d40/dc3/dd3/fca to d8/d21/d3d/d4d/d95/fe5 0 2024-02-28T16:26:52.554 INFO:tasks.workunit.client.0.smithi148.stdout:6/819: dwrite d0/d22/d49/d88/d107/f10c [0,4194304] 0 2024-02-28T16:26:52.555 INFO:tasks.workunit.client.0.smithi148.stdout:8/919: symlink d1/d3/d18/d120/d126/d55/l130 0 2024-02-28T16:26:52.555 INFO:tasks.workunit.client.0.smithi148.stdout:3/892: chown d1/d13/d19/d32/d9e/dfa 4047091 1 2024-02-28T16:26:52.557 INFO:tasks.workunit.client.0.smithi148.stdout:6/820: chown d0/d22/fa6 111256 1 2024-02-28T16:26:52.559 INFO:tasks.workunit.client.0.smithi148.stdout:5/782: fdatasync d1/d8/d20/dd8/f56 0 2024-02-28T16:26:52.562 INFO:tasks.workunit.client.0.smithi148.stdout:4/679: fsync d8/d40/dc3/dd3/f34 0 2024-02-28T16:26:52.563 INFO:tasks.workunit.client.0.smithi148.stdout:5/783: write d1/db/d25/f69 [1504161,59892] 0 2024-02-28T16:26:52.565 INFO:tasks.workunit.client.0.smithi148.stdout:8/920: creat d1/d3/d18/d120/f131 x:0 0 0 2024-02-28T16:26:52.567 INFO:tasks.workunit.client.0.smithi148.stdout:6/821: mkdir d0/d8/d21/d9d/d10d 0 2024-02-28T16:26:52.569 INFO:tasks.workunit.client.0.smithi148.stdout:8/921: stat d1/d3/d9a 0 2024-02-28T16:26:52.570 INFO:tasks.workunit.client.0.smithi148.stdout:2/874: rename d0/d66/d76/lf9 to d0/d66/dd4/l119 0 2024-02-28T16:26:52.570 INFO:tasks.workunit.client.0.smithi148.stdout:4/680: chown d8/d40/dc3/dd3/d17/f1d 0 1 2024-02-28T16:26:52.575 INFO:tasks.workunit.client.0.smithi148.stdout:3/893: mknod d1/d13/d19/d56/d5b/de9/c104 0 2024-02-28T16:26:52.576 INFO:tasks.workunit.client.0.smithi148.stdout:2/875: truncate d0/d9/d13/f80 966714 0 2024-02-28T16:26:52.577 INFO:tasks.workunit.client.0.smithi148.stdout:1/982: dread d2/d5/d40/d7/f38 [0,4194304] 0 2024-02-28T16:26:52.578 INFO:tasks.workunit.client.0.smithi148.stdout:5/784: chown d1/db/d60/d7a/c9a 10961230 1 2024-02-28T16:26:52.579 INFO:tasks.workunit.client.0.smithi148.stdout:6/822: creat d0/d22/d49/f10e x:0 0 0 2024-02-28T16:26:52.579 INFO:tasks.workunit.client.0.smithi148.stdout:9/940: dwrite d7/f93 [0,4194304] 0 2024-02-28T16:26:52.580 INFO:tasks.workunit.client.0.smithi148.stdout:8/922: rmdir d1/dd/d13 39 2024-02-28T16:26:52.581 INFO:tasks.workunit.client.0.smithi148.stdout:2/876: write d0/d66/fd8 [626297,122831] 0 2024-02-28T16:26:52.583 INFO:tasks.workunit.client.0.smithi148.stdout:4/681: mknod d8/d21/d7e/ce6 0 2024-02-28T16:26:52.588 INFO:tasks.workunit.client.0.smithi148.stdout:3/894: mknod d1/d13/d19/d32/d9e/c105 0 2024-02-28T16:26:52.593 INFO:tasks.workunit.client.0.smithi148.stdout:8/923: fsync d1/d3/d18/d120/d126/f32 0 2024-02-28T16:26:52.593 INFO:tasks.workunit.client.0.smithi148.stdout:6/823: truncate d0/d8/dfd/f109 690061 0 2024-02-28T16:26:52.599 INFO:tasks.workunit.client.0.smithi148.stdout:4/682: symlink d8/d21/d3d/d8c/le7 0 2024-02-28T16:26:52.602 INFO:tasks.workunit.client.0.smithi148.stdout:5/785: rmdir d1/d8/d20/d4e/d71/dd5 0 2024-02-28T16:26:52.605 INFO:tasks.workunit.client.0.smithi148.stdout:5/786: dread - d1/d8/d20/d4e/d71/f73 zero size 2024-02-28T16:26:52.606 INFO:tasks.workunit.client.0.smithi148.stdout:6/824: mkdir d0/d22/d49/dae/d10f 0 2024-02-28T16:26:52.611 INFO:tasks.workunit.client.0.smithi148.stdout:9/941: dread d7/faf [0,4194304] 0 2024-02-28T16:26:52.614 INFO:tasks.workunit.client.0.smithi148.stdout:3/895: rename d1/d13/d19/d88/f8c to d1/db/f106 0 2024-02-28T16:26:52.618 INFO:tasks.workunit.client.0.smithi148.stdout:9/942: read d7/d1c/d1f/d49/d5c/f133 [2173850,77868] 0 2024-02-28T16:26:52.620 INFO:tasks.workunit.client.0.smithi148.stdout:8/924: rename d1/dd/d13/d24/l2a to d1/d3/d18/d120/d126/l132 0 2024-02-28T16:26:52.623 INFO:tasks.workunit.client.0.smithi148.stdout:3/896: mknod d1/d13/d19/d56/d5b/c107 0 2024-02-28T16:26:52.633 INFO:tasks.workunit.client.0.smithi148.stdout:6/825: getdents d0/d8/dfd 0 2024-02-28T16:26:52.644 INFO:tasks.workunit.client.0.smithi148.stdout:4/683: dwrite d8/d21/f56 [4194304,4194304] 0 2024-02-28T16:26:52.645 INFO:tasks.workunit.client.0.smithi148.stdout:3/897: rename d1/d13/d19/d94/db6 to d1/db/d35/d70/d9c/d108 0 2024-02-28T16:26:52.649 INFO:tasks.workunit.client.0.smithi148.stdout:1/983: dwrite d2/d5/d40/d7/fa4 [0,4194304] 0 2024-02-28T16:26:52.652 INFO:tasks.workunit.client.0.smithi148.stdout:5/787: dread d1/db/d60/df0/f9c [0,4194304] 0 2024-02-28T16:26:52.656 INFO:tasks.workunit.client.0.smithi148.stdout:2/877: dwrite d0/d1c/f4e [0,4194304] 0 2024-02-28T16:26:52.660 INFO:tasks.workunit.client.0.smithi148.stdout:6/826: symlink d0/d22/d27/l110 0 2024-02-28T16:26:52.660 INFO:tasks.workunit.client.0.smithi148.stdout:6/827: chown d0/d22 11 1 2024-02-28T16:26:52.660 INFO:tasks.workunit.client.0.smithi148.stdout:2/878: chown d0/d18/d20/f92 254 1 2024-02-28T16:26:52.667 INFO:tasks.workunit.client.0.smithi148.stdout:3/898: creat d1/db/d35/d70/d8e/f109 x:0 0 0 2024-02-28T16:26:52.671 INFO:tasks.workunit.client.0.smithi148.stdout:8/925: link d1/dd/d13/d1a/fcf d1/d3/d18/d48/f133 0 2024-02-28T16:26:52.674 INFO:tasks.workunit.client.0.smithi148.stdout:6/828: creat d0/d22/d27/d66/d87/dc6/f111 x:0 0 0 2024-02-28T16:26:52.677 INFO:tasks.workunit.client.0.smithi148.stdout:5/788: unlink d1/db/d60/d7a/d87/ce4 0 2024-02-28T16:26:52.682 INFO:tasks.workunit.client.0.smithi148.stdout:1/984: dwrite d2/d3f/dcf/d75/d76/fd3 [0,4194304] 0 2024-02-28T16:26:52.687 INFO:tasks.workunit.client.0.smithi148.stdout:6/829: fsync d0/d22/fc1 0 2024-02-28T16:26:52.687 INFO:tasks.workunit.client.0.smithi148.stdout:8/926: chown d1/d3/d18/d48/d70/cb0 1065928209 1 2024-02-28T16:26:52.691 INFO:tasks.workunit.client.0.smithi148.stdout:4/684: getdents d8/d21/d3d/d4d/d66/dad 0 2024-02-28T16:26:52.691 INFO:tasks.workunit.client.0.smithi148.stdout:9/943: dwrite d7/d1c/d3d/f61 [0,4194304] 0 2024-02-28T16:26:52.691 INFO:tasks.workunit.client.0.smithi148.stdout:5/789: mknod d1/db/d60/df0/d63/cf2 0 2024-02-28T16:26:52.694 INFO:tasks.workunit.client.0.smithi148.stdout:4/685: stat d8/d37 0 2024-02-28T16:26:52.697 INFO:tasks.workunit.client.0.smithi148.stdout:9/944: dread - d7/d1c/d74/f53 zero size 2024-02-28T16:26:52.698 INFO:tasks.workunit.client.0.smithi148.stdout:2/879: getdents d0/d1c/d49 0 2024-02-28T16:26:52.700 INFO:tasks.workunit.client.0.smithi148.stdout:2/880: readlink d0/d9/l97 0 2024-02-28T16:26:52.705 INFO:tasks.workunit.client.0.smithi148.stdout:4/686: rename d8/d37/la0 to d8/d21/d3d/le8 0 2024-02-28T16:26:52.708 INFO:tasks.workunit.client.0.smithi148.stdout:5/790: mknod d1/d8/cf3 0 2024-02-28T16:26:52.713 INFO:tasks.workunit.client.0.smithi148.stdout:2/881: rmdir d0/d18/d20/dd3 39 2024-02-28T16:26:52.716 INFO:tasks.workunit.client.0.smithi148.stdout:1/985: dwrite d2/d3f/fa0 [4194304,4194304] 0 2024-02-28T16:26:52.721 INFO:tasks.workunit.client.0.smithi148.stdout:6/830: dwrite d0/d8/ff [0,4194304] 0 2024-02-28T16:26:52.723 INFO:tasks.workunit.client.0.smithi148.stdout:1/986: chown d2/d3f/fac 272 1 2024-02-28T16:26:52.723 INFO:tasks.workunit.client.0.smithi148.stdout:4/687: unlink d8/d21/d3d/d4d/f5c 0 2024-02-28T16:26:52.728 INFO:tasks.workunit.client.0.smithi148.stdout:9/945: mknod d7/d1c/c142 0 2024-02-28T16:26:52.733 INFO:tasks.workunit.client.0.smithi148.stdout:5/791: rename d1/db/f49 to d1/d8/d20/dd8/ff4 0 2024-02-28T16:26:52.733 INFO:tasks.workunit.client.0.smithi148.stdout:8/927: dread d1/d3/d18/d48/d70/d75/d91/dcc/ddf/f9e [0,4194304] 0 2024-02-28T16:26:52.739 INFO:tasks.workunit.client.0.smithi148.stdout:3/899: write d1/d13/d19/f28 [9260813,664] 0 2024-02-28T16:26:52.739 INFO:tasks.workunit.client.0.smithi148.stdout:1/987: creat d2/d15/d33/f136 x:0 0 0 2024-02-28T16:26:52.742 INFO:tasks.workunit.client.0.smithi148.stdout:5/792: creat d1/db/d25/ff5 x:0 0 0 2024-02-28T16:26:52.750 INFO:tasks.workunit.client.0.smithi148.stdout:8/928: symlink d1/d3/d18/d48/d70/d75/d84/da4/l134 0 2024-02-28T16:26:52.751 INFO:tasks.workunit.client.0.smithi148.stdout:5/793: unlink d1/l17 0 2024-02-28T16:26:52.752 INFO:tasks.workunit.client.0.smithi148.stdout:6/831: getdents d0/d22/d27/d66/d87/dc6 0 2024-02-28T16:26:52.754 INFO:tasks.workunit.client.0.smithi148.stdout:8/929: chown d1/d3/d18/d48/d70/d75/d91/dcc/ddf/df5/f10c 23497577 1 2024-02-28T16:26:52.755 INFO:tasks.workunit.client.0.smithi148.stdout:1/988: mknod d2/d15/d8b/c137 0 2024-02-28T16:26:52.761 INFO:tasks.workunit.client.0.smithi148.stdout:4/688: write d8/d21/fc4 [259699,57551] 0 2024-02-28T16:26:52.763 INFO:tasks.workunit.client.0.smithi148.stdout:6/832: creat d0/d8/f112 x:0 0 0 2024-02-28T16:26:52.764 INFO:tasks.workunit.client.0.smithi148.stdout:8/930: truncate d1/dd/f104 1697837 0 2024-02-28T16:26:52.765 INFO:tasks.workunit.client.0.smithi148.stdout:5/794: creat d1/d8/d20/ff6 x:0 0 0 2024-02-28T16:26:52.768 INFO:tasks.workunit.client.0.smithi148.stdout:5/795: chown d1/d8/d20/ff6 5 1 2024-02-28T16:26:52.768 INFO:tasks.workunit.client.0.smithi148.stdout:6/833: symlink d0/d8/d21/d9d/l113 0 2024-02-28T16:26:52.770 INFO:tasks.workunit.client.0.smithi148.stdout:3/900: dwrite d1/db/d35/d70/d8e/f109 [0,4194304] 0 2024-02-28T16:26:52.771 INFO:tasks.workunit.client.0.smithi148.stdout:6/834: read d0/d22/d49/f5a [1188386,55558] 0 2024-02-28T16:26:52.773 INFO:tasks.workunit.client.0.smithi148.stdout:3/901: chown d1/d13/d19/d32/f37 46101 1 2024-02-28T16:26:52.774 INFO:tasks.workunit.client.0.smithi148.stdout:6/835: mkdir d0/d22/d25/d114 0 2024-02-28T16:26:52.777 INFO:tasks.workunit.client.0.smithi148.stdout:8/931: link d1/d3/d18/d48/d70/f8c d1/dd/d13/f135 0 2024-02-28T16:26:52.779 INFO:tasks.workunit.client.0.smithi148.stdout:1/989: dwrite d2/d15/d33/f63 [0,4194304] 0 2024-02-28T16:26:52.784 INFO:tasks.workunit.client.0.smithi148.stdout:1/990: truncate d2/d15/d8b/da3/f10e 132438 0 2024-02-28T16:26:52.784 INFO:tasks.workunit.client.0.smithi148.stdout:3/902: truncate d1/d13/d19/d1b/d38/f43 781484 0 2024-02-28T16:26:52.787 INFO:tasks.workunit.client.0.smithi148.stdout:1/991: fsync d2/d5/f95 0 2024-02-28T16:26:52.795 INFO:tasks.workunit.client.0.smithi148.stdout:3/903: rename d1/db/d35/d70/d9c/d108/dd8/dfe to d1/d13/d19/d1b/d10a 0 2024-02-28T16:26:52.796 INFO:tasks.workunit.client.0.smithi148.stdout:1/992: mknod d2/d3f/d46/c138 0 2024-02-28T16:26:52.799 INFO:tasks.workunit.client.0.smithi148.stdout:1/993: stat d2/d3f/d46/lbb 0 2024-02-28T16:26:52.804 INFO:tasks.workunit.client.0.smithi148.stdout:8/932: unlink d1/dd/d13/d1a/c38 0 2024-02-28T16:26:52.806 INFO:tasks.workunit.client.0.smithi148.stdout:1/994: mkdir d2/d3f/d9d/d139 0 2024-02-28T16:26:52.808 INFO:tasks.workunit.client.0.smithi148.stdout:1/995: read - d2/d5/d40/d8/dcd/ff8 zero size 2024-02-28T16:26:52.813 INFO:tasks.workunit.client.0.smithi148.stdout:3/904: dwrite d1/d13/d19/d1b/d38/fca [0,4194304] 0 2024-02-28T16:26:52.816 INFO:tasks.workunit.client.0.smithi148.stdout:1/996: rename d2/d15/d8b/da3/dc2/cce to d2/d3f/d9d/c13a 0 2024-02-28T16:26:52.823 INFO:tasks.workunit.client.0.smithi148.stdout:8/933: dwrite d1/da7/f12c [0,4194304] 0 2024-02-28T16:26:52.826 INFO:tasks.workunit.client.0.smithi148.stdout:1/997: symlink d2/d15/d33/l13b 0 2024-02-28T16:26:52.829 INFO:tasks.workunit.client.0.smithi148.stdout:1/998: stat d2/d5/d40/d7/d91/d120 0 2024-02-28T16:26:52.831 INFO:tasks.workunit.client.0.smithi148.stdout:1/999: readlink d2/d15/d83/d89/daa/le5 0 2024-02-28T16:26:52.845 INFO:tasks.workunit.client.0.smithi148.stdout:3/905: dwrite d1/db/d35/d70/d8e/fb7 [4194304,4194304] 0 2024-02-28T16:26:52.852 INFO:tasks.workunit.client.0.smithi148.stdout:3/906: rename d1/d3f/da5/dda/fba to d1/d3f/da5/da9/dc4/d103/f10b 0 2024-02-28T16:26:52.856 INFO:tasks.workunit.client.0.smithi148.stdout:3/907: truncate d1/db/d45/d80/fc8 256804 0 2024-02-28T16:26:52.858 INFO:tasks.workunit.client.0.smithi148.stdout:3/908: write d1/db/d35/d70/d9c/fe4 [472987,130815] 0 2024-02-28T16:26:52.865 INFO:tasks.workunit.client.0.smithi148.stdout:3/909: dread d1/d13/d19/fb8 [0,4194304] 0 2024-02-28T16:26:52.867 INFO:tasks.workunit.client.0.smithi148.stdout:3/910: stat d1/d13/d19/d32/d9e/dfa/l8f 0 2024-02-28T16:26:52.871 INFO:tasks.workunit.client.0.smithi148.stdout:3/911: mkdir d1/d3f/da5/da9/dc4/d103/d10c 0 2024-02-28T16:26:52.872 INFO:tasks.workunit.client.0.smithi148.stdout:8/934: dread d1/dd/d13/d1a/d25/d50/fca [0,4194304] 0 2024-02-28T16:26:52.876 INFO:tasks.workunit.client.0.smithi148.stdout:3/912: unlink d1/db/d35/d70/d8e/f109 0 2024-02-28T16:26:52.878 INFO:tasks.workunit.client.0.smithi148.stdout:3/913: chown d1/d3f/da5/da9/dc4/d103 373 1 2024-02-28T16:26:52.878 INFO:tasks.workunit.client.0.smithi148.stdout:8/935: creat d1/dd/d51/f136 x:0 0 0 2024-02-28T16:26:52.880 INFO:tasks.workunit.client.0.smithi148.stdout:3/914: write d1/db/d35/d70/fd3 [851804,78230] 0 2024-02-28T16:26:52.884 INFO:tasks.workunit.client.0.smithi148.stdout:3/915: mknod d1/d13/d19/d1b/c10d 0 2024-02-28T16:26:52.889 INFO:tasks.workunit.client.0.smithi148.stdout:3/916: truncate d1/db/f106 1108031 0 2024-02-28T16:26:52.889 INFO:tasks.workunit.client.0.smithi148.stdout:8/936: link d1/dd/d13/d1a/f3f d1/d3/d18/d120/d126/d34/dbc/f137 0 2024-02-28T16:26:52.897 INFO:tasks.workunit.client.0.smithi148.stdout:3/917: dread d1/d13/d19/d1b/d38/f82 [4194304,4194304] 0 2024-02-28T16:26:52.900 INFO:tasks.workunit.client.0.smithi148.stdout:3/918: read d1/d13/f17 [8204165,52024] 0 2024-02-28T16:26:52.903 INFO:tasks.workunit.client.0.smithi148.stdout:3/919: mkdir d1/db/d10e 0 2024-02-28T16:26:52.906 INFO:tasks.workunit.client.0.smithi148.stdout:3/920: rmdir d1/d13/d19/d1b/d38/d9b 39 2024-02-28T16:26:52.908 INFO:tasks.workunit.client.0.smithi148.stdout:3/921: fdatasync d1/db/d35/f6b 0 2024-02-28T16:26:52.910 INFO:tasks.workunit.client.0.smithi148.stdout:3/922: mkdir d1/db/d35/d70/d10f 0 2024-02-28T16:26:52.916 INFO:tasks.workunit.client.0.smithi148.stdout:8/937: dread d1/d3/d18/d120/d126/d55/f6a [0,4194304] 0 2024-02-28T16:26:52.938 INFO:tasks.workunit.client.0.smithi148.stdout:7/790: sync 2024-02-28T16:26:52.949 INFO:tasks.workunit.client.0.smithi148.stdout:8/938: dwrite d1/d3/d18/d48/d70/d75/d91/dcc/ddf/f9e [0,4194304] 0 2024-02-28T16:26:52.949 INFO:tasks.workunit.client.0.smithi148.stdout:3/923: dwrite d1/d13/d19/d1b/d38/f43 [0,4194304] 0 2024-02-28T16:26:52.949 INFO:tasks.workunit.client.0.smithi148.stdout:3/924: stat d1/d13 0 2024-02-28T16:26:52.956 INFO:tasks.workunit.client.0.smithi148.stdout:3/925: write d1/d13/d19/d1b/d38/f8a [498862,108997] 0 2024-02-28T16:26:52.958 INFO:tasks.workunit.client.0.smithi148.stdout:8/939: write d1/dd/d51/d9b/dc6/ff1 [291124,60993] 0 2024-02-28T16:26:52.960 INFO:tasks.workunit.client.0.smithi148.stdout:3/926: chown d1/lb3 675 1 2024-02-28T16:26:52.960 INFO:tasks.workunit.client.0.smithi148.stdout:7/791: dwrite d0/d9/d4c/f6b [0,4194304] 0 2024-02-28T16:26:52.965 INFO:tasks.workunit.client.0.smithi148.stdout:3/927: creat d1/d13/d19/d1b/dd9/f110 x:0 0 0 2024-02-28T16:26:52.965 INFO:tasks.workunit.client.0.smithi148.stdout:7/792: rmdir d0/d9/d25/d96/ddf/d28/d2b 39 2024-02-28T16:26:52.969 INFO:tasks.workunit.client.0.smithi148.stdout:7/793: read d0/d9/d25/d39/f54 [132190,80090] 0 2024-02-28T16:26:52.975 INFO:tasks.workunit.client.0.smithi148.stdout:3/928: rmdir d1/d13/d19/d1b/d38/d9b/d100 0 2024-02-28T16:26:52.977 INFO:tasks.workunit.client.0.smithi148.stdout:7/794: creat d0/dd5/de2/dec/ff3 x:0 0 0 2024-02-28T16:26:52.982 INFO:tasks.workunit.client.0.smithi148.stdout:7/795: symlink d0/d9/d25/d96/ddf/d1c/d32/lf4 0 2024-02-28T16:26:52.984 INFO:tasks.workunit.client.0.smithi148.stdout:7/796: chown d0/d9/d25/d96/ddf/f27 3103768 1 2024-02-28T16:26:52.987 INFO:tasks.workunit.client.0.smithi148.stdout:7/797: creat d0/d9/d4c/ff5 x:0 0 0 2024-02-28T16:26:52.987 INFO:tasks.workunit.client.0.smithi148.stdout:8/940: dread d1/dd/d51/d9b/dc6/ff1 [0,4194304] 0 2024-02-28T16:26:52.989 INFO:tasks.workunit.client.0.smithi148.stdout:8/941: write d1/d3/f20 [2716574,76656] 0 2024-02-28T16:26:52.993 INFO:tasks.workunit.client.0.smithi148.stdout:8/942: fsync d1/dd/d13/d1a/d25/fa6 0 2024-02-28T16:26:52.994 INFO:tasks.workunit.client.0.smithi148.stdout:3/929: dwrite d1/d13/f1e [0,4194304] 0 2024-02-28T16:26:53.002 INFO:tasks.workunit.client.0.smithi148.stdout:3/930: creat d1/d13/d19/d56/d5b/de9/f111 x:0 0 0 2024-02-28T16:26:53.005 INFO:tasks.workunit.client.0.smithi148.stdout:8/943: write d1/dd/d13/d1a/f4b [6871997,92322] 0 2024-02-28T16:26:53.058 INFO:tasks.workunit.client.0.smithi148.stdout:3/931: truncate d1/d13/d19/d1b/d38/f82 1318705 0 2024-02-28T16:26:53.060 INFO:tasks.workunit.client.0.smithi148.stdout:8/944: mkdir d1/d3/d18/d120/d138 0 2024-02-28T16:26:53.063 INFO:tasks.workunit.client.0.smithi148.stdout:3/932: mknod d1/d3f/da5/da9/dc4/d103/c112 0 2024-02-28T16:26:53.065 INFO:tasks.workunit.client.0.smithi148.stdout:8/945: mknod d1/d3/d18/d48/d70/d75/d91/dcc/c139 0 2024-02-28T16:26:53.078 INFO:tasks.workunit.client.1.smithi157.stderr:++ readlink -f fsstress 2024-02-28T16:26:53.079 INFO:tasks.workunit.client.0.smithi148.stdout:3/933: rename d1/d3f/da5/da9/dc4 to d1/d13/d19/d1b/d38/d113 0 2024-02-28T16:26:53.084 INFO:tasks.workunit.client.1.smithi157.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T16:26:53.084 INFO:tasks.workunit.client.1.smithi157.stderr:+ popd 2024-02-28T16:26:53.085 INFO:tasks.workunit.client.0.smithi148.stdout:3/934: fdatasync d1/d13/d19/d32/d9e/dfa/f84 0 2024-02-28T16:26:53.089 INFO:tasks.workunit.client.1.smithi157.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:26:53.089 INFO:tasks.workunit.client.1.smithi157.stderr:+ popd 2024-02-28T16:26:53.093 INFO:tasks.workunit.client.1.smithi157.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-28T16:26:53.095 INFO:tasks.workunit.client.1.smithi157.stderr:++ mktemp -d -p . 2024-02-28T16:26:53.098 INFO:tasks.workunit.client.0.smithi148.stdout:8/946: dread d1/dd/d13/d24/d3a/f59 [0,4194304] 0 2024-02-28T16:26:53.101 INFO:tasks.workunit.client.1.smithi157.stderr:+ T=./tmp.Zusj4b4ANZ 2024-02-28T16:26:53.101 INFO:tasks.workunit.client.1.smithi157.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.Zusj4b4ANZ -l 1 -n 1000 -p 10 -v 2024-02-28T16:26:53.105 INFO:tasks.workunit.client.0.smithi148.stdout:8/947: getdents d1/d3/d18/d48/d70/d75/d118 0 2024-02-28T16:26:53.108 INFO:tasks.workunit.client.0.smithi148.stdout:8/948: write d1/dd/d51/d9b/fd6 [5324756,117220] 0 2024-02-28T16:26:53.111 INFO:tasks.workunit.client.0.smithi148.stdout:8/949: fsync d1/dd/d13/d24/d3a/d49/f9f 0 2024-02-28T16:26:53.115 INFO:tasks.workunit.client.1.smithi157.stdout:seed = 1709092366 2024-02-28T16:26:53.125 INFO:tasks.workunit.client.1.smithi157.stdout:0/0: chown . 387758 1 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/1: chown . 0 1 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/2: dread - no filename 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/3: rmdir - no directory 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/4: truncate - no filename 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/5: dwrite - no filename 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/6: link - no file 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/7: dread - no filename 2024-02-28T16:26:53.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/8: chown . 1202576 1 2024-02-28T16:26:53.129 INFO:tasks.workunit.client.1.smithi157.stdout:0/9: mkdir d0 0 2024-02-28T16:26:53.129 INFO:tasks.workunit.client.1.smithi157.stdout:0/10: write - no filename 2024-02-28T16:26:53.129 INFO:tasks.workunit.client.1.smithi157.stdout:0/11: write - no filename 2024-02-28T16:26:53.132 INFO:tasks.workunit.client.0.smithi148.stdout:8/950: dwrite d1/d3/d18/d120/f131 [0,4194304] 0 2024-02-28T16:26:53.133 INFO:tasks.workunit.client.1.smithi157.stdout:2/0: chown . 24005463 1 2024-02-28T16:26:53.135 INFO:tasks.workunit.client.1.smithi157.stdout:1/0: mknod c0 0 2024-02-28T16:26:53.135 INFO:tasks.workunit.client.1.smithi157.stdout:1/1: write - no filename 2024-02-28T16:26:53.136 INFO:tasks.workunit.client.1.smithi157.stdout:1/2: write - no filename 2024-02-28T16:26:53.136 INFO:tasks.workunit.client.1.smithi157.stdout:1/3: dwrite - no filename 2024-02-28T16:26:53.138 INFO:tasks.workunit.client.1.smithi157.stdout:3/0: truncate - no filename 2024-02-28T16:26:53.138 INFO:tasks.workunit.client.1.smithi157.stdout:3/1: dwrite - no filename 2024-02-28T16:26:53.138 INFO:tasks.workunit.client.1.smithi157.stdout:3/2: write - no filename 2024-02-28T16:26:53.138 INFO:tasks.workunit.client.1.smithi157.stdout:3/3: link - no file 2024-02-28T16:26:53.138 INFO:tasks.workunit.client.1.smithi157.stdout:3/4: link - no file 2024-02-28T16:26:53.142 INFO:tasks.workunit.client.1.smithi157.stdout:1/4: symlink l1 0 2024-02-28T16:26:53.144 INFO:tasks.workunit.client.1.smithi157.stdout:1/5: chown l1 1001451 1 2024-02-28T16:26:53.144 INFO:tasks.workunit.client.1.smithi157.stdout:1/6: dwrite - no filename 2024-02-28T16:26:53.144 INFO:tasks.workunit.client.1.smithi157.stdout:1/7: dread - no filename 2024-02-28T16:26:53.144 INFO:tasks.workunit.client.1.smithi157.stdout:1/8: dread - no filename 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:2/1: symlink l0 0 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/12: rmdir d0 0 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/13: fsync - no filename 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/14: write - no filename 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/15: dread - no filename 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/16: dwrite - no filename 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/17: fdatasync - no filename 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/18: link - no file 2024-02-28T16:26:53.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/19: write - no filename 2024-02-28T16:26:53.146 INFO:tasks.workunit.client.1.smithi157.stdout:0/20: dread - no filename 2024-02-28T16:26:53.146 INFO:tasks.workunit.client.1.smithi157.stdout:0/21: rename - no filename 2024-02-28T16:26:53.146 INFO:tasks.workunit.client.1.smithi157.stdout:0/22: fdatasync - no filename 2024-02-28T16:26:53.146 INFO:tasks.workunit.client.1.smithi157.stdout:0/23: chown . 80 1 2024-02-28T16:26:53.146 INFO:tasks.workunit.client.1.smithi157.stdout:3/5: mkdir d0 0 2024-02-28T16:26:53.147 INFO:tasks.workunit.client.1.smithi157.stdout:1/9: creat f2 x:0 0 0 2024-02-28T16:26:53.148 INFO:tasks.workunit.client.1.smithi157.stdout:5/0: dread - no filename 2024-02-28T16:26:53.148 INFO:tasks.workunit.client.1.smithi157.stdout:5/1: write - no filename 2024-02-28T16:26:53.148 INFO:tasks.workunit.client.1.smithi157.stdout:2/2: mknod c1 0 2024-02-28T16:26:53.148 INFO:tasks.workunit.client.1.smithi157.stdout:0/24: mkdir d1 0 2024-02-28T16:26:53.149 INFO:tasks.workunit.client.1.smithi157.stdout:0/25: dwrite - no filename 2024-02-28T16:26:53.149 INFO:tasks.workunit.client.1.smithi157.stdout:0/26: truncate - no filename 2024-02-28T16:26:53.149 INFO:tasks.workunit.client.1.smithi157.stdout:2/3: stat l0 0 2024-02-28T16:26:53.150 INFO:tasks.workunit.client.1.smithi157.stdout:1/10: symlink l3 0 2024-02-28T16:26:53.151 INFO:tasks.workunit.client.1.smithi157.stdout:6/0: chown . 0 1 2024-02-28T16:26:53.151 INFO:tasks.workunit.client.1.smithi157.stdout:4/0: mknod c0 0 2024-02-28T16:26:53.152 INFO:tasks.workunit.client.1.smithi157.stdout:3/6: mknod d0/c1 0 2024-02-28T16:26:53.152 INFO:tasks.workunit.client.1.smithi157.stdout:3/7: stat d0 0 2024-02-28T16:26:53.152 INFO:tasks.workunit.client.1.smithi157.stdout:3/8: dread - no filename 2024-02-28T16:26:53.153 INFO:tasks.workunit.client.1.smithi157.stdout:2/4: mknod c2 0 2024-02-28T16:26:53.153 INFO:tasks.workunit.client.1.smithi157.stdout:2/5: read - no filename 2024-02-28T16:26:53.154 INFO:tasks.workunit.client.1.smithi157.stdout:5/2: mkdir d0 0 2024-02-28T16:26:53.154 INFO:tasks.workunit.client.1.smithi157.stdout:5/3: dread - no filename 2024-02-28T16:26:53.154 INFO:tasks.workunit.client.1.smithi157.stdout:5/4: fdatasync - no filename 2024-02-28T16:26:53.155 INFO:tasks.workunit.client.1.smithi157.stdout:1/11: creat f4 x:0 0 0 2024-02-28T16:26:53.156 INFO:tasks.workunit.client.1.smithi157.stdout:2/6: chown c2 19 1 2024-02-28T16:26:53.156 INFO:tasks.workunit.client.1.smithi157.stdout:0/27: creat d1/f2 x:0 0 0 2024-02-28T16:26:53.157 INFO:tasks.workunit.client.1.smithi157.stdout:3/9: rmdir d0 39 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/1: getdents . 0 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/2: link - no file 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/3: truncate - no filename 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/4: dread - no filename 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/5: dwrite - no filename 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/6: readlink - no filename 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/7: dwrite - no filename 2024-02-28T16:26:53.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/8: dwrite - no filename 2024-02-28T16:26:53.159 INFO:tasks.workunit.client.1.smithi157.stdout:2/7: chown c2 582 1 2024-02-28T16:26:53.159 INFO:tasks.workunit.client.1.smithi157.stdout:2/8: rmdir - no directory 2024-02-28T16:26:53.159 INFO:tasks.workunit.client.1.smithi157.stdout:5/5: symlink d0/l1 0 2024-02-28T16:26:53.162 INFO:tasks.workunit.client.1.smithi157.stdout:7/0: creat f0 x:0 0 0 2024-02-28T16:26:53.162 INFO:tasks.workunit.client.1.smithi157.stdout:7/1: readlink - no filename 2024-02-28T16:26:53.162 INFO:tasks.workunit.client.1.smithi157.stdout:0/28: mkdir d1/d3 0 2024-02-28T16:26:53.163 INFO:tasks.workunit.client.1.smithi157.stdout:2/9: mkdir d3 0 2024-02-28T16:26:53.163 INFO:tasks.workunit.client.1.smithi157.stdout:5/6: creat d0/f2 x:0 0 0 2024-02-28T16:26:53.165 INFO:tasks.workunit.client.1.smithi157.stdout:7/2: mknod c1 0 2024-02-28T16:26:53.166 INFO:tasks.workunit.client.1.smithi157.stdout:8/0: truncate - no filename 2024-02-28T16:26:53.166 INFO:tasks.workunit.client.1.smithi157.stdout:8/1: dread - no filename 2024-02-28T16:26:53.168 INFO:tasks.workunit.client.1.smithi157.stdout:5/7: write d0/f2 [327821,97612] 0 2024-02-28T16:26:53.169 INFO:tasks.workunit.client.0.smithi148.stdout:2/882: sync 2024-02-28T16:26:53.172 INFO:tasks.workunit.client.1.smithi157.stdout:9/0: chown . 1547190 1 2024-02-28T16:26:53.173 INFO:tasks.workunit.client.1.smithi157.stdout:9/1: dread - no filename 2024-02-28T16:26:53.173 INFO:tasks.workunit.client.1.smithi157.stdout:9/2: dwrite - no filename 2024-02-28T16:26:53.173 INFO:tasks.workunit.client.1.smithi157.stdout:9/3: rmdir - no directory 2024-02-28T16:26:53.176 INFO:tasks.workunit.client.0.smithi148.stdout:2/883: mknod d0/dd/c11a 0 2024-02-28T16:26:53.178 INFO:tasks.workunit.client.1.smithi157.stdout:5/8: dread d0/f2 [0,4194304] 0 2024-02-28T16:26:53.183 INFO:tasks.workunit.client.1.smithi157.stdout:2/10: rmdir d3 0 2024-02-28T16:26:53.183 INFO:tasks.workunit.client.1.smithi157.stdout:2/11: rmdir - no directory 2024-02-28T16:26:53.183 INFO:tasks.workunit.client.1.smithi157.stdout:2/12: read - no filename 2024-02-28T16:26:53.185 INFO:tasks.workunit.client.1.smithi157.stdout:8/2: symlink l0 0 2024-02-28T16:26:53.185 INFO:tasks.workunit.client.1.smithi157.stdout:8/3: rmdir - no directory 2024-02-28T16:26:53.187 INFO:tasks.workunit.client.1.smithi157.stdout:3/10: mknod d0/c2 0 2024-02-28T16:26:53.187 INFO:tasks.workunit.client.1.smithi157.stdout:3/11: write - no filename 2024-02-28T16:26:53.188 INFO:tasks.workunit.client.1.smithi157.stdout:9/4: mkdir d0 0 2024-02-28T16:26:53.190 INFO:tasks.workunit.client.1.smithi157.stdout:5/9: unlink d0/f2 0 2024-02-28T16:26:53.190 INFO:tasks.workunit.client.1.smithi157.stdout:1/12: dwrite f2 [0,4194304] 0 2024-02-28T16:26:53.193 INFO:tasks.workunit.client.1.smithi157.stdout:2/13: symlink l4 0 2024-02-28T16:26:53.193 INFO:tasks.workunit.client.1.smithi157.stdout:2/14: read - no filename 2024-02-28T16:26:53.194 INFO:tasks.workunit.client.1.smithi157.stdout:8/4: mkdir d1 0 2024-02-28T16:26:53.195 INFO:tasks.workunit.client.1.smithi157.stdout:0/29: fsync d1/f2 0 2024-02-28T16:26:53.195 INFO:tasks.workunit.client.1.smithi157.stdout:7/3: dwrite f0 [0,4194304] 0 2024-02-28T16:26:53.200 INFO:tasks.workunit.client.1.smithi157.stdout:3/12: rename d0/c1 to d0/c3 0 2024-02-28T16:26:53.200 INFO:tasks.workunit.client.1.smithi157.stdout:3/13: dread - no filename 2024-02-28T16:26:53.202 INFO:tasks.workunit.client.1.smithi157.stdout:9/5: creat d0/f1 x:0 0 0 2024-02-28T16:26:53.204 INFO:tasks.workunit.client.1.smithi157.stdout:9/6: dread - d0/f1 zero size 2024-02-28T16:26:53.214 INFO:tasks.workunit.client.1.smithi157.stdout:9/7: unlink d0/f1 0 2024-02-28T16:26:53.215 INFO:tasks.workunit.client.1.smithi157.stdout:0/30: link d1/f2 d1/f4 0 2024-02-28T16:26:53.216 INFO:tasks.workunit.client.1.smithi157.stdout:8/5: creat d1/f2 x:0 0 0 2024-02-28T16:26:53.217 INFO:tasks.workunit.client.1.smithi157.stdout:2/15: link c1 c5 0 2024-02-28T16:26:53.217 INFO:tasks.workunit.client.1.smithi157.stdout:2/16: fsync - no filename 2024-02-28T16:26:53.220 INFO:tasks.workunit.client.1.smithi157.stdout:9/8: creat d0/f2 x:0 0 0 2024-02-28T16:26:53.220 INFO:tasks.workunit.client.1.smithi157.stdout:5/10: rmdir d0 39 2024-02-28T16:26:53.221 INFO:tasks.workunit.client.1.smithi157.stdout:7/4: write f0 [4607966,26698] 0 2024-02-28T16:26:53.221 INFO:tasks.workunit.client.1.smithi157.stdout:8/6: write d1/f2 [407425,104952] 0 2024-02-28T16:26:53.223 INFO:tasks.workunit.client.1.smithi157.stdout:2/17: rename l4 to l6 0 2024-02-28T16:26:53.226 INFO:tasks.workunit.client.1.smithi157.stdout:0/31: mknod d1/d3/c5 0 2024-02-28T16:26:53.226 INFO:tasks.workunit.client.1.smithi157.stdout:7/5: write f0 [4178421,36915] 0 2024-02-28T16:26:53.228 INFO:tasks.workunit.client.1.smithi157.stdout:9/9: write d0/f2 [230243,122400] 0 2024-02-28T16:26:53.231 INFO:tasks.workunit.client.1.smithi157.stdout:2/18: rename l0 to l7 0 2024-02-28T16:26:53.231 INFO:tasks.workunit.client.1.smithi157.stdout:1/13: dwrite f2 [4194304,4194304] 0 2024-02-28T16:26:53.232 INFO:tasks.workunit.client.1.smithi157.stdout:8/7: dread d1/f2 [0,4194304] 0 2024-02-28T16:26:53.233 INFO:tasks.workunit.client.1.smithi157.stdout:5/11: creat d0/f3 x:0 0 0 2024-02-28T16:26:53.233 INFO:tasks.workunit.client.1.smithi157.stdout:1/14: read - f4 zero size 2024-02-28T16:26:53.234 INFO:tasks.workunit.client.1.smithi157.stdout:9/10: write d0/f2 [17666,3435] 0 2024-02-28T16:26:53.234 INFO:tasks.workunit.client.1.smithi157.stdout:8/8: chown d1 1349094 1 2024-02-28T16:26:53.237 INFO:tasks.workunit.client.1.smithi157.stdout:2/19: creat f8 x:0 0 0 2024-02-28T16:26:53.240 INFO:tasks.workunit.client.1.smithi157.stdout:1/15: creat f5 x:0 0 0 2024-02-28T16:26:53.241 INFO:tasks.workunit.client.1.smithi157.stdout:2/20: write f8 [208259,124770] 0 2024-02-28T16:26:53.242 INFO:tasks.workunit.client.1.smithi157.stdout:9/11: creat d0/f3 x:0 0 0 2024-02-28T16:26:53.243 INFO:tasks.workunit.client.1.smithi157.stdout:9/12: chown d0 638 1 2024-02-28T16:26:53.245 INFO:tasks.workunit.client.1.smithi157.stdout:5/12: rename d0/f3 to d0/f4 0 2024-02-28T16:26:53.245 INFO:tasks.workunit.client.1.smithi157.stdout:8/9: rmdir d1 39 2024-02-28T16:26:53.246 INFO:tasks.workunit.client.1.smithi157.stdout:5/13: dread - d0/f4 zero size 2024-02-28T16:26:53.248 INFO:tasks.workunit.client.1.smithi157.stdout:7/6: dread f0 [0,4194304] 0 2024-02-28T16:26:53.249 INFO:tasks.workunit.client.1.smithi157.stdout:2/21: creat f9 x:0 0 0 2024-02-28T16:26:53.253 INFO:tasks.workunit.client.1.smithi157.stdout:1/16: dread f2 [0,4194304] 0 2024-02-28T16:26:53.254 INFO:tasks.workunit.client.1.smithi157.stdout:2/22: mkdir da 0 2024-02-28T16:26:53.255 INFO:tasks.workunit.client.1.smithi157.stdout:7/7: symlink l2 0 2024-02-28T16:26:53.257 INFO:tasks.workunit.client.1.smithi157.stdout:9/13: rename d0/f2 to d0/f4 0 2024-02-28T16:26:53.261 INFO:tasks.workunit.client.1.smithi157.stdout:7/8: creat f3 x:0 0 0 2024-02-28T16:26:53.262 INFO:tasks.workunit.client.1.smithi157.stdout:2/23: chown c5 0 1 2024-02-28T16:26:53.263 INFO:tasks.workunit.client.1.smithi157.stdout:1/17: link l3 l6 0 2024-02-28T16:26:53.274 INFO:tasks.workunit.client.1.smithi157.stdout:2/24: mknod da/cb 0 2024-02-28T16:26:53.280 INFO:tasks.workunit.client.1.smithi157.stdout:0/32: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:26:53.289 INFO:tasks.workunit.client.1.smithi157.stdout:7/9: link c1 c4 0 2024-02-28T16:26:53.292 INFO:tasks.workunit.client.1.smithi157.stdout:5/14: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:26:53.294 INFO:tasks.workunit.client.1.smithi157.stdout:1/18: getdents . 0 2024-02-28T16:26:53.298 INFO:tasks.workunit.client.1.smithi157.stdout:0/33: creat d1/f6 x:0 0 0 2024-02-28T16:26:53.305 INFO:tasks.workunit.client.1.smithi157.stdout:8/10: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:26:53.309 INFO:tasks.workunit.client.1.smithi157.stdout:1/19: mknod c7 0 2024-02-28T16:26:53.310 INFO:tasks.workunit.client.1.smithi157.stdout:9/14: dwrite d0/f3 [0,4194304] 0 2024-02-28T16:26:53.316 INFO:tasks.workunit.client.1.smithi157.stdout:1/20: chown l1 0 1 2024-02-28T16:26:53.319 INFO:tasks.workunit.client.1.smithi157.stdout:7/10: link c4 c5 0 2024-02-28T16:26:53.322 INFO:tasks.workunit.client.1.smithi157.stdout:2/25: dwrite f9 [0,4194304] 0 2024-02-28T16:26:53.323 INFO:tasks.workunit.client.1.smithi157.stdout:7/11: truncate f3 794162 0 2024-02-28T16:26:53.326 INFO:tasks.workunit.client.1.smithi157.stdout:9/15: creat d0/f5 x:0 0 0 2024-02-28T16:26:53.328 INFO:tasks.workunit.client.1.smithi157.stdout:1/21: chown l6 0 1 2024-02-28T16:26:53.330 INFO:tasks.workunit.client.1.smithi157.stdout:0/34: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:26:53.334 INFO:tasks.workunit.client.1.smithi157.stdout:1/22: mknod c8 0 2024-02-28T16:26:53.336 INFO:tasks.workunit.client.1.smithi157.stdout:8/11: link l0 d1/l3 0 2024-02-28T16:26:53.337 INFO:tasks.workunit.client.1.smithi157.stdout:7/12: dread f0 [0,4194304] 0 2024-02-28T16:26:53.338 INFO:tasks.workunit.client.1.smithi157.stdout:5/15: truncate d0/f4 2927105 0 2024-02-28T16:26:53.340 INFO:tasks.workunit.client.1.smithi157.stdout:7/13: write f3 [1327609,31593] 0 2024-02-28T16:26:53.340 INFO:tasks.workunit.client.1.smithi157.stdout:0/35: creat d1/d3/f7 x:0 0 0 2024-02-28T16:26:53.342 INFO:tasks.workunit.client.1.smithi157.stdout:2/26: unlink l7 0 2024-02-28T16:26:53.346 INFO:tasks.workunit.client.1.smithi157.stdout:2/27: read f8 [206987,44459] 0 2024-02-28T16:26:53.347 INFO:tasks.workunit.client.1.smithi157.stdout:0/36: mkdir d1/d8 0 2024-02-28T16:26:53.350 INFO:tasks.workunit.client.1.smithi157.stdout:1/23: link f2 f9 0 2024-02-28T16:26:53.352 INFO:tasks.workunit.client.1.smithi157.stdout:8/12: chown d1/l3 10592 1 2024-02-28T16:26:53.354 INFO:tasks.workunit.client.1.smithi157.stdout:2/28: unlink da/cb 0 2024-02-28T16:26:53.358 INFO:tasks.workunit.client.1.smithi157.stdout:0/37: rename d1/d3/f7 to d1/d8/f9 0 2024-02-28T16:26:53.359 INFO:tasks.workunit.client.1.smithi157.stdout:0/38: fdatasync d1/f2 0 2024-02-28T16:26:53.364 INFO:tasks.workunit.client.1.smithi157.stdout:8/13: creat d1/f4 x:0 0 0 2024-02-28T16:26:53.364 INFO:tasks.workunit.client.1.smithi157.stdout:2/29: symlink da/lc 0 2024-02-28T16:26:53.364 INFO:tasks.workunit.client.1.smithi157.stdout:7/14: dwrite f0 [4194304,4194304] 0 2024-02-28T16:26:53.364 INFO:tasks.workunit.client.1.smithi157.stdout:5/16: write d0/f4 [3107742,31455] 0 2024-02-28T16:26:53.366 INFO:tasks.workunit.client.1.smithi157.stdout:5/17: write d0/f4 [2033954,47392] 0 2024-02-28T16:26:53.373 INFO:tasks.workunit.client.1.smithi157.stdout:0/39: dread d1/f4 [0,4194304] 0 2024-02-28T16:26:53.378 INFO:tasks.workunit.client.1.smithi157.stdout:5/18: symlink d0/l5 0 2024-02-28T16:26:53.378 INFO:tasks.workunit.client.1.smithi157.stdout:7/15: link f3 f6 0 2024-02-28T16:26:53.381 INFO:tasks.workunit.client.1.smithi157.stdout:1/24: truncate f2 7264059 0 2024-02-28T16:26:53.381 INFO:tasks.workunit.client.1.smithi157.stdout:1/25: dread - f4 zero size 2024-02-28T16:26:53.383 INFO:tasks.workunit.client.1.smithi157.stdout:5/19: creat d0/f6 x:0 0 0 2024-02-28T16:26:53.384 INFO:tasks.workunit.client.1.smithi157.stdout:5/20: chown d0/f4 1784994 1 2024-02-28T16:26:53.388 INFO:tasks.workunit.client.1.smithi157.stdout:0/40: getdents d1 0 2024-02-28T16:26:53.388 INFO:tasks.workunit.client.1.smithi157.stdout:0/41: dread - d1/f6 zero size 2024-02-28T16:26:53.389 INFO:tasks.workunit.client.1.smithi157.stdout:0/42: fsync d1/f4 0 2024-02-28T16:26:53.389 INFO:tasks.workunit.client.1.smithi157.stdout:5/21: rename d0/l5 to d0/l7 0 2024-02-28T16:26:53.390 INFO:tasks.workunit.client.1.smithi157.stdout:5/22: chown d0/l1 592299 1 2024-02-28T16:26:53.391 INFO:tasks.workunit.client.1.smithi157.stdout:0/43: mkdir d1/da 0 2024-02-28T16:26:53.395 INFO:tasks.workunit.client.1.smithi157.stdout:2/30: getdents da 0 2024-02-28T16:26:53.399 INFO:tasks.workunit.client.1.smithi157.stdout:7/16: truncate f6 155182 0 2024-02-28T16:26:53.399 INFO:tasks.workunit.client.1.smithi157.stdout:5/23: dread d0/f4 [0,4194304] 0 2024-02-28T16:26:53.402 INFO:tasks.workunit.client.1.smithi157.stdout:7/17: symlink l7 0 2024-02-28T16:26:53.404 INFO:tasks.workunit.client.1.smithi157.stdout:5/24: write d0/f4 [450428,86063] 0 2024-02-28T16:26:53.404 INFO:tasks.workunit.client.1.smithi157.stdout:2/31: write f8 [280326,119265] 0 2024-02-28T16:26:53.409 INFO:tasks.workunit.client.1.smithi157.stdout:5/25: mkdir d0/d8 0 2024-02-28T16:26:53.410 INFO:tasks.workunit.client.1.smithi157.stdout:7/18: dread f3 [0,4194304] 0 2024-02-28T16:26:53.410 INFO:tasks.workunit.client.1.smithi157.stdout:0/44: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:26:53.413 INFO:tasks.workunit.client.1.smithi157.stdout:5/26: write d0/f6 [897654,74896] 0 2024-02-28T16:26:53.416 INFO:tasks.workunit.client.1.smithi157.stdout:2/32: rename da/lc to da/ld 0 2024-02-28T16:26:53.417 INFO:tasks.workunit.client.1.smithi157.stdout:7/19: creat f8 x:0 0 0 2024-02-28T16:26:53.418 INFO:tasks.workunit.client.1.smithi157.stdout:1/26: dread f9 [0,4194304] 0 2024-02-28T16:26:53.418 INFO:tasks.workunit.client.1.smithi157.stdout:0/45: mknod d1/cb 0 2024-02-28T16:26:53.418 INFO:tasks.workunit.client.1.smithi157.stdout:5/27: read d0/f4 [2106642,80547] 0 2024-02-28T16:26:53.419 INFO:tasks.workunit.client.1.smithi157.stdout:1/27: readlink l6 0 2024-02-28T16:26:53.420 INFO:tasks.workunit.client.1.smithi157.stdout:0/46: chown d1/f2 123245180 1 2024-02-28T16:26:53.421 INFO:tasks.workunit.client.1.smithi157.stdout:5/28: mkdir d0/d9 0 2024-02-28T16:26:53.422 INFO:tasks.workunit.client.1.smithi157.stdout:2/33: rmdir da 39 2024-02-28T16:26:53.424 INFO:tasks.workunit.client.1.smithi157.stdout:0/47: creat d1/d8/fc x:0 0 0 2024-02-28T16:26:53.424 INFO:tasks.workunit.client.1.smithi157.stdout:5/29: mknod d0/ca 0 2024-02-28T16:26:53.424 INFO:tasks.workunit.client.1.smithi157.stdout:0/48: stat d1/da 0 2024-02-28T16:26:53.426 INFO:tasks.workunit.client.1.smithi157.stdout:0/49: write d1/f6 [147461,55854] 0 2024-02-28T16:26:53.427 INFO:tasks.workunit.client.1.smithi157.stdout:2/34: creat da/fe x:0 0 0 2024-02-28T16:26:53.430 INFO:tasks.workunit.client.1.smithi157.stdout:5/30: creat d0/d8/fb x:0 0 0 2024-02-28T16:26:53.431 INFO:tasks.workunit.client.1.smithi157.stdout:2/35: creat da/ff x:0 0 0 2024-02-28T16:26:53.432 INFO:tasks.workunit.client.1.smithi157.stdout:0/50: write d1/f6 [258212,69225] 0 2024-02-28T16:26:53.436 INFO:tasks.workunit.client.1.smithi157.stdout:0/51: chown d1/d8/f9 25 1 2024-02-28T16:26:53.437 INFO:tasks.workunit.client.1.smithi157.stdout:5/31: unlink d0/l7 0 2024-02-28T16:26:53.438 INFO:tasks.workunit.client.1.smithi157.stdout:2/36: creat da/f10 x:0 0 0 2024-02-28T16:26:53.440 INFO:tasks.workunit.client.1.smithi157.stdout:0/52: read - d1/d8/fc zero size 2024-02-28T16:26:53.442 INFO:tasks.workunit.client.1.smithi157.stdout:2/37: mknod da/c11 0 2024-02-28T16:26:53.443 INFO:tasks.workunit.client.1.smithi157.stdout:7/20: dwrite f8 [0,4194304] 0 2024-02-28T16:26:53.444 INFO:tasks.workunit.client.1.smithi157.stdout:0/53: rename d1/da to d1/da/dd 22 2024-02-28T16:26:53.447 INFO:tasks.workunit.client.1.smithi157.stdout:5/32: link d0/d8/fb d0/fc 0 2024-02-28T16:26:53.448 INFO:tasks.workunit.client.1.smithi157.stdout:0/54: write d1/f2 [3348694,5502] 0 2024-02-28T16:26:53.448 INFO:tasks.workunit.client.1.smithi157.stdout:1/28: dwrite f9 [4194304,4194304] 0 2024-02-28T16:26:53.448 INFO:tasks.workunit.client.1.smithi157.stdout:5/33: stat d0/f6 0 2024-02-28T16:26:53.453 INFO:tasks.workunit.client.1.smithi157.stdout:7/21: mknod c9 0 2024-02-28T16:26:53.456 INFO:tasks.workunit.client.1.smithi157.stdout:7/22: dread f3 [0,4194304] 0 2024-02-28T16:26:53.457 INFO:tasks.workunit.client.1.smithi157.stdout:0/55: rename d1/f4 to d1/d3/fe 0 2024-02-28T16:26:53.464 INFO:tasks.workunit.client.1.smithi157.stdout:5/34: symlink d0/ld 0 2024-02-28T16:26:53.467 INFO:tasks.workunit.client.0.smithi148.stdout:9/946: sync 2024-02-28T16:26:53.467 INFO:tasks.workunit.client.0.smithi148.stdout:4/689: sync 2024-02-28T16:26:53.467 INFO:tasks.workunit.client.0.smithi148.stdout:5/796: sync 2024-02-28T16:26:53.468 INFO:tasks.workunit.client.1.smithi157.stdout:1/29: getdents . 0 2024-02-28T16:26:53.468 INFO:tasks.workunit.client.1.smithi157.stdout:7/23: link l2 la 0 2024-02-28T16:26:53.470 INFO:tasks.workunit.client.1.smithi157.stdout:2/38: dwrite f8 [0,4194304] 0 2024-02-28T16:26:53.471 INFO:tasks.workunit.client.1.smithi157.stdout:2/39: read - da/fe zero size 2024-02-28T16:26:53.474 INFO:tasks.workunit.client.1.smithi157.stdout:0/56: link d1/f6 d1/d3/ff 0 2024-02-28T16:26:53.475 INFO:tasks.workunit.client.1.smithi157.stdout:2/40: write da/fe [866955,105276] 0 2024-02-28T16:26:53.482 INFO:tasks.workunit.client.1.smithi157.stdout:0/57: write d1/d3/ff [34728,17005] 0 2024-02-28T16:26:53.486 INFO:tasks.workunit.client.0.smithi148.stdout:5/797: write d1/f43 [1604304,117469] 0 2024-02-28T16:26:53.491 INFO:tasks.workunit.client.0.smithi148.stdout:9/947: dwrite d7/d1c/d32/d24/f2f [0,4194304] 0 2024-02-28T16:26:53.492 INFO:tasks.workunit.client.1.smithi157.stdout:7/24: getdents . 0 2024-02-28T16:26:53.494 INFO:tasks.workunit.client.1.smithi157.stdout:0/58: write d1/d3/ff [993901,128299] 0 2024-02-28T16:26:53.495 INFO:tasks.workunit.client.1.smithi157.stdout:2/41: write f8 [4962544,32103] 0 2024-02-28T16:26:53.495 INFO:tasks.workunit.client.1.smithi157.stdout:5/35: dwrite d0/f6 [0,4194304] 0 2024-02-28T16:26:53.496 INFO:tasks.workunit.client.1.smithi157.stdout:1/30: dwrite f9 [4194304,4194304] 0 2024-02-28T16:26:53.498 INFO:tasks.workunit.client.1.smithi157.stdout:7/25: creat fb x:0 0 0 2024-02-28T16:26:53.501 INFO:tasks.workunit.client.1.smithi157.stdout:5/36: fdatasync d0/fc 0 2024-02-28T16:26:53.501 INFO:tasks.workunit.client.0.smithi148.stdout:4/690: dwrite d8/d40/dc3/dd3/d17/d6a/f8a [0,4194304] 0 2024-02-28T16:26:53.502 INFO:tasks.workunit.client.1.smithi157.stdout:1/31: creat fa x:0 0 0 2024-02-28T16:26:53.504 INFO:tasks.workunit.client.1.smithi157.stdout:1/32: write fa [946555,119697] 0 2024-02-28T16:26:53.507 INFO:tasks.workunit.client.0.smithi148.stdout:4/691: mknod d8/d37/d91/ce9 0 2024-02-28T16:26:53.507 INFO:tasks.workunit.client.1.smithi157.stdout:0/59: mknod d1/d3/c10 0 2024-02-28T16:26:53.509 INFO:tasks.workunit.client.1.smithi157.stdout:7/26: symlink lc 0 2024-02-28T16:26:53.513 INFO:tasks.workunit.client.1.smithi157.stdout:0/60: creat d1/f11 x:0 0 0 2024-02-28T16:26:53.519 INFO:tasks.workunit.client.1.smithi157.stdout:0/61: truncate d1/f2 4940378 0 2024-02-28T16:26:53.522 INFO:tasks.workunit.client.0.smithi148.stdout:9/948: write d7/d1c/d1f/d49/dd8/f10a [3233760,128176] 0 2024-02-28T16:26:53.524 INFO:tasks.workunit.client.0.smithi148.stdout:6/836: sync 2024-02-28T16:26:53.527 INFO:tasks.workunit.client.1.smithi157.stdout:0/62: rename d1/d3/c5 to d1/c12 0 2024-02-28T16:26:53.527 INFO:tasks.workunit.client.0.smithi148.stdout:5/798: dread d1/f41 [0,4194304] 0 2024-02-28T16:26:53.531 INFO:tasks.workunit.client.0.smithi148.stdout:5/799: creat d1/db/d25/ff7 x:0 0 0 2024-02-28T16:26:53.532 INFO:tasks.workunit.client.1.smithi157.stdout:1/33: fdatasync fa 0 2024-02-28T16:26:53.533 INFO:tasks.workunit.client.1.smithi157.stdout:5/37: fdatasync d0/f6 0 2024-02-28T16:26:53.534 INFO:tasks.workunit.client.1.smithi157.stdout:2/42: dwrite da/f10 [0,4194304] 0 2024-02-28T16:26:53.535 INFO:tasks.workunit.client.0.smithi148.stdout:5/800: mkdir d1/db/d60/d7a/df8 0 2024-02-28T16:26:53.535 INFO:tasks.workunit.client.1.smithi157.stdout:7/27: dread f8 [0,4194304] 0 2024-02-28T16:26:53.536 INFO:tasks.workunit.client.1.smithi157.stdout:7/28: dread - fb zero size 2024-02-28T16:26:53.537 INFO:tasks.workunit.client.1.smithi157.stdout:5/38: creat d0/fe x:0 0 0 2024-02-28T16:26:53.538 INFO:tasks.workunit.client.0.smithi148.stdout:5/801: rmdir d1/d8/d20/dd8 39 2024-02-28T16:26:53.538 INFO:tasks.workunit.client.0.smithi148.stdout:6/837: dread d0/d4/fa1 [0,4194304] 0 2024-02-28T16:26:53.539 INFO:tasks.workunit.client.1.smithi157.stdout:7/29: write fb [1012936,104359] 0 2024-02-28T16:26:53.540 INFO:tasks.workunit.client.0.smithi148.stdout:5/802: chown d1/d8/cb5 2 1 2024-02-28T16:26:53.544 INFO:tasks.workunit.client.1.smithi157.stdout:7/30: creat fd x:0 0 0 2024-02-28T16:26:53.544 INFO:tasks.workunit.client.1.smithi157.stdout:1/34: dread fa [0,4194304] 0 2024-02-28T16:26:53.545 INFO:tasks.workunit.client.0.smithi148.stdout:4/692: dwrite d8/d40/dc3/dd3/f20 [0,4194304] 0 2024-02-28T16:26:53.545 INFO:tasks.workunit.client.1.smithi157.stdout:5/39: creat d0/d9/ff x:0 0 0 2024-02-28T16:26:53.547 INFO:tasks.workunit.client.1.smithi157.stdout:5/40: chown d0/d9 3 1 2024-02-28T16:26:53.549 INFO:tasks.workunit.client.1.smithi157.stdout:5/41: dread - d0/d9/ff zero size 2024-02-28T16:26:53.552 INFO:tasks.workunit.client.0.smithi148.stdout:9/949: dwrite d7/d1c/d1f/d49/d8d/fb7 [0,4194304] 0 2024-02-28T16:26:53.552 INFO:tasks.workunit.client.1.smithi157.stdout:0/63: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:26:53.558 INFO:tasks.workunit.client.0.smithi148.stdout:5/803: fdatasync d1/d8/d20/d31/f40 0 2024-02-28T16:26:53.567 INFO:tasks.workunit.client.0.smithi148.stdout:5/804: stat d1/db/d60/d7a/dbb/fcd 0 2024-02-28T16:26:53.568 INFO:tasks.workunit.client.1.smithi157.stdout:0/64: rename d1/d3 to d1/d13 0 2024-02-28T16:26:53.569 INFO:tasks.workunit.client.0.smithi148.stdout:5/805: chown d1/db/d60 57640 1 2024-02-28T16:26:53.570 INFO:tasks.workunit.client.0.smithi148.stdout:4/693: read d8/d21/d7e/fbb [937018,120205] 0 2024-02-28T16:26:53.571 INFO:tasks.workunit.client.1.smithi157.stdout:2/43: truncate da/f10 1892848 0 2024-02-28T16:26:53.573 INFO:tasks.workunit.client.1.smithi157.stdout:1/35: dwrite f9 [0,4194304] 0 2024-02-28T16:26:53.574 INFO:tasks.workunit.client.1.smithi157.stdout:0/65: chown d1/d13/fe 183456544 1 2024-02-28T16:26:53.575 INFO:tasks.workunit.client.0.smithi148.stdout:2/884: sync 2024-02-28T16:26:53.575 INFO:tasks.workunit.client.0.smithi148.stdout:8/951: sync 2024-02-28T16:26:53.575 INFO:tasks.workunit.client.0.smithi148.stdout:3/935: sync 2024-02-28T16:26:53.575 INFO:tasks.workunit.client.0.smithi148.stdout:7/798: sync 2024-02-28T16:26:53.577 INFO:tasks.workunit.client.0.smithi148.stdout:5/806: unlink d1/db/d60/d7a/d8b/d80/fd0 0 2024-02-28T16:26:53.578 INFO:tasks.workunit.client.1.smithi157.stdout:5/42: dwrite d0/fe [0,4194304] 0 2024-02-28T16:26:53.579 INFO:tasks.workunit.client.1.smithi157.stdout:7/31: getdents . 0 2024-02-28T16:26:53.579 INFO:tasks.workunit.client.1.smithi157.stdout:1/36: chown f9 4 1 2024-02-28T16:26:53.580 INFO:tasks.workunit.client.1.smithi157.stdout:1/37: stat f9 0 2024-02-28T16:26:53.581 INFO:tasks.workunit.client.0.smithi148.stdout:2/885: read - d0/d1c/d85/fe2 zero size 2024-02-28T16:26:53.581 INFO:tasks.workunit.client.1.smithi157.stdout:1/38: read fa [968691,8580] 0 2024-02-28T16:26:53.582 INFO:tasks.workunit.client.0.smithi148.stdout:4/694: readlink d8/d21/d3d/le8 0 2024-02-28T16:26:53.582 INFO:tasks.workunit.client.1.smithi157.stdout:1/39: chown c7 8 1 2024-02-28T16:26:53.583 INFO:tasks.workunit.client.1.smithi157.stdout:0/66: symlink d1/d13/l14 0 2024-02-28T16:26:53.585 INFO:tasks.workunit.client.0.smithi148.stdout:2/886: fsync d0/dd/fab 0 2024-02-28T16:26:53.592 INFO:tasks.workunit.client.0.smithi148.stdout:6/838: dwrite d0/d22/d27/d66/d87/fde [0,4194304] 0 2024-02-28T16:26:53.592 INFO:tasks.workunit.client.1.smithi157.stdout:7/32: rename f6 to fe 0 2024-02-28T16:26:53.592 INFO:tasks.workunit.client.1.smithi157.stdout:1/40: symlink lb 0 2024-02-28T16:26:53.593 INFO:tasks.workunit.client.1.smithi157.stdout:7/33: stat fb 0 2024-02-28T16:26:53.594 INFO:tasks.workunit.client.1.smithi157.stdout:1/41: write f5 [259314,70625] 0 2024-02-28T16:26:53.595 INFO:tasks.workunit.client.0.smithi148.stdout:7/799: mkdir d0/d9/d25/d96/db7/df6 0 2024-02-28T16:26:53.595 INFO:tasks.workunit.client.0.smithi148.stdout:4/695: fdatasync d8/f26 0 2024-02-28T16:26:53.601 INFO:tasks.workunit.client.1.smithi157.stdout:1/42: fsync f5 0 2024-02-28T16:26:53.611 INFO:tasks.workunit.client.0.smithi148.stdout:9/950: dread d7/d1c/d59/d83/de4/d106/f141 [0,4194304] 0 2024-02-28T16:26:53.611 INFO:tasks.workunit.client.0.smithi148.stdout:5/807: dwrite d1/db/d60/df0/f9c [0,4194304] 0 2024-02-28T16:26:53.613 INFO:tasks.workunit.client.1.smithi157.stdout:0/67: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:26:53.614 INFO:tasks.workunit.client.0.smithi148.stdout:9/951: chown d7/d1c/d32/d24/f13c 0 1 2024-02-28T16:26:53.614 INFO:tasks.workunit.client.1.smithi157.stdout:0/68: fdatasync d1/f11 0 2024-02-28T16:26:53.615 INFO:tasks.workunit.client.0.smithi148.stdout:3/936: symlink d1/d13/d19/d32/l114 0 2024-02-28T16:26:53.615 INFO:tasks.workunit.client.1.smithi157.stdout:0/69: read - d1/d8/f9 zero size 2024-02-28T16:26:53.616 INFO:tasks.workunit.client.0.smithi148.stdout:8/952: write d1/da7/dc2/f105 [130404,20258] 0 2024-02-28T16:26:53.617 INFO:tasks.workunit.client.1.smithi157.stdout:7/34: readlink l2 0 2024-02-28T16:26:53.617 INFO:tasks.workunit.client.1.smithi157.stdout:2/44: getdents da 0 2024-02-28T16:26:53.618 INFO:tasks.workunit.client.1.smithi157.stdout:7/35: write f0 [6567472,24349] 0 2024-02-28T16:26:53.626 INFO:tasks.workunit.client.0.smithi148.stdout:4/696: rmdir d8/d40/dc3/dd3/d9f 39 2024-02-28T16:26:53.628 INFO:tasks.workunit.client.1.smithi157.stdout:0/70: creat d1/f15 x:0 0 0 2024-02-28T16:26:53.630 INFO:tasks.workunit.client.0.smithi148.stdout:2/887: mkdir d0/d18/d20/ddd/d11b 0 2024-02-28T16:26:53.634 INFO:tasks.workunit.client.1.smithi157.stdout:2/45: chown l6 338 1 2024-02-28T16:26:53.636 INFO:tasks.workunit.client.0.smithi148.stdout:5/808: creat d1/db/d60/d7a/d8b/ff9 x:0 0 0 2024-02-28T16:26:53.636 INFO:tasks.workunit.client.0.smithi148.stdout:3/937: mkdir d1/d13/d19/d56/d5b/d115 0 2024-02-28T16:26:53.638 INFO:tasks.workunit.client.1.smithi157.stdout:7/36: mkdir df 0 2024-02-28T16:26:53.640 INFO:tasks.workunit.client.0.smithi148.stdout:3/938: write d1/db/d35/d70/d9c/fe4 [1182941,93175] 0 2024-02-28T16:26:53.640 INFO:tasks.workunit.client.1.smithi157.stdout:5/43: getdents d0/d9 0 2024-02-28T16:26:53.641 INFO:tasks.workunit.client.1.smithi157.stdout:5/44: fdatasync d0/f6 0 2024-02-28T16:26:53.642 INFO:tasks.workunit.client.0.smithi148.stdout:3/939: chown d1/d13/d19/d1b/d38/f43 6626951 1 2024-02-28T16:26:53.642 INFO:tasks.workunit.client.0.smithi148.stdout:8/953: symlink d1/dd/d13/d1a/d25/da3/l13a 0 2024-02-28T16:26:53.652 INFO:tasks.workunit.client.1.smithi157.stdout:0/71: creat d1/f16 x:0 0 0 2024-02-28T16:26:53.656 INFO:tasks.workunit.client.1.smithi157.stdout:2/46: creat da/f12 x:0 0 0 2024-02-28T16:26:53.660 INFO:tasks.workunit.client.0.smithi148.stdout:5/809: read d1/db/d60/d7a/f9d [3037679,94922] 0 2024-02-28T16:26:53.660 INFO:tasks.workunit.client.1.smithi157.stdout:7/37: write f3 [908330,124629] 0 2024-02-28T16:26:53.663 INFO:tasks.workunit.client.1.smithi157.stdout:5/45: unlink d0/f4 0 2024-02-28T16:26:53.665 INFO:tasks.workunit.client.1.smithi157.stdout:2/47: symlink da/l13 0 2024-02-28T16:26:53.668 INFO:tasks.workunit.client.0.smithi148.stdout:8/954: dwrite d1/d3/d18/d48/d70/d75/d91/fab [0,4194304] 0 2024-02-28T16:26:53.671 INFO:tasks.workunit.client.1.smithi157.stdout:7/38: dread fb [0,4194304] 0 2024-02-28T16:26:53.672 INFO:tasks.workunit.client.0.smithi148.stdout:6/839: dwrite d0/d22/d25/d76/fb9 [0,4194304] 0 2024-02-28T16:26:53.675 INFO:tasks.workunit.client.1.smithi157.stdout:0/72: dwrite d1/f11 [0,4194304] 0 2024-02-28T16:26:53.676 INFO:tasks.workunit.client.0.smithi148.stdout:5/810: chown d1/d8/d20/d4e/c8d 23411 1 2024-02-28T16:26:53.677 INFO:tasks.workunit.client.0.smithi148.stdout:3/940: mkdir d1/d13/d19/d1b/dd9/d116 0 2024-02-28T16:26:53.680 INFO:tasks.workunit.client.1.smithi157.stdout:0/73: dread - d1/f16 zero size 2024-02-28T16:26:53.681 INFO:tasks.workunit.client.1.smithi157.stdout:1/43: truncate f9 5877917 0 2024-02-28T16:26:53.683 INFO:tasks.workunit.client.0.smithi148.stdout:4/697: mkdir d8/d40/dc3/dd3/dea 0 2024-02-28T16:26:53.683 INFO:tasks.workunit.client.1.smithi157.stdout:0/74: chown d1/f16 14 1 2024-02-28T16:26:53.684 INFO:tasks.workunit.client.0.smithi148.stdout:9/952: dwrite d7/d1c/f9a [8388608,4194304] 0 2024-02-28T16:26:53.686 INFO:tasks.workunit.client.1.smithi157.stdout:7/39: fsync fb 0 2024-02-28T16:26:53.687 INFO:tasks.workunit.client.0.smithi148.stdout:2/888: dread d0/d9/f21 [0,4194304] 0 2024-02-28T16:26:53.687 INFO:tasks.workunit.client.0.smithi148.stdout:8/955: unlink d1/dd/d13/d1a/fcf 0 2024-02-28T16:26:53.689 INFO:tasks.workunit.client.1.smithi157.stdout:7/40: write fe [1814902,5605] 0 2024-02-28T16:26:53.691 INFO:tasks.workunit.client.0.smithi148.stdout:5/811: read - d1/d8/d20/dd8/fd1 zero size 2024-02-28T16:26:53.692 INFO:tasks.workunit.client.0.smithi148.stdout:5/812: write d1/fd7 [1446066,30084] 0 2024-02-28T16:26:53.692 INFO:tasks.workunit.client.1.smithi157.stdout:5/46: rmdir d0 39 2024-02-28T16:26:53.696 INFO:tasks.workunit.client.0.smithi148.stdout:6/840: truncate d0/d22/d25/d76/f85 994159 0 2024-02-28T16:26:53.697 INFO:tasks.workunit.client.0.smithi148.stdout:6/841: stat d0/d8/dfd 0 2024-02-28T16:26:53.700 INFO:tasks.workunit.client.1.smithi157.stdout:2/48: dwrite da/ff [0,4194304] 0 2024-02-28T16:26:53.703 INFO:tasks.workunit.client.0.smithi148.stdout:7/800: getdents d0/d9/d25/d96/ddf/d28/d2b/d6f 0 2024-02-28T16:26:53.704 INFO:tasks.workunit.client.1.smithi157.stdout:2/49: chown da/ld 0 1 2024-02-28T16:26:53.705 INFO:tasks.workunit.client.1.smithi157.stdout:0/75: rename d1/d13/c10 to d1/c17 0 2024-02-28T16:26:53.705 INFO:tasks.workunit.client.0.smithi148.stdout:2/889: dread - d0/d18/d20/fcf zero size 2024-02-28T16:26:53.710 INFO:tasks.workunit.client.1.smithi157.stdout:0/76: write d1/d13/ff [3919060,63374] 0 2024-02-28T16:26:53.710 INFO:tasks.workunit.client.0.smithi148.stdout:8/956: mknod d1/dd/d13/d1a/d25/da3/c13b 0 2024-02-28T16:26:53.712 INFO:tasks.workunit.client.1.smithi157.stdout:1/44: dwrite fa [0,4194304] 0 2024-02-28T16:26:53.717 INFO:tasks.workunit.client.1.smithi157.stdout:2/50: creat da/f14 x:0 0 0 2024-02-28T16:26:53.717 INFO:tasks.workunit.client.0.smithi148.stdout:8/957: chown d1/d3/d18/d120/d126/d55/l5b 113323 1 2024-02-28T16:26:53.717 INFO:tasks.workunit.client.1.smithi157.stdout:7/41: creat df/f10 x:0 0 0 2024-02-28T16:26:53.718 INFO:tasks.workunit.client.1.smithi157.stdout:2/51: readlink da/ld 0 2024-02-28T16:26:53.723 INFO:tasks.workunit.client.0.smithi148.stdout:8/958: stat d1/d3/d18/d5a/dbf/cc8 0 2024-02-28T16:26:53.725 INFO:tasks.workunit.client.0.smithi148.stdout:2/890: unlink d0/d1c/d49/f9b 0 2024-02-28T16:26:53.732 INFO:tasks.workunit.client.0.smithi148.stdout:3/941: creat d1/d13/d19/d1b/d38/f117 x:0 0 0 2024-02-28T16:26:53.734 INFO:tasks.workunit.client.0.smithi148.stdout:4/698: dread d8/d40/dc3/dd3/d17/d6a/d6c/fa2 [0,4194304] 0 2024-02-28T16:26:53.734 INFO:tasks.workunit.client.0.smithi148.stdout:5/813: dwrite d1/db/d60/d7a/f9d [4194304,4194304] 0 2024-02-28T16:26:53.735 INFO:tasks.workunit.client.1.smithi157.stdout:7/42: creat df/f11 x:0 0 0 2024-02-28T16:26:53.737 INFO:tasks.workunit.client.1.smithi157.stdout:2/52: creat da/f15 x:0 0 0 2024-02-28T16:26:53.738 INFO:tasks.workunit.client.1.smithi157.stdout:2/53: truncate da/f14 316412 0 2024-02-28T16:26:53.740 INFO:tasks.workunit.client.0.smithi148.stdout:7/801: mknod d0/d4/d70/da5/dc0/cf7 0 2024-02-28T16:26:53.747 INFO:tasks.workunit.client.0.smithi148.stdout:8/959: dread - d1/dd/d51/d9b/ffc zero size 2024-02-28T16:26:53.749 INFO:tasks.workunit.client.0.smithi148.stdout:8/960: readlink d1/dd/d51/d9b/dc6/dae/ldb 0 2024-02-28T16:26:53.753 INFO:tasks.workunit.client.1.smithi157.stdout:7/43: symlink df/l12 0 2024-02-28T16:26:53.755 INFO:tasks.workunit.client.0.smithi148.stdout:6/842: write d0/d4/dba/fcf [378280,59173] 0 2024-02-28T16:26:53.758 INFO:tasks.workunit.client.1.smithi157.stdout:0/77: stat d1/c17 0 2024-02-28T16:26:53.761 INFO:tasks.workunit.client.1.smithi157.stdout:5/47: write d0/d8/fb [460522,64510] 0 2024-02-28T16:26:53.762 INFO:tasks.workunit.client.0.smithi148.stdout:8/961: dread d1/d3/d18/d120/d126/d55/f6a [4194304,4194304] 0 2024-02-28T16:26:53.762 INFO:tasks.workunit.client.0.smithi148.stdout:5/814: truncate d1/db/d60/d7a/d8b/f45 3757090 0 2024-02-28T16:26:53.764 INFO:tasks.workunit.client.1.smithi157.stdout:5/48: read d0/fc [125832,12442] 0 2024-02-28T16:26:53.765 INFO:tasks.workunit.client.0.smithi148.stdout:7/802: truncate d0/d9/d25/d39/f54 1224917 0 2024-02-28T16:26:53.765 INFO:tasks.workunit.client.0.smithi148.stdout:9/953: truncate d7/d1c/f34 1282206 0 2024-02-28T16:26:53.770 INFO:tasks.workunit.client.1.smithi157.stdout:0/78: mknod d1/da/c18 0 2024-02-28T16:26:53.773 INFO:tasks.workunit.client.1.smithi157.stdout:5/49: creat d0/d9/f10 x:0 0 0 2024-02-28T16:26:53.774 INFO:tasks.workunit.client.1.smithi157.stdout:7/44: rmdir df 39 2024-02-28T16:26:53.774 INFO:tasks.workunit.client.1.smithi157.stdout:2/54: dwrite da/f10 [0,4194304] 0 2024-02-28T16:26:53.775 INFO:tasks.workunit.client.1.smithi157.stdout:7/45: chown l2 9 1 2024-02-28T16:26:53.775 INFO:tasks.workunit.client.1.smithi157.stdout:2/55: chown da 0 1 2024-02-28T16:26:53.776 INFO:tasks.workunit.client.1.smithi157.stdout:2/56: dread - da/f15 zero size 2024-02-28T16:26:53.780 INFO:tasks.workunit.client.1.smithi157.stdout:0/79: creat d1/d13/f19 x:0 0 0 2024-02-28T16:26:53.785 INFO:tasks.workunit.client.0.smithi148.stdout:2/891: rename d0/d9/d13/f16 to d0/d1d/f11c 0 2024-02-28T16:26:53.786 INFO:tasks.workunit.client.0.smithi148.stdout:4/699: truncate d8/d21/d3d/f64 2849941 0 2024-02-28T16:26:53.787 INFO:tasks.workunit.client.0.smithi148.stdout:2/892: fsync d0/d1c/f4e 0 2024-02-28T16:26:53.788 INFO:tasks.workunit.client.1.smithi157.stdout:5/50: mkdir d0/d9/d11 0 2024-02-28T16:26:53.789 INFO:tasks.workunit.client.0.smithi148.stdout:9/954: rmdir d7/d43/da8 39 2024-02-28T16:26:53.789 INFO:tasks.workunit.client.0.smithi148.stdout:4/700: chown d8/d21/d3d/d4d/cc9 1602983 1 2024-02-28T16:26:53.794 INFO:tasks.workunit.client.1.smithi157.stdout:2/57: unlink da/f10 0 2024-02-28T16:26:53.796 INFO:tasks.workunit.client.1.smithi157.stdout:1/45: truncate f2 6474376 0 2024-02-28T16:26:53.796 INFO:tasks.workunit.client.1.smithi157.stdout:1/46: dread - f4 zero size 2024-02-28T16:26:53.797 INFO:tasks.workunit.client.1.smithi157.stdout:0/80: mknod d1/d8/c1a 0 2024-02-28T16:26:53.802 INFO:tasks.workunit.client.1.smithi157.stdout:7/46: mknod df/c13 0 2024-02-28T16:26:53.805 INFO:tasks.workunit.client.0.smithi148.stdout:3/942: rename d1/db/d45/d80/led to d1/d13/d19/d32/d9e/l118 0 2024-02-28T16:26:53.807 INFO:tasks.workunit.client.1.smithi157.stdout:2/58: symlink da/l16 0 2024-02-28T16:26:53.809 INFO:tasks.workunit.client.1.smithi157.stdout:1/47: symlink lc 0 2024-02-28T16:26:53.810 INFO:tasks.workunit.client.1.smithi157.stdout:5/51: mkdir d0/d9/d11/d12 0 2024-02-28T16:26:53.811 INFO:tasks.workunit.client.1.smithi157.stdout:1/48: write fa [1570905,6983] 0 2024-02-28T16:26:53.812 INFO:tasks.workunit.client.0.smithi148.stdout:2/893: creat d0/d9/d13/f11d x:0 0 0 2024-02-28T16:26:53.812 INFO:tasks.workunit.client.0.smithi148.stdout:9/955: mknod d7/d1c/d1f/d49/dae/c143 0 2024-02-28T16:26:53.812 INFO:tasks.workunit.client.1.smithi157.stdout:7/47: symlink df/l14 0 2024-02-28T16:26:53.814 INFO:tasks.workunit.client.0.smithi148.stdout:4/701: creat d8/d21/d3d/d4d/d72/feb x:0 0 0 2024-02-28T16:26:53.818 INFO:tasks.workunit.client.1.smithi157.stdout:2/59: unlink f8 0 2024-02-28T16:26:53.819 INFO:tasks.workunit.client.1.smithi157.stdout:2/60: write da/f12 [678937,73581] 0 2024-02-28T16:26:53.821 INFO:tasks.workunit.client.1.smithi157.stdout:2/61: fdatasync da/f14 0 2024-02-28T16:26:53.822 INFO:tasks.workunit.client.1.smithi157.stdout:1/49: unlink c7 0 2024-02-28T16:26:53.823 INFO:tasks.workunit.client.1.smithi157.stdout:2/62: write da/fe [897279,8213] 0 2024-02-28T16:26:53.824 INFO:tasks.workunit.client.1.smithi157.stdout:5/52: symlink d0/d9/d11/l13 0 2024-02-28T16:26:53.826 INFO:tasks.workunit.client.0.smithi148.stdout:5/815: rmdir d1/d8/d20/d4e/d84/d92/ded 0 2024-02-28T16:26:53.828 INFO:tasks.workunit.client.1.smithi157.stdout:7/48: unlink lc 0 2024-02-28T16:26:53.830 INFO:tasks.workunit.client.0.smithi148.stdout:6/843: rename d0/d4/f3c to d0/d22/d25/d76/f115 0 2024-02-28T16:26:53.831 INFO:tasks.workunit.client.0.smithi148.stdout:6/844: dread - d0/d22/d49/f10e zero size 2024-02-28T16:26:53.835 INFO:tasks.workunit.client.0.smithi148.stdout:2/894: dread d0/d18/d9a/f63 [0,4194304] 0 2024-02-28T16:26:53.838 INFO:tasks.workunit.client.1.smithi157.stdout:2/63: unlink c2 0 2024-02-28T16:26:53.838 INFO:tasks.workunit.client.0.smithi148.stdout:7/803: getdents d0/d9/d25/d96/ddf/d28/d2b/d80 0 2024-02-28T16:26:53.839 INFO:tasks.workunit.client.1.smithi157.stdout:7/49: rmdir df 39 2024-02-28T16:26:53.840 INFO:tasks.workunit.client.0.smithi148.stdout:4/702: mknod d8/d40/d73/cec 0 2024-02-28T16:26:53.840 INFO:tasks.workunit.client.0.smithi148.stdout:7/804: chown d0/d4/d70/da5/cb3 18 1 2024-02-28T16:26:53.841 INFO:tasks.workunit.client.0.smithi148.stdout:4/703: readlink d8/d37/l44 0 2024-02-28T16:26:53.841 INFO:tasks.workunit.client.0.smithi148.stdout:8/962: mkdir d1/d3/d18/d48/d70/d75/d84/d13c 0 2024-02-28T16:26:53.843 INFO:tasks.workunit.client.0.smithi148.stdout:7/805: stat d0/d9/deb/lf1 0 2024-02-28T16:26:53.846 INFO:tasks.workunit.client.0.smithi148.stdout:5/816: rename d1/l93 to d1/db/d60/d7a/d87/de0/lfa 0 2024-02-28T16:26:53.849 INFO:tasks.workunit.client.1.smithi157.stdout:1/50: dwrite f5 [0,4194304] 0 2024-02-28T16:26:53.852 INFO:tasks.workunit.client.0.smithi148.stdout:9/956: mknod d7/d1c/deb/c144 0 2024-02-28T16:26:53.852 INFO:tasks.workunit.client.1.smithi157.stdout:2/64: rename c1 to da/c17 0 2024-02-28T16:26:53.853 INFO:tasks.workunit.client.0.smithi148.stdout:4/704: symlink d8/d40/d73/led 0 2024-02-28T16:26:53.853 INFO:tasks.workunit.client.0.smithi148.stdout:6/845: dwrite d0/d22/d27/f62 [0,4194304] 0 2024-02-28T16:26:53.855 INFO:tasks.workunit.client.1.smithi157.stdout:5/53: dwrite d0/d9/f10 [0,4194304] 0 2024-02-28T16:26:53.858 INFO:tasks.workunit.client.0.smithi148.stdout:6/846: chown d0/d8/f112 598292974 1 2024-02-28T16:26:53.859 INFO:tasks.workunit.client.0.smithi148.stdout:7/806: creat d0/d4/ff8 x:0 0 0 2024-02-28T16:26:53.859 INFO:tasks.workunit.client.0.smithi148.stdout:2/895: dwrite d0/dd/fab [4194304,4194304] 0 2024-02-28T16:26:53.864 INFO:tasks.workunit.client.0.smithi148.stdout:5/817: creat d1/d8/d20/d4e/d84/ffb x:0 0 0 2024-02-28T16:26:53.864 INFO:tasks.workunit.client.0.smithi148.stdout:9/957: rmdir d7/d1c/d32/d24/d78 39 2024-02-28T16:26:53.865 INFO:tasks.workunit.client.1.smithi157.stdout:2/65: mknod da/c18 0 2024-02-28T16:26:53.867 INFO:tasks.workunit.client.1.smithi157.stdout:7/50: dread f8 [0,4194304] 0 2024-02-28T16:26:53.869 INFO:tasks.workunit.client.0.smithi148.stdout:9/958: write d7/d1c/d1f/d49/f89 [2125116,46470] 0 2024-02-28T16:26:53.869 INFO:tasks.workunit.client.1.smithi157.stdout:5/54: unlink d0/fc 0 2024-02-28T16:26:53.870 INFO:tasks.workunit.client.1.smithi157.stdout:7/51: write f0 [5910471,124987] 0 2024-02-28T16:26:53.872 INFO:tasks.workunit.client.1.smithi157.stdout:7/52: dread - fd zero size 2024-02-28T16:26:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:53 smithi148 ceph-mon[28767]: pgmap v51: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 167 MiB/s wr, 396 op/s 2024-02-28T16:26:53.875 INFO:tasks.workunit.client.0.smithi148.stdout:8/963: dwrite d1/dd/d13/d1a/d25/f11c [0,4194304] 0 2024-02-28T16:26:53.884 INFO:tasks.workunit.client.1.smithi157.stdout:2/66: dread da/fe [0,4194304] 0 2024-02-28T16:26:53.884 INFO:tasks.workunit.client.0.smithi148.stdout:2/896: mknod d0/d18/d9a/c11e 0 2024-02-28T16:26:53.885 INFO:tasks.workunit.client.1.smithi157.stdout:2/67: readlink da/l13 0 2024-02-28T16:26:53.887 INFO:tasks.workunit.client.1.smithi157.stdout:2/68: write f9 [4012779,99549] 0 2024-02-28T16:26:53.891 INFO:tasks.workunit.client.0.smithi148.stdout:2/897: fsync d0/d1c/d85/d8b/d8f/fa9 0 2024-02-28T16:26:53.900 INFO:tasks.workunit.client.0.smithi148.stdout:6/847: dwrite d0/d22/d25/d76/f115 [4194304,4194304] 0 2024-02-28T16:26:53.901 INFO:tasks.workunit.client.0.smithi148.stdout:5/818: dwrite d1/db/d60/d7a/dbb/fd3 [0,4194304] 0 2024-02-28T16:26:53.901 INFO:tasks.workunit.client.0.smithi148.stdout:6/848: chown d0/d8/dfd 251077 1 2024-02-28T16:26:53.906 INFO:tasks.workunit.client.0.smithi148.stdout:9/959: creat d7/d1c/d1f/d49/d116/f145 x:0 0 0 2024-02-28T16:26:53.909 INFO:tasks.workunit.client.0.smithi148.stdout:8/964: mkdir d1/dd/d13/d24/d3a/d49/d108/d13d 0 2024-02-28T16:26:53.922 INFO:tasks.workunit.client.0.smithi148.stdout:2/898: chown d0/d1c/d85/d8b/d8f/df3/l42 20 1 2024-02-28T16:26:53.925 INFO:tasks.workunit.client.0.smithi148.stdout:6/849: dread d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:53.933 INFO:tasks.workunit.client.0.smithi148.stdout:4/705: link d8/d21/d3d/d4d/d72/ca4 d8/d40/dc3/dd3/d1f/cee 0 2024-02-28T16:26:53.936 INFO:tasks.workunit.client.0.smithi148.stdout:6/850: truncate d0/d22/d49/f10e 90026 0 2024-02-28T16:26:53.936 INFO:tasks.workunit.client.0.smithi148.stdout:8/965: dwrite d1/d3/f20 [4194304,4194304] 0 2024-02-28T16:26:53.943 INFO:tasks.workunit.client.0.smithi148.stdout:7/807: dwrite d0/d9/d25/d96/ddf/d1c/d32/f3b [0,4194304] 0 2024-02-28T16:26:53.953 INFO:tasks.workunit.client.0.smithi148.stdout:2/899: symlink d0/d1c/d85/d96/dbf/d107/l11f 0 2024-02-28T16:26:53.953 INFO:tasks.workunit.client.0.smithi148.stdout:7/808: write d0/d9/d25/d96/ddf/d28/d2b/d3a/fc3 [1472440,95545] 0 2024-02-28T16:26:53.954 INFO:tasks.workunit.client.0.smithi148.stdout:9/960: symlink d7/d1c/d1f/d49/da0/l146 0 2024-02-28T16:26:53.956 INFO:tasks.workunit.client.0.smithi148.stdout:4/706: mknod d8/d21/d3d/d4d/d66/cef 0 2024-02-28T16:26:53.957 INFO:tasks.workunit.client.0.smithi148.stdout:4/707: chown d8/d40/dc3/dbd/de3 8879 1 2024-02-28T16:26:53.961 INFO:tasks.workunit.client.0.smithi148.stdout:2/900: creat d0/d59/f120 x:0 0 0 2024-02-28T16:26:53.964 INFO:tasks.workunit.client.0.smithi148.stdout:8/966: creat d1/dd/d13/d1a/f13e x:0 0 0 2024-02-28T16:26:53.969 INFO:tasks.workunit.client.0.smithi148.stdout:4/708: symlink d8/d37/d91/lf0 0 2024-02-28T16:26:53.971 INFO:tasks.workunit.client.0.smithi148.stdout:5/819: dwrite d1/db/d25/f3a [0,4194304] 0 2024-02-28T16:26:53.976 INFO:tasks.workunit.client.0.smithi148.stdout:6/851: dread d0/d4/dba/f1f [0,4194304] 0 2024-02-28T16:26:53.976 INFO:tasks.workunit.client.0.smithi148.stdout:4/709: creat d8/d40/ff1 x:0 0 0 2024-02-28T16:26:53.978 INFO:tasks.workunit.client.0.smithi148.stdout:2/901: creat d0/d1c/d85/d8b/d8f/dc9/f121 x:0 0 0 2024-02-28T16:26:53.981 INFO:tasks.workunit.client.0.smithi148.stdout:2/902: write d0/d18/d9a/f87 [822552,97529] 0 2024-02-28T16:26:53.982 INFO:tasks.workunit.client.0.smithi148.stdout:7/809: truncate d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/f93 86290 0 2024-02-28T16:26:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:53 smithi157 ceph-mon[38346]: pgmap v51: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 61 MiB/s rd, 167 MiB/s wr, 396 op/s 2024-02-28T16:26:54.014 INFO:tasks.workunit.client.0.smithi148.stdout:5/820: dread d1/db/d60/d7a/dbb/fcd [0,4194304] 0 2024-02-28T16:26:54.048 INFO:tasks.workunit.client.0.smithi148.stdout:5/821: dread d1/d8/d20/d4e/d84/fa7 [0,4194304] 0 2024-02-28T16:26:54.086 INFO:tasks.workunit.client.0.smithi148.stdout:6/852: write d0/f6e [1559442,75192] 0 2024-02-28T16:26:54.088 INFO:tasks.workunit.client.0.smithi148.stdout:6/853: chown d0/d22/d25/d114 216637141 1 2024-02-28T16:26:54.094 INFO:tasks.workunit.client.0.smithi148.stdout:2/903: rmdir d0/d1c/dcc 39 2024-02-28T16:26:54.100 INFO:tasks.workunit.client.1.smithi157.stdout:1/51: fsync f9 0 2024-02-28T16:26:54.101 INFO:tasks.workunit.client.0.smithi148.stdout:5/822: symlink d1/db/d60/d7a/d8b/d80/lfc 0 2024-02-28T16:26:54.102 INFO:tasks.workunit.client.1.smithi157.stdout:1/52: chown c0 520655568 1 2024-02-28T16:26:54.104 INFO:tasks.workunit.client.0.smithi148.stdout:4/710: symlink d8/de4/lf2 0 2024-02-28T16:26:54.104 INFO:tasks.workunit.client.0.smithi148.stdout:5/823: write d1/d8/d20/d4e/d71/f91 [2552711,70756] 0 2024-02-28T16:26:54.108 INFO:tasks.workunit.client.1.smithi157.stdout:5/55: symlink d0/d8/l14 0 2024-02-28T16:26:54.110 INFO:tasks.workunit.client.0.smithi148.stdout:6/854: symlink d0/d22/d27/d3e/d52/l116 0 2024-02-28T16:26:54.114 INFO:tasks.workunit.client.0.smithi148.stdout:7/810: getdents d0/d9/d25/d96/db7/df6 0 2024-02-28T16:26:54.117 INFO:tasks.workunit.client.0.smithi148.stdout:7/811: chown d0/d9/d25/d96/ddf/d1c/d32/l8a 9538 1 2024-02-28T16:26:54.126 INFO:tasks.workunit.client.0.smithi148.stdout:5/824: mkdir d1/d8/d20/dd8/d89/dfd 0 2024-02-28T16:26:54.131 INFO:tasks.workunit.client.1.smithi157.stdout:7/53: mknod df/c15 0 2024-02-28T16:26:54.133 INFO:tasks.workunit.client.1.smithi157.stdout:5/56: dread d0/fe [0,4194304] 0 2024-02-28T16:26:54.133 INFO:tasks.workunit.client.0.smithi148.stdout:7/812: mknod d0/dd5/cf9 0 2024-02-28T16:26:54.140 INFO:tasks.workunit.client.0.smithi148.stdout:4/711: rename d8/d21/d3d/d4d/d66/cef to d8/d40/dc3/dd3/d9f/cf3 0 2024-02-28T16:26:54.148 INFO:tasks.workunit.client.0.smithi148.stdout:6/855: symlink d0/d8/d21/d9d/d10d/l117 0 2024-02-28T16:26:54.150 INFO:tasks.workunit.client.0.smithi148.stdout:6/856: fsync d0/d8/fcb 0 2024-02-28T16:26:54.152 INFO:tasks.workunit.client.0.smithi148.stdout:7/813: symlink d0/d9/d25/d39/lfa 0 2024-02-28T16:26:54.153 INFO:tasks.workunit.client.1.smithi157.stdout:7/54: creat df/f16 x:0 0 0 2024-02-28T16:26:54.156 INFO:tasks.workunit.client.1.smithi157.stdout:5/57: rename d0/f6 to d0/d9/f15 0 2024-02-28T16:26:54.156 INFO:tasks.workunit.client.0.smithi148.stdout:4/712: chown d8/d40/dc3/dd3/da3 1593681 1 2024-02-28T16:26:54.163 INFO:tasks.workunit.client.0.smithi148.stdout:7/814: mknod d0/d9/d25/d96/cfb 0 2024-02-28T16:26:54.166 INFO:tasks.workunit.client.0.smithi148.stdout:4/713: creat d8/d71/ff4 x:0 0 0 2024-02-28T16:26:54.168 INFO:tasks.workunit.client.1.smithi157.stdout:1/53: getdents . 0 2024-02-28T16:26:54.170 INFO:tasks.workunit.client.0.smithi148.stdout:6/857: dread d0/d22/f65 [0,4194304] 0 2024-02-28T16:26:54.171 INFO:tasks.workunit.client.0.smithi148.stdout:7/815: mkdir d0/dd5/de2/dec/dfc 0 2024-02-28T16:26:54.175 INFO:tasks.workunit.client.0.smithi148.stdout:5/825: getdents d1/db/d60/d7a/d98 0 2024-02-28T16:26:54.177 INFO:tasks.workunit.client.1.smithi157.stdout:1/54: creat fd x:0 0 0 2024-02-28T16:26:54.179 INFO:tasks.workunit.client.0.smithi148.stdout:6/858: symlink d0/d22/d27/d3e/l118 0 2024-02-28T16:26:54.179 INFO:tasks.workunit.client.0.smithi148.stdout:4/714: dread d8/d37/d91/f9a [0,4194304] 0 2024-02-28T16:26:54.181 INFO:tasks.workunit.client.0.smithi148.stdout:4/715: write d8/f14 [3155574,8307] 0 2024-02-28T16:26:54.183 INFO:tasks.workunit.client.0.smithi148.stdout:6/859: write d0/d8/dfd/f109 [791618,70307] 0 2024-02-28T16:26:54.189 INFO:tasks.workunit.client.1.smithi157.stdout:1/55: mknod ce 0 2024-02-28T16:26:54.197 INFO:tasks.workunit.client.0.smithi148.stdout:7/816: fsync d0/d9/d25/d96/ddf/d1c/d32/fa0 0 2024-02-28T16:26:54.201 INFO:tasks.workunit.client.0.smithi148.stdout:4/716: chown d8/d21/c2a 330138401 1 2024-02-28T16:26:54.205 INFO:tasks.workunit.client.0.smithi148.stdout:5/826: creat d1/db/d60/df0/ddd/ffe x:0 0 0 2024-02-28T16:26:54.212 INFO:tasks.workunit.client.0.smithi148.stdout:7/817: unlink d0/d9/d25/c78 0 2024-02-28T16:26:54.215 INFO:tasks.workunit.client.0.smithi148.stdout:7/818: chown d0/c1e 28619067 1 2024-02-28T16:26:54.224 INFO:tasks.workunit.client.0.smithi148.stdout:5/827: dwrite d1/f94 [0,4194304] 0 2024-02-28T16:26:54.226 INFO:tasks.workunit.client.0.smithi148.stdout:7/819: rename d0/d9/d25/d96/ddf/d28/d2b/d6f/de4 to d0/d9/d25/d96/db7/dd4/dfd 0 2024-02-28T16:26:54.228 INFO:tasks.workunit.client.0.smithi148.stdout:5/828: fsync d1/d8/d20/d31/f40 0 2024-02-28T16:26:54.231 INFO:tasks.workunit.client.0.smithi148.stdout:7/820: readlink d0/d9/d25/d96/ddf/d28/d2b/l30 0 2024-02-28T16:26:54.234 INFO:tasks.workunit.client.0.smithi148.stdout:5/829: mkdir d1/d44/d65/ddc/dff 0 2024-02-28T16:26:54.235 INFO:tasks.workunit.client.0.smithi148.stdout:7/821: write d0/d4/fe7 [461015,21720] 0 2024-02-28T16:26:54.236 INFO:tasks.workunit.client.0.smithi148.stdout:4/717: dread d8/d40/dc3/dd3/d17/d6a/f50 [0,4194304] 0 2024-02-28T16:26:54.242 INFO:tasks.workunit.client.0.smithi148.stdout:4/718: creat d8/d37/ff5 x:0 0 0 2024-02-28T16:26:54.248 INFO:tasks.workunit.client.0.smithi148.stdout:7/822: truncate d0/d9/d46/f7a 5062069 0 2024-02-28T16:26:54.250 INFO:tasks.workunit.client.0.smithi148.stdout:8/967: dwrite d1/dd/f10 [0,4194304] 0 2024-02-28T16:26:54.254 INFO:tasks.workunit.client.0.smithi148.stdout:5/830: getdents d1/d8/d23 0 2024-02-28T16:26:54.257 INFO:tasks.workunit.client.0.smithi148.stdout:8/968: fsync d1/dd/d51/d9b/dc6/f11f 0 2024-02-28T16:26:54.258 INFO:tasks.workunit.client.0.smithi148.stdout:5/831: readlink d1/db/d60/d7a/d87/l97 0 2024-02-28T16:26:54.261 INFO:tasks.workunit.client.0.smithi148.stdout:7/823: getdents d0/d9/d25/d96/ddf/d28 0 2024-02-28T16:26:54.262 INFO:tasks.workunit.client.0.smithi148.stdout:4/719: dwrite d8/d40/d73/f96 [0,4194304] 0 2024-02-28T16:26:54.270 INFO:tasks.workunit.client.0.smithi148.stdout:8/969: rename d1/d3/d18/d48 to d1/d3/d18/d5a/d13f 0 2024-02-28T16:26:54.272 INFO:tasks.workunit.client.0.smithi148.stdout:5/832: creat d1/db/d60/d7a/f100 x:0 0 0 2024-02-28T16:26:54.274 INFO:tasks.workunit.client.0.smithi148.stdout:4/720: symlink d8/d21/d3d/d4d/d66/dad/lf6 0 2024-02-28T16:26:54.275 INFO:tasks.workunit.client.0.smithi148.stdout:5/833: readlink d1/d8/d20/d4e/d71/le6 0 2024-02-28T16:26:54.281 INFO:tasks.workunit.client.0.smithi148.stdout:7/824: fdatasync d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/d97/fdb 0 2024-02-28T16:26:54.282 INFO:tasks.workunit.client.0.smithi148.stdout:8/970: read d1/f62 [2607317,57569] 0 2024-02-28T16:26:54.287 INFO:tasks.workunit.client.0.smithi148.stdout:7/825: symlink d0/d18/lfe 0 2024-02-28T16:26:54.287 INFO:tasks.workunit.client.0.smithi148.stdout:4/721: truncate d8/d40/dc3/dd3/f89 923446 0 2024-02-28T16:26:54.289 INFO:tasks.workunit.client.0.smithi148.stdout:8/971: creat d1/d3/d18/d120/d126/d34/f140 x:0 0 0 2024-02-28T16:26:54.290 INFO:tasks.workunit.client.0.smithi148.stdout:7/826: write d0/d9/d25/d96/ddf/d1c/d32/f3b [164272,86820] 0 2024-02-28T16:26:54.301 INFO:tasks.workunit.client.1.smithi157.stdout:4/1: sync 2024-02-28T16:26:54.301 INFO:tasks.workunit.client.0.smithi148.stdout:5/834: dwrite d1/d8/d20/dd8/f56 [0,4194304] 0 2024-02-28T16:26:54.308 INFO:tasks.workunit.client.1.smithi157.stdout:2/69: truncate da/fe 457759 0 2024-02-28T16:26:54.310 INFO:tasks.workunit.client.0.smithi148.stdout:7/827: truncate d0/d9/d25/d96/ddf/d28/d2b/d5c/f85 188894 0 2024-02-28T16:26:54.314 INFO:tasks.workunit.client.0.smithi148.stdout:5/835: write d1/db/f27 [1186409,109398] 0 2024-02-28T16:26:54.317 INFO:tasks.workunit.client.1.smithi157.stdout:2/70: creat da/f19 x:0 0 0 2024-02-28T16:26:54.317 INFO:tasks.workunit.client.0.smithi148.stdout:5/836: chown d1/d44/c72 5 1 2024-02-28T16:26:54.319 INFO:tasks.workunit.client.0.smithi148.stdout:5/837: chown d1/d8/cf3 53 1 2024-02-28T16:26:54.319 INFO:tasks.workunit.client.0.smithi148.stdout:5/838: readlink d1/l19 0 2024-02-28T16:26:54.320 INFO:tasks.workunit.client.1.smithi157.stdout:2/71: fsync da/f12 0 2024-02-28T16:26:54.321 INFO:tasks.workunit.client.0.smithi148.stdout:4/722: dwrite d8/d40/dc3/dd3/d17/d6a/d6c/fe2 [0,4194304] 0 2024-02-28T16:26:54.325 INFO:tasks.workunit.client.1.smithi157.stdout:4/2: link c0 c1 0 2024-02-28T16:26:54.325 INFO:tasks.workunit.client.1.smithi157.stdout:4/3: dread - no filename 2024-02-28T16:26:54.325 INFO:tasks.workunit.client.1.smithi157.stdout:4/4: fsync - no filename 2024-02-28T16:26:54.330 INFO:tasks.workunit.client.1.smithi157.stdout:2/72: creat da/f1a x:0 0 0 2024-02-28T16:26:54.334 INFO:tasks.workunit.client.1.smithi157.stdout:4/5: creat f2 x:0 0 0 2024-02-28T16:26:54.337 INFO:tasks.workunit.client.1.smithi157.stdout:7/55: getdents df 0 2024-02-28T16:26:54.337 INFO:tasks.workunit.client.0.smithi148.stdout:4/723: dwrite d8/d21/f24 [0,4194304] 0 2024-02-28T16:26:54.338 INFO:tasks.workunit.client.1.smithi157.stdout:7/56: read - fd zero size 2024-02-28T16:26:54.341 INFO:tasks.workunit.client.1.smithi157.stdout:5/58: getdents d0 0 2024-02-28T16:26:54.344 INFO:tasks.workunit.client.1.smithi157.stdout:4/6: mkdir d3 0 2024-02-28T16:26:54.346 INFO:tasks.workunit.client.1.smithi157.stdout:7/57: unlink fe 0 2024-02-28T16:26:54.349 INFO:tasks.workunit.client.1.smithi157.stdout:4/7: write f2 [458198,106165] 0 2024-02-28T16:26:54.354 INFO:tasks.workunit.client.1.smithi157.stdout:4/8: write f2 [457658,86861] 0 2024-02-28T16:26:54.361 INFO:tasks.workunit.client.1.smithi157.stdout:1/56: getdents . 0 2024-02-28T16:26:54.365 INFO:tasks.workunit.client.1.smithi157.stdout:4/9: read f2 [54014,8362] 0 2024-02-28T16:26:54.367 INFO:tasks.workunit.client.1.smithi157.stdout:2/73: dwrite da/f15 [0,4194304] 0 2024-02-28T16:26:54.368 INFO:tasks.workunit.client.1.smithi157.stdout:1/57: getdents . 0 2024-02-28T16:26:54.371 INFO:tasks.workunit.client.0.smithi148.stdout:8/972: rmdir d1/dd/d51/d77 39 2024-02-28T16:26:54.371 INFO:tasks.workunit.client.1.smithi157.stdout:4/10: write f2 [879497,42177] 0 2024-02-28T16:26:54.373 INFO:tasks.workunit.client.1.smithi157.stdout:1/58: creat ff x:0 0 0 2024-02-28T16:26:54.373 INFO:tasks.workunit.client.1.smithi157.stdout:4/11: chown f2 1756592 1 2024-02-28T16:26:54.374 INFO:tasks.workunit.client.1.smithi157.stdout:5/59: dwrite d0/d9/f10 [0,4194304] 0 2024-02-28T16:26:54.377 INFO:tasks.workunit.client.1.smithi157.stdout:1/59: write f5 [3096496,48315] 0 2024-02-28T16:26:54.384 INFO:tasks.workunit.client.1.smithi157.stdout:5/60: rmdir d0 39 2024-02-28T16:26:54.385 INFO:tasks.workunit.client.0.smithi148.stdout:6/860: rmdir d0/d8/d21 39 2024-02-28T16:26:54.388 INFO:tasks.workunit.client.0.smithi148.stdout:6/861: truncate d0/d8/fcb 741111 0 2024-02-28T16:26:54.390 INFO:tasks.workunit.client.1.smithi157.stdout:1/60: mkdir d10 0 2024-02-28T16:26:54.391 INFO:tasks.workunit.client.1.smithi157.stdout:4/12: getdents d3 0 2024-02-28T16:26:54.398 INFO:tasks.workunit.client.1.smithi157.stdout:5/61: creat d0/f16 x:0 0 0 2024-02-28T16:26:54.400 INFO:tasks.workunit.client.1.smithi157.stdout:4/13: creat d3/f4 x:0 0 0 2024-02-28T16:26:54.404 INFO:tasks.workunit.client.1.smithi157.stdout:9/16: sync 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/9: sync 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/10: write - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/11: dwrite - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/12: fsync - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/13: dread - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/14: dread - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/15: write - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:8/14: sync 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:6/16: read - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:3/14: sync 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:3/15: dwrite - no filename 2024-02-28T16:26:54.405 INFO:tasks.workunit.client.1.smithi157.stdout:0/81: sync 2024-02-28T16:26:54.407 INFO:tasks.workunit.client.1.smithi157.stdout:0/82: write d1/f6 [3953314,97662] 0 2024-02-28T16:26:54.408 INFO:tasks.workunit.client.1.smithi157.stdout:9/17: write d0/f5 [328250,115888] 0 2024-02-28T16:26:54.408 INFO:tasks.workunit.client.1.smithi157.stdout:1/61: dwrite f5 [0,4194304] 0 2024-02-28T16:26:54.412 INFO:tasks.workunit.client.1.smithi157.stdout:3/16: rmdir d0 39 2024-02-28T16:26:54.412 INFO:tasks.workunit.client.1.smithi157.stdout:3/17: truncate - no filename 2024-02-28T16:26:54.412 INFO:tasks.workunit.client.1.smithi157.stdout:3/18: write - no filename 2024-02-28T16:26:54.416 INFO:tasks.workunit.client.1.smithi157.stdout:6/17: creat f0 x:0 0 0 2024-02-28T16:26:54.419 INFO:tasks.workunit.client.1.smithi157.stdout:0/83: creat d1/d13/f1b x:0 0 0 2024-02-28T16:26:54.422 INFO:tasks.workunit.client.1.smithi157.stdout:9/18: mkdir d0/d6 0 2024-02-28T16:26:54.426 INFO:tasks.workunit.client.1.smithi157.stdout:3/19: chown d0 929081 1 2024-02-28T16:26:54.428 INFO:tasks.workunit.client.1.smithi157.stdout:5/62: dwrite d0/d9/f15 [0,4194304] 0 2024-02-28T16:26:54.429 INFO:tasks.workunit.client.1.smithi157.stdout:9/19: dread d0/f4 [0,4194304] 0 2024-02-28T16:26:54.429 INFO:tasks.workunit.client.0.smithi148.stdout:7/828: unlink d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/f51 0 2024-02-28T16:26:54.430 INFO:tasks.workunit.client.1.smithi157.stdout:1/62: dwrite f5 [0,4194304] 0 2024-02-28T16:26:54.430 INFO:tasks.workunit.client.1.smithi157.stdout:1/63: dread - ff zero size 2024-02-28T16:26:54.432 INFO:tasks.workunit.client.1.smithi157.stdout:6/18: symlink l1 0 2024-02-28T16:26:54.432 INFO:tasks.workunit.client.1.smithi157.stdout:6/19: rmdir - no directory 2024-02-28T16:26:54.433 INFO:tasks.workunit.client.1.smithi157.stdout:6/20: write f0 [469735,73866] 0 2024-02-28T16:26:54.436 INFO:tasks.workunit.client.1.smithi157.stdout:0/84: unlink d1/f11 0 2024-02-28T16:26:54.437 INFO:tasks.workunit.client.1.smithi157.stdout:2/74: truncate da/f12 273809 0 2024-02-28T16:26:54.437 INFO:tasks.workunit.client.0.smithi148.stdout:8/973: truncate d1/d3/f80 192459 0 2024-02-28T16:26:54.439 INFO:tasks.workunit.client.1.smithi157.stdout:2/75: chown da/c11 696778 1 2024-02-28T16:26:54.439 INFO:tasks.workunit.client.0.smithi148.stdout:6/862: mknod d0/d22/d49/d88/d107/c119 0 2024-02-28T16:26:54.443 INFO:tasks.workunit.client.0.smithi148.stdout:7/829: creat d0/dd5/de0/fff x:0 0 0 2024-02-28T16:26:54.443 INFO:tasks.workunit.client.1.smithi157.stdout:2/76: chown da/f14 119711107 1 2024-02-28T16:26:54.444 INFO:tasks.workunit.client.1.smithi157.stdout:4/14: fsync f2 0 2024-02-28T16:26:54.444 INFO:tasks.workunit.client.1.smithi157.stdout:3/20: creat d0/f4 x:0 0 0 2024-02-28T16:26:54.445 INFO:tasks.workunit.client.1.smithi157.stdout:4/15: dread - d3/f4 zero size 2024-02-28T16:26:54.449 INFO:tasks.workunit.client.1.smithi157.stdout:6/21: fdatasync f0 0 2024-02-28T16:26:54.451 INFO:tasks.workunit.client.0.smithi148.stdout:9/961: sync 2024-02-28T16:26:54.451 INFO:tasks.workunit.client.0.smithi148.stdout:3/943: sync 2024-02-28T16:26:54.451 INFO:tasks.workunit.client.0.smithi148.stdout:2/904: sync 2024-02-28T16:26:54.452 INFO:tasks.workunit.client.0.smithi148.stdout:4/724: link d8/d40/dc3/dd3/d5f/f81 d8/d21/d3d/d4d/d66/dad/ff7 0 2024-02-28T16:26:54.453 INFO:tasks.workunit.client.0.smithi148.stdout:9/962: fdatasync d7/d43/ddd/df1/f129 0 2024-02-28T16:26:54.456 INFO:tasks.workunit.client.1.smithi157.stdout:8/15: getdents d1 0 2024-02-28T16:26:54.457 INFO:tasks.workunit.client.0.smithi148.stdout:6/863: creat d0/d22/d27/d3e/d52/f11a x:0 0 0 2024-02-28T16:26:54.458 INFO:tasks.workunit.client.1.smithi157.stdout:0/85: dwrite d1/d8/fc [0,4194304] 0 2024-02-28T16:26:54.459 INFO:tasks.workunit.client.0.smithi148.stdout:7/830: creat d0/d4/d70/f100 x:0 0 0 2024-02-28T16:26:54.460 INFO:tasks.workunit.client.1.smithi157.stdout:8/16: fsync d1/f2 0 2024-02-28T16:26:54.461 INFO:tasks.workunit.client.0.smithi148.stdout:5/839: link d1/d8/d20/d4e/d96/l9f d1/db/d60/d7a/d8b/d80/l101 0 2024-02-28T16:26:54.465 INFO:tasks.workunit.client.1.smithi157.stdout:1/64: mkdir d10/d11 0 2024-02-28T16:26:54.466 INFO:tasks.workunit.client.0.smithi148.stdout:8/974: creat d1/dd/d13/d1a/d115/f141 x:0 0 0 2024-02-28T16:26:54.468 INFO:tasks.workunit.client.0.smithi148.stdout:4/725: read - d8/d40/dc3/dd3/d17/d6a/d6c/f86 zero size 2024-02-28T16:26:54.474 INFO:tasks.workunit.client.0.smithi148.stdout:7/831: write d0/d4/f15 [4274762,52927] 0 2024-02-28T16:26:54.475 INFO:tasks.workunit.client.0.smithi148.stdout:6/864: truncate d0/d8/d21/d9d/fca 1000583 0 2024-02-28T16:26:54.476 INFO:tasks.workunit.client.0.smithi148.stdout:5/840: write d1/d8/d20/d4e/fc7 [1866804,70337] 0 2024-02-28T16:26:54.480 INFO:tasks.workunit.client.1.smithi157.stdout:4/16: dwrite f2 [0,4194304] 0 2024-02-28T16:26:54.480 INFO:tasks.workunit.client.0.smithi148.stdout:3/944: symlink d1/db/d35/d70/d10f/l119 0 2024-02-28T16:26:54.482 INFO:tasks.workunit.client.0.smithi148.stdout:8/975: dread d1/d3/d18/d5a/d13f/d70/d75/d91/dcc/ddf/ff3 [0,4194304] 0 2024-02-28T16:26:54.485 INFO:tasks.workunit.client.1.smithi157.stdout:9/20: rmdir d0/d6 0 2024-02-28T16:26:54.486 INFO:tasks.workunit.client.0.smithi148.stdout:4/726: mknod d8/d21/d3d/d4d/d66/dad/cf8 0 2024-02-28T16:26:54.486 INFO:tasks.workunit.client.1.smithi157.stdout:6/22: dwrite f0 [0,4194304] 0 2024-02-28T16:26:54.489 INFO:tasks.workunit.client.1.smithi157.stdout:4/17: chown d3/f4 28256712 1 2024-02-28T16:26:54.494 INFO:tasks.workunit.client.1.smithi157.stdout:5/63: getdents d0/d8 0 2024-02-28T16:26:54.498 INFO:tasks.workunit.client.0.smithi148.stdout:8/976: write d1/dd/d13/d1a/f44 [4544198,14155] 0 2024-02-28T16:26:54.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/945: rename d1/d13/d19/d1b/l34 to d1/db/d89/l11a 0 2024-02-28T16:26:54.500 INFO:tasks.workunit.client.0.smithi148.stdout:2/905: dread d0/d18/d20/dd3/fc8 [0,4194304] 0 2024-02-28T16:26:54.501 INFO:tasks.workunit.client.1.smithi157.stdout:9/21: dread d0/f4 [0,4194304] 0 2024-02-28T16:26:54.503 INFO:tasks.workunit.client.0.smithi148.stdout:2/906: chown d0/d9/d13/d38/d3a/db3/f8a 4 1 2024-02-28T16:26:54.504 INFO:tasks.workunit.client.1.smithi157.stdout:0/86: dwrite d1/f15 [0,4194304] 0 2024-02-28T16:26:54.504 INFO:tasks.workunit.client.1.smithi157.stdout:5/64: chown d0/d9/d11 11384590 1 2024-02-28T16:26:54.504 INFO:tasks.workunit.client.0.smithi148.stdout:7/832: truncate d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/d97/fdb 529334 0 2024-02-28T16:26:54.505 INFO:tasks.workunit.client.1.smithi157.stdout:8/17: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:26:54.505 INFO:tasks.workunit.client.1.smithi157.stdout:1/65: link f9 d10/f12 0 2024-02-28T16:26:54.509 INFO:tasks.workunit.client.1.smithi157.stdout:4/18: creat d3/f5 x:0 0 0 2024-02-28T16:26:54.510 INFO:tasks.workunit.client.0.smithi148.stdout:4/727: rename d8/d40/dc3/dd3/f36 to d8/d40/dc3/dd3/d17/d6a/d6c/dda/ff9 0 2024-02-28T16:26:54.511 INFO:tasks.workunit.client.1.smithi157.stdout:0/87: truncate d1/d13/f19 546856 0 2024-02-28T16:26:54.512 INFO:tasks.workunit.client.1.smithi157.stdout:5/65: write d0/d9/ff [439635,30133] 0 2024-02-28T16:26:54.512 INFO:tasks.workunit.client.1.smithi157.stdout:4/19: dread - d3/f4 zero size 2024-02-28T16:26:54.513 INFO:tasks.workunit.client.1.smithi157.stdout:4/20: fsync f2 0 2024-02-28T16:26:54.516 INFO:tasks.workunit.client.1.smithi157.stdout:4/21: fdatasync d3/f4 0 2024-02-28T16:26:54.516 INFO:tasks.workunit.client.1.smithi157.stdout:9/22: symlink d0/l7 0 2024-02-28T16:26:54.518 INFO:tasks.workunit.client.1.smithi157.stdout:8/18: readlink l0 0 2024-02-28T16:26:54.518 INFO:tasks.workunit.client.1.smithi157.stdout:4/22: read - d3/f5 zero size 2024-02-28T16:26:54.520 INFO:tasks.workunit.client.1.smithi157.stdout:6/23: dread f0 [0,4194304] 0 2024-02-28T16:26:54.521 INFO:tasks.workunit.client.1.smithi157.stdout:1/66: symlink d10/l13 0 2024-02-28T16:26:54.521 INFO:tasks.workunit.client.1.smithi157.stdout:8/19: write d1/f2 [1059500,123816] 0 2024-02-28T16:26:54.526 INFO:tasks.workunit.client.0.smithi148.stdout:2/907: dwrite d0/d18/d20/dd3/fca [0,4194304] 0 2024-02-28T16:26:54.529 INFO:tasks.workunit.client.0.smithi148.stdout:2/908: dread - d0/d18/d20/dd3/f117 zero size 2024-02-28T16:26:54.530 INFO:tasks.workunit.client.1.smithi157.stdout:4/23: write d3/f5 [518,60269] 0 2024-02-28T16:26:54.532 INFO:tasks.workunit.client.0.smithi148.stdout:8/977: rename d1/dd/d51/f136 to d1/d3/d18/d5a/d13f/d70/d75/d91/dcc/f142 0 2024-02-28T16:26:54.533 INFO:tasks.workunit.client.0.smithi148.stdout:5/841: getdents d1/d8/d20/d4e/d96 0 2024-02-28T16:26:54.539 INFO:tasks.workunit.client.0.smithi148.stdout:6/865: dread d0/d22/d25/f4f [0,4194304] 0 2024-02-28T16:26:54.539 INFO:tasks.workunit.client.1.smithi157.stdout:6/24: mkdir d2 0 2024-02-28T16:26:54.540 INFO:tasks.workunit.client.1.smithi157.stdout:4/24: dread d3/f5 [0,4194304] 0 2024-02-28T16:26:54.540 INFO:tasks.workunit.client.0.smithi148.stdout:7/833: fdatasync d0/d9/d25/d39/f54 0 2024-02-28T16:26:54.541 INFO:tasks.workunit.client.0.smithi148.stdout:8/978: chown d1/d3/f119 736439096 1 2024-02-28T16:26:54.545 INFO:tasks.workunit.client.1.smithi157.stdout:8/20: dwrite d1/f2 [4194304,4194304] 0 2024-02-28T16:26:54.547 INFO:tasks.workunit.client.0.smithi148.stdout:3/946: link d1/d13/d19/d56/f5e d1/d13/d19/d1b/d38/d9b/f11b 0 2024-02-28T16:26:54.553 INFO:tasks.workunit.client.1.smithi157.stdout:5/66: fsync d0/d8/fb 0 2024-02-28T16:26:54.558 INFO:tasks.workunit.client.0.smithi148.stdout:4/728: getdents d8/d21/d3d/dc8 0 2024-02-28T16:26:54.558 INFO:tasks.workunit.client.1.smithi157.stdout:3/21: rmdir d0 39 2024-02-28T16:26:54.560 INFO:tasks.workunit.client.0.smithi148.stdout:2/909: dwrite d0/d18/d9a/fd7 [0,4194304] 0 2024-02-28T16:26:54.563 INFO:tasks.workunit.client.1.smithi157.stdout:9/23: truncate d0/f4 853726 0 2024-02-28T16:26:54.565 INFO:tasks.workunit.client.1.smithi157.stdout:9/24: write d0/f5 [554132,104468] 0 2024-02-28T16:26:54.567 INFO:tasks.workunit.client.1.smithi157.stdout:8/21: fdatasync d1/f2 0 2024-02-28T16:26:54.568 INFO:tasks.workunit.client.1.smithi157.stdout:8/22: dread - d1/f4 zero size 2024-02-28T16:26:54.571 INFO:tasks.workunit.client.1.smithi157.stdout:2/77: fsync da/fe 0 2024-02-28T16:26:54.573 INFO:tasks.workunit.client.1.smithi157.stdout:2/78: dread - da/f1a zero size 2024-02-28T16:26:54.577 INFO:tasks.workunit.client.1.smithi157.stdout:4/25: mknod d3/c6 0 2024-02-28T16:26:54.579 INFO:tasks.workunit.client.0.smithi148.stdout:7/834: mknod d0/d9/d25/d96/ddf/d1c/dbf/c101 0 2024-02-28T16:26:54.585 INFO:tasks.workunit.client.0.smithi148.stdout:6/866: dread d0/d22/d49/d88/d107/f10c [0,4194304] 0 2024-02-28T16:26:54.586 INFO:tasks.workunit.client.0.smithi148.stdout:4/729: unlink d8/d37/c7d 0 2024-02-28T16:26:54.588 INFO:tasks.workunit.client.0.smithi148.stdout:4/730: chown d8/d40/dc3/dd3/l29 114 1 2024-02-28T16:26:54.588 INFO:tasks.workunit.client.0.smithi148.stdout:2/910: symlink d0/d1c/d85/d96/l122 0 2024-02-28T16:26:54.590 INFO:tasks.workunit.client.0.smithi148.stdout:2/911: stat d0/d1d/d52/da3/cfe 0 2024-02-28T16:26:54.591 INFO:tasks.workunit.client.0.smithi148.stdout:2/912: chown d0/da2/cd2 28372 1 2024-02-28T16:26:54.592 INFO:tasks.workunit.client.1.smithi157.stdout:8/23: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:26:54.593 INFO:tasks.workunit.client.1.smithi157.stdout:4/26: dread f2 [0,4194304] 0 2024-02-28T16:26:54.593 INFO:tasks.workunit.client.0.smithi148.stdout:8/979: mkdir d1/d143 0 2024-02-28T16:26:54.595 INFO:tasks.workunit.client.0.smithi148.stdout:2/913: write d0/d1c/d85/d8b/d8f/dc9/f115 [397336,90449] 0 2024-02-28T16:26:54.596 INFO:tasks.workunit.client.1.smithi157.stdout:7/58: dwrite f3 [0,4194304] 0 2024-02-28T16:26:54.596 INFO:tasks.workunit.client.0.smithi148.stdout:3/947: dread d1/d13/d19/f33 [0,4194304] 0 2024-02-28T16:26:54.597 INFO:tasks.workunit.client.1.smithi157.stdout:5/67: write d0/fe [3462852,80552] 0 2024-02-28T16:26:54.598 INFO:tasks.workunit.client.1.smithi157.stdout:0/88: link d1/d13/l14 d1/d8/l1c 0 2024-02-28T16:26:54.599 INFO:tasks.workunit.client.0.smithi148.stdout:6/867: rmdir d0/d22/d27/d3e 39 2024-02-28T16:26:54.600 INFO:tasks.workunit.client.1.smithi157.stdout:7/59: dread - df/f11 zero size 2024-02-28T16:26:54.602 INFO:tasks.workunit.client.1.smithi157.stdout:3/22: write d0/f4 [25073,97056] 0 2024-02-28T16:26:54.602 INFO:tasks.workunit.client.1.smithi157.stdout:5/68: readlink d0/l1 0 2024-02-28T16:26:54.608 INFO:tasks.workunit.client.0.smithi148.stdout:5/842: rename d1/d8/d20/d4e/d84/d92/fde to d1/db/d60/d7a/f102 0 2024-02-28T16:26:54.611 INFO:tasks.workunit.client.0.smithi148.stdout:5/843: write d1/d8/d20/d31/f6c [4822047,58021] 0 2024-02-28T16:26:54.617 INFO:tasks.workunit.client.1.smithi157.stdout:8/24: dread d1/f2 [0,4194304] 0 2024-02-28T16:26:54.619 INFO:tasks.workunit.client.1.smithi157.stdout:6/25: creat d2/f3 x:0 0 0 2024-02-28T16:26:54.620 INFO:tasks.workunit.client.1.smithi157.stdout:4/27: dwrite d3/f4 [0,4194304] 0 2024-02-28T16:26:54.620 INFO:tasks.workunit.client.1.smithi157.stdout:8/25: write d1/f4 [2226357,93402] 0 2024-02-28T16:26:54.622 INFO:tasks.workunit.client.1.smithi157.stdout:2/79: unlink f9 0 2024-02-28T16:26:54.622 INFO:tasks.workunit.client.1.smithi157.stdout:8/26: chown l0 232478 1 2024-02-28T16:26:54.622 INFO:tasks.workunit.client.1.smithi157.stdout:4/28: write d3/f4 [1001739,51051] 0 2024-02-28T16:26:54.624 INFO:tasks.workunit.client.0.smithi148.stdout:8/980: symlink d1/d3/d18/d5a/dbf/l144 0 2024-02-28T16:26:54.628 INFO:tasks.workunit.client.0.smithi148.stdout:2/914: dread d0/d18/f19 [0,4194304] 0 2024-02-28T16:26:54.629 INFO:tasks.workunit.client.0.smithi148.stdout:7/835: rename d0/d9/d46/cab to d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/c102 0 2024-02-28T16:26:54.633 INFO:tasks.workunit.client.0.smithi148.stdout:7/836: fdatasync d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/db4/f84 0 2024-02-28T16:26:54.638 INFO:tasks.workunit.client.0.smithi148.stdout:6/868: symlink d0/d22/d49/dae/d10f/l11b 0 2024-02-28T16:26:54.639 INFO:tasks.workunit.client.1.smithi157.stdout:0/89: creat d1/d8/f1d x:0 0 0 2024-02-28T16:26:54.641 INFO:tasks.workunit.client.1.smithi157.stdout:7/60: rmdir df 39 2024-02-28T16:26:54.644 INFO:tasks.workunit.client.0.smithi148.stdout:8/981: fdatasync d1/dd/d51/d9b/fd6 0 2024-02-28T16:26:54.644 INFO:tasks.workunit.client.0.smithi148.stdout:5/844: dread d1/d8/d20/dd8/ff4 [0,4194304] 0 2024-02-28T16:26:54.645 INFO:tasks.workunit.client.1.smithi157.stdout:7/61: chown l7 38243 1 2024-02-28T16:26:54.646 INFO:tasks.workunit.client.1.smithi157.stdout:1/67: write d10/f12 [1601104,129215] 0 2024-02-28T16:26:54.647 INFO:tasks.workunit.client.1.smithi157.stdout:6/26: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:26:54.647 INFO:tasks.workunit.client.1.smithi157.stdout:5/69: fsync d0/d8/fb 0 2024-02-28T16:26:54.647 INFO:tasks.workunit.client.1.smithi157.stdout:3/23: chown d0/c3 0 1 2024-02-28T16:26:54.649 INFO:tasks.workunit.client.0.smithi148.stdout:5/845: chown d1/d8/d23/f52 1502085 1 2024-02-28T16:26:54.649 INFO:tasks.workunit.client.0.smithi148.stdout:4/731: rename d8/d40/dc3/dd3/d17/d6a/l51 to d8/d71/d85/lfa 0 2024-02-28T16:26:54.651 INFO:tasks.workunit.client.1.smithi157.stdout:2/80: dwrite da/ff [0,4194304] 0 2024-02-28T16:26:54.656 INFO:tasks.workunit.client.1.smithi157.stdout:2/81: write da/f19 [92386,23248] 0 2024-02-28T16:26:54.661 INFO:tasks.workunit.client.0.smithi148.stdout:7/837: rmdir d0/d9/d25/d96/db7 39 2024-02-28T16:26:54.663 INFO:tasks.workunit.client.1.smithi157.stdout:0/90: dread d1/d13/ff [0,4194304] 0 2024-02-28T16:26:54.666 INFO:tasks.workunit.client.1.smithi157.stdout:0/91: read d1/f15 [3514609,105584] 0 2024-02-28T16:26:54.666 INFO:tasks.workunit.client.1.smithi157.stdout:8/27: mkdir d1/d5 0 2024-02-28T16:26:54.672 INFO:tasks.workunit.client.1.smithi157.stdout:4/29: creat d3/f7 x:0 0 0 2024-02-28T16:26:54.673 INFO:tasks.workunit.client.0.smithi148.stdout:2/915: creat d0/d18/d20/ddd/d11b/f123 x:0 0 0 2024-02-28T16:26:54.675 INFO:tasks.workunit.client.0.smithi148.stdout:3/948: dwrite d1/db/f22 [4194304,4194304] 0 2024-02-28T16:26:54.677 INFO:tasks.workunit.client.0.smithi148.stdout:2/916: write d0/d66/d76/fe9 [841975,5855] 0 2024-02-28T16:26:54.677 INFO:tasks.workunit.client.0.smithi148.stdout:4/732: rename d8/f14 to d8/d37/d91/db2/ffb 0 2024-02-28T16:26:54.679 INFO:tasks.workunit.client.0.smithi148.stdout:4/733: readlink d8/d40/l90 0 2024-02-28T16:26:54.687 INFO:tasks.workunit.client.1.smithi157.stdout:7/62: dread - df/f10 zero size 2024-02-28T16:26:54.687 INFO:tasks.workunit.client.0.smithi148.stdout:6/869: unlink d0/d22/d25/d76/ced 0 2024-02-28T16:26:54.689 INFO:tasks.workunit.client.1.smithi157.stdout:6/27: write f0 [2168102,95489] 0 2024-02-28T16:26:54.690 INFO:tasks.workunit.client.1.smithi157.stdout:6/28: rename d2 to d2/d4 22 2024-02-28T16:26:54.692 INFO:tasks.workunit.client.1.smithi157.stdout:5/70: symlink d0/d9/d11/l17 0 2024-02-28T16:26:54.697 INFO:tasks.workunit.client.0.smithi148.stdout:2/917: creat d0/d1c/d6e/f124 x:0 0 0 2024-02-28T16:26:54.701 INFO:tasks.workunit.client.0.smithi148.stdout:6/870: creat d0/d4/dba/d71/db4/f11c x:0 0 0 2024-02-28T16:26:54.702 INFO:tasks.workunit.client.1.smithi157.stdout:5/71: dread d0/d9/f10 [0,4194304] 0 2024-02-28T16:26:54.702 INFO:tasks.workunit.client.1.smithi157.stdout:0/92: symlink d1/l1e 0 2024-02-28T16:26:54.703 INFO:tasks.workunit.client.1.smithi157.stdout:5/72: stat d0/ld 0 2024-02-28T16:26:54.704 INFO:tasks.workunit.client.1.smithi157.stdout:0/93: chown d1/d8/c1a 690 1 2024-02-28T16:26:54.704 INFO:tasks.workunit.client.1.smithi157.stdout:8/28: symlink d1/l6 0 2024-02-28T16:26:54.705 INFO:tasks.workunit.client.0.smithi148.stdout:4/734: dread d8/f26 [4194304,4194304] 0 2024-02-28T16:26:54.705 INFO:tasks.workunit.client.1.smithi157.stdout:8/29: read d1/f2 [1326634,45851] 0 2024-02-28T16:26:54.707 INFO:tasks.workunit.client.0.smithi148.stdout:5/846: write d1/f5f [3570005,99665] 0 2024-02-28T16:26:54.711 INFO:tasks.workunit.client.1.smithi157.stdout:6/29: write d2/f3 [4506660,82866] 0 2024-02-28T16:26:54.712 INFO:tasks.workunit.client.1.smithi157.stdout:7/63: creat df/f17 x:0 0 0 2024-02-28T16:26:54.716 INFO:tasks.workunit.client.0.smithi148.stdout:3/949: rename d1/db/d45 to d1/d13/d19/d32/d11c 0 2024-02-28T16:26:54.716 INFO:tasks.workunit.client.1.smithi157.stdout:9/25: write d0/f4 [489826,110821] 0 2024-02-28T16:26:54.719 INFO:tasks.workunit.client.0.smithi148.stdout:2/918: mkdir d0/d1d/d52/d125 0 2024-02-28T16:26:54.722 INFO:tasks.workunit.client.0.smithi148.stdout:5/847: mknod d1/db/d60/d7a/d87/c103 0 2024-02-28T16:26:54.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/848: chown d1/d8/d20/d4e/d84/fa7 901357482 1 2024-02-28T16:26:54.724 INFO:tasks.workunit.client.1.smithi157.stdout:1/68: creat d10/d11/f14 x:0 0 0 2024-02-28T16:26:54.726 INFO:tasks.workunit.client.0.smithi148.stdout:3/950: creat d1/d13/d19/d1b/d38/d113/d103/f11d x:0 0 0 2024-02-28T16:26:54.727 INFO:tasks.workunit.client.1.smithi157.stdout:6/30: dwrite f0 [0,4194304] 0 2024-02-28T16:26:54.728 INFO:tasks.workunit.client.1.smithi157.stdout:2/82: truncate da/f12 1093741 0 2024-02-28T16:26:54.728 INFO:tasks.workunit.client.1.smithi157.stdout:4/30: write d3/f5 [904852,99589] 0 2024-02-28T16:26:54.731 INFO:tasks.workunit.client.0.smithi148.stdout:6/871: write d0/d22/d27/fc7 [620791,102313] 0 2024-02-28T16:26:54.739 INFO:tasks.workunit.client.0.smithi148.stdout:7/838: dwrite d0/d9/d25/d96/ddf/d28/d2b/d6f/f7f [0,4194304] 0 2024-02-28T16:26:54.742 INFO:tasks.workunit.client.1.smithi157.stdout:1/69: dread f2 [0,4194304] 0 2024-02-28T16:26:54.743 INFO:tasks.workunit.client.1.smithi157.stdout:8/30: rename l0 to d1/l7 0 2024-02-28T16:26:54.745 INFO:tasks.workunit.client.1.smithi157.stdout:4/31: dread d3/f4 [0,4194304] 0 2024-02-28T16:26:54.749 INFO:tasks.workunit.client.1.smithi157.stdout:7/64: mknod df/c18 0 2024-02-28T16:26:54.749 INFO:tasks.workunit.client.0.smithi148.stdout:2/919: write d0/d9/f105 [4457904,95789] 0 2024-02-28T16:26:54.750 INFO:tasks.workunit.client.1.smithi157.stdout:7/65: readlink df/l12 0 2024-02-28T16:26:54.750 INFO:tasks.workunit.client.1.smithi157.stdout:3/24: link d0/c3 d0/c5 0 2024-02-28T16:26:54.751 INFO:tasks.workunit.client.1.smithi157.stdout:6/31: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:26:54.752 INFO:tasks.workunit.client.1.smithi157.stdout:3/25: write d0/f4 [1120191,21063] 0 2024-02-28T16:26:54.753 INFO:tasks.workunit.client.1.smithi157.stdout:9/26: unlink d0/l7 0 2024-02-28T16:26:54.753 INFO:tasks.workunit.client.1.smithi157.stdout:6/32: write d2/f3 [4950370,58539] 0 2024-02-28T16:26:54.754 INFO:tasks.workunit.client.0.smithi148.stdout:4/735: getdents d8/d40/dc3/dd3/da3 0 2024-02-28T16:26:54.755 INFO:tasks.workunit.client.0.smithi148.stdout:2/920: read d0/d18/d9a/fd7 [1630095,96183] 0 2024-02-28T16:26:54.756 INFO:tasks.workunit.client.1.smithi157.stdout:6/33: write f0 [427345,127760] 0 2024-02-28T16:26:54.758 INFO:tasks.workunit.client.0.smithi148.stdout:6/872: creat d0/d22/d25/d114/f11d x:0 0 0 2024-02-28T16:26:54.758 INFO:tasks.workunit.client.0.smithi148.stdout:3/951: link d1/lb3 d1/d13/d19/d1b/d38/d9b/l11e 0 2024-02-28T16:26:54.764 INFO:tasks.workunit.client.1.smithi157.stdout:5/73: link d0/f16 d0/d8/f18 0 2024-02-28T16:26:54.764 INFO:tasks.workunit.client.0.smithi148.stdout:2/921: symlink d0/d59/l126 0 2024-02-28T16:26:54.765 INFO:tasks.workunit.client.1.smithi157.stdout:3/26: fdatasync d0/f4 0 2024-02-28T16:26:54.766 INFO:tasks.workunit.client.0.smithi148.stdout:2/922: chown d0/d9/d13/d38/d3a/l3d 92423161 1 2024-02-28T16:26:54.767 INFO:tasks.workunit.client.0.smithi148.stdout:5/849: dread d1/db/d60/d7a/d8b/f45 [0,4194304] 0 2024-02-28T16:26:54.767 INFO:tasks.workunit.client.1.smithi157.stdout:1/70: symlink d10/d11/l15 0 2024-02-28T16:26:54.768 INFO:tasks.workunit.client.0.smithi148.stdout:3/952: symlink d1/db5/l11f 0 2024-02-28T16:26:54.768 INFO:tasks.workunit.client.1.smithi157.stdout:1/71: chown f9 1112 1 2024-02-28T16:26:54.770 INFO:tasks.workunit.client.1.smithi157.stdout:8/31: unlink d1/l6 0 2024-02-28T16:26:54.771 INFO:tasks.workunit.client.1.smithi157.stdout:7/66: dwrite fd [0,4194304] 0 2024-02-28T16:26:54.772 INFO:tasks.workunit.client.1.smithi157.stdout:8/32: write d1/f4 [4113983,68807] 0 2024-02-28T16:26:54.773 INFO:tasks.workunit.client.0.smithi148.stdout:6/873: mknod d0/d22/d49/d88/d107/da2/c11e 0 2024-02-28T16:26:54.774 INFO:tasks.workunit.client.1.smithi157.stdout:7/67: write fd [53857,76054] 0 2024-02-28T16:26:54.774 INFO:tasks.workunit.client.1.smithi157.stdout:4/32: creat d3/f8 x:0 0 0 2024-02-28T16:26:54.777 INFO:tasks.workunit.client.1.smithi157.stdout:3/27: dread d0/f4 [0,4194304] 0 2024-02-28T16:26:54.779 INFO:tasks.workunit.client.0.smithi148.stdout:2/923: rename d0/d18/d20/f50 to d0/d18/d9a/f127 0 2024-02-28T16:26:54.783 INFO:tasks.workunit.client.0.smithi148.stdout:4/736: dwrite d8/d40/dc3/dd3/f20 [0,4194304] 0 2024-02-28T16:26:54.784 INFO:tasks.workunit.client.0.smithi148.stdout:6/874: dread - d0/d8/d21/fd0 zero size 2024-02-28T16:26:54.784 INFO:tasks.workunit.client.1.smithi157.stdout:0/94: truncate d1/d8/fc 844447 0 2024-02-28T16:26:54.788 INFO:tasks.workunit.client.1.smithi157.stdout:9/27: mknod d0/c8 0 2024-02-28T16:26:54.792 INFO:tasks.workunit.client.1.smithi157.stdout:6/34: creat d2/f5 x:0 0 0 2024-02-28T16:26:54.795 INFO:tasks.workunit.client.1.smithi157.stdout:2/83: read da/f12 [432886,72214] 0 2024-02-28T16:26:54.795 INFO:tasks.workunit.client.0.smithi148.stdout:4/737: fsync d8/d21/f56 0 2024-02-28T16:26:54.801 INFO:tasks.workunit.client.1.smithi157.stdout:1/72: creat d10/f16 x:0 0 0 2024-02-28T16:26:54.806 INFO:tasks.workunit.client.0.smithi148.stdout:2/924: getdents d0/d1d 0 2024-02-28T16:26:54.806 INFO:tasks.workunit.client.1.smithi157.stdout:7/68: mkdir df/d19 0 2024-02-28T16:26:54.806 INFO:tasks.workunit.client.1.smithi157.stdout:6/35: dwrite f0 [0,4194304] 0 2024-02-28T16:26:54.807 INFO:tasks.workunit.client.1.smithi157.stdout:4/33: creat d3/f9 x:0 0 0 2024-02-28T16:26:54.808 INFO:tasks.workunit.client.0.smithi148.stdout:2/925: stat d0/d1c/d85 0 2024-02-28T16:26:54.808 INFO:tasks.workunit.client.0.smithi148.stdout:3/953: dwrite d1/d3f/da5/dda/fa2 [0,4194304] 0 2024-02-28T16:26:54.809 INFO:tasks.workunit.client.1.smithi157.stdout:3/28: mkdir d0/d6 0 2024-02-28T16:26:54.816 INFO:tasks.workunit.client.0.smithi148.stdout:3/954: fdatasync d1/db/d35/d52/f54 0 2024-02-28T16:26:54.820 INFO:tasks.workunit.client.1.smithi157.stdout:2/84: creat da/f1b x:0 0 0 2024-02-28T16:26:54.822 INFO:tasks.workunit.client.1.smithi157.stdout:1/73: mkdir d10/d11/d17 0 2024-02-28T16:26:54.823 INFO:tasks.workunit.client.1.smithi157.stdout:5/74: write d0/d9/f10 [1997825,75269] 0 2024-02-28T16:26:54.823 INFO:tasks.workunit.client.0.smithi148.stdout:6/875: write d0/f4c [6941416,66295] 0 2024-02-28T16:26:54.825 INFO:tasks.workunit.client.1.smithi157.stdout:8/33: symlink d1/d5/l8 0 2024-02-28T16:26:54.827 INFO:tasks.workunit.client.0.smithi148.stdout:2/926: unlink d0/d1c/d85/d8b/d8f/df3/f4f 0 2024-02-28T16:26:54.828 INFO:tasks.workunit.client.1.smithi157.stdout:8/34: write d1/f4 [684614,86612] 0 2024-02-28T16:26:54.829 INFO:tasks.workunit.client.1.smithi157.stdout:7/69: unlink la 0 2024-02-28T16:26:54.830 INFO:tasks.workunit.client.1.smithi157.stdout:8/35: chown d1/d5/l8 4389 1 2024-02-28T16:26:54.831 INFO:tasks.workunit.client.0.smithi148.stdout:6/876: symlink d0/d4/dba/de9/l11f 0 2024-02-28T16:26:54.832 INFO:tasks.workunit.client.0.smithi148.stdout:3/955: dread d1/db/d35/f6b [0,4194304] 0 2024-02-28T16:26:54.832 INFO:tasks.workunit.client.1.smithi157.stdout:6/36: creat d2/f6 x:0 0 0 2024-02-28T16:26:54.832 INFO:tasks.workunit.client.1.smithi157.stdout:8/36: read d1/f4 [820598,20038] 0 2024-02-28T16:26:54.833 INFO:tasks.workunit.client.1.smithi157.stdout:4/34: mkdir d3/da 0 2024-02-28T16:26:54.833 INFO:tasks.workunit.client.1.smithi157.stdout:6/37: write d2/f3 [5360463,97192] 0 2024-02-28T16:26:54.834 INFO:tasks.workunit.client.1.smithi157.stdout:8/37: write d1/f2 [4286011,129685] 0 2024-02-28T16:26:54.835 INFO:tasks.workunit.client.0.smithi148.stdout:2/927: truncate d0/dd/fe4 1679932 0 2024-02-28T16:26:54.836 INFO:tasks.workunit.client.1.smithi157.stdout:3/29: symlink d0/l7 0 2024-02-28T16:26:54.838 INFO:tasks.workunit.client.1.smithi157.stdout:0/95: write d1/d13/ff [3028834,103252] 0 2024-02-28T16:26:54.840 INFO:tasks.workunit.client.0.smithi148.stdout:6/877: creat d0/d22/d49/dae/d10f/f120 x:0 0 0 2024-02-28T16:26:54.840 INFO:tasks.workunit.client.0.smithi148.stdout:4/738: dwrite d8/d21/f30 [0,4194304] 0 2024-02-28T16:26:54.842 INFO:tasks.workunit.client.1.smithi157.stdout:2/85: symlink da/l1c 0 2024-02-28T16:26:54.848 INFO:tasks.workunit.client.1.smithi157.stdout:1/74: mkdir d10/d11/d18 0 2024-02-28T16:26:54.849 INFO:tasks.workunit.client.1.smithi157.stdout:1/75: write fd [438059,59014] 0 2024-02-28T16:26:54.849 INFO:tasks.workunit.client.1.smithi157.stdout:7/70: creat df/f1a x:0 0 0 2024-02-28T16:26:54.851 INFO:tasks.workunit.client.1.smithi157.stdout:1/76: write fd [462700,111706] 0 2024-02-28T16:26:54.854 INFO:tasks.workunit.client.0.smithi148.stdout:3/956: creat d1/f120 x:0 0 0 2024-02-28T16:26:54.856 INFO:tasks.workunit.client.1.smithi157.stdout:6/38: mkdir d2/d7 0 2024-02-28T16:26:54.857 INFO:tasks.workunit.client.0.smithi148.stdout:3/957: chown d1/db/d35/d70/la7 3 1 2024-02-28T16:26:54.857 INFO:tasks.workunit.client.1.smithi157.stdout:8/38: symlink d1/l9 0 2024-02-28T16:26:54.859 INFO:tasks.workunit.client.1.smithi157.stdout:3/30: creat d0/f8 x:0 0 0 2024-02-28T16:26:54.859 INFO:tasks.workunit.client.1.smithi157.stdout:6/39: truncate d2/f3 6443844 0 2024-02-28T16:26:54.861 INFO:tasks.workunit.client.1.smithi157.stdout:3/31: dread - d0/f8 zero size 2024-02-28T16:26:54.866 INFO:tasks.workunit.client.1.smithi157.stdout:6/40: chown d2/f5 5075 1 2024-02-28T16:26:54.867 INFO:tasks.workunit.client.0.smithi148.stdout:6/878: dwrite d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:54.868 INFO:tasks.workunit.client.1.smithi157.stdout:6/41: stat f0 0 2024-02-28T16:26:54.869 INFO:tasks.workunit.client.1.smithi157.stdout:3/32: write d0/f8 [525916,66579] 0 2024-02-28T16:26:54.873 INFO:tasks.workunit.client.0.smithi148.stdout:3/958: link d1/db/d35/d52/f54 d1/d13/dce/f121 0 2024-02-28T16:26:54.874 INFO:tasks.workunit.client.1.smithi157.stdout:3/33: truncate d0/f8 796981 0 2024-02-28T16:26:54.874 INFO:tasks.workunit.client.1.smithi157.stdout:4/35: mknod d3/da/cb 0 2024-02-28T16:26:54.875 INFO:tasks.workunit.client.0.smithi148.stdout:6/879: fsync d0/d22/d49/d88/d107/f9c 0 2024-02-28T16:26:54.877 INFO:tasks.workunit.client.1.smithi157.stdout:7/71: dwrite df/f16 [0,4194304] 0 2024-02-28T16:26:54.877 INFO:tasks.workunit.client.1.smithi157.stdout:8/39: dwrite d1/f2 [4194304,4194304] 0 2024-02-28T16:26:54.878 INFO:tasks.workunit.client.1.smithi157.stdout:7/72: chown df/l12 193860 1 2024-02-28T16:26:54.879 INFO:tasks.workunit.client.0.smithi148.stdout:6/880: write d0/d22/d27/f62 [2276530,65828] 0 2024-02-28T16:26:54.881 INFO:tasks.workunit.client.1.smithi157.stdout:3/34: dread d0/f4 [0,4194304] 0 2024-02-28T16:26:54.881 INFO:tasks.workunit.client.0.smithi148.stdout:6/881: chown d0/d4/dba/d71 89297099 1 2024-02-28T16:26:54.882 INFO:tasks.workunit.client.1.smithi157.stdout:9/28: getdents d0 0 2024-02-28T16:26:54.883 INFO:tasks.workunit.client.1.smithi157.stdout:7/73: truncate df/f17 304391 0 2024-02-28T16:26:54.890 INFO:tasks.workunit.client.0.smithi148.stdout:2/928: dwrite d0/d1c/d49/fa4 [0,4194304] 0 2024-02-28T16:26:54.892 INFO:tasks.workunit.client.0.smithi148.stdout:4/739: dwrite d8/d37/d91/f9a [0,4194304] 0 2024-02-28T16:26:54.895 INFO:tasks.workunit.client.1.smithi157.stdout:8/40: dread d1/f2 [4194304,4194304] 0 2024-02-28T16:26:54.896 INFO:tasks.workunit.client.0.smithi148.stdout:2/929: write d0/d18/d9a/f87 [3460778,52347] 0 2024-02-28T16:26:54.900 INFO:tasks.workunit.client.0.smithi148.stdout:2/930: read d0/d9/f21 [1367442,13531] 0 2024-02-28T16:26:54.900 INFO:tasks.workunit.client.1.smithi157.stdout:9/29: dread d0/f3 [0,4194304] 0 2024-02-28T16:26:54.900 INFO:tasks.workunit.client.1.smithi157.stdout:3/35: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:26:54.901 INFO:tasks.workunit.client.0.smithi148.stdout:3/959: getdents d1/db/d35/d52 0 2024-02-28T16:26:54.905 INFO:tasks.workunit.client.0.smithi148.stdout:4/740: link d8/d71/ff4 d8/d40/dc3/dd3/d17/ffc 0 2024-02-28T16:26:54.907 INFO:tasks.workunit.client.0.smithi148.stdout:2/931: mknod d0/d9/d13/d38/d3a/db3/c128 0 2024-02-28T16:26:54.909 INFO:tasks.workunit.client.0.smithi148.stdout:2/932: readlink d0/d1c/d85/d8b/d8f/l9f 0 2024-02-28T16:26:54.911 INFO:tasks.workunit.client.0.smithi148.stdout:3/960: mknod d1/d13/d19/d1b/d10a/c122 0 2024-02-28T16:26:54.911 INFO:tasks.workunit.client.0.smithi148.stdout:4/741: symlink d8/d37/d91/lfd 0 2024-02-28T16:26:54.917 INFO:tasks.workunit.client.0.smithi148.stdout:3/961: creat d1/d13/d19/d56/d5b/de9/f123 x:0 0 0 2024-02-28T16:26:54.920 INFO:tasks.workunit.client.0.smithi148.stdout:3/962: creat d1/db5/f124 x:0 0 0 2024-02-28T16:26:54.922 INFO:tasks.workunit.client.0.smithi148.stdout:3/963: read d1/db/f65 [2941001,59615] 0 2024-02-28T16:26:54.926 INFO:tasks.workunit.client.0.smithi148.stdout:3/964: unlink d1/db/d35/d70/l86 0 2024-02-28T16:26:54.927 INFO:tasks.workunit.client.0.smithi148.stdout:3/965: dread - d1/db5/f124 zero size 2024-02-28T16:26:54.932 INFO:tasks.workunit.client.0.smithi148.stdout:3/966: mknod d1/d13/d19/d56/d5b/d115/c125 0 2024-02-28T16:26:54.933 INFO:tasks.workunit.client.0.smithi148.stdout:2/933: dread d0/dd/fab [0,4194304] 0 2024-02-28T16:26:54.936 INFO:tasks.workunit.client.0.smithi148.stdout:2/934: write d0/d1c/d85/d8b/fef [1359910,15917] 0 2024-02-28T16:26:54.939 INFO:tasks.workunit.client.0.smithi148.stdout:3/967: rename d1/d13/d19/d32/d9e/dfa/f84 to d1/d13/d19/d1b/d10a/f126 0 2024-02-28T16:26:54.943 INFO:tasks.workunit.client.0.smithi148.stdout:3/968: mkdir d1/db/d35/d70/d9c/d127 0 2024-02-28T16:26:54.953 INFO:tasks.workunit.client.1.smithi157.stdout:4/36: mknod d3/cc 0 2024-02-28T16:26:54.955 INFO:tasks.workunit.client.1.smithi157.stdout:5/75: sync 2024-02-28T16:26:54.955 INFO:tasks.workunit.client.1.smithi157.stdout:4/37: dread - d3/f9 zero size 2024-02-28T16:26:54.955 INFO:tasks.workunit.client.1.smithi157.stdout:7/74: mknod df/c1b 0 2024-02-28T16:26:54.956 INFO:tasks.workunit.client.1.smithi157.stdout:8/41: symlink d1/la 0 2024-02-28T16:26:54.957 INFO:tasks.workunit.client.1.smithi157.stdout:3/36: mknod d0/c9 0 2024-02-28T16:26:54.959 INFO:tasks.workunit.client.1.smithi157.stdout:6/42: mkdir d2/d7/d8 0 2024-02-28T16:26:54.959 INFO:tasks.workunit.client.1.smithi157.stdout:8/42: readlink d1/la 0 2024-02-28T16:26:54.959 INFO:tasks.workunit.client.1.smithi157.stdout:1/77: link lc d10/d11/d17/l19 0 2024-02-28T16:26:54.960 INFO:tasks.workunit.client.1.smithi157.stdout:9/30: link d0/f5 d0/f9 0 2024-02-28T16:26:54.961 INFO:tasks.workunit.client.1.smithi157.stdout:5/76: creat d0/f19 x:0 0 0 2024-02-28T16:26:54.962 INFO:tasks.workunit.client.1.smithi157.stdout:2/86: link da/fe da/f1d 0 2024-02-28T16:26:54.964 INFO:tasks.workunit.client.1.smithi157.stdout:4/38: creat d3/da/fd x:0 0 0 2024-02-28T16:26:54.964 INFO:tasks.workunit.client.1.smithi157.stdout:1/78: fdatasync d10/d11/f14 0 2024-02-28T16:26:54.966 INFO:tasks.workunit.client.1.smithi157.stdout:2/87: fdatasync da/f14 0 2024-02-28T16:26:54.967 INFO:tasks.workunit.client.1.smithi157.stdout:3/37: link d0/f8 d0/d6/fa 0 2024-02-28T16:26:54.967 INFO:tasks.workunit.client.1.smithi157.stdout:1/79: stat d10/l13 0 2024-02-28T16:26:54.967 INFO:tasks.workunit.client.1.smithi157.stdout:7/75: rmdir df/d19 0 2024-02-28T16:26:54.968 INFO:tasks.workunit.client.1.smithi157.stdout:5/77: symlink d0/d9/d11/l1a 0 2024-02-28T16:26:54.969 INFO:tasks.workunit.client.1.smithi157.stdout:4/39: symlink d3/le 0 2024-02-28T16:26:54.972 INFO:tasks.workunit.client.1.smithi157.stdout:2/88: rename da/f14 to da/f1e 0 2024-02-28T16:26:54.973 INFO:tasks.workunit.client.1.smithi157.stdout:9/31: dread d0/f9 [0,4194304] 0 2024-02-28T16:26:54.975 INFO:tasks.workunit.client.1.smithi157.stdout:3/38: write d0/d6/fa [379902,111671] 0 2024-02-28T16:26:54.976 INFO:tasks.workunit.client.1.smithi157.stdout:9/32: chown d0/f9 24 1 2024-02-28T16:26:54.976 INFO:tasks.workunit.client.1.smithi157.stdout:5/78: rmdir d0/d9/d11/d12 0 2024-02-28T16:26:54.982 INFO:tasks.workunit.client.1.smithi157.stdout:9/33: creat d0/fa x:0 0 0 2024-02-28T16:26:54.982 INFO:tasks.workunit.client.1.smithi157.stdout:5/79: truncate d0/f16 968688 0 2024-02-28T16:26:54.987 INFO:tasks.workunit.client.1.smithi157.stdout:5/80: mkdir d0/d9/d1b 0 2024-02-28T16:26:54.994 INFO:tasks.workunit.client.1.smithi157.stdout:6/43: dwrite d2/f3 [4194304,4194304] 0 2024-02-28T16:26:54.995 INFO:tasks.workunit.client.1.smithi157.stdout:5/81: write d0/d9/ff [645740,73695] 0 2024-02-28T16:26:54.996 INFO:tasks.workunit.client.1.smithi157.stdout:6/44: readlink l1 0 2024-02-28T16:26:54.998 INFO:tasks.workunit.client.1.smithi157.stdout:6/45: rename d2 to d2/d9 22 2024-02-28T16:26:54.998 INFO:tasks.workunit.client.1.smithi157.stdout:7/76: dwrite f0 [0,4194304] 0 2024-02-28T16:26:55.000 INFO:tasks.workunit.client.1.smithi157.stdout:1/80: dwrite fa [0,4194304] 0 2024-02-28T16:26:55.002 INFO:tasks.workunit.client.1.smithi157.stdout:5/82: creat d0/f1c x:0 0 0 2024-02-28T16:26:55.004 INFO:tasks.workunit.client.1.smithi157.stdout:1/81: write d10/f16 [630811,65885] 0 2024-02-28T16:26:55.005 INFO:tasks.workunit.client.1.smithi157.stdout:1/82: stat l6 0 2024-02-28T16:26:55.007 INFO:tasks.workunit.client.1.smithi157.stdout:6/46: mkdir d2/d7/d8/da 0 2024-02-28T16:26:55.020 INFO:tasks.workunit.client.1.smithi157.stdout:6/47: creat d2/d7/d8/fb x:0 0 0 2024-02-28T16:26:55.021 INFO:tasks.workunit.client.1.smithi157.stdout:6/48: dread - d2/f5 zero size 2024-02-28T16:26:55.023 INFO:tasks.workunit.client.1.smithi157.stdout:6/49: write d2/f5 [195383,61554] 0 2024-02-28T16:26:55.027 INFO:tasks.workunit.client.1.smithi157.stdout:1/83: creat d10/d11/d17/f1a x:0 0 0 2024-02-28T16:26:55.027 INFO:tasks.workunit.client.0.smithi148.stdout:6/882: write d0/d22/fa6 [4569542,31029] 0 2024-02-28T16:26:55.030 INFO:tasks.workunit.client.1.smithi157.stdout:1/84: dread - d10/d11/d17/f1a zero size 2024-02-28T16:26:55.032 INFO:tasks.workunit.client.1.smithi157.stdout:1/85: write d10/d11/d17/f1a [262369,30239] 0 2024-02-28T16:26:55.033 INFO:tasks.workunit.client.0.smithi148.stdout:6/883: mkdir d0/d22/d25/dcc/d121 0 2024-02-28T16:26:55.036 INFO:tasks.workunit.client.1.smithi157.stdout:1/86: creat d10/f1b x:0 0 0 2024-02-28T16:26:55.042 INFO:tasks.workunit.client.1.smithi157.stdout:1/87: creat d10/d11/f1c x:0 0 0 2024-02-28T16:26:55.043 INFO:tasks.workunit.client.1.smithi157.stdout:6/50: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:26:55.046 INFO:tasks.workunit.client.0.smithi148.stdout:3/969: dread d1/d13/d19/f28 [0,4194304] 0 2024-02-28T16:26:55.047 INFO:tasks.workunit.client.1.smithi157.stdout:1/88: symlink d10/d11/d17/l1d 0 2024-02-28T16:26:55.063 INFO:tasks.workunit.client.0.smithi148.stdout:3/970: dwrite d1/db/d35/d70/d9c/fe4 [0,4194304] 0 2024-02-28T16:26:55.067 INFO:tasks.workunit.client.1.smithi157.stdout:1/89: dwrite f4 [0,4194304] 0 2024-02-28T16:26:55.068 INFO:tasks.workunit.client.1.smithi157.stdout:1/90: stat d10/f12 0 2024-02-28T16:26:55.072 INFO:tasks.workunit.client.0.smithi148.stdout:2/935: truncate d0/dd/f88 720957 0 2024-02-28T16:26:55.073 INFO:tasks.workunit.client.1.smithi157.stdout:1/91: truncate f9 2626858 0 2024-02-28T16:26:55.074 INFO:tasks.workunit.client.1.smithi157.stdout:1/92: dread - d10/d11/f14 zero size 2024-02-28T16:26:55.075 INFO:tasks.workunit.client.0.smithi148.stdout:2/936: creat d0/d1c/d6e/f129 x:0 0 0 2024-02-28T16:26:55.076 INFO:tasks.workunit.client.0.smithi148.stdout:3/971: mknod d1/d13/d19/d1b/d38/d113/d103/d10c/c128 0 2024-02-28T16:26:55.080 INFO:tasks.workunit.client.0.smithi148.stdout:2/937: rename d0/d18/d20 to d0/d18/d12a 0 2024-02-28T16:26:55.084 INFO:tasks.workunit.client.0.smithi148.stdout:3/972: creat d1/db/d35/d70/d9c/d108/dd8/f129 x:0 0 0 2024-02-28T16:26:55.089 INFO:tasks.workunit.client.0.smithi148.stdout:2/938: rename d0/d9 to d0/d18/d12a/ddd/d11b/d12b 0 2024-02-28T16:26:55.089 INFO:tasks.workunit.client.1.smithi157.stdout:0/96: write d1/d8/fc [1228541,77076] 0 2024-02-28T16:26:55.091 INFO:tasks.workunit.client.0.smithi148.stdout:2/939: write d0/d1c/d85/d96/ffc [1490570,46748] 0 2024-02-28T16:26:55.093 INFO:tasks.workunit.client.0.smithi148.stdout:3/973: readlink d1/l2c 0 2024-02-28T16:26:55.094 INFO:tasks.workunit.client.1.smithi157.stdout:0/97: creat d1/f1f x:0 0 0 2024-02-28T16:26:55.096 INFO:tasks.workunit.client.0.smithi148.stdout:2/940: mknod d0/d1c/d6e/c12c 0 2024-02-28T16:26:55.106 INFO:tasks.workunit.client.1.smithi157.stdout:3/39: rmdir d0 39 2024-02-28T16:26:55.108 INFO:tasks.workunit.client.1.smithi157.stdout:7/77: getdents df 0 2024-02-28T16:26:55.109 INFO:tasks.workunit.client.1.smithi157.stdout:0/98: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:26:55.111 INFO:tasks.workunit.client.0.smithi148.stdout:2/941: dwrite d0/d18/d12a/ddd/d11b/d12b/fa6 [0,4194304] 0 2024-02-28T16:26:55.116 INFO:tasks.workunit.client.0.smithi148.stdout:3/974: dwrite d1/d13/f3b [4194304,4194304] 0 2024-02-28T16:26:55.116 INFO:tasks.workunit.client.1.smithi157.stdout:3/40: write d0/f8 [2139606,14906] 0 2024-02-28T16:26:55.116 INFO:tasks.workunit.client.1.smithi157.stdout:7/78: symlink df/l1c 0 2024-02-28T16:26:55.117 INFO:tasks.workunit.client.1.smithi157.stdout:2/89: truncate da/f15 3900533 0 2024-02-28T16:26:55.118 INFO:tasks.workunit.client.1.smithi157.stdout:0/99: creat d1/d8/f20 x:0 0 0 2024-02-28T16:26:55.120 INFO:tasks.workunit.client.1.smithi157.stdout:0/100: write d1/f16 [106458,81376] 0 2024-02-28T16:26:55.120 INFO:tasks.workunit.client.1.smithi157.stdout:9/34: rmdir d0 39 2024-02-28T16:26:55.123 INFO:tasks.workunit.client.0.smithi148.stdout:2/942: chown d0/d18/d12a/l83 1 1 2024-02-28T16:26:55.124 INFO:tasks.workunit.client.0.smithi148.stdout:2/943: write d0/d18/d12a/dd3/f117 [756347,76416] 0 2024-02-28T16:26:55.126 INFO:tasks.workunit.client.1.smithi157.stdout:5/83: getdents d0 0 2024-02-28T16:26:55.131 INFO:tasks.workunit.client.1.smithi157.stdout:6/51: rmdir d2/d7/d8 39 2024-02-28T16:26:55.132 INFO:tasks.workunit.client.0.smithi148.stdout:3/975: dread d1/db/d35/d70/fd3 [0,4194304] 0 2024-02-28T16:26:55.136 INFO:tasks.workunit.client.0.smithi148.stdout:2/944: fdatasync d0/d18/d12a/ddd/d11b/d12b/f47 0 2024-02-28T16:26:55.136 INFO:tasks.workunit.client.1.smithi157.stdout:7/79: dwrite df/f10 [0,4194304] 0 2024-02-28T16:26:55.137 INFO:tasks.workunit.client.0.smithi148.stdout:6/884: write d0/d8/f67 [1242638,116821] 0 2024-02-28T16:26:55.141 INFO:tasks.workunit.client.1.smithi157.stdout:0/101: readlink d1/d13/l14 0 2024-02-28T16:26:55.147 INFO:tasks.workunit.client.1.smithi157.stdout:5/84: creat d0/d9/f1d x:0 0 0 2024-02-28T16:26:55.147 INFO:tasks.workunit.client.1.smithi157.stdout:8/43: sync 2024-02-28T16:26:55.149 INFO:tasks.workunit.client.1.smithi157.stdout:3/41: creat d0/d6/fb x:0 0 0 2024-02-28T16:26:55.154 INFO:tasks.workunit.client.0.smithi148.stdout:6/885: rmdir d0/d22/d27/d3e/d52 39 2024-02-28T16:26:55.154 INFO:tasks.workunit.client.1.smithi157.stdout:5/85: dread d0/f16 [0,4194304] 0 2024-02-28T16:26:55.157 INFO:tasks.workunit.client.0.smithi148.stdout:2/945: creat d0/d18/d12a/dd3/db5/de5/df0/f12d x:0 0 0 2024-02-28T16:26:55.157 INFO:tasks.workunit.client.1.smithi157.stdout:0/102: dread d1/d13/ff [0,4194304] 0 2024-02-28T16:26:55.158 INFO:tasks.workunit.client.1.smithi157.stdout:7/80: dwrite f3 [0,4194304] 0 2024-02-28T16:26:55.159 INFO:tasks.workunit.client.1.smithi157.stdout:7/81: dread - df/f1a zero size 2024-02-28T16:26:55.167 INFO:tasks.workunit.client.1.smithi157.stdout:3/42: mknod d0/cc 0 2024-02-28T16:26:55.168 INFO:tasks.workunit.client.0.smithi148.stdout:9/963: sync 2024-02-28T16:26:55.169 INFO:tasks.workunit.client.1.smithi157.stdout:5/86: mknod d0/c1e 0 2024-02-28T16:26:55.171 INFO:tasks.workunit.client.0.smithi148.stdout:9/964: write d7/d1c/d1f/d49/d116/f139 [39503,82581] 0 2024-02-28T16:26:55.171 INFO:tasks.workunit.client.0.smithi148.stdout:2/946: getdents d0/d18/d12a/dd3/db5/de5 0 2024-02-28T16:26:55.172 INFO:tasks.workunit.client.0.smithi148.stdout:9/965: chown d7/d1c/d32/c131 29674 1 2024-02-28T16:26:55.174 INFO:tasks.workunit.client.1.smithi157.stdout:5/87: write d0/f19 [968914,36661] 0 2024-02-28T16:26:55.181 INFO:tasks.workunit.client.0.smithi148.stdout:2/947: symlink d0/d1d/d55/l12e 0 2024-02-28T16:26:55.181 INFO:tasks.workunit.client.1.smithi157.stdout:5/88: write d0/fe [4318203,53426] 0 2024-02-28T16:26:55.181 INFO:tasks.workunit.client.1.smithi157.stdout:7/82: rename df/c1b to df/c1d 0 2024-02-28T16:26:55.183 INFO:tasks.workunit.client.0.smithi148.stdout:9/966: stat d7/d43/da8/fd7 0 2024-02-28T16:26:55.183 INFO:tasks.workunit.client.1.smithi157.stdout:8/44: dread d1/f4 [0,4194304] 0 2024-02-28T16:26:55.184 INFO:tasks.workunit.client.1.smithi157.stdout:6/52: creat d2/d7/fc x:0 0 0 2024-02-28T16:26:55.185 INFO:tasks.workunit.client.0.smithi148.stdout:2/948: creat d0/d18/d12a/dd3/d109/f12f x:0 0 0 2024-02-28T16:26:55.186 INFO:tasks.workunit.client.1.smithi157.stdout:2/90: dwrite da/f12 [0,4194304] 0 2024-02-28T16:26:55.187 INFO:tasks.workunit.client.1.smithi157.stdout:0/103: dwrite d1/d13/fe [4194304,4194304] 0 2024-02-28T16:26:55.187 INFO:tasks.workunit.client.1.smithi157.stdout:5/89: chown d0/d9/d1b 21212667 1 2024-02-28T16:26:55.187 INFO:tasks.workunit.client.0.smithi148.stdout:6/886: write d0/d22/d49/d88/d107/f9c [793012,41008] 0 2024-02-28T16:26:55.187 INFO:tasks.workunit.client.0.smithi148.stdout:2/949: fdatasync d0/d1c/d85/d96/dbf/fe8 0 2024-02-28T16:26:55.190 INFO:tasks.workunit.client.1.smithi157.stdout:7/83: write fb [71389,26875] 0 2024-02-28T16:26:55.194 INFO:tasks.workunit.client.1.smithi157.stdout:6/53: write d2/f3 [7916671,84366] 0 2024-02-28T16:26:55.194 INFO:tasks.workunit.client.1.smithi157.stdout:7/84: fdatasync df/f17 0 2024-02-28T16:26:55.195 INFO:tasks.workunit.client.1.smithi157.stdout:2/91: creat da/f1f x:0 0 0 2024-02-28T16:26:55.195 INFO:tasks.workunit.client.0.smithi148.stdout:6/887: truncate d0/d22/d49/dae/d10f/f120 386235 0 2024-02-28T16:26:55.197 INFO:tasks.workunit.client.1.smithi157.stdout:0/104: mknod d1/d8/c21 0 2024-02-28T16:26:55.202 INFO:tasks.workunit.client.1.smithi157.stdout:2/92: chown da/l1c 40759 1 2024-02-28T16:26:55.202 INFO:tasks.workunit.client.1.smithi157.stdout:6/54: write d2/f5 [864135,50681] 0 2024-02-28T16:26:55.203 INFO:tasks.workunit.client.0.smithi148.stdout:9/967: read d7/d43/da8/fab [2772294,70716] 0 2024-02-28T16:26:55.204 INFO:tasks.workunit.client.1.smithi157.stdout:3/43: dwrite d0/d6/fb [0,4194304] 0 2024-02-28T16:26:55.207 INFO:tasks.workunit.client.1.smithi157.stdout:6/55: fdatasync d2/d7/fc 0 2024-02-28T16:26:55.207 INFO:tasks.workunit.client.0.smithi148.stdout:2/950: dread d0/d1d/f11c [0,4194304] 0 2024-02-28T16:26:55.210 INFO:tasks.workunit.client.0.smithi148.stdout:9/968: chown d7/d1c/d1f/d49/d8d/l134 3 1 2024-02-28T16:26:55.210 INFO:tasks.workunit.client.0.smithi148.stdout:2/951: truncate d0/d59/f120 898404 0 2024-02-28T16:26:55.210 INFO:tasks.workunit.client.1.smithi157.stdout:5/90: getdents d0/d9/d11 0 2024-02-28T16:26:55.213 INFO:tasks.workunit.client.1.smithi157.stdout:2/93: rename da/l13 to da/l20 0 2024-02-28T16:26:55.215 INFO:tasks.workunit.client.1.smithi157.stdout:8/45: dread d1/f4 [0,4194304] 0 2024-02-28T16:26:55.216 INFO:tasks.workunit.client.1.smithi157.stdout:6/56: read - d2/d7/d8/fb zero size 2024-02-28T16:26:55.218 INFO:tasks.workunit.client.1.smithi157.stdout:6/57: write f0 [1294598,45613] 0 2024-02-28T16:26:55.219 INFO:tasks.workunit.client.1.smithi157.stdout:6/58: fsync d2/f6 0 2024-02-28T16:26:55.220 INFO:tasks.workunit.client.1.smithi157.stdout:4/40: sync 2024-02-28T16:26:55.221 INFO:tasks.workunit.client.1.smithi157.stdout:6/59: fsync d2/d7/d8/fb 0 2024-02-28T16:26:55.221 INFO:tasks.workunit.client.0.smithi148.stdout:2/952: rename d0/d1c/d85/fe2 to d0/d1c/dcc/f130 0 2024-02-28T16:26:55.222 INFO:tasks.workunit.client.1.smithi157.stdout:3/44: dread d0/d6/fa [0,4194304] 0 2024-02-28T16:26:55.224 INFO:tasks.workunit.client.1.smithi157.stdout:5/91: unlink d0/f1c 0 2024-02-28T16:26:55.225 INFO:tasks.workunit.client.1.smithi157.stdout:5/92: chown d0/l1 19881729 1 2024-02-28T16:26:55.228 INFO:tasks.workunit.client.0.smithi148.stdout:2/953: mknod d0/d1c/d85/d8b/d8f/c131 0 2024-02-28T16:26:55.231 INFO:tasks.workunit.client.1.smithi157.stdout:0/105: link d1/d13/l14 d1/da/l22 0 2024-02-28T16:26:55.232 INFO:tasks.workunit.client.0.smithi148.stdout:6/888: truncate d0/d4/d14/d59/f94 6537814 0 2024-02-28T16:26:55.234 INFO:tasks.workunit.client.0.smithi148.stdout:6/889: chown d0/d22/d49/f10e 3560225 1 2024-02-28T16:26:55.234 INFO:tasks.workunit.client.1.smithi157.stdout:8/46: dread d1/f2 [4194304,4194304] 0 2024-02-28T16:26:55.238 INFO:tasks.workunit.client.1.smithi157.stdout:7/85: truncate fb 1071124 0 2024-02-28T16:26:55.238 INFO:tasks.workunit.client.1.smithi157.stdout:7/86: chown df/l12 5787990 1 2024-02-28T16:26:55.239 INFO:tasks.workunit.client.1.smithi157.stdout:3/45: rename d0/c2 to d0/cd 0 2024-02-28T16:26:55.239 INFO:tasks.workunit.client.1.smithi157.stdout:7/87: fsync df/f11 0 2024-02-28T16:26:55.243 INFO:tasks.workunit.client.0.smithi148.stdout:9/969: dwrite d7/d1c/d1f/f27 [0,4194304] 0 2024-02-28T16:26:55.244 INFO:tasks.workunit.client.1.smithi157.stdout:1/93: sync 2024-02-28T16:26:55.244 INFO:tasks.workunit.client.1.smithi157.stdout:9/35: sync 2024-02-28T16:26:55.246 INFO:tasks.workunit.client.1.smithi157.stdout:5/93: rename d0/f16 to d0/d9/f1f 0 2024-02-28T16:26:55.247 INFO:tasks.workunit.client.1.smithi157.stdout:7/88: rename df to df/d1e 22 2024-02-28T16:26:55.247 INFO:tasks.workunit.client.1.smithi157.stdout:7/89: stat fd 0 2024-02-28T16:26:55.248 INFO:tasks.workunit.client.1.smithi157.stdout:5/94: fdatasync d0/d9/ff 0 2024-02-28T16:26:55.249 INFO:tasks.workunit.client.1.smithi157.stdout:3/46: dread d0/d6/fa [0,4194304] 0 2024-02-28T16:26:55.253 INFO:tasks.workunit.client.1.smithi157.stdout:4/41: truncate f2 2053884 0 2024-02-28T16:26:55.255 INFO:tasks.workunit.client.0.smithi148.stdout:9/970: rmdir d7/d1c/d1f/d49/d6a 39 2024-02-28T16:26:55.256 INFO:tasks.workunit.client.1.smithi157.stdout:0/106: read d1/d13/ff [441789,78765] 0 2024-02-28T16:26:55.257 INFO:tasks.workunit.client.1.smithi157.stdout:6/60: mknod d2/d7/cd 0 2024-02-28T16:26:55.258 INFO:tasks.workunit.client.1.smithi157.stdout:0/107: write d1/f16 [1221770,104998] 0 2024-02-28T16:26:55.259 INFO:tasks.workunit.client.1.smithi157.stdout:6/61: dread - d2/d7/d8/fb zero size 2024-02-28T16:26:55.260 INFO:tasks.workunit.client.0.smithi148.stdout:6/890: write d0/d22/d25/d76/f79 [1844718,11450] 0 2024-02-28T16:26:55.261 INFO:tasks.workunit.client.1.smithi157.stdout:6/62: write d2/f6 [1749400,121459] 0 2024-02-28T16:26:55.262 INFO:tasks.workunit.client.1.smithi157.stdout:2/94: truncate da/ff 2266217 0 2024-02-28T16:26:55.265 INFO:tasks.workunit.client.0.smithi148.stdout:2/954: dwrite d0/d1c/d85/d8b/d8f/df3/fb8 [0,4194304] 0 2024-02-28T16:26:55.269 INFO:tasks.workunit.client.0.smithi148.stdout:6/891: rmdir d0/d22/d27/d3e 39 2024-02-28T16:26:55.271 INFO:tasks.workunit.client.1.smithi157.stdout:3/47: mknod d0/d6/ce 0 2024-02-28T16:26:55.271 INFO:tasks.workunit.client.1.smithi157.stdout:3/48: fdatasync d0/f4 0 2024-02-28T16:26:55.276 INFO:tasks.workunit.client.0.smithi148.stdout:9/971: rename d7/d1c to d7/d43/d147 0 2024-02-28T16:26:55.278 INFO:tasks.workunit.client.1.smithi157.stdout:5/95: rename d0/c1e to d0/d9/d11/c20 0 2024-02-28T16:26:55.282 INFO:tasks.workunit.client.0.smithi148.stdout:6/892: symlink d0/d22/d25/dcc/l122 0 2024-02-28T16:26:55.285 INFO:tasks.workunit.client.0.smithi148.stdout:2/955: rename d0/d1c/d114 to d0/d18/d12a/ddd/d11b/d12b/d13/d38/d3a/d132 0 2024-02-28T16:26:55.286 INFO:tasks.workunit.client.1.smithi157.stdout:8/47: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:26:55.286 INFO:tasks.workunit.client.1.smithi157.stdout:0/108: symlink d1/l23 0 2024-02-28T16:26:55.287 INFO:tasks.workunit.client.0.smithi148.stdout:9/972: unlink d7/d43/d147/d74/f9b 0 2024-02-28T16:26:55.287 INFO:tasks.workunit.client.1.smithi157.stdout:0/109: chown d1/d8/fc 56721548 1 2024-02-28T16:26:55.289 INFO:tasks.workunit.client.0.smithi148.stdout:2/956: truncate d0/d1c/d85/d8b/d8f/dc9/f115 727265 0 2024-02-28T16:26:55.293 INFO:tasks.workunit.client.1.smithi157.stdout:0/110: write d1/d13/f1b [1044948,83752] 0 2024-02-28T16:26:55.294 INFO:tasks.workunit.client.1.smithi157.stdout:9/36: rename d0/fa to d0/fb 0 2024-02-28T16:26:55.296 INFO:tasks.workunit.client.1.smithi157.stdout:0/111: write d1/d8/fc [78064,54452] 0 2024-02-28T16:26:55.298 INFO:tasks.workunit.client.0.smithi148.stdout:2/957: rename d0/d1c/dcc/d10e to d0/d1c/dcc/d133 0 2024-02-28T16:26:55.300 INFO:tasks.workunit.client.0.smithi148.stdout:2/958: chown d0/d18/d12a/dd3/d109 511172 1 2024-02-28T16:26:55.301 INFO:tasks.workunit.client.1.smithi157.stdout:3/49: mknod d0/cf 0 2024-02-28T16:26:55.305 INFO:tasks.workunit.client.0.smithi148.stdout:9/973: dwrite d7/d43/da8/f11b [0,4194304] 0 2024-02-28T16:26:55.308 INFO:tasks.workunit.client.1.smithi157.stdout:1/94: write f9 [72261,91241] 0 2024-02-28T16:26:55.309 INFO:tasks.workunit.client.0.smithi148.stdout:6/893: dread d0/d22/d49/f6b [4194304,4194304] 0 2024-02-28T16:26:55.311 INFO:tasks.workunit.client.1.smithi157.stdout:9/37: symlink d0/lc 0 2024-02-28T16:26:55.313 INFO:tasks.workunit.client.1.smithi157.stdout:0/112: creat d1/f24 x:0 0 0 2024-02-28T16:26:55.313 INFO:tasks.workunit.client.0.smithi148.stdout:5/850: sync 2024-02-28T16:26:55.313 INFO:tasks.workunit.client.0.smithi148.stdout:7/839: sync 2024-02-28T16:26:55.313 INFO:tasks.workunit.client.0.smithi148.stdout:8/982: sync 2024-02-28T16:26:55.317 INFO:tasks.workunit.client.0.smithi148.stdout:5/851: fsync d1/db/d25/f69 0 2024-02-28T16:26:55.318 INFO:tasks.workunit.client.0.smithi148.stdout:6/894: fdatasync d0/d8/ff 0 2024-02-28T16:26:55.321 INFO:tasks.workunit.client.0.smithi148.stdout:5/852: dread - d1/d8/d20/dd8/fd1 zero size 2024-02-28T16:26:55.321 INFO:tasks.workunit.client.1.smithi157.stdout:5/96: fdatasync d0/d8/f18 0 2024-02-28T16:26:55.321 INFO:tasks.workunit.client.1.smithi157.stdout:4/42: link f2 d3/da/ff 0 2024-02-28T16:26:55.321 INFO:tasks.workunit.client.1.smithi157.stdout:5/97: write d0/d9/f1d [847446,63140] 0 2024-02-28T16:26:55.321 INFO:tasks.workunit.client.1.smithi157.stdout:4/43: stat d3/f7 0 2024-02-28T16:26:55.322 INFO:tasks.workunit.client.1.smithi157.stdout:4/44: fsync d3/f7 0 2024-02-28T16:26:55.322 INFO:tasks.workunit.client.1.smithi157.stdout:2/95: write da/f1d [588430,56993] 0 2024-02-28T16:26:55.324 INFO:tasks.workunit.client.1.smithi157.stdout:4/45: write d3/f8 [374322,55237] 0 2024-02-28T16:26:55.324 INFO:tasks.workunit.client.1.smithi157.stdout:1/95: creat d10/d11/d17/f1e x:0 0 0 2024-02-28T16:26:55.324 INFO:tasks.workunit.client.0.smithi148.stdout:5/853: write d1/db/d60/d7a/f9d [7679694,65324] 0 2024-02-28T16:26:55.325 INFO:tasks.workunit.client.1.smithi157.stdout:7/90: getdents df 0 2024-02-28T16:26:55.327 INFO:tasks.workunit.client.1.smithi157.stdout:9/38: write d0/fb [168439,98290] 0 2024-02-28T16:26:55.328 INFO:tasks.workunit.client.0.smithi148.stdout:5/854: read d1/d8/d20/d31/f6c [4016077,44567] 0 2024-02-28T16:26:55.329 INFO:tasks.workunit.client.1.smithi157.stdout:0/113: rename d1/d13/f19 to d1/d8/f25 0 2024-02-28T16:26:55.332 INFO:tasks.workunit.client.1.smithi157.stdout:4/46: mknod d3/da/c10 0 2024-02-28T16:26:55.334 INFO:tasks.workunit.client.1.smithi157.stdout:7/91: unlink df/l1c 0 2024-02-28T16:26:55.338 INFO:tasks.workunit.client.1.smithi157.stdout:3/50: dwrite d0/d6/fa [4194304,4194304] 0 2024-02-28T16:26:55.340 INFO:tasks.workunit.client.1.smithi157.stdout:5/98: rename d0/d9/d11/l13 to d0/d8/l21 0 2024-02-28T16:26:55.340 INFO:tasks.workunit.client.1.smithi157.stdout:5/99: stat d0/f19 0 2024-02-28T16:26:55.342 INFO:tasks.workunit.client.1.smithi157.stdout:0/114: creat d1/d8/f26 x:0 0 0 2024-02-28T16:26:55.343 INFO:tasks.workunit.client.1.smithi157.stdout:1/96: getdents d10/d11/d18 0 2024-02-28T16:26:55.353 INFO:tasks.workunit.client.1.smithi157.stdout:3/51: symlink d0/l10 0 2024-02-28T16:26:55.354 INFO:tasks.workunit.client.1.smithi157.stdout:3/52: read d0/f4 [294970,28969] 0 2024-02-28T16:26:55.356 INFO:tasks.workunit.client.1.smithi157.stdout:0/115: mkdir d1/d8/d27 0 2024-02-28T16:26:55.357 INFO:tasks.workunit.client.1.smithi157.stdout:5/100: dread d0/d8/f18 [0,4194304] 0 2024-02-28T16:26:55.358 INFO:tasks.workunit.client.1.smithi157.stdout:0/116: chown d1/d13/fe 24 1 2024-02-28T16:26:55.359 INFO:tasks.workunit.client.1.smithi157.stdout:0/117: write d1/f16 [1813993,58336] 0 2024-02-28T16:26:55.362 INFO:tasks.workunit.client.1.smithi157.stdout:2/96: getdents da 0 2024-02-28T16:26:55.362 INFO:tasks.workunit.client.1.smithi157.stdout:0/118: fsync d1/f16 0 2024-02-28T16:26:55.362 INFO:tasks.workunit.client.1.smithi157.stdout:2/97: readlink da/ld 0 2024-02-28T16:26:55.363 INFO:tasks.workunit.client.1.smithi157.stdout:3/53: unlink d0/cc 0 2024-02-28T16:26:55.364 INFO:tasks.workunit.client.1.smithi157.stdout:0/119: write d1/f24 [1001829,123899] 0 2024-02-28T16:26:55.368 INFO:tasks.workunit.client.1.smithi157.stdout:9/39: getdents d0 0 2024-02-28T16:26:55.369 INFO:tasks.workunit.client.1.smithi157.stdout:9/40: chown d0 61169116 1 2024-02-28T16:26:55.374 INFO:tasks.workunit.client.1.smithi157.stdout:3/54: dread d0/f8 [0,4194304] 0 2024-02-28T16:26:55.375 INFO:tasks.workunit.client.1.smithi157.stdout:1/97: truncate f4 1620194 0 2024-02-28T16:26:55.376 INFO:tasks.workunit.client.1.smithi157.stdout:2/98: truncate da/f15 3023654 0 2024-02-28T16:26:55.377 INFO:tasks.workunit.client.1.smithi157.stdout:1/98: write f2 [2051175,98514] 0 2024-02-28T16:26:55.377 INFO:tasks.workunit.client.1.smithi157.stdout:5/101: mknod d0/d9/d1b/c22 0 2024-02-28T16:26:55.379 INFO:tasks.workunit.client.1.smithi157.stdout:1/99: chown d10/l13 7188595 1 2024-02-28T16:26:55.381 INFO:tasks.workunit.client.1.smithi157.stdout:0/120: symlink d1/d8/d27/l28 0 2024-02-28T16:26:55.381 INFO:tasks.workunit.client.1.smithi157.stdout:3/55: creat d0/d6/f11 x:0 0 0 2024-02-28T16:26:55.382 INFO:tasks.workunit.client.1.smithi157.stdout:9/41: dread d0/f3 [0,4194304] 0 2024-02-28T16:26:55.383 INFO:tasks.workunit.client.1.smithi157.stdout:5/102: unlink d0/d9/d11/l1a 0 2024-02-28T16:26:55.384 INFO:tasks.workunit.client.1.smithi157.stdout:3/56: symlink d0/d6/l12 0 2024-02-28T16:26:55.385 INFO:tasks.workunit.client.1.smithi157.stdout:0/121: symlink d1/d8/l29 0 2024-02-28T16:26:55.386 INFO:tasks.workunit.client.1.smithi157.stdout:3/57: chown d0/d6/fa 92598753 1 2024-02-28T16:26:55.387 INFO:tasks.workunit.client.1.smithi157.stdout:9/42: rename d0/f9 to d0/fd 0 2024-02-28T16:26:55.390 INFO:tasks.workunit.client.0.smithi148.stdout:2/959: symlink d0/l134 0 2024-02-28T16:26:55.392 INFO:tasks.workunit.client.0.smithi148.stdout:2/960: readlink d0/d1c/d85/d96/dbf/ld1 0 2024-02-28T16:26:55.392 INFO:tasks.workunit.client.0.smithi148.stdout:9/974: dread d7/d43/d147/d32/d24/dac/fdc [0,4194304] 0 2024-02-28T16:26:55.394 INFO:tasks.workunit.client.0.smithi148.stdout:7/840: mkdir d0/d9/d25/d96/ddf/d1c/d32/d103 0 2024-02-28T16:26:55.396 INFO:tasks.workunit.client.0.smithi148.stdout:7/841: truncate d0/d9/d4c/ff5 70415 0 2024-02-28T16:26:55.405 INFO:tasks.workunit.client.0.smithi148.stdout:5/855: creat d1/d8/d20/dd8/d89/dfd/f104 x:0 0 0 2024-02-28T16:26:55.407 INFO:tasks.workunit.client.0.smithi148.stdout:5/856: chown d1/f94 61822 1 2024-02-28T16:26:55.408 INFO:tasks.workunit.client.0.smithi148.stdout:7/842: fsync d0/d9/d25/d96/ddf/f41 0 2024-02-28T16:26:55.409 INFO:tasks.workunit.client.0.smithi148.stdout:5/857: chown d1/d8/d20/d4e/d71 593786 1 2024-02-28T16:26:55.411 INFO:tasks.workunit.client.0.smithi148.stdout:9/975: getdents d7/d43/ddd/df1/df3 0 2024-02-28T16:26:55.413 INFO:tasks.workunit.client.0.smithi148.stdout:9/976: fsync d7/d43/d147/d1f/d49/d116/f145 0 2024-02-28T16:26:55.414 INFO:tasks.workunit.client.0.smithi148.stdout:7/843: creat d0/dd5/de2/f104 x:0 0 0 2024-02-28T16:26:55.415 INFO:tasks.workunit.client.0.smithi148.stdout:5/858: mkdir d1/db/d60/df0/ddd/d105 0 2024-02-28T16:26:55.415 INFO:tasks.workunit.client.0.smithi148.stdout:9/977: chown d7/d43/d147/d32/d119 30809241 1 2024-02-28T16:26:55.425 INFO:tasks.workunit.client.0.smithi148.stdout:5/859: link d1/f6f d1/db/d60/d7a/d8b/f106 0 2024-02-28T16:26:55.425 INFO:tasks.workunit.client.0.smithi148.stdout:7/844: unlink d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/d97/cdc 0 2024-02-28T16:26:55.425 INFO:tasks.workunit.client.0.smithi148.stdout:2/961: dread d0/d18/d9a/f127 [0,4194304] 0 2024-02-28T16:26:55.426 INFO:tasks.workunit.client.0.smithi148.stdout:5/860: write d1/db/d60/d7a/f9d [8918626,93111] 0 2024-02-28T16:26:55.428 INFO:tasks.workunit.client.1.smithi157.stdout:5/103: mknod d0/c23 0 2024-02-28T16:26:55.428 INFO:tasks.workunit.client.1.smithi157.stdout:0/122: mknod d1/da/c2a 0 2024-02-28T16:26:55.429 INFO:tasks.workunit.client.0.smithi148.stdout:2/962: fdatasync d0/d1d/f5c 0 2024-02-28T16:26:55.430 INFO:tasks.workunit.client.1.smithi157.stdout:3/58: creat d0/d6/f13 x:0 0 0 2024-02-28T16:26:55.432 INFO:tasks.workunit.client.0.smithi148.stdout:2/963: write d0/d18/d12a/dd3/f117 [1290954,88490] 0 2024-02-28T16:26:55.433 INFO:tasks.workunit.client.0.smithi148.stdout:5/861: unlink d1/d8/d20/dd8/f56 0 2024-02-28T16:26:55.433 INFO:tasks.workunit.client.1.smithi157.stdout:1/100: getdents d10 0 2024-02-28T16:26:55.434 INFO:tasks.workunit.client.0.smithi148.stdout:2/964: stat d0/d18/d12a/dd3/d109/c10c 0 2024-02-28T16:26:55.435 INFO:tasks.workunit.client.1.smithi157.stdout:9/43: symlink d0/le 0 2024-02-28T16:26:55.436 INFO:tasks.workunit.client.1.smithi157.stdout:0/123: write d1/f1f [919455,54518] 0 2024-02-28T16:26:55.436 INFO:tasks.workunit.client.1.smithi157.stdout:1/101: readlink l1 0 2024-02-28T16:26:55.438 INFO:tasks.workunit.client.1.smithi157.stdout:2/99: dwrite da/f19 [0,4194304] 0 2024-02-28T16:26:55.441 INFO:tasks.workunit.client.1.smithi157.stdout:9/44: truncate d0/f4 1303120 0 2024-02-28T16:26:55.442 INFO:tasks.workunit.client.0.smithi148.stdout:5/862: mknod d1/d8/d20/d4e/c107 0 2024-02-28T16:26:55.443 INFO:tasks.workunit.client.0.smithi148.stdout:8/983: write d1/d3/d18/d5a/d13f/d70/d75/d91/dcc/fd2 [171997,118022] 0 2024-02-28T16:26:55.444 INFO:tasks.workunit.client.0.smithi148.stdout:2/965: write d0/dd/fab [3438750,121197] 0 2024-02-28T16:26:55.445 INFO:tasks.workunit.client.1.smithi157.stdout:2/100: rmdir da 39 2024-02-28T16:26:55.448 INFO:tasks.workunit.client.1.smithi157.stdout:9/45: dread d0/fb [0,4194304] 0 2024-02-28T16:26:55.448 INFO:tasks.workunit.client.0.smithi148.stdout:2/966: read d0/f10 [2345118,17996] 0 2024-02-28T16:26:55.450 INFO:tasks.workunit.client.0.smithi148.stdout:2/967: chown d0/d1d/lb2 65458 1 2024-02-28T16:26:55.454 INFO:tasks.workunit.client.1.smithi157.stdout:5/104: dread d0/d9/ff [0,4194304] 0 2024-02-28T16:26:55.455 INFO:tasks.workunit.client.0.smithi148.stdout:7/845: link d0/d4/d70/f100 d0/d9/d25/d96/ddf/d28/d2b/f105 0 2024-02-28T16:26:55.458 INFO:tasks.workunit.client.1.smithi157.stdout:3/59: dwrite d0/d6/f13 [0,4194304] 0 2024-02-28T16:26:55.461 INFO:tasks.workunit.client.1.smithi157.stdout:0/124: dwrite d1/f16 [0,4194304] 0 2024-02-28T16:26:55.464 INFO:tasks.workunit.client.0.smithi148.stdout:7/846: symlink d0/d18/l106 0 2024-02-28T16:26:55.465 INFO:tasks.workunit.client.1.smithi157.stdout:9/46: read d0/fb [64497,112416] 0 2024-02-28T16:26:55.469 INFO:tasks.workunit.client.0.smithi148.stdout:9/978: dwrite d7/d43/d147/d1f/d49/d5c/f133 [0,4194304] 0 2024-02-28T16:26:55.474 INFO:tasks.workunit.client.0.smithi148.stdout:5/863: getdents d1 0 2024-02-28T16:26:55.476 INFO:tasks.workunit.client.0.smithi148.stdout:5/864: chown d1/f94 179 1 2024-02-28T16:26:55.479 INFO:tasks.workunit.client.1.smithi157.stdout:5/105: symlink d0/d9/d11/l24 0 2024-02-28T16:26:55.480 INFO:tasks.workunit.client.0.smithi148.stdout:2/968: creat d0/d1c/f135 x:0 0 0 2024-02-28T16:26:55.481 INFO:tasks.workunit.client.0.smithi148.stdout:8/984: write d1/dd/f10d [970508,43043] 0 2024-02-28T16:26:55.482 INFO:tasks.workunit.client.1.smithi157.stdout:3/60: symlink d0/l14 0 2024-02-28T16:26:55.483 INFO:tasks.workunit.client.0.smithi148.stdout:4/742: sync 2024-02-28T16:26:55.484 INFO:tasks.workunit.client.0.smithi148.stdout:3/976: sync 2024-02-28T16:26:55.486 INFO:tasks.workunit.client.1.smithi157.stdout:0/125: dwrite d1/f1f [0,4194304] 0 2024-02-28T16:26:55.487 INFO:tasks.workunit.client.0.smithi148.stdout:7/847: getdents d0/dd5/de2/dec/dfc 0 2024-02-28T16:26:55.487 INFO:tasks.workunit.client.0.smithi148.stdout:3/977: dread - d1/d13/d19/d1b/d38/d113/d103/f11d zero size 2024-02-28T16:26:55.488 INFO:tasks.workunit.client.1.smithi157.stdout:9/47: symlink d0/lf 0 2024-02-28T16:26:55.490 INFO:tasks.workunit.client.1.smithi157.stdout:1/102: chown f4 222687914 1 2024-02-28T16:26:55.491 INFO:tasks.workunit.client.1.smithi157.stdout:6/63: sync 2024-02-28T16:26:55.491 INFO:tasks.workunit.client.1.smithi157.stdout:5/106: creat d0/d9/d1b/f25 x:0 0 0 2024-02-28T16:26:55.493 INFO:tasks.workunit.client.1.smithi157.stdout:3/61: creat d0/d6/f15 x:0 0 0 2024-02-28T16:26:55.494 INFO:tasks.workunit.client.0.smithi148.stdout:5/865: dread d1/d8/d20/dd8/ff4 [0,4194304] 0 2024-02-28T16:26:55.495 INFO:tasks.workunit.client.0.smithi148.stdout:3/978: mkdir d1/db/d35/d52/d12a 0 2024-02-28T16:26:55.496 INFO:tasks.workunit.client.1.smithi157.stdout:0/126: creat d1/d8/d27/f2b x:0 0 0 2024-02-28T16:26:55.497 INFO:tasks.workunit.client.0.smithi148.stdout:4/743: read d8/d40/dc3/dd3/d1f/f42 [1572610,77534] 0 2024-02-28T16:26:55.498 INFO:tasks.workunit.client.0.smithi148.stdout:7/848: unlink d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/ca3 0 2024-02-28T16:26:55.500 INFO:tasks.workunit.client.0.smithi148.stdout:3/979: dread d1/db/d35/f6b [0,4194304] 0 2024-02-28T16:26:55.501 INFO:tasks.workunit.client.1.smithi157.stdout:5/107: creat d0/d8/f26 x:0 0 0 2024-02-28T16:26:55.502 INFO:tasks.workunit.client.0.smithi148.stdout:2/969: dwrite d0/d59/f120 [0,4194304] 0 2024-02-28T16:26:55.503 INFO:tasks.workunit.client.0.smithi148.stdout:8/985: dread d1/dd/d13/d24/fa5 [0,4194304] 0 2024-02-28T16:26:55.504 INFO:tasks.workunit.client.1.smithi157.stdout:3/62: creat d0/d6/f16 x:0 0 0 2024-02-28T16:26:55.506 INFO:tasks.workunit.client.0.smithi148.stdout:5/866: mkdir d1/d8/d20/d4e/d84/d108 0 2024-02-28T16:26:55.508 INFO:tasks.workunit.client.1.smithi157.stdout:9/48: dread d0/f5 [0,4194304] 0 2024-02-28T16:26:55.511 INFO:tasks.workunit.client.1.smithi157.stdout:3/63: dread - d0/d6/f11 zero size 2024-02-28T16:26:55.512 INFO:tasks.workunit.client.1.smithi157.stdout:9/49: fsync d0/f4 0 2024-02-28T16:26:55.513 INFO:tasks.workunit.client.0.smithi148.stdout:7/849: symlink d0/dc8/l107 0 2024-02-28T16:26:55.517 INFO:tasks.workunit.client.1.smithi157.stdout:3/64: fdatasync d0/d6/f11 0 2024-02-28T16:26:55.520 INFO:tasks.workunit.client.0.smithi148.stdout:3/980: write d1/d13/fcb [1145807,46409] 0 2024-02-28T16:26:55.521 INFO:tasks.workunit.client.0.smithi148.stdout:9/979: truncate d7/d43/d147/d32/d24/f2f 3125411 0 2024-02-28T16:26:55.524 INFO:tasks.workunit.client.0.smithi148.stdout:9/980: chown d7/d43/d147/f45 0 1 2024-02-28T16:26:55.525 INFO:tasks.workunit.client.1.smithi157.stdout:0/127: creat d1/d8/f2c x:0 0 0 2024-02-28T16:26:55.525 INFO:tasks.workunit.client.1.smithi157.stdout:1/103: dwrite ff [0,4194304] 0 2024-02-28T16:26:55.525 INFO:tasks.workunit.client.0.smithi148.stdout:5/867: rename d1/d8/cf3 to d1/d8/c109 0 2024-02-28T16:26:55.527 INFO:tasks.workunit.client.1.smithi157.stdout:5/108: fsync d0/d8/f18 0 2024-02-28T16:26:55.527 INFO:tasks.workunit.client.0.smithi148.stdout:5/868: write d1/f41 [4496809,68654] 0 2024-02-28T16:26:55.529 INFO:tasks.workunit.client.0.smithi148.stdout:5/869: stat d1/c2 0 2024-02-28T16:26:55.529 INFO:tasks.workunit.client.1.smithi157.stdout:6/64: dwrite d2/d7/d8/fb [0,4194304] 0 2024-02-28T16:26:55.530 INFO:tasks.workunit.client.1.smithi157.stdout:9/50: dread d0/f4 [0,4194304] 0 2024-02-28T16:26:55.534 INFO:tasks.workunit.client.1.smithi157.stdout:3/65: write d0/d6/fa [5431870,17375] 0 2024-02-28T16:26:55.535 INFO:tasks.workunit.client.0.smithi148.stdout:8/986: creat d1/d3/d18/d5a/d13f/d70/d75/d84/d13c/f145 x:0 0 0 2024-02-28T16:26:55.536 INFO:tasks.workunit.client.1.smithi157.stdout:3/66: read - d0/d6/f15 zero size 2024-02-28T16:26:55.544 INFO:tasks.workunit.client.1.smithi157.stdout:0/128: mkdir d1/d8/d27/d2d 0 2024-02-28T16:26:55.546 INFO:tasks.workunit.client.1.smithi157.stdout:4/47: sync 2024-02-28T16:26:55.546 INFO:tasks.workunit.client.1.smithi157.stdout:8/48: sync 2024-02-28T16:26:55.547 INFO:tasks.workunit.client.1.smithi157.stdout:7/92: sync 2024-02-28T16:26:55.547 INFO:tasks.workunit.client.0.smithi148.stdout:6/895: sync 2024-02-28T16:26:55.547 INFO:tasks.workunit.client.1.smithi157.stdout:1/104: symlink d10/d11/l1f 0 2024-02-28T16:26:55.549 INFO:tasks.workunit.client.0.smithi148.stdout:2/970: dread d0/d1c/f4e [0,4194304] 0 2024-02-28T16:26:55.552 INFO:tasks.workunit.client.0.smithi148.stdout:6/896: chown d0/d22/d27/d66/d87/fde 1355389 1 2024-02-28T16:26:55.554 INFO:tasks.workunit.client.0.smithi148.stdout:2/971: chown d0/d18/d9a/ldc 1824844 1 2024-02-28T16:26:55.554 INFO:tasks.workunit.client.0.smithi148.stdout:5/870: symlink d1/d8/d20/l10a 0 2024-02-28T16:26:55.554 INFO:tasks.workunit.client.0.smithi148.stdout:3/981: dread d1/db/f106 [0,4194304] 0 2024-02-28T16:26:55.554 INFO:tasks.workunit.client.0.smithi148.stdout:8/987: dwrite d1/dd/d13/d24/fb6 [4194304,4194304] 0 2024-02-28T16:26:55.558 INFO:tasks.workunit.client.1.smithi157.stdout:1/105: write d10/d11/f1c [898371,73011] 0 2024-02-28T16:26:55.558 INFO:tasks.workunit.client.0.smithi148.stdout:6/897: fsync d0/d4/d14/f100 0 2024-02-28T16:26:55.559 INFO:tasks.workunit.client.0.smithi148.stdout:3/982: dread - d1/db/d35/d52/fc3 zero size 2024-02-28T16:26:55.565 INFO:tasks.workunit.client.0.smithi148.stdout:8/988: write d1/dd/d13/d1a/d25/f11c [3301727,43654] 0 2024-02-28T16:26:55.565 INFO:tasks.workunit.client.0.smithi148.stdout:3/983: read d1/d13/d19/f28 [4667964,14966] 0 2024-02-28T16:26:55.566 INFO:tasks.workunit.client.1.smithi157.stdout:5/109: dwrite d0/d8/fb [0,4194304] 0 2024-02-28T16:26:55.568 INFO:tasks.workunit.client.0.smithi148.stdout:8/989: readlink d1/d3/l8e 0 2024-02-28T16:26:55.572 INFO:tasks.workunit.client.0.smithi148.stdout:4/744: dwrite d8/d21/d3d/d4d/d66/f82 [0,4194304] 0 2024-02-28T16:26:55.573 INFO:tasks.workunit.client.0.smithi148.stdout:9/981: link d7/d43/d147/d1f/d49/d5c/f127 d7/d43/d147/d32/d24/f148 0 2024-02-28T16:26:55.574 INFO:tasks.workunit.client.1.smithi157.stdout:6/65: mkdir d2/d7/de 0 2024-02-28T16:26:55.578 INFO:tasks.workunit.client.1.smithi157.stdout:7/93: mkdir df/d1f 0 2024-02-28T16:26:55.579 INFO:tasks.workunit.client.0.smithi148.stdout:7/850: dwrite d0/d9/d25/d96/ddf/fa2 [0,4194304] 0 2024-02-28T16:26:55.581 INFO:tasks.workunit.client.0.smithi148.stdout:4/745: write d8/d21/d3d/f52 [577800,37692] 0 2024-02-28T16:26:55.582 INFO:tasks.workunit.client.1.smithi157.stdout:9/51: write d0/fd [905431,109351] 0 2024-02-28T16:26:55.585 INFO:tasks.workunit.client.1.smithi157.stdout:1/106: rename f9 to d10/d11/d18/f20 0 2024-02-28T16:26:55.590 INFO:tasks.workunit.client.1.smithi157.stdout:3/67: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:26:55.591 INFO:tasks.workunit.client.1.smithi157.stdout:2/101: dwrite da/f15 [0,4194304] 0 2024-02-28T16:26:55.593 INFO:tasks.workunit.client.0.smithi148.stdout:8/990: chown d1/dd/d51/d77 2096506611 1 2024-02-28T16:26:55.597 INFO:tasks.workunit.client.1.smithi157.stdout:2/102: chown da/l20 1 1 2024-02-28T16:26:55.597 INFO:tasks.workunit.client.1.smithi157.stdout:0/129: write d1/d13/ff [3675184,78819] 0 2024-02-28T16:26:55.598 INFO:tasks.workunit.client.1.smithi157.stdout:8/49: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:26:55.598 INFO:tasks.workunit.client.0.smithi148.stdout:3/984: dread d1/d3f/da5/dda/fa2 [0,4194304] 0 2024-02-28T16:26:55.599 INFO:tasks.workunit.client.1.smithi157.stdout:1/107: truncate d10/d11/f1c 1454689 0 2024-02-28T16:26:55.602 INFO:tasks.workunit.client.1.smithi157.stdout:4/48: dwrite d3/f7 [0,4194304] 0 2024-02-28T16:26:55.603 INFO:tasks.workunit.client.0.smithi148.stdout:9/982: truncate d7/dd/d26/f5d 2398528 0 2024-02-28T16:26:55.606 INFO:tasks.workunit.client.0.smithi148.stdout:3/985: chown d1/d13/d19/d56/d5b/de9/f111 2176120 1 2024-02-28T16:26:55.607 INFO:tasks.workunit.client.0.smithi148.stdout:9/983: readlink d7/d43/d147/d1f/d49/dae/dc9/d100/l13f 0 2024-02-28T16:26:55.607 INFO:tasks.workunit.client.0.smithi148.stdout:7/851: rmdir d0/d9/d25/d96/ddf/d28/d2b/d3a/d49 39 2024-02-28T16:26:55.609 INFO:tasks.workunit.client.0.smithi148.stdout:2/972: dread d0/d18/d12a/f92 [0,4194304] 0 2024-02-28T16:26:55.611 INFO:tasks.workunit.client.0.smithi148.stdout:4/746: fdatasync d8/d40/dc3/dd3/d17/d6a/f50 0 2024-02-28T16:26:55.611 INFO:tasks.workunit.client.1.smithi157.stdout:0/130: chown d1/d13/f1b 783299 1 2024-02-28T16:26:55.612 INFO:tasks.workunit.client.0.smithi148.stdout:3/986: write d1/d13/d19/d1b/d38/f43 [2447722,37078] 0 2024-02-28T16:26:55.616 INFO:tasks.workunit.client.1.smithi157.stdout:7/94: mknod df/d1f/c20 0 2024-02-28T16:26:55.617 INFO:tasks.workunit.client.0.smithi148.stdout:2/973: fdatasync d0/d18/d12a/ddd/d11b/d12b/d13/f80 0 2024-02-28T16:26:55.621 INFO:tasks.workunit.client.0.smithi148.stdout:5/871: creat d1/d8/d20/d31/f10b x:0 0 0 2024-02-28T16:26:55.621 INFO:tasks.workunit.client.0.smithi148.stdout:2/974: stat d0/d1c/d85/d8b/d8f/dc9/f115 0 2024-02-28T16:26:55.621 INFO:tasks.workunit.client.1.smithi157.stdout:7/95: fdatasync df/f1a 0 2024-02-28T16:26:55.622 INFO:tasks.workunit.client.0.smithi148.stdout:5/872: write d1/db/fc5 [941257,71643] 0 2024-02-28T16:26:55.628 INFO:tasks.workunit.client.1.smithi157.stdout:6/66: dread d2/f3 [0,4194304] 0 2024-02-28T16:26:55.629 INFO:tasks.workunit.client.1.smithi157.stdout:2/103: rename da/l16 to da/l21 0 2024-02-28T16:26:55.631 INFO:tasks.workunit.client.1.smithi157.stdout:2/104: stat da/l1c 0 2024-02-28T16:26:55.632 INFO:tasks.workunit.client.1.smithi157.stdout:9/52: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:26:55.637 INFO:tasks.workunit.client.1.smithi157.stdout:9/53: chown d0/f5 1228709 1 2024-02-28T16:26:55.638 INFO:tasks.workunit.client.1.smithi157.stdout:6/67: read f0 [4106421,40874] 0 2024-02-28T16:26:55.638 INFO:tasks.workunit.client.0.smithi148.stdout:6/898: unlink d0/d22/d27/d3e/d52/f11a 0 2024-02-28T16:26:55.640 INFO:tasks.workunit.client.1.smithi157.stdout:9/54: chown d0/fd 1 1 2024-02-28T16:26:55.640 INFO:tasks.workunit.client.1.smithi157.stdout:8/50: dread d1/f2 [4194304,4194304] 0 2024-02-28T16:26:55.642 INFO:tasks.workunit.client.0.smithi148.stdout:6/899: chown d0/d22/d27/d66/d87/dc6/f111 274798 1 2024-02-28T16:26:55.643 INFO:tasks.workunit.client.1.smithi157.stdout:3/68: dwrite d0/d6/fb [0,4194304] 0 2024-02-28T16:26:55.646 INFO:tasks.workunit.client.1.smithi157.stdout:9/55: read d0/f4 [352776,95647] 0 2024-02-28T16:26:55.647 INFO:tasks.workunit.client.1.smithi157.stdout:0/131: unlink d1/f1f 0 2024-02-28T16:26:55.649 INFO:tasks.workunit.client.1.smithi157.stdout:5/110: getdents d0/d8 0 2024-02-28T16:26:55.653 INFO:tasks.workunit.client.1.smithi157.stdout:3/69: write d0/d6/f13 [521143,9013] 0 2024-02-28T16:26:55.654 INFO:tasks.workunit.client.0.smithi148.stdout:9/984: truncate d7/d43/d147/d59/d83/d88/f8a 2397963 0 2024-02-28T16:26:55.655 INFO:tasks.workunit.client.0.smithi148.stdout:8/991: dread d1/dd/d51/d9b/fd6 [0,4194304] 0 2024-02-28T16:26:55.656 INFO:tasks.workunit.client.1.smithi157.stdout:7/96: mknod df/c21 0 2024-02-28T16:26:55.658 INFO:tasks.workunit.client.0.smithi148.stdout:3/987: fdatasync d1/d13/d19/d32/d11c/d80/fc7 0 2024-02-28T16:26:55.667 INFO:tasks.workunit.client.1.smithi157.stdout:1/108: dwrite d10/f12 [0,4194304] 0 2024-02-28T16:26:55.668 INFO:tasks.workunit.client.1.smithi157.stdout:4/49: dread d3/f4 [0,4194304] 0 2024-02-28T16:26:55.668 INFO:tasks.workunit.client.0.smithi148.stdout:4/747: fsync d8/d21/d3d/f64 0 2024-02-28T16:26:55.670 INFO:tasks.workunit.client.1.smithi157.stdout:9/56: rmdir d0 39 2024-02-28T16:26:55.670 INFO:tasks.workunit.client.0.smithi148.stdout:4/748: fdatasync d8/d37/d91/db2/ffb 0 2024-02-28T16:26:55.673 INFO:tasks.workunit.client.0.smithi148.stdout:9/985: rmdir d7/d43/d147/d1f/d49/dae/dc9 39 2024-02-28T16:26:55.675 INFO:tasks.workunit.client.0.smithi148.stdout:8/992: mkdir d1/dd/d13/d1a/d25/d146 0 2024-02-28T16:26:55.676 INFO:tasks.workunit.client.1.smithi157.stdout:2/105: dwrite da/f1a [0,4194304] 0 2024-02-28T16:26:55.684 INFO:tasks.workunit.client.1.smithi157.stdout:6/68: link d2/f6 d2/ff 0 2024-02-28T16:26:55.686 INFO:tasks.workunit.client.1.smithi157.stdout:6/69: stat d2/d7/fc 0 2024-02-28T16:26:55.687 INFO:tasks.workunit.client.1.smithi157.stdout:5/111: dwrite d0/d9/ff [0,4194304] 0 2024-02-28T16:26:55.689 INFO:tasks.workunit.client.0.smithi148.stdout:5/873: creat d1/d8/d20/d4e/d96/ddb/dea/f10c x:0 0 0 2024-02-28T16:26:55.690 INFO:tasks.workunit.client.1.smithi157.stdout:0/132: rename d1/c17 to d1/d8/d27/c2e 0 2024-02-28T16:26:55.691 INFO:tasks.workunit.client.0.smithi148.stdout:3/988: mkdir d1/db/d35/d70/d9c/d108/d12b 0 2024-02-28T16:26:55.695 INFO:tasks.workunit.client.0.smithi148.stdout:3/989: chown d1/d13/d19/d32/d9e/dfa/l72 1310673 1 2024-02-28T16:26:55.696 INFO:tasks.workunit.client.1.smithi157.stdout:7/97: rename df/l12 to df/l22 0 2024-02-28T16:26:55.696 INFO:tasks.workunit.client.0.smithi148.stdout:7/852: dread d0/d9/d25/d96/ddf/d1c/d32/f4e [0,4194304] 0 2024-02-28T16:26:55.701 INFO:tasks.workunit.client.0.smithi148.stdout:4/749: chown d8/l16 0 1 2024-02-28T16:26:55.703 INFO:tasks.workunit.client.1.smithi157.stdout:1/109: creat d10/f21 x:0 0 0 2024-02-28T16:26:55.704 INFO:tasks.workunit.client.0.smithi148.stdout:9/986: creat d7/d43/d147/d74/d6b/f149 x:0 0 0 2024-02-28T16:26:55.708 INFO:tasks.workunit.client.0.smithi148.stdout:8/993: fsync d1/d3/d18/d5a/d13f/d70/f72 0 2024-02-28T16:26:55.713 INFO:tasks.workunit.client.1.smithi157.stdout:4/50: rename d3/f9 to d3/f11 0 2024-02-28T16:26:55.716 INFO:tasks.workunit.client.1.smithi157.stdout:2/106: dwrite da/f12 [4194304,4194304] 0 2024-02-28T16:26:55.717 INFO:tasks.workunit.client.0.smithi148.stdout:5/874: mknod d1/c10d 0 2024-02-28T16:26:55.719 INFO:tasks.workunit.client.1.smithi157.stdout:6/70: dwrite d2/f5 [0,4194304] 0 2024-02-28T16:26:55.723 INFO:tasks.workunit.client.1.smithi157.stdout:5/112: dwrite d0/d9/f10 [0,4194304] 0 2024-02-28T16:26:55.726 INFO:tasks.workunit.client.0.smithi148.stdout:6/900: link d0/d22/d25/d76/lf2 d0/d22/d27/d66/d87/l123 0 2024-02-28T16:26:55.732 INFO:tasks.workunit.client.1.smithi157.stdout:6/71: dread d2/f3 [0,4194304] 0 2024-02-28T16:26:55.736 INFO:tasks.workunit.client.0.smithi148.stdout:7/853: fdatasync d0/d9/d25/d96/ddf/d1c/d32/faa 0 2024-02-28T16:26:55.736 INFO:tasks.workunit.client.0.smithi148.stdout:4/750: dread - d8/d21/d3d/d8c/fd7 zero size 2024-02-28T16:26:55.739 INFO:tasks.workunit.client.1.smithi157.stdout:0/133: creat d1/da/f2f x:0 0 0 2024-02-28T16:26:55.741 INFO:tasks.workunit.client.1.smithi157.stdout:0/134: write d1/d8/f20 [12011,130034] 0 2024-02-28T16:26:55.742 INFO:tasks.workunit.client.1.smithi157.stdout:7/98: write f8 [5174110,64861] 0 2024-02-28T16:26:55.744 INFO:tasks.workunit.client.1.smithi157.stdout:7/99: readlink df/l14 0 2024-02-28T16:26:55.745 INFO:tasks.workunit.client.1.smithi157.stdout:0/135: truncate d1/f15 4491226 0 2024-02-28T16:26:55.745 INFO:tasks.workunit.client.1.smithi157.stdout:3/70: link d0/d6/f13 d0/d6/f17 0 2024-02-28T16:26:55.749 INFO:tasks.workunit.client.1.smithi157.stdout:1/110: readlink d10/d11/d17/l19 0 2024-02-28T16:26:55.752 INFO:tasks.workunit.client.0.smithi148.stdout:8/994: read d1/d3/d18/fc3 [919000,512] 0 2024-02-28T16:26:55.752 INFO:tasks.workunit.client.1.smithi157.stdout:4/51: creat d3/da/f12 x:0 0 0 2024-02-28T16:26:55.754 INFO:tasks.workunit.client.1.smithi157.stdout:2/107: unlink da/f15 0 2024-02-28T16:26:55.757 INFO:tasks.workunit.client.0.smithi148.stdout:3/990: dwrite d1/d13/d19/d32/d9e/dfa/f83 [0,4194304] 0 2024-02-28T16:26:55.758 INFO:tasks.workunit.client.1.smithi157.stdout:5/113: creat d0/f27 x:0 0 0 2024-02-28T16:26:55.762 INFO:tasks.workunit.client.1.smithi157.stdout:8/51: getdents d1/d5 0 2024-02-28T16:26:55.765 INFO:tasks.workunit.client.1.smithi157.stdout:4/52: dread d3/f5 [0,4194304] 0 2024-02-28T16:26:55.768 INFO:tasks.workunit.client.0.smithi148.stdout:6/901: write d0/d4/fa1 [540462,129271] 0 2024-02-28T16:26:55.769 INFO:tasks.workunit.client.1.smithi157.stdout:9/57: write d0/f3 [4770782,84708] 0 2024-02-28T16:26:55.769 INFO:tasks.workunit.client.1.smithi157.stdout:7/100: rmdir df/d1f 39 2024-02-28T16:26:55.769 INFO:tasks.workunit.client.0.smithi148.stdout:9/987: dwrite d7/d43/fd0 [0,4194304] 0 2024-02-28T16:26:55.771 INFO:tasks.workunit.client.0.smithi148.stdout:5/875: fsync d1/fd7 0 2024-02-28T16:26:55.778 INFO:tasks.workunit.client.0.smithi148.stdout:7/854: creat d0/d9/d25/d96/db7/f108 x:0 0 0 2024-02-28T16:26:55.779 INFO:tasks.workunit.client.0.smithi148.stdout:7/855: dread - d0/d9/d1b/f9d zero size 2024-02-28T16:26:55.780 INFO:tasks.workunit.client.0.smithi148.stdout:3/991: symlink d1/d13/d19/d1b/d38/d113/d103/l12c 0 2024-02-28T16:26:55.782 INFO:tasks.workunit.client.1.smithi157.stdout:0/136: write d1/d8/f9 [82532,44974] 0 2024-02-28T16:26:55.782 INFO:tasks.workunit.client.1.smithi157.stdout:2/108: symlink da/l22 0 2024-02-28T16:26:55.793 INFO:tasks.workunit.client.1.smithi157.stdout:9/58: rename d0/fd to d0/f10 0 2024-02-28T16:26:55.796 INFO:tasks.workunit.client.1.smithi157.stdout:7/101: symlink df/l23 0 2024-02-28T16:26:55.796 INFO:tasks.workunit.client.1.smithi157.stdout:0/137: fsync d1/d13/f1b 0 2024-02-28T16:26:55.797 INFO:tasks.workunit.client.0.smithi148.stdout:8/995: dread d1/d3/d18/d5a/d60/f6d [0,4194304] 0 2024-02-28T16:26:55.797 INFO:tasks.workunit.client.1.smithi157.stdout:3/71: dwrite d0/d6/f15 [0,4194304] 0 2024-02-28T16:26:55.801 INFO:tasks.workunit.client.0.smithi148.stdout:7/856: mknod d0/d9/d25/d96/ddf/d28/d2b/d6f/c109 0 2024-02-28T16:26:55.803 INFO:tasks.workunit.client.1.smithi157.stdout:1/111: dwrite d10/d11/f1c [0,4194304] 0 2024-02-28T16:26:55.805 INFO:tasks.workunit.client.1.smithi157.stdout:5/114: dwrite d0/f27 [0,4194304] 0 2024-02-28T16:26:55.807 INFO:tasks.workunit.client.0.smithi148.stdout:6/902: dread d0/d22/d25/d76/f85 [0,4194304] 0 2024-02-28T16:26:55.811 INFO:tasks.workunit.client.1.smithi157.stdout:8/52: dread d1/f2 [4194304,4194304] 0 2024-02-28T16:26:55.811 INFO:tasks.workunit.client.1.smithi157.stdout:9/59: symlink d0/l11 0 2024-02-28T16:26:55.813 INFO:tasks.workunit.client.1.smithi157.stdout:0/138: write d1/d13/ff [2436164,30541] 0 2024-02-28T16:26:55.815 INFO:tasks.workunit.client.1.smithi157.stdout:6/72: dwrite f0 [4194304,4194304] 0 2024-02-28T16:26:55.817 INFO:tasks.workunit.client.0.smithi148.stdout:7/857: fsync d0/d9/d25/f7e 0 2024-02-28T16:26:55.818 INFO:tasks.workunit.client.0.smithi148.stdout:6/903: fsync d0/d4/dba/fa0 0 2024-02-28T16:26:55.820 INFO:tasks.workunit.client.1.smithi157.stdout:6/73: rename d2 to d2/d10 22 2024-02-28T16:26:55.820 INFO:tasks.workunit.client.1.smithi157.stdout:0/139: chown d1/d8/f25 1 1 2024-02-28T16:26:55.821 INFO:tasks.workunit.client.1.smithi157.stdout:5/115: dread d0/d8/f18 [0,4194304] 0 2024-02-28T16:26:55.822 INFO:tasks.workunit.client.1.smithi157.stdout:1/112: mkdir d10/d11/d22 0 2024-02-28T16:26:55.822 INFO:tasks.workunit.client.0.smithi148.stdout:5/876: dwrite d1/db/d25/fe3 [0,4194304] 0 2024-02-28T16:26:55.823 INFO:tasks.workunit.client.0.smithi148.stdout:7/858: stat d0/d9/d25/d96/lc5 0 2024-02-28T16:26:55.823 INFO:tasks.workunit.client.1.smithi157.stdout:9/60: creat d0/f12 x:0 0 0 2024-02-28T16:26:55.825 INFO:tasks.workunit.client.1.smithi157.stdout:7/102: mkdir df/d1f/d24 0 2024-02-28T16:26:55.826 INFO:tasks.workunit.client.1.smithi157.stdout:2/109: getdents da 0 2024-02-28T16:26:55.827 INFO:tasks.workunit.client.1.smithi157.stdout:8/53: unlink d1/l7 0 2024-02-28T16:26:55.828 INFO:tasks.workunit.client.1.smithi157.stdout:5/116: chown d0/f19 3917916 1 2024-02-28T16:26:55.829 INFO:tasks.workunit.client.1.smithi157.stdout:1/113: write d10/d11/d17/f1e [956430,101597] 0 2024-02-28T16:26:55.831 INFO:tasks.workunit.client.1.smithi157.stdout:3/72: dread d0/d6/f17 [0,4194304] 0 2024-02-28T16:26:55.833 INFO:tasks.workunit.client.1.smithi157.stdout:9/61: symlink d0/l13 0 2024-02-28T16:26:55.834 INFO:tasks.workunit.client.0.smithi148.stdout:4/751: dwrite d8/d21/d3d/f4c [0,4194304] 0 2024-02-28T16:26:55.835 INFO:tasks.workunit.client.1.smithi157.stdout:3/73: write d0/f4 [1012413,55839] 0 2024-02-28T16:26:55.836 INFO:tasks.workunit.client.0.smithi148.stdout:9/988: dread d7/dd/d26/f5d [0,4194304] 0 2024-02-28T16:26:55.838 INFO:tasks.workunit.client.0.smithi148.stdout:6/904: creat d0/d22/d27/d3e/d52/f124 x:0 0 0 2024-02-28T16:26:55.840 INFO:tasks.workunit.client.1.smithi157.stdout:5/117: mknod d0/d9/c28 0 2024-02-28T16:26:55.841 INFO:tasks.workunit.client.1.smithi157.stdout:7/103: dread df/f10 [0,4194304] 0 2024-02-28T16:26:55.841 INFO:tasks.workunit.client.1.smithi157.stdout:1/114: creat d10/d11/d18/f23 x:0 0 0 2024-02-28T16:26:55.842 INFO:tasks.workunit.client.1.smithi157.stdout:7/104: read fd [1989489,102354] 0 2024-02-28T16:26:55.843 INFO:tasks.workunit.client.1.smithi157.stdout:5/118: chown d0/fe 61 1 2024-02-28T16:26:55.845 INFO:tasks.workunit.client.0.smithi148.stdout:8/996: dwrite d1/d3/d18/d5a/d60/f82 [4194304,4194304] 0 2024-02-28T16:26:55.855 INFO:tasks.workunit.client.1.smithi157.stdout:9/62: symlink d0/l14 0 2024-02-28T16:26:55.856 INFO:tasks.workunit.client.0.smithi148.stdout:7/859: mkdir d0/d9/d25/d96/ddf/d28/d2b/d5c/d10a 0 2024-02-28T16:26:55.856 INFO:tasks.workunit.client.0.smithi148.stdout:3/992: dread d1/d13/d19/d1b/d38/f43 [0,4194304] 0 2024-02-28T16:26:55.856 INFO:tasks.workunit.client.0.smithi148.stdout:9/989: creat d7/d43/de0/f14a x:0 0 0 2024-02-28T16:26:55.859 INFO:tasks.workunit.client.0.smithi148.stdout:4/752: rmdir d8/d40/dc3/dd3/d17/d6a/d6c/dda 39 2024-02-28T16:26:55.860 INFO:tasks.workunit.client.1.smithi157.stdout:2/110: link da/fe da/f23 0 2024-02-28T16:26:55.862 INFO:tasks.workunit.client.0.smithi148.stdout:2/975: sync 2024-02-28T16:26:55.863 INFO:tasks.workunit.client.1.smithi157.stdout:3/74: rename d0/l7 to d0/d6/l18 0 2024-02-28T16:26:55.864 INFO:tasks.workunit.client.1.smithi157.stdout:5/119: mknod d0/c29 0 2024-02-28T16:26:55.864 INFO:tasks.workunit.client.1.smithi157.stdout:7/105: dwrite f0 [4194304,4194304] 0 2024-02-28T16:26:55.870 INFO:tasks.workunit.client.0.smithi148.stdout:6/905: dwrite d0/d4/fa1 [0,4194304] 0 2024-02-28T16:26:55.871 INFO:tasks.workunit.client.1.smithi157.stdout:9/63: creat d0/f15 x:0 0 0 2024-02-28T16:26:55.877 INFO:tasks.workunit.client.0.smithi148.stdout:4/753: mkdir d8/d21/d3d/d4d/d66/dad/dfe 0 2024-02-28T16:26:55.879 INFO:tasks.workunit.client.1.smithi157.stdout:6/74: fsync f0 0 2024-02-28T16:26:55.879 INFO:tasks.workunit.client.1.smithi157.stdout:1/115: creat d10/d11/d22/f24 x:0 0 0 2024-02-28T16:26:55.881 INFO:tasks.workunit.client.1.smithi157.stdout:1/116: stat d10/d11/f14 0 2024-02-28T16:26:55.881 INFO:tasks.workunit.client.1.smithi157.stdout:2/111: creat da/f24 x:0 0 0 2024-02-28T16:26:55.882 INFO:tasks.workunit.client.1.smithi157.stdout:1/117: chown d10/f21 0 1 2024-02-28T16:26:55.885 INFO:tasks.workunit.client.0.smithi148.stdout:2/976: unlink d0/d18/d12a/ddd/d11b/d12b/d13/d38/f3e 0 2024-02-28T16:26:55.891 INFO:tasks.workunit.client.1.smithi157.stdout:3/75: rename d0/c9 to d0/c19 0 2024-02-28T16:26:55.892 INFO:tasks.workunit.client.1.smithi157.stdout:3/76: chown d0/d6 819671285 1 2024-02-28T16:26:55.895 INFO:tasks.workunit.client.0.smithi148.stdout:7/860: symlink d0/d9/d25/d96/ddf/d28/d2b/d5c/d10a/l10b 0 2024-02-28T16:26:55.904 INFO:tasks.workunit.client.1.smithi157.stdout:8/54: dwrite d1/f2 [4194304,4194304] 0 2024-02-28T16:26:55.904 INFO:tasks.workunit.client.0.smithi148.stdout:7/861: creat d0/d9/d25/d96/db7/dd4/dfd/f10c x:0 0 0 2024-02-28T16:26:55.905 INFO:tasks.workunit.client.1.smithi157.stdout:4/53: sync 2024-02-28T16:26:55.908 INFO:tasks.workunit.client.0.smithi148.stdout:5/877: write d1/db/d60/d7a/d8b/f5e [4225681,92992] 0 2024-02-28T16:26:55.911 INFO:tasks.workunit.client.0.smithi148.stdout:6/906: creat d0/d22/d27/d3e/f125 x:0 0 0 2024-02-28T16:26:55.912 INFO:tasks.workunit.client.0.smithi148.stdout:7/862: mknod d0/d9/d4c/c10d 0 2024-02-28T16:26:55.914 INFO:tasks.workunit.client.0.smithi148.stdout:9/990: dwrite d7/d43/d147/d59/d83/de4/f124 [0,4194304] 0 2024-02-28T16:26:55.917 INFO:tasks.workunit.client.0.smithi148.stdout:2/977: creat d0/f136 x:0 0 0 2024-02-28T16:26:55.919 INFO:tasks.workunit.client.0.smithi148.stdout:6/907: chown d0/d4/d14/d59/f75 88 1 2024-02-28T16:26:55.930 INFO:tasks.workunit.client.0.smithi148.stdout:3/993: write d1/d13/d19/d32/d11c/f8b [3223148,93360] 0 2024-02-28T16:26:55.935 INFO:tasks.workunit.client.0.smithi148.stdout:8/997: dwrite d1/dd/d13/d1a/d33/fa8 [0,4194304] 0 2024-02-28T16:26:55.935 INFO:tasks.workunit.client.0.smithi148.stdout:9/991: mknod d7/d43/d147/d3d/c14b 0 2024-02-28T16:26:55.939 INFO:tasks.workunit.client.0.smithi148.stdout:2/978: truncate d0/d1c/dcc/d133/fc5 969541 0 2024-02-28T16:26:55.944 INFO:tasks.workunit.client.0.smithi148.stdout:2/979: read d0/d18/d12a/ddd/d11b/d12b/d13/d38/d3a/fb1 [3228353,17149] 0 2024-02-28T16:26:55.945 INFO:tasks.workunit.client.1.smithi157.stdout:5/120: write d0/d9/f1f [1989070,44375] 0 2024-02-28T16:26:55.945 INFO:tasks.workunit.client.0.smithi148.stdout:4/754: write d8/d40/dc3/dd3/d17/ffc [210711,105546] 0 2024-02-28T16:26:55.959 INFO:tasks.workunit.client.0.smithi148.stdout:5/878: write d1/f2f [4361290,95949] 0 2024-02-28T16:26:55.967 INFO:tasks.workunit.client.1.smithi157.stdout:5/121: dread d0/d8/f18 [0,4194304] 0 2024-02-28T16:26:55.968 INFO:tasks.workunit.client.0.smithi148.stdout:7/863: dwrite d0/d9/fc [0,4194304] 0 2024-02-28T16:26:55.971 INFO:tasks.workunit.client.0.smithi148.stdout:6/908: dread d0/d22/d25/d76/f115 [4194304,4194304] 0 2024-02-28T16:26:55.972 INFO:tasks.workunit.client.0.smithi148.stdout:9/992: creat d7/dd/dd2/f14c x:0 0 0 2024-02-28T16:26:55.981 INFO:tasks.workunit.client.1.smithi157.stdout:0/140: sync 2024-02-28T16:26:55.983 INFO:tasks.workunit.client.0.smithi148.stdout:2/980: unlink d0/d18/d12a/ddd/d11b/d12b/d13/d38/d3a/db3/ldb 0 2024-02-28T16:26:55.985 INFO:tasks.workunit.client.0.smithi148.stdout:3/994: dwrite d1/d3f/da5/dda/ff1 [0,4194304] 0 2024-02-28T16:26:55.988 INFO:tasks.workunit.client.0.smithi148.stdout:3/995: chown d1/da0/fef 528183 1 2024-02-28T16:26:55.994 INFO:tasks.workunit.client.0.smithi148.stdout:9/993: mknod d7/d43/ddd/df1/d113/c14d 0 2024-02-28T16:26:56.001 INFO:tasks.workunit.client.0.smithi148.stdout:4/755: dwrite d8/d21/d3d/d8c/db0/fd2 [0,4194304] 0 2024-02-28T16:26:56.015 INFO:tasks.workunit.client.0.smithi148.stdout:4/756: chown d8/d21/d3d/d4d/d66/fa9 339869 1 2024-02-28T16:26:56.017 INFO:tasks.workunit.client.1.smithi157.stdout:0/141: dwrite d1/d8/fc [0,4194304] 0 2024-02-28T16:26:56.021 INFO:tasks.workunit.client.0.smithi148.stdout:5/879: mkdir d1/d8/d20/dd8/d89/d10e 0 2024-02-28T16:26:56.023 INFO:tasks.workunit.client.0.smithi148.stdout:5/880: stat d1/db/d60/df0/lb1 0 2024-02-28T16:26:56.026 INFO:tasks.workunit.client.0.smithi148.stdout:7/864: write d0/d9/d25/f7e [1020854,128214] 0 2024-02-28T16:26:56.029 INFO:tasks.workunit.client.0.smithi148.stdout:7/865: chown d0/d9/d25/d96/db7 8 1 2024-02-28T16:26:56.031 INFO:tasks.workunit.client.0.smithi148.stdout:3/996: mkdir d1/d13/d19/d56/d5b/d115/d12d 0 2024-02-28T16:26:56.031 INFO:tasks.workunit.client.0.smithi148.stdout:8/998: dwrite d1/dd/d13/d1a/d87/f6b [0,4194304] 0 2024-02-28T16:26:56.033 INFO:tasks.workunit.client.0.smithi148.stdout:9/994: unlink d7/dd/d26/c28 0 2024-02-28T16:26:56.037 INFO:tasks.workunit.client.0.smithi148.stdout:4/757: symlink d8/d71/lff 0 2024-02-28T16:26:56.039 INFO:tasks.workunit.client.0.smithi148.stdout:4/758: dread - d8/d37/ff5 zero size 2024-02-28T16:26:56.041 INFO:tasks.workunit.client.0.smithi148.stdout:6/909: dwrite d0/d22/f37 [0,4194304] 0 2024-02-28T16:26:56.045 INFO:tasks.workunit.client.0.smithi148.stdout:5/881: truncate d1/d8/d20/d4e/d84/fa7 2085449 0 2024-02-28T16:26:56.048 INFO:tasks.workunit.client.0.smithi148.stdout:7/866: mknod d0/d18/c10e 0 2024-02-28T16:26:56.049 INFO:tasks.workunit.client.0.smithi148.stdout:7/867: stat d0/f2 0 2024-02-28T16:26:56.053 INFO:tasks.workunit.client.1.smithi157.stdout:6/75: unlink d2/d7/d8/fb 0 2024-02-28T16:26:56.057 INFO:tasks.workunit.client.1.smithi157.stdout:2/112: rename da/f19 to da/f25 0 2024-02-28T16:26:56.058 INFO:tasks.workunit.client.1.smithi157.stdout:2/113: readlink l6 0 2024-02-28T16:26:56.058 INFO:tasks.workunit.client.0.smithi148.stdout:6/910: dwrite d0/d8/dfd/f109 [0,4194304] 0 2024-02-28T16:26:56.059 INFO:tasks.workunit.client.0.smithi148.stdout:9/995: rename d7/d43/d147/d3d to d7/dd/dd2/d14e 0 2024-02-28T16:26:56.062 INFO:tasks.workunit.client.1.smithi157.stdout:1/118: unlink d10/d11/d18/f20 0 2024-02-28T16:26:56.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/911: truncate d0/d22/d49/d88/d107/f9c 1298768 0 2024-02-28T16:26:56.066 INFO:tasks.workunit.client.0.smithi148.stdout:4/759: creat d8/d40/dc3/dd3/d17/d6a/f100 x:0 0 0 2024-02-28T16:26:56.067 INFO:tasks.workunit.client.1.smithi157.stdout:7/106: mkdir df/d25 0 2024-02-28T16:26:56.070 INFO:tasks.workunit.client.1.smithi157.stdout:3/77: rename d0/l10 to d0/d6/l1a 0 2024-02-28T16:26:56.079 INFO:tasks.workunit.client.0.smithi148.stdout:9/996: truncate d7/f3c 2858664 0 2024-02-28T16:26:56.083 INFO:tasks.workunit.client.0.smithi148.stdout:9/997: dread d7/d43/d147/d32/d24/dac/fdc [0,4194304] 0 2024-02-28T16:26:56.085 INFO:tasks.workunit.client.0.smithi148.stdout:4/760: creat d8/d37/f101 x:0 0 0 2024-02-28T16:26:56.085 INFO:tasks.workunit.client.0.smithi148.stdout:8/999: dwrite d1/dd/d13/d24/d3a/d49/fde [0,4194304] 0 2024-02-28T16:26:56.087 INFO:tasks.workunit.client.0.smithi148.stdout:5/882: mknod d1/d8/d20/d4e/d84/d108/c10f 0 2024-02-28T16:26:56.087 INFO:tasks.workunit.client.0.smithi148.stdout:9/998: truncate d7/d43/d147/d32/d24/f13c 879856 0 2024-02-28T16:26:56.089 INFO:tasks.workunit.client.0.smithi148.stdout:5/883: stat d1/db/d25/l8f 0 2024-02-28T16:26:56.091 INFO:tasks.workunit.client.0.smithi148.stdout:9/999: write d7/d43/d147/d1f/d49/dd8/f10a [1497759,117351] 0 2024-02-28T16:26:56.092 INFO:tasks.workunit.client.0.smithi148.stdout:5/884: chown d1/db/d60/d7a/d8b/d80/le9 8215239 1 2024-02-28T16:26:56.093 INFO:tasks.workunit.client.0.smithi148.stdout:3/997: link d1/db5/f124 d1/db/d35/f12e 0 2024-02-28T16:26:56.097 INFO:tasks.workunit.client.1.smithi157.stdout:9/64: truncate d0/f4 499824 0 2024-02-28T16:26:56.104 INFO:tasks.workunit.client.1.smithi157.stdout:2/114: rename da/f1b to da/f26 0 2024-02-28T16:26:56.105 INFO:tasks.workunit.client.0.smithi148.stdout:4/761: dwrite d8/d40/dc3/dd3/d17/fe0 [0,4194304] 0 2024-02-28T16:26:56.106 INFO:tasks.workunit.client.1.smithi157.stdout:2/115: chown da/ld 3721 1 2024-02-28T16:26:56.107 INFO:tasks.workunit.client.1.smithi157.stdout:2/116: read - da/f24 zero size 2024-02-28T16:26:56.109 INFO:tasks.workunit.client.1.smithi157.stdout:1/119: creat d10/d11/d17/f25 x:0 0 0 2024-02-28T16:26:56.118 INFO:tasks.workunit.client.0.smithi148.stdout:7/868: creat d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/f10f x:0 0 0 2024-02-28T16:26:56.125 INFO:tasks.workunit.client.0.smithi148.stdout:7/869: unlink d0/d9/lce 0 2024-02-28T16:26:56.128 INFO:tasks.workunit.client.0.smithi148.stdout:4/762: dwrite d8/d40/ff1 [0,4194304] 0 2024-02-28T16:26:56.128 INFO:tasks.workunit.client.1.smithi157.stdout:9/65: mknod d0/c16 0 2024-02-28T16:26:56.131 INFO:tasks.workunit.client.0.smithi148.stdout:6/912: dwrite d0/d4/d14/d59/f94 [0,4194304] 0 2024-02-28T16:26:56.131 INFO:tasks.workunit.client.1.smithi157.stdout:2/117: creat da/f27 x:0 0 0 2024-02-28T16:26:56.134 INFO:tasks.workunit.client.1.smithi157.stdout:1/120: creat d10/d11/d17/f26 x:0 0 0 2024-02-28T16:26:56.137 INFO:tasks.workunit.client.0.smithi148.stdout:5/885: dread d1/db/d60/f86 [0,4194304] 0 2024-02-28T16:26:56.137 INFO:tasks.workunit.client.1.smithi157.stdout:0/142: rename d1/d13/l14 to d1/d8/d27/l30 0 2024-02-28T16:26:56.139 INFO:tasks.workunit.client.1.smithi157.stdout:0/143: chown d1/l1e 26695 1 2024-02-28T16:26:56.144 INFO:tasks.workunit.client.0.smithi148.stdout:6/913: symlink d0/d22/d27/d3e/d52/l126 0 2024-02-28T16:26:56.147 INFO:tasks.workunit.client.1.smithi157.stdout:5/122: truncate d0/d9/ff 1947719 0 2024-02-28T16:26:56.148 INFO:tasks.workunit.client.1.smithi157.stdout:9/66: fdatasync d0/f5 0 2024-02-28T16:26:56.150 INFO:tasks.workunit.client.1.smithi157.stdout:9/67: fdatasync d0/f10 0 2024-02-28T16:26:56.153 INFO:tasks.workunit.client.0.smithi148.stdout:5/886: mknod d1/d8/d20/dd8/c110 0 2024-02-28T16:26:56.155 INFO:tasks.workunit.client.1.smithi157.stdout:7/107: truncate df/f10 2621436 0 2024-02-28T16:26:56.156 INFO:tasks.workunit.client.0.smithi148.stdout:6/914: symlink d0/d22/d25/d76/l127 0 2024-02-28T16:26:56.158 INFO:tasks.workunit.client.0.smithi148.stdout:6/915: read d0/f4c [4606840,63034] 0 2024-02-28T16:26:56.160 INFO:tasks.workunit.client.1.smithi157.stdout:3/78: truncate d0/d6/fa 3209230 0 2024-02-28T16:26:56.161 INFO:tasks.workunit.client.0.smithi148.stdout:5/887: rename d1/db/d60/d7a/d8b/d80 to d1/db/d60/d7a/db2/d111 0 2024-02-28T16:26:56.161 INFO:tasks.workunit.client.1.smithi157.stdout:1/121: dwrite d10/d11/d17/f1a [0,4194304] 0 2024-02-28T16:26:56.163 INFO:tasks.workunit.client.1.smithi157.stdout:0/144: symlink d1/da/l31 0 2024-02-28T16:26:56.165 INFO:tasks.workunit.client.1.smithi157.stdout:4/54: getdents d3/da 0 2024-02-28T16:26:56.165 INFO:tasks.workunit.client.1.smithi157.stdout:1/122: read d10/d11/f1c [1375319,16262] 0 2024-02-28T16:26:56.171 INFO:tasks.workunit.client.1.smithi157.stdout:1/123: stat d10/d11/d17/f1a 0 2024-02-28T16:26:56.172 INFO:tasks.workunit.client.1.smithi157.stdout:1/124: fsync fd 0 2024-02-28T16:26:56.174 INFO:tasks.workunit.client.1.smithi157.stdout:3/79: creat d0/f1b x:0 0 0 2024-02-28T16:26:56.175 INFO:tasks.workunit.client.1.smithi157.stdout:9/68: dwrite d0/f15 [0,4194304] 0 2024-02-28T16:26:56.182 INFO:tasks.workunit.client.0.smithi148.stdout:7/870: dread d0/d9/d25/d96/ddf/d28/d2b/d6f/dd3/fd9 [0,4194304] 0 2024-02-28T16:26:56.182 INFO:tasks.workunit.client.1.smithi157.stdout:4/55: unlink d3/f11 0 2024-02-28T16:26:56.184 INFO:tasks.workunit.client.1.smithi157.stdout:6/76: rename d2/ff to d2/d7/f11 0 2024-02-28T16:26:56.185 INFO:tasks.workunit.client.0.smithi148.stdout:6/916: dwrite d0/d22/d49/d88/d107/f10c [0,4194304] 0 2024-02-28T16:26:56.186 INFO:tasks.workunit.client.1.smithi157.stdout:2/118: dwrite da/f1e [0,4194304] 0 2024-02-28T16:26:56.190 INFO:tasks.workunit.client.1.smithi157.stdout:5/123: write d0/d9/ff [2542903,3379] 0 2024-02-28T16:26:56.191 INFO:tasks.workunit.client.0.smithi148.stdout:7/871: read d0/d18/f79 [922808,123277] 0 2024-02-28T16:26:56.193 INFO:tasks.workunit.client.1.smithi157.stdout:1/125: mkdir d10/d11/d17/d27 0 2024-02-28T16:26:56.197 INFO:tasks.workunit.client.1.smithi157.stdout:3/80: creat d0/f1c x:0 0 0 2024-02-28T16:26:56.198 INFO:tasks.workunit.client.1.smithi157.stdout:0/145: creat d1/d8/d27/d2d/f32 x:0 0 0 2024-02-28T16:26:56.200 INFO:tasks.workunit.client.0.smithi148.stdout:7/872: mknod d0/d9/d25/d96/ddf/d28/d2b/d5c/c110 0 2024-02-28T16:26:56.200 INFO:tasks.workunit.client.1.smithi157.stdout:6/77: mknod d2/d7/d8/c12 0 2024-02-28T16:26:56.203 INFO:tasks.workunit.client.1.smithi157.stdout:1/126: creat d10/d11/f28 x:0 0 0 2024-02-28T16:26:56.203 INFO:tasks.workunit.client.1.smithi157.stdout:3/81: dread - d0/d6/f11 zero size 2024-02-28T16:26:56.205 INFO:tasks.workunit.client.1.smithi157.stdout:0/146: mkdir d1/d8/d33 0 2024-02-28T16:26:56.206 INFO:tasks.workunit.client.1.smithi157.stdout:1/127: write f5 [1186055,29602] 0 2024-02-28T16:26:56.206 INFO:tasks.workunit.client.1.smithi157.stdout:3/82: stat d0/d6/ce 0 2024-02-28T16:26:56.207 INFO:tasks.workunit.client.1.smithi157.stdout:8/55: rename d1 to d1/db 22 2024-02-28T16:26:56.208 INFO:tasks.workunit.client.0.smithi148.stdout:6/917: dwrite d0/f6e [0,4194304] 0 2024-02-28T16:26:56.209 INFO:tasks.workunit.client.1.smithi157.stdout:8/56: chown d1 845 1 2024-02-28T16:26:56.213 INFO:tasks.workunit.client.1.smithi157.stdout:4/56: dwrite d3/da/f12 [0,4194304] 0 2024-02-28T16:26:56.213 INFO:tasks.workunit.client.1.smithi157.stdout:9/69: link d0/lc d0/l17 0 2024-02-28T16:26:56.218 INFO:tasks.workunit.client.1.smithi157.stdout:9/70: write d0/f15 [533612,14703] 0 2024-02-28T16:26:56.219 INFO:tasks.workunit.client.1.smithi157.stdout:1/128: dread f4 [0,4194304] 0 2024-02-28T16:26:56.219 INFO:tasks.workunit.client.0.smithi148.stdout:5/888: dread d1/db/d25/f7e [0,4194304] 0 2024-02-28T16:26:56.223 INFO:tasks.workunit.client.0.smithi148.stdout:5/889: chown d1/d8/d20/d4e/d71/c95 85 1 2024-02-28T16:26:56.224 INFO:tasks.workunit.client.1.smithi157.stdout:0/147: mknod d1/d8/c34 0 2024-02-28T16:26:56.226 INFO:tasks.workunit.client.1.smithi157.stdout:9/71: chown d0/f5 0 1 2024-02-28T16:26:56.228 INFO:tasks.workunit.client.1.smithi157.stdout:4/57: creat d3/f13 x:0 0 0 2024-02-28T16:26:56.229 INFO:tasks.workunit.client.1.smithi157.stdout:0/148: write d1/f6 [5112446,103030] 0 2024-02-28T16:26:56.231 INFO:tasks.workunit.client.1.smithi157.stdout:7/108: dwrite df/f10 [0,4194304] 0 2024-02-28T16:26:56.232 INFO:tasks.workunit.client.1.smithi157.stdout:2/119: getdents da 0 2024-02-28T16:26:56.233 INFO:tasks.workunit.client.0.smithi148.stdout:5/890: readlink d1/db/d60/d7a/db2/d111/le8 0 2024-02-28T16:26:56.235 INFO:tasks.workunit.client.1.smithi157.stdout:0/149: chown d1/d8/f20 2362 1 2024-02-28T16:26:56.236 INFO:tasks.workunit.client.1.smithi157.stdout:5/124: dwrite d0/d8/fb [0,4194304] 0 2024-02-28T16:26:56.237 INFO:tasks.workunit.client.1.smithi157.stdout:3/83: truncate d0/d6/f17 3495828 0 2024-02-28T16:26:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:55 smithi157 ceph-mon[38346]: pgmap v52: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 108 MiB/s wr, 272 op/s 2024-02-28T16:26:56.238 INFO:tasks.workunit.client.1.smithi157.stdout:4/58: write d3/da/f12 [3205358,57043] 0 2024-02-28T16:26:56.242 INFO:tasks.workunit.client.1.smithi157.stdout:3/84: chown d0/d6/f16 25078859 1 2024-02-28T16:26:56.242 INFO:tasks.workunit.client.1.smithi157.stdout:1/129: mknod d10/d11/d22/c29 0 2024-02-28T16:26:56.243 INFO:tasks.workunit.client.1.smithi157.stdout:9/72: creat d0/f18 x:0 0 0 2024-02-28T16:26:56.245 INFO:tasks.workunit.client.1.smithi157.stdout:2/120: rmdir da 39 2024-02-28T16:26:56.246 INFO:tasks.workunit.client.1.smithi157.stdout:1/130: write fd [1064425,122958] 0 2024-02-28T16:26:56.247 INFO:tasks.workunit.client.1.smithi157.stdout:2/121: chown da/ld 1042996 1 2024-02-28T16:26:56.248 INFO:tasks.workunit.client.1.smithi157.stdout:1/131: read f4 [677831,37651] 0 2024-02-28T16:26:56.249 INFO:tasks.workunit.client.1.smithi157.stdout:2/122: chown da/f23 7894716 1 2024-02-28T16:26:56.250 INFO:tasks.workunit.client.0.smithi148.stdout:5/891: link d1/d8e/cbd d1/db/d60/df0/ddd/c112 0 2024-02-28T16:26:56.251 INFO:tasks.workunit.client.1.smithi157.stdout:7/109: fsync fd 0 2024-02-28T16:26:56.252 INFO:tasks.workunit.client.1.smithi157.stdout:0/150: creat d1/d8/d27/d2d/f35 x:0 0 0 2024-02-28T16:26:56.253 INFO:tasks.workunit.client.1.smithi157.stdout:4/59: symlink d3/da/l14 0 2024-02-28T16:26:56.254 INFO:tasks.workunit.client.1.smithi157.stdout:5/125: creat d0/d9/d11/f2a x:0 0 0 2024-02-28T16:26:56.255 INFO:tasks.workunit.client.0.smithi148.stdout:6/918: truncate d0/d22/d27/fc7 250434 0 2024-02-28T16:26:56.255 INFO:tasks.workunit.client.0.smithi148.stdout:5/892: write d1/f43 [747058,128723] 0 2024-02-28T16:26:56.255 INFO:tasks.workunit.client.1.smithi157.stdout:6/78: write d2/f6 [2308173,22676] 0 2024-02-28T16:26:56.260 INFO:tasks.workunit.client.1.smithi157.stdout:6/79: readlink l1 0 2024-02-28T16:26:56.261 INFO:tasks.workunit.client.0.smithi148.stdout:6/919: chown d0/d22/d25/d76/cdd 362402 1 2024-02-28T16:26:56.263 INFO:tasks.workunit.client.0.smithi148.stdout:7/873: dwrite d0/d9/d25/d96/ddf/d1c/d32/f4e [0,4194304] 0 2024-02-28T16:26:56.265 INFO:tasks.workunit.client.1.smithi157.stdout:7/110: dread df/f17 [0,4194304] 0 2024-02-28T16:26:56.265 INFO:tasks.workunit.client.1.smithi157.stdout:1/132: rename d10/d11/d17/d27 to d10/d11/d18/d2a 0 2024-02-28T16:26:56.269 INFO:tasks.workunit.client.1.smithi157.stdout:8/57: rename d1/l9 to d1/lc 0 2024-02-28T16:26:56.271 INFO:tasks.workunit.client.1.smithi157.stdout:7/111: write df/f16 [4994666,83320] 0 2024-02-28T16:26:56.271 INFO:tasks.workunit.client.1.smithi157.stdout:1/133: chown d10/d11/f14 85052 1 2024-02-28T16:26:56.271 INFO:tasks.workunit.client.1.smithi157.stdout:0/151: symlink d1/d13/l36 0 2024-02-28T16:26:56.272 INFO:tasks.workunit.client.0.smithi148.stdout:6/920: chown d0/d4/dba/l2c 411035 1 2024-02-28T16:26:56.275 INFO:tasks.workunit.client.1.smithi157.stdout:0/152: fdatasync d1/f2 0 2024-02-28T16:26:56.278 INFO:tasks.workunit.client.1.smithi157.stdout:2/123: link da/f26 da/f28 0 2024-02-28T16:26:56.280 INFO:tasks.workunit.client.1.smithi157.stdout:9/73: dwrite d0/f12 [0,4194304] 0 2024-02-28T16:26:56.282 INFO:tasks.workunit.client.0.smithi148.stdout:6/921: write d0/d8/d21/d9d/fca [24525,109996] 0 2024-02-28T16:26:56.284 INFO:tasks.workunit.client.1.smithi157.stdout:2/124: truncate da/f23 939779 0 2024-02-28T16:26:56.285 INFO:tasks.workunit.client.0.smithi148.stdout:6/922: fsync d0/d22/d25/d76/fb9 0 2024-02-28T16:26:56.286 INFO:tasks.workunit.client.1.smithi157.stdout:1/134: mkdir d10/d11/d18/d2b 0 2024-02-28T16:26:56.288 INFO:tasks.workunit.client.1.smithi157.stdout:1/135: dread - d10/f1b zero size 2024-02-28T16:26:56.289 INFO:tasks.workunit.client.1.smithi157.stdout:4/60: dread d3/f4 [0,4194304] 0 2024-02-28T16:26:56.289 INFO:tasks.workunit.client.0.smithi148.stdout:7/874: dwrite d0/d9/d25/d96/ddf/f27 [4194304,4194304] 0 2024-02-28T16:26:56.291 INFO:tasks.workunit.client.1.smithi157.stdout:9/74: mkdir d0/d19 0 2024-02-28T16:26:56.291 INFO:tasks.workunit.client.1.smithi157.stdout:4/61: chown d3/f8 208 1 2024-02-28T16:26:56.293 INFO:tasks.workunit.client.1.smithi157.stdout:9/75: fsync d0/f5 0 2024-02-28T16:26:56.293 INFO:tasks.workunit.client.1.smithi157.stdout:5/126: dwrite d0/f19 [0,4194304] 0 2024-02-28T16:26:56.293 INFO:tasks.workunit.client.1.smithi157.stdout:0/153: mknod d1/d8/d27/c37 0 2024-02-28T16:26:56.294 INFO:tasks.workunit.client.0.smithi148.stdout:6/923: creat d0/d22/d25/d76/f128 x:0 0 0 2024-02-28T16:26:56.294 INFO:tasks.workunit.client.0.smithi148.stdout:7/875: stat d0/d9/d25/d96/ddf/d28/d2b 0 2024-02-28T16:26:56.297 INFO:tasks.workunit.client.1.smithi157.stdout:3/85: getdents d0/d6 0 2024-02-28T16:26:56.304 INFO:tasks.workunit.client.1.smithi157.stdout:7/112: mknod df/d25/c26 0 2024-02-28T16:26:56.306 INFO:tasks.workunit.client.1.smithi157.stdout:2/125: mknod da/c29 0 2024-02-28T16:26:56.307 INFO:tasks.workunit.client.0.smithi148.stdout:5/893: dread d1/db/f27 [4194304,4194304] 0 2024-02-28T16:26:56.310 INFO:tasks.workunit.client.1.smithi157.stdout:8/58: dwrite d1/f4 [4194304,4194304] 0 2024-02-28T16:26:56.312 INFO:tasks.workunit.client.1.smithi157.stdout:9/76: dread d0/f3 [0,4194304] 0 2024-02-28T16:26:56.314 INFO:tasks.workunit.client.0.smithi148.stdout:7/876: chown d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/faf 33 1 2024-02-28T16:26:56.314 INFO:tasks.workunit.client.1.smithi157.stdout:4/62: rename d3/da/cb to d3/da/c15 0 2024-02-28T16:26:56.315 INFO:tasks.workunit.client.1.smithi157.stdout:9/77: truncate d0/f12 5187779 0 2024-02-28T16:26:56.323 INFO:tasks.workunit.client.0.smithi148.stdout:7/877: write d0/d9/d4c/f6b [1770675,95836] 0 2024-02-28T16:26:56.329 INFO:tasks.workunit.client.1.smithi157.stdout:0/154: unlink d1/d13/f1b 0 2024-02-28T16:26:56.335 INFO:tasks.workunit.client.0.smithi148.stdout:6/924: dread d0/d22/d25/d76/fb9 [0,4194304] 0 2024-02-28T16:26:56.335 INFO:tasks.workunit.client.1.smithi157.stdout:5/127: read d0/d9/f1f [1810509,58367] 0 2024-02-28T16:26:56.335 INFO:tasks.workunit.client.1.smithi157.stdout:7/113: symlink df/d25/l27 0 2024-02-28T16:26:56.335 INFO:tasks.workunit.client.1.smithi157.stdout:7/114: dread - df/f1a zero size 2024-02-28T16:26:56.336 INFO:tasks.workunit.client.1.smithi157.stdout:5/128: dread - d0/d9/d1b/f25 zero size 2024-02-28T16:26:56.338 INFO:tasks.workunit.client.1.smithi157.stdout:5/129: chown d0/d9/d11/l17 2053 1 2024-02-28T16:26:56.341 INFO:tasks.workunit.client.1.smithi157.stdout:4/63: creat d3/f16 x:0 0 0 2024-02-28T16:26:56.343 INFO:tasks.workunit.client.1.smithi157.stdout:9/78: mknod d0/c1a 0 2024-02-28T16:26:56.344 INFO:tasks.workunit.client.1.smithi157.stdout:0/155: dwrite d1/f2 [8388608,4194304] 0 2024-02-28T16:26:56.350 INFO:tasks.workunit.client.1.smithi157.stdout:2/126: link da/f24 da/f2a 0 2024-02-28T16:26:56.351 INFO:tasks.workunit.client.1.smithi157.stdout:2/127: read da/f12 [4290962,78589] 0 2024-02-28T16:26:56.356 INFO:tasks.workunit.client.1.smithi157.stdout:7/115: truncate fd 4712371 0 2024-02-28T16:26:56.356 INFO:tasks.workunit.client.1.smithi157.stdout:7/116: read f0 [4141267,17639] 0 2024-02-28T16:26:56.358 INFO:tasks.workunit.client.1.smithi157.stdout:7/117: dread - df/f1a zero size 2024-02-28T16:26:56.359 INFO:tasks.workunit.client.1.smithi157.stdout:2/128: dread da/f23 [0,4194304] 0 2024-02-28T16:26:56.361 INFO:tasks.workunit.client.1.smithi157.stdout:2/129: truncate da/f24 1037543 0 2024-02-28T16:26:56.362 INFO:tasks.workunit.client.1.smithi157.stdout:2/130: read da/f23 [814861,49302] 0 2024-02-28T16:26:56.367 INFO:tasks.workunit.client.1.smithi157.stdout:1/136: write f2 [3218473,55869] 0 2024-02-28T16:26:56.368 INFO:tasks.workunit.client.0.smithi148.stdout:7/878: dread d0/d18/f79 [0,4194304] 0 2024-02-28T16:26:56.368 INFO:tasks.workunit.client.1.smithi157.stdout:0/156: fdatasync d1/f15 0 2024-02-28T16:26:56.370 INFO:tasks.workunit.client.1.smithi157.stdout:1/137: truncate d10/d11/d17/f26 431192 0 2024-02-28T16:26:56.372 INFO:tasks.workunit.client.1.smithi157.stdout:1/138: read d10/d11/d17/f26 [150268,20418] 0 2024-02-28T16:26:56.373 INFO:tasks.workunit.client.1.smithi157.stdout:3/86: fdatasync d0/d6/f17 0 2024-02-28T16:26:56.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:55 smithi148 ceph-mon[28767]: pgmap v52: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 108 MiB/s wr, 272 op/s 2024-02-28T16:26:56.374 INFO:tasks.workunit.client.1.smithi157.stdout:1/139: truncate d10/f1b 479684 0 2024-02-28T16:26:56.374 INFO:tasks.workunit.client.1.smithi157.stdout:3/87: stat d0/d6/l18 0 2024-02-28T16:26:56.375 INFO:tasks.workunit.client.1.smithi157.stdout:1/140: write f2 [4870589,41672] 0 2024-02-28T16:26:56.377 INFO:tasks.workunit.client.1.smithi157.stdout:1/141: stat d10/d11/d17/f26 0 2024-02-28T16:26:56.380 INFO:tasks.workunit.client.1.smithi157.stdout:8/59: getdents d1/d5 0 2024-02-28T16:26:56.381 INFO:tasks.workunit.client.1.smithi157.stdout:6/80: sync 2024-02-28T16:26:56.383 INFO:tasks.workunit.client.1.smithi157.stdout:2/131: chown c5 411 1 2024-02-28T16:26:56.385 INFO:tasks.workunit.client.1.smithi157.stdout:4/64: fdatasync f2 0 2024-02-28T16:26:56.387 INFO:tasks.workunit.client.1.smithi157.stdout:9/79: write d0/fb [974818,39250] 0 2024-02-28T16:26:56.388 INFO:tasks.workunit.client.1.smithi157.stdout:0/157: symlink d1/d8/l38 0 2024-02-28T16:26:56.394 INFO:tasks.workunit.client.1.smithi157.stdout:5/130: dwrite d0/f19 [4194304,4194304] 0 2024-02-28T16:26:56.395 INFO:tasks.workunit.client.1.smithi157.stdout:3/88: creat d0/d6/f1d x:0 0 0 2024-02-28T16:26:56.398 INFO:tasks.workunit.client.1.smithi157.stdout:6/81: dwrite d2/d7/fc [0,4194304] 0 2024-02-28T16:26:56.399 INFO:tasks.workunit.client.1.smithi157.stdout:6/82: chown d2/d7/d8 7 1 2024-02-28T16:26:56.401 INFO:tasks.workunit.client.1.smithi157.stdout:7/118: creat df/d1f/d24/f28 x:0 0 0 2024-02-28T16:26:56.404 INFO:tasks.workunit.client.1.smithi157.stdout:0/158: dread d1/f2 [0,4194304] 0 2024-02-28T16:26:56.404 INFO:tasks.workunit.client.1.smithi157.stdout:7/119: write df/f11 [393388,110938] 0 2024-02-28T16:26:56.407 INFO:tasks.workunit.client.1.smithi157.stdout:1/142: rename d10/d11/d17 to d10/d11/d2c 0 2024-02-28T16:26:56.409 INFO:tasks.workunit.client.1.smithi157.stdout:2/132: mkdir da/d2b 0 2024-02-28T16:26:56.410 INFO:tasks.workunit.client.1.smithi157.stdout:1/143: write d10/d11/f28 [578349,82366] 0 2024-02-28T16:26:56.412 INFO:tasks.workunit.client.1.smithi157.stdout:4/65: symlink d3/da/l17 0 2024-02-28T16:26:56.422 INFO:tasks.workunit.client.1.smithi157.stdout:8/60: dread d1/f2 [4194304,4194304] 0 2024-02-28T16:26:56.423 INFO:tasks.workunit.client.1.smithi157.stdout:8/61: chown d1/d5 0 1 2024-02-28T16:26:56.425 INFO:tasks.workunit.client.1.smithi157.stdout:5/131: creat d0/d8/f2b x:0 0 0 2024-02-28T16:26:56.427 INFO:tasks.workunit.client.1.smithi157.stdout:6/83: unlink f0 0 2024-02-28T16:26:56.428 INFO:tasks.workunit.client.1.smithi157.stdout:5/132: read - d0/d9/d11/f2a zero size 2024-02-28T16:26:56.428 INFO:tasks.workunit.client.1.smithi157.stdout:7/120: mknod df/d1f/c29 0 2024-02-28T16:26:56.429 INFO:tasks.workunit.client.1.smithi157.stdout:2/133: dread da/ff [0,4194304] 0 2024-02-28T16:26:56.430 INFO:tasks.workunit.client.1.smithi157.stdout:6/84: chown d2/d7/d8/da 57833867 1 2024-02-28T16:26:56.432 INFO:tasks.workunit.client.1.smithi157.stdout:1/144: dwrite fa [4194304,4194304] 0 2024-02-28T16:26:56.432 INFO:tasks.workunit.client.1.smithi157.stdout:2/134: chown da/f2a 146 1 2024-02-28T16:26:56.437 INFO:tasks.workunit.client.0.smithi148.stdout:7/879: unlink d0/d4/d70/fcf 0 2024-02-28T16:26:56.439 INFO:tasks.workunit.client.1.smithi157.stdout:4/66: mknod d3/c18 0 2024-02-28T16:26:56.439 INFO:tasks.workunit.client.1.smithi157.stdout:8/62: dread d1/f4 [0,4194304] 0 2024-02-28T16:26:56.445 INFO:tasks.workunit.client.0.smithi148.stdout:7/880: mknod d0/d9/d25/d96/db7/dd4/c111 0 2024-02-28T16:26:56.447 INFO:tasks.workunit.client.0.smithi148.stdout:5/894: getdents d1/d8/d20/d4e/d84 0 2024-02-28T16:26:56.448 INFO:tasks.workunit.client.1.smithi157.stdout:6/85: dwrite d2/f5 [0,4194304] 0 2024-02-28T16:26:56.452 INFO:tasks.workunit.client.0.smithi148.stdout:7/881: creat d0/dd5/f112 x:0 0 0 2024-02-28T16:26:56.452 INFO:tasks.workunit.client.1.smithi157.stdout:0/159: creat d1/d8/d33/f39 x:0 0 0 2024-02-28T16:26:56.452 INFO:tasks.workunit.client.1.smithi157.stdout:7/121: creat df/d25/f2a x:0 0 0 2024-02-28T16:26:56.453 INFO:tasks.workunit.client.0.smithi148.stdout:7/882: stat d0/d9/d1b 0 2024-02-28T16:26:56.455 INFO:tasks.workunit.client.0.smithi148.stdout:5/895: rmdir d1/d8/d20/d4e/d96/ddb/dea 39 2024-02-28T16:26:56.456 INFO:tasks.workunit.client.1.smithi157.stdout:5/133: creat d0/d9/f2c x:0 0 0 2024-02-28T16:26:56.460 INFO:tasks.workunit.client.0.smithi148.stdout:7/883: write d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/db4/f84 [1556998,126354] 0 2024-02-28T16:26:56.464 INFO:tasks.workunit.client.0.smithi148.stdout:5/896: symlink d1/db/d60/d7a/d8b/l113 0 2024-02-28T16:26:56.465 INFO:tasks.workunit.client.1.smithi157.stdout:2/135: creat da/f2c x:0 0 0 2024-02-28T16:26:56.466 INFO:tasks.workunit.client.0.smithi148.stdout:5/897: chown d1/d8/d20/d4e/d96 54 1 2024-02-28T16:26:56.466 INFO:tasks.workunit.client.1.smithi157.stdout:4/67: symlink d3/da/l19 0 2024-02-28T16:26:56.467 INFO:tasks.workunit.client.0.smithi148.stdout:5/898: readlink d1/db/d60/l68 0 2024-02-28T16:26:56.467 INFO:tasks.workunit.client.1.smithi157.stdout:7/122: dwrite df/d1f/d24/f28 [0,4194304] 0 2024-02-28T16:26:56.470 INFO:tasks.workunit.client.0.smithi148.stdout:6/925: truncate d0/d22/d49/dae/feb 4170379 0 2024-02-28T16:26:56.472 INFO:tasks.workunit.client.0.smithi148.stdout:7/884: creat d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/dad/f113 x:0 0 0 2024-02-28T16:26:56.474 INFO:tasks.workunit.client.1.smithi157.stdout:0/160: rename d1/d8/f26 to d1/d8/d27/f3a 0 2024-02-28T16:26:56.475 INFO:tasks.workunit.client.1.smithi157.stdout:5/134: creat d0/d8/f2d x:0 0 0 2024-02-28T16:26:56.476 INFO:tasks.workunit.client.1.smithi157.stdout:6/86: fsync d2/f5 0 2024-02-28T16:26:56.477 INFO:tasks.workunit.client.0.smithi148.stdout:5/899: creat d1/db/d60/d7a/dbb/de7/f114 x:0 0 0 2024-02-28T16:26:56.477 INFO:tasks.workunit.client.1.smithi157.stdout:5/135: fsync d0/d8/f26 0 2024-02-28T16:26:56.481 INFO:tasks.workunit.client.1.smithi157.stdout:8/63: mknod d1/cd 0 2024-02-28T16:26:56.483 INFO:tasks.workunit.client.1.smithi157.stdout:9/80: dwrite d0/f4 [0,4194304] 0 2024-02-28T16:26:56.483 INFO:tasks.workunit.client.0.smithi148.stdout:6/926: creat d0/d4/dba/f129 x:0 0 0 2024-02-28T16:26:56.485 INFO:tasks.workunit.client.0.smithi148.stdout:5/900: readlink d1/db/d60/d7a/db2/d111/l101 0 2024-02-28T16:26:56.486 INFO:tasks.workunit.client.1.smithi157.stdout:4/68: mknod d3/c1a 0 2024-02-28T16:26:56.486 INFO:tasks.workunit.client.1.smithi157.stdout:7/123: mknod df/d1f/c2b 0 2024-02-28T16:26:56.488 INFO:tasks.workunit.client.0.smithi148.stdout:6/927: creat d0/d22/d27/d66/f12a x:0 0 0 2024-02-28T16:26:56.494 INFO:tasks.workunit.client.0.smithi148.stdout:5/901: symlink d1/db/d60/d7a/dbb/de7/l115 0 2024-02-28T16:26:56.494 INFO:tasks.workunit.client.1.smithi157.stdout:6/87: dread d2/f3 [0,4194304] 0 2024-02-28T16:26:56.494 INFO:tasks.workunit.client.1.smithi157.stdout:1/145: rmdir d10/d11/d18/d2b 0 2024-02-28T16:26:56.494 INFO:tasks.workunit.client.1.smithi157.stdout:1/146: chown fa 402 1 2024-02-28T16:26:56.495 INFO:tasks.workunit.client.1.smithi157.stdout:1/147: fsync d10/d11/f14 0 2024-02-28T16:26:56.499 INFO:tasks.workunit.client.0.smithi148.stdout:3/998: sync 2024-02-28T16:26:56.499 INFO:tasks.workunit.client.0.smithi148.stdout:2/981: sync 2024-02-28T16:26:56.500 INFO:tasks.workunit.client.1.smithi157.stdout:2/136: mknod da/d2b/c2d 0 2024-02-28T16:26:56.502 INFO:tasks.workunit.client.0.smithi148.stdout:5/902: rmdir d1/db/d60/d7a/d8b 39 2024-02-28T16:26:56.502 INFO:tasks.workunit.client.1.smithi157.stdout:2/137: write da/f1e [74726,36700] 0 2024-02-28T16:26:56.503 INFO:tasks.workunit.client.1.smithi157.stdout:5/136: rmdir d0/d8 39 2024-02-28T16:26:56.505 INFO:tasks.workunit.client.1.smithi157.stdout:0/161: mknod d1/d8/c3b 0 2024-02-28T16:26:56.506 INFO:tasks.workunit.client.0.smithi148.stdout:7/885: write d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/d97/fdb [195584,128780] 0 2024-02-28T16:26:56.506 INFO:tasks.workunit.client.0.smithi148.stdout:3/999: dread - d1/db5/fde zero size 2024-02-28T16:26:56.506 INFO:tasks.workunit.client.1.smithi157.stdout:3/89: sync 2024-02-28T16:26:56.507 INFO:tasks.workunit.client.1.smithi157.stdout:0/162: chown d1/d8/d27/c37 12761 1 2024-02-28T16:26:56.509 INFO:tasks.workunit.client.0.smithi148.stdout:2/982: rename d0/d18/f28 to d0/d1d/d52/d125/f137 0 2024-02-28T16:26:56.511 INFO:tasks.workunit.client.1.smithi157.stdout:8/64: creat d1/d5/fe x:0 0 0 2024-02-28T16:26:56.512 INFO:tasks.workunit.client.1.smithi157.stdout:7/124: rmdir df/d1f 39 2024-02-28T16:26:56.513 INFO:tasks.workunit.client.0.smithi148.stdout:2/983: read d0/d1c/d85/d8b/d8f/fa9 [1681748,55795] 0 2024-02-28T16:26:56.514 INFO:tasks.workunit.client.1.smithi157.stdout:2/138: dread da/f1e [0,4194304] 0 2024-02-28T16:26:56.515 INFO:tasks.workunit.client.1.smithi157.stdout:7/125: write df/d25/f2a [326681,10621] 0 2024-02-28T16:26:56.515 INFO:tasks.workunit.client.1.smithi157.stdout:4/69: mknod d3/da/c1b 0 2024-02-28T16:26:56.515 INFO:tasks.workunit.client.1.smithi157.stdout:6/88: dread d2/f6 [0,4194304] 0 2024-02-28T16:26:56.520 INFO:tasks.workunit.client.0.smithi148.stdout:5/903: getdents d1/db/d60/d7a/d87/de0/dee 0 2024-02-28T16:26:56.520 INFO:tasks.workunit.client.0.smithi148.stdout:6/928: write d0/d22/d25/d76/f85 [1717357,60238] 0 2024-02-28T16:26:56.526 INFO:tasks.workunit.client.0.smithi148.stdout:7/886: write d0/d9/d25/d96/ddf/fd8 [45405,36780] 0 2024-02-28T16:26:56.527 INFO:tasks.workunit.client.1.smithi157.stdout:3/90: mkdir d0/d6/d1e 0 2024-02-28T16:26:56.533 INFO:tasks.workunit.client.1.smithi157.stdout:2/139: dwrite da/f1a [0,4194304] 0 2024-02-28T16:26:56.534 INFO:tasks.workunit.client.1.smithi157.stdout:2/140: rename da/d2b to da/d2b/d2e 22 2024-02-28T16:26:56.541 INFO:tasks.workunit.client.1.smithi157.stdout:7/126: dread f3 [0,4194304] 0 2024-02-28T16:26:56.660 INFO:tasks.workunit.client.0.smithi148.stdout:7/887: creat d0/dc8/f114 x:0 0 0 2024-02-28T16:26:56.663 INFO:tasks.workunit.client.1.smithi157.stdout:4/70: creat d3/f1c x:0 0 0 2024-02-28T16:26:56.664 INFO:tasks.workunit.client.1.smithi157.stdout:9/81: truncate d0/f12 4301112 0 2024-02-28T16:26:56.666 INFO:tasks.workunit.client.1.smithi157.stdout:8/65: write d1/f4 [7981192,114931] 0 2024-02-28T16:26:56.667 INFO:tasks.workunit.client.0.smithi148.stdout:7/888: fsync d0/d9/d25/d96/ddf/f58 0 2024-02-28T16:26:56.668 INFO:tasks.workunit.client.0.smithi148.stdout:7/889: chown d0/dc8 15 1 2024-02-28T16:26:56.671 INFO:tasks.workunit.client.0.smithi148.stdout:6/929: dwrite d0/d22/d25/d76/d7f/f70 [0,4194304] 0 2024-02-28T16:26:56.671 INFO:tasks.workunit.client.1.smithi157.stdout:4/71: write d3/f1c [30297,50345] 0 2024-02-28T16:26:56.675 INFO:tasks.workunit.client.1.smithi157.stdout:8/66: read d1/f4 [1187758,72380] 0 2024-02-28T16:26:56.679 INFO:tasks.workunit.client.0.smithi148.stdout:7/890: rmdir d0/d9/d25/d96/ddf/d28/d2b/d5c 39 2024-02-28T16:26:56.680 INFO:tasks.workunit.client.0.smithi148.stdout:6/930: creat d0/d22/d27/d66/d87/f12b x:0 0 0 2024-02-28T16:26:56.681 INFO:tasks.workunit.client.0.smithi148.stdout:7/891: dread - d0/dd5/de2/dec/ff3 zero size 2024-02-28T16:26:56.684 INFO:tasks.workunit.client.0.smithi148.stdout:7/892: readlink d0/d9/d25/d39/lfa 0 2024-02-28T16:26:56.684 INFO:tasks.workunit.client.1.smithi157.stdout:4/72: chown d3/da/c10 12665076 1 2024-02-28T16:26:56.684 INFO:tasks.workunit.client.1.smithi157.stdout:7/127: chown l2 50721309 1 2024-02-28T16:26:56.691 INFO:tasks.workunit.client.1.smithi157.stdout:7/128: fsync df/f17 0 2024-02-28T16:26:56.691 INFO:tasks.workunit.client.1.smithi157.stdout:5/137: rename d0/f27 to d0/f2e 0 2024-02-28T16:26:56.691 INFO:tasks.workunit.client.1.smithi157.stdout:8/67: unlink d1/cd 0 2024-02-28T16:26:56.692 INFO:tasks.workunit.client.1.smithi157.stdout:4/73: write d3/f1c [862110,61042] 0 2024-02-28T16:26:56.694 INFO:tasks.workunit.client.1.smithi157.stdout:9/82: creat d0/d19/f1b x:0 0 0 2024-02-28T16:26:56.694 INFO:tasks.workunit.client.1.smithi157.stdout:6/89: link l1 d2/d7/de/l13 0 2024-02-28T16:26:56.699 INFO:tasks.workunit.client.1.smithi157.stdout:8/68: chown d1/d5/l8 466868 1 2024-02-28T16:26:56.700 INFO:tasks.workunit.client.1.smithi157.stdout:4/74: rename d3/cc to d3/da/c1d 0 2024-02-28T16:26:56.701 INFO:tasks.workunit.client.1.smithi157.stdout:1/148: truncate d10/f1b 333682 0 2024-02-28T16:26:56.702 INFO:tasks.workunit.client.1.smithi157.stdout:4/75: fsync d3/da/f12 0 2024-02-28T16:26:56.705 INFO:tasks.workunit.client.1.smithi157.stdout:9/83: rename d0/f4 to d0/d19/f1c 0 2024-02-28T16:26:56.705 INFO:tasks.workunit.client.1.smithi157.stdout:1/149: truncate d10/f16 1588032 0 2024-02-28T16:26:56.706 INFO:tasks.workunit.client.1.smithi157.stdout:4/76: write d3/f8 [781250,90331] 0 2024-02-28T16:26:56.706 INFO:tasks.workunit.client.1.smithi157.stdout:5/138: dread d0/d9/f1f [0,4194304] 0 2024-02-28T16:26:56.707 INFO:tasks.workunit.client.1.smithi157.stdout:8/69: mknod d1/cf 0 2024-02-28T16:26:56.709 INFO:tasks.workunit.client.1.smithi157.stdout:0/163: truncate d1/d13/fe 3291817 0 2024-02-28T16:26:56.710 INFO:tasks.workunit.client.1.smithi157.stdout:4/77: fdatasync d3/da/f12 0 2024-02-28T16:26:56.711 INFO:tasks.workunit.client.1.smithi157.stdout:2/141: write da/f12 [8171513,61120] 0 2024-02-28T16:26:56.712 INFO:tasks.workunit.client.1.smithi157.stdout:1/150: dread - d10/d11/f14 zero size 2024-02-28T16:26:56.712 INFO:tasks.workunit.client.1.smithi157.stdout:8/70: mkdir d1/d5/d10 0 2024-02-28T16:26:56.717 INFO:tasks.workunit.client.1.smithi157.stdout:2/142: read da/f23 [741948,68366] 0 2024-02-28T16:26:56.717 INFO:tasks.workunit.client.1.smithi157.stdout:5/139: creat d0/f2f x:0 0 0 2024-02-28T16:26:56.718 INFO:tasks.workunit.client.0.smithi148.stdout:4/763: sync 2024-02-28T16:26:56.719 INFO:tasks.workunit.client.1.smithi157.stdout:0/164: mknod d1/d8/d27/c3c 0 2024-02-28T16:26:56.719 INFO:tasks.workunit.client.1.smithi157.stdout:7/129: dwrite df/f10 [0,4194304] 0 2024-02-28T16:26:56.720 INFO:tasks.workunit.client.1.smithi157.stdout:8/71: chown d1/l3 1608772 1 2024-02-28T16:26:56.721 INFO:tasks.workunit.client.1.smithi157.stdout:4/78: truncate d3/f5 1434587 0 2024-02-28T16:26:56.723 INFO:tasks.workunit.client.0.smithi148.stdout:7/893: dwrite d0/f1d [0,4194304] 0 2024-02-28T16:26:56.724 INFO:tasks.workunit.client.1.smithi157.stdout:4/79: chown d3/f8 75945 1 2024-02-28T16:26:56.732 INFO:tasks.workunit.client.0.smithi148.stdout:4/764: dread d8/d21/fbc [0,4194304] 0 2024-02-28T16:26:56.732 INFO:tasks.workunit.client.1.smithi157.stdout:3/91: dwrite d0/d6/f13 [0,4194304] 0 2024-02-28T16:26:56.732 INFO:tasks.workunit.client.1.smithi157.stdout:4/80: write d3/da/f12 [156578,77382] 0 2024-02-28T16:26:56.732 INFO:tasks.workunit.client.1.smithi157.stdout:9/84: dread d0/f5 [0,4194304] 0 2024-02-28T16:26:56.733 INFO:tasks.workunit.client.0.smithi148.stdout:7/894: mknod d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/df0/c115 0 2024-02-28T16:26:56.734 INFO:tasks.workunit.client.1.smithi157.stdout:0/165: symlink d1/d8/d27/d2d/l3d 0 2024-02-28T16:26:56.734 INFO:tasks.workunit.client.1.smithi157.stdout:4/81: readlink d3/da/l19 0 2024-02-28T16:26:56.736 INFO:tasks.workunit.client.1.smithi157.stdout:5/140: mkdir d0/d30 0 2024-02-28T16:26:56.739 INFO:tasks.workunit.client.1.smithi157.stdout:8/72: mknod d1/d5/d10/c11 0 2024-02-28T16:26:56.740 INFO:tasks.workunit.client.1.smithi157.stdout:0/166: chown d1/d8/f25 8055542 1 2024-02-28T16:26:56.740 INFO:tasks.workunit.client.0.smithi148.stdout:4/765: symlink d8/d40/dc3/dd3/d17/dd9/l102 0 2024-02-28T16:26:56.744 INFO:tasks.workunit.client.1.smithi157.stdout:6/90: dwrite d2/f6 [0,4194304] 0 2024-02-28T16:26:56.746 INFO:tasks.workunit.client.1.smithi157.stdout:6/91: write d2/d7/fc [784086,63747] 0 2024-02-28T16:26:56.748 INFO:tasks.workunit.client.1.smithi157.stdout:4/82: unlink d3/f7 0 2024-02-28T16:26:56.753 INFO:tasks.workunit.client.0.smithi148.stdout:4/766: symlink d8/de4/l103 0 2024-02-28T16:26:56.755 INFO:tasks.workunit.client.0.smithi148.stdout:7/895: rename d0/d9/d25/f7c to d0/d9/d25/d96/db7/f116 0 2024-02-28T16:26:56.757 INFO:tasks.workunit.client.0.smithi148.stdout:7/896: stat d0/d9/fc 0 2024-02-28T16:26:56.759 INFO:tasks.workunit.client.1.smithi157.stdout:8/73: fsync d1/f4 0 2024-02-28T16:26:56.759 INFO:tasks.workunit.client.1.smithi157.stdout:0/167: creat d1/d13/f3e x:0 0 0 2024-02-28T16:26:56.764 INFO:tasks.workunit.client.1.smithi157.stdout:0/168: chown d1/f15 2411 1 2024-02-28T16:26:56.769 INFO:tasks.workunit.client.1.smithi157.stdout:0/169: readlink d1/l23 0 2024-02-28T16:26:56.770 INFO:tasks.workunit.client.1.smithi157.stdout:8/74: creat d1/d5/f12 x:0 0 0 2024-02-28T16:26:56.775 INFO:tasks.workunit.client.1.smithi157.stdout:3/92: write d0/f8 [4153025,58072] 0 2024-02-28T16:26:56.775 INFO:tasks.workunit.client.1.smithi157.stdout:1/151: dwrite d10/d11/d2c/f26 [0,4194304] 0 2024-02-28T16:26:56.777 INFO:tasks.workunit.client.1.smithi157.stdout:4/83: rename c0 to d3/da/c1e 0 2024-02-28T16:26:56.779 INFO:tasks.workunit.client.1.smithi157.stdout:7/130: dwrite f0 [0,4194304] 0 2024-02-28T16:26:56.779 INFO:tasks.workunit.client.1.smithi157.stdout:2/143: dwrite da/f2a [0,4194304] 0 2024-02-28T16:26:56.780 INFO:tasks.workunit.client.0.smithi148.stdout:4/767: write d8/d21/d3d/d4d/d66/dad/ff7 [1342605,31618] 0 2024-02-28T16:26:56.781 INFO:tasks.workunit.client.1.smithi157.stdout:1/152: write fa [6222582,7842] 0 2024-02-28T16:26:56.782 INFO:tasks.workunit.client.1.smithi157.stdout:2/144: readlink da/l22 0 2024-02-28T16:26:56.785 INFO:tasks.workunit.client.0.smithi148.stdout:4/768: write d8/d37/ff5 [46458,55674] 0 2024-02-28T16:26:56.786 INFO:tasks.workunit.client.1.smithi157.stdout:5/141: getdents d0/d8 0 2024-02-28T16:26:56.788 INFO:tasks.workunit.client.1.smithi157.stdout:4/84: mkdir d3/da/d1f 0 2024-02-28T16:26:56.789 INFO:tasks.workunit.client.1.smithi157.stdout:8/75: fsync d1/d5/f12 0 2024-02-28T16:26:56.789 INFO:tasks.workunit.client.1.smithi157.stdout:4/85: chown d3/da 30 1 2024-02-28T16:26:56.792 INFO:tasks.workunit.client.1.smithi157.stdout:4/86: chown d3/da/ff 83970 1 2024-02-28T16:26:56.793 INFO:tasks.workunit.client.1.smithi157.stdout:3/93: rename d0/f4 to d0/d6/d1e/f1f 0 2024-02-28T16:26:56.794 INFO:tasks.workunit.client.1.smithi157.stdout:4/87: readlink d3/da/l19 0 2024-02-28T16:26:56.795 INFO:tasks.workunit.client.1.smithi157.stdout:6/92: truncate d2/d7/f11 733326 0 2024-02-28T16:26:56.800 INFO:tasks.workunit.client.1.smithi157.stdout:2/145: creat da/f2f x:0 0 0 2024-02-28T16:26:56.800 INFO:tasks.workunit.client.1.smithi157.stdout:7/131: mknod df/d1f/c2c 0 2024-02-28T16:26:56.800 INFO:tasks.workunit.client.0.smithi148.stdout:7/897: dwrite d0/d9/d25/d96/ddf/d1c/d32/fa0 [0,4194304] 0 2024-02-28T16:26:56.801 INFO:tasks.workunit.client.1.smithi157.stdout:2/146: read - da/f2f zero size 2024-02-28T16:26:56.801 INFO:tasks.workunit.client.1.smithi157.stdout:5/142: rename d0/l1 to d0/d9/d1b/l31 0 2024-02-28T16:26:56.803 INFO:tasks.workunit.client.0.smithi148.stdout:4/769: rmdir d8/d37/dd5 0 2024-02-28T16:26:56.809 INFO:tasks.workunit.client.1.smithi157.stdout:1/153: dread d10/d11/d2c/f1e [0,4194304] 0 2024-02-28T16:26:56.810 INFO:tasks.workunit.client.1.smithi157.stdout:4/88: creat d3/da/f20 x:0 0 0 2024-02-28T16:26:56.812 INFO:tasks.workunit.client.1.smithi157.stdout:8/76: dread d1/f4 [4194304,4194304] 0 2024-02-28T16:26:56.813 INFO:tasks.workunit.client.0.smithi148.stdout:7/898: symlink d0/d9/d25/d96/ddf/d28/d2b/d5c/l117 0 2024-02-28T16:26:56.814 INFO:tasks.workunit.client.0.smithi148.stdout:7/899: readlink d0/d4/l5e 0 2024-02-28T16:26:56.816 INFO:tasks.workunit.client.1.smithi157.stdout:4/89: creat d3/da/f21 x:0 0 0 2024-02-28T16:26:56.816 INFO:tasks.workunit.client.0.smithi148.stdout:4/770: dread d8/d40/d73/fd1 [0,4194304] 0 2024-02-28T16:26:56.817 INFO:tasks.workunit.client.0.smithi148.stdout:7/900: chown d0/d9/d25/d96/ddf/d28/d2b/l30 32958843 1 2024-02-28T16:26:56.817 INFO:tasks.workunit.client.1.smithi157.stdout:1/154: rename f5 to d10/d11/d18/d2a/f2d 0 2024-02-28T16:26:56.827 INFO:tasks.workunit.client.1.smithi157.stdout:1/155: write fa [6767340,14062] 0 2024-02-28T16:26:56.827 INFO:tasks.workunit.client.0.smithi148.stdout:7/901: rename d0/d9/d25/f7e to d0/d9/d25/d96/ddf/d28/d2b/d6f/d82/f118 0 2024-02-28T16:26:56.830 INFO:tasks.workunit.client.0.smithi148.stdout:4/771: dread d8/d21/d3d/d4d/d66/dad/ff7 [0,4194304] 0 2024-02-28T16:26:56.830 INFO:tasks.workunit.client.0.smithi148.stdout:7/902: chown d0/d9/d25/d96/ddf/d1c/d32/faa 3 1 2024-02-28T16:26:56.831 INFO:tasks.workunit.client.1.smithi157.stdout:7/132: truncate df/f11 450456 0 2024-02-28T16:26:56.832 INFO:tasks.workunit.client.0.smithi148.stdout:7/903: fsync d0/dd5/de2/dec/ff3 0 2024-02-28T16:26:56.834 INFO:tasks.workunit.client.1.smithi157.stdout:4/90: rmdir d3 39 2024-02-28T16:26:56.835 INFO:tasks.workunit.client.1.smithi157.stdout:3/94: dwrite d0/d6/f11 [0,4194304] 0 2024-02-28T16:26:56.842 INFO:tasks.workunit.client.1.smithi157.stdout:9/85: sync 2024-02-28T16:26:56.842 INFO:tasks.workunit.client.0.smithi148.stdout:4/772: link d8/d40/d73/fd1 d8/d40/dc3/dd3/f104 0 2024-02-28T16:26:56.844 INFO:tasks.workunit.client.0.smithi148.stdout:2/984: sync 2024-02-28T16:26:56.846 INFO:tasks.workunit.client.1.smithi157.stdout:8/77: write d1/f4 [2304386,47666] 0 2024-02-28T16:26:56.850 INFO:tasks.workunit.client.1.smithi157.stdout:7/133: write df/f17 [1021166,69022] 0 2024-02-28T16:26:56.851 INFO:tasks.workunit.client.0.smithi148.stdout:2/985: unlink d0/d18/d12a/ddd/d11b/d12b/d13/lb0 0 2024-02-28T16:26:56.855 INFO:tasks.workunit.client.1.smithi157.stdout:5/143: dwrite d0/d8/f26 [0,4194304] 0 2024-02-28T16:26:56.855 INFO:tasks.workunit.client.1.smithi157.stdout:3/95: fsync d0/d6/fa 0 2024-02-28T16:26:56.858 INFO:tasks.workunit.client.1.smithi157.stdout:6/93: dwrite d2/d7/f11 [0,4194304] 0 2024-02-28T16:26:56.864 INFO:tasks.workunit.client.0.smithi148.stdout:2/986: creat d0/d1c/d85/d96/dbf/d104/f138 x:0 0 0 2024-02-28T16:26:56.865 INFO:tasks.workunit.client.0.smithi148.stdout:4/773: write d8/d40/dc3/dd3/f89 [93743,26868] 0 2024-02-28T16:26:56.868 INFO:tasks.workunit.client.1.smithi157.stdout:0/170: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:26:56.871 INFO:tasks.workunit.client.1.smithi157.stdout:2/147: dwrite da/f27 [0,4194304] 0 2024-02-28T16:26:56.871 INFO:tasks.workunit.client.0.smithi148.stdout:4/774: creat d8/f105 x:0 0 0 2024-02-28T16:26:56.873 INFO:tasks.workunit.client.0.smithi148.stdout:2/987: mkdir d0/d1c/d85/d8b/d139 0 2024-02-28T16:26:56.879 INFO:tasks.workunit.client.0.smithi148.stdout:2/988: rmdir d0/d1d/d55 39 2024-02-28T16:26:56.881 INFO:tasks.workunit.client.0.smithi148.stdout:7/904: dread d0/d9/d25/d96/ddf/d28/d2b/f69 [0,4194304] 0 2024-02-28T16:26:56.884 INFO:tasks.workunit.client.1.smithi157.stdout:4/91: mkdir d3/da/d1f/d22 0 2024-02-28T16:26:56.884 INFO:tasks.workunit.client.0.smithi148.stdout:4/775: creat d8/d21/d3d/d4d/d66/dad/dfe/f106 x:0 0 0 2024-02-28T16:26:56.885 INFO:tasks.workunit.client.0.smithi148.stdout:2/989: rmdir d0/dd 39 2024-02-28T16:26:56.887 INFO:tasks.workunit.client.1.smithi157.stdout:4/92: write d3/f1c [45528,43783] 0 2024-02-28T16:26:56.888 INFO:tasks.workunit.client.1.smithi157.stdout:4/93: chown d3/da 16289 1 2024-02-28T16:26:56.892 INFO:tasks.workunit.client.0.smithi148.stdout:7/905: mknod d0/d9/d25/c119 0 2024-02-28T16:26:56.893 INFO:tasks.workunit.client.1.smithi157.stdout:1/156: dread d10/d11/d2c/f1a [0,4194304] 0 2024-02-28T16:26:56.894 INFO:tasks.workunit.client.1.smithi157.stdout:9/86: dread d0/f10 [0,4194304] 0 2024-02-28T16:26:56.895 INFO:tasks.workunit.client.0.smithi148.stdout:2/990: rename d0/d18/d12a/d73/ca7 to d0/d59/c13a 0 2024-02-28T16:26:56.899 INFO:tasks.workunit.client.0.smithi148.stdout:7/906: write d0/d9/d25/d96/ddf/d28/d2b/d6f/dd3/fd9 [4618566,3102] 0 2024-02-28T16:26:56.900 INFO:tasks.workunit.client.0.smithi148.stdout:6/931: sync 2024-02-28T16:26:56.900 INFO:tasks.workunit.client.0.smithi148.stdout:5/904: sync 2024-02-28T16:26:56.902 INFO:tasks.workunit.client.0.smithi148.stdout:2/991: mkdir d0/d18/d12a/d73/d13b 0 2024-02-28T16:26:56.904 INFO:tasks.workunit.client.0.smithi148.stdout:6/932: read - d0/d4/d14/f100 zero size 2024-02-28T16:26:56.910 INFO:tasks.workunit.client.0.smithi148.stdout:2/992: creat d0/d18/d12a/ddd/f13c x:0 0 0 2024-02-28T16:26:56.914 INFO:tasks.workunit.client.0.smithi148.stdout:4/776: dwrite d8/d40/dc3/dd3/d5f/fcc [0,4194304] 0 2024-02-28T16:26:56.921 INFO:tasks.workunit.client.0.smithi148.stdout:4/777: chown d8/d21/d3d/d4d/d72/fa1 1367 1 2024-02-28T16:26:56.926 INFO:tasks.workunit.client.0.smithi148.stdout:7/907: dwrite d0/d9/d25/d96/ddf/d1c/d32/f3b [0,4194304] 0 2024-02-28T16:26:56.927 INFO:tasks.workunit.client.0.smithi148.stdout:6/933: dread d0/d4/dba/fa0 [0,4194304] 0 2024-02-28T16:26:56.933 INFO:tasks.workunit.client.0.smithi148.stdout:4/778: mkdir d8/d21/d3d/d4d/d95/d107 0 2024-02-28T16:26:56.935 INFO:tasks.workunit.client.0.smithi148.stdout:2/993: getdents d0/d18/d12a/ddd/d11b/d12b 0 2024-02-28T16:26:56.937 INFO:tasks.workunit.client.0.smithi148.stdout:7/908: rename d0/d9/d25/d96/ddf/d1c/dbf/cd2 to d0/dd5/de2/c11a 0 2024-02-28T16:26:56.940 INFO:tasks.workunit.client.0.smithi148.stdout:5/905: dread d1/db/d60/d7a/fc1 [0,4194304] 0 2024-02-28T16:26:56.941 INFO:tasks.workunit.client.0.smithi148.stdout:7/909: chown d0/d9/d25/d96/ddf/d28/cb5 103332988 1 2024-02-28T16:26:56.942 INFO:tasks.workunit.client.0.smithi148.stdout:5/906: write d1/d8/d20/fc3 [35675,50662] 0 2024-02-28T16:26:56.942 INFO:tasks.workunit.client.0.smithi148.stdout:6/934: rename d0/d22/d25/c4d to d0/d22/d25/d76/d7f/c12c 0 2024-02-28T16:26:56.942 INFO:tasks.workunit.client.0.smithi148.stdout:4/779: write d8/d21/d3d/d4d/d66/dad/ff7 [1351888,46048] 0 2024-02-28T16:26:56.943 INFO:tasks.workunit.client.0.smithi148.stdout:7/910: readlink d0/d9/le5 0 2024-02-28T16:26:56.944 INFO:tasks.workunit.client.0.smithi148.stdout:2/994: symlink d0/d18/d12a/ddd/d11b/d12b/d13/d38/d3a/db3/l13d 0 2024-02-28T16:26:56.947 INFO:tasks.workunit.client.0.smithi148.stdout:7/911: chown d0/dd5/cf9 104124 1 2024-02-28T16:26:56.950 INFO:tasks.workunit.client.0.smithi148.stdout:6/935: mknod d0/d22/d27/c12d 0 2024-02-28T16:26:56.953 INFO:tasks.workunit.client.0.smithi148.stdout:6/936: stat d0/d22/d49/dae/d10f/l11b 0 2024-02-28T16:26:56.958 INFO:tasks.workunit.client.0.smithi148.stdout:4/780: rename d8/d40/d73/f96 to d8/d40/dc3/dbd/de3/f108 0 2024-02-28T16:26:56.965 INFO:tasks.workunit.client.0.smithi148.stdout:4/781: truncate d8/d71/ff4 995813 0 2024-02-28T16:26:56.973 INFO:tasks.workunit.client.0.smithi148.stdout:5/907: rename d1/db/d60/d7a/d8b/l34 to d1/l116 0 2024-02-28T16:26:56.974 INFO:tasks.workunit.client.1.smithi157.stdout:7/134: creat df/d1f/d24/f2d x:0 0 0 2024-02-28T16:26:56.976 INFO:tasks.workunit.client.1.smithi157.stdout:7/135: chown df/d1f/d24 118 1 2024-02-28T16:26:56.976 INFO:tasks.workunit.client.0.smithi148.stdout:7/912: dwrite d0/d9/d25/d96/ddf/f27 [0,4194304] 0 2024-02-28T16:26:56.978 INFO:tasks.workunit.client.1.smithi157.stdout:8/78: rename d1/d5/f12 to d1/d5/d10/f13 0 2024-02-28T16:26:56.984 INFO:tasks.workunit.client.0.smithi148.stdout:5/908: mkdir d1/db/d60/df0/d63/d117 0 2024-02-28T16:26:56.986 INFO:tasks.workunit.client.1.smithi157.stdout:2/148: mkdir da/d2b/d30 0 2024-02-28T16:26:56.988 INFO:tasks.workunit.client.1.smithi157.stdout:4/94: mknod d3/da/d1f/c23 0 2024-02-28T16:26:56.990 INFO:tasks.workunit.client.1.smithi157.stdout:1/157: fsync f4 0 2024-02-28T16:26:56.992 INFO:tasks.workunit.client.0.smithi148.stdout:7/913: read d0/d9/d25/d96/ddf/d1c/d32/f3d [173953,55339] 0 2024-02-28T16:26:56.993 INFO:tasks.workunit.client.1.smithi157.stdout:4/95: write d3/da/f20 [861991,13266] 0 2024-02-28T16:26:56.994 INFO:tasks.workunit.client.1.smithi157.stdout:7/136: symlink df/d1f/l2e 0 2024-02-28T16:26:56.995 INFO:tasks.workunit.client.0.smithi148.stdout:4/782: creat d8/d21/f109 x:0 0 0 2024-02-28T16:26:57.006 INFO:tasks.workunit.client.1.smithi157.stdout:6/94: dwrite d2/f3 [0,4194304] 0 2024-02-28T16:26:57.009 INFO:tasks.workunit.client.1.smithi157.stdout:7/137: dread f0 [4194304,4194304] 0 2024-02-28T16:26:57.009 INFO:tasks.workunit.client.0.smithi148.stdout:4/783: dwrite d8/d40/d73/f7a [4194304,4194304] 0 2024-02-28T16:26:57.011 INFO:tasks.workunit.client.0.smithi148.stdout:4/784: chown d8/d21 47892 1 2024-02-28T16:26:57.022 INFO:tasks.workunit.client.1.smithi157.stdout:5/144: sync 2024-02-28T16:26:57.027 INFO:tasks.workunit.client.1.smithi157.stdout:7/138: dwrite df/d1f/d24/f2d [0,4194304] 0 2024-02-28T16:26:57.057 INFO:tasks.workunit.client.0.smithi148.stdout:4/785: getdents d8/d21/d3d/d4d/d66/dad/dfe 0 2024-02-28T16:26:57.058 INFO:tasks.workunit.client.1.smithi157.stdout:7/139: symlink df/d25/l2f 0 2024-02-28T16:26:57.059 INFO:tasks.workunit.client.1.smithi157.stdout:7/140: readlink df/l14 0 2024-02-28T16:26:57.061 INFO:tasks.workunit.client.1.smithi157.stdout:2/149: rmdir da/d2b/d30 0 2024-02-28T16:26:57.061 INFO:tasks.workunit.client.1.smithi157.stdout:2/150: stat da/f2c 0 2024-02-28T16:26:57.062 INFO:tasks.workunit.client.0.smithi148.stdout:4/786: mknod d8/d21/d3d/d4d/d72/c10a 0 2024-02-28T16:26:57.064 INFO:tasks.workunit.client.1.smithi157.stdout:5/145: symlink d0/l32 0 2024-02-28T16:26:57.064 INFO:tasks.workunit.client.1.smithi157.stdout:2/151: read - da/f2f zero size 2024-02-28T16:26:57.066 INFO:tasks.workunit.client.1.smithi157.stdout:4/96: link d3/da/l19 d3/da/l24 0 2024-02-28T16:26:57.067 INFO:tasks.workunit.client.1.smithi157.stdout:4/97: fdatasync d3/f1c 0 2024-02-28T16:26:57.069 INFO:tasks.workunit.client.1.smithi157.stdout:7/141: dread fb [0,4194304] 0 2024-02-28T16:26:57.069 INFO:tasks.workunit.client.1.smithi157.stdout:6/95: getdents d2/d7 0 2024-02-28T16:26:57.070 INFO:tasks.workunit.client.1.smithi157.stdout:5/146: write d0/d8/fb [3471804,76991] 0 2024-02-28T16:26:57.072 INFO:tasks.workunit.client.1.smithi157.stdout:5/147: fsync d0/d8/f2d 0 2024-02-28T16:26:57.073 INFO:tasks.workunit.client.0.smithi148.stdout:4/787: link d8/d37/c65 d8/d21/d3d/d4d/c10b 0 2024-02-28T16:26:57.074 INFO:tasks.workunit.client.1.smithi157.stdout:5/148: write d0/d9/d11/f2a [857406,33022] 0 2024-02-28T16:26:57.075 INFO:tasks.workunit.client.0.smithi148.stdout:2/995: dwrite d0/d18/d12a/ddd/d11b/d12b/d13/d38/d3a/fb1 [0,4194304] 0 2024-02-28T16:26:57.075 INFO:tasks.workunit.client.1.smithi157.stdout:5/149: fdatasync d0/d8/fb 0 2024-02-28T16:26:57.079 INFO:tasks.workunit.client.0.smithi148.stdout:4/788: fdatasync d8/d21/f54 0 2024-02-28T16:26:57.079 INFO:tasks.workunit.client.1.smithi157.stdout:6/96: unlink d2/f3 0 2024-02-28T16:26:57.081 INFO:tasks.workunit.client.1.smithi157.stdout:7/142: fsync fd 0 2024-02-28T16:26:57.083 INFO:tasks.workunit.client.1.smithi157.stdout:6/97: write d2/d7/f11 [3964181,14367] 0 2024-02-28T16:26:57.083 INFO:tasks.workunit.client.1.smithi157.stdout:4/98: mkdir d3/da/d1f/d22/d25 0 2024-02-28T16:26:57.085 INFO:tasks.workunit.client.0.smithi148.stdout:6/937: dwrite d0/d22/d49/d88/d107/fc9 [0,4194304] 0 2024-02-28T16:26:57.088 INFO:tasks.workunit.client.0.smithi148.stdout:4/789: symlink d8/d40/d73/l10c 0 2024-02-28T16:26:57.091 INFO:tasks.workunit.client.0.smithi148.stdout:2/996: rename d0/d18/d12a/d73/fb7 to d0/d18/d12a/ddd/d11b/f13e 0 2024-02-28T16:26:57.092 INFO:tasks.workunit.client.0.smithi148.stdout:2/997: chown d0/d59/f7f 126855388 1 2024-02-28T16:26:57.093 INFO:tasks.workunit.client.0.smithi148.stdout:6/938: write d0/d22/d27/d66/d87/f91 [2980403,27335] 0 2024-02-28T16:26:57.098 INFO:tasks.workunit.client.1.smithi157.stdout:4/99: creat d3/da/d1f/f26 x:0 0 0 2024-02-28T16:26:57.099 INFO:tasks.workunit.client.1.smithi157.stdout:3/96: sync 2024-02-28T16:26:57.101 INFO:tasks.workunit.client.1.smithi157.stdout:3/97: write d0/d6/f17 [4288855,88880] 0 2024-02-28T16:26:57.101 INFO:tasks.workunit.client.1.smithi157.stdout:7/143: symlink df/d1f/d24/l30 0 2024-02-28T16:26:57.102 INFO:tasks.workunit.client.0.smithi148.stdout:4/790: link d8/d37/d91/db2/ffb d8/d37/f10d 0 2024-02-28T16:26:57.103 INFO:tasks.workunit.client.1.smithi157.stdout:7/144: truncate df/f1a 180600 0 2024-02-28T16:26:57.105 INFO:tasks.workunit.client.1.smithi157.stdout:7/145: write df/f1a [682237,8264] 0 2024-02-28T16:26:57.109 INFO:tasks.workunit.client.1.smithi157.stdout:3/98: mkdir d0/d20 0 2024-02-28T16:26:57.110 INFO:tasks.workunit.client.1.smithi157.stdout:9/87: write d0/f12 [4828752,35140] 0 2024-02-28T16:26:57.112 INFO:tasks.workunit.client.1.smithi157.stdout:5/150: rename d0/ld to d0/l33 0 2024-02-28T16:26:57.112 INFO:tasks.workunit.client.1.smithi157.stdout:3/99: chown d0/f8 7 1 2024-02-28T16:26:57.114 INFO:tasks.workunit.client.1.smithi157.stdout:6/98: getdents d2/d7/d8/da 0 2024-02-28T16:26:57.115 INFO:tasks.workunit.client.1.smithi157.stdout:8/79: dwrite d1/f2 [4194304,4194304] 0 2024-02-28T16:26:57.115 INFO:tasks.workunit.client.0.smithi148.stdout:6/939: dread d0/d22/d27/d3e/f45 [0,4194304] 0 2024-02-28T16:26:57.116 INFO:tasks.workunit.client.0.smithi148.stdout:2/998: dread d0/f10 [0,4194304] 0 2024-02-28T16:26:57.117 INFO:tasks.workunit.client.0.smithi148.stdout:6/940: write d0/f6e [1333803,17729] 0 2024-02-28T16:26:57.118 INFO:tasks.workunit.client.1.smithi157.stdout:2/152: rmdir da 39 2024-02-28T16:26:57.118 INFO:tasks.workunit.client.0.smithi148.stdout:7/914: dwrite d0/d9/d25/f2f [4194304,4194304] 0 2024-02-28T16:26:57.121 INFO:tasks.workunit.client.0.smithi148.stdout:4/791: creat d8/d21/d3d/d4d/d95/d107/f10e x:0 0 0 2024-02-28T16:26:57.124 INFO:tasks.workunit.client.1.smithi157.stdout:9/88: mknod d0/c1d 0 2024-02-28T16:26:57.125 INFO:tasks.workunit.client.0.smithi148.stdout:6/941: chown d0/d22/d27/d3e 37245 1 2024-02-28T16:26:57.125 INFO:tasks.workunit.client.0.smithi148.stdout:2/999: dread - d0/d1c/d85/d8b/d8f/dc9/f121 zero size 2024-02-28T16:26:57.127 INFO:tasks.workunit.client.1.smithi157.stdout:3/100: unlink d0/c5 0 2024-02-28T16:26:57.128 INFO:tasks.workunit.client.1.smithi157.stdout:6/99: readlink l1 0 2024-02-28T16:26:57.132 INFO:tasks.workunit.client.1.smithi157.stdout:8/80: mkdir d1/d5/d14 0 2024-02-28T16:26:57.136 INFO:tasks.workunit.client.1.smithi157.stdout:4/100: rmdir d3/da/d1f/d22/d25 0 2024-02-28T16:26:57.138 INFO:tasks.workunit.client.0.smithi148.stdout:4/792: rename d8/d40/dc3/dd3/d17/fe0 to d8/d21/d3d/d4d/d95/d107/f10f 0 2024-02-28T16:26:57.141 INFO:tasks.workunit.client.0.smithi148.stdout:7/915: creat d0/d9/d25/d96/ddf/d28/d2b/f11b x:0 0 0 2024-02-28T16:26:57.142 INFO:tasks.workunit.client.1.smithi157.stdout:9/89: fdatasync d0/f3 0 2024-02-28T16:26:57.143 INFO:tasks.workunit.client.1.smithi157.stdout:9/90: stat d0/f12 0 2024-02-28T16:26:57.143 INFO:tasks.workunit.client.0.smithi148.stdout:7/916: chown d0/d9/d25/d39/l89 49 1 2024-02-28T16:26:57.145 INFO:tasks.workunit.client.0.smithi148.stdout:4/793: symlink d8/d40/dc3/l110 0 2024-02-28T16:26:57.147 INFO:tasks.workunit.client.1.smithi157.stdout:3/101: chown d0/c19 213 1 2024-02-28T16:26:57.148 INFO:tasks.workunit.client.0.smithi148.stdout:7/917: mknod d0/d9/d25/d96/db7/c11c 0 2024-02-28T16:26:57.148 INFO:tasks.workunit.client.1.smithi157.stdout:3/102: chown d0/d6/l12 12 1 2024-02-28T16:26:57.149 INFO:tasks.workunit.client.1.smithi157.stdout:1/158: sync 2024-02-28T16:26:57.149 INFO:tasks.workunit.client.1.smithi157.stdout:0/171: sync 2024-02-28T16:26:57.149 INFO:tasks.workunit.client.1.smithi157.stdout:6/100: symlink d2/d7/l14 0 2024-02-28T16:26:57.150 INFO:tasks.workunit.client.1.smithi157.stdout:3/103: write d0/d6/f1d [657759,21683] 0 2024-02-28T16:26:57.151 INFO:tasks.workunit.client.1.smithi157.stdout:8/81: rename d1/l3 to d1/d5/d10/l15 0 2024-02-28T16:26:57.151 INFO:tasks.workunit.client.1.smithi157.stdout:0/172: write d1/da/f2f [972492,74910] 0 2024-02-28T16:26:57.153 INFO:tasks.workunit.client.1.smithi157.stdout:2/153: mknod da/d2b/c31 0 2024-02-28T16:26:57.154 INFO:tasks.workunit.client.1.smithi157.stdout:3/104: write d0/d6/f1d [1352723,15507] 0 2024-02-28T16:26:57.155 INFO:tasks.workunit.client.1.smithi157.stdout:4/101: creat d3/da/d1f/f27 x:0 0 0 2024-02-28T16:26:57.159 INFO:tasks.workunit.client.0.smithi148.stdout:4/794: link d8/d37/d91/fc5 d8/d21/d3d/d4d/d72/f111 0 2024-02-28T16:26:57.159 INFO:tasks.workunit.client.0.smithi148.stdout:6/942: write d0/d22/d49/d88/d97/fb6 [575574,97469] 0 2024-02-28T16:26:57.159 INFO:tasks.workunit.client.1.smithi157.stdout:9/91: dread d0/d19/f1c [0,4194304] 0 2024-02-28T16:26:57.159 INFO:tasks.workunit.client.1.smithi157.stdout:5/151: link d0/f2e d0/f34 0 2024-02-28T16:26:57.162 INFO:tasks.workunit.client.1.smithi157.stdout:1/159: unlink d10/d11/d18/f23 0 2024-02-28T16:26:57.163 INFO:tasks.workunit.client.1.smithi157.stdout:7/146: truncate f0 7139198 0 2024-02-28T16:26:57.164 INFO:tasks.workunit.client.1.smithi157.stdout:8/82: dread d1/f4 [4194304,4194304] 0 2024-02-28T16:26:57.164 INFO:tasks.workunit.client.1.smithi157.stdout:8/83: chown d1/d5/d14 1259321 1 2024-02-28T16:26:57.168 INFO:tasks.workunit.client.1.smithi157.stdout:0/173: rmdir d1/d8 39 2024-02-28T16:26:57.170 INFO:tasks.workunit.client.1.smithi157.stdout:2/154: rmdir da/d2b 39 2024-02-28T16:26:57.171 INFO:tasks.workunit.client.1.smithi157.stdout:4/102: mkdir d3/da/d28 0 2024-02-28T16:26:57.173 INFO:tasks.workunit.client.1.smithi157.stdout:4/103: write d3/da/d1f/f26 [30205,45028] 0 2024-02-28T16:26:57.174 INFO:tasks.workunit.client.1.smithi157.stdout:5/152: unlink d0/d9/f15 0 2024-02-28T16:26:57.175 INFO:tasks.workunit.client.0.smithi148.stdout:6/943: getdents d0/d4/dba/de9 0 2024-02-28T16:26:57.176 INFO:tasks.workunit.client.0.smithi148.stdout:6/944: stat d0/d4/d14/f81 0 2024-02-28T16:26:57.177 INFO:tasks.workunit.client.1.smithi157.stdout:1/160: creat d10/d11/f2e x:0 0 0 2024-02-28T16:26:57.179 INFO:tasks.workunit.client.1.smithi157.stdout:7/147: rmdir df/d1f/d24 39 2024-02-28T16:26:57.180 INFO:tasks.workunit.client.1.smithi157.stdout:7/148: read df/f16 [5049480,59947] 0 2024-02-28T16:26:57.182 INFO:tasks.workunit.client.0.smithi148.stdout:4/795: write d8/d21/d3d/d4d/d72/f77 [3186935,12017] 0 2024-02-28T16:26:57.183 INFO:tasks.workunit.client.1.smithi157.stdout:2/155: dread da/f1e [0,4194304] 0 2024-02-28T16:26:57.184 INFO:tasks.workunit.client.0.smithi148.stdout:4/796: write d8/d71/ff4 [1967557,4847] 0 2024-02-28T16:26:57.192 INFO:tasks.workunit.client.1.smithi157.stdout:5/153: creat d0/d9/d1b/f35 x:0 0 0 2024-02-28T16:26:57.192 INFO:tasks.workunit.client.1.smithi157.stdout:5/154: chown d0/f34 0 1 2024-02-28T16:26:57.193 INFO:tasks.workunit.client.1.smithi157.stdout:5/155: chown d0/f2f 831 1 2024-02-28T16:26:57.196 INFO:tasks.workunit.client.1.smithi157.stdout:8/84: link d1/d5/d10/f13 d1/d5/f16 0 2024-02-28T16:26:57.197 INFO:tasks.workunit.client.0.smithi148.stdout:6/945: dread d0/d4/f11 [0,4194304] 0 2024-02-28T16:26:57.197 INFO:tasks.workunit.client.1.smithi157.stdout:0/174: mknod d1/c3f 0 2024-02-28T16:26:57.198 INFO:tasks.workunit.client.0.smithi148.stdout:4/797: write d8/d40/dc3/dd3/d17/d6a/d6c/fa2 [2845346,71025] 0 2024-02-28T16:26:57.199 INFO:tasks.workunit.client.1.smithi157.stdout:4/104: getdents d3/da/d28 0 2024-02-28T16:26:57.201 INFO:tasks.workunit.client.1.smithi157.stdout:4/105: write d3/da/d1f/f26 [1116185,109199] 0 2024-02-28T16:26:57.201 INFO:tasks.workunit.client.0.smithi148.stdout:4/798: rmdir d8/d37/d91/db2 39 2024-02-28T16:26:57.205 INFO:tasks.workunit.client.1.smithi157.stdout:5/156: rename d0/d9/d11 to d0/d9/d1b/d36 0 2024-02-28T16:26:57.207 INFO:tasks.workunit.client.1.smithi157.stdout:0/175: stat d1/d8/d33 0 2024-02-28T16:26:57.208 INFO:tasks.workunit.client.1.smithi157.stdout:6/101: creat d2/d7/f15 x:0 0 0 2024-02-28T16:26:57.209 INFO:tasks.workunit.client.1.smithi157.stdout:2/156: symlink da/l32 0 2024-02-28T16:26:57.210 INFO:tasks.workunit.client.1.smithi157.stdout:7/149: creat df/f31 x:0 0 0 2024-02-28T16:26:57.211 INFO:tasks.workunit.client.0.smithi148.stdout:6/946: write d0/d22/d25/f4f [4249484,121276] 0 2024-02-28T16:26:57.213 INFO:tasks.workunit.client.1.smithi157.stdout:4/106: rename d3/f8 to d3/da/d1f/f29 0 2024-02-28T16:26:57.216 INFO:tasks.workunit.client.1.smithi157.stdout:6/102: unlink d2/f6 0 2024-02-28T16:26:57.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/947: creat d0/d22/d27/f12e x:0 0 0 2024-02-28T16:26:57.220 INFO:tasks.workunit.client.0.smithi148.stdout:6/948: readlink d0/d22/d27/l63 0 2024-02-28T16:26:57.221 INFO:tasks.workunit.client.1.smithi157.stdout:8/85: creat d1/f17 x:0 0 0 2024-02-28T16:26:57.222 INFO:tasks.workunit.client.1.smithi157.stdout:0/176: dwrite d1/f24 [0,4194304] 0 2024-02-28T16:26:57.224 INFO:tasks.workunit.client.1.smithi157.stdout:5/157: rename d0/d9/d1b/f25 to d0/d9/f37 0 2024-02-28T16:26:57.225 INFO:tasks.workunit.client.1.smithi157.stdout:5/158: readlink d0/l32 0 2024-02-28T16:26:57.226 INFO:tasks.workunit.client.1.smithi157.stdout:4/107: rmdir d3/da 39 2024-02-28T16:26:57.226 INFO:tasks.workunit.client.1.smithi157.stdout:7/150: dread df/f11 [0,4194304] 0 2024-02-28T16:26:57.227 INFO:tasks.workunit.client.0.smithi148.stdout:6/949: symlink d0/d22/d27/d3e/l12f 0 2024-02-28T16:26:57.229 INFO:tasks.workunit.client.1.smithi157.stdout:6/103: write d2/d7/fc [995629,62984] 0 2024-02-28T16:26:57.229 INFO:tasks.workunit.client.1.smithi157.stdout:0/177: mknod d1/d8/c40 0 2024-02-28T16:26:57.231 INFO:tasks.workunit.client.1.smithi157.stdout:6/104: read d2/d7/fc [1078465,116231] 0 2024-02-28T16:26:57.231 INFO:tasks.workunit.client.1.smithi157.stdout:8/86: rename d1/d5/d10/f13 to d1/d5/d10/f18 0 2024-02-28T16:26:57.233 INFO:tasks.workunit.client.0.smithi148.stdout:6/950: creat d0/d22/d49/d88/d107/f130 x:0 0 0 2024-02-28T16:26:57.234 INFO:tasks.workunit.client.1.smithi157.stdout:2/157: rename da/c11 to da/c33 0 2024-02-28T16:26:57.241 INFO:tasks.workunit.client.1.smithi157.stdout:4/108: creat d3/da/d28/f2a x:0 0 0 2024-02-28T16:26:57.243 INFO:tasks.workunit.client.0.smithi148.stdout:6/951: link d0/d8/c1c d0/d22/d27/c131 0 2024-02-28T16:26:57.245 INFO:tasks.workunit.client.1.smithi157.stdout:4/109: creat d3/da/f2b x:0 0 0 2024-02-28T16:26:57.245 INFO:tasks.workunit.client.0.smithi148.stdout:6/952: fdatasync d0/f4c 0 2024-02-28T16:26:57.249 INFO:tasks.workunit.client.0.smithi148.stdout:6/953: mknod d0/d8/dfd/c132 0 2024-02-28T16:26:57.251 INFO:tasks.workunit.client.0.smithi148.stdout:6/954: chown d0/d22/d49/d88/d107/da2 2149374 1 2024-02-28T16:26:57.253 INFO:tasks.workunit.client.1.smithi157.stdout:4/110: truncate d3/da/d28/f2a 830095 0 2024-02-28T16:26:57.253 INFO:tasks.workunit.client.0.smithi148.stdout:6/955: chown d0/d22/d49/d88/d107/da2 14822366 1 2024-02-28T16:26:57.254 INFO:tasks.workunit.client.1.smithi157.stdout:0/178: dwrite d1/d8/f1d [0,4194304] 0 2024-02-28T16:26:57.256 INFO:tasks.workunit.client.1.smithi157.stdout:8/87: dwrite d1/f17 [0,4194304] 0 2024-02-28T16:26:57.261 INFO:tasks.workunit.client.1.smithi157.stdout:4/111: truncate d3/f4 4102224 0 2024-02-28T16:26:57.264 INFO:tasks.workunit.client.1.smithi157.stdout:5/159: write d0/d8/f18 [345437,100483] 0 2024-02-28T16:26:57.264 INFO:tasks.workunit.client.1.smithi157.stdout:2/158: write da/f26 [645224,15846] 0 2024-02-28T16:26:57.264 INFO:tasks.workunit.client.0.smithi148.stdout:6/956: creat d0/f133 x:0 0 0 2024-02-28T16:26:57.269 INFO:tasks.workunit.client.1.smithi157.stdout:4/112: write d3/da/f20 [1610065,17990] 0 2024-02-28T16:26:57.269 INFO:tasks.workunit.client.1.smithi157.stdout:5/160: write d0/d9/f1d [704887,105825] 0 2024-02-28T16:26:57.274 INFO:tasks.workunit.client.1.smithi157.stdout:5/161: creat d0/d9/d1b/d36/f38 x:0 0 0 2024-02-28T16:26:57.276 INFO:tasks.workunit.client.1.smithi157.stdout:2/159: creat da/f34 x:0 0 0 2024-02-28T16:26:57.282 INFO:tasks.workunit.client.1.smithi157.stdout:4/113: fdatasync d3/da/f20 0 2024-02-28T16:26:57.285 INFO:tasks.workunit.client.1.smithi157.stdout:8/88: truncate d1/f17 395782 0 2024-02-28T16:26:57.287 INFO:tasks.workunit.client.1.smithi157.stdout:2/160: mkdir da/d35 0 2024-02-28T16:26:57.289 INFO:tasks.workunit.client.1.smithi157.stdout:4/114: symlink d3/da/d28/l2c 0 2024-02-28T16:26:57.291 INFO:tasks.workunit.client.1.smithi157.stdout:4/115: write d3/f16 [352081,112546] 0 2024-02-28T16:26:57.291 INFO:tasks.workunit.client.1.smithi157.stdout:5/162: link d0/l32 d0/d8/l39 0 2024-02-28T16:26:57.293 INFO:tasks.workunit.client.1.smithi157.stdout:2/161: creat da/d35/f36 x:0 0 0 2024-02-28T16:26:57.293 INFO:tasks.workunit.client.1.smithi157.stdout:4/116: chown d3/da/d1f/f26 208217 1 2024-02-28T16:26:57.293 INFO:tasks.workunit.client.0.smithi148.stdout:6/957: dwrite d0/d8/dfd/fd6 [0,4194304] 0 2024-02-28T16:26:57.294 INFO:tasks.workunit.client.1.smithi157.stdout:6/105: dwrite d2/d7/f11 [0,4194304] 0 2024-02-28T16:26:57.297 INFO:tasks.workunit.client.1.smithi157.stdout:4/117: write d3/da/f21 [361505,44591] 0 2024-02-28T16:26:57.299 INFO:tasks.workunit.client.1.smithi157.stdout:3/105: sync 2024-02-28T16:26:57.301 INFO:tasks.workunit.client.1.smithi157.stdout:5/163: mkdir d0/d9/d3a 0 2024-02-28T16:26:57.301 INFO:tasks.workunit.client.0.smithi148.stdout:6/958: fdatasync d0/d22/d49/d88/d97/fb5 0 2024-02-28T16:26:57.305 INFO:tasks.workunit.client.1.smithi157.stdout:4/118: creat d3/da/f2d x:0 0 0 2024-02-28T16:26:57.306 INFO:tasks.workunit.client.1.smithi157.stdout:5/164: mknod d0/d9/d1b/c3b 0 2024-02-28T16:26:57.308 INFO:tasks.workunit.client.1.smithi157.stdout:2/162: creat da/f37 x:0 0 0 2024-02-28T16:26:57.308 INFO:tasks.workunit.client.1.smithi157.stdout:5/165: read d0/f34 [3268487,23085] 0 2024-02-28T16:26:57.308 INFO:tasks.workunit.client.1.smithi157.stdout:3/106: mknod d0/d20/c21 0 2024-02-28T16:26:57.308 INFO:tasks.workunit.client.1.smithi157.stdout:6/106: mkdir d2/d7/d16 0 2024-02-28T16:26:57.309 INFO:tasks.workunit.client.0.smithi148.stdout:6/959: creat d0/d22/d27/f134 x:0 0 0 2024-02-28T16:26:57.310 INFO:tasks.workunit.client.1.smithi157.stdout:5/166: chown d0/d8/f2d 3 1 2024-02-28T16:26:57.310 INFO:tasks.workunit.client.0.smithi148.stdout:6/960: fdatasync d0/d4/f11 0 2024-02-28T16:26:57.311 INFO:tasks.workunit.client.0.smithi148.stdout:6/961: fsync d0/d22/d27/f62 0 2024-02-28T16:26:57.312 INFO:tasks.workunit.client.1.smithi157.stdout:5/167: write d0/f19 [1078046,12046] 0 2024-02-28T16:26:57.314 INFO:tasks.workunit.client.1.smithi157.stdout:2/163: mkdir da/d38 0 2024-02-28T16:26:57.315 INFO:tasks.workunit.client.1.smithi157.stdout:5/168: truncate d0/d9/f37 533369 0 2024-02-28T16:26:57.317 INFO:tasks.workunit.client.1.smithi157.stdout:5/169: fdatasync d0/d9/d1b/d36/f2a 0 2024-02-28T16:26:57.317 INFO:tasks.workunit.client.0.smithi148.stdout:6/962: rename d0/d22/d27/d66/f108 to d0/d4/f135 0 2024-02-28T16:26:57.319 INFO:tasks.workunit.client.1.smithi157.stdout:2/164: dread da/f1d [0,4194304] 0 2024-02-28T16:26:57.320 INFO:tasks.workunit.client.1.smithi157.stdout:2/165: readlink da/l21 0 2024-02-28T16:26:57.321 INFO:tasks.workunit.client.1.smithi157.stdout:2/166: stat da/f37 0 2024-02-28T16:26:57.322 INFO:tasks.workunit.client.1.smithi157.stdout:5/170: mknod d0/d30/c3c 0 2024-02-28T16:26:57.323 INFO:tasks.workunit.client.1.smithi157.stdout:2/167: chown da/f28 176 1 2024-02-28T16:26:57.323 INFO:tasks.workunit.client.1.smithi157.stdout:4/119: dwrite d3/f13 [0,4194304] 0 2024-02-28T16:26:57.323 INFO:tasks.workunit.client.0.smithi148.stdout:6/963: mkdir d0/d22/d25/dcc/d136 0 2024-02-28T16:26:57.326 INFO:tasks.workunit.client.1.smithi157.stdout:5/171: symlink d0/d30/l3d 0 2024-02-28T16:26:57.327 INFO:tasks.workunit.client.1.smithi157.stdout:5/172: stat d0/f2e 0 2024-02-28T16:26:57.328 INFO:tasks.workunit.client.1.smithi157.stdout:5/173: stat d0/d9/f1f 0 2024-02-28T16:26:57.337 INFO:tasks.workunit.client.1.smithi157.stdout:4/120: dwrite d3/da/f2d [0,4194304] 0 2024-02-28T16:26:57.342 INFO:tasks.workunit.client.0.smithi148.stdout:5/909: sync 2024-02-28T16:26:57.344 INFO:tasks.workunit.client.1.smithi157.stdout:2/168: mknod da/d38/c39 0 2024-02-28T16:26:57.345 INFO:tasks.workunit.client.1.smithi157.stdout:5/174: rename d0/d30/c3c to d0/d8/c3e 0 2024-02-28T16:26:57.356 INFO:tasks.workunit.client.1.smithi157.stdout:4/121: dwrite d3/da/f20 [0,4194304] 0 2024-02-28T16:26:57.361 INFO:tasks.workunit.client.1.smithi157.stdout:2/169: dread da/f27 [0,4194304] 0 2024-02-28T16:26:57.372 INFO:tasks.workunit.client.1.smithi157.stdout:4/122: dread d3/da/f20 [0,4194304] 0 2024-02-28T16:26:57.374 INFO:tasks.workunit.client.1.smithi157.stdout:5/175: dwrite d0/d9/f2c [0,4194304] 0 2024-02-28T16:26:57.376 INFO:tasks.workunit.client.1.smithi157.stdout:4/123: rmdir d3 39 2024-02-28T16:26:57.377 INFO:tasks.workunit.client.1.smithi157.stdout:5/176: truncate d0/d9/d1b/f35 496148 0 2024-02-28T16:26:57.387 INFO:tasks.workunit.client.1.smithi157.stdout:4/124: creat d3/f2e x:0 0 0 2024-02-28T16:26:57.388 INFO:tasks.workunit.client.1.smithi157.stdout:4/125: readlink d3/da/d28/l2c 0 2024-02-28T16:26:57.388 INFO:tasks.workunit.client.0.smithi148.stdout:6/964: unlink d0/d22/d49/d88/d107/f130 0 2024-02-28T16:26:57.390 INFO:tasks.workunit.client.1.smithi157.stdout:5/177: dread d0/f34 [0,4194304] 0 2024-02-28T16:26:57.391 INFO:tasks.workunit.client.0.smithi148.stdout:5/910: rename d1/d8/d20/d31/f6c to d1/d8/d20/dd8/d89/d10e/f118 0 2024-02-28T16:26:57.391 INFO:tasks.workunit.client.1.smithi157.stdout:5/178: read d0/f19 [4872370,122035] 0 2024-02-28T16:26:57.393 INFO:tasks.workunit.client.1.smithi157.stdout:4/126: unlink d3/da/f21 0 2024-02-28T16:26:57.397 INFO:tasks.workunit.client.0.smithi148.stdout:6/965: read d0/d22/d25/f4b [311597,30178] 0 2024-02-28T16:26:57.400 INFO:tasks.workunit.client.1.smithi157.stdout:5/179: mkdir d0/d9/d3a/d3f 0 2024-02-28T16:26:57.402 INFO:tasks.workunit.client.0.smithi148.stdout:6/966: mknod d0/d22/d27/d66/d87/c137 0 2024-02-28T16:26:57.403 INFO:tasks.workunit.client.1.smithi157.stdout:4/127: creat d3/f2f x:0 0 0 2024-02-28T16:26:57.405 INFO:tasks.workunit.client.1.smithi157.stdout:5/180: unlink d0/d8/c3e 0 2024-02-28T16:26:57.405 INFO:tasks.workunit.client.1.smithi157.stdout:4/128: truncate d3/da/f2b 938288 0 2024-02-28T16:26:57.406 INFO:tasks.workunit.client.1.smithi157.stdout:4/129: chown d3/c18 63 1 2024-02-28T16:26:57.407 INFO:tasks.workunit.client.1.smithi157.stdout:4/130: truncate d3/f13 5125483 0 2024-02-28T16:26:57.408 INFO:tasks.workunit.client.1.smithi157.stdout:5/181: rename d0/c23 to d0/d9/c40 0 2024-02-28T16:26:57.408 INFO:tasks.workunit.client.1.smithi157.stdout:4/131: chown d3/f2f 31 1 2024-02-28T16:26:57.409 INFO:tasks.workunit.client.1.smithi157.stdout:5/182: fdatasync d0/d8/f2d 0 2024-02-28T16:26:57.411 INFO:tasks.workunit.client.1.smithi157.stdout:4/132: symlink d3/da/d1f/l30 0 2024-02-28T16:26:57.412 INFO:tasks.workunit.client.0.smithi148.stdout:6/967: dread d0/d22/d27/d3e/f45 [0,4194304] 0 2024-02-28T16:26:57.415 INFO:tasks.workunit.client.1.smithi157.stdout:4/133: rename d3/da/d28/f2a to d3/da/f31 0 2024-02-28T16:26:57.415 INFO:tasks.workunit.client.0.smithi148.stdout:5/911: dwrite d1/f94 [0,4194304] 0 2024-02-28T16:26:57.416 INFO:tasks.workunit.client.1.smithi157.stdout:5/183: dread d0/d9/f1d [0,4194304] 0 2024-02-28T16:26:57.418 INFO:tasks.workunit.client.1.smithi157.stdout:4/134: creat d3/da/d1f/f32 x:0 0 0 2024-02-28T16:26:57.419 INFO:tasks.workunit.client.0.smithi148.stdout:6/968: creat d0/f138 x:0 0 0 2024-02-28T16:26:57.420 INFO:tasks.workunit.client.0.smithi148.stdout:5/912: getdents d1/db/d60/d7a/db2/dd9 0 2024-02-28T16:26:57.422 INFO:tasks.workunit.client.0.smithi148.stdout:5/913: readlink d1/d8/d20/d4e/d96/l9f 0 2024-02-28T16:26:57.425 INFO:tasks.workunit.client.1.smithi157.stdout:5/184: getdents d0/d9/d1b/d36 0 2024-02-28T16:26:57.426 INFO:tasks.workunit.client.1.smithi157.stdout:5/185: fdatasync d0/d9/f1f 0 2024-02-28T16:26:57.429 INFO:tasks.workunit.client.0.smithi148.stdout:6/969: getdents d0/d22/d27 0 2024-02-28T16:26:57.433 INFO:tasks.workunit.client.1.smithi157.stdout:5/186: unlink d0/l33 0 2024-02-28T16:26:57.434 INFO:tasks.workunit.client.1.smithi157.stdout:5/187: stat d0/d8/f2b 0 2024-02-28T16:26:57.434 INFO:tasks.workunit.client.1.smithi157.stdout:4/135: dwrite d3/f2f [0,4194304] 0 2024-02-28T16:26:57.435 INFO:tasks.workunit.client.0.smithi148.stdout:6/970: rename d0/d4/fa1 to d0/d22/d25/dcc/d136/f139 0 2024-02-28T16:26:57.435 INFO:tasks.workunit.client.1.smithi157.stdout:9/92: sync 2024-02-28T16:26:57.437 INFO:tasks.workunit.client.1.smithi157.stdout:9/93: chown d0/l11 2567 1 2024-02-28T16:26:57.440 INFO:tasks.workunit.client.0.smithi148.stdout:6/971: unlink d0/d4/dba/d71/l83 0 2024-02-28T16:26:57.442 INFO:tasks.workunit.client.1.smithi157.stdout:9/94: creat d0/d19/f1e x:0 0 0 2024-02-28T16:26:57.443 INFO:tasks.workunit.client.1.smithi157.stdout:4/136: creat d3/f33 x:0 0 0 2024-02-28T16:26:57.444 INFO:tasks.workunit.client.1.smithi157.stdout:9/95: chown d0/l11 0 1 2024-02-28T16:26:57.445 INFO:tasks.workunit.client.0.smithi148.stdout:6/972: creat d0/d22/d27/d66/d87/f13a x:0 0 0 2024-02-28T16:26:57.446 INFO:tasks.workunit.client.1.smithi157.stdout:9/96: write d0/d19/f1c [4074021,6567] 0 2024-02-28T16:26:57.448 INFO:tasks.workunit.client.1.smithi157.stdout:9/97: chown d0/l11 746 1 2024-02-28T16:26:57.449 INFO:tasks.workunit.client.1.smithi157.stdout:9/98: fdatasync d0/d19/f1e 0 2024-02-28T16:26:57.450 INFO:tasks.workunit.client.0.smithi148.stdout:6/973: creat d0/d8/f13b x:0 0 0 2024-02-28T16:26:57.453 INFO:tasks.workunit.client.0.smithi148.stdout:6/974: read d0/d8/d21/d9d/fca [884202,126811] 0 2024-02-28T16:26:57.455 INFO:tasks.workunit.client.0.smithi148.stdout:5/914: write d1/db/d60/fa8 [1611960,120061] 0 2024-02-28T16:26:57.456 INFO:tasks.workunit.client.0.smithi148.stdout:6/975: mkdir d0/d4/d14/d59/df9/d13c 0 2024-02-28T16:26:57.460 INFO:tasks.workunit.client.1.smithi157.stdout:4/137: dwrite d3/f2e [0,4194304] 0 2024-02-28T16:26:57.463 INFO:tasks.workunit.client.1.smithi157.stdout:4/138: write d3/f16 [1005682,99500] 0 2024-02-28T16:26:57.463 INFO:tasks.workunit.client.1.smithi157.stdout:4/139: fdatasync d3/da/fd 0 2024-02-28T16:26:57.464 INFO:tasks.workunit.client.1.smithi157.stdout:9/99: rmdir d0/d19 39 2024-02-28T16:26:57.466 INFO:tasks.workunit.client.1.smithi157.stdout:4/140: write d3/da/d1f/f27 [904695,66796] 0 2024-02-28T16:26:57.468 INFO:tasks.workunit.client.1.smithi157.stdout:9/100: write d0/d19/f1b [176195,94981] 0 2024-02-28T16:26:57.473 INFO:tasks.workunit.client.1.smithi157.stdout:9/101: creat d0/f1f x:0 0 0 2024-02-28T16:26:57.476 INFO:tasks.workunit.client.1.smithi157.stdout:9/102: rename d0/f15 to d0/f20 0 2024-02-28T16:26:57.478 INFO:tasks.workunit.client.1.smithi157.stdout:9/103: chown d0/lc 19301714 1 2024-02-28T16:26:57.480 INFO:tasks.workunit.client.1.smithi157.stdout:9/104: chown d0/d19/f1c 7459839 1 2024-02-28T16:26:57.484 INFO:tasks.workunit.client.0.smithi148.stdout:5/915: write d1/d8/d20/d31/f39 [2174009,100241] 0 2024-02-28T16:26:57.485 INFO:tasks.workunit.client.0.smithi148.stdout:6/976: write d0/d22/d49/d88/d97/fb5 [561283,123646] 0 2024-02-28T16:26:57.486 INFO:tasks.workunit.client.1.smithi157.stdout:9/105: creat d0/f21 x:0 0 0 2024-02-28T16:26:57.486 INFO:tasks.workunit.client.1.smithi157.stdout:9/106: fdatasync d0/f12 0 2024-02-28T16:26:57.487 INFO:tasks.workunit.client.0.smithi148.stdout:6/977: stat d0/d22/d49/f10e 0 2024-02-28T16:26:57.488 INFO:tasks.workunit.client.1.smithi157.stdout:4/141: truncate d3/f16 986498 0 2024-02-28T16:26:57.490 INFO:tasks.workunit.client.1.smithi157.stdout:9/107: mknod d0/d19/c22 0 2024-02-28T16:26:57.491 INFO:tasks.workunit.client.1.smithi157.stdout:9/108: chown d0/l17 7 1 2024-02-28T16:26:57.492 INFO:tasks.workunit.client.0.smithi148.stdout:5/916: write d1/d8/d20/fd6 [181685,123760] 0 2024-02-28T16:26:57.493 INFO:tasks.workunit.client.1.smithi157.stdout:9/109: write d0/f18 [369279,126089] 0 2024-02-28T16:26:57.493 INFO:tasks.workunit.client.0.smithi148.stdout:5/917: chown d1/db/d60/d7a/db2 30183 1 2024-02-28T16:26:57.494 INFO:tasks.workunit.client.0.smithi148.stdout:5/918: chown d1/d8/c5c 2 1 2024-02-28T16:26:57.498 INFO:tasks.workunit.client.0.smithi148.stdout:5/919: symlink d1/db/d60/d7a/df8/l119 0 2024-02-28T16:26:57.505 INFO:tasks.workunit.client.0.smithi148.stdout:5/920: write d1/d8/fbc [377972,9762] 0 2024-02-28T16:26:57.508 INFO:tasks.workunit.client.1.smithi157.stdout:4/142: dwrite d3/f33 [0,4194304] 0 2024-02-28T16:26:57.510 INFO:tasks.workunit.client.1.smithi157.stdout:4/143: fsync d3/da/fd 0 2024-02-28T16:26:57.511 INFO:tasks.workunit.client.0.smithi148.stdout:6/978: dread d0/d22/d27/d3e/f7b [0,4194304] 0 2024-02-28T16:26:57.512 INFO:tasks.workunit.client.1.smithi157.stdout:4/144: truncate d3/f16 1458723 0 2024-02-28T16:26:57.514 INFO:tasks.workunit.client.1.smithi157.stdout:9/110: dwrite d0/f1f [0,4194304] 0 2024-02-28T16:26:57.515 INFO:tasks.workunit.client.1.smithi157.stdout:1/161: sync 2024-02-28T16:26:57.517 INFO:tasks.workunit.client.1.smithi157.stdout:4/145: rename d3/c1a to d3/da/d1f/c34 0 2024-02-28T16:26:57.518 INFO:tasks.workunit.client.1.smithi157.stdout:1/162: rename d10/d11 to d10/d11/d2f 22 2024-02-28T16:26:57.521 INFO:tasks.workunit.client.1.smithi157.stdout:4/146: truncate d3/da/d1f/f27 1840599 0 2024-02-28T16:26:57.521 INFO:tasks.workunit.client.1.smithi157.stdout:1/163: read d10/f12 [3244238,62856] 0 2024-02-28T16:26:57.524 INFO:tasks.workunit.client.1.smithi157.stdout:1/164: truncate d10/d11/f28 1655374 0 2024-02-28T16:26:57.525 INFO:tasks.workunit.client.0.smithi148.stdout:5/921: dwrite d1/d8/d20/dd8/ff4 [0,4194304] 0 2024-02-28T16:26:57.529 INFO:tasks.workunit.client.0.smithi148.stdout:5/922: chown d1/d8/d20/d31/f10b 51514312 1 2024-02-28T16:26:57.530 INFO:tasks.workunit.client.1.smithi157.stdout:1/165: dread d10/f1b [0,4194304] 0 2024-02-28T16:26:57.532 INFO:tasks.workunit.client.0.smithi148.stdout:6/979: dwrite d0/d22/d27/d66/d87/fde [4194304,4194304] 0 2024-02-28T16:26:57.533 INFO:tasks.workunit.client.0.smithi148.stdout:5/923: dread d1/d8/d20/fc3 [0,4194304] 0 2024-02-28T16:26:57.533 INFO:tasks.workunit.client.1.smithi157.stdout:1/166: mknod d10/d11/c30 0 2024-02-28T16:26:57.537 INFO:tasks.workunit.client.0.smithi148.stdout:4/799: sync 2024-02-28T16:26:57.537 INFO:tasks.workunit.client.0.smithi148.stdout:7/918: sync 2024-02-28T16:26:57.538 INFO:tasks.workunit.client.0.smithi148.stdout:5/924: mkdir d1/db/d60/d7a/d87/de0/dee/d11a 0 2024-02-28T16:26:57.539 INFO:tasks.workunit.client.1.smithi157.stdout:1/167: truncate d10/f16 2355777 0 2024-02-28T16:26:57.539 INFO:tasks.workunit.client.1.smithi157.stdout:9/111: write d0/f3 [1640688,97390] 0 2024-02-28T16:26:57.542 INFO:tasks.workunit.client.1.smithi157.stdout:1/168: dread - d10/d11/f2e zero size 2024-02-28T16:26:57.543 INFO:tasks.workunit.client.0.smithi148.stdout:4/800: symlink d8/d21/d3d/d4d/d66/dad/dfe/l112 0 2024-02-28T16:26:57.545 INFO:tasks.workunit.client.1.smithi157.stdout:9/112: symlink d0/l23 0 2024-02-28T16:26:57.547 INFO:tasks.workunit.client.1.smithi157.stdout:9/113: write d0/f3 [81106,1609] 0 2024-02-28T16:26:57.548 INFO:tasks.workunit.client.0.smithi148.stdout:5/925: rename d1/d8/d20/dd8/dbe to d1/d44/d65/ddc/d11b 0 2024-02-28T16:26:57.549 INFO:tasks.workunit.client.0.smithi148.stdout:4/801: fsync d8/d40/dc3/dd3/d17/d6a/f8d 0 2024-02-28T16:26:57.549 INFO:tasks.workunit.client.1.smithi157.stdout:9/114: write d0/d19/f1b [1018787,63517] 0 2024-02-28T16:26:57.553 INFO:tasks.workunit.client.1.smithi157.stdout:1/169: rename d10/d11/d18 to d10/d11/d31 0 2024-02-28T16:26:57.554 INFO:tasks.workunit.client.1.smithi157.stdout:4/147: truncate d3/da/f20 686772 0 2024-02-28T16:26:57.555 INFO:tasks.workunit.client.1.smithi157.stdout:1/170: truncate d10/d11/f2e 377287 0 2024-02-28T16:26:57.555 INFO:tasks.workunit.client.1.smithi157.stdout:4/148: fsync d3/f2f 0 2024-02-28T16:26:57.556 INFO:tasks.workunit.client.1.smithi157.stdout:4/149: fdatasync d3/da/d1f/f26 0 2024-02-28T16:26:57.559 INFO:tasks.workunit.client.1.smithi157.stdout:9/115: unlink d0/f10 0 2024-02-28T16:26:57.561 INFO:tasks.workunit.client.0.smithi148.stdout:5/926: rename d1/d8/d20/d4e/d71/l7d to d1/db/d60/d7a/db2/d111/l11c 0 2024-02-28T16:26:57.563 INFO:tasks.workunit.client.0.smithi148.stdout:7/919: write d0/d9/d4c/fa8 [3231677,90650] 0 2024-02-28T16:26:57.566 INFO:tasks.workunit.client.0.smithi148.stdout:4/802: dwrite d8/d37/d91/f9a [0,4194304] 0 2024-02-28T16:26:57.567 INFO:tasks.workunit.client.1.smithi157.stdout:1/171: rename d10/d11/d22/f24 to d10/d11/f32 0 2024-02-28T16:26:57.568 INFO:tasks.workunit.client.1.smithi157.stdout:4/150: creat d3/da/f35 x:0 0 0 2024-02-28T16:26:57.569 INFO:tasks.workunit.client.1.smithi157.stdout:9/116: dread d0/f12 [0,4194304] 0 2024-02-28T16:26:57.571 INFO:tasks.workunit.client.0.smithi148.stdout:7/920: creat d0/d4/f11d x:0 0 0 2024-02-28T16:26:57.571 INFO:tasks.workunit.client.1.smithi157.stdout:9/117: chown d0/f1f 6 1 2024-02-28T16:26:57.575 INFO:tasks.workunit.client.0.smithi148.stdout:7/921: dread - d0/d9/d25/d96/ddf/d28/d2b/f11b zero size 2024-02-28T16:26:57.575 INFO:tasks.workunit.client.0.smithi148.stdout:5/927: rename d1/db/d60/d7a/d87/fe5 to d1/d8/d23/f11d 0 2024-02-28T16:26:57.576 INFO:tasks.workunit.client.1.smithi157.stdout:7/151: sync 2024-02-28T16:26:57.577 INFO:tasks.workunit.client.0.smithi148.stdout:5/928: truncate d1/db/fc5 1542705 0 2024-02-28T16:26:57.578 INFO:tasks.workunit.client.0.smithi148.stdout:4/803: fsync d8/d40/dc3/dd3/d17/d6a/f3a 0 2024-02-28T16:26:57.579 INFO:tasks.workunit.client.0.smithi148.stdout:7/922: dread d0/d9/d25/d39/f54 [0,4194304] 0 2024-02-28T16:26:57.581 INFO:tasks.workunit.client.1.smithi157.stdout:4/151: dread d3/f2f [0,4194304] 0 2024-02-28T16:26:57.584 INFO:tasks.workunit.client.1.smithi157.stdout:7/152: symlink df/l32 0 2024-02-28T16:26:57.586 INFO:tasks.workunit.client.1.smithi157.stdout:9/118: creat d0/f24 x:0 0 0 2024-02-28T16:26:57.586 INFO:tasks.workunit.client.0.smithi148.stdout:7/923: mknod d0/d9/d25/d96/db7/c11e 0 2024-02-28T16:26:57.591 INFO:tasks.workunit.client.1.smithi157.stdout:9/119: dread d0/f18 [0,4194304] 0 2024-02-28T16:26:57.591 INFO:tasks.workunit.client.0.smithi148.stdout:4/804: creat d8/d40/dc3/dd3/d17/d6a/d6c/dda/f113 x:0 0 0 2024-02-28T16:26:57.592 INFO:tasks.workunit.client.1.smithi157.stdout:1/172: dread f2 [0,4194304] 0 2024-02-28T16:26:57.593 INFO:tasks.workunit.client.1.smithi157.stdout:1/173: dread - d10/d11/d2c/f25 zero size 2024-02-28T16:26:57.593 INFO:tasks.workunit.client.0.smithi148.stdout:4/805: write d8/d40/dc3/dd3/d17/d6a/f100 [160062,7170] 0 2024-02-28T16:26:57.594 INFO:tasks.workunit.client.0.smithi148.stdout:7/924: symlink d0/d9/d46/l11f 0 2024-02-28T16:26:57.594 INFO:tasks.workunit.client.1.smithi157.stdout:1/174: chown d10/f16 0 1 2024-02-28T16:26:57.595 INFO:tasks.workunit.client.1.smithi157.stdout:1/175: readlink lb 0 2024-02-28T16:26:57.595 INFO:tasks.workunit.client.0.smithi148.stdout:5/929: link d1/d8/d23/c2c d1/d8/d20/d4e/d71/c11e 0 2024-02-28T16:26:57.597 INFO:tasks.workunit.client.0.smithi148.stdout:5/930: dread - d1/d8/d23/fef zero size 2024-02-28T16:26:57.597 INFO:tasks.workunit.client.0.smithi148.stdout:7/925: truncate d0/d4/d70/f100 435431 0 2024-02-28T16:26:57.597 INFO:tasks.workunit.client.1.smithi157.stdout:9/120: creat d0/d19/f25 x:0 0 0 2024-02-28T16:26:57.598 INFO:tasks.workunit.client.1.smithi157.stdout:7/153: rmdir df 39 2024-02-28T16:26:57.600 INFO:tasks.workunit.client.0.smithi148.stdout:4/806: unlink d8/d21/d3d/d4d/cc9 0 2024-02-28T16:26:57.602 INFO:tasks.workunit.client.0.smithi148.stdout:5/931: creat d1/d8/d20/dd8/f11f x:0 0 0 2024-02-28T16:26:57.602 INFO:tasks.workunit.client.1.smithi157.stdout:4/152: write d3/da/ff [2562688,70574] 0 2024-02-28T16:26:57.604 INFO:tasks.workunit.client.0.smithi148.stdout:7/926: mkdir d0/d9/d25/d96/db7/dd4/dfd/d120 0 2024-02-28T16:26:57.605 INFO:tasks.workunit.client.0.smithi148.stdout:4/807: symlink d8/d21/d3d/d4d/d66/dad/dfe/l114 0 2024-02-28T16:26:57.607 INFO:tasks.workunit.client.0.smithi148.stdout:5/932: stat d1/f5f 0 2024-02-28T16:26:57.608 INFO:tasks.workunit.client.0.smithi148.stdout:5/933: chown d1/d44/d65/ddc/d11b 117 1 2024-02-28T16:26:57.608 INFO:tasks.workunit.client.0.smithi148.stdout:7/927: write d0/d9/d25/d96/ddf/d28/d2b/d3a/fc4 [159110,105791] 0 2024-02-28T16:26:57.611 INFO:tasks.workunit.client.0.smithi148.stdout:4/808: rename d8/d40/dc3/cb7 to d8/d40/dc3/dd3/d17/c115 0 2024-02-28T16:26:57.614 INFO:tasks.workunit.client.0.smithi148.stdout:5/934: mkdir d1/db/d60/d7a/db2/d120 0 2024-02-28T16:26:57.616 INFO:tasks.workunit.client.1.smithi157.stdout:1/176: dwrite fa [4194304,4194304] 0 2024-02-28T16:26:57.617 INFO:tasks.workunit.client.0.smithi148.stdout:4/809: creat d8/d40/dc3/dbd/de3/f116 x:0 0 0 2024-02-28T16:26:57.617 INFO:tasks.workunit.client.1.smithi157.stdout:9/121: dwrite d0/f21 [0,4194304] 0 2024-02-28T16:26:57.619 INFO:tasks.workunit.client.0.smithi148.stdout:5/935: rename d1/d8/d20/d4e/d71/le6 to d1/d44/d65/ddc/l121 0 2024-02-28T16:26:57.621 INFO:tasks.workunit.client.1.smithi157.stdout:9/122: chown d0/f12 175215 1 2024-02-28T16:26:57.622 INFO:tasks.workunit.client.1.smithi157.stdout:7/154: dread f0 [0,4194304] 0 2024-02-28T16:26:57.623 INFO:tasks.workunit.client.1.smithi157.stdout:1/177: symlink d10/d11/d2c/l33 0 2024-02-28T16:26:57.625 INFO:tasks.workunit.client.1.smithi157.stdout:4/153: dread d3/da/ff [0,4194304] 0 2024-02-28T16:26:57.626 INFO:tasks.workunit.client.1.smithi157.stdout:5/188: sync 2024-02-28T16:26:57.626 INFO:tasks.workunit.client.1.smithi157.stdout:2/170: sync 2024-02-28T16:26:57.626 INFO:tasks.workunit.client.1.smithi157.stdout:6/107: sync 2024-02-28T16:26:57.626 INFO:tasks.workunit.client.1.smithi157.stdout:3/107: sync 2024-02-28T16:26:57.626 INFO:tasks.workunit.client.1.smithi157.stdout:0/179: sync 2024-02-28T16:26:57.627 INFO:tasks.workunit.client.1.smithi157.stdout:8/89: sync 2024-02-28T16:26:57.627 INFO:tasks.workunit.client.1.smithi157.stdout:9/123: mknod d0/d19/c26 0 2024-02-28T16:26:57.628 INFO:tasks.workunit.client.0.smithi148.stdout:7/928: dwrite d0/d4/f15 [0,4194304] 0 2024-02-28T16:26:57.630 INFO:tasks.workunit.client.1.smithi157.stdout:1/178: creat d10/d11/d31/d2a/f34 x:0 0 0 2024-02-28T16:26:57.637 INFO:tasks.workunit.client.1.smithi157.stdout:0/180: mknod d1/da/c41 0 2024-02-28T16:26:57.638 INFO:tasks.workunit.client.1.smithi157.stdout:2/171: dread - da/f37 zero size 2024-02-28T16:26:57.639 INFO:tasks.workunit.client.1.smithi157.stdout:3/108: mknod d0/d20/c22 0 2024-02-28T16:26:57.639 INFO:tasks.workunit.client.1.smithi157.stdout:5/189: fdatasync d0/d9/f1f 0 2024-02-28T16:26:57.640 INFO:tasks.workunit.client.0.smithi148.stdout:5/936: dwrite d1/db/d25/ff5 [0,4194304] 0 2024-02-28T16:26:57.641 INFO:tasks.workunit.client.1.smithi157.stdout:2/172: readlink da/l20 0 2024-02-28T16:26:57.642 INFO:tasks.workunit.client.1.smithi157.stdout:3/109: write d0/f8 [3626947,33822] 0 2024-02-28T16:26:57.642 INFO:tasks.workunit.client.1.smithi157.stdout:6/108: mkdir d2/d17 0 2024-02-28T16:26:57.643 INFO:tasks.workunit.client.1.smithi157.stdout:8/90: symlink d1/d5/d10/l19 0 2024-02-28T16:26:57.645 INFO:tasks.workunit.client.1.smithi157.stdout:3/110: write d0/d6/f16 [839259,18324] 0 2024-02-28T16:26:57.645 INFO:tasks.workunit.client.1.smithi157.stdout:1/179: rename d10/d11/l1f to d10/d11/d31/d2a/l35 0 2024-02-28T16:26:57.646 INFO:tasks.workunit.client.1.smithi157.stdout:8/91: rename d1/d5/d14 to d1/d5/d14/d1a 22 2024-02-28T16:26:57.647 INFO:tasks.workunit.client.0.smithi148.stdout:5/937: unlink d1/db/d60/f86 0 2024-02-28T16:26:57.647 INFO:tasks.workunit.client.1.smithi157.stdout:8/92: stat d1/f2 0 2024-02-28T16:26:57.650 INFO:tasks.workunit.client.1.smithi157.stdout:0/181: symlink d1/d8/d27/l42 0 2024-02-28T16:26:57.654 INFO:tasks.workunit.client.0.smithi148.stdout:4/810: dwrite d8/d40/dc3/dd3/f34 [4194304,4194304] 0 2024-02-28T16:26:57.657 INFO:tasks.workunit.client.1.smithi157.stdout:9/124: mknod d0/c27 0 2024-02-28T16:26:57.660 INFO:tasks.workunit.client.0.smithi148.stdout:4/811: write d8/d40/d73/fd1 [284446,116050] 0 2024-02-28T16:26:57.664 INFO:tasks.workunit.client.1.smithi157.stdout:9/125: read d0/fb [202139,123652] 0 2024-02-28T16:26:57.665 INFO:tasks.workunit.client.1.smithi157.stdout:9/126: readlink d0/le 0 2024-02-28T16:26:57.666 INFO:tasks.workunit.client.0.smithi148.stdout:4/812: readlink d8/d21/d3d/d4d/d66/dad/dfe/l112 0 2024-02-28T16:26:57.669 INFO:tasks.workunit.client.1.smithi157.stdout:3/111: unlink d0/d6/f16 0 2024-02-28T16:26:57.672 INFO:tasks.workunit.client.0.smithi148.stdout:4/813: read d8/d40/dc3/dd3/d17/d6a/f50 [3901963,6269] 0 2024-02-28T16:26:57.673 INFO:tasks.workunit.client.0.smithi148.stdout:7/929: dread d0/d9/f8e [0,4194304] 0 2024-02-28T16:26:57.679 INFO:tasks.workunit.client.0.smithi148.stdout:5/938: write d1/d44/d65/f76 [4645686,41055] 0 2024-02-28T16:26:57.681 INFO:tasks.workunit.client.1.smithi157.stdout:0/182: creat d1/da/f43 x:0 0 0 2024-02-28T16:26:57.681 INFO:tasks.workunit.client.0.smithi148.stdout:4/814: truncate d8/d21/d3d/d4d/f60 79051 0 2024-02-28T16:26:57.683 INFO:tasks.workunit.client.1.smithi157.stdout:2/173: mkdir da/d3a 0 2024-02-28T16:26:57.683 INFO:tasks.workunit.client.1.smithi157.stdout:0/183: chown d1/f2 8253609 1 2024-02-28T16:26:57.684 INFO:tasks.workunit.client.0.smithi148.stdout:7/930: mknod d0/d9/d25/d96/db7/dd4/dfd/d120/c121 0 2024-02-28T16:26:57.685 INFO:tasks.workunit.client.0.smithi148.stdout:5/939: symlink d1/d8/d20/d4e/d96/l122 0 2024-02-28T16:26:57.686 INFO:tasks.workunit.client.1.smithi157.stdout:0/184: dread - d1/d8/d27/f3a zero size 2024-02-28T16:26:57.687 INFO:tasks.workunit.client.0.smithi148.stdout:5/940: write d1/f2f [5061465,42282] 0 2024-02-28T16:26:57.687 INFO:tasks.workunit.client.1.smithi157.stdout:6/109: stat d2/d7/fc 0 2024-02-28T16:26:57.688 INFO:tasks.workunit.client.0.smithi148.stdout:4/815: creat d8/d71/f117 x:0 0 0 2024-02-28T16:26:57.689 INFO:tasks.workunit.client.1.smithi157.stdout:0/185: chown d1/da/f2f 9723 1 2024-02-28T16:26:57.689 INFO:tasks.workunit.client.1.smithi157.stdout:5/190: dwrite d0/f2e [0,4194304] 0 2024-02-28T16:26:57.689 INFO:tasks.workunit.client.1.smithi157.stdout:8/93: write d1/d5/d10/f18 [419980,127599] 0 2024-02-28T16:26:57.690 INFO:tasks.workunit.client.0.smithi148.stdout:5/941: write d1/db/d60/df0/ddd/ffe [540246,20052] 0 2024-02-28T16:26:57.691 INFO:tasks.workunit.client.0.smithi148.stdout:4/816: chown d8/d21/d3d/d8c/db0/f92 354641571 1 2024-02-28T16:26:57.691 INFO:tasks.workunit.client.1.smithi157.stdout:4/154: truncate d3/f33 3424740 0 2024-02-28T16:26:57.696 INFO:tasks.workunit.client.1.smithi157.stdout:9/127: dread d0/f20 [0,4194304] 0 2024-02-28T16:26:57.697 INFO:tasks.workunit.client.1.smithi157.stdout:0/186: write d1/f24 [2395829,79102] 0 2024-02-28T16:26:57.697 INFO:tasks.workunit.client.1.smithi157.stdout:8/94: chown d1/d5/l8 52270 1 2024-02-28T16:26:57.698 INFO:tasks.workunit.client.0.smithi148.stdout:4/817: mknod d8/c118 0 2024-02-28T16:26:57.699 INFO:tasks.workunit.client.1.smithi157.stdout:7/155: link f0 df/d1f/d24/f33 0 2024-02-28T16:26:57.700 INFO:tasks.workunit.client.1.smithi157.stdout:0/187: fdatasync d1/d13/f3e 0 2024-02-28T16:26:57.704 INFO:tasks.workunit.client.1.smithi157.stdout:9/128: read d0/f1f [2675395,63792] 0 2024-02-28T16:26:57.705 INFO:tasks.workunit.client.0.smithi148.stdout:4/818: mknod d8/d40/dc3/dd3/c119 0 2024-02-28T16:26:57.708 INFO:tasks.workunit.client.0.smithi148.stdout:4/819: fsync d8/d21/d3d/d8c/db0/f92 0 2024-02-28T16:26:57.708 INFO:tasks.workunit.client.1.smithi157.stdout:5/191: creat d0/d8/f41 x:0 0 0 2024-02-28T16:26:57.711 INFO:tasks.workunit.client.1.smithi157.stdout:8/95: symlink d1/d5/l1b 0 2024-02-28T16:26:57.712 INFO:tasks.workunit.client.1.smithi157.stdout:1/180: link l6 d10/d11/d31/l36 0 2024-02-28T16:26:57.716 INFO:tasks.workunit.client.1.smithi157.stdout:0/188: creat d1/d8/d33/f44 x:0 0 0 2024-02-28T16:26:57.716 INFO:tasks.workunit.client.1.smithi157.stdout:3/112: dread d0/d6/fa [0,4194304] 0 2024-02-28T16:26:57.717 INFO:tasks.workunit.client.0.smithi148.stdout:4/820: truncate d8/d40/dc3/dd3/d5f/f8f 1128410 0 2024-02-28T16:26:57.717 INFO:tasks.workunit.client.1.smithi157.stdout:0/189: chown d1/d8 12399 1 2024-02-28T16:26:57.718 INFO:tasks.workunit.client.1.smithi157.stdout:4/155: symlink d3/l36 0 2024-02-28T16:26:57.720 INFO:tasks.workunit.client.1.smithi157.stdout:5/192: rename d0/d9/f10 to d0/d9/f42 0 2024-02-28T16:26:57.720 INFO:tasks.workunit.client.1.smithi157.stdout:2/174: creat da/f3b x:0 0 0 2024-02-28T16:26:57.722 INFO:tasks.workunit.client.1.smithi157.stdout:4/156: dread - d3/da/fd zero size 2024-02-28T16:26:57.722 INFO:tasks.workunit.client.0.smithi148.stdout:4/821: unlink d8/d21/d3d/d4d/d66/dad/ff7 0 2024-02-28T16:26:57.723 INFO:tasks.workunit.client.1.smithi157.stdout:5/193: chown d0/d9/d3a 14 1 2024-02-28T16:26:57.723 INFO:tasks.workunit.client.1.smithi157.stdout:6/110: dwrite d2/f5 [0,4194304] 0 2024-02-28T16:26:57.724 INFO:tasks.workunit.client.1.smithi157.stdout:5/194: stat d0/d9/f1d 0 2024-02-28T16:26:57.724 INFO:tasks.workunit.client.0.smithi148.stdout:4/822: chown d8/d40/dc3/dd3/d17/d6a 3719 1 2024-02-28T16:26:57.727 INFO:tasks.workunit.client.1.smithi157.stdout:1/181: mknod d10/d11/d31/c37 0 2024-02-28T16:26:57.729 INFO:tasks.workunit.client.0.smithi148.stdout:5/942: write d1/d8/d20/d4e/d84/f8a [615411,26904] 0 2024-02-28T16:26:57.733 INFO:tasks.workunit.client.1.smithi157.stdout:5/195: dread d0/d9/d1b/d36/f2a [0,4194304] 0 2024-02-28T16:26:57.733 INFO:tasks.workunit.client.1.smithi157.stdout:3/113: mkdir d0/d20/d23 0 2024-02-28T16:26:57.734 INFO:tasks.workunit.client.1.smithi157.stdout:5/196: stat d0/d9/ff 0 2024-02-28T16:26:57.734 INFO:tasks.workunit.client.1.smithi157.stdout:0/190: creat d1/d8/f45 x:0 0 0 2024-02-28T16:26:57.735 INFO:tasks.workunit.client.0.smithi148.stdout:7/931: dwrite d0/d9/d25/d96/ddf/f41 [0,4194304] 0 2024-02-28T16:26:57.736 INFO:tasks.workunit.client.1.smithi157.stdout:2/175: symlink da/d35/l3c 0 2024-02-28T16:26:57.737 INFO:tasks.workunit.client.0.smithi148.stdout:4/823: fdatasync d8/d21/d3d/d4d/d72/f111 0 2024-02-28T16:26:57.738 INFO:tasks.workunit.client.1.smithi157.stdout:4/157: mkdir d3/da/d37 0 2024-02-28T16:26:57.739 INFO:tasks.workunit.client.1.smithi157.stdout:4/158: readlink d3/da/l14 0 2024-02-28T16:26:57.741 INFO:tasks.workunit.client.1.smithi157.stdout:6/111: chown d2/d7/de/l13 3 1 2024-02-28T16:26:57.742 INFO:tasks.workunit.client.1.smithi157.stdout:8/96: symlink d1/d5/d14/l1c 0 2024-02-28T16:26:57.744 INFO:tasks.workunit.client.1.smithi157.stdout:8/97: write d1/d5/d10/f18 [850566,115991] 0 2024-02-28T16:26:57.747 INFO:tasks.workunit.client.1.smithi157.stdout:9/129: rename d0/d19/f1b to d0/f28 0 2024-02-28T16:26:57.747 INFO:tasks.workunit.client.1.smithi157.stdout:8/98: dread d1/f17 [0,4194304] 0 2024-02-28T16:26:57.748 INFO:tasks.workunit.client.1.smithi157.stdout:4/159: dread d3/da/d1f/f29 [0,4194304] 0 2024-02-28T16:26:57.748 INFO:tasks.workunit.client.1.smithi157.stdout:9/130: chown d0/f12 8179558 1 2024-02-28T16:26:57.750 INFO:tasks.workunit.client.1.smithi157.stdout:9/131: truncate d0/f24 40216 0 2024-02-28T16:26:57.752 INFO:tasks.workunit.client.1.smithi157.stdout:3/114: fdatasync d0/f8 0 2024-02-28T16:26:57.752 INFO:tasks.workunit.client.1.smithi157.stdout:8/99: read d1/d5/f16 [835760,71641] 0 2024-02-28T16:26:57.753 INFO:tasks.workunit.client.1.smithi157.stdout:3/115: stat d0/d20/d23 0 2024-02-28T16:26:57.755 INFO:tasks.workunit.client.1.smithi157.stdout:8/100: write d1/d5/fe [251075,103145] 0 2024-02-28T16:26:57.757 INFO:tasks.workunit.client.0.smithi148.stdout:7/932: rename d0/d9/d25/d96/ddf/d28/d2b/d5c/fe8 to d0/d9/d4c/f122 0 2024-02-28T16:26:57.760 INFO:tasks.workunit.client.0.smithi148.stdout:4/824: dwrite d8/d40/dc3/dd3/d5f/fcc [4194304,4194304] 0 2024-02-28T16:26:57.760 INFO:tasks.workunit.client.1.smithi157.stdout:7/156: dread fd [0,4194304] 0 2024-02-28T16:26:57.761 INFO:tasks.workunit.client.1.smithi157.stdout:7/157: read fd [336045,89720] 0 2024-02-28T16:26:57.761 INFO:tasks.workunit.client.1.smithi157.stdout:8/101: dread d1/d5/d10/f18 [0,4194304] 0 2024-02-28T16:26:57.764 INFO:tasks.workunit.client.1.smithi157.stdout:1/182: rename d10/d11/d2c/f25 to d10/f38 0 2024-02-28T16:26:57.768 INFO:tasks.workunit.client.1.smithi157.stdout:4/160: read d3/da/f20 [517280,10166] 0 2024-02-28T16:26:57.768 INFO:tasks.workunit.client.0.smithi148.stdout:7/933: link d0/d4/f63 d0/d9/d25/d39/f123 0 2024-02-28T16:26:57.772 INFO:tasks.workunit.client.0.smithi148.stdout:5/943: truncate d1/f43 1020680 0 2024-02-28T16:26:57.774 INFO:tasks.workunit.client.0.smithi148.stdout:5/944: write d1/d8/d20/fd6 [242330,27430] 0 2024-02-28T16:26:57.776 INFO:tasks.workunit.client.1.smithi157.stdout:3/116: creat d0/f24 x:0 0 0 2024-02-28T16:26:57.780 INFO:tasks.workunit.client.0.smithi148.stdout:4/825: write d8/d21/d3d/d8c/fd7 [694553,43183] 0 2024-02-28T16:26:57.780 INFO:tasks.workunit.client.1.smithi157.stdout:2/176: creat da/d2b/f3d x:0 0 0 2024-02-28T16:26:57.780 INFO:tasks.workunit.client.1.smithi157.stdout:6/112: mknod d2/d17/c18 0 2024-02-28T16:26:57.781 INFO:tasks.workunit.client.1.smithi157.stdout:8/102: symlink d1/d5/d10/l1d 0 2024-02-28T16:26:57.782 INFO:tasks.workunit.client.1.smithi157.stdout:1/183: symlink d10/d11/d31/l39 0 2024-02-28T16:26:57.784 INFO:tasks.workunit.client.1.smithi157.stdout:9/132: fdatasync d0/f5 0 2024-02-28T16:26:57.787 INFO:tasks.workunit.client.1.smithi157.stdout:5/197: link d0/d8/l14 d0/d9/l43 0 2024-02-28T16:26:57.788 INFO:tasks.workunit.client.0.smithi148.stdout:7/934: dwrite d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/f10f [0,4194304] 0 2024-02-28T16:26:57.788 INFO:tasks.workunit.client.1.smithi157.stdout:2/177: mkdir da/d38/d3e 0 2024-02-28T16:26:57.790 INFO:tasks.workunit.client.1.smithi157.stdout:2/178: chown da/d35/l3c 16417819 1 2024-02-28T16:26:57.796 INFO:tasks.workunit.client.0.smithi148.stdout:5/945: dread d1/db/d60/d7a/d8b/f5e [0,4194304] 0 2024-02-28T16:26:57.797 INFO:tasks.workunit.client.1.smithi157.stdout:6/113: read d2/d7/f11 [2894353,24308] 0 2024-02-28T16:26:57.800 INFO:tasks.workunit.client.1.smithi157.stdout:8/103: mknod d1/d5/c1e 0 2024-02-28T16:26:57.800 INFO:tasks.workunit.client.0.smithi148.stdout:4/826: link d8/d40/dc3/dd3/c7f d8/d40/dc3/dd3/d17/d6a/d6c/dda/c11a 0 2024-02-28T16:26:57.801 INFO:tasks.workunit.client.0.smithi148.stdout:4/827: chown d8/d40/dc3/dd3 105643943 1 2024-02-28T16:26:57.805 INFO:tasks.workunit.client.1.smithi157.stdout:1/184: rmdir d10/d11/d31/d2a 39 2024-02-28T16:26:57.810 INFO:tasks.workunit.client.1.smithi157.stdout:1/185: write d10/d11/f28 [438298,70004] 0 2024-02-28T16:26:57.811 INFO:tasks.workunit.client.1.smithi157.stdout:0/191: getdents d1/d8 0 2024-02-28T16:26:57.812 INFO:tasks.workunit.client.1.smithi157.stdout:3/117: mknod d0/d20/d23/c25 0 2024-02-28T16:26:57.812 INFO:tasks.workunit.client.1.smithi157.stdout:2/179: creat da/d2b/f3f x:0 0 0 2024-02-28T16:26:57.814 INFO:tasks.workunit.client.1.smithi157.stdout:7/158: dread df/f16 [0,4194304] 0 2024-02-28T16:26:57.814 INFO:tasks.workunit.client.1.smithi157.stdout:5/198: dwrite d0/f2f [0,4194304] 0 2024-02-28T16:26:57.814 INFO:tasks.workunit.client.1.smithi157.stdout:0/192: chown d1/d8/d33 21 1 2024-02-28T16:26:57.815 INFO:tasks.workunit.client.0.smithi148.stdout:7/935: write d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/fbe [2150700,86624] 0 2024-02-28T16:26:57.816 INFO:tasks.workunit.client.0.smithi148.stdout:5/946: link d1/db/d60/d7a/d98/ca2 d1/c123 0 2024-02-28T16:26:57.817 INFO:tasks.workunit.client.0.smithi148.stdout:5/947: stat d1/d44/d65/ddc 0 2024-02-28T16:26:57.819 INFO:tasks.workunit.client.1.smithi157.stdout:0/193: dread d1/d8/f9 [0,4194304] 0 2024-02-28T16:26:57.819 INFO:tasks.workunit.client.1.smithi157.stdout:4/161: dread d3/f33 [0,4194304] 0 2024-02-28T16:26:57.822 INFO:tasks.workunit.client.1.smithi157.stdout:1/186: write d10/f38 [456146,100889] 0 2024-02-28T16:26:57.822 INFO:tasks.workunit.client.1.smithi157.stdout:4/162: readlink d3/da/d1f/l30 0 2024-02-28T16:26:57.822 INFO:tasks.workunit.client.0.smithi148.stdout:4/828: write d8/d37/f10d [6870000,124202] 0 2024-02-28T16:26:57.824 INFO:tasks.workunit.client.1.smithi157.stdout:2/180: creat da/d38/f40 x:0 0 0 2024-02-28T16:26:57.825 INFO:tasks.workunit.client.1.smithi157.stdout:5/199: symlink d0/d9/l44 0 2024-02-28T16:26:57.826 INFO:tasks.workunit.client.1.smithi157.stdout:1/187: write d10/f21 [691662,29503] 0 2024-02-28T16:26:57.826 INFO:tasks.workunit.client.0.smithi148.stdout:7/936: mkdir d0/dd5/de2/d124 0 2024-02-28T16:26:57.828 INFO:tasks.workunit.client.1.smithi157.stdout:2/181: chown da/f23 106741460 1 2024-02-28T16:26:57.829 INFO:tasks.workunit.client.1.smithi157.stdout:1/188: chown d10/l13 1509 1 2024-02-28T16:26:57.830 INFO:tasks.workunit.client.1.smithi157.stdout:2/182: chown da/l20 89895 1 2024-02-28T16:26:57.831 INFO:tasks.workunit.client.1.smithi157.stdout:2/183: readlink l6 0 2024-02-28T16:26:57.831 INFO:tasks.workunit.client.1.smithi157.stdout:3/118: dread d0/d6/f17 [0,4194304] 0 2024-02-28T16:26:57.832 INFO:tasks.workunit.client.0.smithi148.stdout:5/948: mkdir d1/db/d60/df0/ddd/d124 0 2024-02-28T16:26:57.832 INFO:tasks.workunit.client.1.smithi157.stdout:9/133: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:26:57.833 INFO:tasks.workunit.client.1.smithi157.stdout:2/184: dread - da/f2c zero size 2024-02-28T16:26:57.835 INFO:tasks.workunit.client.0.smithi148.stdout:4/829: rename d8/d40/dc3/dd3/f104 to d8/de4/f11b 0 2024-02-28T16:26:57.836 INFO:tasks.workunit.client.1.smithi157.stdout:6/114: mknod d2/d7/c19 0 2024-02-28T16:26:57.838 INFO:tasks.workunit.client.1.smithi157.stdout:7/159: mknod df/d1f/d24/c34 0 2024-02-28T16:26:57.839 INFO:tasks.workunit.client.1.smithi157.stdout:7/160: chown df/c18 6178 1 2024-02-28T16:26:57.840 INFO:tasks.workunit.client.1.smithi157.stdout:7/161: stat df/d1f/c2c 0 2024-02-28T16:26:57.841 INFO:tasks.workunit.client.0.smithi148.stdout:5/949: rename d1/d8/d20/ff6 to d1/db/d25/f125 0 2024-02-28T16:26:57.844 INFO:tasks.workunit.client.1.smithi157.stdout:0/194: rename d1/d8/d27/d2d to d1/d13/d46 0 2024-02-28T16:26:57.847 INFO:tasks.workunit.client.1.smithi157.stdout:5/200: mknod d0/d8/c45 0 2024-02-28T16:26:57.849 INFO:tasks.workunit.client.1.smithi157.stdout:4/163: symlink d3/da/d28/l38 0 2024-02-28T16:26:57.849 INFO:tasks.workunit.client.1.smithi157.stdout:5/201: truncate d0/d8/f41 674188 0 2024-02-28T16:26:57.850 INFO:tasks.workunit.client.0.smithi148.stdout:6/980: sync 2024-02-28T16:26:57.851 INFO:tasks.workunit.client.0.smithi148.stdout:5/950: creat d1/db/d60/df0/ddd/f126 x:0 0 0 2024-02-28T16:26:57.852 INFO:tasks.workunit.client.1.smithi157.stdout:7/162: dread df/f10 [0,4194304] 0 2024-02-28T16:26:57.853 INFO:tasks.workunit.client.0.smithi148.stdout:5/951: chown d1/db/d60/fac 0 1 2024-02-28T16:26:57.855 INFO:tasks.workunit.client.1.smithi157.stdout:3/119: write d0/d6/f17 [972591,53147] 0 2024-02-28T16:26:57.858 INFO:tasks.workunit.client.0.smithi148.stdout:7/937: dread d0/d9/d25/d96/ddf/d28/d2b/d6f/f7f [0,4194304] 0 2024-02-28T16:26:57.858 INFO:tasks.workunit.client.1.smithi157.stdout:2/185: unlink da/f2f 0 2024-02-28T16:26:57.859 INFO:tasks.workunit.client.0.smithi148.stdout:6/981: truncate d0/d22/d49/f5a 427534 0 2024-02-28T16:26:57.862 INFO:tasks.workunit.client.0.smithi148.stdout:5/952: creat d1/d8/d20/d4e/d96/f127 x:0 0 0 2024-02-28T16:26:57.864 INFO:tasks.workunit.client.0.smithi148.stdout:4/830: getdents d8/d40/dc3/dd3/d17/d6a/d6c 0 2024-02-28T16:26:57.865 INFO:tasks.workunit.client.1.smithi157.stdout:2/186: dread da/f28 [0,4194304] 0 2024-02-28T16:26:57.865 INFO:tasks.workunit.client.0.smithi148.stdout:4/831: stat d8/d40/dc3/dd3/d9f/caf 0 2024-02-28T16:26:57.866 INFO:tasks.workunit.client.1.smithi157.stdout:2/187: write da/f1f [397699,62803] 0 2024-02-28T16:26:57.867 INFO:tasks.workunit.client.0.smithi148.stdout:4/832: truncate d8/d37/f101 358429 0 2024-02-28T16:26:57.868 INFO:tasks.workunit.client.1.smithi157.stdout:9/134: rename d0/f24 to d0/d19/f29 0 2024-02-28T16:26:57.869 INFO:tasks.workunit.client.1.smithi157.stdout:2/188: dread da/f26 [0,4194304] 0 2024-02-28T16:26:57.869 INFO:tasks.workunit.client.0.smithi148.stdout:7/938: creat d0/d9/d25/d96/ddf/d1c/f125 x:0 0 0 2024-02-28T16:26:57.870 INFO:tasks.workunit.client.1.smithi157.stdout:2/189: chown da/f2a 0 1 2024-02-28T16:26:57.870 INFO:tasks.workunit.client.1.smithi157.stdout:0/195: creat d1/d13/f47 x:0 0 0 2024-02-28T16:26:57.873 INFO:tasks.workunit.client.1.smithi157.stdout:4/164: creat d3/da/d28/f39 x:0 0 0 2024-02-28T16:26:57.876 INFO:tasks.workunit.client.0.smithi148.stdout:4/833: chown d8/d40/dc3/dd3/d9f/cf3 1 1 2024-02-28T16:26:57.876 INFO:tasks.workunit.client.1.smithi157.stdout:1/189: dread ff [0,4194304] 0 2024-02-28T16:26:57.879 INFO:tasks.workunit.client.0.smithi148.stdout:4/834: write d8/f33 [1057527,30218] 0 2024-02-28T16:26:57.879 INFO:tasks.workunit.client.1.smithi157.stdout:7/163: fsync fd 0 2024-02-28T16:26:57.882 INFO:tasks.workunit.client.1.smithi157.stdout:3/120: symlink d0/d6/d1e/l26 0 2024-02-28T16:26:57.886 INFO:tasks.workunit.client.1.smithi157.stdout:6/115: creat d2/d7/d8/f1a x:0 0 0 2024-02-28T16:26:57.893 INFO:tasks.workunit.client.0.smithi148.stdout:7/939: dwrite d0/d9/d25/d96/ddf/d28/d2b/d6f/f7f [0,4194304] 0 2024-02-28T16:26:57.893 INFO:tasks.workunit.client.0.smithi148.stdout:6/982: dwrite d0/d4/dba/f1f [4194304,4194304] 0 2024-02-28T16:26:57.895 INFO:tasks.workunit.client.0.smithi148.stdout:4/835: creat d8/d21/f11c x:0 0 0 2024-02-28T16:26:57.896 INFO:tasks.workunit.client.0.smithi148.stdout:7/940: write d0/d9/d4c/fa8 [2554570,31271] 0 2024-02-28T16:26:57.899 INFO:tasks.workunit.client.0.smithi148.stdout:5/953: dwrite d1/d8/d20/d31/f40 [0,4194304] 0 2024-02-28T16:26:57.910 INFO:tasks.workunit.client.0.smithi148.stdout:4/836: creat d8/d21/d3d/d4d/dd0/dd4/f11d x:0 0 0 2024-02-28T16:26:57.910 INFO:tasks.workunit.client.1.smithi157.stdout:8/104: sync 2024-02-28T16:26:57.913 INFO:tasks.workunit.client.1.smithi157.stdout:7/164: creat df/d1f/d24/f35 x:0 0 0 2024-02-28T16:26:57.916 INFO:tasks.workunit.client.0.smithi148.stdout:7/941: write d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/f10f [640669,102899] 0 2024-02-28T16:26:57.917 INFO:tasks.workunit.client.1.smithi157.stdout:3/121: mknod d0/d6/d1e/c27 0 2024-02-28T16:26:57.922 INFO:tasks.workunit.client.1.smithi157.stdout:9/135: mknod d0/c2a 0 2024-02-28T16:26:57.924 INFO:tasks.workunit.client.1.smithi157.stdout:2/190: symlink da/l41 0 2024-02-28T16:26:57.925 INFO:tasks.workunit.client.1.smithi157.stdout:1/190: dwrite d10/d11/d2c/f1a [0,4194304] 0 2024-02-28T16:26:57.926 INFO:tasks.workunit.client.1.smithi157.stdout:0/196: link d1/d13/f3e d1/d13/f48 0 2024-02-28T16:26:57.927 INFO:tasks.workunit.client.1.smithi157.stdout:1/191: chown d10/d11/d31/l39 35861951 1 2024-02-28T16:26:57.927 INFO:tasks.workunit.client.1.smithi157.stdout:4/165: symlink d3/da/d37/l3a 0 2024-02-28T16:26:57.928 INFO:tasks.workunit.client.1.smithi157.stdout:7/165: dread df/d1f/d24/f33 [0,4194304] 0 2024-02-28T16:26:57.932 INFO:tasks.workunit.client.0.smithi148.stdout:4/837: dwrite d8/d40/dc3/dbd/de3/f116 [0,4194304] 0 2024-02-28T16:26:57.933 INFO:tasks.workunit.client.1.smithi157.stdout:5/202: rmdir d0/d9/d3a/d3f 0 2024-02-28T16:26:57.933 INFO:tasks.workunit.client.1.smithi157.stdout:8/105: symlink d1/d5/d10/l1f 0 2024-02-28T16:26:57.933 INFO:tasks.workunit.client.1.smithi157.stdout:6/116: mkdir d2/d7/de/d1b 0 2024-02-28T16:26:57.934 INFO:tasks.workunit.client.1.smithi157.stdout:6/117: dread - d2/d7/d8/f1a zero size 2024-02-28T16:26:57.936 INFO:tasks.workunit.client.0.smithi148.stdout:4/838: fdatasync d8/d21/d3d/d4d/d72/f77 0 2024-02-28T16:26:57.936 INFO:tasks.workunit.client.0.smithi148.stdout:6/983: dwrite d0/d4/f7a [0,4194304] 0 2024-02-28T16:26:57.938 INFO:tasks.workunit.client.1.smithi157.stdout:3/122: mkdir d0/d28 0 2024-02-28T16:26:57.939 INFO:tasks.workunit.client.1.smithi157.stdout:2/191: creat da/d2b/f42 x:0 0 0 2024-02-28T16:26:57.939 INFO:tasks.workunit.client.1.smithi157.stdout:0/197: rmdir d1/d8/d33 39 2024-02-28T16:26:57.939 INFO:tasks.workunit.client.1.smithi157.stdout:4/166: symlink d3/da/d1f/l3b 0 2024-02-28T16:26:57.944 INFO:tasks.workunit.client.1.smithi157.stdout:5/203: unlink d0/d9/d1b/d36/c20 0 2024-02-28T16:26:57.950 INFO:tasks.workunit.client.0.smithi148.stdout:7/942: dwrite d0/d9/d25/d96/ddf/d1c/d32/f3b [0,4194304] 0 2024-02-28T16:26:57.954 INFO:tasks.workunit.client.1.smithi157.stdout:3/123: dwrite d0/d6/f15 [0,4194304] 0 2024-02-28T16:26:57.958 INFO:tasks.workunit.client.1.smithi157.stdout:9/136: mknod d0/c2b 0 2024-02-28T16:26:57.960 INFO:tasks.workunit.client.1.smithi157.stdout:6/118: dread d2/d7/f11 [0,4194304] 0 2024-02-28T16:26:57.964 INFO:tasks.workunit.client.0.smithi148.stdout:7/943: unlink d0/d9/le5 0 2024-02-28T16:26:57.967 INFO:tasks.workunit.client.1.smithi157.stdout:3/124: dread d0/d6/fa [0,4194304] 0 2024-02-28T16:26:57.968 INFO:tasks.workunit.client.0.smithi148.stdout:4/839: link d8/d21/f67 d8/d40/dc3/dd3/da3/f11e 0 2024-02-28T16:26:57.973 INFO:tasks.workunit.client.1.smithi157.stdout:4/167: creat d3/da/d1f/d22/f3c x:0 0 0 2024-02-28T16:26:57.976 INFO:tasks.workunit.client.1.smithi157.stdout:5/204: fdatasync d0/d9/f1d 0 2024-02-28T16:26:57.976 INFO:tasks.workunit.client.0.smithi148.stdout:5/954: dwrite d1/db/d60/d7a/d8b/f9e [4194304,4194304] 0 2024-02-28T16:26:57.977 INFO:tasks.workunit.client.1.smithi157.stdout:2/192: dwrite da/f25 [0,4194304] 0 2024-02-28T16:26:57.979 INFO:tasks.workunit.client.1.smithi157.stdout:2/193: dread - da/f37 zero size 2024-02-28T16:26:57.980 INFO:tasks.workunit.client.1.smithi157.stdout:9/137: symlink d0/d19/l2c 0 2024-02-28T16:26:57.983 INFO:tasks.workunit.client.1.smithi157.stdout:9/138: dread d0/d19/f29 [0,4194304] 0 2024-02-28T16:26:57.985 INFO:tasks.workunit.client.1.smithi157.stdout:6/119: rmdir d2/d7 39 2024-02-28T16:26:57.985 INFO:tasks.workunit.client.1.smithi157.stdout:3/125: mknod d0/d20/c29 0 2024-02-28T16:26:57.987 INFO:tasks.workunit.client.1.smithi157.stdout:0/198: creat d1/d8/d33/f49 x:0 0 0 2024-02-28T16:26:57.987 INFO:tasks.workunit.client.1.smithi157.stdout:4/168: creat d3/da/d1f/d22/f3d x:0 0 0 2024-02-28T16:26:57.987 INFO:tasks.workunit.client.1.smithi157.stdout:5/205: creat d0/d8/f46 x:0 0 0 2024-02-28T16:26:57.987 INFO:tasks.workunit.client.1.smithi157.stdout:3/126: chown d0/f1b 2 1 2024-02-28T16:26:57.988 INFO:tasks.workunit.client.1.smithi157.stdout:2/194: rename da/f1a to da/d3a/f43 0 2024-02-28T16:26:57.998 INFO:tasks.workunit.client.1.smithi157.stdout:3/127: dread d0/d6/f11 [0,4194304] 0 2024-02-28T16:26:58.000 INFO:tasks.workunit.client.1.smithi157.stdout:6/120: write d2/d7/d8/f1a [312648,36537] 0 2024-02-28T16:26:58.001 INFO:tasks.workunit.client.1.smithi157.stdout:8/106: rename d1/lc to d1/l20 0 2024-02-28T16:26:58.003 INFO:tasks.workunit.client.1.smithi157.stdout:0/199: creat d1/d8/d27/f4a x:0 0 0 2024-02-28T16:26:58.003 INFO:tasks.workunit.client.1.smithi157.stdout:5/206: dwrite d0/d8/f2b [0,4194304] 0 2024-02-28T16:26:58.004 INFO:tasks.workunit.client.1.smithi157.stdout:4/169: creat d3/da/d28/f3e x:0 0 0 2024-02-28T16:26:58.005 INFO:tasks.workunit.client.1.smithi157.stdout:8/107: dread d1/f17 [0,4194304] 0 2024-02-28T16:26:58.007 INFO:tasks.workunit.client.1.smithi157.stdout:8/108: chown d1/d5/l8 1737 1 2024-02-28T16:26:58.009 INFO:tasks.workunit.client.1.smithi157.stdout:1/192: getdents d10/d11/d31/d2a 0 2024-02-28T16:26:58.011 INFO:tasks.workunit.client.1.smithi157.stdout:8/109: chown d1/f2 63401934 1 2024-02-28T16:26:58.012 INFO:tasks.workunit.client.1.smithi157.stdout:6/121: write d2/d7/fc [4058865,37554] 0 2024-02-28T16:26:58.012 INFO:tasks.workunit.client.1.smithi157.stdout:0/200: creat d1/d13/f4b x:0 0 0 2024-02-28T16:26:58.012 INFO:tasks.workunit.client.1.smithi157.stdout:5/207: mkdir d0/d9/d47 0 2024-02-28T16:26:58.016 INFO:tasks.workunit.client.1.smithi157.stdout:9/139: rename d0/c8 to d0/c2d 0 2024-02-28T16:26:58.020 INFO:tasks.workunit.client.1.smithi157.stdout:4/170: mknod d3/c3f 0 2024-02-28T16:26:58.022 INFO:tasks.workunit.client.1.smithi157.stdout:6/122: truncate d2/d7/f15 484462 0 2024-02-28T16:26:58.024 INFO:tasks.workunit.client.1.smithi157.stdout:0/201: creat d1/d8/f4c x:0 0 0 2024-02-28T16:26:58.025 INFO:tasks.workunit.client.1.smithi157.stdout:3/128: dwrite d0/d6/f11 [0,4194304] 0 2024-02-28T16:26:58.027 INFO:tasks.workunit.client.1.smithi157.stdout:5/208: getdents d0/d9/d1b/d36 0 2024-02-28T16:26:58.032 INFO:tasks.workunit.client.1.smithi157.stdout:3/129: chown d0/c3 10311 1 2024-02-28T16:26:58.034 INFO:tasks.workunit.client.1.smithi157.stdout:6/123: symlink d2/d7/l1c 0 2024-02-28T16:26:58.034 INFO:tasks.workunit.client.1.smithi157.stdout:0/202: unlink d1/d8/l1c 0 2024-02-28T16:26:58.043 INFO:tasks.workunit.client.1.smithi157.stdout:1/193: dread f4 [0,4194304] 0 2024-02-28T16:26:58.045 INFO:tasks.workunit.client.1.smithi157.stdout:3/130: unlink d0/d6/d1e/l26 0 2024-02-28T16:26:58.047 INFO:tasks.workunit.client.1.smithi157.stdout:0/203: symlink d1/d13/l4d 0 2024-02-28T16:26:58.048 INFO:tasks.workunit.client.1.smithi157.stdout:9/140: dwrite d0/f5 [4194304,4194304] 0 2024-02-28T16:26:58.052 INFO:tasks.workunit.client.1.smithi157.stdout:4/171: dwrite d3/f1c [0,4194304] 0 2024-02-28T16:26:58.052 INFO:tasks.workunit.client.1.smithi157.stdout:3/131: fdatasync d0/d6/f15 0 2024-02-28T16:26:58.052 INFO:tasks.workunit.client.1.smithi157.stdout:1/194: fdatasync f4 0 2024-02-28T16:26:58.057 INFO:tasks.workunit.client.1.smithi157.stdout:9/141: creat d0/d19/f2e x:0 0 0 2024-02-28T16:26:58.057 INFO:tasks.workunit.client.1.smithi157.stdout:2/195: dwrite da/f23 [0,4194304] 0 2024-02-28T16:26:58.058 INFO:tasks.workunit.client.1.smithi157.stdout:5/209: getdents d0 0 2024-02-28T16:26:58.059 INFO:tasks.workunit.client.1.smithi157.stdout:1/195: read - d10/d11/f14 zero size 2024-02-28T16:26:58.060 INFO:tasks.workunit.client.1.smithi157.stdout:0/204: write d1/d8/d33/f49 [828639,70178] 0 2024-02-28T16:26:58.061 INFO:tasks.workunit.client.1.smithi157.stdout:6/124: rename d2/d7/d8/c12 to d2/c1d 0 2024-02-28T16:26:58.064 INFO:tasks.workunit.client.1.smithi157.stdout:5/210: write d0/d9/f1d [802008,4514] 0 2024-02-28T16:26:58.068 INFO:tasks.workunit.client.1.smithi157.stdout:8/110: dwrite d1/f4 [0,4194304] 0 2024-02-28T16:26:58.068 INFO:tasks.workunit.client.1.smithi157.stdout:4/172: creat d3/da/d1f/f40 x:0 0 0 2024-02-28T16:26:58.070 INFO:tasks.workunit.client.1.smithi157.stdout:0/205: rmdir d1/da 39 2024-02-28T16:26:58.070 INFO:tasks.workunit.client.1.smithi157.stdout:7/166: sync 2024-02-28T16:26:58.075 INFO:tasks.workunit.client.1.smithi157.stdout:4/173: write d3/da/d1f/d22/f3d [219157,84791] 0 2024-02-28T16:26:58.075 INFO:tasks.workunit.client.1.smithi157.stdout:6/125: unlink d2/d7/cd 0 2024-02-28T16:26:58.075 INFO:tasks.workunit.client.1.smithi157.stdout:5/211: creat d0/d9/f48 x:0 0 0 2024-02-28T16:26:58.080 INFO:tasks.workunit.client.1.smithi157.stdout:8/111: creat d1/d5/f21 x:0 0 0 2024-02-28T16:26:58.081 INFO:tasks.workunit.client.1.smithi157.stdout:9/142: rename d0/l13 to d0/l2f 0 2024-02-28T16:26:58.088 INFO:tasks.workunit.client.1.smithi157.stdout:6/126: read d2/d7/fc [1445327,116283] 0 2024-02-28T16:26:58.093 INFO:tasks.workunit.client.1.smithi157.stdout:0/206: write d1/d13/ff [4009341,23909] 0 2024-02-28T16:26:58.094 INFO:tasks.workunit.client.1.smithi157.stdout:7/167: dread df/d25/f2a [0,4194304] 0 2024-02-28T16:26:58.094 INFO:tasks.workunit.client.1.smithi157.stdout:5/212: creat d0/d9/f49 x:0 0 0 2024-02-28T16:26:58.097 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:57 smithi148 ceph-mon[28767]: pgmap v53: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 108 MiB/s wr, 272 op/s 2024-02-28T16:26:58.097 INFO:tasks.workunit.client.1.smithi157.stdout:9/143: mkdir d0/d19/d30 0 2024-02-28T16:26:58.102 INFO:tasks.workunit.client.1.smithi157.stdout:8/112: unlink d1/d5/d10/l19 0 2024-02-28T16:26:58.103 INFO:tasks.workunit.client.1.smithi157.stdout:4/174: fsync d3/da/ff 0 2024-02-28T16:26:58.103 INFO:tasks.workunit.client.1.smithi157.stdout:3/132: dwrite d0/d6/f17 [0,4194304] 0 2024-02-28T16:26:58.104 INFO:tasks.workunit.client.1.smithi157.stdout:6/127: creat d2/d17/f1e x:0 0 0 2024-02-28T16:26:58.106 INFO:tasks.workunit.client.1.smithi157.stdout:7/168: truncate f0 5492678 0 2024-02-28T16:26:58.107 INFO:tasks.workunit.client.1.smithi157.stdout:2/196: dwrite da/f34 [0,4194304] 0 2024-02-28T16:26:58.111 INFO:tasks.workunit.client.1.smithi157.stdout:1/196: dwrite d10/f38 [0,4194304] 0 2024-02-28T16:26:58.111 INFO:tasks.workunit.client.1.smithi157.stdout:4/175: read d3/da/f20 [196617,39142] 0 2024-02-28T16:26:58.111 INFO:tasks.workunit.client.1.smithi157.stdout:6/128: write d2/d7/d8/f1a [66541,53944] 0 2024-02-28T16:26:58.114 INFO:tasks.workunit.client.1.smithi157.stdout:1/197: readlink d10/d11/d2c/l33 0 2024-02-28T16:26:58.121 INFO:tasks.workunit.client.1.smithi157.stdout:2/197: creat da/d3a/f44 x:0 0 0 2024-02-28T16:26:58.122 INFO:tasks.workunit.client.1.smithi157.stdout:6/129: fdatasync d2/d7/d8/f1a 0 2024-02-28T16:26:58.127 INFO:tasks.workunit.client.1.smithi157.stdout:4/176: rename d3/f2f to d3/da/d28/f41 0 2024-02-28T16:26:58.128 INFO:tasks.workunit.client.1.smithi157.stdout:7/169: read df/f10 [2642542,27332] 0 2024-02-28T16:26:58.129 INFO:tasks.workunit.client.1.smithi157.stdout:5/213: symlink d0/d9/d47/l4a 0 2024-02-28T16:26:58.131 INFO:tasks.workunit.client.1.smithi157.stdout:2/198: read da/f1d [561810,79344] 0 2024-02-28T16:26:58.135 INFO:tasks.workunit.client.1.smithi157.stdout:7/170: stat df/d25 0 2024-02-28T16:26:58.139 INFO:tasks.workunit.client.1.smithi157.stdout:6/130: write d2/d7/f11 [1142419,57044] 0 2024-02-28T16:26:58.139 INFO:tasks.workunit.client.1.smithi157.stdout:1/198: dread fd [0,4194304] 0 2024-02-28T16:26:58.139 INFO:tasks.workunit.client.1.smithi157.stdout:9/144: dwrite d0/d19/f1c [0,4194304] 0 2024-02-28T16:26:58.142 INFO:tasks.workunit.client.1.smithi157.stdout:9/145: stat d0/d19 0 2024-02-28T16:26:58.142 INFO:tasks.workunit.client.1.smithi157.stdout:4/177: dread d3/da/d1f/f29 [0,4194304] 0 2024-02-28T16:26:58.143 INFO:tasks.workunit.client.1.smithi157.stdout:3/133: dread d0/d6/f11 [0,4194304] 0 2024-02-28T16:26:58.145 INFO:tasks.workunit.client.1.smithi157.stdout:9/146: write d0/f12 [2013087,22850] 0 2024-02-28T16:26:58.146 INFO:tasks.workunit.client.1.smithi157.stdout:7/171: write df/f11 [881989,6414] 0 2024-02-28T16:26:58.148 INFO:tasks.workunit.client.1.smithi157.stdout:2/199: rename da/c29 to da/d2b/c45 0 2024-02-28T16:26:58.148 INFO:tasks.workunit.client.1.smithi157.stdout:3/134: rename d0 to d0/d20/d23/d2a 22 2024-02-28T16:26:58.149 INFO:tasks.workunit.client.1.smithi157.stdout:8/113: dwrite d1/d5/d10/f18 [0,4194304] 0 2024-02-28T16:26:58.150 INFO:tasks.workunit.client.1.smithi157.stdout:1/199: unlink d10/d11/d31/d2a/f34 0 2024-02-28T16:26:58.152 INFO:tasks.workunit.client.1.smithi157.stdout:4/178: creat d3/da/f42 x:0 0 0 2024-02-28T16:26:58.152 INFO:tasks.workunit.client.1.smithi157.stdout:3/135: read d0/d6/f11 [1768086,12189] 0 2024-02-28T16:26:58.153 INFO:tasks.workunit.client.1.smithi157.stdout:0/207: dread d1/f6 [0,4194304] 0 2024-02-28T16:26:58.153 INFO:tasks.workunit.client.1.smithi157.stdout:2/200: write da/d2b/f3d [794595,122171] 0 2024-02-28T16:26:58.154 INFO:tasks.workunit.client.1.smithi157.stdout:1/200: unlink fd 0 2024-02-28T16:26:58.154 INFO:tasks.workunit.client.1.smithi157.stdout:8/114: truncate d1/f17 507607 0 2024-02-28T16:26:58.158 INFO:tasks.workunit.client.1.smithi157.stdout:3/136: stat d0/d6/f17 0 2024-02-28T16:26:58.158 INFO:tasks.workunit.client.1.smithi157.stdout:5/214: link d0/d30/l3d d0/l4b 0 2024-02-28T16:26:58.164 INFO:tasks.workunit.client.1.smithi157.stdout:6/131: creat d2/f1f x:0 0 0 2024-02-28T16:26:58.164 INFO:tasks.workunit.client.1.smithi157.stdout:3/137: chown d0/c19 12990 1 2024-02-28T16:26:58.165 INFO:tasks.workunit.client.1.smithi157.stdout:2/201: rmdir da/d38 39 2024-02-28T16:26:58.165 INFO:tasks.workunit.client.1.smithi157.stdout:9/147: dread d0/f5 [0,4194304] 0 2024-02-28T16:26:58.166 INFO:tasks.workunit.client.1.smithi157.stdout:1/201: mkdir d10/d11/d3a 0 2024-02-28T16:26:58.170 INFO:tasks.workunit.client.1.smithi157.stdout:0/208: link d1/d8/d27/f3a d1/d8/d33/f4e 0 2024-02-28T16:26:58.170 INFO:tasks.workunit.client.0.smithi148.stdout:7/944: truncate d0/d9/d25/d96/db7/f116 1560922 0 2024-02-28T16:26:58.173 INFO:tasks.workunit.client.1.smithi157.stdout:3/138: rename d0/d28 to d0/d20/d23/d2b 0 2024-02-28T16:26:58.174 INFO:tasks.workunit.client.0.smithi148.stdout:4/840: write d8/d21/d3d/d8c/db0/fcd [29055,118063] 0 2024-02-28T16:26:58.174 INFO:tasks.workunit.client.0.smithi148.stdout:7/945: write d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/f10f [564294,13799] 0 2024-02-28T16:26:58.176 INFO:tasks.workunit.client.0.smithi148.stdout:5/955: mkdir d1/d8/d20/dd8/d89/dfd/d128 0 2024-02-28T16:26:58.178 INFO:tasks.workunit.client.1.smithi157.stdout:4/179: dwrite d3/da/f42 [0,4194304] 0 2024-02-28T16:26:58.179 INFO:tasks.workunit.client.1.smithi157.stdout:7/172: write df/d1f/d24/f33 [4188733,66077] 0 2024-02-28T16:26:58.180 INFO:tasks.workunit.client.1.smithi157.stdout:1/202: symlink d10/d11/l3b 0 2024-02-28T16:26:58.183 INFO:tasks.workunit.client.1.smithi157.stdout:8/115: dwrite d1/d5/f16 [0,4194304] 0 2024-02-28T16:26:58.183 INFO:tasks.workunit.client.1.smithi157.stdout:4/180: read d3/da/d1f/f29 [539836,127210] 0 2024-02-28T16:26:58.183 INFO:tasks.workunit.client.0.smithi148.stdout:5/956: unlink l0 0 2024-02-28T16:26:58.186 INFO:tasks.workunit.client.0.smithi148.stdout:7/946: mknod d0/d18/dcd/c126 0 2024-02-28T16:26:58.188 INFO:tasks.workunit.client.1.smithi157.stdout:4/181: chown d3/da/d1f/d22/f3d 255 1 2024-02-28T16:26:58.191 INFO:tasks.workunit.client.0.smithi148.stdout:4/841: truncate d8/d40/dc3/dd3/f97 5805588 0 2024-02-28T16:26:58.191 INFO:tasks.workunit.client.1.smithi157.stdout:5/215: dread - d0/d9/d1b/d36/f38 zero size 2024-02-28T16:26:58.192 INFO:tasks.workunit.client.1.smithi157.stdout:3/139: mknod d0/d20/d23/d2b/c2c 0 2024-02-28T16:26:58.193 INFO:tasks.workunit.client.0.smithi148.stdout:7/947: symlink d0/dd5/de2/dec/l127 0 2024-02-28T16:26:58.195 INFO:tasks.workunit.client.1.smithi157.stdout:7/173: rename df/d1f/c29 to df/d25/c36 0 2024-02-28T16:26:58.195 INFO:tasks.workunit.client.1.smithi157.stdout:8/116: creat d1/d5/d10/f22 x:0 0 0 2024-02-28T16:26:58.195 INFO:tasks.workunit.client.0.smithi148.stdout:4/842: fdatasync d8/d37/fc6 0 2024-02-28T16:26:58.198 INFO:tasks.workunit.client.1.smithi157.stdout:2/202: creat da/f46 x:0 0 0 2024-02-28T16:26:58.199 INFO:tasks.workunit.client.1.smithi157.stdout:3/140: creat d0/d6/f2d x:0 0 0 2024-02-28T16:26:58.200 INFO:tasks.workunit.client.0.smithi148.stdout:7/948: fsync d0/d9/d25/d96/ddf/d1c/d32/faa 0 2024-02-28T16:26:58.203 INFO:tasks.workunit.client.1.smithi157.stdout:9/148: rename d0/le to d0/l31 0 2024-02-28T16:26:58.203 INFO:tasks.workunit.client.0.smithi148.stdout:7/949: truncate d0/d4/d70/da5/fc1 480407 0 2024-02-28T16:26:58.204 INFO:tasks.workunit.client.0.smithi148.stdout:4/843: mknod d8/d21/d3d/d4d/dd0/dd4/c11f 0 2024-02-28T16:26:58.204 INFO:tasks.workunit.client.1.smithi157.stdout:9/149: chown d0/f5 7 1 2024-02-28T16:26:58.205 INFO:tasks.workunit.client.0.smithi148.stdout:7/950: readlink d0/d9/d25/d96/ddf/d28/d2b/d6f/d82/l99 0 2024-02-28T16:26:58.206 INFO:tasks.workunit.client.1.smithi157.stdout:1/203: creat d10/d11/d3a/f3c x:0 0 0 2024-02-28T16:26:58.208 INFO:tasks.workunit.client.1.smithi157.stdout:4/182: dwrite d3/f13 [0,4194304] 0 2024-02-28T16:26:58.208 INFO:tasks.workunit.client.0.smithi148.stdout:5/957: getdents d1/d8/d20/d4e/d84 0 2024-02-28T16:26:58.210 INFO:tasks.workunit.client.1.smithi157.stdout:8/117: mkdir d1/d5/d23 0 2024-02-28T16:26:58.214 INFO:tasks.workunit.client.0.smithi148.stdout:5/958: fdatasync d1/db/f27 0 2024-02-28T16:26:58.219 INFO:tasks.workunit.client.1.smithi157.stdout:5/216: dwrite d0/d8/f46 [0,4194304] 0 2024-02-28T16:26:58.219 INFO:tasks.workunit.client.0.smithi148.stdout:4/844: mkdir d8/d37/d91/db2/d120 0 2024-02-28T16:26:58.219 INFO:tasks.workunit.client.1.smithi157.stdout:0/209: dwrite d1/d8/f9 [0,4194304] 0 2024-02-28T16:26:58.223 INFO:tasks.workunit.client.0.smithi148.stdout:4/845: write d8/d40/dc3/dd3/d17/d6a/d6c/fa2 [3299313,15940] 0 2024-02-28T16:26:58.224 INFO:tasks.workunit.client.0.smithi148.stdout:5/959: mkdir d1/db/d60/d7a/d87/d129 0 2024-02-28T16:26:58.227 INFO:tasks.workunit.client.1.smithi157.stdout:7/174: mkdir df/d1f/d37 0 2024-02-28T16:26:58.232 INFO:tasks.workunit.client.0.smithi148.stdout:4/846: mkdir d8/d40/dc3/d121 0 2024-02-28T16:26:58.233 INFO:tasks.workunit.client.1.smithi157.stdout:2/203: mkdir da/d47 0 2024-02-28T16:26:58.234 INFO:tasks.workunit.client.1.smithi157.stdout:8/118: symlink d1/d5/d14/l24 0 2024-02-28T16:26:58.234 INFO:tasks.workunit.client.0.smithi148.stdout:5/960: mkdir d1/db/d60/d7a/dbb/de7/d12a 0 2024-02-28T16:26:58.235 INFO:tasks.workunit.client.1.smithi157.stdout:9/150: creat d0/d19/d30/f32 x:0 0 0 2024-02-28T16:26:58.236 INFO:tasks.workunit.client.0.smithi148.stdout:7/951: getdents d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/df0 0 2024-02-28T16:26:58.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:57 smithi157 ceph-mon[38346]: pgmap v53: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 42 MiB/s rd, 108 MiB/s wr, 272 op/s 2024-02-28T16:26:58.238 INFO:tasks.workunit.client.1.smithi157.stdout:5/217: chown d0/d9/d1b/l31 1014393 1 2024-02-28T16:26:58.240 INFO:tasks.workunit.client.1.smithi157.stdout:0/210: creat d1/d13/d46/f4f x:0 0 0 2024-02-28T16:26:58.241 INFO:tasks.workunit.client.0.smithi148.stdout:5/961: symlink d1/d8/d20/d4e/d84/d108/l12b 0 2024-02-28T16:26:58.241 INFO:tasks.workunit.client.1.smithi157.stdout:5/218: write d0/d9/f49 [239102,82322] 0 2024-02-28T16:26:58.243 INFO:tasks.workunit.client.1.smithi157.stdout:1/204: dread d10/d11/d31/d2a/f2d [0,4194304] 0 2024-02-28T16:26:58.246 INFO:tasks.workunit.client.0.smithi148.stdout:7/952: write d0/d4/d70/da5/fc1 [1339758,95998] 0 2024-02-28T16:26:58.247 INFO:tasks.workunit.client.1.smithi157.stdout:7/175: mkdir df/d1f/d24/d38 0 2024-02-28T16:26:58.247 INFO:tasks.workunit.client.1.smithi157.stdout:1/205: read d10/d11/d2c/f1e [266578,108015] 0 2024-02-28T16:26:58.248 INFO:tasks.workunit.client.0.smithi148.stdout:7/953: read d0/d9/d25/d39/f54 [917666,76376] 0 2024-02-28T16:26:58.252 INFO:tasks.workunit.client.1.smithi157.stdout:6/132: sync 2024-02-28T16:26:58.254 INFO:tasks.workunit.client.0.smithi148.stdout:4/847: write d8/fe1 [720698,5181] 0 2024-02-28T16:26:58.255 INFO:tasks.workunit.client.1.smithi157.stdout:0/211: dread d1/d8/f9 [0,4194304] 0 2024-02-28T16:26:58.255 INFO:tasks.workunit.client.0.smithi148.stdout:5/962: link d1/db/d60/d7a/dbb/fd3 d1/d8/d20/d4e/d96/ddb/f12c 0 2024-02-28T16:26:58.257 INFO:tasks.workunit.client.1.smithi157.stdout:5/219: symlink d0/d9/d1b/d36/l4c 0 2024-02-28T16:26:58.258 INFO:tasks.workunit.client.0.smithi148.stdout:7/954: mkdir d0/dd5/de2/dec/dfc/d128 0 2024-02-28T16:26:58.258 INFO:tasks.workunit.client.1.smithi157.stdout:0/212: write d1/d8/f20 [373172,84291] 0 2024-02-28T16:26:58.259 INFO:tasks.workunit.client.1.smithi157.stdout:3/141: getdents d0/d20/d23/d2b 0 2024-02-28T16:26:58.260 INFO:tasks.workunit.client.0.smithi148.stdout:4/848: mkdir d8/d21/d3d/d8c/db0/d122 0 2024-02-28T16:26:58.261 INFO:tasks.workunit.client.0.smithi148.stdout:4/849: chown d8/c118 36841 1 2024-02-28T16:26:58.262 INFO:tasks.workunit.client.1.smithi157.stdout:3/142: write d0/f8 [3767481,76370] 0 2024-02-28T16:26:58.262 INFO:tasks.workunit.client.1.smithi157.stdout:8/119: symlink d1/d5/d23/l25 0 2024-02-28T16:26:58.263 INFO:tasks.workunit.client.0.smithi148.stdout:7/955: read - d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/d97/fcb zero size 2024-02-28T16:26:58.265 INFO:tasks.workunit.client.1.smithi157.stdout:7/176: mkdir df/d1f/d24/d39 0 2024-02-28T16:26:58.266 INFO:tasks.workunit.client.0.smithi148.stdout:4/850: fsync d8/d21/d3d/d4d/f4e 0 2024-02-28T16:26:58.266 INFO:tasks.workunit.client.0.smithi148.stdout:5/963: link d1/d8/d20/d4e/c107 d1/db/d60/d7a/d87/de0/dee/d11a/c12d 0 2024-02-28T16:26:58.266 INFO:tasks.workunit.client.1.smithi157.stdout:3/143: dread - d0/d6/f2d zero size 2024-02-28T16:26:58.269 INFO:tasks.workunit.client.1.smithi157.stdout:4/183: dwrite d3/f4 [0,4194304] 0 2024-02-28T16:26:58.270 INFO:tasks.workunit.client.0.smithi148.stdout:7/956: symlink d0/d9/d25/d96/ddf/d1c/d32/d103/l129 0 2024-02-28T16:26:58.273 INFO:tasks.workunit.client.0.smithi148.stdout:5/964: symlink d1/d8/d20/dd8/d89/dfd/l12e 0 2024-02-28T16:26:58.274 INFO:tasks.workunit.client.1.smithi157.stdout:9/151: dwrite d0/fb [0,4194304] 0 2024-02-28T16:26:58.276 INFO:tasks.workunit.client.0.smithi148.stdout:7/957: rename d0/d4/d70/da5/dc0/cf7 to d0/dd5/de0/c12a 0 2024-02-28T16:26:58.279 INFO:tasks.workunit.client.0.smithi148.stdout:7/958: chown d0/d4/l5e 7 1 2024-02-28T16:26:58.282 INFO:tasks.workunit.client.1.smithi157.stdout:8/120: chown d1/l20 38 1 2024-02-28T16:26:58.283 INFO:tasks.workunit.client.1.smithi157.stdout:0/213: dwrite d1/d8/d33/f49 [0,4194304] 0 2024-02-28T16:26:58.286 INFO:tasks.workunit.client.1.smithi157.stdout:0/214: chown d1/d8/d27/f3a 5570 1 2024-02-28T16:26:58.289 INFO:tasks.workunit.client.1.smithi157.stdout:6/133: mknod d2/d7/c20 0 2024-02-28T16:26:58.290 INFO:tasks.workunit.client.1.smithi157.stdout:3/144: mkdir d0/d20/d23/d2b/d2e 0 2024-02-28T16:26:58.294 INFO:tasks.workunit.client.1.smithi157.stdout:5/220: dread d0/d8/f26 [0,4194304] 0 2024-02-28T16:26:58.295 INFO:tasks.workunit.client.1.smithi157.stdout:4/184: mknod d3/da/d1f/c43 0 2024-02-28T16:26:58.295 INFO:tasks.workunit.client.0.smithi148.stdout:5/965: getdents d1/db/d60/d7a/d87 0 2024-02-28T16:26:58.295 INFO:tasks.workunit.client.0.smithi148.stdout:7/959: write d0/d9/d25/fb9 [1030244,128649] 0 2024-02-28T16:26:58.297 INFO:tasks.workunit.client.1.smithi157.stdout:2/204: getdents da/d3a 0 2024-02-28T16:26:58.297 INFO:tasks.workunit.client.0.smithi148.stdout:4/851: dread d8/d21/d3d/d4d/d95/fe5 [0,4194304] 0 2024-02-28T16:26:58.297 INFO:tasks.workunit.client.1.smithi157.stdout:9/152: readlink d0/l31 0 2024-02-28T16:26:58.298 INFO:tasks.workunit.client.1.smithi157.stdout:2/205: dread - da/d3a/f44 zero size 2024-02-28T16:26:58.298 INFO:tasks.workunit.client.1.smithi157.stdout:1/206: creat d10/d11/d31/f3d x:0 0 0 2024-02-28T16:26:58.300 INFO:tasks.workunit.client.1.smithi157.stdout:2/206: chown da/d35/l3c 132993 1 2024-02-28T16:26:58.300 INFO:tasks.workunit.client.1.smithi157.stdout:7/177: mknod df/d1f/c3a 0 2024-02-28T16:26:58.302 INFO:tasks.workunit.client.1.smithi157.stdout:6/134: creat d2/d17/f21 x:0 0 0 2024-02-28T16:26:58.304 INFO:tasks.workunit.client.1.smithi157.stdout:3/145: symlink d0/d20/l2f 0 2024-02-28T16:26:58.305 INFO:tasks.workunit.client.1.smithi157.stdout:5/221: chown d0/d9/l43 1 1 2024-02-28T16:26:58.306 INFO:tasks.workunit.client.0.smithi148.stdout:4/852: symlink d8/d40/dc3/d121/l123 0 2024-02-28T16:26:58.306 INFO:tasks.workunit.client.1.smithi157.stdout:4/185: creat d3/da/d1f/d22/f44 x:0 0 0 2024-02-28T16:26:58.309 INFO:tasks.workunit.client.1.smithi157.stdout:8/121: mknod d1/c26 0 2024-02-28T16:26:58.311 INFO:tasks.workunit.client.0.smithi148.stdout:7/960: link d0/d9/d25/d96/ddf/d28/d2b/d6f/d82/l99 d0/d9/d25/d39/l12b 0 2024-02-28T16:26:58.313 INFO:tasks.workunit.client.0.smithi148.stdout:4/853: mkdir d8/d21/d3d/d4d/d66/dad/dfe/d124 0 2024-02-28T16:26:58.313 INFO:tasks.workunit.client.0.smithi148.stdout:5/966: dread d1/db/d25/f7e [0,4194304] 0 2024-02-28T16:26:58.314 INFO:tasks.workunit.client.0.smithi148.stdout:6/984: sync 2024-02-28T16:26:58.315 INFO:tasks.workunit.client.1.smithi157.stdout:6/135: symlink d2/d7/de/l22 0 2024-02-28T16:26:58.316 INFO:tasks.workunit.client.0.smithi148.stdout:7/961: symlink d0/d18/dcd/l12c 0 2024-02-28T16:26:58.319 INFO:tasks.workunit.client.1.smithi157.stdout:6/136: fdatasync d2/d7/d8/f1a 0 2024-02-28T16:26:58.319 INFO:tasks.workunit.client.1.smithi157.stdout:5/222: creat d0/d9/d47/f4d x:0 0 0 2024-02-28T16:26:58.322 INFO:tasks.workunit.client.1.smithi157.stdout:2/207: dwrite da/f2c [0,4194304] 0 2024-02-28T16:26:58.322 INFO:tasks.workunit.client.0.smithi148.stdout:6/985: rmdir d0 39 2024-02-28T16:26:58.323 INFO:tasks.workunit.client.1.smithi157.stdout:3/146: dread d0/f8 [0,4194304] 0 2024-02-28T16:26:58.324 INFO:tasks.workunit.client.1.smithi157.stdout:5/223: truncate d0/d9/f49 1065827 0 2024-02-28T16:26:58.327 INFO:tasks.workunit.client.1.smithi157.stdout:8/122: symlink d1/d5/d23/l27 0 2024-02-28T16:26:58.328 INFO:tasks.workunit.client.0.smithi148.stdout:4/854: fsync d8/d40/dc3/dd3/d17/f1d 0 2024-02-28T16:26:58.328 INFO:tasks.workunit.client.1.smithi157.stdout:9/153: dwrite d0/f20 [0,4194304] 0 2024-02-28T16:26:58.329 INFO:tasks.workunit.client.0.smithi148.stdout:7/962: rename d0/d4/d70/da5 to d0/d9/d25/d96/ddf/d1c/d32/d12d 0 2024-02-28T16:26:58.341 INFO:tasks.workunit.client.1.smithi157.stdout:6/137: creat d2/d17/f23 x:0 0 0 2024-02-28T16:26:58.345 INFO:tasks.workunit.client.1.smithi157.stdout:2/208: creat da/d35/f48 x:0 0 0 2024-02-28T16:26:58.346 INFO:tasks.workunit.client.0.smithi148.stdout:5/967: dread d1/db/d60/d7a/d8b/f45 [0,4194304] 0 2024-02-28T16:26:58.347 INFO:tasks.workunit.client.1.smithi157.stdout:3/147: symlink d0/d20/d23/l30 0 2024-02-28T16:26:58.348 INFO:tasks.workunit.client.1.smithi157.stdout:0/215: dwrite d1/d8/d27/f3a [0,4194304] 0 2024-02-28T16:26:58.349 INFO:tasks.workunit.client.1.smithi157.stdout:5/224: creat d0/d9/d47/f4e x:0 0 0 2024-02-28T16:26:58.354 INFO:tasks.workunit.client.1.smithi157.stdout:5/225: fsync d0/d9/d47/f4d 0 2024-02-28T16:26:58.354 INFO:tasks.workunit.client.1.smithi157.stdout:8/123: dwrite d1/d5/f16 [0,4194304] 0 2024-02-28T16:26:58.359 INFO:tasks.workunit.client.1.smithi157.stdout:1/207: dwrite d10/f1b [0,4194304] 0 2024-02-28T16:26:58.359 INFO:tasks.workunit.client.1.smithi157.stdout:5/226: chown d0/d9/c28 8134 1 2024-02-28T16:26:58.359 INFO:tasks.workunit.client.1.smithi157.stdout:8/124: write d1/d5/fe [722290,57690] 0 2024-02-28T16:26:58.361 INFO:tasks.workunit.client.1.smithi157.stdout:4/186: dread d3/da/f12 [0,4194304] 0 2024-02-28T16:26:58.361 INFO:tasks.workunit.client.1.smithi157.stdout:5/227: read d0/d8/f41 [98432,61777] 0 2024-02-28T16:26:58.366 INFO:tasks.workunit.client.1.smithi157.stdout:4/187: fsync d3/da/f42 0 2024-02-28T16:26:58.369 INFO:tasks.workunit.client.1.smithi157.stdout:0/216: rename d1/f16 to d1/d8/d33/f50 0 2024-02-28T16:26:58.370 INFO:tasks.workunit.client.1.smithi157.stdout:2/209: creat da/d3a/f49 x:0 0 0 2024-02-28T16:26:58.371 INFO:tasks.workunit.client.1.smithi157.stdout:7/178: getdents df/d1f 0 2024-02-28T16:26:58.372 INFO:tasks.workunit.client.1.smithi157.stdout:1/208: mkdir d10/d11/d3a/d3e 0 2024-02-28T16:26:58.373 INFO:tasks.workunit.client.1.smithi157.stdout:1/209: chown l1 2103 1 2024-02-28T16:26:58.374 INFO:tasks.workunit.client.1.smithi157.stdout:2/210: truncate da/d2b/f3f 685453 0 2024-02-28T16:26:58.376 INFO:tasks.workunit.client.1.smithi157.stdout:8/125: unlink d1/d5/d10/l1d 0 2024-02-28T16:26:58.385 INFO:tasks.workunit.client.1.smithi157.stdout:9/154: creat d0/f33 x:0 0 0 2024-02-28T16:26:58.387 INFO:tasks.workunit.client.1.smithi157.stdout:8/126: dread d1/d5/d10/f18 [0,4194304] 0 2024-02-28T16:26:58.387 INFO:tasks.workunit.client.1.smithi157.stdout:0/217: fsync d1/f6 0 2024-02-28T16:26:58.389 INFO:tasks.workunit.client.1.smithi157.stdout:3/148: dread d0/d6/fb [0,4194304] 0 2024-02-28T16:26:58.390 INFO:tasks.workunit.client.1.smithi157.stdout:3/149: write d0/f24 [812272,53943] 0 2024-02-28T16:26:58.391 INFO:tasks.workunit.client.1.smithi157.stdout:7/179: symlink df/d1f/l3b 0 2024-02-28T16:26:58.391 INFO:tasks.workunit.client.1.smithi157.stdout:3/150: dread - d0/f1c zero size 2024-02-28T16:26:58.395 INFO:tasks.workunit.client.1.smithi157.stdout:1/210: creat d10/d11/d22/f3f x:0 0 0 2024-02-28T16:26:58.395 INFO:tasks.workunit.client.1.smithi157.stdout:1/211: chown l1 281476987 1 2024-02-28T16:26:58.395 INFO:tasks.workunit.client.1.smithi157.stdout:1/212: stat d10/d11/l15 0 2024-02-28T16:26:58.405 INFO:tasks.workunit.client.1.smithi157.stdout:8/127: symlink d1/d5/l28 0 2024-02-28T16:26:58.408 INFO:tasks.workunit.client.1.smithi157.stdout:7/180: mknod df/d25/c3c 0 2024-02-28T16:26:58.410 INFO:tasks.workunit.client.1.smithi157.stdout:3/151: creat d0/d20/d23/d2b/f31 x:0 0 0 2024-02-28T16:26:58.412 INFO:tasks.workunit.client.0.smithi148.stdout:4/855: dread d8/d21/f67 [0,4194304] 0 2024-02-28T16:26:58.419 INFO:tasks.workunit.client.0.smithi148.stdout:4/856: dread d8/d21/d3d/d4d/f4e [0,4194304] 0 2024-02-28T16:26:58.427 INFO:tasks.workunit.client.0.smithi148.stdout:5/968: mknod d1/d8/d20/d31/c12f 0 2024-02-28T16:26:58.428 INFO:tasks.workunit.client.1.smithi157.stdout:1/213: mknod d10/d11/d31/d2a/c40 0 2024-02-28T16:26:58.428 INFO:tasks.workunit.client.1.smithi157.stdout:9/155: mknod d0/c34 0 2024-02-28T16:26:58.429 INFO:tasks.workunit.client.1.smithi157.stdout:6/138: getdents d2/d7 0 2024-02-28T16:26:58.429 INFO:tasks.workunit.client.0.smithi148.stdout:4/857: mknod d8/d40/dc3/dd3/dea/c125 0 2024-02-28T16:26:58.430 INFO:tasks.workunit.client.1.smithi157.stdout:5/228: truncate d0/d9/f1d 783672 0 2024-02-28T16:26:58.430 INFO:tasks.workunit.client.1.smithi157.stdout:3/152: dread - d0/d20/d23/d2b/f31 zero size 2024-02-28T16:26:58.430 INFO:tasks.workunit.client.1.smithi157.stdout:2/211: link da/l32 da/d2b/l4a 0 2024-02-28T16:26:58.431 INFO:tasks.workunit.client.1.smithi157.stdout:4/188: getdents d3/da/d1f/d22 0 2024-02-28T16:26:58.432 INFO:tasks.workunit.client.1.smithi157.stdout:2/212: write da/f24 [1598237,118633] 0 2024-02-28T16:26:58.432 INFO:tasks.workunit.client.1.smithi157.stdout:4/189: read d3/da/f42 [717189,48281] 0 2024-02-28T16:26:58.433 INFO:tasks.workunit.client.0.smithi148.stdout:6/986: write d0/d4/dba/d71/fd3 [4690,49631] 0 2024-02-28T16:26:58.434 INFO:tasks.workunit.client.0.smithi148.stdout:5/969: creat d1/d8/d20/dd8/d89/dfd/d128/f130 x:0 0 0 2024-02-28T16:26:58.434 INFO:tasks.workunit.client.1.smithi157.stdout:2/213: dread - da/f37 zero size 2024-02-28T16:26:58.437 INFO:tasks.workunit.client.0.smithi148.stdout:4/858: rename d8/d37/cb3 to d8/d21/d3d/d4d/d66/dad/dfe/c126 0 2024-02-28T16:26:58.440 INFO:tasks.workunit.client.0.smithi148.stdout:7/963: truncate d0/d9/d25/fb9 190893 0 2024-02-28T16:26:58.441 INFO:tasks.workunit.client.1.smithi157.stdout:6/139: creat d2/d7/f24 x:0 0 0 2024-02-28T16:26:58.442 INFO:tasks.workunit.client.0.smithi148.stdout:4/859: mkdir d8/d40/dc3/dd3/d17/d127 0 2024-02-28T16:26:58.443 INFO:tasks.workunit.client.1.smithi157.stdout:5/229: fsync d0/f2f 0 2024-02-28T16:26:58.444 INFO:tasks.workunit.client.1.smithi157.stdout:3/153: unlink d0/c19 0 2024-02-28T16:26:58.445 INFO:tasks.workunit.client.0.smithi148.stdout:5/970: rename d1/f6f to d1/d44/d65/ddc/d11b/f131 0 2024-02-28T16:26:58.447 INFO:tasks.workunit.client.0.smithi148.stdout:5/971: fdatasync d1/db/d60/d7a/d8b/ff9 0 2024-02-28T16:26:58.448 INFO:tasks.workunit.client.1.smithi157.stdout:8/128: link d1/d5/d23/l27 d1/d5/l29 0 2024-02-28T16:26:58.448 INFO:tasks.workunit.client.0.smithi148.stdout:7/964: creat d0/d9/d25/d96/ddf/d28/d2b/d3a/d6a/df0/f12e x:0 0 0 2024-02-28T16:26:58.449 INFO:tasks.workunit.client.0.smithi148.stdout:7/965: chown d0/dd5/de2 58 1 2024-02-28T16:26:58.450 INFO:tasks.workunit.client.0.smithi148.stdout:5/972: chown d1/d44/d65/ddc/d11b/fcf 32924988 1 2024-02-28T16:26:58.451 INFO:tasks.workunit.client.1.smithi157.stdout:9/156: dwrite d0/d19/f2e [0,4194304] 0 2024-02-28T16:26:58.452 INFO:tasks.workunit.client.0.smithi148.stdout:5/973: chown d1/d8/c10 25910 1 2024-02-28T16:26:58.458 INFO:tasks.workunit.client.1.smithi157.stdout:5/230: creat d0/d9/d47/f4f x:0 0 0 2024-02-28T16:26:58.459 INFO:tasks.workunit.client.1.smithi157.stdout:3/154: creat d0/d20/d23/d2b/f32 x:0 0 0 2024-02-28T16:26:58.460 INFO:tasks.workunit.client.0.smithi148.stdout:5/974: mknod d1/d8/d20/d4e/d84/d108/c132 0 2024-02-28T16:26:58.460 INFO:tasks.workunit.client.1.smithi157.stdout:1/214: creat d10/d11/d31/f41 x:0 0 0 2024-02-28T16:26:58.462 INFO:tasks.workunit.client.1.smithi157.stdout:2/214: dwrite da/f46 [0,4194304] 0 2024-02-28T16:26:58.462 INFO:tasks.workunit.client.1.smithi157.stdout:4/190: dwrite d3/da/d1f/f26 [0,4194304] 0 2024-02-28T16:26:58.464 INFO:tasks.workunit.client.1.smithi157.stdout:3/155: stat d0/d6/d1e/c27 0 2024-02-28T16:26:58.466 INFO:tasks.workunit.client.1.smithi157.stdout:7/181: dwrite df/d1f/d24/f35 [0,4194304] 0 2024-02-28T16:26:58.468 INFO:tasks.workunit.client.1.smithi157.stdout:8/129: mknod d1/d5/d10/c2a 0 2024-02-28T16:26:58.469 INFO:tasks.workunit.client.0.smithi148.stdout:7/966: dwrite d0/d9/d25/d96/db7/f108 [0,4194304] 0 2024-02-28T16:26:58.477 INFO:tasks.workunit.client.1.smithi157.stdout:9/157: chown d0/l2f 5 1 2024-02-28T16:26:58.477 INFO:tasks.workunit.client.1.smithi157.stdout:6/140: fsync d2/d7/f11 0 2024-02-28T16:26:58.477 INFO:tasks.workunit.client.1.smithi157.stdout:1/215: read f4 [1088432,98417] 0 2024-02-28T16:26:58.479 INFO:tasks.workunit.client.1.smithi157.stdout:4/191: mknod d3/da/c45 0 2024-02-28T16:26:58.481 INFO:tasks.workunit.client.1.smithi157.stdout:1/216: chown d10/d11/d3a/f3c 161871310 1 2024-02-28T16:26:58.481 INFO:tasks.workunit.client.1.smithi157.stdout:4/192: readlink d3/da/d28/l2c 0 2024-02-28T16:26:58.488 INFO:tasks.workunit.client.1.smithi157.stdout:7/182: fdatasync df/f16 0 2024-02-28T16:26:58.489 INFO:tasks.workunit.client.0.smithi148.stdout:4/860: dwrite d8/d37/fc6 [0,4194304] 0 2024-02-28T16:26:58.495 INFO:tasks.workunit.client.0.smithi148.stdout:7/967: dread d0/d9/d25/d96/ddf/d1c/d32/d12d/fc1 [0,4194304] 0 2024-02-28T16:26:58.496 INFO:tasks.workunit.client.1.smithi157.stdout:5/231: mkdir d0/d30/d50 0 2024-02-28T16:26:58.497 INFO:tasks.workunit.client.1.smithi157.stdout:2/215: symlink da/d47/l4b 0 2024-02-28T16:26:58.498 INFO:tasks.workunit.client.0.smithi148.stdout:5/975: write d1/d8/d20/d4e/d84/fe2 [927932,121524] 0 2024-02-28T16:26:58.499 INFO:tasks.workunit.client.1.smithi157.stdout:6/141: creat d2/d17/f25 x:0 0 0 2024-02-28T16:26:58.499 INFO:tasks.workunit.client.1.smithi157.stdout:9/158: mknod d0/d19/d30/c35 0 2024-02-28T16:26:58.499 INFO:tasks.workunit.client.1.smithi157.stdout:1/217: dread f2 [0,4194304] 0 2024-02-28T16:26:58.502 INFO:tasks.workunit.client.0.smithi148.stdout:4/861: mkdir d8/d40/dc3/d121/d128 0 2024-02-28T16:26:58.504 INFO:tasks.workunit.client.1.smithi157.stdout:4/193: creat d3/da/f46 x:0 0 0 2024-02-28T16:26:58.509 INFO:tasks.workunit.client.1.smithi157.stdout:6/142: dread d2/f5 [0,4194304] 0 2024-02-28T16:26:58.510 INFO:tasks.workunit.client.1.smithi157.stdout:6/143: read - d2/d7/f24 zero size 2024-02-28T16:26:58.511 INFO:tasks.workunit.client.0.smithi148.stdout:5/976: dread d1/d8/d20/d4e/d84/fe2 [0,4194304] 0 2024-02-28T16:26:58.512 INFO:tasks.workunit.client.1.smithi157.stdout:5/232: mkdir d0/d8/d51 0 2024-02-28T16:26:58.513 INFO:tasks.workunit.client.0.smithi148.stdout:5/977: dread - d1/d8/d20/d4e/d96/f127 zero size 2024-02-28T16:26:58.514 INFO:tasks.workunit.client.0.smithi148.stdout:7/968: rename d0/dd5/de0/c12a to d0/d9/d25/d96/ddf/d1c/c12f 0 2024-02-28T16:26:58.515 INFO:tasks.workunit.client.1.smithi157.stdout:2/216: symlink da/d35/l4c 0 2024-02-28T16:26:58.516 INFO:tasks.workunit.client.1.smithi157.stdout:2/217: chown da/f12 503221 1 2024-02-28T16:26:58.516 INFO:tasks.workunit.client.0.smithi148.stdout:7/969: chown d0/d9/d46/l5d 85134 1 2024-02-28T16:26:58.524 INFO:tasks.workunit.client.1.smithi157.stdout:4/194: symlink d3/da/d28/l47 0 2024-02-28T16:26:58.526 INFO:tasks.workunit.client.1.smithi157.stdout:4/195: write d3/da/f2b [794725,61760] 0 2024-02-28T16:26:58.526 INFO:tasks.workunit.client.1.smithi157.stdout:3/156: truncate d0/d6/fa 3054085 0 2024-02-28T16:26:58.527 INFO:tasks.workunit.client.1.smithi157.stdout:4/196: write d3/f13 [4423887,13919] 0 2024-02-28T16:26:58.528 INFO:tasks.workunit.client.0.smithi148.stdout:4/862: rmdir d8/d21/d3d/d4d/d66/dad/dfe/d124 0 2024-02-28T16:26:58.528 INFO:tasks.workunit.client.1.smithi157.stdout:3/157: truncate d0/d6/f2d 829915 0 2024-02-28T16:26:58.529 INFO:tasks.workunit.client.1.smithi157.stdout:4/197: write d3/da/f35 [954578,23754] 0 2024-02-28T16:26:58.529 INFO:tasks.workunit.client.0.smithi148.stdout:7/970: dread d0/d9/d25/d96/ddf/d28/d2b/d5c/f85 [0,4194304] 0 2024-02-28T16:26:58.532 INFO:tasks.workunit.client.1.smithi157.stdout:4/198: write d3/da/d1f/d22/f3d [331516,301] 0 2024-02-28T16:26:58.535 INFO:tasks.workunit.client.1.smithi157.stdout:5/233: rename d0/d8/f2b to d0/d9/f52 0 2024-02-28T16:26:58.535 INFO:tasks.workunit.client.0.smithi148.stdout:7/971: fdatasync d0/d9/d25/d96/ddf/f41 0 2024-02-28T16:26:58.539 INFO:tasks.workunit.client.1.smithi157.stdout:9/159: mkdir d0/d36 0 2024-02-28T16:26:58.544 INFO:tasks.workunit.client.1.smithi157.stdout:4/199: dwrite d3/f13 [0,4194304] 0 2024-02-28T16:26:58.546 INFO:tasks.workunit.client.0.smithi148.stdout:4/863: rename d8/d40/d73/fd1 to d8/d21/d3d/d4d/dd0/dd4/f129 0 2024-02-28T16:26:58.552 INFO:tasks.workunit.client.0.smithi148.stdout:5/978: dwrite d1/d8/d20/d4e/d71/feb [0,4194304] 0 2024-02-28T16:26:58.559 INFO:tasks.workunit.client.1.smithi157.stdout:7/183: mknod df/d1f/d37/c3d 0 2024-02-28T16:26:58.559 INFO:tasks.workunit.client.1.smithi157.stdout:7/184: write f8 [805216,119672] 0 2024-02-28T16:26:58.564 INFO:tasks.workunit.client.0.smithi148.stdout:4/864: creat d8/d21/d3d/d4d/d95/f12a x:0 0 0 2024-02-28T16:26:58.570 INFO:tasks.workunit.client.1.smithi157.stdout:2/218: mknod da/c4d 0 2024-02-28T16:26:58.572 INFO:tasks.workunit.client.1.smithi157.stdout:2/219: chown da/d3a/f49 1325691 1 2024-02-28T16:26:58.576 INFO:tasks.workunit.client.1.smithi157.stdout:5/234: rename d0/d9/f52 to d0/d9/d1b/d36/f53 0 2024-02-28T16:26:58.576 INFO:tasks.workunit.client.0.smithi148.stdout:5/979: dwrite d1/d8/d20/d31/f10b [0,4194304] 0 2024-02-28T16:26:58.577 INFO:tasks.workunit.client.1.smithi157.stdout:0/218: sync 2024-02-28T16:26:58.579 INFO:tasks.workunit.client.0.smithi148.stdout:7/972: dwrite d0/d9/d25/d96/ddf/d1c/d32/f3d [0,4194304] 0 2024-02-28T16:26:58.579 INFO:tasks.workunit.client.0.smithi148.stdout:4/865: fsync d8/d40/dc3/dd3/d5f/f8f 0 2024-02-28T16:26:58.581 INFO:tasks.workunit.client.1.smithi157.stdout:4/200: mkdir d3/da/d48 0 2024-02-28T16:26:58.582 INFO:tasks.workunit.client.0.smithi148.stdout:7/973: chown d0/d4/d70/c8d 373387336 1 2024-02-28T16:26:58.582 INFO:tasks.workunit.client.1.smithi157.stdout:4/201: readlink d3/le 0 2024-02-28T16:26:58.582 INFO:tasks.workunit.client.1.smithi157.stdout:1/218: creat d10/d11/d31/f42 x:0 0 0 2024-02-28T16:26:58.584 INFO:tasks.workunit.client.1.smithi157.stdout:4/202: chown d3/da/d1f/f32 3 1 2024-02-28T16:26:58.587 INFO:tasks.workunit.client.1.smithi157.stdout:7/185: symlink df/d1f/d37/l3e 0 2024-02-28T16:26:58.590 INFO:tasks.workunit.client.1.smithi157.stdout:6/144: mknod d2/d7/d8/da/c26 0 2024-02-28T16:26:58.593 INFO:tasks.workunit.client.1.smithi157.stdout:3/158: creat d0/d20/d23/d2b/d2e/f33 x:0 0 0 2024-02-28T16:26:58.596 INFO:tasks.workunit.client.1.smithi157.stdout:2/220: rmdir da/d3a 39 2024-02-28T16:26:58.598 INFO:tasks.workunit.client.1.smithi157.stdout:2/221: write da/d35/f48 [359465,22518] 0 2024-02-28T16:26:58.605 INFO:tasks.workunit.client.0.smithi148.stdout:4/866: creat d8/d40/dc3/dd3/d17/d6a/d6c/dda/f12b x:0 0 0 2024-02-28T16:26:58.609 INFO:tasks.workunit.client.0.smithi148.stdout:5/980: mkdir d1/d8/d20/d133 0 2024-02-28T16:26:58.612 INFO:tasks.workunit.client.1.smithi157.stdout:1/219: rename d10/d11/d31/c37 to d10/d11/c43 0 2024-02-28T16:26:58.613 INFO:tasks.workunit.client.0.smithi148.stdout:5/981: write d1/d8/d20/fd6 [116234,74891] 0 2024-02-28T16:26:58.615 INFO:tasks.workunit.client.0.smithi148.stdout:7/974: dread d0/d9/d25/d96/db7/f116 [0,4194304] 0 2024-02-28T16:26:58.615 INFO:tasks.workunit.client.1.smithi157.stdout:4/203: creat d3/da/d37/f49 x:0 0 0 2024-02-28T16:26:58.616 INFO:tasks.workunit.client.1.smithi157.stdout:4/204: stat d3/f16 0 2024-02-28T16:26:58.618 INFO:tasks.workunit.client.0.smithi148.stdout:4/867: truncate d8/d40/dc3/dd3/d5f/f7b 209823 0 2024-02-28T16:26:58.624 INFO:tasks.workunit.client.0.smithi148.stdout:5/982: creat d1/d44/d65/f134 x:0 0 0 2024-02-28T16:26:58.625 INFO:tasks.workunit.client.0.smithi148.stdout:7/975: mknod d0/dd5/de0/c130 0 2024-02-28T16:26:58.626 INFO:tasks.workunit.client.1.smithi157.stdout:2/222: fsync da/f1e 0 2024-02-28T16:26:58.626 INFO:tasks.workunit.client.0.smithi148.stdout:4/868: mknod d8/d71/d85/c12c 0 2024-02-28T16:26:58.627 INFO:tasks.workunit.client.0.smithi148.stdout:7/976: chown d0/f2 916 1 2024-02-28T16:26:58.629 INFO:tasks.workunit.client.0.smithi148.stdout:4/869: stat d8/d40/dc3/dd3/d17/d6a/d6c/dda 0 2024-02-28T16:26:58.630 INFO:tasks.workunit.client.1.smithi157.stdout:0/219: link d1/d8/d33/f4e d1/d13/d46/f51 0 2024-02-28T16:26:58.631 INFO:tasks.workunit.client.1.smithi157.stdout:1/220: mknod d10/d11/d3a/c44 0 2024-02-28T16:26:58.640 INFO:tasks.workunit.client.1.smithi157.stdout:7/186: mkdir df/d1f/d24/d39/d3f 0 2024-02-28T16:26:58.642 INFO:tasks.workunit.client.0.smithi148.stdout:4/870: mknod d8/d71/c12d 0 2024-02-28T16:26:58.642 INFO:tasks.workunit.client.1.smithi157.stdout:3/159: dwrite d0/d6/f11 [0,4194304] 0 2024-02-28T16:26:58.646 INFO:tasks.workunit.client.1.smithi157.stdout:6/145: write d2/d7/fc [680205,10869] 0 2024-02-28T16:26:58.646 INFO:tasks.workunit.client.1.smithi157.stdout:3/160: write d0/d6/f17 [4504331,96928] 0 2024-02-28T16:26:58.650 INFO:tasks.workunit.client.1.smithi157.stdout:9/160: getdents d0/d19/d30 0 2024-02-28T16:26:58.653 INFO:tasks.workunit.client.1.smithi157.stdout:0/220: mkdir d1/d13/d52 0 2024-02-28T16:26:58.655 INFO:tasks.workunit.client.1.smithi157.stdout:4/205: mkdir d3/da/d48/d4a 0 2024-02-28T16:26:58.656 INFO:tasks.workunit.client.0.smithi148.stdout:5/983: write d1/db/d60/d7a/dbb/fd3 [839315,15628] 0 2024-02-28T16:26:58.656 INFO:tasks.workunit.client.0.smithi148.stdout:7/977: write d0/d9/f1a [1639307,72180] 0 2024-02-28T16:26:58.657 INFO:tasks.workunit.client.1.smithi157.stdout:0/221: truncate d1/d8/f45 100836 0 2024-02-28T16:26:58.657 INFO:tasks.workunit.client.1.smithi157.stdout:1/221: dwrite d10/d11/d31/f3d [0,4194304] 0 2024-02-28T16:26:58.661 INFO:tasks.workunit.client.1.smithi157.stdout:6/146: stat d2/d7/c20 0 2024-02-28T16:26:58.661 INFO:tasks.workunit.client.1.smithi157.stdout:2/223: mkdir da/d38/d4e 0 2024-02-28T16:26:58.662 INFO:tasks.workunit.client.1.smithi157.stdout:3/161: mkdir d0/d6/d34 0 2024-02-28T16:26:58.663 INFO:tasks.workunit.client.1.smithi157.stdout:1/222: dread d10/d11/f2e [0,4194304] 0 2024-02-28T16:26:58.664 INFO:tasks.workunit.client.1.smithi157.stdout:4/206: dread d3/da/d1f/d22/f3d [0,4194304] 0 2024-02-28T16:26:58.666 INFO:tasks.workunit.client.1.smithi157.stdout:3/162: fdatasync d0/d20/d23/d2b/f31 0 2024-02-28T16:26:58.666 INFO:tasks.workunit.client.1.smithi157.stdout:4/207: write d3/da/ff [291847,17849] 0 2024-02-28T16:26:58.669 INFO:tasks.workunit.client.0.smithi148.stdout:5/984: link d1/db/d25/f7e d1/db/d60/df0/d63/f135 0 2024-02-28T16:26:58.672 INFO:tasks.workunit.client.0.smithi148.stdout:7/978: creat d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/d97/f131 x:0 0 0 2024-02-28T16:26:58.673 INFO:tasks.workunit.client.0.smithi148.stdout:4/871: write d8/d40/dc3/dd3/d17/d6a/d6c/dda/ff9 [915345,12064] 0 2024-02-28T16:26:58.676 INFO:tasks.workunit.client.1.smithi157.stdout:2/224: creat da/d2b/f4f x:0 0 0 2024-02-28T16:26:58.677 INFO:tasks.workunit.client.0.smithi148.stdout:4/872: chown d8/d40/dc3/dd3/d1f/f4b 41892744 1 2024-02-28T16:26:58.678 INFO:tasks.workunit.client.1.smithi157.stdout:1/223: creat d10/d11/d2c/f45 x:0 0 0 2024-02-28T16:26:58.679 INFO:tasks.workunit.client.1.smithi157.stdout:9/161: mkdir d0/d36/d37 0 2024-02-28T16:26:58.681 INFO:tasks.workunit.client.1.smithi157.stdout:7/187: rename df/d1f/d24/d39/d3f to df/d40 0 2024-02-28T16:26:58.682 INFO:tasks.workunit.client.1.smithi157.stdout:7/188: write f8 [5191702,33816] 0 2024-02-28T16:26:58.684 INFO:tasks.workunit.client.0.smithi148.stdout:5/985: dwrite d1/db/fc5 [0,4194304] 0 2024-02-28T16:26:58.684 INFO:tasks.workunit.client.1.smithi157.stdout:4/208: creat d3/da/d1f/d22/f4b x:0 0 0 2024-02-28T16:26:58.687 INFO:tasks.workunit.client.0.smithi148.stdout:4/873: rename d8/d40/dc3/dd3/da3/fa6 to d8/d21/d3d/d8c/db0/f12e 0 2024-02-28T16:26:58.689 INFO:tasks.workunit.client.0.smithi148.stdout:5/986: rmdir d1/db/d60/d7a/d87/de0/dee/d11a 39 2024-02-28T16:26:58.693 INFO:tasks.workunit.client.1.smithi157.stdout:9/162: creat d0/d19/d30/f38 x:0 0 0 2024-02-28T16:26:58.694 INFO:tasks.workunit.client.0.smithi148.stdout:5/987: mkdir d1/d8/d20/d4e/d136 0 2024-02-28T16:26:58.695 INFO:tasks.workunit.client.1.smithi157.stdout:9/163: dread - d0/d19/d30/f38 zero size 2024-02-28T16:26:58.697 INFO:tasks.workunit.client.1.smithi157.stdout:3/163: rename d0/d20/d23/d2b/c2c to d0/d20/c35 0 2024-02-28T16:26:58.698 INFO:tasks.workunit.client.1.smithi157.stdout:7/189: mkdir df/d1f/d24/d39/d41 0 2024-02-28T16:26:58.701 INFO:tasks.workunit.client.1.smithi157.stdout:8/130: sync 2024-02-28T16:26:58.702 INFO:tasks.workunit.client.1.smithi157.stdout:8/131: fsync d1/f4 0 2024-02-28T16:26:58.702 INFO:tasks.workunit.client.1.smithi157.stdout:6/147: getdents d2/d7 0 2024-02-28T16:26:58.702 INFO:tasks.workunit.client.0.smithi148.stdout:4/874: creat d8/d21/d3d/d8c/f12f x:0 0 0 2024-02-28T16:26:58.704 INFO:tasks.workunit.client.0.smithi148.stdout:4/875: write d8/d21/f30 [3186617,10157] 0 2024-02-28T16:26:58.706 INFO:tasks.workunit.client.0.smithi148.stdout:5/988: link d1/db/d25/f125 d1/d8/d20/dd8/d89/d10e/f137 0 2024-02-28T16:26:58.707 INFO:tasks.workunit.client.1.smithi157.stdout:9/164: creat d0/d19/d30/f39 x:0 0 0 2024-02-28T16:26:58.708 INFO:tasks.workunit.client.0.smithi148.stdout:4/876: write d8/d40/dc3/dd3/d17/d6a/f100 [263167,42451] 0 2024-02-28T16:26:58.711 INFO:tasks.workunit.client.1.smithi157.stdout:2/225: rename da/d3a/f44 to da/d2b/f50 0 2024-02-28T16:26:58.714 INFO:tasks.workunit.client.1.smithi157.stdout:3/164: symlink d0/d20/d23/l36 0 2024-02-28T16:26:58.715 INFO:tasks.workunit.client.1.smithi157.stdout:3/165: write d0/f24 [176883,115595] 0 2024-02-28T16:26:58.719 INFO:tasks.workunit.client.1.smithi157.stdout:7/190: fsync df/f16 0 2024-02-28T16:26:58.720 INFO:tasks.workunit.client.1.smithi157.stdout:0/222: getdents d1/d8 0 2024-02-28T16:26:58.722 INFO:tasks.workunit.client.1.smithi157.stdout:0/223: write d1/d8/f45 [879961,122424] 0 2024-02-28T16:26:58.723 INFO:tasks.workunit.client.1.smithi157.stdout:8/132: symlink d1/d5/d14/l2b 0 2024-02-28T16:26:58.724 INFO:tasks.workunit.client.0.smithi148.stdout:5/989: dwrite d1/db/d25/ff5 [0,4194304] 0 2024-02-28T16:26:58.730 INFO:tasks.workunit.client.1.smithi157.stdout:3/166: rmdir d0/d6 39 2024-02-28T16:26:58.730 INFO:tasks.workunit.client.1.smithi157.stdout:4/209: link d3/da/f20 d3/da/d48/d4a/f4c 0 2024-02-28T16:26:58.737 INFO:tasks.workunit.client.1.smithi157.stdout:1/224: truncate d10/d11/f28 95516 0 2024-02-28T16:26:58.739 INFO:tasks.workunit.client.1.smithi157.stdout:3/167: chown d0/d6/f2d 1 1 2024-02-28T16:26:58.749 INFO:tasks.workunit.client.0.smithi148.stdout:4/877: write d8/d21/d3d/f88 [539956,5004] 0 2024-02-28T16:26:58.750 INFO:tasks.workunit.client.0.smithi148.stdout:5/990: write d1/d44/d65/fce [458468,95210] 0 2024-02-28T16:26:58.754 INFO:tasks.workunit.client.0.smithi148.stdout:4/878: truncate d8/d21/d3d/f52 2007574 0 2024-02-28T16:26:58.755 INFO:tasks.workunit.client.1.smithi157.stdout:1/225: read d10/d11/d2c/f26 [2037814,69314] 0 2024-02-28T16:26:58.755 INFO:tasks.workunit.client.1.smithi157.stdout:0/224: mkdir d1/d13/d52/d53 0 2024-02-28T16:26:58.755 INFO:tasks.workunit.client.1.smithi157.stdout:9/165: link d0/c27 d0/d36/d37/c3a 0 2024-02-28T16:26:58.756 INFO:tasks.workunit.client.1.smithi157.stdout:2/226: link da/d2b/c31 da/d47/c51 0 2024-02-28T16:26:58.756 INFO:tasks.workunit.client.0.smithi148.stdout:5/991: read d1/db/d60/d7a/d8b/f42 [111459,29518] 0 2024-02-28T16:26:58.756 INFO:tasks.workunit.client.1.smithi157.stdout:3/168: unlink d0/d6/f1d 0 2024-02-28T16:26:58.757 INFO:tasks.workunit.client.1.smithi157.stdout:0/225: chown d1/d13/l4d 119 1 2024-02-28T16:26:58.758 INFO:tasks.workunit.client.1.smithi157.stdout:9/166: dread - d0/d19/f1e zero size 2024-02-28T16:26:58.758 INFO:tasks.workunit.client.0.smithi148.stdout:5/992: chown d1/d8/d20/d4e/d96 7951 1 2024-02-28T16:26:58.759 INFO:tasks.workunit.client.0.smithi148.stdout:5/993: dread - d1/db/d25/f125 zero size 2024-02-28T16:26:58.759 INFO:tasks.workunit.client.1.smithi157.stdout:2/227: write da/d2b/f4f [904987,130321] 0 2024-02-28T16:26:58.760 INFO:tasks.workunit.client.1.smithi157.stdout:8/133: creat d1/f2c x:0 0 0 2024-02-28T16:26:58.760 INFO:tasks.workunit.client.1.smithi157.stdout:4/210: link d3/da/c45 d3/da/d37/c4d 0 2024-02-28T16:26:58.761 INFO:tasks.workunit.client.1.smithi157.stdout:3/169: mknod d0/d6/d1e/c37 0 2024-02-28T16:26:58.763 INFO:tasks.workunit.client.1.smithi157.stdout:0/226: write d1/d8/f45 [1522576,114576] 0 2024-02-28T16:26:58.765 INFO:tasks.workunit.client.1.smithi157.stdout:9/167: truncate d0/d19/f1e 669274 0 2024-02-28T16:26:58.765 INFO:tasks.workunit.client.0.smithi148.stdout:4/879: rename d8/d21/f67 to d8/d40/dc3/dd3/f130 0 2024-02-28T16:26:58.767 INFO:tasks.workunit.client.1.smithi157.stdout:4/211: mknod d3/da/d1f/c4e 0 2024-02-28T16:26:58.767 INFO:tasks.workunit.client.1.smithi157.stdout:9/168: dread - d0/d19/d30/f32 zero size 2024-02-28T16:26:58.768 INFO:tasks.workunit.client.1.smithi157.stdout:3/170: truncate d0/d6/d1e/f1f 1752539 0 2024-02-28T16:26:58.770 INFO:tasks.workunit.client.1.smithi157.stdout:9/169: chown d0/d19/d30 392 1 2024-02-28T16:26:58.770 INFO:tasks.workunit.client.1.smithi157.stdout:0/227: creat d1/d13/f54 x:0 0 0 2024-02-28T16:26:58.771 INFO:tasks.workunit.client.1.smithi157.stdout:6/148: dwrite d2/f5 [4194304,4194304] 0 2024-02-28T16:26:58.771 INFO:tasks.workunit.client.0.smithi148.stdout:4/880: rename d8/d21/f11c to d8/d40/dc3/dd3/d5f/f131 0 2024-02-28T16:26:58.773 INFO:tasks.workunit.client.1.smithi157.stdout:8/134: link d1/f2c d1/d5/d14/f2d 0 2024-02-28T16:26:58.774 INFO:tasks.workunit.client.1.smithi157.stdout:9/170: dread d0/d19/f1e [0,4194304] 0 2024-02-28T16:26:58.776 INFO:tasks.workunit.client.0.smithi148.stdout:4/881: unlink d8/d21/c59 0 2024-02-28T16:26:58.780 INFO:tasks.workunit.client.0.smithi148.stdout:5/994: truncate d1/f5f 757989 0 2024-02-28T16:26:58.782 INFO:tasks.workunit.client.1.smithi157.stdout:0/228: mkdir d1/d8/d27/d55 0 2024-02-28T16:26:58.783 INFO:tasks.workunit.client.1.smithi157.stdout:2/228: dwrite da/f27 [0,4194304] 0 2024-02-28T16:26:58.784 INFO:tasks.workunit.client.0.smithi148.stdout:4/882: rename d8/l9 to d8/d71/d85/l132 0 2024-02-28T16:26:58.786 INFO:tasks.workunit.client.0.smithi148.stdout:4/883: chown d8/d40/d73/l10c 965 1 2024-02-28T16:26:58.788 INFO:tasks.workunit.client.1.smithi157.stdout:4/212: dwrite d3/da/f2b [0,4194304] 0 2024-02-28T16:26:58.790 INFO:tasks.workunit.client.1.smithi157.stdout:8/135: rename d1/d5/d23/l25 to d1/d5/d10/l2e 0 2024-02-28T16:26:58.793 INFO:tasks.workunit.client.1.smithi157.stdout:8/136: chown d1/d5/d14/f2d 13883211 1 2024-02-28T16:26:58.793 INFO:tasks.workunit.client.1.smithi157.stdout:6/149: dwrite d2/d7/f15 [0,4194304] 0 2024-02-28T16:26:58.795 INFO:tasks.workunit.client.0.smithi148.stdout:5/995: mkdir d1/db/d60/d7a/d87/de0/dee/d138 0 2024-02-28T16:26:58.796 INFO:tasks.workunit.client.1.smithi157.stdout:8/137: write d1/d5/d10/f22 [828088,6575] 0 2024-02-28T16:26:58.798 INFO:tasks.workunit.client.0.smithi148.stdout:4/884: symlink d8/d21/d3d/l133 0 2024-02-28T16:26:58.800 INFO:tasks.workunit.client.1.smithi157.stdout:2/229: rmdir da/d2b 39 2024-02-28T16:26:58.807 INFO:tasks.workunit.client.1.smithi157.stdout:4/213: creat d3/da/f4f x:0 0 0 2024-02-28T16:26:58.809 INFO:tasks.workunit.client.1.smithi157.stdout:6/150: creat d2/d7/d8/f27 x:0 0 0 2024-02-28T16:26:58.810 INFO:tasks.workunit.client.1.smithi157.stdout:4/214: write d3/f13 [3391314,28269] 0 2024-02-28T16:26:58.811 INFO:tasks.workunit.client.1.smithi157.stdout:8/138: unlink d1/d5/l8 0 2024-02-28T16:26:58.812 INFO:tasks.workunit.client.1.smithi157.stdout:2/230: mknod da/d3a/c52 0 2024-02-28T16:26:58.815 INFO:tasks.workunit.client.1.smithi157.stdout:3/171: getdents d0/d6/d1e 0 2024-02-28T16:26:58.815 INFO:tasks.workunit.client.1.smithi157.stdout:8/139: chown d1/d5/d10/c11 4164 1 2024-02-28T16:26:58.816 INFO:tasks.workunit.client.1.smithi157.stdout:9/171: dwrite d0/f1f [0,4194304] 0 2024-02-28T16:26:58.819 INFO:tasks.workunit.client.0.smithi148.stdout:4/885: write d8/d37/d91/db2/fd6 [499223,75748] 0 2024-02-28T16:26:58.820 INFO:tasks.workunit.client.1.smithi157.stdout:9/172: fsync d0/d19/d30/f39 0 2024-02-28T16:26:58.821 INFO:tasks.workunit.client.1.smithi157.stdout:4/215: creat d3/da/d37/f50 x:0 0 0 2024-02-28T16:26:58.822 INFO:tasks.workunit.client.1.smithi157.stdout:2/231: creat da/d3a/f53 x:0 0 0 2024-02-28T16:26:58.823 INFO:tasks.workunit.client.1.smithi157.stdout:4/216: stat d3/f13 0 2024-02-28T16:26:58.824 INFO:tasks.workunit.client.1.smithi157.stdout:5/235: sync 2024-02-28T16:26:58.824 INFO:tasks.workunit.client.1.smithi157.stdout:8/140: fdatasync d1/d5/d10/f18 0 2024-02-28T16:26:58.827 INFO:tasks.workunit.client.1.smithi157.stdout:4/217: readlink d3/le 0 2024-02-28T16:26:58.827 INFO:tasks.workunit.client.1.smithi157.stdout:6/151: creat d2/d7/de/d1b/f28 x:0 0 0 2024-02-28T16:26:58.827 INFO:tasks.workunit.client.0.smithi148.stdout:4/886: read d8/fa8 [355948,124289] 0 2024-02-28T16:26:58.828 INFO:tasks.workunit.client.1.smithi157.stdout:5/236: stat d0/d9/d1b/c22 0 2024-02-28T16:26:58.830 INFO:tasks.workunit.client.0.smithi148.stdout:4/887: creat d8/d40/dc3/f134 x:0 0 0 2024-02-28T16:26:58.831 INFO:tasks.workunit.client.1.smithi157.stdout:9/173: symlink d0/d36/l3b 0 2024-02-28T16:26:58.834 INFO:tasks.workunit.client.1.smithi157.stdout:5/237: creat d0/d9/d47/f54 x:0 0 0 2024-02-28T16:26:58.834 INFO:tasks.workunit.client.1.smithi157.stdout:0/229: dwrite d1/d13/f3e [0,4194304] 0 2024-02-28T16:26:58.837 INFO:tasks.workunit.client.1.smithi157.stdout:9/174: write d0/d19/d30/f32 [423890,23632] 0 2024-02-28T16:26:58.841 INFO:tasks.workunit.client.1.smithi157.stdout:3/172: dwrite d0/d6/f2d [0,4194304] 0 2024-02-28T16:26:58.843 INFO:tasks.workunit.client.1.smithi157.stdout:2/232: getdents da 0 2024-02-28T16:26:58.844 INFO:tasks.workunit.client.0.smithi148.stdout:4/888: link d8/d21/f54 d8/d40/dc3/dd3/d17/d6a/f135 0 2024-02-28T16:26:58.847 INFO:tasks.workunit.client.1.smithi157.stdout:4/218: creat d3/f51 x:0 0 0 2024-02-28T16:26:58.848 INFO:tasks.workunit.client.1.smithi157.stdout:5/238: creat d0/d9/d47/f55 x:0 0 0 2024-02-28T16:26:58.849 INFO:tasks.workunit.client.1.smithi157.stdout:5/239: write d0/d9/f1f [2261680,69777] 0 2024-02-28T16:26:58.851 INFO:tasks.workunit.client.1.smithi157.stdout:5/240: dread - d0/d9/d47/f4d zero size 2024-02-28T16:26:58.855 INFO:tasks.workunit.client.0.smithi148.stdout:4/889: creat d8/d21/d3d/d4d/d66/f136 x:0 0 0 2024-02-28T16:26:58.857 INFO:tasks.workunit.client.1.smithi157.stdout:4/219: mkdir d3/da/d1f/d22/d52 0 2024-02-28T16:26:58.858 INFO:tasks.workunit.client.1.smithi157.stdout:8/141: link d1/d5/d14/l2b d1/d5/d14/l2f 0 2024-02-28T16:26:58.858 INFO:tasks.workunit.client.0.smithi148.stdout:4/890: chown d8/d40/dc3/dd3/d17/d6a/f3a 1 1 2024-02-28T16:26:58.859 INFO:tasks.workunit.client.1.smithi157.stdout:9/175: symlink d0/l3c 0 2024-02-28T16:26:58.859 INFO:tasks.workunit.client.1.smithi157.stdout:6/152: getdents d2/d7/de/d1b 0 2024-02-28T16:26:58.861 INFO:tasks.workunit.client.0.smithi148.stdout:4/891: creat d8/d21/d3d/d8c/db0/f137 x:0 0 0 2024-02-28T16:26:58.863 INFO:tasks.workunit.client.1.smithi157.stdout:0/230: getdents d1/d13/d52 0 2024-02-28T16:26:58.864 INFO:tasks.workunit.client.1.smithi157.stdout:6/153: rmdir d2/d7/de/d1b 39 2024-02-28T16:26:58.865 INFO:tasks.workunit.client.1.smithi157.stdout:0/231: stat d1/d8 0 2024-02-28T16:26:58.865 INFO:tasks.workunit.client.0.smithi148.stdout:4/892: creat d8/d40/dc3/d121/d128/f138 x:0 0 0 2024-02-28T16:26:58.868 INFO:tasks.workunit.client.1.smithi157.stdout:0/232: fdatasync d1/da/f2f 0 2024-02-28T16:26:58.868 INFO:tasks.workunit.client.0.smithi148.stdout:4/893: symlink d8/d21/d3d/d8c/l139 0 2024-02-28T16:26:58.869 INFO:tasks.workunit.client.1.smithi157.stdout:0/233: stat d1/d13/fe 0 2024-02-28T16:26:58.869 INFO:tasks.workunit.client.1.smithi157.stdout:6/154: getdents d2/d7/de/d1b 0 2024-02-28T16:26:58.871 INFO:tasks.workunit.client.1.smithi157.stdout:6/155: chown d2/d17/f21 444503221 1 2024-02-28T16:26:58.873 INFO:tasks.workunit.client.1.smithi157.stdout:2/233: dwrite da/f1d [0,4194304] 0 2024-02-28T16:26:58.877 INFO:tasks.workunit.client.1.smithi157.stdout:6/156: mkdir d2/d7/d8/da/d29 0 2024-02-28T16:26:58.879 INFO:tasks.workunit.client.1.smithi157.stdout:4/220: dread d3/f33 [0,4194304] 0 2024-02-28T16:26:58.886 INFO:tasks.workunit.client.1.smithi157.stdout:9/176: dread d0/f3 [0,4194304] 0 2024-02-28T16:26:58.894 INFO:tasks.workunit.client.1.smithi157.stdout:3/173: write d0/d6/fa [4057205,59796] 0 2024-02-28T16:26:58.895 INFO:tasks.workunit.client.1.smithi157.stdout:8/142: write d1/d5/f16 [4029498,96022] 0 2024-02-28T16:26:58.896 INFO:tasks.workunit.client.0.smithi148.stdout:4/894: dread d8/f26 [0,4194304] 0 2024-02-28T16:26:58.897 INFO:tasks.workunit.client.1.smithi157.stdout:0/234: truncate d1/d8/fc 3955790 0 2024-02-28T16:26:58.898 INFO:tasks.workunit.client.1.smithi157.stdout:3/174: readlink d0/d6/l18 0 2024-02-28T16:26:58.899 INFO:tasks.workunit.client.0.smithi148.stdout:4/895: mknod d8/d21/d3d/d4d/d95/c13a 0 2024-02-28T16:26:58.900 INFO:tasks.workunit.client.1.smithi157.stdout:2/234: dwrite da/d3a/f49 [0,4194304] 0 2024-02-28T16:26:58.901 INFO:tasks.workunit.client.1.smithi157.stdout:4/221: dread d3/da/f2b [0,4194304] 0 2024-02-28T16:26:58.902 INFO:tasks.workunit.client.0.smithi148.stdout:4/896: fsync d8/d21/d3d/d4d/d72/fa1 0 2024-02-28T16:26:58.902 INFO:tasks.workunit.client.1.smithi157.stdout:2/235: readlink da/d35/l4c 0 2024-02-28T16:26:58.903 INFO:tasks.workunit.client.1.smithi157.stdout:0/235: mkdir d1/d8/d33/d56 0 2024-02-28T16:26:58.905 INFO:tasks.workunit.client.0.smithi148.stdout:4/897: mknod d8/d21/d3d/d8c/db0/c13b 0 2024-02-28T16:26:58.908 INFO:tasks.workunit.client.1.smithi157.stdout:3/175: creat d0/f38 x:0 0 0 2024-02-28T16:26:58.908 INFO:tasks.workunit.client.0.smithi148.stdout:4/898: chown d8/d40/dc3/dd3/d5f/f81 61348 1 2024-02-28T16:26:58.912 INFO:tasks.workunit.client.1.smithi157.stdout:0/236: rmdir d1/d13/d52 39 2024-02-28T16:26:58.916 INFO:tasks.workunit.client.1.smithi157.stdout:0/237: readlink d1/da/l22 0 2024-02-28T16:26:58.918 INFO:tasks.workunit.client.1.smithi157.stdout:9/177: dwrite d0/d19/f1c [0,4194304] 0 2024-02-28T16:26:58.921 INFO:tasks.workunit.client.1.smithi157.stdout:0/238: write d1/d13/ff [5541190,51841] 0 2024-02-28T16:26:58.923 INFO:tasks.workunit.client.1.smithi157.stdout:0/239: dread - d1/da/f43 zero size 2024-02-28T16:26:58.923 INFO:tasks.workunit.client.1.smithi157.stdout:8/143: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:26:58.927 INFO:tasks.workunit.client.1.smithi157.stdout:9/178: rename d0/l11 to d0/l3d 0 2024-02-28T16:26:58.927 INFO:tasks.workunit.client.1.smithi157.stdout:8/144: symlink d1/d5/d23/l30 0 2024-02-28T16:26:58.928 INFO:tasks.workunit.client.1.smithi157.stdout:0/240: dread d1/d8/f25 [0,4194304] 0 2024-02-28T16:26:58.928 INFO:tasks.workunit.client.0.smithi148.stdout:4/899: dwrite f6 [0,4194304] 0 2024-02-28T16:26:58.929 INFO:tasks.workunit.client.1.smithi157.stdout:2/236: dwrite da/d3a/f43 [0,4194304] 0 2024-02-28T16:26:58.932 INFO:tasks.workunit.client.1.smithi157.stdout:8/145: creat d1/d5/f31 x:0 0 0 2024-02-28T16:26:58.933 INFO:tasks.workunit.client.1.smithi157.stdout:0/241: write d1/d13/f54 [810648,130837] 0 2024-02-28T16:26:58.937 INFO:tasks.workunit.client.1.smithi157.stdout:8/146: dread - d1/d5/f31 zero size 2024-02-28T16:26:58.938 INFO:tasks.workunit.client.1.smithi157.stdout:3/176: dread d0/f8 [0,4194304] 0 2024-02-28T16:26:58.945 INFO:tasks.workunit.client.1.smithi157.stdout:4/222: truncate d3/da/d1f/f29 1786 0 2024-02-28T16:26:58.946 INFO:tasks.workunit.client.1.smithi157.stdout:3/177: creat d0/d6/f39 x:0 0 0 2024-02-28T16:26:58.946 INFO:tasks.workunit.client.1.smithi157.stdout:2/237: dread da/f23 [0,4194304] 0 2024-02-28T16:26:58.948 INFO:tasks.workunit.client.1.smithi157.stdout:4/223: write d3/da/f46 [627029,80509] 0 2024-02-28T16:26:58.949 INFO:tasks.workunit.client.1.smithi157.stdout:2/238: write da/f27 [4907288,4859] 0 2024-02-28T16:26:58.949 INFO:tasks.workunit.client.1.smithi157.stdout:9/179: chown d0/l3d 155803721 1 2024-02-28T16:26:58.949 INFO:tasks.workunit.client.1.smithi157.stdout:0/242: mkdir d1/d13/d57 0 2024-02-28T16:26:58.955 INFO:tasks.workunit.client.1.smithi157.stdout:4/224: symlink d3/da/d37/l53 0 2024-02-28T16:26:58.957 INFO:tasks.workunit.client.1.smithi157.stdout:2/239: unlink da/d38/c39 0 2024-02-28T16:26:58.960 INFO:tasks.workunit.client.1.smithi157.stdout:9/180: rename d0/d19/c26 to d0/c3e 0 2024-02-28T16:26:58.962 INFO:tasks.workunit.client.1.smithi157.stdout:4/225: link d3/da/c10 d3/da/d1f/d22/d52/c54 0 2024-02-28T16:26:58.965 INFO:tasks.workunit.client.1.smithi157.stdout:4/226: creat d3/da/d1f/d22/d52/f55 x:0 0 0 2024-02-28T16:26:58.966 INFO:tasks.workunit.client.1.smithi157.stdout:4/227: write d3/da/f46 [142336,124320] 0 2024-02-28T16:26:58.967 INFO:tasks.workunit.client.1.smithi157.stdout:4/228: stat d3/da/f42 0 2024-02-28T16:26:58.970 INFO:tasks.workunit.client.1.smithi157.stdout:4/229: creat d3/da/d1f/d22/d52/f56 x:0 0 0 2024-02-28T16:26:58.971 INFO:tasks.workunit.client.1.smithi157.stdout:4/230: dread - d3/da/d1f/f32 zero size 2024-02-28T16:26:58.971 INFO:tasks.workunit.client.1.smithi157.stdout:9/181: dread d0/f5 [4194304,4194304] 0 2024-02-28T16:26:58.972 INFO:tasks.workunit.client.0.smithi148.stdout:6/987: sync 2024-02-28T16:26:58.972 INFO:tasks.workunit.client.0.smithi148.stdout:7/979: sync 2024-02-28T16:26:58.974 INFO:tasks.workunit.client.1.smithi157.stdout:9/182: mkdir d0/d36/d3f 0 2024-02-28T16:26:58.975 INFO:tasks.workunit.client.1.smithi157.stdout:9/183: stat d0/d19/d30/f38 0 2024-02-28T16:26:58.980 INFO:tasks.workunit.client.1.smithi157.stdout:3/178: rmdir d0/d6 39 2024-02-28T16:26:58.981 INFO:tasks.workunit.client.0.smithi148.stdout:4/900: truncate d8/d40/dc3/dd3/f34 6515480 0 2024-02-28T16:26:58.985 INFO:tasks.workunit.client.1.smithi157.stdout:4/231: dwrite d3/da/d28/f3e [0,4194304] 0 2024-02-28T16:26:58.988 INFO:tasks.workunit.client.1.smithi157.stdout:4/232: dread - d3/da/d1f/d22/f44 zero size 2024-02-28T16:26:58.989 INFO:tasks.workunit.client.1.smithi157.stdout:8/147: dread d1/f4 [4194304,4194304] 0 2024-02-28T16:26:58.989 INFO:tasks.workunit.client.1.smithi157.stdout:1/226: sync 2024-02-28T16:26:58.991 INFO:tasks.workunit.client.1.smithi157.stdout:4/233: chown d3/f2e 1 1 2024-02-28T16:26:58.991 INFO:tasks.workunit.client.1.smithi157.stdout:7/191: sync 2024-02-28T16:26:58.994 INFO:tasks.workunit.client.1.smithi157.stdout:7/192: stat df/f11 0 2024-02-28T16:26:59.000 INFO:tasks.workunit.client.1.smithi157.stdout:8/148: dread d1/d5/d10/f22 [0,4194304] 0 2024-02-28T16:26:59.034 INFO:tasks.workunit.client.1.smithi157.stdout:6/157: sync 2024-02-28T16:26:59.034 INFO:tasks.workunit.client.1.smithi157.stdout:5/241: sync 2024-02-28T16:26:59.035 INFO:tasks.workunit.client.1.smithi157.stdout:5/242: stat d0/d9/d1b 0 2024-02-28T16:26:59.044 INFO:tasks.workunit.client.1.smithi157.stdout:0/243: rmdir d1 39 2024-02-28T16:26:59.049 INFO:tasks.workunit.client.0.smithi148.stdout:4/901: creat d8/d37/d91/db2/f13c x:0 0 0 2024-02-28T16:26:59.051 INFO:tasks.workunit.client.1.smithi157.stdout:6/158: dwrite d2/d17/f25 [0,4194304] 0 2024-02-28T16:26:59.051 INFO:tasks.workunit.client.1.smithi157.stdout:4/234: mknod d3/da/d37/c57 0 2024-02-28T16:26:59.052 INFO:tasks.workunit.client.0.smithi148.stdout:7/980: getdents d0/d9/d25/d96/ddf/d28/d2b/d3a/d49 0 2024-02-28T16:26:59.053 INFO:tasks.workunit.client.1.smithi157.stdout:6/159: chown d2/d7/de 15 1 2024-02-28T16:26:59.056 INFO:tasks.workunit.client.1.smithi157.stdout:1/227: rename d10/d11/d2c to d10/d11/d3a/d3e/d46 0 2024-02-28T16:26:59.058 INFO:tasks.workunit.client.1.smithi157.stdout:7/193: mknod df/d25/c42 0 2024-02-28T16:26:59.061 INFO:tasks.workunit.client.1.smithi157.stdout:2/240: dwrite da/ff [0,4194304] 0 2024-02-28T16:26:59.061 INFO:tasks.workunit.client.1.smithi157.stdout:9/184: rmdir d0 39 2024-02-28T16:26:59.062 INFO:tasks.workunit.client.1.smithi157.stdout:8/149: mknod d1/d5/d23/c32 0 2024-02-28T16:26:59.064 INFO:tasks.workunit.client.0.smithi148.stdout:6/988: write d0/d4/dba/d71/fac [518791,112496] 0 2024-02-28T16:26:59.065 INFO:tasks.workunit.client.0.smithi148.stdout:7/981: dread d0/f1d [0,4194304] 0 2024-02-28T16:26:59.067 INFO:tasks.workunit.client.1.smithi157.stdout:8/150: read d1/f17 [474333,46375] 0 2024-02-28T16:26:59.073 INFO:tasks.workunit.client.1.smithi157.stdout:5/243: creat d0/d9/d47/f56 x:0 0 0 2024-02-28T16:26:59.078 INFO:tasks.workunit.client.1.smithi157.stdout:7/194: dread df/f10 [0,4194304] 0 2024-02-28T16:26:59.078 INFO:tasks.workunit.client.0.smithi148.stdout:7/982: rmdir d0/d9/d25/d96/ddf/d28/d2b/d3a/d49/dad 39 2024-02-28T16:26:59.081 INFO:tasks.workunit.client.0.smithi148.stdout:7/983: write d0/d9/d25/d96/ddf/d1c/d32/fa0 [4073261,9611] 0 2024-02-28T16:26:59.081 INFO:tasks.workunit.client.1.smithi157.stdout:1/228: dwrite d10/f16 [0,4194304] 0 2024-02-28T16:26:59.087 INFO:tasks.workunit.client.1.smithi157.stdout:4/235: mknod d3/da/d37/c58 0 2024-02-28T16:26:59.089 INFO:tasks.workunit.client.1.smithi157.stdout:4/236: write d3/da/d28/f39 [654692,92312] 0 2024-02-28T16:26:59.092 INFO:tasks.workunit.client.0.smithi148.stdout:5/996: sync 2024-02-28T16:26:59.094 INFO:tasks.workunit.client.0.smithi148.stdout:7/984: creat d0/d18/dcd/f132 x:0 0 0 2024-02-28T16:26:59.097 INFO:tasks.workunit.client.1.smithi157.stdout:6/160: creat d2/d17/f2a x:0 0 0 2024-02-28T16:26:59.099 INFO:tasks.workunit.client.0.smithi148.stdout:7/985: creat d0/d4/d70/f133 x:0 0 0 2024-02-28T16:26:59.101 INFO:tasks.workunit.client.0.smithi148.stdout:7/986: fdatasync d0/d4/f11d 0 2024-02-28T16:26:59.106 INFO:tasks.workunit.client.0.smithi148.stdout:7/987: fdatasync d0/f71 0 2024-02-28T16:26:59.107 INFO:tasks.workunit.client.1.smithi157.stdout:4/237: dread d3/da/ff [0,4194304] 0 2024-02-28T16:26:59.107 INFO:tasks.workunit.client.1.smithi157.stdout:2/241: creat da/d35/f54 x:0 0 0 2024-02-28T16:26:59.108 INFO:tasks.workunit.client.1.smithi157.stdout:3/179: creat d0/d6/d34/f3a x:0 0 0 2024-02-28T16:26:59.110 INFO:tasks.workunit.client.0.smithi148.stdout:7/988: symlink d0/dc8/l134 0 2024-02-28T16:26:59.111 INFO:tasks.workunit.client.1.smithi157.stdout:2/242: write da/d2b/f4f [187404,111214] 0 2024-02-28T16:26:59.112 INFO:tasks.workunit.client.1.smithi157.stdout:5/244: symlink d0/d9/d47/l57 0 2024-02-28T16:26:59.116 INFO:tasks.workunit.client.1.smithi157.stdout:7/195: dread df/d1f/d24/f28 [0,4194304] 0 2024-02-28T16:26:59.117 INFO:tasks.workunit.client.1.smithi157.stdout:1/229: symlink d10/d11/d22/l47 0 2024-02-28T16:26:59.122 INFO:tasks.workunit.client.1.smithi157.stdout:4/238: mknod d3/da/d1f/c59 0 2024-02-28T16:26:59.123 INFO:tasks.workunit.client.1.smithi157.stdout:3/180: dread d0/f8 [0,4194304] 0 2024-02-28T16:26:59.125 INFO:tasks.workunit.client.1.smithi157.stdout:2/243: symlink da/d38/l55 0 2024-02-28T16:26:59.126 INFO:tasks.workunit.client.1.smithi157.stdout:2/244: chown c5 359737638 1 2024-02-28T16:26:59.128 INFO:tasks.workunit.client.1.smithi157.stdout:6/161: mkdir d2/d7/d8/da/d29/d2b 0 2024-02-28T16:26:59.128 INFO:tasks.workunit.client.1.smithi157.stdout:0/244: dwrite d1/d8/f25 [0,4194304] 0 2024-02-28T16:26:59.130 INFO:tasks.workunit.client.1.smithi157.stdout:6/162: dread - d2/d7/de/d1b/f28 zero size 2024-02-28T16:26:59.131 INFO:tasks.workunit.client.1.smithi157.stdout:1/230: rename d10/d11/d31/l39 to d10/d11/d22/l48 0 2024-02-28T16:26:59.132 INFO:tasks.workunit.client.1.smithi157.stdout:6/163: dread - d2/d7/f24 zero size 2024-02-28T16:26:59.133 INFO:tasks.workunit.client.1.smithi157.stdout:9/185: mkdir d0/d36/d37/d40 0 2024-02-28T16:26:59.134 INFO:tasks.workunit.client.1.smithi157.stdout:6/164: write d2/f5 [6243163,86] 0 2024-02-28T16:26:59.136 INFO:tasks.workunit.client.1.smithi157.stdout:9/186: write d0/d19/f1c [4206557,116597] 0 2024-02-28T16:26:59.136 INFO:tasks.workunit.client.1.smithi157.stdout:2/245: dread da/d2b/f3d [0,4194304] 0 2024-02-28T16:26:59.139 INFO:tasks.workunit.client.1.smithi157.stdout:5/245: fsync d0/f19 0 2024-02-28T16:26:59.142 INFO:tasks.workunit.client.1.smithi157.stdout:7/196: creat df/d1f/d24/d38/f43 x:0 0 0 2024-02-28T16:26:59.143 INFO:tasks.workunit.client.1.smithi157.stdout:0/245: creat d1/da/f58 x:0 0 0 2024-02-28T16:26:59.145 INFO:tasks.workunit.client.1.smithi157.stdout:3/181: rename d0/d6/d1e/c27 to d0/d20/d23/d2b/c3b 0 2024-02-28T16:26:59.150 INFO:tasks.workunit.client.1.smithi157.stdout:4/239: fdatasync d3/f5 0 2024-02-28T16:26:59.153 INFO:tasks.workunit.client.1.smithi157.stdout:4/240: write d3/da/d1f/d22/f3c [90595,62627] 0 2024-02-28T16:26:59.154 INFO:tasks.workunit.client.1.smithi157.stdout:8/151: getdents d1 0 2024-02-28T16:26:59.155 INFO:tasks.workunit.client.1.smithi157.stdout:6/165: mknod d2/d7/d8/da/c2c 0 2024-02-28T16:26:59.157 INFO:tasks.workunit.client.1.smithi157.stdout:2/246: mknod da/d38/c56 0 2024-02-28T16:26:59.157 INFO:tasks.workunit.client.1.smithi157.stdout:6/166: fsync d2/d7/f11 0 2024-02-28T16:26:59.159 INFO:tasks.workunit.client.1.smithi157.stdout:5/246: dwrite d0/d9/d47/f55 [0,4194304] 0 2024-02-28T16:26:59.159 INFO:tasks.workunit.client.1.smithi157.stdout:2/247: chown da/f27 77 1 2024-02-28T16:26:59.160 INFO:tasks.workunit.client.1.smithi157.stdout:6/167: stat d2/d7/de/l13 0 2024-02-28T16:26:59.161 INFO:tasks.workunit.client.1.smithi157.stdout:9/187: write d0/f3 [597845,125485] 0 2024-02-28T16:26:59.163 INFO:tasks.workunit.client.1.smithi157.stdout:0/246: creat d1/d8/f59 x:0 0 0 2024-02-28T16:26:59.167 INFO:tasks.workunit.client.1.smithi157.stdout:7/197: rename df/d1f/d24/f28 to df/d25/f44 0 2024-02-28T16:26:59.169 INFO:tasks.workunit.client.1.smithi157.stdout:3/182: mknod d0/d20/d23/c3c 0 2024-02-28T16:26:59.171 INFO:tasks.workunit.client.1.smithi157.stdout:7/198: write df/d1f/d24/d38/f43 [1004438,373] 0 2024-02-28T16:26:59.174 INFO:tasks.workunit.client.1.smithi157.stdout:8/152: creat d1/d5/d10/f33 x:0 0 0 2024-02-28T16:26:59.175 INFO:tasks.workunit.client.1.smithi157.stdout:5/247: mknod d0/d8/c58 0 2024-02-28T16:26:59.176 INFO:tasks.workunit.client.1.smithi157.stdout:8/153: chown d1/d5/d10/l1f 411251 1 2024-02-28T16:26:59.178 INFO:tasks.workunit.client.1.smithi157.stdout:6/168: mkdir d2/d7/d8/da/d29/d2d 0 2024-02-28T16:26:59.181 INFO:tasks.workunit.client.1.smithi157.stdout:2/248: dwrite da/f24 [0,4194304] 0 2024-02-28T16:26:59.183 INFO:tasks.workunit.client.1.smithi157.stdout:2/249: dread - da/d35/f54 zero size 2024-02-28T16:26:59.184 INFO:tasks.workunit.client.1.smithi157.stdout:8/154: fsync d1/f17 0 2024-02-28T16:26:59.187 INFO:tasks.workunit.client.1.smithi157.stdout:6/169: mknod d2/d7/d8/da/d29/c2e 0 2024-02-28T16:26:59.190 INFO:tasks.workunit.client.1.smithi157.stdout:2/250: creat da/d38/f57 x:0 0 0 2024-02-28T16:26:59.190 INFO:tasks.workunit.client.1.smithi157.stdout:4/241: getdents d3/da/d28 0 2024-02-28T16:26:59.193 INFO:tasks.workunit.client.1.smithi157.stdout:8/155: mknod d1/d5/d14/c34 0 2024-02-28T16:26:59.195 INFO:tasks.workunit.client.1.smithi157.stdout:2/251: mkdir da/d35/d58 0 2024-02-28T16:26:59.196 INFO:tasks.workunit.client.1.smithi157.stdout:4/242: creat d3/da/d28/f5a x:0 0 0 2024-02-28T16:26:59.198 INFO:tasks.workunit.client.1.smithi157.stdout:8/156: creat d1/d5/d10/f35 x:0 0 0 2024-02-28T16:26:59.200 INFO:tasks.workunit.client.1.smithi157.stdout:5/248: dwrite d0/d8/f2d [0,4194304] 0 2024-02-28T16:26:59.205 INFO:tasks.workunit.client.1.smithi157.stdout:4/243: fdatasync d3/da/d1f/d22/f3d 0 2024-02-28T16:26:59.205 INFO:tasks.workunit.client.1.smithi157.stdout:5/249: mknod d0/d9/d3a/c59 0 2024-02-28T16:26:59.209 INFO:tasks.workunit.client.1.smithi157.stdout:5/250: truncate d0/d9/d47/f54 764464 0 2024-02-28T16:26:59.210 INFO:tasks.workunit.client.0.smithi148.stdout:6/989: write d0/d22/d27/d66/ff6 [801051,12025] 0 2024-02-28T16:26:59.210 INFO:tasks.workunit.client.1.smithi157.stdout:4/244: write d3/da/ff [539217,2576] 0 2024-02-28T16:26:59.215 INFO:tasks.workunit.client.1.smithi157.stdout:2/252: dwrite da/f1f [0,4194304] 0 2024-02-28T16:26:59.219 INFO:tasks.workunit.client.0.smithi148.stdout:6/990: unlink d0/d22/l2f 0 2024-02-28T16:26:59.219 INFO:tasks.workunit.client.0.smithi148.stdout:4/902: dwrite d8/d40/dc3/dd3/d5f/f7b [0,4194304] 0 2024-02-28T16:26:59.221 INFO:tasks.workunit.client.0.smithi148.stdout:4/903: chown d8/d40/dc3/dbd/de3/f108 1691 1 2024-02-28T16:26:59.223 INFO:tasks.workunit.client.0.smithi148.stdout:6/991: write d0/d4/dba/d71/fac [910137,92564] 0 2024-02-28T16:26:59.225 INFO:tasks.workunit.client.0.smithi148.stdout:4/904: chown d8/d40/dc3/dd3/d17/d6a/d6c 3186578 1 2024-02-28T16:26:59.225 INFO:tasks.workunit.client.1.smithi157.stdout:5/251: chown d0/d30/l3d 194 1 2024-02-28T16:26:59.225 INFO:tasks.workunit.client.1.smithi157.stdout:2/253: mkdir da/d2b/d59 0 2024-02-28T16:26:59.228 INFO:tasks.workunit.client.0.smithi148.stdout:6/992: mkdir d0/d4/d14/d59/df9/d13d 0 2024-02-28T16:26:59.228 INFO:tasks.workunit.client.1.smithi157.stdout:7/199: dread fd [0,4194304] 0 2024-02-28T16:26:59.230 INFO:tasks.workunit.client.0.smithi148.stdout:4/905: unlink d8/d40/dc3/dd3/f20 0 2024-02-28T16:26:59.232 INFO:tasks.workunit.client.1.smithi157.stdout:7/200: write f0 [6285747,113748] 0 2024-02-28T16:26:59.232 INFO:tasks.workunit.client.1.smithi157.stdout:2/254: truncate da/d35/f36 206995 0 2024-02-28T16:26:59.236 INFO:tasks.workunit.client.1.smithi157.stdout:5/252: truncate d0/d8/f41 679081 0 2024-02-28T16:26:59.236 INFO:tasks.workunit.client.1.smithi157.stdout:4/245: dwrite d3/da/f46 [0,4194304] 0 2024-02-28T16:26:59.238 INFO:tasks.workunit.client.1.smithi157.stdout:4/246: chown d3/c18 9 1 2024-02-28T16:26:59.239 INFO:tasks.workunit.client.1.smithi157.stdout:2/255: mkdir da/d38/d5a 0 2024-02-28T16:26:59.239 INFO:tasks.workunit.client.1.smithi157.stdout:5/253: truncate d0/d9/d1b/d36/f38 943360 0 2024-02-28T16:26:59.241 INFO:tasks.workunit.client.1.smithi157.stdout:5/254: readlink d0/d9/l43 0 2024-02-28T16:26:59.242 INFO:tasks.workunit.client.1.smithi157.stdout:2/256: chown da/d38/f40 0 1 2024-02-28T16:26:59.242 INFO:tasks.workunit.client.1.smithi157.stdout:7/201: creat df/d1f/d24/d39/d41/f45 x:0 0 0 2024-02-28T16:26:59.245 INFO:tasks.workunit.client.1.smithi157.stdout:5/255: readlink d0/d9/d1b/d36/l4c 0 2024-02-28T16:26:59.248 INFO:tasks.workunit.client.1.smithi157.stdout:2/257: unlink da/f27 0 2024-02-28T16:26:59.249 INFO:tasks.workunit.client.1.smithi157.stdout:7/202: readlink df/d1f/l2e 0 2024-02-28T16:26:59.252 INFO:tasks.workunit.client.1.smithi157.stdout:5/256: unlink d0/d9/d1b/f35 0 2024-02-28T16:26:59.255 INFO:tasks.workunit.client.0.smithi148.stdout:4/906: dwrite d8/d21/d3d/d4d/d95/d107/f10e [0,4194304] 0 2024-02-28T16:26:59.255 INFO:tasks.workunit.client.1.smithi157.stdout:5/257: write d0/d8/f2d [3847323,61437] 0 2024-02-28T16:26:59.255 INFO:tasks.workunit.client.1.smithi157.stdout:4/247: dwrite d3/da/d1f/d22/d52/f56 [0,4194304] 0 2024-02-28T16:26:59.258 INFO:tasks.workunit.client.0.smithi148.stdout:4/907: chown d8/d40/dc3/dd3/d17/d6a/d6c/lc2 1671 1 2024-02-28T16:26:59.262 INFO:tasks.workunit.client.1.smithi157.stdout:7/203: mkdir df/d1f/d37/d46 0 2024-02-28T16:26:59.265 INFO:tasks.workunit.client.0.smithi148.stdout:7/989: truncate d0/dc8/fac 1637856 0 2024-02-28T16:26:59.266 INFO:tasks.workunit.client.1.smithi157.stdout:4/248: creat d3/da/d28/f5b x:0 0 0 2024-02-28T16:26:59.267 INFO:tasks.workunit.client.0.smithi148.stdout:7/990: dread - d0/d18/dcd/f132 zero size 2024-02-28T16:26:59.269 INFO:tasks.workunit.client.1.smithi157.stdout:4/249: write d3/f1c [385310,116444] 0 2024-02-28T16:26:59.271 INFO:tasks.workunit.client.0.smithi148.stdout:7/991: read d0/d9/d4c/f6b [2454251,85310] 0 2024-02-28T16:26:59.276 INFO:tasks.workunit.client.1.smithi157.stdout:4/250: rename d3/da/d37/c58 to d3/da/d1f/d22/d52/c5c 0 2024-02-28T16:26:59.277 INFO:tasks.workunit.client.1.smithi157.stdout:4/251: chown d3/da/d37/c57 2078856295 1 2024-02-28T16:26:59.278 INFO:tasks.workunit.client.0.smithi148.stdout:7/992: creat d0/d9/d1b/f135 x:0 0 0 2024-02-28T16:26:59.278 INFO:tasks.workunit.client.1.smithi157.stdout:4/252: chown d3/c18 2575150 1 2024-02-28T16:26:59.281 INFO:tasks.workunit.client.1.smithi157.stdout:4/253: mknod d3/c5d 0 2024-02-28T16:26:59.286 INFO:tasks.workunit.client.1.smithi157.stdout:5/258: dwrite d0/f19 [8388608,4194304] 0 2024-02-28T16:26:59.292 INFO:tasks.workunit.client.1.smithi157.stdout:5/259: creat d0/f5a x:0 0 0 2024-02-28T16:26:59.298 INFO:tasks.workunit.client.1.smithi157.stdout:1/231: truncate f2 2453786 0 2024-02-28T16:26:59.300 INFO:tasks.workunit.client.1.smithi157.stdout:9/188: write d0/f18 [1241160,105312] 0 2024-02-28T16:26:59.301 INFO:tasks.workunit.client.1.smithi157.stdout:4/254: dwrite d3/da/f12 [4194304,4194304] 0 2024-02-28T16:26:59.301 INFO:tasks.workunit.client.1.smithi157.stdout:5/260: chown d0/d9/d47/l57 3209 1 2024-02-28T16:26:59.302 INFO:tasks.workunit.client.1.smithi157.stdout:1/232: read d10/f21 [619175,43874] 0 2024-02-28T16:26:59.303 INFO:tasks.workunit.client.0.smithi148.stdout:5/997: rename d1/d8/d20/l47 to d1/d8/d20/dd8/l139 0 2024-02-28T16:26:59.303 INFO:tasks.workunit.client.1.smithi157.stdout:0/247: write d1/d13/d46/f51 [530781,83710] 0 2024-02-28T16:26:59.305 INFO:tasks.workunit.client.1.smithi157.stdout:3/183: truncate d0/d6/f2d 3216733 0 2024-02-28T16:26:59.305 INFO:tasks.workunit.client.1.smithi157.stdout:5/261: truncate d0/d9/f48 33755 0 2024-02-28T16:26:59.306 INFO:tasks.workunit.client.1.smithi157.stdout:9/189: mknod d0/d36/d37/c41 0 2024-02-28T16:26:59.309 INFO:tasks.workunit.client.1.smithi157.stdout:0/248: chown d1/d13/d46/f4f 10 1 2024-02-28T16:26:59.310 INFO:tasks.workunit.client.1.smithi157.stdout:1/233: symlink d10/d11/l49 0 2024-02-28T16:26:59.312 INFO:tasks.workunit.client.0.smithi148.stdout:5/998: mknod d1/db/d60/d7a/d87/d129/c13a 0 2024-02-28T16:26:59.313 INFO:tasks.workunit.client.1.smithi157.stdout:1/234: dread - d10/d11/d3a/d3e/d46/f45 zero size 2024-02-28T16:26:59.315 INFO:tasks.workunit.client.1.smithi157.stdout:5/262: mkdir d0/d9/d47/d5b 0 2024-02-28T16:26:59.315 INFO:tasks.workunit.client.1.smithi157.stdout:5/263: chown d0/d9/d3a 15753781 1 2024-02-28T16:26:59.317 INFO:tasks.workunit.client.1.smithi157.stdout:0/249: symlink d1/d13/l5a 0 2024-02-28T16:26:59.317 INFO:tasks.workunit.client.0.smithi148.stdout:5/999: mknod d1/db/d60/df0/d63/d117/c13b 0 2024-02-28T16:26:59.318 INFO:tasks.workunit.client.1.smithi157.stdout:1/235: symlink d10/d11/d3a/d3e/l4a 0 2024-02-28T16:26:59.319 INFO:tasks.workunit.client.1.smithi157.stdout:9/190: creat d0/f42 x:0 0 0 2024-02-28T16:26:59.320 INFO:tasks.workunit.client.1.smithi157.stdout:5/264: stat d0/d9/f1d 0 2024-02-28T16:26:59.342 INFO:tasks.workunit.client.0.smithi148.stdout:6/993: dwrite d0/d4/dba/fd5 [0,4194304] 0 2024-02-28T16:26:59.342 INFO:tasks.workunit.client.1.smithi157.stdout:8/157: truncate d1/f2c 562379 0 2024-02-28T16:26:59.344 INFO:tasks.workunit.client.1.smithi157.stdout:1/236: fsync f4 0 2024-02-28T16:26:59.348 INFO:tasks.workunit.client.0.smithi148.stdout:6/994: dread d0/d4/dba/fa0 [0,4194304] 0 2024-02-28T16:26:59.349 INFO:tasks.workunit.client.1.smithi157.stdout:5/265: write d0/d9/d1b/d36/f2a [154797,50125] 0 2024-02-28T16:26:59.353 INFO:tasks.workunit.client.1.smithi157.stdout:0/250: write d1/d8/d33/f49 [1700883,78461] 0 2024-02-28T16:26:59.354 INFO:tasks.workunit.client.0.smithi148.stdout:4/908: write d8/d40/dc3/dd3/da3/f11e [402310,30327] 0 2024-02-28T16:26:59.358 INFO:tasks.workunit.client.1.smithi157.stdout:4/255: dwrite d3/da/ff [0,4194304] 0 2024-02-28T16:26:59.368 INFO:tasks.workunit.client.1.smithi157.stdout:9/191: link d0/f20 d0/d36/d37/f43 0 2024-02-28T16:26:59.373 INFO:tasks.workunit.client.1.smithi157.stdout:7/204: dwrite df/f10 [0,4194304] 0 2024-02-28T16:26:59.374 INFO:tasks.workunit.client.0.smithi148.stdout:4/909: dwrite d8/d40/dc3/dd3/d17/d6a/f100 [0,4194304] 0 2024-02-28T16:26:59.374 INFO:tasks.workunit.client.0.smithi148.stdout:6/995: mknod d0/d22/d25/d76/c13e 0 2024-02-28T16:26:59.374 INFO:tasks.workunit.client.1.smithi157.stdout:2/258: write da/d3a/f43 [4682042,36090] 0 2024-02-28T16:26:59.378 INFO:tasks.workunit.client.0.smithi148.stdout:4/910: stat d8/cd 0 2024-02-28T16:26:59.379 INFO:tasks.workunit.client.1.smithi157.stdout:8/158: getdents d1 0 2024-02-28T16:26:59.380 INFO:tasks.workunit.client.0.smithi148.stdout:6/996: chown d0/d22/d27/d66/d87/c98 0 1 2024-02-28T16:26:59.381 INFO:tasks.workunit.client.1.smithi157.stdout:9/192: rmdir d0/d36/d37 39 2024-02-28T16:26:59.382 INFO:tasks.workunit.client.0.smithi148.stdout:6/997: readlink d0/l2d 0 2024-02-28T16:26:59.383 INFO:tasks.workunit.client.1.smithi157.stdout:9/193: truncate d0/f21 4659268 0 2024-02-28T16:26:59.384 INFO:tasks.workunit.client.0.smithi148.stdout:6/998: write d0/d4/dba/d71/fac [896782,6642] 0 2024-02-28T16:26:59.384 INFO:tasks.workunit.client.1.smithi157.stdout:4/256: rename d3/da/f42 to d3/da/f5e 0 2024-02-28T16:26:59.388 INFO:tasks.workunit.client.1.smithi157.stdout:2/259: chown da/f25 57877554 1 2024-02-28T16:26:59.395 INFO:tasks.workunit.client.1.smithi157.stdout:8/159: rename d1/la to d1/d5/d23/l36 0 2024-02-28T16:26:59.398 INFO:tasks.workunit.client.0.smithi148.stdout:4/911: link d8/d40/dc3/dd3/d17/d6a/f135 d8/d40/dc3/dbd/de3/f13d 0 2024-02-28T16:26:59.402 INFO:tasks.workunit.client.1.smithi157.stdout:6/170: sync 2024-02-28T16:26:59.406 INFO:tasks.workunit.client.1.smithi157.stdout:4/257: rename d3/da/f2b to d3/f5f 0 2024-02-28T16:26:59.407 INFO:tasks.workunit.client.0.smithi148.stdout:4/912: getdents d8/d21/d3d/d4d 0 2024-02-28T16:26:59.407 INFO:tasks.workunit.client.1.smithi157.stdout:1/237: dread d10/d11/d3a/d3e/d46/f26 [0,4194304] 0 2024-02-28T16:26:59.407 INFO:tasks.workunit.client.1.smithi157.stdout:7/205: dwrite df/d1f/d24/f33 [4194304,4194304] 0 2024-02-28T16:26:59.411 INFO:tasks.workunit.client.0.smithi148.stdout:4/913: creat d8/d21/d3d/d4d/d95/f13e x:0 0 0 2024-02-28T16:26:59.412 INFO:tasks.workunit.client.1.smithi157.stdout:9/194: creat d0/d36/d37/d40/f44 x:0 0 0 2024-02-28T16:26:59.413 INFO:tasks.workunit.client.1.smithi157.stdout:9/195: chown d0/d19/c22 32657 1 2024-02-28T16:26:59.415 INFO:tasks.workunit.client.1.smithi157.stdout:8/160: getdents d1/d5/d10 0 2024-02-28T16:26:59.415 INFO:tasks.workunit.client.0.smithi148.stdout:6/999: dread d0/f16 [8388608,4194304] 0 2024-02-28T16:26:59.416 INFO:tasks.workunit.client.1.smithi157.stdout:1/238: creat d10/d11/d3a/f4b x:0 0 0 2024-02-28T16:26:59.419 INFO:tasks.workunit.client.0.smithi148.stdout:4/914: mknod d8/d40/dc3/dd3/da3/c13f 0 2024-02-28T16:26:59.419 INFO:tasks.workunit.client.1.smithi157.stdout:8/161: write d1/f4 [8377724,103887] 0 2024-02-28T16:26:59.421 INFO:tasks.workunit.client.1.smithi157.stdout:7/206: mknod df/d25/c47 0 2024-02-28T16:26:59.421 INFO:tasks.workunit.client.1.smithi157.stdout:5/266: dread d0/fe [0,4194304] 0 2024-02-28T16:26:59.421 INFO:tasks.workunit.client.1.smithi157.stdout:8/162: fsync d1/d5/f16 0 2024-02-28T16:26:59.422 INFO:tasks.workunit.client.1.smithi157.stdout:6/171: link d2/d7/d8/f27 d2/d7/d16/f2f 0 2024-02-28T16:26:59.422 INFO:tasks.workunit.client.1.smithi157.stdout:7/207: write df/f31 [20972,104120] 0 2024-02-28T16:26:59.422 INFO:tasks.workunit.client.0.smithi148.stdout:4/915: read d8/d21/f56 [407133,63471] 0 2024-02-28T16:26:59.423 INFO:tasks.workunit.client.1.smithi157.stdout:6/172: readlink d2/d7/l1c 0 2024-02-28T16:26:59.424 INFO:tasks.workunit.client.1.smithi157.stdout:2/260: rename da/f1d to da/d38/d3e/f5b 0 2024-02-28T16:26:59.427 INFO:tasks.workunit.client.0.smithi148.stdout:4/916: mknod d8/c140 0 2024-02-28T16:26:59.428 INFO:tasks.workunit.client.1.smithi157.stdout:0/251: truncate d1/d8/d33/f50 3444337 0 2024-02-28T16:26:59.430 INFO:tasks.workunit.client.1.smithi157.stdout:1/239: chown l6 8224 1 2024-02-28T16:26:59.431 INFO:tasks.workunit.client.0.smithi148.stdout:4/917: dread - d8/d21/d3d/d4d/dd0/dd4/fdc zero size 2024-02-28T16:26:59.433 INFO:tasks.workunit.client.1.smithi157.stdout:1/240: dread - d10/d11/d3a/d3e/d46/f45 zero size 2024-02-28T16:26:59.433 INFO:tasks.workunit.client.1.smithi157.stdout:5/267: mkdir d0/d9/d47/d5c 0 2024-02-28T16:26:59.434 INFO:tasks.workunit.client.1.smithi157.stdout:8/163: symlink d1/d5/l37 0 2024-02-28T16:26:59.438 INFO:tasks.workunit.client.0.smithi148.stdout:4/918: mknod d8/d21/d3d/dc8/c141 0 2024-02-28T16:26:59.442 INFO:tasks.workunit.client.1.smithi157.stdout:9/196: symlink d0/d36/l45 0 2024-02-28T16:26:59.444 INFO:tasks.workunit.client.0.smithi148.stdout:4/919: dread d8/d21/d3d/d8c/db0/fcd [0,4194304] 0 2024-02-28T16:26:59.446 INFO:tasks.workunit.client.0.smithi148.stdout:4/920: chown d8/d40/dc3/dd3/dea/c125 11635 1 2024-02-28T16:26:59.448 INFO:tasks.workunit.client.1.smithi157.stdout:8/164: mkdir d1/d5/d23/d38 0 2024-02-28T16:26:59.450 INFO:tasks.workunit.client.1.smithi157.stdout:4/258: dread d3/da/f2d [0,4194304] 0 2024-02-28T16:26:59.451 INFO:tasks.workunit.client.1.smithi157.stdout:0/252: unlink d1/d8/f4c 0 2024-02-28T16:26:59.451 INFO:tasks.workunit.client.0.smithi148.stdout:4/921: fdatasync d8/d40/dc3/dd3/d5f/fb5 0 2024-02-28T16:26:59.455 INFO:tasks.workunit.client.1.smithi157.stdout:2/261: write da/f1e [1980174,7777] 0 2024-02-28T16:26:59.456 INFO:tasks.workunit.client.0.smithi148.stdout:4/922: write d8/d21/d3d/d8c/db0/fcd [601818,108274] 0 2024-02-28T16:26:59.459 INFO:tasks.workunit.client.1.smithi157.stdout:7/208: write f3 [3048657,110290] 0 2024-02-28T16:26:59.461 INFO:tasks.workunit.client.1.smithi157.stdout:4/259: rename d3/da/c1b to d3/da/d28/c60 0 2024-02-28T16:26:59.463 INFO:tasks.workunit.client.1.smithi157.stdout:4/260: fdatasync d3/f4 0 2024-02-28T16:26:59.464 INFO:tasks.workunit.client.1.smithi157.stdout:0/253: mknod d1/d8/c5b 0 2024-02-28T16:26:59.465 INFO:tasks.workunit.client.1.smithi157.stdout:1/241: dread d10/d11/d3a/d3e/d46/f1a [0,4194304] 0 2024-02-28T16:26:59.467 INFO:tasks.workunit.client.0.smithi148.stdout:4/923: getdents d8/d21/d3d/d4d/d95 0 2024-02-28T16:26:59.470 INFO:tasks.workunit.client.1.smithi157.stdout:7/209: write fb [1117555,84051] 0 2024-02-28T16:26:59.471 INFO:tasks.workunit.client.1.smithi157.stdout:8/165: link d1/d5/l37 d1/d5/d23/d38/l39 0 2024-02-28T16:26:59.471 INFO:tasks.workunit.client.0.smithi148.stdout:4/924: symlink d8/d21/d3d/d4d/l142 0 2024-02-28T16:26:59.474 INFO:tasks.workunit.client.1.smithi157.stdout:6/173: dwrite d2/d7/d8/f27 [0,4194304] 0 2024-02-28T16:26:59.475 INFO:tasks.workunit.client.1.smithi157.stdout:4/261: mknod d3/da/d48/c61 0 2024-02-28T16:26:59.477 INFO:tasks.workunit.client.0.smithi148.stdout:4/925: creat d8/d21/d3d/d8c/db0/d122/f143 x:0 0 0 2024-02-28T16:26:59.480 INFO:tasks.workunit.client.1.smithi157.stdout:1/242: symlink d10/d11/d3a/d3e/l4c 0 2024-02-28T16:26:59.482 INFO:tasks.workunit.client.1.smithi157.stdout:5/268: dwrite d0/d9/f1d [0,4194304] 0 2024-02-28T16:26:59.482 INFO:tasks.workunit.client.1.smithi157.stdout:7/210: write df/d1f/d24/d39/d41/f45 [415329,118859] 0 2024-02-28T16:26:59.484 INFO:tasks.workunit.client.0.smithi148.stdout:4/926: creat d8/d21/d3d/d4d/dd0/dd4/f144 x:0 0 0 2024-02-28T16:26:59.490 INFO:tasks.workunit.client.0.smithi148.stdout:4/927: rmdir d8/d40/dc3/dd3/dea 39 2024-02-28T16:26:59.492 INFO:tasks.workunit.client.0.smithi148.stdout:4/928: chown d8/d21/f68 41 1 2024-02-28T16:26:59.494 INFO:tasks.workunit.client.0.smithi148.stdout:4/929: mkdir d8/d21/d3d/d145 0 2024-02-28T16:26:59.507 INFO:tasks.workunit.client.0.smithi148.stdout:4/930: dwrite d8/d21/d3d/d4d/dd0/dd4/f144 [0,4194304] 0 2024-02-28T16:26:59.524 INFO:tasks.workunit.client.0.smithi148.stdout:4/931: dread d8/d21/d3d/f64 [0,4194304] 0 2024-02-28T16:26:59.529 INFO:tasks.workunit.client.1.smithi157.stdout:3/184: sync 2024-02-28T16:26:59.529 INFO:tasks.workunit.client.1.smithi157.stdout:2/262: getdents da/d38 0 2024-02-28T16:26:59.530 INFO:tasks.workunit.client.1.smithi157.stdout:5/269: write d0/d9/d47/f55 [532972,2448] 0 2024-02-28T16:26:59.531 INFO:tasks.workunit.client.1.smithi157.stdout:6/174: mkdir d2/d7/d8/da/d29/d2d/d30 0 2024-02-28T16:26:59.532 INFO:tasks.workunit.client.1.smithi157.stdout:1/243: mknod d10/d11/d31/d2a/c4d 0 2024-02-28T16:26:59.533 INFO:tasks.workunit.client.1.smithi157.stdout:0/254: dwrite d1/d13/fe [0,4194304] 0 2024-02-28T16:26:59.535 INFO:tasks.workunit.client.1.smithi157.stdout:2/263: stat da/d35 0 2024-02-28T16:26:59.538 INFO:tasks.workunit.client.1.smithi157.stdout:3/185: creat d0/d6/f3d x:0 0 0 2024-02-28T16:26:59.539 INFO:tasks.workunit.client.1.smithi157.stdout:5/270: fdatasync d0/f19 0 2024-02-28T16:26:59.541 INFO:tasks.workunit.client.0.smithi148.stdout:4/932: dwrite d8/d40/dc3/dbd/de3/f108 [0,4194304] 0 2024-02-28T16:26:59.542 INFO:tasks.workunit.client.1.smithi157.stdout:6/175: mkdir d2/d7/d8/da/d31 0 2024-02-28T16:26:59.544 INFO:tasks.workunit.client.1.smithi157.stdout:3/186: write d0/f1b [972797,13855] 0 2024-02-28T16:26:59.544 INFO:tasks.workunit.client.1.smithi157.stdout:0/255: readlink d1/d8/d27/l28 0 2024-02-28T16:26:59.548 INFO:tasks.workunit.client.1.smithi157.stdout:2/264: mkdir da/d38/d5a/d5c 0 2024-02-28T16:26:59.548 INFO:tasks.workunit.client.1.smithi157.stdout:5/271: write d0/d9/f49 [1526887,46018] 0 2024-02-28T16:26:59.550 INFO:tasks.workunit.client.0.smithi148.stdout:7/993: sync 2024-02-28T16:26:59.551 INFO:tasks.workunit.client.1.smithi157.stdout:6/176: unlink d2/d7/f11 0 2024-02-28T16:26:59.553 INFO:tasks.workunit.client.0.smithi148.stdout:7/994: dread - d0/dc8/f114 zero size 2024-02-28T16:26:59.554 INFO:tasks.workunit.client.1.smithi157.stdout:2/265: write da/d35/f54 [220243,30166] 0 2024-02-28T16:26:59.555 INFO:tasks.workunit.client.0.smithi148.stdout:7/995: write d0/d9/d25/f2f [115659,82293] 0 2024-02-28T16:26:59.557 INFO:tasks.workunit.client.0.smithi148.stdout:4/933: dread d8/d37/fc6 [0,4194304] 0 2024-02-28T16:26:59.559 INFO:tasks.workunit.client.1.smithi157.stdout:3/187: symlink d0/d20/d23/d2b/l3e 0 2024-02-28T16:26:59.559 INFO:tasks.workunit.client.0.smithi148.stdout:7/996: symlink d0/d9/deb/l136 0 2024-02-28T16:26:59.562 INFO:tasks.workunit.client.1.smithi157.stdout:0/256: creat d1/d13/d57/f5c x:0 0 0 2024-02-28T16:26:59.562 INFO:tasks.workunit.client.1.smithi157.stdout:8/166: dwrite d1/d5/d14/f2d [0,4194304] 0 2024-02-28T16:26:59.563 INFO:tasks.workunit.client.0.smithi148.stdout:4/934: mknod d8/d21/d3d/d4d/d66/dad/dfe/c146 0 2024-02-28T16:26:59.564 INFO:tasks.workunit.client.1.smithi157.stdout:7/211: dwrite df/d25/f44 [0,4194304] 0 2024-02-28T16:26:59.564 INFO:tasks.workunit.client.1.smithi157.stdout:6/177: mknod d2/c32 0 2024-02-28T16:26:59.565 INFO:tasks.workunit.client.0.smithi148.stdout:7/997: mknod d0/d9/d25/d96/db7/c137 0 2024-02-28T16:26:59.572 INFO:tasks.workunit.client.0.smithi148.stdout:7/998: truncate d0/d9/d25/d96/ddf/f58 4762100 0 2024-02-28T16:26:59.573 INFO:tasks.workunit.client.1.smithi157.stdout:8/167: write d1/f17 [977698,23752] 0 2024-02-28T16:26:59.575 INFO:tasks.workunit.client.1.smithi157.stdout:1/244: dwrite d10/d11/f2e [0,4194304] 0 2024-02-28T16:26:59.575 INFO:tasks.workunit.client.0.smithi148.stdout:7/999: truncate d0/d9/d4c/ff5 168818 0 2024-02-28T16:26:59.580 INFO:tasks.workunit.client.0.smithi148.stdout:4/935: write d8/d21/f56 [4914796,24024] 0 2024-02-28T16:26:59.584 INFO:tasks.workunit.client.0.smithi148.stdout:4/936: mknod d8/d21/d3d/d8c/db0/d122/c147 0 2024-02-28T16:26:59.592 INFO:tasks.workunit.client.0.smithi148.stdout:4/937: symlink d8/d40/dc3/dd3/l148 0 2024-02-28T16:26:59.592 INFO:tasks.workunit.client.1.smithi157.stdout:5/272: dwrite d0/d9/d47/f56 [0,4194304] 0 2024-02-28T16:26:59.595 INFO:tasks.workunit.client.1.smithi157.stdout:0/257: getdents d1/d13/d52 0 2024-02-28T16:26:59.595 INFO:tasks.workunit.client.1.smithi157.stdout:6/178: creat d2/d7/d16/f33 x:0 0 0 2024-02-28T16:26:59.595 INFO:tasks.workunit.client.1.smithi157.stdout:3/188: dwrite d0/f38 [0,4194304] 0 2024-02-28T16:26:59.602 INFO:tasks.workunit.client.1.smithi157.stdout:0/258: dread - d1/d13/d46/f4f zero size 2024-02-28T16:26:59.602 INFO:tasks.workunit.client.1.smithi157.stdout:6/179: unlink d2/d7/l14 0 2024-02-28T16:26:59.602 INFO:tasks.workunit.client.1.smithi157.stdout:7/212: dwrite df/d25/f44 [4194304,4194304] 0 2024-02-28T16:26:59.604 INFO:tasks.workunit.client.1.smithi157.stdout:6/180: dread - d2/d7/f24 zero size 2024-02-28T16:26:59.604 INFO:tasks.workunit.client.1.smithi157.stdout:2/266: dread da/f2a [0,4194304] 0 2024-02-28T16:26:59.605 INFO:tasks.workunit.client.1.smithi157.stdout:9/197: sync 2024-02-28T16:26:59.607 INFO:tasks.workunit.client.0.smithi148.stdout:4/938: dwrite d8/d21/d3d/d4d/dd0/dd4/f11d [0,4194304] 0 2024-02-28T16:26:59.607 INFO:tasks.workunit.client.1.smithi157.stdout:6/181: dread - d2/d17/f21 zero size 2024-02-28T16:26:59.609 INFO:tasks.workunit.client.1.smithi157.stdout:5/273: link d0/d9/f49 d0/d30/d50/f5d 0 2024-02-28T16:26:59.613 INFO:tasks.workunit.client.0.smithi148.stdout:4/939: symlink d8/d21/d3d/d4d/d72/l149 0 2024-02-28T16:26:59.613 INFO:tasks.workunit.client.1.smithi157.stdout:1/245: write d10/d11/f1c [1197507,98319] 0 2024-02-28T16:26:59.614 INFO:tasks.workunit.client.1.smithi157.stdout:7/213: creat df/d40/f48 x:0 0 0 2024-02-28T16:26:59.616 INFO:tasks.workunit.client.0.smithi148.stdout:4/940: creat d8/d21/d3d/d8c/db0/d122/f14a x:0 0 0 2024-02-28T16:26:59.617 INFO:tasks.workunit.client.1.smithi157.stdout:3/189: creat d0/f3f x:0 0 0 2024-02-28T16:26:59.619 INFO:tasks.workunit.client.1.smithi157.stdout:5/274: write d0/d9/f1f [2315871,30324] 0 2024-02-28T16:26:59.619 INFO:tasks.workunit.client.1.smithi157.stdout:2/267: write da/f12 [6719398,82080] 0 2024-02-28T16:26:59.619 INFO:tasks.workunit.client.0.smithi148.stdout:4/941: creat d8/d37/d91/db2/f14b x:0 0 0 2024-02-28T16:26:59.620 INFO:tasks.workunit.client.1.smithi157.stdout:8/168: truncate d1/f2 2968903 0 2024-02-28T16:26:59.620 INFO:tasks.workunit.client.1.smithi157.stdout:6/182: unlink d2/d17/f23 0 2024-02-28T16:26:59.625 INFO:tasks.workunit.client.1.smithi157.stdout:0/259: creat d1/d8/d33/d56/f5d x:0 0 0 2024-02-28T16:26:59.625 INFO:tasks.workunit.client.1.smithi157.stdout:6/183: dread - d2/d17/f2a zero size 2024-02-28T16:26:59.626 INFO:tasks.workunit.client.1.smithi157.stdout:7/214: unlink df/d1f/c2c 0 2024-02-28T16:26:59.627 INFO:tasks.workunit.client.1.smithi157.stdout:2/268: symlink da/d35/l5d 0 2024-02-28T16:26:59.631 INFO:tasks.workunit.client.1.smithi157.stdout:7/215: read f0 [8103484,93627] 0 2024-02-28T16:26:59.632 INFO:tasks.workunit.client.1.smithi157.stdout:7/216: read f3 [2441397,49203] 0 2024-02-28T16:26:59.633 INFO:tasks.workunit.client.1.smithi157.stdout:1/246: creat d10/d11/d31/d2a/f4e x:0 0 0 2024-02-28T16:26:59.634 INFO:tasks.workunit.client.1.smithi157.stdout:5/275: unlink d0/d8/f46 0 2024-02-28T16:26:59.639 INFO:tasks.workunit.client.1.smithi157.stdout:5/276: write d0/d9/ff [3163356,13507] 0 2024-02-28T16:26:59.641 INFO:tasks.workunit.client.1.smithi157.stdout:6/184: write d2/d7/f15 [1164588,40793] 0 2024-02-28T16:26:59.641 INFO:tasks.workunit.client.1.smithi157.stdout:9/198: dwrite d0/fb [0,4194304] 0 2024-02-28T16:26:59.649 INFO:tasks.workunit.client.0.smithi148.stdout:4/942: write d8/d21/d3d/d4d/dd0/dd4/fdc [19869,34257] 0 2024-02-28T16:26:59.653 INFO:tasks.workunit.client.0.smithi148.stdout:4/943: rename d8/d21/d3d/d4d/dd0/dd4/f144 to d8/d71/f14c 0 2024-02-28T16:26:59.656 INFO:tasks.workunit.client.0.smithi148.stdout:4/944: mknod d8/d40/dc3/d121/c14d 0 2024-02-28T16:26:59.660 INFO:tasks.workunit.client.1.smithi157.stdout:1/247: fdatasync d10/f21 0 2024-02-28T16:26:59.660 INFO:tasks.workunit.client.0.smithi148.stdout:4/945: getdents d8/d40/dc3/d121/d128 0 2024-02-28T16:26:59.664 INFO:tasks.workunit.client.1.smithi157.stdout:6/185: chown d2/d17/f1e 8120737 1 2024-02-28T16:26:59.667 INFO:tasks.workunit.client.1.smithi157.stdout:8/169: getdents d1/d5/d23 0 2024-02-28T16:26:59.668 INFO:tasks.workunit.client.1.smithi157.stdout:2/269: creat da/f5e x:0 0 0 2024-02-28T16:26:59.669 INFO:tasks.workunit.client.0.smithi148.stdout:4/946: write d8/d21/d7e/fbb [335728,55709] 0 2024-02-28T16:26:59.669 INFO:tasks.workunit.client.1.smithi157.stdout:3/190: dwrite d0/d20/d23/d2b/f31 [0,4194304] 0 2024-02-28T16:26:59.671 INFO:tasks.workunit.client.1.smithi157.stdout:0/260: dwrite d1/f24 [0,4194304] 0 2024-02-28T16:26:59.673 INFO:tasks.workunit.client.1.smithi157.stdout:3/191: dread - d0/d6/f3d zero size 2024-02-28T16:26:59.675 INFO:tasks.workunit.client.0.smithi148.stdout:4/947: rename d8/f26 to d8/d21/d3d/d8c/db0/d122/f14e 0 2024-02-28T16:26:59.675 INFO:tasks.workunit.client.1.smithi157.stdout:1/248: write d10/d11/f32 [349777,68268] 0 2024-02-28T16:26:59.677 INFO:tasks.workunit.client.1.smithi157.stdout:8/170: mknod d1/d5/d10/c3a 0 2024-02-28T16:26:59.679 INFO:tasks.workunit.client.0.smithi148.stdout:4/948: symlink d8/d40/dc3/dd3/da3/l14f 0 2024-02-28T16:26:59.684 INFO:tasks.workunit.client.1.smithi157.stdout:8/171: creat d1/d5/f3b x:0 0 0 2024-02-28T16:26:59.685 INFO:tasks.workunit.client.1.smithi157.stdout:0/261: unlink d1/d13/d46/f35 0 2024-02-28T16:26:59.685 INFO:tasks.workunit.client.1.smithi157.stdout:3/192: mknod d0/d6/d1e/c40 0 2024-02-28T16:26:59.685 INFO:tasks.workunit.client.0.smithi148.stdout:4/949: creat d8/d40/dc3/dd3/d5f/f150 x:0 0 0 2024-02-28T16:26:59.688 INFO:tasks.workunit.client.0.smithi148.stdout:4/950: write d8/d71/ff4 [2915616,2326] 0 2024-02-28T16:26:59.690 INFO:tasks.workunit.client.1.smithi157.stdout:1/249: creat d10/d11/d3a/d3e/d46/f4f x:0 0 0 2024-02-28T16:26:59.690 INFO:tasks.workunit.client.1.smithi157.stdout:8/172: chown d1/d5/c1e 674293 1 2024-02-28T16:26:59.690 INFO:tasks.workunit.client.1.smithi157.stdout:9/199: getdents d0/d36/d37/d40 0 2024-02-28T16:26:59.691 INFO:tasks.workunit.client.1.smithi157.stdout:0/262: dread - d1/d8/d33/f39 zero size 2024-02-28T16:26:59.693 INFO:tasks.workunit.client.1.smithi157.stdout:1/250: fdatasync d10/d11/f1c 0 2024-02-28T16:26:59.696 INFO:tasks.workunit.client.1.smithi157.stdout:3/193: symlink d0/l41 0 2024-02-28T16:26:59.699 INFO:tasks.workunit.client.0.smithi148.stdout:4/951: rename d8/d40/dc3/ccb to d8/d40/dc3/dd3/d1f/c151 0 2024-02-28T16:26:59.699 INFO:tasks.workunit.client.1.smithi157.stdout:6/186: dwrite d2/f1f [0,4194304] 0 2024-02-28T16:26:59.699 INFO:tasks.workunit.client.1.smithi157.stdout:2/270: dwrite da/f5e [0,4194304] 0 2024-02-28T16:26:59.701 INFO:tasks.workunit.client.1.smithi157.stdout:6/187: fsync d2/d17/f2a 0 2024-02-28T16:26:59.707 INFO:tasks.workunit.client.1.smithi157.stdout:2/271: chown da/d2b/f50 5 1 2024-02-28T16:26:59.710 INFO:tasks.workunit.client.1.smithi157.stdout:4/262: sync 2024-02-28T16:26:59.711 INFO:tasks.workunit.client.1.smithi157.stdout:4/263: chown d3/da/d1f/f32 0 1 2024-02-28T16:26:59.713 INFO:tasks.workunit.client.1.smithi157.stdout:6/188: readlink d2/d7/de/l22 0 2024-02-28T16:26:59.718 INFO:tasks.workunit.client.1.smithi157.stdout:4/264: unlink d3/da/d28/f41 0 2024-02-28T16:26:59.721 INFO:tasks.workunit.client.1.smithi157.stdout:6/189: creat d2/d17/f34 x:0 0 0 2024-02-28T16:26:59.724 INFO:tasks.workunit.client.1.smithi157.stdout:2/272: mkdir da/d47/d5f 0 2024-02-28T16:26:59.724 INFO:tasks.workunit.client.0.smithi148.stdout:4/952: write d8/d40/dc3/dd3/d17/d6a/f3a [1925959,67865] 0 2024-02-28T16:26:59.727 INFO:tasks.workunit.client.1.smithi157.stdout:0/263: dread d1/f6 [0,4194304] 0 2024-02-28T16:26:59.728 INFO:tasks.workunit.client.1.smithi157.stdout:1/251: rename d10/d11/d31/d2a/c40 to d10/d11/d31/c50 0 2024-02-28T16:26:59.729 INFO:tasks.workunit.client.0.smithi148.stdout:4/953: chown d8/d40/dc3/dd3/f97 25642635 1 2024-02-28T16:26:59.730 INFO:tasks.workunit.client.1.smithi157.stdout:3/194: dwrite d0/f1b [0,4194304] 0 2024-02-28T16:26:59.730 INFO:tasks.workunit.client.1.smithi157.stdout:6/190: truncate d2/d17/f34 264970 0 2024-02-28T16:26:59.731 INFO:tasks.workunit.client.0.smithi148.stdout:4/954: dread - d8/d40/dc3/dd3/d17/d6a/d6c/dda/f12b zero size 2024-02-28T16:26:59.732 INFO:tasks.workunit.client.1.smithi157.stdout:9/200: truncate d0/f3 3295451 0 2024-02-28T16:26:59.732 INFO:tasks.workunit.client.1.smithi157.stdout:1/252: fsync d10/f16 0 2024-02-28T16:26:59.733 INFO:tasks.workunit.client.0.smithi148.stdout:4/955: readlink d8/d40/dc3/dd3/d1f/l80 0 2024-02-28T16:26:59.736 INFO:tasks.workunit.client.1.smithi157.stdout:2/273: chown da/d38/d3e/f5b 13896 1 2024-02-28T16:26:59.737 INFO:tasks.workunit.client.1.smithi157.stdout:9/201: write d0/f33 [877898,36571] 0 2024-02-28T16:26:59.739 INFO:tasks.workunit.client.1.smithi157.stdout:1/253: mknod d10/d11/d3a/d3e/c51 0 2024-02-28T16:26:59.744 INFO:tasks.workunit.client.1.smithi157.stdout:2/274: symlink da/d2b/l60 0 2024-02-28T16:26:59.744 INFO:tasks.workunit.client.1.smithi157.stdout:9/202: rmdir d0/d36/d37 39 2024-02-28T16:26:59.746 INFO:tasks.workunit.client.1.smithi157.stdout:1/254: chown c0 5868004 1 2024-02-28T16:26:59.747 INFO:tasks.workunit.client.1.smithi157.stdout:6/191: creat d2/f35 x:0 0 0 2024-02-28T16:26:59.749 INFO:tasks.workunit.client.1.smithi157.stdout:4/265: dwrite d3/da/d1f/f40 [0,4194304] 0 2024-02-28T16:26:59.751 INFO:tasks.workunit.client.1.smithi157.stdout:2/275: write da/f25 [2375184,44627] 0 2024-02-28T16:26:59.752 INFO:tasks.workunit.client.1.smithi157.stdout:4/266: read d3/f33 [3036338,21418] 0 2024-02-28T16:26:59.754 INFO:tasks.workunit.client.1.smithi157.stdout:2/276: fsync da/d2b/f42 0 2024-02-28T16:26:59.754 INFO:tasks.workunit.client.1.smithi157.stdout:1/255: fdatasync d10/d11/d3a/d3e/d46/f26 0 2024-02-28T16:26:59.757 INFO:tasks.workunit.client.1.smithi157.stdout:9/203: link d0/c1a d0/d19/d30/c46 0 2024-02-28T16:26:59.758 INFO:tasks.workunit.client.0.smithi148.stdout:4/956: dwrite d8/d40/dc3/dd3/d5f/f81 [0,4194304] 0 2024-02-28T16:26:59.758 INFO:tasks.workunit.client.1.smithi157.stdout:4/267: truncate d3/da/f4f 623718 0 2024-02-28T16:26:59.759 INFO:tasks.workunit.client.1.smithi157.stdout:1/256: write d10/d11/d3a/f3c [507479,32311] 0 2024-02-28T16:26:59.760 INFO:tasks.workunit.client.1.smithi157.stdout:0/264: dwrite d1/f15 [0,4194304] 0 2024-02-28T16:26:59.762 INFO:tasks.workunit.client.0.smithi148.stdout:4/957: readlink d8/d40/dc3/dd3/l148 0 2024-02-28T16:26:59.765 INFO:tasks.workunit.client.1.smithi157.stdout:9/204: write d0/f28 [21843,11156] 0 2024-02-28T16:26:59.767 INFO:tasks.workunit.client.0.smithi148.stdout:4/958: rename d8/d37/d91/f9a to d8/d21/d3d/f152 0 2024-02-28T16:26:59.767 INFO:tasks.workunit.client.1.smithi157.stdout:1/257: dread - d10/d11/d31/d2a/f4e zero size 2024-02-28T16:26:59.768 INFO:tasks.workunit.client.1.smithi157.stdout:2/277: rename da/c33 to da/d38/c61 0 2024-02-28T16:26:59.771 INFO:tasks.workunit.client.1.smithi157.stdout:4/268: creat d3/da/d1f/d22/d52/f62 x:0 0 0 2024-02-28T16:26:59.772 INFO:tasks.workunit.client.1.smithi157.stdout:0/265: write d1/d8/d33/f4e [2447531,122335] 0 2024-02-28T16:26:59.775 INFO:tasks.workunit.client.1.smithi157.stdout:1/258: creat d10/d11/d22/f52 x:0 0 0 2024-02-28T16:26:59.776 INFO:tasks.workunit.client.0.smithi148.stdout:4/959: rename d8/d37/d91/lfd to d8/d21/d3d/d8c/l153 0 2024-02-28T16:26:59.777 INFO:tasks.workunit.client.1.smithi157.stdout:9/205: truncate d0/f42 503755 0 2024-02-28T16:26:59.778 INFO:tasks.workunit.client.0.smithi148.stdout:4/960: chown d8/d40/dc3/dd3/d17/d6a/c46 1528 1 2024-02-28T16:26:59.780 INFO:tasks.workunit.client.1.smithi157.stdout:4/269: creat d3/da/d1f/f63 x:0 0 0 2024-02-28T16:26:59.780 INFO:tasks.workunit.client.0.smithi148.stdout:4/961: write d8/d21/d3d/f4c [3484823,54328] 0 2024-02-28T16:26:59.781 INFO:tasks.workunit.client.1.smithi157.stdout:6/192: dread d2/d17/f25 [0,4194304] 0 2024-02-28T16:26:59.783 INFO:tasks.workunit.client.1.smithi157.stdout:2/278: write da/f46 [314557,17815] 0 2024-02-28T16:26:59.783 INFO:tasks.workunit.client.1.smithi157.stdout:0/266: chown d1/d8/d33/f49 9106 1 2024-02-28T16:26:59.784 INFO:tasks.workunit.client.1.smithi157.stdout:1/259: chown c8 0 1 2024-02-28T16:26:59.785 INFO:tasks.workunit.client.1.smithi157.stdout:2/279: chown da/f46 124596 1 2024-02-28T16:26:59.786 INFO:tasks.workunit.client.1.smithi157.stdout:6/193: chown d2/d17/f1e 1 1 2024-02-28T16:26:59.787 INFO:tasks.workunit.client.1.smithi157.stdout:4/270: chown d3/da/d28/f3e 6 1 2024-02-28T16:26:59.789 INFO:tasks.workunit.client.1.smithi157.stdout:1/260: creat d10/d11/d3a/d3e/f53 x:0 0 0 2024-02-28T16:26:59.790 INFO:tasks.workunit.client.1.smithi157.stdout:6/194: dread - d2/d17/f1e zero size 2024-02-28T16:26:59.790 INFO:tasks.workunit.client.1.smithi157.stdout:4/271: chown d3/da/fd 197317264 1 2024-02-28T16:26:59.791 INFO:tasks.workunit.client.1.smithi157.stdout:0/267: creat d1/f5e x:0 0 0 2024-02-28T16:26:59.792 INFO:tasks.workunit.client.1.smithi157.stdout:2/280: write da/f2c [3810452,75833] 0 2024-02-28T16:26:59.793 INFO:tasks.workunit.client.1.smithi157.stdout:6/195: fdatasync d2/f35 0 2024-02-28T16:26:59.795 INFO:tasks.workunit.client.1.smithi157.stdout:4/272: symlink d3/da/d37/l64 0 2024-02-28T16:26:59.796 INFO:tasks.workunit.client.1.smithi157.stdout:6/196: fdatasync d2/f35 0 2024-02-28T16:26:59.801 INFO:tasks.workunit.client.1.smithi157.stdout:2/281: write da/d35/f36 [434325,77923] 0 2024-02-28T16:26:59.803 INFO:tasks.workunit.client.1.smithi157.stdout:6/197: write d2/d17/f25 [4238403,120767] 0 2024-02-28T16:26:59.806 INFO:tasks.workunit.client.1.smithi157.stdout:9/206: dwrite d0/d19/d30/f32 [0,4194304] 0 2024-02-28T16:26:59.806 INFO:tasks.workunit.client.1.smithi157.stdout:0/268: link d1/d8/d27/f2b d1/d8/d27/d55/f5f 0 2024-02-28T16:26:59.807 INFO:tasks.workunit.client.1.smithi157.stdout:2/282: unlink l6 0 2024-02-28T16:26:59.809 INFO:tasks.workunit.client.1.smithi157.stdout:1/261: link d10/d11/d31/d2a/c4d d10/d11/d3a/d3e/d46/c54 0 2024-02-28T16:26:59.811 INFO:tasks.workunit.client.1.smithi157.stdout:2/283: rmdir da/d47 39 2024-02-28T16:26:59.812 INFO:tasks.workunit.client.1.smithi157.stdout:0/269: chown d1/d8/c1a 13925 1 2024-02-28T16:26:59.812 INFO:tasks.workunit.client.1.smithi157.stdout:1/262: truncate d10/d11/d3a/f3c 992075 0 2024-02-28T16:26:59.815 INFO:tasks.workunit.client.1.smithi157.stdout:9/207: truncate d0/d36/d37/f43 1466539 0 2024-02-28T16:26:59.816 INFO:tasks.workunit.client.1.smithi157.stdout:2/284: symlink da/d38/d5a/l62 0 2024-02-28T16:26:59.817 INFO:tasks.workunit.client.1.smithi157.stdout:1/263: truncate d10/d11/d31/d2a/f4e 621786 0 2024-02-28T16:26:59.819 INFO:tasks.workunit.client.1.smithi157.stdout:4/273: dwrite d3/da/d1f/d22/f3d [0,4194304] 0 2024-02-28T16:26:59.820 INFO:tasks.workunit.client.1.smithi157.stdout:1/264: write d10/d11/d3a/f3c [1521894,115327] 0 2024-02-28T16:26:59.822 INFO:tasks.workunit.client.1.smithi157.stdout:6/198: truncate d2/d7/d8/f27 2059038 0 2024-02-28T16:26:59.827 INFO:tasks.workunit.client.1.smithi157.stdout:2/285: creat da/d38/d4e/f63 x:0 0 0 2024-02-28T16:26:59.829 INFO:tasks.workunit.client.1.smithi157.stdout:4/274: dread d3/da/d1f/d22/f3c [0,4194304] 0 2024-02-28T16:26:59.829 INFO:tasks.workunit.client.1.smithi157.stdout:7/217: sync 2024-02-28T16:26:59.830 INFO:tasks.workunit.client.1.smithi157.stdout:9/208: link d0/d19/f29 d0/d36/d37/f47 0 2024-02-28T16:26:59.831 INFO:tasks.workunit.client.1.smithi157.stdout:2/286: dread - da/d38/f40 zero size 2024-02-28T16:26:59.835 INFO:tasks.workunit.client.1.smithi157.stdout:7/218: write df/d25/f44 [1401634,99809] 0 2024-02-28T16:26:59.835 INFO:tasks.workunit.client.1.smithi157.stdout:1/265: link d10/d11/d3a/f4b d10/d11/d31/d2a/f55 0 2024-02-28T16:26:59.836 INFO:tasks.workunit.client.1.smithi157.stdout:6/199: symlink d2/d7/d8/da/d29/d2d/d30/l36 0 2024-02-28T16:26:59.836 INFO:tasks.workunit.client.1.smithi157.stdout:4/275: dread - d3/da/d28/f5a zero size 2024-02-28T16:26:59.840 INFO:tasks.workunit.client.1.smithi157.stdout:0/270: dwrite d1/d8/d33/f39 [0,4194304] 0 2024-02-28T16:26:59.846 INFO:tasks.workunit.client.1.smithi157.stdout:7/219: creat df/d1f/d37/f49 x:0 0 0 2024-02-28T16:26:59.848 INFO:tasks.workunit.client.1.smithi157.stdout:4/276: creat d3/da/d1f/d22/d52/f65 x:0 0 0 2024-02-28T16:26:59.849 INFO:tasks.workunit.client.1.smithi157.stdout:7/220: chown df/l32 17 1 2024-02-28T16:26:59.852 INFO:tasks.workunit.client.1.smithi157.stdout:2/287: read da/f34 [2961104,128622] 0 2024-02-28T16:26:59.856 INFO:tasks.workunit.client.1.smithi157.stdout:4/277: getdents d3/da/d48 0 2024-02-28T16:26:59.858 INFO:tasks.workunit.client.1.smithi157.stdout:2/288: write da/d35/f54 [329700,13013] 0 2024-02-28T16:26:59.860 INFO:tasks.workunit.client.1.smithi157.stdout:7/221: dread df/f1a [0,4194304] 0 2024-02-28T16:26:59.863 INFO:tasks.workunit.client.1.smithi157.stdout:2/289: chown da/d2b/f3f 21333325 1 2024-02-28T16:26:59.863 INFO:tasks.workunit.client.1.smithi157.stdout:6/200: dread d2/d17/f25 [0,4194304] 0 2024-02-28T16:26:59.865 INFO:tasks.workunit.client.1.smithi157.stdout:1/266: dread f2 [0,4194304] 0 2024-02-28T16:26:59.866 INFO:tasks.workunit.client.1.smithi157.stdout:7/222: symlink df/d1f/d24/d39/d41/l4a 0 2024-02-28T16:26:59.867 INFO:tasks.workunit.client.1.smithi157.stdout:1/267: stat d10/d11/d31/f42 0 2024-02-28T16:26:59.867 INFO:tasks.workunit.client.1.smithi157.stdout:7/223: chown df/f16 221 1 2024-02-28T16:26:59.868 INFO:tasks.workunit.client.1.smithi157.stdout:2/290: creat da/d2b/d59/f64 x:0 0 0 2024-02-28T16:26:59.868 INFO:tasks.workunit.client.1.smithi157.stdout:6/201: write d2/d17/f25 [4424445,72419] 0 2024-02-28T16:26:59.868 INFO:tasks.workunit.client.1.smithi157.stdout:4/278: dread d3/da/f35 [0,4194304] 0 2024-02-28T16:26:59.870 INFO:tasks.workunit.client.1.smithi157.stdout:7/224: stat df/d25/c36 0 2024-02-28T16:26:59.872 INFO:tasks.workunit.client.1.smithi157.stdout:2/291: mkdir da/d65 0 2024-02-28T16:26:59.873 INFO:tasks.workunit.client.1.smithi157.stdout:1/268: symlink d10/d11/d31/d2a/l56 0 2024-02-28T16:26:59.875 INFO:tasks.workunit.client.1.smithi157.stdout:7/225: rmdir df/d1f/d24/d38 39 2024-02-28T16:26:59.880 INFO:tasks.workunit.client.1.smithi157.stdout:6/202: rename d2/d7/d8/da/d29 to d2/d7/d8/da/d31/d37 0 2024-02-28T16:26:59.883 INFO:tasks.workunit.client.1.smithi157.stdout:7/226: mkdir df/d4b 0 2024-02-28T16:26:59.884 INFO:tasks.workunit.client.1.smithi157.stdout:9/209: dwrite d0/d36/d37/f43 [0,4194304] 0 2024-02-28T16:26:59.888 INFO:tasks.workunit.client.1.smithi157.stdout:6/203: write d2/d17/f25 [1156465,124888] 0 2024-02-28T16:26:59.888 INFO:tasks.workunit.client.1.smithi157.stdout:7/227: write df/d25/f44 [9130388,98393] 0 2024-02-28T16:26:59.894 INFO:tasks.workunit.client.1.smithi157.stdout:1/269: rename l1 to d10/d11/d3a/d3e/l57 0 2024-02-28T16:26:59.896 INFO:tasks.workunit.client.1.smithi157.stdout:7/228: fsync f0 0 2024-02-28T16:26:59.899 INFO:tasks.workunit.client.1.smithi157.stdout:9/210: link d0/f5 d0/d19/d30/f48 0 2024-02-28T16:26:59.901 INFO:tasks.workunit.client.1.smithi157.stdout:1/270: write d10/d11/d3a/d3e/d46/f45 [608920,44739] 0 2024-02-28T16:26:59.901 INFO:tasks.workunit.client.1.smithi157.stdout:6/204: mkdir d2/d7/d38 0 2024-02-28T16:26:59.903 INFO:tasks.workunit.client.1.smithi157.stdout:7/229: mkdir df/d4b/d4c 0 2024-02-28T16:26:59.903 INFO:tasks.workunit.client.1.smithi157.stdout:4/279: dread d3/f2e [0,4194304] 0 2024-02-28T16:26:59.904 INFO:tasks.workunit.client.1.smithi157.stdout:2/292: dread da/f1f [0,4194304] 0 2024-02-28T16:26:59.904 INFO:tasks.workunit.client.1.smithi157.stdout:6/205: dread - d2/d17/f1e zero size 2024-02-28T16:26:59.905 INFO:tasks.workunit.client.1.smithi157.stdout:9/211: creat d0/d36/d37/d40/f49 x:0 0 0 2024-02-28T16:26:59.906 INFO:tasks.workunit.client.1.smithi157.stdout:1/271: write d10/d11/d31/d2a/f2d [427242,77782] 0 2024-02-28T16:26:59.907 INFO:tasks.workunit.client.1.smithi157.stdout:4/280: readlink d3/da/d28/l2c 0 2024-02-28T16:26:59.907 INFO:tasks.workunit.client.1.smithi157.stdout:9/212: stat d0/d36/l45 0 2024-02-28T16:26:59.907 INFO:tasks.workunit.client.1.smithi157.stdout:7/230: write df/d1f/d24/f35 [2001595,1764] 0 2024-02-28T16:26:59.910 INFO:tasks.workunit.client.1.smithi157.stdout:6/206: rename l1 to d2/d7/d8/da/d31/l39 0 2024-02-28T16:26:59.910 INFO:tasks.workunit.client.1.smithi157.stdout:7/231: chown df/d25/f44 2 1 2024-02-28T16:26:59.911 INFO:tasks.workunit.client.1.smithi157.stdout:1/272: write d10/d11/d31/f42 [1040775,42055] 0 2024-02-28T16:26:59.911 INFO:tasks.workunit.client.1.smithi157.stdout:2/293: creat da/d38/d5a/f66 x:0 0 0 2024-02-28T16:26:59.914 INFO:tasks.workunit.client.1.smithi157.stdout:9/213: symlink d0/d36/d37/d40/l4a 0 2024-02-28T16:26:59.915 INFO:tasks.workunit.client.1.smithi157.stdout:4/281: fsync d3/da/d1f/f29 0 2024-02-28T16:26:59.916 INFO:tasks.workunit.client.1.smithi157.stdout:2/294: readlink da/ld 0 2024-02-28T16:26:59.917 INFO:tasks.workunit.client.1.smithi157.stdout:7/232: mknod df/d1f/c4d 0 2024-02-28T16:26:59.923 INFO:tasks.workunit.client.1.smithi157.stdout:6/207: rename d2/d7/d16 to d2/d7/d8/da/d31/d3a 0 2024-02-28T16:26:59.925 INFO:tasks.workunit.client.1.smithi157.stdout:4/282: creat d3/da/d48/f66 x:0 0 0 2024-02-28T16:26:59.926 INFO:tasks.workunit.client.1.smithi157.stdout:7/233: mkdir df/d25/d4e 0 2024-02-28T16:26:59.927 INFO:tasks.workunit.client.1.smithi157.stdout:2/295: mkdir da/d47/d67 0 2024-02-28T16:26:59.928 INFO:tasks.workunit.client.1.smithi157.stdout:4/283: chown d3/da/f4f 1314310641 1 2024-02-28T16:26:59.928 INFO:tasks.workunit.client.1.smithi157.stdout:6/208: creat d2/d7/d8/da/d31/d37/d2d/f3b x:0 0 0 2024-02-28T16:26:59.929 INFO:tasks.workunit.client.1.smithi157.stdout:1/273: truncate d10/d11/f32 114643 0 2024-02-28T16:26:59.932 INFO:tasks.workunit.client.1.smithi157.stdout:2/296: dread - da/d38/f57 zero size 2024-02-28T16:26:59.933 INFO:tasks.workunit.client.1.smithi157.stdout:6/209: dread d2/d17/f34 [0,4194304] 0 2024-02-28T16:26:59.933 INFO:tasks.workunit.client.1.smithi157.stdout:4/284: write d3/da/d1f/f63 [648461,90113] 0 2024-02-28T16:26:59.933 INFO:tasks.workunit.client.1.smithi157.stdout:9/214: dwrite d0/d36/d37/d40/f44 [0,4194304] 0 2024-02-28T16:26:59.933 INFO:tasks.workunit.client.1.smithi157.stdout:7/234: mkdir df/d1f/d24/d4f 0 2024-02-28T16:26:59.937 INFO:tasks.workunit.client.1.smithi157.stdout:7/235: write df/d40/f48 [1040453,61088] 0 2024-02-28T16:26:59.939 INFO:tasks.workunit.client.1.smithi157.stdout:4/285: creat d3/da/d1f/f67 x:0 0 0 2024-02-28T16:26:59.943 INFO:tasks.workunit.client.1.smithi157.stdout:2/297: creat da/d47/d67/f68 x:0 0 0 2024-02-28T16:26:59.945 INFO:tasks.workunit.client.1.smithi157.stdout:7/236: symlink df/d1f/d37/l50 0 2024-02-28T16:26:59.946 INFO:tasks.workunit.client.1.smithi157.stdout:4/286: rename d3/da/d28/l2c to d3/da/d1f/l68 0 2024-02-28T16:26:59.948 INFO:tasks.workunit.client.1.smithi157.stdout:2/298: mkdir da/d38/d5a/d69 0 2024-02-28T16:26:59.950 INFO:tasks.workunit.client.1.smithi157.stdout:6/210: creat d2/d7/f3c x:0 0 0 2024-02-28T16:26:59.951 INFO:tasks.workunit.client.1.smithi157.stdout:7/237: creat df/d1f/d24/d38/f51 x:0 0 0 2024-02-28T16:26:59.953 INFO:tasks.workunit.client.1.smithi157.stdout:6/211: write d2/d7/f15 [1136064,83302] 0 2024-02-28T16:26:59.955 INFO:tasks.workunit.client.1.smithi157.stdout:9/215: dwrite d0/d36/d37/f43 [0,4194304] 0 2024-02-28T16:26:59.955 INFO:tasks.workunit.client.1.smithi157.stdout:6/212: fdatasync d2/f5 0 2024-02-28T16:26:59.955 INFO:tasks.workunit.client.1.smithi157.stdout:2/299: rename da/d2b/c45 to da/d38/d5a/d69/c6a 0 2024-02-28T16:26:59.957 INFO:tasks.workunit.client.1.smithi157.stdout:5/277: sync 2024-02-28T16:26:59.959 INFO:tasks.workunit.client.1.smithi157.stdout:6/213: read d2/f5 [5943960,47670] 0 2024-02-28T16:26:59.962 INFO:tasks.workunit.client.1.smithi157.stdout:5/278: chown d0/d9/d1b/c3b 1 1 2024-02-28T16:26:59.962 INFO:tasks.workunit.client.1.smithi157.stdout:6/214: chown d2/d7/d8/da 118 1 2024-02-28T16:26:59.964 INFO:tasks.workunit.client.1.smithi157.stdout:7/238: rename df/d1f/d24/f35 to df/d25/d4e/f52 0 2024-02-28T16:26:59.965 INFO:tasks.workunit.client.1.smithi157.stdout:6/215: truncate d2/d17/f2a 656822 0 2024-02-28T16:26:59.965 INFO:tasks.workunit.client.1.smithi157.stdout:2/300: symlink da/d38/d5a/d5c/l6b 0 2024-02-28T16:26:59.965 INFO:tasks.workunit.client.1.smithi157.stdout:4/287: write d3/da/d48/d4a/f4c [579872,25357] 0 2024-02-28T16:26:59.968 INFO:tasks.workunit.client.1.smithi157.stdout:6/216: dread - d2/d7/f24 zero size 2024-02-28T16:26:59.970 INFO:tasks.workunit.client.1.smithi157.stdout:5/279: rename d0/d9/d1b/d36/l24 to d0/d30/l5e 0 2024-02-28T16:26:59.972 INFO:tasks.workunit.client.1.smithi157.stdout:5/280: fsync d0/d9/ff 0 2024-02-28T16:26:59.972 INFO:tasks.workunit.client.1.smithi157.stdout:2/301: mknod da/d38/d3e/c6c 0 2024-02-28T16:26:59.981 INFO:tasks.workunit.client.1.smithi157.stdout:2/302: dread - da/d38/d5a/f66 zero size 2024-02-28T16:26:59.981 INFO:tasks.workunit.client.1.smithi157.stdout:5/281: chown d0/d9/d47/f55 1969516829 1 2024-02-28T16:26:59.983 INFO:tasks.workunit.client.1.smithi157.stdout:9/216: dwrite d0/d19/f1e [0,4194304] 0 2024-02-28T16:26:59.992 INFO:tasks.workunit.client.1.smithi157.stdout:2/303: rename da/d47/l4b to da/d38/d5a/l6d 0 2024-02-28T16:26:59.994 INFO:tasks.workunit.client.1.smithi157.stdout:9/217: mkdir d0/d36/d37/d40/d4b 0 2024-02-28T16:26:59.994 INFO:tasks.workunit.client.1.smithi157.stdout:7/239: dwrite df/f16 [0,4194304] 0 2024-02-28T16:26:59.997 INFO:tasks.workunit.client.1.smithi157.stdout:2/304: rmdir da/d47 39 2024-02-28T16:26:59.999 INFO:tasks.workunit.client.1.smithi157.stdout:6/217: dwrite d2/d7/fc [0,4194304] 0 2024-02-28T16:27:00.006 INFO:tasks.workunit.client.1.smithi157.stdout:4/288: dread d3/da/d1f/f26 [0,4194304] 0 2024-02-28T16:27:00.010 INFO:tasks.workunit.client.1.smithi157.stdout:2/305: read da/d3a/f49 [2777107,12176] 0 2024-02-28T16:27:00.010 INFO:tasks.workunit.client.1.smithi157.stdout:7/240: creat df/d1f/d24/f53 x:0 0 0 2024-02-28T16:27:00.014 INFO:tasks.workunit.client.1.smithi157.stdout:5/282: dread d0/f19 [8388608,4194304] 0 2024-02-28T16:27:00.015 INFO:tasks.workunit.client.1.smithi157.stdout:4/289: chown d3/da/d1f/c34 808159 1 2024-02-28T16:27:00.015 INFO:tasks.workunit.client.1.smithi157.stdout:7/241: chown df/f11 12430290 1 2024-02-28T16:27:00.016 INFO:tasks.workunit.client.1.smithi157.stdout:2/306: fdatasync da/f1f 0 2024-02-28T16:27:00.020 INFO:tasks.workunit.client.1.smithi157.stdout:7/242: mknod df/c54 0 2024-02-28T16:27:00.022 INFO:tasks.workunit.client.1.smithi157.stdout:5/283: rename d0/d8/f26 to d0/d30/f5f 0 2024-02-28T16:27:00.024 INFO:tasks.workunit.client.1.smithi157.stdout:7/243: dread - df/d1f/d24/f53 zero size 2024-02-28T16:27:00.030 INFO:tasks.workunit.client.1.smithi157.stdout:7/244: creat df/d4b/d4c/f55 x:0 0 0 2024-02-28T16:27:00.031 INFO:tasks.workunit.client.1.smithi157.stdout:6/218: dwrite d2/d7/d8/f1a [0,4194304] 0 2024-02-28T16:27:00.032 INFO:tasks.workunit.client.1.smithi157.stdout:5/284: dread d0/d8/f41 [0,4194304] 0 2024-02-28T16:27:00.036 INFO:tasks.workunit.client.1.smithi157.stdout:5/285: fsync d0/d9/f1f 0 2024-02-28T16:27:00.040 INFO:tasks.workunit.client.1.smithi157.stdout:7/245: symlink df/d1f/d24/d4f/l56 0 2024-02-28T16:27:00.040 INFO:tasks.workunit.client.1.smithi157.stdout:4/290: dread d3/da/d1f/f40 [0,4194304] 0 2024-02-28T16:27:00.041 INFO:tasks.workunit.client.1.smithi157.stdout:5/286: symlink d0/d9/d3a/l60 0 2024-02-28T16:27:00.042 INFO:tasks.workunit.client.1.smithi157.stdout:2/307: dwrite da/f1f [4194304,4194304] 0 2024-02-28T16:27:00.046 INFO:tasks.workunit.client.1.smithi157.stdout:4/291: symlink d3/da/d37/l69 0 2024-02-28T16:27:00.048 INFO:tasks.workunit.client.1.smithi157.stdout:7/246: chown df/d1f/c20 2354873 1 2024-02-28T16:27:00.048 INFO:tasks.workunit.client.1.smithi157.stdout:5/287: mkdir d0/d8/d51/d61 0 2024-02-28T16:27:00.049 INFO:tasks.workunit.client.0.smithi148.stdout:4/962: sync 2024-02-28T16:27:00.055 INFO:tasks.workunit.client.1.smithi157.stdout:7/247: unlink df/d1f/d24/l30 0 2024-02-28T16:27:00.057 INFO:tasks.workunit.client.0.smithi148.stdout:4/963: mknod d8/d21/d3d/d4d/d95/d107/c154 0 2024-02-28T16:27:00.057 INFO:tasks.workunit.client.1.smithi157.stdout:4/292: chown d3/da/d1f/d22/d52/c5c 335 1 2024-02-28T16:27:00.062 INFO:tasks.workunit.client.1.smithi157.stdout:6/219: dwrite d2/d7/d8/da/d31/d37/d2d/f3b [0,4194304] 0 2024-02-28T16:27:00.062 INFO:tasks.workunit.client.0.smithi148.stdout:4/964: mkdir d8/d21/d3d/d8c/db0/d122/d155 0 2024-02-28T16:27:00.063 INFO:tasks.workunit.client.1.smithi157.stdout:7/248: write df/d1f/d24/d39/d41/f45 [1261885,97715] 0 2024-02-28T16:27:00.065 INFO:tasks.workunit.client.1.smithi157.stdout:3/195: sync 2024-02-28T16:27:00.065 INFO:tasks.workunit.client.1.smithi157.stdout:8/173: sync 2024-02-28T16:27:00.066 INFO:tasks.workunit.client.1.smithi157.stdout:5/288: rmdir d0 39 2024-02-28T16:27:00.067 INFO:tasks.workunit.client.0.smithi148.stdout:4/965: rmdir d8/d21/d3d/d8c/db0/d122/d155 0 2024-02-28T16:27:00.069 INFO:tasks.workunit.client.1.smithi157.stdout:9/218: dread d0/f1f [0,4194304] 0 2024-02-28T16:27:00.070 INFO:tasks.workunit.client.0.smithi148.stdout:4/966: write d8/d21/d3d/d8c/db0/d122/f143 [752059,75909] 0 2024-02-28T16:27:00.073 INFO:tasks.workunit.client.1.smithi157.stdout:4/293: chown d3/da/d1f/d22/d52/c54 1941492 1 2024-02-28T16:27:00.074 INFO:tasks.workunit.client.1.smithi157.stdout:2/308: dwrite da/f23 [4194304,4194304] 0 2024-02-28T16:27:00.074 INFO:tasks.workunit.client.1.smithi157.stdout:8/174: creat d1/f3c x:0 0 0 2024-02-28T16:27:00.075 INFO:tasks.workunit.client.1.smithi157.stdout:7/249: read df/d1f/d24/d38/f43 [183470,13451] 0 2024-02-28T16:27:00.076 INFO:tasks.workunit.client.1.smithi157.stdout:5/289: write d0/d9/f2c [3346225,76194] 0 2024-02-28T16:27:00.076 INFO:tasks.workunit.client.1.smithi157.stdout:6/220: mkdir d2/d7/de/d1b/d3d 0 2024-02-28T16:27:00.077 INFO:tasks.workunit.client.0.smithi148.stdout:4/967: creat d8/d21/d3d/d4d/d95/d107/f156 x:0 0 0 2024-02-28T16:27:00.080 INFO:tasks.workunit.client.1.smithi157.stdout:9/219: fdatasync d0/f5 0 2024-02-28T16:27:00.080 INFO:tasks.workunit.client.1.smithi157.stdout:2/309: readlink da/d38/l55 0 2024-02-28T16:27:00.082 INFO:tasks.workunit.client.1.smithi157.stdout:4/294: read d3/da/d1f/d22/f3c [120525,103280] 0 2024-02-28T16:27:00.083 INFO:tasks.workunit.client.1.smithi157.stdout:8/175: dread - d1/d5/f31 zero size 2024-02-28T16:27:00.083 INFO:tasks.workunit.client.0.smithi148.stdout:4/968: mkdir d8/d21/d3d/d4d/d66/dad/dfe/d157 0 2024-02-28T16:27:00.084 INFO:tasks.workunit.client.1.smithi157.stdout:5/290: symlink d0/d8/l62 0 2024-02-28T16:27:00.086 INFO:tasks.workunit.client.1.smithi157.stdout:4/295: fsync d3/da/f4f 0 2024-02-28T16:27:00.086 INFO:tasks.workunit.client.1.smithi157.stdout:8/176: chown d1/d5/l1b 132299570 1 2024-02-28T16:27:00.087 INFO:tasks.workunit.client.0.smithi148.stdout:4/969: read d8/d40/dc3/dd3/d17/d6a/f50 [4709012,113453] 0 2024-02-28T16:27:00.088 INFO:tasks.workunit.client.1.smithi157.stdout:2/310: mknod da/d35/c6e 0 2024-02-28T16:27:00.088 INFO:tasks.workunit.client.1.smithi157.stdout:4/296: readlink d3/da/d37/l3a 0 2024-02-28T16:27:00.088 INFO:tasks.workunit.client.1.smithi157.stdout:2/311: fsync da/f46 0 2024-02-28T16:27:00.089 INFO:tasks.workunit.client.1.smithi157.stdout:8/177: stat d1/d5/d23/d38 0 2024-02-28T16:27:00.089 INFO:tasks.workunit.client.0.smithi148.stdout:4/970: fsync d8/f105 0 2024-02-28T16:27:00.090 INFO:tasks.workunit.client.1.smithi157.stdout:4/297: fsync d3/da/d1f/d22/f44 0 2024-02-28T16:27:00.091 INFO:tasks.workunit.client.1.smithi157.stdout:9/220: rename d0/d36/d37/f47 to d0/d19/d30/f4c 0 2024-02-28T16:27:00.095 INFO:tasks.workunit.client.1.smithi157.stdout:6/221: dread d2/f1f [0,4194304] 0 2024-02-28T16:27:00.096 INFO:tasks.workunit.client.1.smithi157.stdout:8/178: unlink d1/d5/l1b 0 2024-02-28T16:27:00.097 INFO:tasks.workunit.client.1.smithi157.stdout:4/298: symlink d3/da/d37/l6a 0 2024-02-28T16:27:00.097 INFO:tasks.workunit.client.1.smithi157.stdout:8/179: write d1/f17 [1101698,5828] 0 2024-02-28T16:27:00.100 INFO:tasks.workunit.client.1.smithi157.stdout:8/180: dread - d1/d5/f3b zero size 2024-02-28T16:27:00.100 INFO:tasks.workunit.client.1.smithi157.stdout:5/291: creat d0/d30/d50/f63 x:0 0 0 2024-02-28T16:27:00.101 INFO:tasks.workunit.client.1.smithi157.stdout:9/221: mkdir d0/d36/d37/d4d 0 2024-02-28T16:27:00.101 INFO:tasks.workunit.client.1.smithi157.stdout:8/181: stat d1/d5/f31 0 2024-02-28T16:27:00.103 INFO:tasks.workunit.client.1.smithi157.stdout:2/312: rename da/d2b/f42 to da/d38/f6f 0 2024-02-28T16:27:00.103 INFO:tasks.workunit.client.1.smithi157.stdout:4/299: write d3/da/d1f/d22/d52/f56 [2832977,75268] 0 2024-02-28T16:27:00.105 INFO:tasks.workunit.client.1.smithi157.stdout:2/313: chown da/d2b/l60 1565 1 2024-02-28T16:27:00.106 INFO:tasks.workunit.client.1.smithi157.stdout:6/222: creat d2/d7/d8/da/d31/d37/d2d/d30/f3e x:0 0 0 2024-02-28T16:27:00.106 INFO:tasks.workunit.client.1.smithi157.stdout:9/222: truncate d0/d36/d37/f43 4351018 0 2024-02-28T16:27:00.107 INFO:tasks.workunit.client.0.smithi148.stdout:4/971: dwrite d8/d21/d3d/d8c/fd7 [0,4194304] 0 2024-02-28T16:27:00.108 INFO:tasks.workunit.client.1.smithi157.stdout:8/182: mknod d1/c3d 0 2024-02-28T16:27:00.109 INFO:tasks.workunit.client.0.smithi148.stdout:4/972: stat d8/d71/d85/fc7 0 2024-02-28T16:27:00.110 INFO:tasks.workunit.client.1.smithi157.stdout:7/250: getdents df/d1f/d37 0 2024-02-28T16:27:00.111 INFO:tasks.workunit.client.1.smithi157.stdout:3/196: dread d0/d6/f15 [0,4194304] 0 2024-02-28T16:27:00.112 INFO:tasks.workunit.client.0.smithi148.stdout:4/973: write d8/d21/d3d/d4d/d95/f12a [756159,19986] 0 2024-02-28T16:27:00.112 INFO:tasks.workunit.client.1.smithi157.stdout:2/314: write da/d3a/f49 [2194856,40249] 0 2024-02-28T16:27:00.113 INFO:tasks.workunit.client.1.smithi157.stdout:5/292: rename d0/d8/l39 to d0/d9/d47/d5c/l64 0 2024-02-28T16:27:00.115 INFO:tasks.workunit.client.1.smithi157.stdout:8/183: mkdir d1/d5/d14/d3e 0 2024-02-28T16:27:00.115 INFO:tasks.workunit.client.1.smithi157.stdout:5/293: chown d0/d9/d3a/l60 6658455 1 2024-02-28T16:27:00.118 INFO:tasks.workunit.client.0.smithi148.stdout:4/974: creat d8/d21/d7e/f158 x:0 0 0 2024-02-28T16:27:00.118 INFO:tasks.workunit.client.1.smithi157.stdout:4/300: symlink d3/l6b 0 2024-02-28T16:27:00.118 INFO:tasks.workunit.client.1.smithi157.stdout:8/184: write d1/d5/d14/f2d [4513967,110850] 0 2024-02-28T16:27:00.122 INFO:tasks.workunit.client.1.smithi157.stdout:2/315: symlink da/d2b/d59/l70 0 2024-02-28T16:27:00.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:59 smithi148 ceph-mon[28767]: pgmap v54: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 187 MiB/s wr, 427 op/s 2024-02-28T16:27:00.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:59 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:00.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:26:59 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:00.124 INFO:tasks.workunit.client.1.smithi157.stdout:4/301: write d3/f13 [656121,100335] 0 2024-02-28T16:27:00.125 INFO:tasks.workunit.client.0.smithi148.stdout:4/975: symlink d8/d40/dc3/dd3/d17/d127/l159 0 2024-02-28T16:27:00.127 INFO:tasks.workunit.client.1.smithi157.stdout:6/223: creat d2/d7/d8/da/d31/d37/d2b/f3f x:0 0 0 2024-02-28T16:27:00.128 INFO:tasks.workunit.client.1.smithi157.stdout:2/316: truncate da/d38/d3e/f5b 9104796 0 2024-02-28T16:27:00.129 INFO:tasks.workunit.client.0.smithi148.stdout:4/976: creat d8/d40/dc3/f15a x:0 0 0 2024-02-28T16:27:00.132 INFO:tasks.workunit.client.1.smithi157.stdout:5/294: write d0/f2e [662902,119141] 0 2024-02-28T16:27:00.132 INFO:tasks.workunit.client.1.smithi157.stdout:3/197: dread d0/f1b [0,4194304] 0 2024-02-28T16:27:00.135 INFO:tasks.workunit.client.1.smithi157.stdout:3/198: dread - d0/d20/d23/d2b/d2e/f33 zero size 2024-02-28T16:27:00.137 INFO:tasks.workunit.client.1.smithi157.stdout:7/251: getdents df/d1f/d24/d39 0 2024-02-28T16:27:00.139 INFO:tasks.workunit.client.1.smithi157.stdout:7/252: chown df/d40/f48 2 1 2024-02-28T16:27:00.140 INFO:tasks.workunit.client.0.smithi148.stdout:4/977: rename d8/d21/f24 to d8/d37/d91/f15b 0 2024-02-28T16:27:00.143 INFO:tasks.workunit.client.1.smithi157.stdout:9/223: dread d0/f5 [0,4194304] 0 2024-02-28T16:27:00.143 INFO:tasks.workunit.client.0.smithi148.stdout:4/978: unlink d8/d21/c2a 0 2024-02-28T16:27:00.146 INFO:tasks.workunit.client.1.smithi157.stdout:4/302: getdents d3/da/d1f 0 2024-02-28T16:27:00.146 INFO:tasks.workunit.client.1.smithi157.stdout:6/224: write d2/d7/d8/f27 [3015884,9256] 0 2024-02-28T16:27:00.148 INFO:tasks.workunit.client.1.smithi157.stdout:7/253: fsync df/f1a 0 2024-02-28T16:27:00.148 INFO:tasks.workunit.client.0.smithi148.stdout:4/979: symlink d8/d40/dc3/dd3/d9f/l15c 0 2024-02-28T16:27:00.149 INFO:tasks.workunit.client.1.smithi157.stdout:0/271: sync 2024-02-28T16:27:00.149 INFO:tasks.workunit.client.1.smithi157.stdout:1/274: sync 2024-02-28T16:27:00.151 INFO:tasks.workunit.client.1.smithi157.stdout:0/272: stat d1/d13/f48 0 2024-02-28T16:27:00.152 INFO:tasks.workunit.client.1.smithi157.stdout:8/185: dread d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:00.152 INFO:tasks.workunit.client.1.smithi157.stdout:1/275: fsync d10/d11/f1c 0 2024-02-28T16:27:00.154 INFO:tasks.workunit.client.1.smithi157.stdout:3/199: dread d0/f38 [0,4194304] 0 2024-02-28T16:27:00.157 INFO:tasks.workunit.client.1.smithi157.stdout:1/276: rmdir d10 39 2024-02-28T16:27:00.159 INFO:tasks.workunit.client.1.smithi157.stdout:3/200: chown d0/d6/d1e/c37 27332 1 2024-02-28T16:27:00.160 INFO:tasks.workunit.client.1.smithi157.stdout:7/254: write df/d1f/d24/f33 [5844287,81151] 0 2024-02-28T16:27:00.160 INFO:tasks.workunit.client.1.smithi157.stdout:0/273: symlink d1/l60 0 2024-02-28T16:27:00.161 INFO:tasks.workunit.client.1.smithi157.stdout:8/186: symlink d1/d5/l3f 0 2024-02-28T16:27:00.169 INFO:tasks.workunit.client.0.smithi148.stdout:4/980: dread d8/d21/f55 [4194304,4194304] 0 2024-02-28T16:27:00.169 INFO:tasks.workunit.client.1.smithi157.stdout:7/255: dread - df/d1f/d24/d38/f51 zero size 2024-02-28T16:27:00.169 INFO:tasks.workunit.client.1.smithi157.stdout:0/274: write d1/d13/f54 [1612827,7194] 0 2024-02-28T16:27:00.170 INFO:tasks.workunit.client.1.smithi157.stdout:3/201: write d0/f1b [2838174,21795] 0 2024-02-28T16:27:00.170 INFO:tasks.workunit.client.0.smithi148.stdout:4/981: chown d8/d21/d3d/d4d/d66/dad/cbf 231944512 1 2024-02-28T16:27:00.174 INFO:tasks.workunit.client.1.smithi157.stdout:1/277: creat d10/d11/d3a/d3e/d46/f58 x:0 0 0 2024-02-28T16:27:00.176 INFO:tasks.workunit.client.1.smithi157.stdout:7/256: chown df/f31 8419 1 2024-02-28T16:27:00.177 INFO:tasks.workunit.client.1.smithi157.stdout:6/225: dwrite d2/d7/d8/f27 [0,4194304] 0 2024-02-28T16:27:00.177 INFO:tasks.workunit.client.1.smithi157.stdout:4/303: dwrite d3/da/d1f/d22/f4b [0,4194304] 0 2024-02-28T16:27:00.178 INFO:tasks.workunit.client.1.smithi157.stdout:9/224: dread d0/d19/d30/f48 [4194304,4194304] 0 2024-02-28T16:27:00.179 INFO:tasks.workunit.client.0.smithi148.stdout:4/982: rename d8/d40/dc3/dd3/d1f/cee to d8/d21/d3d/d4d/d95/c15d 0 2024-02-28T16:27:00.179 INFO:tasks.workunit.client.1.smithi157.stdout:7/257: fsync df/f1a 0 2024-02-28T16:27:00.180 INFO:tasks.workunit.client.1.smithi157.stdout:8/187: write d1/f2 [3714534,127501] 0 2024-02-28T16:27:00.182 INFO:tasks.workunit.client.1.smithi157.stdout:8/188: fdatasync d1/f2c 0 2024-02-28T16:27:00.183 INFO:tasks.workunit.client.1.smithi157.stdout:5/295: dread d0/f19 [4194304,4194304] 0 2024-02-28T16:27:00.184 INFO:tasks.workunit.client.1.smithi157.stdout:9/225: unlink d0/l23 0 2024-02-28T16:27:00.184 INFO:tasks.workunit.client.1.smithi157.stdout:4/304: rename d3/da to d3/da/d1f/d22/d52/d6c 22 2024-02-28T16:27:00.186 INFO:tasks.workunit.client.1.smithi157.stdout:1/278: symlink d10/d11/d3a/d3e/l59 0 2024-02-28T16:27:00.188 INFO:tasks.workunit.client.1.smithi157.stdout:6/226: write d2/d7/de/d1b/f28 [432327,9278] 0 2024-02-28T16:27:00.189 INFO:tasks.workunit.client.1.smithi157.stdout:4/305: write d3/da/d28/f5a [360800,78602] 0 2024-02-28T16:27:00.192 INFO:tasks.workunit.client.1.smithi157.stdout:5/296: mknod d0/d9/d1b/d36/c65 0 2024-02-28T16:27:00.193 INFO:tasks.workunit.client.1.smithi157.stdout:9/226: mknod d0/d36/d37/d40/c4e 0 2024-02-28T16:27:00.197 INFO:tasks.workunit.client.1.smithi157.stdout:1/279: rename l6 to d10/d11/d31/d2a/l5a 0 2024-02-28T16:27:00.197 INFO:tasks.workunit.client.1.smithi157.stdout:6/227: fsync d2/d7/d8/da/d31/d37/d2b/f3f 0 2024-02-28T16:27:00.197 INFO:tasks.workunit.client.1.smithi157.stdout:9/227: readlink d0/l31 0 2024-02-28T16:27:00.198 INFO:tasks.workunit.client.1.smithi157.stdout:4/306: unlink d3/da/ff 0 2024-02-28T16:27:00.199 INFO:tasks.workunit.client.0.smithi148.stdout:4/983: dwrite d8/d21/f109 [0,4194304] 0 2024-02-28T16:27:00.202 INFO:tasks.workunit.client.1.smithi157.stdout:1/280: fsync d10/d11/d3a/d3e/d46/f26 0 2024-02-28T16:27:00.206 INFO:tasks.workunit.client.1.smithi157.stdout:3/202: dwrite d0/d6/f13 [4194304,4194304] 0 2024-02-28T16:27:00.207 INFO:tasks.workunit.client.1.smithi157.stdout:9/228: fdatasync d0/d19/d30/f48 0 2024-02-28T16:27:00.211 INFO:tasks.workunit.client.1.smithi157.stdout:7/258: truncate df/f11 11297 0 2024-02-28T16:27:00.211 INFO:tasks.workunit.client.1.smithi157.stdout:1/281: unlink d10/d11/d3a/d3e/l4c 0 2024-02-28T16:27:00.218 INFO:tasks.workunit.client.1.smithi157.stdout:9/229: creat d0/d19/d30/f4f x:0 0 0 2024-02-28T16:27:00.219 INFO:tasks.workunit.client.1.smithi157.stdout:6/228: mkdir d2/d7/de/d40 0 2024-02-28T16:27:00.222 INFO:tasks.workunit.client.1.smithi157.stdout:7/259: unlink df/d40/f48 0 2024-02-28T16:27:00.230 INFO:tasks.workunit.client.1.smithi157.stdout:6/229: write d2/d7/de/d1b/f28 [1029679,109415] 0 2024-02-28T16:27:00.232 INFO:tasks.workunit.client.1.smithi157.stdout:5/297: dread d0/d30/d50/f5d [0,4194304] 0 2024-02-28T16:27:00.235 INFO:tasks.workunit.client.1.smithi157.stdout:7/260: creat df/d1f/d24/d38/f57 x:0 0 0 2024-02-28T16:27:00.236 INFO:tasks.workunit.client.0.smithi148.stdout:4/984: dwrite d8/d40/dc3/dd3/f34 [0,4194304] 0 2024-02-28T16:27:00.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:59 smithi157 ceph-mon[38346]: pgmap v54: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 63 MiB/s rd, 187 MiB/s wr, 427 op/s 2024-02-28T16:27:00.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:59 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:00.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:26:59 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:00.240 INFO:tasks.workunit.client.1.smithi157.stdout:8/189: dwrite d1/d5/d10/f22 [0,4194304] 0 2024-02-28T16:27:00.241 INFO:tasks.workunit.client.0.smithi148.stdout:4/985: truncate d8/d40/dc3/dd3/d5f/f79 525633 0 2024-02-28T16:27:00.243 INFO:tasks.workunit.client.1.smithi157.stdout:9/230: write d0/d19/d30/f4c [357469,90449] 0 2024-02-28T16:27:00.246 INFO:tasks.workunit.client.0.smithi148.stdout:4/986: truncate d8/d21/f54 1185704 0 2024-02-28T16:27:00.248 INFO:tasks.workunit.client.1.smithi157.stdout:5/298: mknod d0/d9/d47/d5b/c66 0 2024-02-28T16:27:00.250 INFO:tasks.workunit.client.1.smithi157.stdout:8/190: chown d1/c26 119886 1 2024-02-28T16:27:00.252 INFO:tasks.workunit.client.1.smithi157.stdout:4/307: dwrite d3/da/d1f/d22/f44 [0,4194304] 0 2024-02-28T16:27:00.262 INFO:tasks.workunit.client.1.smithi157.stdout:3/203: dwrite d0/d20/d23/d2b/f32 [0,4194304] 0 2024-02-28T16:27:00.262 INFO:tasks.workunit.client.1.smithi157.stdout:9/231: link d0/d36/d37/d40/f49 d0/d36/d3f/f50 0 2024-02-28T16:27:00.269 INFO:tasks.workunit.client.0.smithi148.stdout:4/987: dwrite d8/d21/d3d/d4d/d72/f111 [0,4194304] 0 2024-02-28T16:27:00.270 INFO:tasks.workunit.client.1.smithi157.stdout:1/282: dwrite d10/d11/d3a/f4b [0,4194304] 0 2024-02-28T16:27:00.270 INFO:tasks.workunit.client.1.smithi157.stdout:4/308: creat d3/da/d1f/f6d x:0 0 0 2024-02-28T16:27:00.273 INFO:tasks.workunit.client.0.smithi148.stdout:4/988: symlink d8/d21/d3d/d4d/d95/l15e 0 2024-02-28T16:27:00.276 INFO:tasks.workunit.client.0.smithi148.stdout:4/989: write d8/d40/dc3/dd3/f89 [1600859,63173] 0 2024-02-28T16:27:00.276 INFO:tasks.workunit.client.1.smithi157.stdout:8/191: link d1/f4 d1/d5/d23/f40 0 2024-02-28T16:27:00.276 INFO:tasks.workunit.client.1.smithi157.stdout:7/261: dwrite f8 [0,4194304] 0 2024-02-28T16:27:00.279 INFO:tasks.workunit.client.0.smithi148.stdout:4/990: symlink d8/d71/d85/l15f 0 2024-02-28T16:27:00.280 INFO:tasks.workunit.client.1.smithi157.stdout:6/230: dread d2/d7/fc [0,4194304] 0 2024-02-28T16:27:00.282 INFO:tasks.workunit.client.1.smithi157.stdout:7/262: write f8 [484803,122384] 0 2024-02-28T16:27:00.282 INFO:tasks.workunit.client.0.smithi148.stdout:4/991: symlink d8/d21/d3d/d4d/dd0/dd4/l160 0 2024-02-28T16:27:00.283 INFO:tasks.workunit.client.1.smithi157.stdout:5/299: getdents d0/d9/d47/d5b 0 2024-02-28T16:27:00.284 INFO:tasks.workunit.client.1.smithi157.stdout:2/317: sync 2024-02-28T16:27:00.284 INFO:tasks.workunit.client.1.smithi157.stdout:0/275: sync 2024-02-28T16:27:00.285 INFO:tasks.workunit.client.0.smithi148.stdout:4/992: truncate d8/d40/dc3/dd3/da3/f11e 1189542 0 2024-02-28T16:27:00.286 INFO:tasks.workunit.client.1.smithi157.stdout:1/283: truncate d10/d11/d3a/d3e/d46/f45 1637244 0 2024-02-28T16:27:00.292 INFO:tasks.workunit.client.1.smithi157.stdout:7/263: chown df/d25/f44 28 1 2024-02-28T16:27:00.292 INFO:tasks.workunit.client.1.smithi157.stdout:9/232: dread d0/d19/f29 [0,4194304] 0 2024-02-28T16:27:00.296 INFO:tasks.workunit.client.0.smithi148.stdout:4/993: getdents d8/d40/dc3 0 2024-02-28T16:27:00.298 INFO:tasks.workunit.client.0.smithi148.stdout:4/994: write d8/d37/f101 [1396066,113174] 0 2024-02-28T16:27:00.299 INFO:tasks.workunit.client.1.smithi157.stdout:6/231: truncate d2/d7/de/d1b/f28 1990968 0 2024-02-28T16:27:00.300 INFO:tasks.workunit.client.1.smithi157.stdout:2/318: mknod da/c71 0 2024-02-28T16:27:00.304 INFO:tasks.workunit.client.1.smithi157.stdout:7/264: unlink df/d1f/c20 0 2024-02-28T16:27:00.306 INFO:tasks.workunit.client.1.smithi157.stdout:4/309: truncate d3/da/f4f 422852 0 2024-02-28T16:27:00.306 INFO:tasks.workunit.client.1.smithi157.stdout:3/204: dread d0/d6/f15 [0,4194304] 0 2024-02-28T16:27:00.307 INFO:tasks.workunit.client.0.smithi148.stdout:4/995: rename d8/d40/ff1 to d8/d40/dc3/dd3/dea/f161 0 2024-02-28T16:27:00.309 INFO:tasks.workunit.client.0.smithi148.stdout:4/996: chown d8/d21/d3d/d8c/db0/fd2 45604 1 2024-02-28T16:27:00.311 INFO:tasks.workunit.client.1.smithi157.stdout:4/310: write d3/da/d37/f50 [50233,11632] 0 2024-02-28T16:27:00.312 INFO:tasks.workunit.client.1.smithi157.stdout:1/284: creat d10/d11/d3a/d3e/f5b x:0 0 0 2024-02-28T16:27:00.313 INFO:tasks.workunit.client.0.smithi148.stdout:4/997: mkdir d8/d21/d3d/d4d/d72/d162 0 2024-02-28T16:27:00.314 INFO:tasks.workunit.client.1.smithi157.stdout:9/233: fdatasync d0/d36/d37/d40/f49 0 2024-02-28T16:27:00.316 INFO:tasks.workunit.client.1.smithi157.stdout:3/205: mknod d0/d20/d23/d2b/c42 0 2024-02-28T16:27:00.317 INFO:tasks.workunit.client.1.smithi157.stdout:2/319: chown da/fe 487 1 2024-02-28T16:27:00.317 INFO:tasks.workunit.client.1.smithi157.stdout:9/234: readlink d0/l31 0 2024-02-28T16:27:00.317 INFO:tasks.workunit.client.1.smithi157.stdout:0/276: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:27:00.321 INFO:tasks.workunit.client.1.smithi157.stdout:8/192: dread d1/d5/d14/f2d [0,4194304] 0 2024-02-28T16:27:00.321 INFO:tasks.workunit.client.0.smithi148.stdout:4/998: getdents d8/d21/d3d/d4d/d66/dad/dfe/d157 0 2024-02-28T16:27:00.321 INFO:tasks.workunit.client.1.smithi157.stdout:2/320: readlink da/d35/l4c 0 2024-02-28T16:27:00.322 INFO:tasks.workunit.client.0.smithi148.stdout:4/999: chown d8/de4 8836 1 2024-02-28T16:27:00.322 INFO:tasks.workunit.client.1.smithi157.stdout:1/285: fsync d10/f12 0 2024-02-28T16:27:00.325 INFO:tasks.workunit.client.1.smithi157.stdout:4/311: mknod d3/da/d48/c6e 0 2024-02-28T16:27:00.325 INFO:tasks.workunit.client.1.smithi157.stdout:2/321: chown da/d2b/d59/f64 86964338 1 2024-02-28T16:27:00.328 INFO:tasks.workunit.client.1.smithi157.stdout:3/206: write d0/f38 [2757528,58846] 0 2024-02-28T16:27:00.330 INFO:tasks.workunit.client.0.smithi148.stderr:+ rm -rf -- ./tmp.LSsvsRNMvx 2024-02-28T16:27:00.332 INFO:tasks.workunit.client.1.smithi157.stdout:2/322: stat da/f34 0 2024-02-28T16:27:00.334 INFO:tasks.workunit.client.1.smithi157.stdout:6/232: link d2/d7/de/l13 d2/d7/de/d1b/l41 0 2024-02-28T16:27:00.335 INFO:tasks.workunit.client.1.smithi157.stdout:1/286: mkdir d10/d11/d3a/d5c 0 2024-02-28T16:27:00.335 INFO:tasks.workunit.client.1.smithi157.stdout:3/207: chown d0/d20/d23/d2b/d2e/f33 2 1 2024-02-28T16:27:00.337 INFO:tasks.workunit.client.1.smithi157.stdout:0/277: mkdir d1/d13/d61 0 2024-02-28T16:27:00.339 INFO:tasks.workunit.client.1.smithi157.stdout:5/300: dread d0/f2f [0,4194304] 0 2024-02-28T16:27:00.339 INFO:tasks.workunit.client.1.smithi157.stdout:2/323: read da/d2b/f4f [733772,86172] 0 2024-02-28T16:27:00.340 INFO:tasks.workunit.client.1.smithi157.stdout:1/287: chown d10/d11/c30 260434 1 2024-02-28T16:27:00.345 INFO:tasks.workunit.client.1.smithi157.stdout:6/233: symlink d2/d17/l42 0 2024-02-28T16:27:00.346 INFO:tasks.workunit.client.1.smithi157.stdout:7/265: getdents df/d1f/d24/d4f 0 2024-02-28T16:27:00.347 INFO:tasks.workunit.client.1.smithi157.stdout:8/193: dwrite d1/d5/d10/f35 [0,4194304] 0 2024-02-28T16:27:00.349 INFO:tasks.workunit.client.1.smithi157.stdout:3/208: mkdir d0/d6/d34/d43 0 2024-02-28T16:27:00.350 INFO:tasks.workunit.client.1.smithi157.stdout:3/209: stat d0/d6/l1a 0 2024-02-28T16:27:00.351 INFO:tasks.workunit.client.1.smithi157.stdout:0/278: creat d1/d8/d33/d56/f62 x:0 0 0 2024-02-28T16:27:00.354 INFO:tasks.workunit.client.1.smithi157.stdout:3/210: write d0/f1c [341701,52642] 0 2024-02-28T16:27:00.360 INFO:tasks.workunit.client.1.smithi157.stdout:7/266: creat df/d1f/d24/d39/f58 x:0 0 0 2024-02-28T16:27:00.364 INFO:tasks.workunit.client.1.smithi157.stdout:2/324: rename da/d2b/c31 to da/d38/c72 0 2024-02-28T16:27:00.366 INFO:tasks.workunit.client.1.smithi157.stdout:8/194: dread d1/d5/d14/f2d [0,4194304] 0 2024-02-28T16:27:00.367 INFO:tasks.workunit.client.1.smithi157.stdout:2/325: fdatasync da/d3a/f53 0 2024-02-28T16:27:00.369 INFO:tasks.workunit.client.1.smithi157.stdout:4/312: getdents d3/da 0 2024-02-28T16:27:00.370 INFO:tasks.workunit.client.1.smithi157.stdout:7/267: dread f8 [4194304,4194304] 0 2024-02-28T16:27:00.371 INFO:tasks.workunit.client.1.smithi157.stdout:3/211: mkdir d0/d6/d44 0 2024-02-28T16:27:00.371 INFO:tasks.workunit.client.1.smithi157.stdout:5/301: dread d0/d30/f5f [0,4194304] 0 2024-02-28T16:27:00.376 INFO:tasks.workunit.client.1.smithi157.stdout:1/288: rename d10/d11/d3a/f4b to d10/d11/d31/d2a/f5d 0 2024-02-28T16:27:00.381 INFO:tasks.workunit.client.1.smithi157.stdout:8/195: dread d1/d5/d10/f18 [0,4194304] 0 2024-02-28T16:27:00.383 INFO:tasks.workunit.client.1.smithi157.stdout:0/279: dread d1/d8/d33/f4e [0,4194304] 0 2024-02-28T16:27:00.414 INFO:tasks.workunit.client.1.smithi157.stdout:1/289: creat d10/d11/d3a/d3e/d46/f5e x:0 0 0 2024-02-28T16:27:00.414 INFO:tasks.workunit.client.1.smithi157.stdout:6/234: getdents d2/d7/d8/da/d31/d3a 0 2024-02-28T16:27:00.416 INFO:tasks.workunit.client.1.smithi157.stdout:3/212: rmdir d0 39 2024-02-28T16:27:00.418 INFO:tasks.workunit.client.1.smithi157.stdout:1/290: write d10/f1b [4111014,1192] 0 2024-02-28T16:27:00.419 INFO:tasks.workunit.client.1.smithi157.stdout:6/235: symlink d2/d17/l43 0 2024-02-28T16:27:00.419 INFO:tasks.workunit.client.1.smithi157.stdout:0/280: write d1/d8/f25 [2930006,103041] 0 2024-02-28T16:27:00.424 INFO:tasks.workunit.client.1.smithi157.stdout:5/302: dwrite d0/d9/d47/f4e [0,4194304] 0 2024-02-28T16:27:00.425 INFO:tasks.workunit.client.1.smithi157.stdout:3/213: mknod d0/d20/d23/c45 0 2024-02-28T16:27:00.427 INFO:tasks.workunit.client.1.smithi157.stdout:1/291: creat d10/d11/d3a/f5f x:0 0 0 2024-02-28T16:27:00.428 INFO:tasks.workunit.client.1.smithi157.stdout:6/236: fdatasync d2/d7/d8/da/d31/d37/d2b/f3f 0 2024-02-28T16:27:00.435 INFO:tasks.workunit.client.1.smithi157.stdout:5/303: creat d0/d9/d1b/f67 x:0 0 0 2024-02-28T16:27:00.435 INFO:tasks.workunit.client.1.smithi157.stdout:2/326: dwrite da/d2b/f4f [0,4194304] 0 2024-02-28T16:27:00.437 INFO:tasks.workunit.client.1.smithi157.stdout:5/304: write d0/d9/d47/f55 [2272923,59910] 0 2024-02-28T16:27:00.439 INFO:tasks.workunit.client.1.smithi157.stdout:6/237: symlink d2/d7/de/d40/l44 0 2024-02-28T16:27:00.447 INFO:tasks.workunit.client.1.smithi157.stdout:5/305: unlink d0/d9/ff 0 2024-02-28T16:27:00.447 INFO:tasks.workunit.client.1.smithi157.stdout:8/196: dwrite d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:00.448 INFO:tasks.workunit.client.1.smithi157.stdout:0/281: dwrite d1/d13/fe [0,4194304] 0 2024-02-28T16:27:00.452 INFO:tasks.workunit.client.1.smithi157.stdout:0/282: chown d1/d8/d33/f44 41803158 1 2024-02-28T16:27:00.455 INFO:tasks.workunit.client.1.smithi157.stdout:6/238: creat d2/d7/d8/da/d31/d37/d2d/d30/f45 x:0 0 0 2024-02-28T16:27:00.457 INFO:tasks.workunit.client.1.smithi157.stdout:5/306: rename d0/d9/d3a/l60 to d0/d9/d3a/l68 0 2024-02-28T16:27:00.459 INFO:tasks.workunit.client.1.smithi157.stdout:8/197: unlink d1/d5/d14/l2b 0 2024-02-28T16:27:00.465 INFO:tasks.workunit.client.1.smithi157.stdout:6/239: creat d2/d17/f46 x:0 0 0 2024-02-28T16:27:00.466 INFO:tasks.workunit.client.1.smithi157.stdout:9/235: sync 2024-02-28T16:27:00.470 INFO:tasks.workunit.client.1.smithi157.stdout:2/327: dwrite da/d38/f6f [0,4194304] 0 2024-02-28T16:27:00.470 INFO:tasks.workunit.client.1.smithi157.stdout:6/240: creat d2/d7/de/d40/f47 x:0 0 0 2024-02-28T16:27:00.477 INFO:tasks.workunit.client.1.smithi157.stdout:6/241: fdatasync d2/d7/fc 0 2024-02-28T16:27:00.477 INFO:tasks.workunit.client.1.smithi157.stdout:0/283: dread d1/f24 [0,4194304] 0 2024-02-28T16:27:00.481 INFO:tasks.workunit.client.1.smithi157.stdout:0/284: fsync d1/d13/f54 0 2024-02-28T16:27:00.491 INFO:tasks.workunit.client.1.smithi157.stdout:6/242: creat d2/d7/d8/da/d31/d37/d2d/f48 x:0 0 0 2024-02-28T16:27:00.495 INFO:tasks.workunit.client.1.smithi157.stdout:9/236: truncate d0/f28 822575 0 2024-02-28T16:27:00.497 INFO:tasks.workunit.client.1.smithi157.stdout:2/328: dwrite da/f1e [0,4194304] 0 2024-02-28T16:27:00.498 INFO:tasks.workunit.client.1.smithi157.stdout:3/214: dread d0/f8 [0,4194304] 0 2024-02-28T16:27:00.499 INFO:tasks.workunit.client.1.smithi157.stdout:6/243: write d2/d7/d8/da/d31/d37/d2d/f3b [3474122,109969] 0 2024-02-28T16:27:00.503 INFO:tasks.workunit.client.1.smithi157.stdout:0/285: creat d1/d13/d61/f63 x:0 0 0 2024-02-28T16:27:00.503 INFO:tasks.workunit.client.1.smithi157.stdout:8/198: dwrite d1/d5/d10/f22 [0,4194304] 0 2024-02-28T16:27:00.505 INFO:tasks.workunit.client.1.smithi157.stdout:1/292: dread d10/d11/d3a/d3e/d46/f26 [0,4194304] 0 2024-02-28T16:27:00.511 INFO:tasks.workunit.client.1.smithi157.stdout:2/329: getdents da/d38/d5a 0 2024-02-28T16:27:00.513 INFO:tasks.workunit.client.1.smithi157.stdout:1/293: mkdir d10/d11/d60 0 2024-02-28T16:27:00.516 INFO:tasks.workunit.client.1.smithi157.stdout:6/244: dread d2/d17/f34 [0,4194304] 0 2024-02-28T16:27:00.522 INFO:tasks.workunit.client.1.smithi157.stdout:2/330: unlink da/d35/l4c 0 2024-02-28T16:27:00.524 INFO:tasks.workunit.client.1.smithi157.stdout:1/294: fdatasync f4 0 2024-02-28T16:27:00.526 INFO:tasks.workunit.client.1.smithi157.stdout:6/245: unlink d2/d7/f3c 0 2024-02-28T16:27:00.533 INFO:tasks.workunit.client.1.smithi157.stdout:8/199: dwrite d1/d5/f3b [0,4194304] 0 2024-02-28T16:27:00.533 INFO:tasks.workunit.client.1.smithi157.stdout:5/307: dread d0/d9/d47/f55 [0,4194304] 0 2024-02-28T16:27:00.533 INFO:tasks.workunit.client.1.smithi157.stdout:1/295: creat d10/d11/d3a/f61 x:0 0 0 2024-02-28T16:27:00.534 INFO:tasks.workunit.client.1.smithi157.stdout:6/246: mknod d2/d7/c49 0 2024-02-28T16:27:00.536 INFO:tasks.workunit.client.1.smithi157.stdout:2/331: truncate da/d38/d5a/f66 847145 0 2024-02-28T16:27:00.537 INFO:tasks.workunit.client.1.smithi157.stdout:0/286: dwrite d1/d8/f2c [0,4194304] 0 2024-02-28T16:27:00.539 INFO:tasks.workunit.client.1.smithi157.stdout:6/247: read - d2/d17/f1e zero size 2024-02-28T16:27:00.539 INFO:tasks.workunit.client.1.smithi157.stdout:2/332: chown da/f23 1477 1 2024-02-28T16:27:00.541 INFO:tasks.workunit.client.1.smithi157.stdout:5/308: mknod d0/d30/c69 0 2024-02-28T16:27:00.542 INFO:tasks.workunit.client.1.smithi157.stdout:8/200: mknod d1/d5/c41 0 2024-02-28T16:27:00.544 INFO:tasks.workunit.client.1.smithi157.stdout:1/296: read d10/d11/d31/d2a/f5d [3429914,30265] 0 2024-02-28T16:27:00.545 INFO:tasks.workunit.client.1.smithi157.stdout:3/215: dread d0/d6/fb [0,4194304] 0 2024-02-28T16:27:00.546 INFO:tasks.workunit.client.1.smithi157.stdout:6/248: symlink d2/d7/d8/da/l4a 0 2024-02-28T16:27:00.548 INFO:tasks.workunit.client.1.smithi157.stdout:3/216: truncate d0/d6/d34/f3a 458754 0 2024-02-28T16:27:00.548 INFO:tasks.workunit.client.1.smithi157.stdout:0/287: mkdir d1/d13/d61/d64 0 2024-02-28T16:27:00.548 INFO:tasks.workunit.client.1.smithi157.stdout:3/217: chown d0 48 1 2024-02-28T16:27:00.550 INFO:tasks.workunit.client.1.smithi157.stdout:0/288: chown d1/d13/d61/d64 62 1 2024-02-28T16:27:00.551 INFO:tasks.workunit.client.1.smithi157.stdout:5/309: mkdir d0/d9/d47/d5b/d6a 0 2024-02-28T16:27:00.556 INFO:tasks.workunit.client.1.smithi157.stdout:9/237: dread d0/f28 [0,4194304] 0 2024-02-28T16:27:00.558 INFO:tasks.workunit.client.1.smithi157.stdout:1/297: rename d10/d11/d3a/d3e/d46/f1a to d10/d11/d22/f62 0 2024-02-28T16:27:00.563 INFO:tasks.workunit.client.1.smithi157.stdout:5/310: rename d0/d30/d50/f5d to d0/d9/d47/d5b/d6a/f6b 0 2024-02-28T16:27:00.564 INFO:tasks.workunit.client.1.smithi157.stdout:2/333: dwrite da/f2c [0,4194304] 0 2024-02-28T16:27:00.564 INFO:tasks.workunit.client.1.smithi157.stdout:5/311: chown d0/d30/d50 935860 1 2024-02-28T16:27:00.566 INFO:tasks.workunit.client.1.smithi157.stdout:1/298: chown d10/d11/f32 12695 1 2024-02-28T16:27:00.567 INFO:tasks.workunit.client.1.smithi157.stdout:4/313: sync 2024-02-28T16:27:00.567 INFO:tasks.workunit.client.1.smithi157.stdout:7/268: sync 2024-02-28T16:27:00.569 INFO:tasks.workunit.client.1.smithi157.stdout:8/201: rmdir d1 39 2024-02-28T16:27:00.569 INFO:tasks.workunit.client.1.smithi157.stdout:6/249: creat d2/f4b x:0 0 0 2024-02-28T16:27:00.574 INFO:tasks.workunit.client.1.smithi157.stdout:0/289: write d1/d8/d27/f2b [568893,97254] 0 2024-02-28T16:27:00.578 INFO:tasks.workunit.client.1.smithi157.stdout:3/218: write d0/d6/f2d [3404049,31246] 0 2024-02-28T16:27:00.578 INFO:tasks.workunit.client.1.smithi157.stdout:1/299: stat d10/d11/d31/c50 0 2024-02-28T16:27:00.578 INFO:tasks.workunit.client.1.smithi157.stdout:9/238: creat d0/d36/d37/d4d/f51 x:0 0 0 2024-02-28T16:27:00.582 INFO:tasks.workunit.client.1.smithi157.stdout:7/269: rmdir df/d1f/d24/d39 39 2024-02-28T16:27:00.583 INFO:tasks.workunit.client.1.smithi157.stdout:6/250: mkdir d2/d7/d8/da/d4c 0 2024-02-28T16:27:00.585 INFO:tasks.workunit.client.1.smithi157.stdout:0/290: rmdir d1/d8/d33 39 2024-02-28T16:27:00.594 INFO:tasks.workunit.client.1.smithi157.stdout:2/334: getdents da/d47/d5f 0 2024-02-28T16:27:00.596 INFO:tasks.workunit.client.1.smithi157.stdout:6/251: mkdir d2/d7/de/d1b/d4d 0 2024-02-28T16:27:00.599 INFO:tasks.workunit.client.1.smithi157.stdout:8/202: fsync d1/d5/d14/f2d 0 2024-02-28T16:27:00.600 INFO:tasks.workunit.client.1.smithi157.stdout:3/219: creat d0/f46 x:0 0 0 2024-02-28T16:27:00.601 INFO:tasks.workunit.client.1.smithi157.stdout:4/314: dwrite d3/da/d1f/d22/d52/f55 [0,4194304] 0 2024-02-28T16:27:00.604 INFO:tasks.workunit.client.1.smithi157.stdout:8/203: write d1/f2c [3186605,44350] 0 2024-02-28T16:27:00.606 INFO:tasks.workunit.client.1.smithi157.stdout:6/252: fsync d2/d7/d8/da/d31/d37/d2d/f3b 0 2024-02-28T16:27:00.607 INFO:tasks.workunit.client.1.smithi157.stdout:2/335: mknod da/d38/d4e/c73 0 2024-02-28T16:27:00.611 INFO:tasks.workunit.client.1.smithi157.stdout:5/312: dread d0/d9/f1d [0,4194304] 0 2024-02-28T16:27:00.612 INFO:tasks.workunit.client.1.smithi157.stdout:0/291: getdents d1/da 0 2024-02-28T16:27:00.614 INFO:tasks.workunit.client.1.smithi157.stdout:4/315: mknod d3/c6f 0 2024-02-28T16:27:00.618 INFO:tasks.workunit.client.1.smithi157.stdout:6/253: stat d2/d7/d8/f1a 0 2024-02-28T16:27:00.619 INFO:tasks.workunit.client.1.smithi157.stdout:4/316: stat d3/da/f31 0 2024-02-28T16:27:00.620 INFO:tasks.workunit.client.1.smithi157.stdout:3/220: rename d0/d6/d1e/c40 to d0/d20/c47 0 2024-02-28T16:27:00.623 INFO:tasks.workunit.client.1.smithi157.stdout:6/254: chown d2/d7/d8/da 26992 1 2024-02-28T16:27:00.623 INFO:tasks.workunit.client.1.smithi157.stdout:7/270: dwrite fb [0,4194304] 0 2024-02-28T16:27:00.626 INFO:tasks.workunit.client.1.smithi157.stdout:9/239: dwrite d0/d19/d30/f4f [0,4194304] 0 2024-02-28T16:27:00.627 INFO:tasks.workunit.client.1.smithi157.stdout:1/300: dread d10/f16 [0,4194304] 0 2024-02-28T16:27:00.627 INFO:tasks.workunit.client.1.smithi157.stdout:2/336: rename da/d38/d5a/d5c/l6b to da/d35/l74 0 2024-02-28T16:27:00.628 INFO:tasks.workunit.client.1.smithi157.stdout:4/317: write d3/da/d1f/f67 [262256,76684] 0 2024-02-28T16:27:00.628 INFO:tasks.workunit.client.1.smithi157.stdout:3/221: write d0/f3f [77611,49956] 0 2024-02-28T16:27:00.631 INFO:tasks.workunit.client.1.smithi157.stdout:8/204: creat d1/d5/d14/f42 x:0 0 0 2024-02-28T16:27:00.636 INFO:tasks.workunit.client.1.smithi157.stdout:5/313: rename d0/f19 to d0/d9/d1b/d36/f6c 0 2024-02-28T16:27:00.639 INFO:tasks.workunit.client.1.smithi157.stdout:1/301: chown d10/d11/d31/f41 1732021946 1 2024-02-28T16:27:00.640 INFO:tasks.workunit.client.1.smithi157.stdout:5/314: write d0/f5a [838287,75545] 0 2024-02-28T16:27:00.640 INFO:tasks.workunit.client.1.smithi157.stdout:3/222: write d0/f46 [513655,54109] 0 2024-02-28T16:27:00.643 INFO:tasks.workunit.client.1.smithi157.stdout:7/271: dread df/f11 [0,4194304] 0 2024-02-28T16:27:00.645 INFO:tasks.workunit.client.1.smithi157.stdout:8/205: mkdir d1/d5/d43 0 2024-02-28T16:27:00.645 INFO:tasks.workunit.client.1.smithi157.stdout:2/337: rename da/f25 to da/d38/f75 0 2024-02-28T16:27:00.651 INFO:tasks.workunit.client.1.smithi157.stdout:7/272: dread - df/d1f/d24/d38/f51 zero size 2024-02-28T16:27:00.658 INFO:tasks.workunit.client.1.smithi157.stdout:6/255: rename d2/d7/d8/f27 to d2/d7/de/f4e 0 2024-02-28T16:27:00.658 INFO:tasks.workunit.client.1.smithi157.stdout:2/338: dread da/d2b/f3f [0,4194304] 0 2024-02-28T16:27:00.658 INFO:tasks.workunit.client.1.smithi157.stdout:1/302: truncate d10/d11/d3a/f5f 428409 0 2024-02-28T16:27:00.661 INFO:tasks.workunit.client.1.smithi157.stdout:0/292: dwrite d1/d8/d33/d56/f62 [0,4194304] 0 2024-02-28T16:27:00.664 INFO:tasks.workunit.client.1.smithi157.stdout:7/273: mkdir df/d25/d59 0 2024-02-28T16:27:00.669 INFO:tasks.workunit.client.1.smithi157.stdout:9/240: dwrite d0/f12 [4194304,4194304] 0 2024-02-28T16:27:00.675 INFO:tasks.workunit.client.1.smithi157.stdout:7/274: truncate df/f10 4793587 0 2024-02-28T16:27:00.677 INFO:tasks.workunit.client.1.smithi157.stdout:4/318: dwrite d3/da/d28/f5a [0,4194304] 0 2024-02-28T16:27:00.679 INFO:tasks.workunit.client.1.smithi157.stdout:3/223: dwrite d0/d6/fa [0,4194304] 0 2024-02-28T16:27:00.681 INFO:tasks.workunit.client.1.smithi157.stdout:8/206: link d1/d5/c41 d1/d5/d43/c44 0 2024-02-28T16:27:00.682 INFO:tasks.workunit.client.1.smithi157.stdout:3/224: fdatasync d0/f46 0 2024-02-28T16:27:00.684 INFO:tasks.workunit.client.1.smithi157.stdout:6/256: truncate d2/d7/d8/da/d31/d37/d2d/f48 853552 0 2024-02-28T16:27:00.686 INFO:tasks.workunit.client.1.smithi157.stdout:4/319: stat d3/da/d48/f66 0 2024-02-28T16:27:00.689 INFO:tasks.workunit.client.1.smithi157.stdout:5/315: dwrite d0/d9/f1d [0,4194304] 0 2024-02-28T16:27:00.691 INFO:tasks.workunit.client.1.smithi157.stdout:1/303: write d10/d11/f32 [163782,108678] 0 2024-02-28T16:27:00.693 INFO:tasks.workunit.client.1.smithi157.stdout:3/225: write d0/f1b [146489,21897] 0 2024-02-28T16:27:00.700 INFO:tasks.workunit.client.1.smithi157.stdout:7/275: mknod df/d1f/d24/d38/c5a 0 2024-02-28T16:27:00.705 INFO:tasks.workunit.client.1.smithi157.stdout:5/316: creat d0/d9/d47/f6d x:0 0 0 2024-02-28T16:27:00.713 INFO:tasks.workunit.client.1.smithi157.stdout:4/320: mknod d3/da/d48/d4a/c70 0 2024-02-28T16:27:00.713 INFO:tasks.workunit.client.1.smithi157.stdout:2/339: dwrite da/f12 [0,4194304] 0 2024-02-28T16:27:00.717 INFO:tasks.workunit.client.1.smithi157.stdout:3/226: chown d0/d20/d23/d2b/c3b 130572 1 2024-02-28T16:27:00.719 INFO:tasks.workunit.client.1.smithi157.stdout:0/293: dwrite d1/d8/d27/d55/f5f [0,4194304] 0 2024-02-28T16:27:00.719 INFO:tasks.workunit.client.1.smithi157.stdout:1/304: truncate d10/d11/d3a/d3e/f5b 295090 0 2024-02-28T16:27:00.724 INFO:tasks.workunit.client.1.smithi157.stdout:6/257: link d2/d7/d8/da/l4a d2/d7/de/d1b/d4d/l4f 0 2024-02-28T16:27:00.725 INFO:tasks.workunit.client.1.smithi157.stdout:1/305: write d10/d11/d3a/d3e/f53 [535981,14027] 0 2024-02-28T16:27:00.727 INFO:tasks.workunit.client.1.smithi157.stdout:2/340: write da/f1e [3595672,8275] 0 2024-02-28T16:27:00.734 INFO:tasks.workunit.client.1.smithi157.stdout:5/317: getdents d0/d9/d47/d5c 0 2024-02-28T16:27:00.735 INFO:tasks.workunit.client.1.smithi157.stdout:9/241: dread d0/d19/f1e [0,4194304] 0 2024-02-28T16:27:00.735 INFO:tasks.workunit.client.1.smithi157.stdout:5/318: write d0/f5a [1840926,75672] 0 2024-02-28T16:27:00.740 INFO:tasks.workunit.client.1.smithi157.stdout:6/258: symlink d2/d7/l50 0 2024-02-28T16:27:00.742 INFO:tasks.workunit.client.1.smithi157.stdout:8/207: truncate d1/d5/d10/f22 1670487 0 2024-02-28T16:27:00.743 INFO:tasks.workunit.client.1.smithi157.stdout:2/341: dread da/d35/f36 [0,4194304] 0 2024-02-28T16:27:00.745 INFO:tasks.workunit.client.1.smithi157.stdout:7/276: dwrite fb [4194304,4194304] 0 2024-02-28T16:27:00.749 INFO:tasks.workunit.client.1.smithi157.stdout:2/342: fdatasync da/d3a/f49 0 2024-02-28T16:27:00.751 INFO:tasks.workunit.client.1.smithi157.stdout:7/277: fsync df/f16 0 2024-02-28T16:27:00.753 INFO:tasks.workunit.client.1.smithi157.stdout:9/242: dread d0/f28 [0,4194304] 0 2024-02-28T16:27:00.756 INFO:tasks.workunit.client.1.smithi157.stdout:8/208: creat d1/d5/d43/f45 x:0 0 0 2024-02-28T16:27:00.760 INFO:tasks.workunit.client.1.smithi157.stdout:2/343: symlink da/d38/d5a/l76 0 2024-02-28T16:27:00.764 INFO:tasks.workunit.client.1.smithi157.stdout:6/259: rmdir d2 39 2024-02-28T16:27:00.765 INFO:tasks.workunit.client.1.smithi157.stdout:0/294: dwrite d1/d8/f1d [0,4194304] 0 2024-02-28T16:27:00.770 INFO:tasks.workunit.client.1.smithi157.stdout:3/227: dwrite d0/d6/f2d [0,4194304] 0 2024-02-28T16:27:00.770 INFO:tasks.workunit.client.1.smithi157.stdout:8/209: unlink d1/d5/d23/f40 0 2024-02-28T16:27:00.774 INFO:tasks.workunit.client.1.smithi157.stdout:7/278: creat df/d1f/d37/d46/f5b x:0 0 0 2024-02-28T16:27:00.774 INFO:tasks.workunit.client.1.smithi157.stdout:4/321: dwrite d3/f5 [0,4194304] 0 2024-02-28T16:27:00.778 INFO:tasks.workunit.client.1.smithi157.stdout:1/306: dwrite d10/d11/d3a/d3e/d46/f45 [0,4194304] 0 2024-02-28T16:27:00.780 INFO:tasks.workunit.client.1.smithi157.stdout:2/344: creat da/d47/f77 x:0 0 0 2024-02-28T16:27:00.780 INFO:tasks.workunit.client.1.smithi157.stdout:8/210: chown d1/d5/d10/f35 11651 1 2024-02-28T16:27:00.782 INFO:tasks.workunit.client.1.smithi157.stdout:9/243: write d0/d19/f29 [746273,26181] 0 2024-02-28T16:27:00.783 INFO:tasks.workunit.client.1.smithi157.stdout:4/322: write d3/da/d1f/d22/f3d [1635078,18908] 0 2024-02-28T16:27:00.787 INFO:tasks.workunit.client.1.smithi157.stdout:8/211: fdatasync d1/d5/d14/f2d 0 2024-02-28T16:27:00.787 INFO:tasks.workunit.client.1.smithi157.stdout:6/260: creat d2/d17/f51 x:0 0 0 2024-02-28T16:27:00.796 INFO:tasks.workunit.client.1.smithi157.stdout:7/279: creat df/d1f/d24/d39/f5c x:0 0 0 2024-02-28T16:27:00.800 INFO:tasks.workunit.client.1.smithi157.stdout:9/244: creat d0/d36/d37/d4d/f52 x:0 0 0 2024-02-28T16:27:00.800 INFO:tasks.workunit.client.1.smithi157.stdout:6/261: fdatasync d2/f5 0 2024-02-28T16:27:00.802 INFO:tasks.workunit.client.1.smithi157.stdout:0/295: fdatasync d1/d8/f1d 0 2024-02-28T16:27:00.805 INFO:tasks.workunit.client.1.smithi157.stdout:4/323: mkdir d3/da/d37/d71 0 2024-02-28T16:27:00.807 INFO:tasks.workunit.client.1.smithi157.stdout:3/228: getdents d0/d6/d1e 0 2024-02-28T16:27:00.816 INFO:tasks.workunit.client.1.smithi157.stdout:3/229: write d0/d6/f2d [1845399,90861] 0 2024-02-28T16:27:00.819 INFO:tasks.workunit.client.1.smithi157.stdout:8/212: dwrite d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:00.819 INFO:tasks.workunit.client.1.smithi157.stdout:5/319: dread d0/d8/fb [0,4194304] 0 2024-02-28T16:27:00.820 INFO:tasks.workunit.client.1.smithi157.stdout:4/324: truncate f2 3992869 0 2024-02-28T16:27:00.822 INFO:tasks.workunit.client.1.smithi157.stdout:3/230: dread - d0/d6/f39 zero size 2024-02-28T16:27:00.824 INFO:tasks.workunit.client.1.smithi157.stdout:1/307: dwrite d10/d11/d3a/d3e/d46/f45 [0,4194304] 0 2024-02-28T16:27:00.830 INFO:tasks.workunit.client.1.smithi157.stdout:1/308: chown d10/d11 61337209 1 2024-02-28T16:27:00.831 INFO:tasks.workunit.client.1.smithi157.stdout:7/280: write df/f11 [144117,126236] 0 2024-02-28T16:27:00.833 INFO:tasks.workunit.client.1.smithi157.stdout:8/213: symlink d1/d5/l46 0 2024-02-28T16:27:00.836 INFO:tasks.workunit.client.1.smithi157.stdout:4/325: symlink d3/da/d37/d71/l72 0 2024-02-28T16:27:00.836 INFO:tasks.workunit.client.1.smithi157.stdout:3/231: fdatasync d0/d6/d34/f3a 0 2024-02-28T16:27:00.837 INFO:tasks.workunit.client.1.smithi157.stdout:0/296: truncate d1/d13/fe 3955972 0 2024-02-28T16:27:00.840 INFO:tasks.workunit.client.1.smithi157.stdout:9/245: dwrite d0/d19/d30/f32 [0,4194304] 0 2024-02-28T16:27:00.844 INFO:tasks.workunit.client.1.smithi157.stdout:3/232: readlink d0/d20/d23/l36 0 2024-02-28T16:27:00.845 INFO:tasks.workunit.client.1.smithi157.stdout:0/297: stat d1/d13/d61/d64 0 2024-02-28T16:27:00.858 INFO:tasks.workunit.client.1.smithi157.stdout:7/281: creat df/d25/d59/f5d x:0 0 0 2024-02-28T16:27:00.858 INFO:tasks.workunit.client.1.smithi157.stdout:2/345: dread da/f24 [0,4194304] 0 2024-02-28T16:27:00.858 INFO:tasks.workunit.client.1.smithi157.stdout:6/262: dwrite d2/d7/de/d1b/f28 [0,4194304] 0 2024-02-28T16:27:00.858 INFO:tasks.workunit.client.1.smithi157.stdout:0/298: symlink d1/d13/d52/l65 0 2024-02-28T16:27:00.859 INFO:tasks.workunit.client.1.smithi157.stdout:3/233: mkdir d0/d6/d44/d48 0 2024-02-28T16:27:00.860 INFO:tasks.workunit.client.1.smithi157.stdout:5/320: dwrite d0/d30/f5f [0,4194304] 0 2024-02-28T16:27:00.860 INFO:tasks.workunit.client.1.smithi157.stdout:1/309: truncate ff 1101987 0 2024-02-28T16:27:00.864 INFO:tasks.workunit.client.1.smithi157.stdout:9/246: link d0/d19/d30/f4f d0/d36/d37/d4d/f53 0 2024-02-28T16:27:00.864 INFO:tasks.workunit.client.1.smithi157.stdout:4/326: write d3/f33 [2751624,63507] 0 2024-02-28T16:27:00.867 INFO:tasks.workunit.client.1.smithi157.stdout:0/299: write d1/f6 [4235359,72031] 0 2024-02-28T16:27:00.869 INFO:tasks.workunit.client.1.smithi157.stdout:6/263: mknod d2/d7/d8/da/d31/d37/c52 0 2024-02-28T16:27:00.871 INFO:tasks.workunit.client.1.smithi157.stdout:5/321: chown d0/ca 4 1 2024-02-28T16:27:00.872 INFO:tasks.workunit.client.1.smithi157.stdout:6/264: read - d2/d17/f1e zero size 2024-02-28T16:27:00.874 INFO:tasks.workunit.client.1.smithi157.stdout:3/234: mknod d0/d20/d23/c49 0 2024-02-28T16:27:00.878 INFO:tasks.workunit.client.1.smithi157.stdout:5/322: write d0/d9/d1b/d36/f2a [978748,47165] 0 2024-02-28T16:27:00.879 INFO:tasks.workunit.client.1.smithi157.stdout:9/247: creat d0/d19/d30/f54 x:0 0 0 2024-02-28T16:27:00.882 INFO:tasks.workunit.client.1.smithi157.stdout:2/346: rename da/d38/d5a/d69/c6a to da/d38/c78 0 2024-02-28T16:27:00.883 INFO:tasks.workunit.client.1.smithi157.stdout:8/214: dwrite d1/f4 [4194304,4194304] 0 2024-02-28T16:27:00.883 INFO:tasks.workunit.client.1.smithi157.stdout:0/300: rename d1/d13/d52/l65 to d1/d13/d52/l66 0 2024-02-28T16:27:00.884 INFO:tasks.workunit.client.1.smithi157.stdout:2/347: stat da/f1e 0 2024-02-28T16:27:00.886 INFO:tasks.workunit.client.1.smithi157.stdout:2/348: chown da/d2b/d59 4 1 2024-02-28T16:27:00.886 INFO:tasks.workunit.client.1.smithi157.stdout:1/310: mknod d10/d11/d31/c63 0 2024-02-28T16:27:00.888 INFO:tasks.workunit.client.1.smithi157.stdout:8/215: write d1/f2 [4250183,73080] 0 2024-02-28T16:27:00.889 INFO:tasks.workunit.client.1.smithi157.stdout:7/282: creat df/d1f/f5e x:0 0 0 2024-02-28T16:27:00.900 INFO:tasks.workunit.client.1.smithi157.stdout:2/349: write da/f23 [7553757,116309] 0 2024-02-28T16:27:00.901 INFO:tasks.workunit.client.1.smithi157.stdout:9/248: rename d0/d19/d30/c35 to d0/d36/d37/d40/c55 0 2024-02-28T16:27:00.902 INFO:tasks.workunit.client.1.smithi157.stdout:7/283: readlink df/l23 0 2024-02-28T16:27:00.903 INFO:tasks.workunit.client.1.smithi157.stdout:1/311: write d10/d11/d31/f3d [1837651,46315] 0 2024-02-28T16:27:00.906 INFO:tasks.workunit.client.1.smithi157.stdout:9/249: fdatasync d0/fb 0 2024-02-28T16:27:00.912 INFO:tasks.workunit.client.1.smithi157.stdout:9/250: readlink d0/l31 0 2024-02-28T16:27:00.912 INFO:tasks.workunit.client.1.smithi157.stdout:7/284: read df/d1f/d24/f33 [6276167,989] 0 2024-02-28T16:27:00.912 INFO:tasks.workunit.client.1.smithi157.stdout:4/327: dwrite d3/da/d1f/d22/f4b [0,4194304] 0 2024-02-28T16:27:00.914 INFO:tasks.workunit.client.1.smithi157.stdout:2/350: mkdir da/d38/d5a/d79 0 2024-02-28T16:27:00.916 INFO:tasks.workunit.client.1.smithi157.stdout:1/312: fsync d10/d11/d31/d2a/f55 0 2024-02-28T16:27:00.922 INFO:tasks.workunit.client.1.smithi157.stdout:6/265: dwrite d2/d7/d8/f1a [0,4194304] 0 2024-02-28T16:27:00.923 INFO:tasks.workunit.client.1.smithi157.stdout:4/328: write d3/da/d28/f5a [4022924,121096] 0 2024-02-28T16:27:00.925 INFO:tasks.workunit.client.1.smithi157.stdout:9/251: write d0/d19/d30/f54 [413450,35227] 0 2024-02-28T16:27:00.925 INFO:tasks.workunit.client.1.smithi157.stdout:0/301: dwrite d1/d8/f25 [4194304,4194304] 0 2024-02-28T16:27:00.927 INFO:tasks.workunit.client.1.smithi157.stdout:7/285: unlink df/c18 0 2024-02-28T16:27:00.928 INFO:tasks.workunit.client.1.smithi157.stdout:8/216: creat d1/d5/d14/f47 x:0 0 0 2024-02-28T16:27:00.930 INFO:tasks.workunit.client.1.smithi157.stdout:9/252: chown d0/d19/d30/f48 40 1 2024-02-28T16:27:00.935 INFO:tasks.workunit.client.1.smithi157.stdout:1/313: rename d10/f16 to d10/d11/d31/d2a/f64 0 2024-02-28T16:27:00.937 INFO:tasks.workunit.client.1.smithi157.stdout:3/235: dread d0/d6/f11 [0,4194304] 0 2024-02-28T16:27:00.938 INFO:tasks.workunit.client.1.smithi157.stdout:2/351: getdents da/d35/d58 0 2024-02-28T16:27:00.940 INFO:tasks.workunit.client.1.smithi157.stdout:4/329: write d3/da/d1f/d22/f3c [638838,12851] 0 2024-02-28T16:27:00.941 INFO:tasks.workunit.client.1.smithi157.stdout:6/266: mkdir d2/d7/d8/da/d31/d37/d2d/d53 0 2024-02-28T16:27:00.944 INFO:tasks.workunit.client.1.smithi157.stdout:6/267: dread - d2/f35 zero size 2024-02-28T16:27:00.952 INFO:tasks.workunit.client.1.smithi157.stdout:3/236: rename d0/d20/d23/c49 to d0/d20/d23/c4a 0 2024-02-28T16:27:00.953 INFO:tasks.workunit.client.1.smithi157.stdout:0/302: dwrite d1/d13/f3e [0,4194304] 0 2024-02-28T16:27:00.957 INFO:tasks.workunit.client.1.smithi157.stdout:2/352: creat da/d38/d5a/d5c/f7a x:0 0 0 2024-02-28T16:27:00.962 INFO:tasks.workunit.client.1.smithi157.stdout:3/237: truncate d0/d6/f15 4966980 0 2024-02-28T16:27:00.963 INFO:tasks.workunit.client.1.smithi157.stdout:0/303: unlink d1/d13/d46/f32 0 2024-02-28T16:27:00.965 INFO:tasks.workunit.client.1.smithi157.stdout:8/217: truncate d1/d5/d10/f35 2136245 0 2024-02-28T16:27:00.968 INFO:tasks.workunit.client.1.smithi157.stdout:0/304: fsync d1/f24 0 2024-02-28T16:27:00.968 INFO:tasks.workunit.client.1.smithi157.stdout:1/314: dwrite d10/d11/f14 [0,4194304] 0 2024-02-28T16:27:00.969 INFO:tasks.workunit.client.1.smithi157.stdout:2/353: mkdir da/d38/d5a/d79/d7b 0 2024-02-28T16:27:00.974 INFO:tasks.workunit.client.1.smithi157.stdout:4/330: dwrite d3/f5 [0,4194304] 0 2024-02-28T16:27:00.977 INFO:tasks.workunit.client.1.smithi157.stdout:1/315: creat d10/d11/f65 x:0 0 0 2024-02-28T16:27:00.977 INFO:tasks.workunit.client.1.smithi157.stdout:8/218: creat d1/d5/d23/d38/f48 x:0 0 0 2024-02-28T16:27:00.981 INFO:tasks.workunit.client.1.smithi157.stdout:8/219: truncate d1/d5/f21 314298 0 2024-02-28T16:27:00.983 INFO:tasks.workunit.client.1.smithi157.stdout:8/220: chown d1/d5/d43 11 1 2024-02-28T16:27:00.983 INFO:tasks.workunit.client.1.smithi157.stdout:4/331: creat d3/da/d37/d71/f73 x:0 0 0 2024-02-28T16:27:00.986 INFO:tasks.workunit.client.1.smithi157.stdout:9/253: dread d0/f20 [0,4194304] 0 2024-02-28T16:27:00.989 INFO:tasks.workunit.client.1.smithi157.stdout:4/332: readlink d3/da/l24 0 2024-02-28T16:27:00.989 INFO:tasks.workunit.client.1.smithi157.stdout:9/254: stat d0 0 2024-02-28T16:27:00.994 INFO:tasks.workunit.client.1.smithi157.stdout:8/221: mkdir d1/d5/d23/d38/d49 0 2024-02-28T16:27:00.995 INFO:tasks.workunit.client.1.smithi157.stdout:4/333: chown d3/f1c 149 1 2024-02-28T16:27:01.002 INFO:tasks.workunit.client.1.smithi157.stdout:2/354: dread da/d2b/f4f [0,4194304] 0 2024-02-28T16:27:01.006 INFO:tasks.workunit.client.1.smithi157.stdout:4/334: truncate d3/da/f31 1197030 0 2024-02-28T16:27:01.009 INFO:tasks.workunit.client.1.smithi157.stdout:3/238: dwrite d0/d6/f3d [0,4194304] 0 2024-02-28T16:27:01.011 INFO:tasks.workunit.client.1.smithi157.stdout:2/355: chown da/f1f 3244 1 2024-02-28T16:27:01.012 INFO:tasks.workunit.client.1.smithi157.stdout:0/305: dwrite d1/d8/f59 [0,4194304] 0 2024-02-28T16:27:01.015 INFO:tasks.workunit.client.1.smithi157.stdout:1/316: dread d10/d11/f14 [0,4194304] 0 2024-02-28T16:27:01.015 INFO:tasks.workunit.client.1.smithi157.stdout:4/335: creat d3/da/d1f/d22/d52/f74 x:0 0 0 2024-02-28T16:27:01.016 INFO:tasks.workunit.client.1.smithi157.stdout:3/239: mkdir d0/d6/d44/d4b 0 2024-02-28T16:27:01.020 INFO:tasks.workunit.client.1.smithi157.stdout:4/336: write d3/f13 [3211430,124184] 0 2024-02-28T16:27:01.022 INFO:tasks.workunit.client.1.smithi157.stdout:4/337: readlink d3/da/l17 0 2024-02-28T16:27:01.023 INFO:tasks.workunit.client.1.smithi157.stdout:9/255: dwrite d0/d36/d3f/f50 [0,4194304] 0 2024-02-28T16:27:01.023 INFO:tasks.workunit.client.1.smithi157.stdout:8/222: dread d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:01.031 INFO:tasks.workunit.client.1.smithi157.stdout:1/317: symlink d10/d11/l66 0 2024-02-28T16:27:01.031 INFO:tasks.workunit.client.1.smithi157.stdout:0/306: rename d1/d8/d27/l30 to d1/d13/d61/l67 0 2024-02-28T16:27:01.031 INFO:tasks.workunit.client.1.smithi157.stdout:3/240: mknod d0/d20/c4c 0 2024-02-28T16:27:01.034 INFO:tasks.workunit.client.1.smithi157.stdout:2/356: link da/d38/c56 da/d38/c7c 0 2024-02-28T16:27:01.035 INFO:tasks.workunit.client.1.smithi157.stdout:3/241: read - d0/d6/f39 zero size 2024-02-28T16:27:01.036 INFO:tasks.workunit.client.1.smithi157.stdout:9/256: mknod d0/d36/c56 0 2024-02-28T16:27:01.039 INFO:tasks.workunit.client.1.smithi157.stdout:0/307: write d1/d13/f48 [2726018,57358] 0 2024-02-28T16:27:01.043 INFO:tasks.workunit.client.1.smithi157.stdout:2/357: dread - da/d47/d67/f68 zero size 2024-02-28T16:27:01.045 INFO:tasks.workunit.client.1.smithi157.stdout:9/257: write d0/d36/d37/d4d/f51 [963415,22446] 0 2024-02-28T16:27:01.048 INFO:tasks.workunit.client.1.smithi157.stdout:3/242: creat d0/f4d x:0 0 0 2024-02-28T16:27:01.053 INFO:tasks.workunit.client.1.smithi157.stdout:4/338: dwrite d3/da/d37/f50 [0,4194304] 0 2024-02-28T16:27:01.055 INFO:tasks.workunit.client.1.smithi157.stdout:8/223: dwrite d1/d5/d14/f47 [0,4194304] 0 2024-02-28T16:27:01.065 INFO:tasks.workunit.client.1.smithi157.stdout:1/318: dwrite d10/d11/f32 [0,4194304] 0 2024-02-28T16:27:01.066 INFO:tasks.workunit.client.1.smithi157.stdout:3/243: rmdir d0/d20/d23 39 2024-02-28T16:27:01.068 INFO:tasks.workunit.client.1.smithi157.stdout:8/224: write d1/d5/d43/f45 [53014,13511] 0 2024-02-28T16:27:01.077 INFO:tasks.workunit.client.1.smithi157.stdout:2/358: getdents da/d38/d4e 0 2024-02-28T16:27:01.077 INFO:tasks.workunit.client.1.smithi157.stdout:4/339: link d3/da/d1f/l3b d3/da/d28/l75 0 2024-02-28T16:27:01.077 INFO:tasks.workunit.client.1.smithi157.stdout:2/359: stat da/f1f 0 2024-02-28T16:27:01.078 INFO:tasks.workunit.client.1.smithi157.stdout:0/308: dwrite d1/f6 [0,4194304] 0 2024-02-28T16:27:01.080 INFO:tasks.workunit.client.1.smithi157.stdout:9/258: dwrite d0/d36/d3f/f50 [0,4194304] 0 2024-02-28T16:27:01.081 INFO:tasks.workunit.client.1.smithi157.stdout:8/225: creat d1/d5/f4a x:0 0 0 2024-02-28T16:27:01.086 INFO:tasks.workunit.client.1.smithi157.stdout:4/340: creat d3/da/d28/f76 x:0 0 0 2024-02-28T16:27:01.091 INFO:tasks.workunit.client.1.smithi157.stdout:3/244: creat d0/d6/d44/d48/f4e x:0 0 0 2024-02-28T16:27:01.091 INFO:tasks.workunit.client.1.smithi157.stdout:4/341: chown d3/l36 898845 1 2024-02-28T16:27:01.092 INFO:tasks.workunit.client.1.smithi157.stdout:1/319: creat d10/d11/d3a/d5c/f67 x:0 0 0 2024-02-28T16:27:01.092 INFO:tasks.workunit.client.1.smithi157.stdout:9/259: creat d0/d36/d37/f57 x:0 0 0 2024-02-28T16:27:01.094 INFO:tasks.workunit.client.1.smithi157.stdout:9/260: readlink d0/d36/l45 0 2024-02-28T16:27:01.094 INFO:tasks.workunit.client.1.smithi157.stdout:1/320: dread - d10/d11/d3a/d5c/f67 zero size 2024-02-28T16:27:01.096 INFO:tasks.workunit.client.1.smithi157.stdout:3/245: write d0/d6/f2d [1731021,24567] 0 2024-02-28T16:27:01.099 INFO:tasks.workunit.client.1.smithi157.stdout:0/309: getdents d1/d8/d33 0 2024-02-28T16:27:01.100 INFO:tasks.workunit.client.1.smithi157.stdout:9/261: creat d0/d19/f58 x:0 0 0 2024-02-28T16:27:01.104 INFO:tasks.workunit.client.1.smithi157.stdout:1/321: symlink d10/d11/d3a/d3e/d46/l68 0 2024-02-28T16:27:01.105 INFO:tasks.workunit.client.1.smithi157.stdout:4/342: rename d3/da/d1f/d22/d52 to d3/d77 0 2024-02-28T16:27:01.110 INFO:tasks.workunit.client.1.smithi157.stdout:8/226: dwrite d1/d5/d10/f18 [0,4194304] 0 2024-02-28T16:27:01.113 INFO:tasks.workunit.client.1.smithi157.stdout:8/227: write d1/d5/d23/d38/f48 [725149,35570] 0 2024-02-28T16:27:01.121 INFO:tasks.workunit.client.1.smithi157.stdout:5/323: sync 2024-02-28T16:27:01.121 INFO:tasks.workunit.client.1.smithi157.stdout:4/343: fsync d3/da/d1f/f40 0 2024-02-28T16:27:01.121 INFO:tasks.workunit.client.1.smithi157.stdout:6/268: sync 2024-02-28T16:27:01.122 INFO:tasks.workunit.client.1.smithi157.stdout:7/286: sync 2024-02-28T16:27:01.122 INFO:tasks.workunit.client.1.smithi157.stdout:1/322: rmdir d10/d11/d3a/d5c 39 2024-02-28T16:27:01.122 INFO:tasks.workunit.client.1.smithi157.stdout:7/287: readlink df/d1f/l3b 0 2024-02-28T16:27:01.122 INFO:tasks.workunit.client.1.smithi157.stdout:0/310: rename d1/d8/d27/f4a to d1/d13/d61/d64/f68 0 2024-02-28T16:27:01.122 INFO:tasks.workunit.client.1.smithi157.stdout:3/246: dwrite d0/f1c [0,4194304] 0 2024-02-28T16:27:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:00 smithi148 ceph-mon[28767]: Reconfiguring node-exporter.smithi157 (dependencies changed)... 2024-02-28T16:27:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:00 smithi148 ceph-mon[28767]: Reconfiguring daemon node-exporter.smithi157 on smithi157 2024-02-28T16:27:01.124 INFO:tasks.workunit.client.1.smithi157.stdout:7/288: fsync f0 0 2024-02-28T16:27:01.127 INFO:tasks.workunit.client.1.smithi157.stdout:5/324: write d0/d9/d47/f4d [744554,112871] 0 2024-02-28T16:27:01.129 INFO:tasks.workunit.client.1.smithi157.stdout:2/360: dread da/d38/f75 [0,4194304] 0 2024-02-28T16:27:01.129 INFO:tasks.workunit.client.1.smithi157.stdout:1/323: rmdir d10/d11/d22 39 2024-02-28T16:27:01.132 INFO:tasks.workunit.client.1.smithi157.stdout:6/269: truncate d2/d17/f34 479094 0 2024-02-28T16:27:01.132 INFO:tasks.workunit.client.1.smithi157.stdout:7/289: chown df/d1f/d24/d39/d41/f45 28909 1 2024-02-28T16:27:01.132 INFO:tasks.workunit.client.1.smithi157.stdout:3/247: mknod d0/d6/d44/c4f 0 2024-02-28T16:27:01.133 INFO:tasks.workunit.client.1.smithi157.stdout:0/311: unlink d1/d8/c40 0 2024-02-28T16:27:01.135 INFO:tasks.workunit.client.1.smithi157.stdout:5/325: fsync d0/fe 0 2024-02-28T16:27:01.137 INFO:tasks.workunit.client.1.smithi157.stdout:2/361: rmdir da/d3a 39 2024-02-28T16:27:01.141 INFO:tasks.workunit.client.1.smithi157.stdout:0/312: read d1/d8/f1d [3285224,106137] 0 2024-02-28T16:27:01.141 INFO:tasks.workunit.client.1.smithi157.stdout:6/270: chown d2/d7/d8/da/d31/d37/c52 18203978 1 2024-02-28T16:27:01.141 INFO:tasks.workunit.client.1.smithi157.stdout:3/248: read d0/f46 [174770,104431] 0 2024-02-28T16:27:01.142 INFO:tasks.workunit.client.1.smithi157.stdout:9/262: dread d0/f3 [0,4194304] 0 2024-02-28T16:27:01.143 INFO:tasks.workunit.client.1.smithi157.stdout:6/271: stat d2/d7/d8/da 0 2024-02-28T16:27:01.146 INFO:tasks.workunit.client.1.smithi157.stdout:2/362: symlink da/d38/d5a/d79/l7d 0 2024-02-28T16:27:01.146 INFO:tasks.workunit.client.1.smithi157.stdout:4/344: dwrite d3/da/fd [0,4194304] 0 2024-02-28T16:27:01.146 INFO:tasks.workunit.client.1.smithi157.stdout:1/324: link d10/d11/d31/f3d d10/d11/d22/f69 0 2024-02-28T16:27:01.154 INFO:tasks.workunit.client.1.smithi157.stdout:5/326: rename d0/d30/l3d to d0/d9/d47/d5b/l6e 0 2024-02-28T16:27:01.155 INFO:tasks.workunit.client.1.smithi157.stdout:6/272: chown d2/d7/d8/da/d31/d37/d2d/d30 0 1 2024-02-28T16:27:01.157 INFO:tasks.workunit.client.1.smithi157.stdout:7/290: link df/d25/d59/f5d df/d1f/d24/d39/f5f 0 2024-02-28T16:27:01.157 INFO:tasks.workunit.client.1.smithi157.stdout:6/273: fdatasync d2/f35 0 2024-02-28T16:27:01.159 INFO:tasks.workunit.client.1.smithi157.stdout:3/249: getdents d0/d6/d34/d43 0 2024-02-28T16:27:01.162 INFO:tasks.workunit.client.1.smithi157.stdout:9/263: link d0/l3c d0/d36/d37/d40/l59 0 2024-02-28T16:27:01.162 INFO:tasks.workunit.client.1.smithi157.stdout:3/250: read d0/d6/fb [2758904,34769] 0 2024-02-28T16:27:01.163 INFO:tasks.workunit.client.1.smithi157.stdout:5/327: rename d0/d30/l5e to d0/d9/d3a/l6f 0 2024-02-28T16:27:01.166 INFO:tasks.workunit.client.1.smithi157.stdout:7/291: creat df/f60 x:0 0 0 2024-02-28T16:27:01.167 INFO:tasks.workunit.client.1.smithi157.stdout:5/328: stat d0/d9/d1b/d36/f53 0 2024-02-28T16:27:01.167 INFO:tasks.workunit.client.1.smithi157.stdout:2/363: dwrite da/fe [0,4194304] 0 2024-02-28T16:27:01.167 INFO:tasks.workunit.client.1.smithi157.stdout:0/313: dwrite d1/d8/d33/d56/f62 [0,4194304] 0 2024-02-28T16:27:01.168 INFO:tasks.workunit.client.1.smithi157.stdout:3/251: write d0/d6/d44/d48/f4e [332905,128884] 0 2024-02-28T16:27:01.169 INFO:tasks.workunit.client.1.smithi157.stdout:9/264: mknod d0/d36/d37/d40/c5a 0 2024-02-28T16:27:01.171 INFO:tasks.workunit.client.1.smithi157.stdout:1/325: dread d10/d11/f14 [0,4194304] 0 2024-02-28T16:27:01.176 INFO:tasks.workunit.client.1.smithi157.stdout:5/329: symlink d0/l70 0 2024-02-28T16:27:01.176 INFO:tasks.workunit.client.1.smithi157.stdout:7/292: creat df/d1f/d24/d4f/f61 x:0 0 0 2024-02-28T16:27:01.178 INFO:tasks.workunit.client.1.smithi157.stdout:1/326: write d10/d11/d3a/d3e/f5b [240490,19640] 0 2024-02-28T16:27:01.179 INFO:tasks.workunit.client.1.smithi157.stdout:2/364: mkdir da/d38/d7e 0 2024-02-28T16:27:01.181 INFO:tasks.workunit.client.1.smithi157.stdout:9/265: mkdir d0/d36/d37/d40/d5b 0 2024-02-28T16:27:01.182 INFO:tasks.workunit.client.1.smithi157.stdout:1/327: stat d10/d11/d31/d2a/f55 0 2024-02-28T16:27:01.185 INFO:tasks.workunit.client.1.smithi157.stdout:6/274: dwrite d2/d7/d8/da/d31/d37/d2d/f3b [0,4194304] 0 2024-02-28T16:27:01.186 INFO:tasks.workunit.client.1.smithi157.stdout:5/330: symlink d0/d9/d47/d5c/l71 0 2024-02-28T16:27:01.187 INFO:tasks.workunit.client.1.smithi157.stdout:3/252: creat d0/d20/d23/f50 x:0 0 0 2024-02-28T16:27:01.187 INFO:tasks.workunit.client.1.smithi157.stdout:2/365: creat da/d47/d67/f7f x:0 0 0 2024-02-28T16:27:01.189 INFO:tasks.workunit.client.1.smithi157.stdout:7/293: unlink c4 0 2024-02-28T16:27:01.191 INFO:tasks.workunit.client.1.smithi157.stdout:0/314: dread d1/d13/ff [0,4194304] 0 2024-02-28T16:27:01.193 INFO:tasks.workunit.client.1.smithi157.stdout:2/366: symlink da/d38/d5a/l80 0 2024-02-28T16:27:01.194 INFO:tasks.workunit.client.1.smithi157.stdout:1/328: mkdir d10/d11/d3a/d5c/d6a 0 2024-02-28T16:27:01.198 INFO:tasks.workunit.client.1.smithi157.stdout:0/315: mknod d1/d8/d33/d56/c69 0 2024-02-28T16:27:01.198 INFO:tasks.workunit.client.1.smithi157.stdout:1/329: read d10/d11/d3a/f3c [1029611,16578] 0 2024-02-28T16:27:01.199 INFO:tasks.workunit.client.1.smithi157.stdout:0/316: chown d1/c3f 1125 1 2024-02-28T16:27:01.199 INFO:tasks.workunit.client.1.smithi157.stdout:6/275: link d2/d7/d8/da/d31/d37/d2d/f48 d2/d7/d8/da/d31/d37/d2b/f54 0 2024-02-28T16:27:01.201 INFO:tasks.workunit.client.1.smithi157.stdout:9/266: rename d0/d36/d37/c41 to d0/d36/c5c 0 2024-02-28T16:27:01.202 INFO:tasks.workunit.client.1.smithi157.stdout:6/276: read d2/d7/d8/f1a [421938,41494] 0 2024-02-28T16:27:01.202 INFO:tasks.workunit.client.1.smithi157.stdout:3/253: link d0/f3f d0/d20/f51 0 2024-02-28T16:27:01.204 INFO:tasks.workunit.client.1.smithi157.stdout:0/317: symlink d1/d13/d46/l6a 0 2024-02-28T16:27:01.205 INFO:tasks.workunit.client.1.smithi157.stdout:1/330: creat d10/f6b x:0 0 0 2024-02-28T16:27:01.211 INFO:tasks.workunit.client.1.smithi157.stdout:6/277: unlink d2/d17/f46 0 2024-02-28T16:27:01.211 INFO:tasks.workunit.client.1.smithi157.stdout:7/294: dwrite df/d1f/d24/d4f/f61 [0,4194304] 0 2024-02-28T16:27:01.212 INFO:tasks.workunit.client.1.smithi157.stdout:1/331: mkdir d10/d11/d3a/d5c/d6c 0 2024-02-28T16:27:01.213 INFO:tasks.workunit.client.1.smithi157.stdout:7/295: readlink df/l32 0 2024-02-28T16:27:01.216 INFO:tasks.workunit.client.1.smithi157.stdout:6/278: truncate d2/d17/f21 776363 0 2024-02-28T16:27:01.219 INFO:tasks.workunit.client.1.smithi157.stdout:7/296: write df/d1f/d24/d39/f5f [473064,13901] 0 2024-02-28T16:27:01.220 INFO:tasks.workunit.client.1.smithi157.stdout:2/367: dread da/f1f [0,4194304] 0 2024-02-28T16:27:01.221 INFO:tasks.workunit.client.1.smithi157.stdout:6/279: symlink d2/d7/de/d40/l55 0 2024-02-28T16:27:01.223 INFO:tasks.workunit.client.1.smithi157.stdout:9/267: dwrite d0/f18 [0,4194304] 0 2024-02-28T16:27:01.232 INFO:tasks.workunit.client.1.smithi157.stdout:2/368: unlink da/fe 0 2024-02-28T16:27:01.233 INFO:tasks.workunit.client.1.smithi157.stdout:9/268: creat d0/d36/d37/d4d/f5d x:0 0 0 2024-02-28T16:27:01.235 INFO:tasks.workunit.client.1.smithi157.stdout:3/254: dread d0/d6/d1e/f1f [0,4194304] 0 2024-02-28T16:27:01.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:00 smithi157 ceph-mon[38346]: Reconfiguring node-exporter.smithi157 (dependencies changed)... 2024-02-28T16:27:01.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:00 smithi157 ceph-mon[38346]: Reconfiguring daemon node-exporter.smithi157 on smithi157 2024-02-28T16:27:01.242 INFO:tasks.workunit.client.1.smithi157.stdout:1/332: dwrite d10/d11/f65 [0,4194304] 0 2024-02-28T16:27:01.243 INFO:tasks.workunit.client.1.smithi157.stdout:3/255: creat d0/d6/d44/f52 x:0 0 0 2024-02-28T16:27:01.244 INFO:tasks.workunit.client.1.smithi157.stdout:2/369: creat da/d38/d5a/d79/d7b/f81 x:0 0 0 2024-02-28T16:27:01.245 INFO:tasks.workunit.client.1.smithi157.stdout:9/269: symlink d0/d36/d37/d4d/l5e 0 2024-02-28T16:27:01.247 INFO:tasks.workunit.client.1.smithi157.stdout:0/318: dread d1/d13/d46/f51 [0,4194304] 0 2024-02-28T16:27:01.247 INFO:tasks.workunit.client.1.smithi157.stdout:7/297: dwrite df/d1f/d37/f49 [0,4194304] 0 2024-02-28T16:27:01.250 INFO:tasks.workunit.client.1.smithi157.stdout:1/333: creat d10/d11/d31/d2a/f6d x:0 0 0 2024-02-28T16:27:01.257 INFO:tasks.workunit.client.1.smithi157.stdout:3/256: creat d0/d20/f53 x:0 0 0 2024-02-28T16:27:01.261 INFO:tasks.workunit.client.1.smithi157.stdout:9/270: unlink d0/l3c 0 2024-02-28T16:27:01.264 INFO:tasks.workunit.client.1.smithi157.stdout:2/370: rename da/c4d to da/d2b/d59/c82 0 2024-02-28T16:27:01.271 INFO:tasks.workunit.client.1.smithi157.stdout:2/371: chown da/d38/c72 2623383 1 2024-02-28T16:27:01.271 INFO:tasks.workunit.client.1.smithi157.stdout:3/257: getdents d0/d6/d44/d4b 0 2024-02-28T16:27:01.272 INFO:tasks.workunit.client.1.smithi157.stdout:9/271: symlink d0/d36/d3f/l5f 0 2024-02-28T16:27:01.277 INFO:tasks.workunit.client.1.smithi157.stdout:3/258: creat d0/d20/d23/d2b/d2e/f54 x:0 0 0 2024-02-28T16:27:01.280 INFO:tasks.workunit.client.1.smithi157.stdout:9/272: rename d0/d36/d37/d4d/f52 to d0/d36/d3f/f60 0 2024-02-28T16:27:01.281 INFO:tasks.workunit.client.1.smithi157.stdout:9/273: fsync d0/d19/f29 0 2024-02-28T16:27:01.283 INFO:tasks.workunit.client.1.smithi157.stdout:3/259: symlink d0/d6/d44/l55 0 2024-02-28T16:27:01.284 INFO:tasks.workunit.client.1.smithi157.stdout:7/298: dread df/d25/d4e/f52 [0,4194304] 0 2024-02-28T16:27:01.286 INFO:tasks.workunit.client.1.smithi157.stdout:7/299: chown df/f17 14 1 2024-02-28T16:27:01.286 INFO:tasks.workunit.client.1.smithi157.stdout:2/372: getdents da/d38 0 2024-02-28T16:27:01.288 INFO:tasks.workunit.client.1.smithi157.stdout:9/274: mknod d0/d36/d37/c61 0 2024-02-28T16:27:01.292 INFO:tasks.workunit.client.1.smithi157.stdout:6/280: dwrite d2/d17/f34 [0,4194304] 0 2024-02-28T16:27:01.303 INFO:tasks.workunit.client.1.smithi157.stdout:1/334: dwrite d10/f12 [0,4194304] 0 2024-02-28T16:27:01.304 INFO:tasks.workunit.client.1.smithi157.stdout:3/260: dwrite d0/f1b [4194304,4194304] 0 2024-02-28T16:27:01.308 INFO:tasks.workunit.client.1.smithi157.stdout:6/281: truncate d2/d7/fc 2787358 0 2024-02-28T16:27:01.367 INFO:tasks.workunit.client.1.smithi157.stdout:7/300: dread df/d1f/d24/d4f/f61 [0,4194304] 0 2024-02-28T16:27:01.367 INFO:tasks.workunit.client.1.smithi157.stdout:6/282: dread - d2/f4b zero size 2024-02-28T16:27:01.370 INFO:tasks.workunit.client.1.smithi157.stdout:7/301: fsync df/f60 0 2024-02-28T16:27:01.370 INFO:tasks.workunit.client.1.smithi157.stdout:2/373: fdatasync da/d38/f40 0 2024-02-28T16:27:01.370 INFO:tasks.workunit.client.1.smithi157.stdout:6/283: fdatasync d2/d17/f21 0 2024-02-28T16:27:01.371 INFO:tasks.workunit.client.1.smithi157.stdout:1/335: symlink d10/d11/l6e 0 2024-02-28T16:27:01.372 INFO:tasks.workunit.client.1.smithi157.stdout:0/319: dwrite d1/f2 [4194304,4194304] 0 2024-02-28T16:27:01.373 INFO:tasks.workunit.client.1.smithi157.stdout:9/275: dwrite d0/d36/d3f/f50 [4194304,4194304] 0 2024-02-28T16:27:01.374 INFO:tasks.workunit.client.1.smithi157.stdout:6/284: chown d2/d7/de/f4e 5827 1 2024-02-28T16:27:01.375 INFO:tasks.workunit.client.1.smithi157.stdout:0/320: read d1/d13/ff [1914236,52489] 0 2024-02-28T16:27:01.376 INFO:tasks.workunit.client.1.smithi157.stdout:1/336: write d10/d11/d31/f41 [1018793,17838] 0 2024-02-28T16:27:01.377 INFO:tasks.workunit.client.1.smithi157.stdout:9/276: write d0/f12 [2979654,87489] 0 2024-02-28T16:27:01.378 INFO:tasks.workunit.client.1.smithi157.stdout:3/261: unlink d0/f1b 0 2024-02-28T16:27:01.379 INFO:tasks.workunit.client.1.smithi157.stdout:9/277: readlink d0/l2f 0 2024-02-28T16:27:01.380 INFO:tasks.workunit.client.1.smithi157.stdout:2/374: chown da/d38/d5a/d79/d7b/f81 36 1 2024-02-28T16:27:01.387 INFO:tasks.workunit.client.1.smithi157.stdout:2/375: read da/ff [1002376,55872] 0 2024-02-28T16:27:01.388 INFO:tasks.workunit.client.1.smithi157.stdout:6/285: link d2/f5 d2/d7/d8/f56 0 2024-02-28T16:27:01.391 INFO:tasks.workunit.client.1.smithi157.stdout:0/321: link d1/d13/f4b d1/d8/d33/f6b 0 2024-02-28T16:27:01.392 INFO:tasks.workunit.client.1.smithi157.stdout:7/302: dwrite df/d1f/d24/d38/f51 [0,4194304] 0 2024-02-28T16:27:01.396 INFO:tasks.workunit.client.1.smithi157.stdout:1/337: mkdir d10/d11/d3a/d5c/d6c/d6f 0 2024-02-28T16:27:01.396 INFO:tasks.workunit.client.1.smithi157.stdout:7/303: write df/f31 [51905,35206] 0 2024-02-28T16:27:01.399 INFO:tasks.workunit.client.1.smithi157.stdout:6/286: chown d2/d7/de/d1b/d4d/l4f 661574 1 2024-02-28T16:27:01.403 INFO:tasks.workunit.client.1.smithi157.stdout:0/322: mkdir d1/da/d6c 0 2024-02-28T16:27:01.405 INFO:tasks.workunit.client.1.smithi157.stdout:0/323: chown d1/d8/d27/d55/f5f 2050 1 2024-02-28T16:27:01.406 INFO:tasks.workunit.client.1.smithi157.stdout:7/304: creat df/d1f/d24/d38/f62 x:0 0 0 2024-02-28T16:27:01.408 INFO:tasks.workunit.client.1.smithi157.stdout:1/338: dread d10/d11/d3a/d3e/f5b [0,4194304] 0 2024-02-28T16:27:01.408 INFO:tasks.workunit.client.1.smithi157.stdout:6/287: creat d2/d7/de/d1b/f57 x:0 0 0 2024-02-28T16:27:01.410 INFO:tasks.workunit.client.1.smithi157.stdout:7/305: truncate df/d1f/d24/d39/f5c 86220 0 2024-02-28T16:27:01.415 INFO:tasks.workunit.client.1.smithi157.stdout:2/376: getdents da/d38 0 2024-02-28T16:27:01.418 INFO:tasks.workunit.client.1.smithi157.stdout:2/377: readlink da/ld 0 2024-02-28T16:27:01.421 INFO:tasks.workunit.client.1.smithi157.stdout:2/378: stat da/d47/d5f 0 2024-02-28T16:27:01.422 INFO:tasks.workunit.client.1.smithi157.stdout:0/324: dwrite d1/d13/f3e [0,4194304] 0 2024-02-28T16:27:01.425 INFO:tasks.workunit.client.1.smithi157.stdout:2/379: write da/d47/d67/f68 [647983,15018] 0 2024-02-28T16:27:01.428 INFO:tasks.workunit.client.1.smithi157.stdout:6/288: dwrite d2/d7/d8/da/d31/d3a/f33 [0,4194304] 0 2024-02-28T16:27:01.429 INFO:tasks.workunit.client.1.smithi157.stdout:0/325: write d1/d13/d46/f51 [981035,98232] 0 2024-02-28T16:27:01.430 INFO:tasks.workunit.client.1.smithi157.stdout:3/262: dread d0/f8 [0,4194304] 0 2024-02-28T16:27:01.430 INFO:tasks.workunit.client.1.smithi157.stdout:7/306: dwrite df/f16 [4194304,4194304] 0 2024-02-28T16:27:01.432 INFO:tasks.workunit.client.1.smithi157.stdout:0/326: read - d1/da/f58 zero size 2024-02-28T16:27:01.438 INFO:tasks.workunit.client.1.smithi157.stdout:2/380: mkdir da/d38/d3e/d83 0 2024-02-28T16:27:01.442 INFO:tasks.workunit.client.1.smithi157.stdout:7/307: read df/d1f/d24/d39/f5c [27920,51938] 0 2024-02-28T16:27:01.446 INFO:tasks.workunit.client.1.smithi157.stdout:6/289: mkdir d2/d58 0 2024-02-28T16:27:01.448 INFO:tasks.workunit.client.1.smithi157.stdout:6/290: stat d2/d7/de/d40/l44 0 2024-02-28T16:27:01.449 INFO:tasks.workunit.client.1.smithi157.stdout:7/308: chown df/d1f/d37/d46/f5b 2975230 1 2024-02-28T16:27:01.450 INFO:tasks.workunit.client.1.smithi157.stdout:0/327: fdatasync d1/d8/f9 0 2024-02-28T16:27:01.451 INFO:tasks.workunit.client.1.smithi157.stdout:6/291: fdatasync d2/d7/f24 0 2024-02-28T16:27:01.454 INFO:tasks.workunit.client.1.smithi157.stdout:2/381: creat da/d38/d3e/f84 x:0 0 0 2024-02-28T16:27:01.454 INFO:tasks.workunit.client.1.smithi157.stdout:7/309: fsync df/d25/d59/f5d 0 2024-02-28T16:27:01.454 INFO:tasks.workunit.client.1.smithi157.stdout:9/278: dwrite d0/f3 [0,4194304] 0 2024-02-28T16:27:01.458 INFO:tasks.workunit.client.1.smithi157.stdout:1/339: write d10/d11/d22/f69 [773738,27027] 0 2024-02-28T16:27:01.460 INFO:tasks.workunit.client.1.smithi157.stdout:3/263: getdents d0/d6/d44/d48 0 2024-02-28T16:27:01.461 INFO:tasks.workunit.client.1.smithi157.stdout:6/292: mkdir d2/d7/d8/da/d31/d59 0 2024-02-28T16:27:01.462 INFO:tasks.workunit.client.1.smithi157.stdout:2/382: fdatasync da/d2b/f3d 0 2024-02-28T16:27:01.469 INFO:tasks.workunit.client.1.smithi157.stdout:1/340: rename d10/d11/d3a/d3e to d10/d11/d31/d2a/d70 0 2024-02-28T16:27:01.469 INFO:tasks.workunit.client.1.smithi157.stdout:0/328: creat d1/d13/f6d x:0 0 0 2024-02-28T16:27:01.471 INFO:tasks.workunit.client.1.smithi157.stdout:2/383: dread da/d38/d5a/f66 [0,4194304] 0 2024-02-28T16:27:01.473 INFO:tasks.workunit.client.1.smithi157.stdout:3/264: rename d0/f3f to d0/d6/f56 0 2024-02-28T16:27:01.474 INFO:tasks.workunit.client.1.smithi157.stdout:6/293: dread d2/d7/d8/da/d31/d37/d2b/f54 [0,4194304] 0 2024-02-28T16:27:01.475 INFO:tasks.workunit.client.1.smithi157.stdout:0/329: mknod d1/d8/d27/c6e 0 2024-02-28T16:27:01.476 INFO:tasks.workunit.client.1.smithi157.stdout:9/279: dread d0/d36/d37/f43 [0,4194304] 0 2024-02-28T16:27:01.477 INFO:tasks.workunit.client.1.smithi157.stdout:2/384: chown da/c18 41 1 2024-02-28T16:27:01.478 INFO:tasks.workunit.client.1.smithi157.stdout:3/265: creat d0/d20/d23/d2b/f57 x:0 0 0 2024-02-28T16:27:01.480 INFO:tasks.workunit.client.1.smithi157.stdout:6/294: creat d2/d17/f5a x:0 0 0 2024-02-28T16:27:01.481 INFO:tasks.workunit.client.1.smithi157.stdout:2/385: stat da/d38/d5a 0 2024-02-28T16:27:01.481 INFO:tasks.workunit.client.1.smithi157.stdout:7/310: dwrite df/d1f/d24/d38/f51 [4194304,4194304] 0 2024-02-28T16:27:01.483 INFO:tasks.workunit.client.1.smithi157.stdout:7/311: write df/f10 [903771,16661] 0 2024-02-28T16:27:01.485 INFO:tasks.workunit.client.1.smithi157.stdout:0/330: rename d1/d8/d33/d56/c69 to d1/d13/d61/c6f 0 2024-02-28T16:27:01.486 INFO:tasks.workunit.client.1.smithi157.stdout:1/341: dwrite fa [0,4194304] 0 2024-02-28T16:27:01.487 INFO:tasks.workunit.client.1.smithi157.stdout:3/266: mknod d0/d20/d23/d2b/d2e/c58 0 2024-02-28T16:27:01.490 INFO:tasks.workunit.client.1.smithi157.stdout:6/295: write d2/d7/d8/da/d31/d3a/f2f [2752841,126849] 0 2024-02-28T16:27:01.495 INFO:tasks.workunit.client.1.smithi157.stdout:8/228: sync 2024-02-28T16:27:01.495 INFO:tasks.workunit.client.1.smithi157.stdout:3/267: creat d0/d20/d23/d2b/f59 x:0 0 0 2024-02-28T16:27:01.497 INFO:tasks.workunit.client.1.smithi157.stdout:9/280: creat d0/d36/d37/d40/f62 x:0 0 0 2024-02-28T16:27:01.500 INFO:tasks.workunit.client.1.smithi157.stdout:2/386: dread da/f26 [0,4194304] 0 2024-02-28T16:27:01.503 INFO:tasks.workunit.client.1.smithi157.stdout:0/331: dread d1/f6 [0,4194304] 0 2024-02-28T16:27:01.504 INFO:tasks.workunit.client.1.smithi157.stdout:2/387: truncate da/d38/d5a/d79/d7b/f81 693102 0 2024-02-28T16:27:01.517 INFO:tasks.workunit.client.1.smithi157.stdout:7/312: write df/d1f/d24/d38/f43 [585704,47543] 0 2024-02-28T16:27:01.518 INFO:tasks.workunit.client.1.smithi157.stdout:2/388: mknod da/d38/c85 0 2024-02-28T16:27:01.520 INFO:tasks.workunit.client.1.smithi157.stdout:3/268: creat d0/d20/f5a x:0 0 0 2024-02-28T16:27:01.521 INFO:tasks.workunit.client.1.smithi157.stdout:1/342: link l3 d10/d11/d3a/d5c/d6c/d6f/l71 0 2024-02-28T16:27:01.523 INFO:tasks.workunit.client.1.smithi157.stdout:1/343: write d10/d11/d31/d2a/f55 [3131312,101691] 0 2024-02-28T16:27:01.524 INFO:tasks.workunit.client.1.smithi157.stdout:6/296: getdents d2/d7/de 0 2024-02-28T16:27:01.524 INFO:tasks.workunit.client.1.smithi157.stdout:0/332: mknod d1/da/d6c/c70 0 2024-02-28T16:27:01.525 INFO:tasks.workunit.client.1.smithi157.stdout:9/281: creat d0/d36/f63 x:0 0 0 2024-02-28T16:27:01.526 INFO:tasks.workunit.client.1.smithi157.stdout:7/313: mknod df/d25/d59/c63 0 2024-02-28T16:27:01.527 INFO:tasks.workunit.client.1.smithi157.stdout:2/389: rmdir da/d38/d5a/d79 39 2024-02-28T16:27:01.527 INFO:tasks.workunit.client.1.smithi157.stdout:1/344: truncate f4 2410444 0 2024-02-28T16:27:01.528 INFO:tasks.workunit.client.1.smithi157.stdout:0/333: chown d1/d8/d27/l28 14 1 2024-02-28T16:27:01.531 INFO:tasks.workunit.client.1.smithi157.stdout:6/297: mkdir d2/d7/de/d1b/d4d/d5b 0 2024-02-28T16:27:01.531 INFO:tasks.workunit.client.1.smithi157.stdout:1/345: stat d10/d11/d22/c29 0 2024-02-28T16:27:01.532 INFO:tasks.workunit.client.1.smithi157.stdout:0/334: readlink d1/d8/l29 0 2024-02-28T16:27:01.534 INFO:tasks.workunit.client.1.smithi157.stdout:8/229: dwrite d1/d5/d10/f35 [0,4194304] 0 2024-02-28T16:27:01.535 INFO:tasks.workunit.client.1.smithi157.stdout:2/390: creat da/f86 x:0 0 0 2024-02-28T16:27:01.535 INFO:tasks.workunit.client.1.smithi157.stdout:4/345: sync 2024-02-28T16:27:01.535 INFO:tasks.workunit.client.1.smithi157.stdout:5/331: sync 2024-02-28T16:27:01.539 INFO:tasks.workunit.client.1.smithi157.stdout:6/298: truncate d2/d17/f1e 44576 0 2024-02-28T16:27:01.542 INFO:tasks.workunit.client.1.smithi157.stdout:0/335: write d1/d8/d27/f3a [4947920,104747] 0 2024-02-28T16:27:01.542 INFO:tasks.workunit.client.1.smithi157.stdout:5/332: mknod d0/d8/c72 0 2024-02-28T16:27:01.544 INFO:tasks.workunit.client.1.smithi157.stdout:4/346: unlink d3/da/l17 0 2024-02-28T16:27:01.545 INFO:tasks.workunit.client.1.smithi157.stdout:1/346: truncate d10/d11/d31/d2a/f64 4459016 0 2024-02-28T16:27:01.546 INFO:tasks.workunit.client.1.smithi157.stdout:3/269: dwrite d0/d6/d44/f52 [0,4194304] 0 2024-02-28T16:27:01.546 INFO:tasks.workunit.client.1.smithi157.stdout:8/230: creat d1/d5/d10/f4b x:0 0 0 2024-02-28T16:27:01.549 INFO:tasks.workunit.client.1.smithi157.stdout:5/333: creat d0/d9/d1b/f73 x:0 0 0 2024-02-28T16:27:01.549 INFO:tasks.workunit.client.1.smithi157.stdout:6/299: fdatasync d2/d7/d8/da/d31/d37/d2b/f3f 0 2024-02-28T16:27:01.552 INFO:tasks.workunit.client.1.smithi157.stdout:1/347: chown d10/d11/d3a/c44 138474 1 2024-02-28T16:27:01.553 INFO:tasks.workunit.client.1.smithi157.stdout:4/347: creat d3/da/d37/f78 x:0 0 0 2024-02-28T16:27:01.554 INFO:tasks.workunit.client.1.smithi157.stdout:3/270: dread - d0/d20/d23/d2b/f57 zero size 2024-02-28T16:27:01.554 INFO:tasks.workunit.client.1.smithi157.stdout:5/334: fdatasync d0/fe 0 2024-02-28T16:27:01.554 INFO:tasks.workunit.client.1.smithi157.stdout:2/391: rmdir da/d47/d5f 0 2024-02-28T16:27:01.554 INFO:tasks.workunit.client.1.smithi157.stdout:9/282: dread d0/f20 [0,4194304] 0 2024-02-28T16:27:01.556 INFO:tasks.workunit.client.1.smithi157.stdout:8/231: write d1/d5/d14/f42 [4900,13982] 0 2024-02-28T16:27:01.558 INFO:tasks.workunit.client.1.smithi157.stdout:7/314: dwrite f3 [0,4194304] 0 2024-02-28T16:27:01.558 INFO:tasks.workunit.client.1.smithi157.stdout:5/335: chown d0/d8/l62 119837 1 2024-02-28T16:27:01.559 INFO:tasks.workunit.client.1.smithi157.stdout:4/348: symlink d3/d77/l79 0 2024-02-28T16:27:01.560 INFO:tasks.workunit.client.1.smithi157.stdout:6/300: chown d2/d7/d8/da/d31/d37/d2d/d30/l36 4 1 2024-02-28T16:27:01.561 INFO:tasks.workunit.client.1.smithi157.stdout:1/348: mknod d10/d11/d31/d2a/d70/d46/c72 0 2024-02-28T16:27:01.564 INFO:tasks.workunit.client.1.smithi157.stdout:4/349: write d3/da/d1f/f32 [325105,19059] 0 2024-02-28T16:27:01.565 INFO:tasks.workunit.client.1.smithi157.stdout:2/392: fsync da/f1f 0 2024-02-28T16:27:01.567 INFO:tasks.workunit.client.1.smithi157.stdout:1/349: mkdir d10/d73 0 2024-02-28T16:27:01.609 INFO:tasks.workunit.client.1.smithi157.stdout:7/315: mkdir df/d1f/d24/d39/d64 0 2024-02-28T16:27:01.610 INFO:tasks.workunit.client.1.smithi157.stdout:8/232: dread d1/d5/fe [0,4194304] 0 2024-02-28T16:27:01.612 INFO:tasks.workunit.client.1.smithi157.stdout:7/316: write df/f31 [199026,104583] 0 2024-02-28T16:27:01.613 INFO:tasks.workunit.client.1.smithi157.stdout:4/350: creat d3/da/d1f/d22/f7a x:0 0 0 2024-02-28T16:27:01.614 INFO:tasks.workunit.client.1.smithi157.stdout:4/351: chown d3/c18 1123 1 2024-02-28T16:27:01.614 INFO:tasks.workunit.client.1.smithi157.stdout:7/317: fdatasync df/d1f/d24/f53 0 2024-02-28T16:27:01.618 INFO:tasks.workunit.client.1.smithi157.stdout:9/283: link d0/d36/d37/d4d/f53 d0/d19/f64 0 2024-02-28T16:27:01.620 INFO:tasks.workunit.client.1.smithi157.stdout:4/352: symlink d3/da/d28/l7b 0 2024-02-28T16:27:01.624 INFO:tasks.workunit.client.1.smithi157.stdout:1/350: dread fa [0,4194304] 0 2024-02-28T16:27:01.624 INFO:tasks.workunit.client.1.smithi157.stdout:7/318: symlink df/d1f/d24/l65 0 2024-02-28T16:27:01.624 INFO:tasks.workunit.client.1.smithi157.stdout:2/393: getdents da/d38 0 2024-02-28T16:27:01.626 INFO:tasks.workunit.client.1.smithi157.stdout:4/353: creat d3/da/d48/f7c x:0 0 0 2024-02-28T16:27:01.627 INFO:tasks.workunit.client.1.smithi157.stdout:7/319: fdatasync df/f10 0 2024-02-28T16:27:01.631 INFO:tasks.workunit.client.1.smithi157.stdout:6/301: dread d2/d7/fc [0,4194304] 0 2024-02-28T16:27:01.632 INFO:tasks.workunit.client.1.smithi157.stdout:0/336: dread d1/d8/d27/f2b [0,4194304] 0 2024-02-28T16:27:01.634 INFO:tasks.workunit.client.1.smithi157.stdout:5/336: dwrite d0/d9/d47/d5b/d6a/f6b [0,4194304] 0 2024-02-28T16:27:01.637 INFO:tasks.workunit.client.1.smithi157.stdout:6/302: write d2/d17/f2a [1258705,42630] 0 2024-02-28T16:27:01.637 INFO:tasks.workunit.client.1.smithi157.stdout:5/337: fsync d0/d9/f48 0 2024-02-28T16:27:01.638 INFO:tasks.workunit.client.1.smithi157.stdout:4/354: link d3/da/f5e d3/da/d1f/f7d 0 2024-02-28T16:27:01.639 INFO:tasks.workunit.client.1.smithi157.stdout:8/233: truncate d1/d5/d10/f35 2483428 0 2024-02-28T16:27:01.640 INFO:tasks.workunit.client.1.smithi157.stdout:9/284: dread d0/f20 [0,4194304] 0 2024-02-28T16:27:01.642 INFO:tasks.workunit.client.1.smithi157.stdout:2/394: rename da/d35/l74 to da/d38/d5a/d69/l87 0 2024-02-28T16:27:01.644 INFO:tasks.workunit.client.1.smithi157.stdout:2/395: stat da/d38/d5a/d69 0 2024-02-28T16:27:01.648 INFO:tasks.workunit.client.1.smithi157.stdout:7/320: truncate df/d1f/d24/d39/f5c 1084991 0 2024-02-28T16:27:01.648 INFO:tasks.workunit.client.1.smithi157.stdout:6/303: rmdir d2/d7/de 39 2024-02-28T16:27:01.652 INFO:tasks.workunit.client.1.smithi157.stdout:9/285: truncate d0/f5 4066930 0 2024-02-28T16:27:01.653 INFO:tasks.workunit.client.1.smithi157.stdout:8/234: dread d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:01.653 INFO:tasks.workunit.client.1.smithi157.stdout:1/351: dread d10/d11/d22/f62 [0,4194304] 0 2024-02-28T16:27:01.656 INFO:tasks.workunit.client.1.smithi157.stdout:7/321: mknod df/d4b/c66 0 2024-02-28T16:27:01.660 INFO:tasks.workunit.client.1.smithi157.stdout:4/355: dwrite d3/da/d1f/d22/f7a [0,4194304] 0 2024-02-28T16:27:01.661 INFO:tasks.workunit.client.1.smithi157.stdout:8/235: mknod d1/d5/d43/c4c 0 2024-02-28T16:27:01.664 INFO:tasks.workunit.client.1.smithi157.stdout:8/236: chown d1/c26 64208 1 2024-02-28T16:27:01.665 INFO:tasks.workunit.client.1.smithi157.stdout:0/337: creat d1/d13/f71 x:0 0 0 2024-02-28T16:27:01.670 INFO:tasks.workunit.client.1.smithi157.stdout:7/322: rename df/d1f/d24/d39/d41 to df/d25/d4e/d67 0 2024-02-28T16:27:01.671 INFO:tasks.workunit.client.1.smithi157.stdout:6/304: dwrite d2/d7/d8/da/d31/d3a/f33 [4194304,4194304] 0 2024-02-28T16:27:01.672 INFO:tasks.workunit.client.1.smithi157.stdout:0/338: chown d1/d8/d33/d56 68826 1 2024-02-28T16:27:01.672 INFO:tasks.workunit.client.1.smithi157.stdout:5/338: dwrite d0/d9/d1b/d36/f53 [0,4194304] 0 2024-02-28T16:27:01.674 INFO:tasks.workunit.client.1.smithi157.stdout:5/339: chown d0/d9/d47/f55 101811289 1 2024-02-28T16:27:01.685 INFO:tasks.workunit.client.1.smithi157.stdout:5/340: chown d0/d9/d3a/l6f 486007 1 2024-02-28T16:27:01.687 INFO:tasks.workunit.client.1.smithi157.stdout:7/323: symlink df/d1f/d24/l68 0 2024-02-28T16:27:01.688 INFO:tasks.workunit.client.1.smithi157.stdout:6/305: mknod d2/d7/de/d40/c5c 0 2024-02-28T16:27:01.690 INFO:tasks.workunit.client.1.smithi157.stdout:5/341: fdatasync d0/d30/d50/f63 0 2024-02-28T16:27:01.690 INFO:tasks.workunit.client.1.smithi157.stdout:9/286: link d0/d36/d37/d40/c5a d0/d19/d30/c65 0 2024-02-28T16:27:01.693 INFO:tasks.workunit.client.1.smithi157.stdout:1/352: dread ff [0,4194304] 0 2024-02-28T16:27:01.693 INFO:tasks.workunit.client.1.smithi157.stdout:6/306: read - d2/d17/f51 zero size 2024-02-28T16:27:01.694 INFO:tasks.workunit.client.1.smithi157.stdout:8/237: dread d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:01.698 INFO:tasks.workunit.client.1.smithi157.stdout:7/324: symlink df/d1f/d37/l69 0 2024-02-28T16:27:01.699 INFO:tasks.workunit.client.1.smithi157.stdout:5/342: write d0/f34 [2294561,119526] 0 2024-02-28T16:27:01.699 INFO:tasks.workunit.client.1.smithi157.stdout:0/339: link d1/da/d6c/c70 d1/d13/d57/c72 0 2024-02-28T16:27:01.704 INFO:tasks.workunit.client.1.smithi157.stdout:5/343: chown d0/d9/d47/f4e 1156866 1 2024-02-28T16:27:01.710 INFO:tasks.workunit.client.1.smithi157.stdout:6/307: creat d2/d7/de/d1b/f5d x:0 0 0 2024-02-28T16:27:01.710 INFO:tasks.workunit.client.1.smithi157.stdout:1/353: symlink d10/d11/d3a/d5c/d6c/d6f/l74 0 2024-02-28T16:27:01.712 INFO:tasks.workunit.client.1.smithi157.stdout:7/325: fdatasync df/d1f/d24/d38/f51 0 2024-02-28T16:27:01.716 INFO:tasks.workunit.client.1.smithi157.stdout:0/340: write d1/d8/d27/f2b [1761713,52287] 0 2024-02-28T16:27:01.718 INFO:tasks.workunit.client.1.smithi157.stdout:4/356: dwrite d3/f5f [0,4194304] 0 2024-02-28T16:27:01.721 INFO:tasks.workunit.client.1.smithi157.stdout:5/344: creat d0/d8/d51/d61/f74 x:0 0 0 2024-02-28T16:27:01.723 INFO:tasks.workunit.client.1.smithi157.stdout:1/354: mknod d10/d11/c75 0 2024-02-28T16:27:01.729 INFO:tasks.workunit.client.1.smithi157.stdout:8/238: dwrite d1/d5/d14/f2d [0,4194304] 0 2024-02-28T16:27:01.731 INFO:tasks.workunit.client.1.smithi157.stdout:4/357: rmdir d3/da/d1f/d22 39 2024-02-28T16:27:01.734 INFO:tasks.workunit.client.1.smithi157.stdout:4/358: dread - d3/da/d37/f78 zero size 2024-02-28T16:27:01.735 INFO:tasks.workunit.client.1.smithi157.stdout:1/355: unlink d10/d11/d3a/f61 0 2024-02-28T16:27:01.738 INFO:tasks.workunit.client.1.smithi157.stdout:9/287: dwrite d0/d36/d3f/f60 [0,4194304] 0 2024-02-28T16:27:01.738 INFO:tasks.workunit.client.1.smithi157.stdout:8/239: mkdir d1/d5/d4d 0 2024-02-28T16:27:01.741 INFO:tasks.workunit.client.1.smithi157.stdout:1/356: chown d10/d11/d31/d2a/d70 1 1 2024-02-28T16:27:01.741 INFO:tasks.workunit.client.1.smithi157.stdout:0/341: rename d1/d8/f9 to d1/d13/f73 0 2024-02-28T16:27:01.746 INFO:tasks.workunit.client.1.smithi157.stdout:9/288: read d0/d19/f1e [1606938,52092] 0 2024-02-28T16:27:01.746 INFO:tasks.workunit.client.1.smithi157.stdout:4/359: write d3/da/f31 [465385,52602] 0 2024-02-28T16:27:01.747 INFO:tasks.workunit.client.1.smithi157.stdout:8/240: symlink d1/d5/d10/l4e 0 2024-02-28T16:27:01.752 INFO:tasks.workunit.client.1.smithi157.stdout:1/357: write d10/d11/d3a/f3c [1345780,124714] 0 2024-02-28T16:27:01.753 INFO:tasks.workunit.client.1.smithi157.stdout:5/345: dwrite d0/d9/d1b/f67 [0,4194304] 0 2024-02-28T16:27:01.753 INFO:tasks.workunit.client.1.smithi157.stdout:6/308: dwrite d2/d7/d8/da/d31/d37/d2d/d30/f3e [0,4194304] 0 2024-02-28T16:27:01.753 INFO:tasks.workunit.client.1.smithi157.stdout:7/326: write fd [2923616,130160] 0 2024-02-28T16:27:01.756 INFO:tasks.workunit.client.1.smithi157.stdout:6/309: dread - d2/f4b zero size 2024-02-28T16:27:01.757 INFO:tasks.workunit.client.1.smithi157.stdout:9/289: unlink d0/d36/d37/f57 0 2024-02-28T16:27:01.764 INFO:tasks.workunit.client.1.smithi157.stdout:1/358: stat d10/d11/f28 0 2024-02-28T16:27:01.764 INFO:tasks.workunit.client.1.smithi157.stdout:6/310: write d2/d17/f1e [313320,48012] 0 2024-02-28T16:27:01.767 INFO:tasks.workunit.client.1.smithi157.stdout:5/346: mkdir d0/d9/d47/d5c/d75 0 2024-02-28T16:27:01.767 INFO:tasks.workunit.client.1.smithi157.stdout:3/271: sync 2024-02-28T16:27:01.770 INFO:tasks.workunit.client.1.smithi157.stdout:9/290: stat d0/d36/d37/d4d/f53 0 2024-02-28T16:27:01.771 INFO:tasks.workunit.client.1.smithi157.stdout:8/241: getdents d1/d5/d14 0 2024-02-28T16:27:01.773 INFO:tasks.workunit.client.1.smithi157.stdout:0/342: dwrite d1/da/f58 [0,4194304] 0 2024-02-28T16:27:01.777 INFO:tasks.workunit.client.1.smithi157.stdout:9/291: truncate d0/d19/d30/f32 5040374 0 2024-02-28T16:27:01.777 INFO:tasks.workunit.client.1.smithi157.stdout:8/242: creat d1/f4f x:0 0 0 2024-02-28T16:27:01.781 INFO:tasks.workunit.client.1.smithi157.stdout:6/311: read d2/f5 [348570,122242] 0 2024-02-28T16:27:01.787 INFO:tasks.workunit.client.1.smithi157.stdout:6/312: chown d2/f5 514750303 1 2024-02-28T16:27:01.789 INFO:tasks.workunit.client.1.smithi157.stdout:7/327: dwrite df/f10 [0,4194304] 0 2024-02-28T16:27:01.789 INFO:tasks.workunit.client.1.smithi157.stdout:0/343: mknod d1/d8/d27/c74 0 2024-02-28T16:27:01.790 INFO:tasks.workunit.client.1.smithi157.stdout:9/292: symlink d0/l66 0 2024-02-28T16:27:01.793 INFO:tasks.workunit.client.1.smithi157.stdout:7/328: fdatasync df/d4b/d4c/f55 0 2024-02-28T16:27:01.796 INFO:tasks.workunit.client.1.smithi157.stdout:6/313: fsync d2/d7/d8/da/d31/d37/d2d/f3b 0 2024-02-28T16:27:01.797 INFO:tasks.workunit.client.1.smithi157.stdout:0/344: rmdir d1/d13/d52 39 2024-02-28T16:27:01.801 INFO:tasks.workunit.client.1.smithi157.stdout:9/293: creat d0/d36/d37/f67 x:0 0 0 2024-02-28T16:27:01.801 INFO:tasks.workunit.client.1.smithi157.stdout:3/272: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:27:01.801 INFO:tasks.workunit.client.1.smithi157.stdout:1/359: dwrite d10/d11/d31/d2a/f6d [0,4194304] 0 2024-02-28T16:27:01.802 INFO:tasks.workunit.client.1.smithi157.stdout:7/329: write df/d1f/d24/d38/f43 [1654883,66771] 0 2024-02-28T16:27:01.805 INFO:tasks.workunit.client.1.smithi157.stdout:8/243: dread d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:01.810 INFO:tasks.workunit.client.1.smithi157.stdout:6/314: unlink d2/d7/c49 0 2024-02-28T16:27:01.812 INFO:tasks.workunit.client.1.smithi157.stdout:3/273: rmdir d0/d6/d34 39 2024-02-28T16:27:01.814 INFO:tasks.workunit.client.1.smithi157.stdout:3/274: dread - d0/d20/d23/d2b/d2e/f33 zero size 2024-02-28T16:27:01.817 INFO:tasks.workunit.client.1.smithi157.stdout:1/360: mknod d10/d11/d60/c76 0 2024-02-28T16:27:01.822 INFO:tasks.workunit.client.1.smithi157.stdout:1/361: truncate d10/d11/d31/d2a/d70/d46/f5e 993158 0 2024-02-28T16:27:01.822 INFO:tasks.workunit.client.1.smithi157.stdout:1/362: readlink lb 0 2024-02-28T16:27:01.823 INFO:tasks.workunit.client.1.smithi157.stdout:6/315: creat d2/d7/d8/da/d31/d3a/f5e x:0 0 0 2024-02-28T16:27:01.823 INFO:tasks.workunit.client.1.smithi157.stdout:8/244: dwrite d1/d5/f3b [0,4194304] 0 2024-02-28T16:27:01.825 INFO:tasks.workunit.client.1.smithi157.stdout:8/245: dread - d1/f3c zero size 2024-02-28T16:27:01.826 INFO:tasks.workunit.client.1.smithi157.stdout:7/330: link df/d1f/d24/c34 df/d25/d4e/c6a 0 2024-02-28T16:27:01.828 INFO:tasks.workunit.client.1.smithi157.stdout:3/275: dread d0/d6/d34/f3a [0,4194304] 0 2024-02-28T16:27:01.835 INFO:tasks.workunit.client.1.smithi157.stdout:8/246: unlink d1/d5/d10/f4b 0 2024-02-28T16:27:01.838 INFO:tasks.workunit.client.1.smithi157.stdout:7/331: creat df/d25/d4e/f6b x:0 0 0 2024-02-28T16:27:01.839 INFO:tasks.workunit.client.1.smithi157.stdout:9/294: truncate d0/f3 244353 0 2024-02-28T16:27:01.840 INFO:tasks.workunit.client.1.smithi157.stdout:3/276: rmdir d0/d6 39 2024-02-28T16:27:01.843 INFO:tasks.workunit.client.1.smithi157.stdout:1/363: dwrite d10/d11/d31/f3d [0,4194304] 0 2024-02-28T16:27:01.844 INFO:tasks.workunit.client.1.smithi157.stdout:6/316: dwrite d2/d7/d8/da/d31/d37/d2d/d30/f45 [0,4194304] 0 2024-02-28T16:27:01.846 INFO:tasks.workunit.client.1.smithi157.stdout:7/332: symlink df/d1f/d37/d46/l6c 0 2024-02-28T16:27:01.849 INFO:tasks.workunit.client.1.smithi157.stdout:3/277: chown d0/d6/d44/d48/f4e 1339 1 2024-02-28T16:27:01.854 INFO:tasks.workunit.client.1.smithi157.stdout:8/247: mknod d1/d5/d4d/c50 0 2024-02-28T16:27:01.858 INFO:tasks.workunit.client.1.smithi157.stdout:8/248: truncate d1/d5/f21 670215 0 2024-02-28T16:27:01.859 INFO:tasks.workunit.client.1.smithi157.stdout:6/317: rename d2/d7/d8/da/d31/d3a/f5e to d2/d7/d8/da/d31/d37/d2b/f5f 0 2024-02-28T16:27:01.860 INFO:tasks.workunit.client.1.smithi157.stdout:3/278: mkdir d0/d6/d1e/d5b 0 2024-02-28T16:27:01.861 INFO:tasks.workunit.client.1.smithi157.stdout:9/295: symlink d0/d36/l68 0 2024-02-28T16:27:01.864 INFO:tasks.workunit.client.1.smithi157.stdout:1/364: dwrite d10/d11/d31/d2a/d70/d46/f5e [0,4194304] 0 2024-02-28T16:27:01.868 INFO:tasks.workunit.client.1.smithi157.stdout:8/249: mknod d1/d5/c51 0 2024-02-28T16:27:01.869 INFO:tasks.workunit.client.1.smithi157.stdout:1/365: truncate d10/d11/d31/d2a/f64 4912861 0 2024-02-28T16:27:01.870 INFO:tasks.workunit.client.1.smithi157.stdout:6/318: creat d2/d7/d8/da/d31/d37/d2d/f60 x:0 0 0 2024-02-28T16:27:01.872 INFO:tasks.workunit.client.1.smithi157.stdout:3/279: mkdir d0/d20/d5c 0 2024-02-28T16:27:01.880 INFO:tasks.workunit.client.1.smithi157.stdout:8/250: mkdir d1/d5/d14/d3e/d52 0 2024-02-28T16:27:01.880 INFO:tasks.workunit.client.1.smithi157.stdout:3/280: unlink d0/d20/d23/d2b/f59 0 2024-02-28T16:27:01.880 INFO:tasks.workunit.client.1.smithi157.stdout:6/319: symlink d2/d7/l61 0 2024-02-28T16:27:01.881 INFO:tasks.workunit.client.1.smithi157.stdout:9/296: dwrite d0/d19/f2e [0,4194304] 0 2024-02-28T16:27:01.886 INFO:tasks.workunit.client.1.smithi157.stdout:8/251: mkdir d1/d5/d23/d53 0 2024-02-28T16:27:01.886 INFO:tasks.workunit.client.1.smithi157.stdout:6/320: readlink d2/d7/d8/da/d31/d37/d2d/d30/l36 0 2024-02-28T16:27:01.886 INFO:tasks.workunit.client.1.smithi157.stdout:3/281: unlink d0/d20/d23/d2b/l3e 0 2024-02-28T16:27:01.891 INFO:tasks.workunit.client.1.smithi157.stdout:1/366: dwrite d10/d11/d31/f3d [0,4194304] 0 2024-02-28T16:27:01.892 INFO:tasks.workunit.client.1.smithi157.stdout:3/282: chown d0/d6/f13 731 1 2024-02-28T16:27:01.910 INFO:tasks.workunit.client.1.smithi157.stdout:7/333: dwrite df/d1f/d24/d39/f5c [0,4194304] 0 2024-02-28T16:27:01.910 INFO:tasks.workunit.client.1.smithi157.stdout:9/297: dread d0/d36/d3f/f60 [0,4194304] 0 2024-02-28T16:27:01.911 INFO:tasks.workunit.client.1.smithi157.stdout:1/367: symlink d10/d11/d3a/d5c/d6a/l77 0 2024-02-28T16:27:01.916 INFO:tasks.workunit.client.1.smithi157.stdout:8/252: dwrite d1/f3c [0,4194304] 0 2024-02-28T16:27:01.919 INFO:tasks.workunit.client.1.smithi157.stdout:1/368: rmdir d10/d11/d3a/d5c/d6c 39 2024-02-28T16:27:01.919 INFO:tasks.workunit.client.1.smithi157.stdout:9/298: write d0/f20 [1898276,62025] 0 2024-02-28T16:27:01.919 INFO:tasks.workunit.client.1.smithi157.stdout:6/321: dread d2/d7/d8/da/d31/d3a/f33 [0,4194304] 0 2024-02-28T16:27:01.921 INFO:tasks.workunit.client.1.smithi157.stdout:2/396: sync 2024-02-28T16:27:01.921 INFO:tasks.workunit.client.1.smithi157.stdout:8/253: chown d1/d5/c1e 21322 1 2024-02-28T16:27:01.922 INFO:tasks.workunit.client.1.smithi157.stdout:9/299: stat d0/d36/c56 0 2024-02-28T16:27:01.924 INFO:tasks.workunit.client.1.smithi157.stdout:3/283: dwrite d0/d6/f3d [0,4194304] 0 2024-02-28T16:27:01.925 INFO:tasks.workunit.client.1.smithi157.stdout:1/369: write d10/d11/d31/d2a/f6d [1554289,65925] 0 2024-02-28T16:27:01.929 INFO:tasks.workunit.client.1.smithi157.stdout:8/254: write d1/d5/d23/d38/f48 [507853,127476] 0 2024-02-28T16:27:01.931 INFO:tasks.workunit.client.1.smithi157.stdout:2/397: stat da/d3a/c52 0 2024-02-28T16:27:01.932 INFO:tasks.workunit.client.1.smithi157.stdout:8/255: stat d1/c26 0 2024-02-28T16:27:01.934 INFO:tasks.workunit.client.1.smithi157.stdout:3/284: mknod d0/d6/d44/c5d 0 2024-02-28T16:27:01.935 INFO:tasks.workunit.client.1.smithi157.stdout:8/256: stat d1/d5/d43/c4c 0 2024-02-28T16:27:01.936 INFO:tasks.workunit.client.1.smithi157.stdout:9/300: getdents d0/d36/d37/d40 0 2024-02-28T16:27:01.937 INFO:tasks.workunit.client.1.smithi157.stdout:2/398: readlink da/l41 0 2024-02-28T16:27:01.944 INFO:tasks.workunit.client.1.smithi157.stdout:2/399: dread - da/d2b/f50 zero size 2024-02-28T16:27:01.945 INFO:tasks.workunit.client.1.smithi157.stdout:9/301: dread d0/f42 [0,4194304] 0 2024-02-28T16:27:01.946 INFO:tasks.workunit.client.1.smithi157.stdout:1/370: rename d10/d11/l49 to d10/d11/d31/d2a/d70/l78 0 2024-02-28T16:27:01.948 INFO:tasks.workunit.client.1.smithi157.stdout:7/334: dwrite df/d4b/d4c/f55 [0,4194304] 0 2024-02-28T16:27:01.951 INFO:tasks.workunit.client.1.smithi157.stdout:2/400: creat da/d3a/f88 x:0 0 0 2024-02-28T16:27:01.954 INFO:tasks.workunit.client.1.smithi157.stdout:7/335: write df/d25/d4e/f52 [105057,55279] 0 2024-02-28T16:27:01.958 INFO:tasks.workunit.client.1.smithi157.stdout:1/371: creat d10/d73/f79 x:0 0 0 2024-02-28T16:27:01.960 INFO:tasks.workunit.client.1.smithi157.stdout:1/372: fdatasync d10/d11/d31/d2a/d70/d46/f58 0 2024-02-28T16:27:01.961 INFO:tasks.workunit.client.1.smithi157.stdout:2/401: rename da/f1e to da/d38/f89 0 2024-02-28T16:27:01.964 INFO:tasks.workunit.client.1.smithi157.stdout:8/257: dread d1/f2 [0,4194304] 0 2024-02-28T16:27:01.969 INFO:tasks.workunit.client.1.smithi157.stdout:7/336: creat df/d1f/d24/d38/f6d x:0 0 0 2024-02-28T16:27:01.972 INFO:tasks.workunit.client.1.smithi157.stdout:1/373: mkdir d10/d7a 0 2024-02-28T16:27:01.974 INFO:tasks.workunit.client.1.smithi157.stdout:7/337: creat df/d40/f6e x:0 0 0 2024-02-28T16:27:01.974 INFO:tasks.workunit.client.1.smithi157.stdout:8/258: getdents d1/d5/d23/d53 0 2024-02-28T16:27:01.976 INFO:tasks.workunit.client.1.smithi157.stdout:9/302: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:27:01.981 INFO:tasks.workunit.client.1.smithi157.stdout:9/303: read d0/f21 [2906252,114201] 0 2024-02-28T16:27:01.982 INFO:tasks.workunit.client.1.smithi157.stdout:8/259: mkdir d1/d5/d14/d3e/d52/d54 0 2024-02-28T16:27:01.983 INFO:tasks.workunit.client.1.smithi157.stdout:7/338: getdents df/d1f/d37 0 2024-02-28T16:27:01.986 INFO:tasks.workunit.client.1.smithi157.stdout:9/304: write d0/f28 [351177,119443] 0 2024-02-28T16:27:01.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:01 smithi157 ceph-mon[38346]: pgmap v55: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 43 MiB/s rd, 133 MiB/s wr, 288 op/s 2024-02-28T16:27:01.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:01 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:01.988 INFO:tasks.workunit.client.1.smithi157.stdout:6/322: dread d2/d7/d8/f56 [4194304,4194304] 0 2024-02-28T16:27:01.992 INFO:tasks.workunit.client.1.smithi157.stdout:8/260: unlink d1/d5/d10/l15 0 2024-02-28T16:27:01.993 INFO:tasks.workunit.client.1.smithi157.stdout:8/261: fsync d1/d5/f4a 0 2024-02-28T16:27:01.995 INFO:tasks.workunit.client.1.smithi157.stdout:1/374: dwrite d10/d11/d3a/f3c [0,4194304] 0 2024-02-28T16:27:01.996 INFO:tasks.workunit.client.1.smithi157.stdout:2/402: dread da/d38/f89 [0,4194304] 0 2024-02-28T16:27:01.996 INFO:tasks.workunit.client.1.smithi157.stdout:7/339: rename df/d1f/d37/l3e to df/d25/d4e/l6f 0 2024-02-28T16:27:01.996 INFO:tasks.workunit.client.1.smithi157.stdout:8/262: chown d1/d5/d4d/c50 1560 1 2024-02-28T16:27:02.001 INFO:tasks.workunit.client.1.smithi157.stdout:6/323: creat d2/d7/de/d1b/d4d/f62 x:0 0 0 2024-02-28T16:27:02.002 INFO:tasks.workunit.client.1.smithi157.stdout:7/340: chown df/d1f/d24/d39/f5f 1985618 1 2024-02-28T16:27:02.002 INFO:tasks.workunit.client.1.smithi157.stdout:2/403: write da/d38/d5a/d5c/f7a [230681,72241] 0 2024-02-28T16:27:02.004 INFO:tasks.workunit.client.1.smithi157.stdout:8/263: mknod d1/d5/d23/d38/d49/c55 0 2024-02-28T16:27:02.006 INFO:tasks.workunit.client.1.smithi157.stdout:7/341: read df/f16 [7699296,103214] 0 2024-02-28T16:27:02.007 INFO:tasks.workunit.client.1.smithi157.stdout:6/324: fdatasync d2/d7/d8/da/d31/d37/d2d/d30/f3e 0 2024-02-28T16:27:02.008 INFO:tasks.workunit.client.1.smithi157.stdout:2/404: truncate da/d2b/f4f 4882249 0 2024-02-28T16:27:02.011 INFO:tasks.workunit.client.1.smithi157.stdout:9/305: dwrite d0/d36/d37/d40/f44 [0,4194304] 0 2024-02-28T16:27:02.014 INFO:tasks.workunit.client.1.smithi157.stdout:1/375: rename d10/d11/d31/d2a/d70/d46 to d10/d11/d3a/d5c/d6c/d7b 0 2024-02-28T16:27:02.016 INFO:tasks.workunit.client.1.smithi157.stdout:6/325: rmdir d2/d7/d8/da 39 2024-02-28T16:27:02.019 INFO:tasks.workunit.client.1.smithi157.stdout:9/306: mkdir d0/d36/d3f/d69 0 2024-02-28T16:27:02.021 INFO:tasks.workunit.client.1.smithi157.stdout:1/376: unlink d10/d73/f79 0 2024-02-28T16:27:02.021 INFO:tasks.workunit.client.1.smithi157.stdout:9/307: truncate d0/f1f 4670875 0 2024-02-28T16:27:02.023 INFO:tasks.workunit.client.1.smithi157.stdout:2/405: creat da/d38/d3e/d83/f8a x:0 0 0 2024-02-28T16:27:02.025 INFO:tasks.workunit.client.1.smithi157.stdout:7/342: dwrite df/d25/d4e/f52 [0,4194304] 0 2024-02-28T16:27:02.026 INFO:tasks.workunit.client.1.smithi157.stdout:2/406: write da/d3a/f88 [17869,81083] 0 2024-02-28T16:27:02.027 INFO:tasks.workunit.client.1.smithi157.stdout:2/407: dread - da/d2b/d59/f64 zero size 2024-02-28T16:27:02.031 INFO:tasks.workunit.client.1.smithi157.stdout:8/264: truncate d1/d5/d10/f18 2949607 0 2024-02-28T16:27:02.032 INFO:tasks.workunit.client.1.smithi157.stdout:7/343: creat df/d1f/d24/d38/f70 x:0 0 0 2024-02-28T16:27:02.033 INFO:tasks.workunit.client.1.smithi157.stdout:6/326: write d2/d7/fc [293712,71948] 0 2024-02-28T16:27:02.034 INFO:tasks.workunit.client.1.smithi157.stdout:7/344: fsync df/d1f/d37/d46/f5b 0 2024-02-28T16:27:02.035 INFO:tasks.workunit.client.1.smithi157.stdout:4/360: sync 2024-02-28T16:27:02.036 INFO:tasks.workunit.client.1.smithi157.stdout:1/377: mknod d10/d11/d3a/c7c 0 2024-02-28T16:27:02.037 INFO:tasks.workunit.client.1.smithi157.stdout:9/308: creat d0/d36/d37/d40/d5b/f6a x:0 0 0 2024-02-28T16:27:02.038 INFO:tasks.workunit.client.1.smithi157.stdout:8/265: mknod d1/d5/d10/c56 0 2024-02-28T16:27:02.041 INFO:tasks.workunit.client.1.smithi157.stdout:8/266: truncate d1/d5/d10/f33 4250243 0 2024-02-28T16:27:02.041 INFO:tasks.workunit.client.1.smithi157.stdout:4/361: mknod d3/da/d28/c7e 0 2024-02-28T16:27:02.042 INFO:tasks.workunit.client.1.smithi157.stdout:7/345: rename df/l14 to df/d25/d59/l71 0 2024-02-28T16:27:02.045 INFO:tasks.workunit.client.1.smithi157.stdout:6/327: mknod d2/d7/de/d1b/d3d/c63 0 2024-02-28T16:27:02.049 INFO:tasks.workunit.client.1.smithi157.stdout:9/309: mknod d0/c6b 0 2024-02-28T16:27:02.050 INFO:tasks.workunit.client.1.smithi157.stdout:7/346: mkdir df/d1f/d24/d4f/d72 0 2024-02-28T16:27:02.054 INFO:tasks.workunit.client.1.smithi157.stdout:1/378: dwrite d10/d11/d31/f41 [0,4194304] 0 2024-02-28T16:27:02.054 INFO:tasks.workunit.client.1.smithi157.stdout:2/408: getdents da/d2b/d59 0 2024-02-28T16:27:02.059 INFO:tasks.workunit.client.1.smithi157.stdout:9/310: unlink d0/d19/d30/f38 0 2024-02-28T16:27:02.060 INFO:tasks.workunit.client.1.smithi157.stdout:2/409: write da/d47/d67/f68 [439179,31269] 0 2024-02-28T16:27:02.063 INFO:tasks.workunit.client.1.smithi157.stdout:8/267: dread d1/d5/d14/f47 [0,4194304] 0 2024-02-28T16:27:02.066 INFO:tasks.workunit.client.1.smithi157.stdout:8/268: truncate d1/d5/d14/f42 957166 0 2024-02-28T16:27:02.070 INFO:tasks.workunit.client.1.smithi157.stdout:6/328: dwrite d2/d7/d8/da/d31/d3a/f2f [0,4194304] 0 2024-02-28T16:27:02.071 INFO:tasks.workunit.client.1.smithi157.stdout:0/345: sync 2024-02-28T16:27:02.071 INFO:tasks.workunit.client.1.smithi157.stdout:3/285: sync 2024-02-28T16:27:02.071 INFO:tasks.workunit.client.1.smithi157.stdout:5/347: sync 2024-02-28T16:27:02.071 INFO:tasks.workunit.client.1.smithi157.stdout:4/362: getdents d3/da/d37 0 2024-02-28T16:27:02.072 INFO:tasks.workunit.client.1.smithi157.stdout:1/379: link d10/d11/d3a/d5c/d6c/d7b/f45 d10/d7a/f7d 0 2024-02-28T16:27:02.074 INFO:tasks.workunit.client.1.smithi157.stdout:7/347: link df/c13 df/d25/d4e/d67/c73 0 2024-02-28T16:27:02.074 INFO:tasks.workunit.client.1.smithi157.stdout:4/363: fdatasync d3/da/d28/f5b 0 2024-02-28T16:27:02.076 INFO:tasks.workunit.client.1.smithi157.stdout:2/410: link da/d2b/d59/f64 da/d35/f8b 0 2024-02-28T16:27:02.079 INFO:tasks.workunit.client.1.smithi157.stdout:0/346: creat d1/d8/d33/d56/f75 x:0 0 0 2024-02-28T16:27:02.081 INFO:tasks.workunit.client.1.smithi157.stdout:7/348: write df/d1f/d24/d38/f57 [983923,50104] 0 2024-02-28T16:27:02.081 INFO:tasks.workunit.client.1.smithi157.stdout:0/347: readlink d1/l23 0 2024-02-28T16:27:02.083 INFO:tasks.workunit.client.1.smithi157.stdout:7/349: chown df/c1d 436408329 1 2024-02-28T16:27:02.087 INFO:tasks.workunit.client.1.smithi157.stdout:8/269: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:27:02.090 INFO:tasks.workunit.client.1.smithi157.stdout:3/286: creat d0/d20/d5c/f5e x:0 0 0 2024-02-28T16:27:02.091 INFO:tasks.workunit.client.1.smithi157.stdout:1/380: mkdir d10/d11/d7e 0 2024-02-28T16:27:02.092 INFO:tasks.workunit.client.1.smithi157.stdout:5/348: link d0/f34 d0/d8/d51/d61/f76 0 2024-02-28T16:27:02.094 INFO:tasks.workunit.client.1.smithi157.stdout:2/411: dread da/d38/f89 [0,4194304] 0 2024-02-28T16:27:02.098 INFO:tasks.workunit.client.1.smithi157.stdout:2/412: dread - da/d2b/d59/f64 zero size 2024-02-28T16:27:02.103 INFO:tasks.workunit.client.1.smithi157.stdout:9/311: dread d0/f12 [0,4194304] 0 2024-02-28T16:27:02.103 INFO:tasks.workunit.client.1.smithi157.stdout:7/350: dread df/d25/d4e/f52 [0,4194304] 0 2024-02-28T16:27:02.108 INFO:tasks.workunit.client.1.smithi157.stdout:7/351: chown df/d1f/d24/d38/f70 1240932541 1 2024-02-28T16:27:02.109 INFO:tasks.workunit.client.1.smithi157.stdout:1/381: mkdir d10/d11/d31/d7f 0 2024-02-28T16:27:02.109 INFO:tasks.workunit.client.1.smithi157.stdout:0/348: dwrite d1/d13/d57/f5c [0,4194304] 0 2024-02-28T16:27:02.113 INFO:tasks.workunit.client.1.smithi157.stdout:7/352: chown df/d1f/d24/l65 340 1 2024-02-28T16:27:02.119 INFO:tasks.workunit.client.1.smithi157.stdout:5/349: dread d0/d9/d1b/f67 [0,4194304] 0 2024-02-28T16:27:02.119 INFO:tasks.workunit.client.1.smithi157.stdout:3/287: dwrite d0/d20/d23/d2b/f31 [0,4194304] 0 2024-02-28T16:27:02.120 INFO:tasks.workunit.client.1.smithi157.stdout:6/329: dwrite d2/d7/d8/da/d31/d37/d2d/f48 [0,4194304] 0 2024-02-28T16:27:02.121 INFO:tasks.workunit.client.1.smithi157.stdout:5/350: fsync d0/d9/f1f 0 2024-02-28T16:27:02.123 INFO:tasks.workunit.client.1.smithi157.stdout:8/270: truncate d1/f2 2897719 0 2024-02-28T16:27:02.124 INFO:tasks.workunit.client.1.smithi157.stdout:8/271: dread - d1/d5/f4a zero size 2024-02-28T16:27:02.129 INFO:tasks.workunit.client.1.smithi157.stdout:4/364: getdents d3/da 0 2024-02-28T16:27:02.130 INFO:tasks.workunit.client.1.smithi157.stdout:2/413: chown da/d38/d5a/d79/d7b 15952789 1 2024-02-28T16:27:02.133 INFO:tasks.workunit.client.1.smithi157.stdout:6/330: rmdir d2/d7/d8/da/d31 39 2024-02-28T16:27:02.136 INFO:tasks.workunit.client.1.smithi157.stdout:8/272: mknod d1/d5/d23/c57 0 2024-02-28T16:27:02.139 INFO:tasks.workunit.client.1.smithi157.stdout:9/312: dwrite d0/f18 [0,4194304] 0 2024-02-28T16:27:02.140 INFO:tasks.workunit.client.1.smithi157.stdout:1/382: creat d10/d11/d31/f80 x:0 0 0 2024-02-28T16:27:02.145 INFO:tasks.workunit.client.1.smithi157.stdout:9/313: chown d0/d36/d3f/f60 1072730 1 2024-02-28T16:27:02.146 INFO:tasks.workunit.client.1.smithi157.stdout:3/288: getdents d0 0 2024-02-28T16:27:02.148 INFO:tasks.workunit.client.1.smithi157.stdout:8/273: creat d1/d5/d14/d3e/d52/f58 x:0 0 0 2024-02-28T16:27:02.149 INFO:tasks.workunit.client.1.smithi157.stdout:1/383: stat d10/d11/d3a/d5c/d6a 0 2024-02-28T16:27:02.150 INFO:tasks.workunit.client.1.smithi157.stdout:2/414: write da/d38/d5a/f66 [850787,111564] 0 2024-02-28T16:27:02.150 INFO:tasks.workunit.client.1.smithi157.stdout:7/353: dwrite df/d1f/d24/f2d [0,4194304] 0 2024-02-28T16:27:02.154 INFO:tasks.workunit.client.1.smithi157.stdout:1/384: stat d10/d11/f32 0 2024-02-28T16:27:02.156 INFO:tasks.workunit.client.1.smithi157.stdout:9/314: creat d0/d36/d3f/f6c x:0 0 0 2024-02-28T16:27:02.156 INFO:tasks.workunit.client.1.smithi157.stdout:7/354: fsync df/d1f/f5e 0 2024-02-28T16:27:02.156 INFO:tasks.workunit.client.1.smithi157.stdout:1/385: fsync d10/d11/f65 0 2024-02-28T16:27:02.159 INFO:tasks.workunit.client.1.smithi157.stdout:8/274: mknod d1/c59 0 2024-02-28T16:27:02.159 INFO:tasks.workunit.client.1.smithi157.stdout:5/351: truncate d0/d9/d47/f4e 158457 0 2024-02-28T16:27:02.160 INFO:tasks.workunit.client.1.smithi157.stdout:8/275: write d1/d5/f4a [187021,53265] 0 2024-02-28T16:27:02.161 INFO:tasks.workunit.client.1.smithi157.stdout:4/365: truncate d3/f5f 3668994 0 2024-02-28T16:27:02.166 INFO:tasks.workunit.client.1.smithi157.stdout:3/289: read d0/d6/f56 [14694,107129] 0 2024-02-28T16:27:02.170 INFO:tasks.workunit.client.1.smithi157.stdout:6/331: dread d2/d7/d8/da/d31/d37/d2d/f48 [0,4194304] 0 2024-02-28T16:27:02.172 INFO:tasks.workunit.client.1.smithi157.stdout:3/290: chown d0/d6/f2d 448091 1 2024-02-28T16:27:02.174 INFO:tasks.workunit.client.1.smithi157.stdout:1/386: creat d10/d11/d31/d7f/f81 x:0 0 0 2024-02-28T16:27:02.175 INFO:tasks.workunit.client.1.smithi157.stdout:9/315: creat d0/d36/d37/d40/d4b/f6d x:0 0 0 2024-02-28T16:27:02.181 INFO:tasks.workunit.client.1.smithi157.stdout:2/415: getdents da/d47/d67 0 2024-02-28T16:27:02.183 INFO:tasks.workunit.client.1.smithi157.stdout:5/352: getdents d0/d9/d1b/d36 0 2024-02-28T16:27:02.183 INFO:tasks.workunit.client.1.smithi157.stdout:1/387: truncate d10/d11/d22/f3f 961023 0 2024-02-28T16:27:02.183 INFO:tasks.workunit.client.1.smithi157.stdout:3/291: dread d0/f46 [0,4194304] 0 2024-02-28T16:27:02.184 INFO:tasks.workunit.client.1.smithi157.stdout:9/316: rmdir d0/d36/d37/d4d 39 2024-02-28T16:27:02.188 INFO:tasks.workunit.client.1.smithi157.stdout:1/388: chown d10/d11/d22/f69 7927 1 2024-02-28T16:27:02.188 INFO:tasks.workunit.client.1.smithi157.stdout:5/353: unlink d0/l70 0 2024-02-28T16:27:02.194 INFO:tasks.workunit.client.1.smithi157.stdout:6/332: dwrite d2/f35 [0,4194304] 0 2024-02-28T16:27:02.194 INFO:tasks.workunit.client.1.smithi157.stdout:4/366: dread d3/d77/f55 [0,4194304] 0 2024-02-28T16:27:02.195 INFO:tasks.workunit.client.1.smithi157.stdout:8/276: dwrite d1/d5/d14/f2d [4194304,4194304] 0 2024-02-28T16:27:02.199 INFO:tasks.workunit.client.1.smithi157.stdout:9/317: dread d0/d19/f29 [0,4194304] 0 2024-02-28T16:27:02.203 INFO:tasks.workunit.client.1.smithi157.stdout:7/355: dwrite df/f16 [0,4194304] 0 2024-02-28T16:27:02.204 INFO:tasks.workunit.client.1.smithi157.stdout:8/277: read d1/d5/d14/f2d [507448,11589] 0 2024-02-28T16:27:02.208 INFO:tasks.workunit.client.1.smithi157.stdout:5/354: rename d0/d9/d47/d5b/d6a/f6b to d0/d8/f77 0 2024-02-28T16:27:02.208 INFO:tasks.workunit.client.1.smithi157.stdout:4/367: symlink d3/l7f 0 2024-02-28T16:27:02.208 INFO:tasks.workunit.client.1.smithi157.stdout:6/333: symlink d2/d7/de/d40/l64 0 2024-02-28T16:27:02.211 INFO:tasks.workunit.client.1.smithi157.stdout:5/355: fdatasync d0/d9/f1f 0 2024-02-28T16:27:02.215 INFO:tasks.workunit.client.1.smithi157.stdout:4/368: creat d3/da/d28/f80 x:0 0 0 2024-02-28T16:27:02.216 INFO:tasks.workunit.client.1.smithi157.stdout:9/318: fdatasync d0/d36/d37/d4d/f5d 0 2024-02-28T16:27:02.216 INFO:tasks.workunit.client.1.smithi157.stdout:7/356: creat df/d1f/d24/d39/d64/f74 x:0 0 0 2024-02-28T16:27:02.219 INFO:tasks.workunit.client.1.smithi157.stdout:6/334: creat d2/d7/de/d40/f65 x:0 0 0 2024-02-28T16:27:02.221 INFO:tasks.workunit.client.1.smithi157.stdout:8/278: write d1/d5/d10/f33 [662466,127825] 0 2024-02-28T16:27:02.221 INFO:tasks.workunit.client.1.smithi157.stdout:4/369: symlink d3/da/d37/l81 0 2024-02-28T16:27:02.221 INFO:tasks.workunit.client.1.smithi157.stdout:8/279: readlink d1/d5/d23/l36 0 2024-02-28T16:27:02.222 INFO:tasks.workunit.client.1.smithi157.stdout:9/319: unlink d0/d19/d30/f4f 0 2024-02-28T16:27:02.224 INFO:tasks.workunit.client.1.smithi157.stdout:6/335: stat d2/d7/de/l13 0 2024-02-28T16:27:02.225 INFO:tasks.workunit.client.1.smithi157.stdout:3/292: dread d0/d6/f2d [0,4194304] 0 2024-02-28T16:27:02.225 INFO:tasks.workunit.client.1.smithi157.stdout:7/357: mkdir df/d1f/d24/d4f/d72/d75 0 2024-02-28T16:27:02.227 INFO:tasks.workunit.client.1.smithi157.stdout:3/293: write d0/f46 [822656,67546] 0 2024-02-28T16:27:02.227 INFO:tasks.workunit.client.1.smithi157.stdout:4/370: mknod d3/c82 0 2024-02-28T16:27:02.227 INFO:tasks.workunit.client.1.smithi157.stdout:7/358: chown df/d1f/d24/d38/f43 65 1 2024-02-28T16:27:02.228 INFO:tasks.workunit.client.1.smithi157.stdout:8/280: mknod d1/d5/d14/d3e/d52/c5a 0 2024-02-28T16:27:02.229 INFO:tasks.workunit.client.1.smithi157.stdout:6/336: mkdir d2/d7/d8/da/d31/d37/d2d/d66 0 2024-02-28T16:27:02.230 INFO:tasks.workunit.client.1.smithi157.stdout:7/359: dread - df/d1f/d24/d38/f70 zero size 2024-02-28T16:27:02.230 INFO:tasks.workunit.client.1.smithi157.stdout:8/281: chown d1/f2c 6768 1 2024-02-28T16:27:02.230 INFO:tasks.workunit.client.1.smithi157.stdout:9/320: mkdir d0/d36/d6e 0 2024-02-28T16:27:02.230 INFO:tasks.workunit.client.1.smithi157.stdout:4/371: read d3/da/d1f/f26 [3832769,30352] 0 2024-02-28T16:27:02.234 INFO:tasks.workunit.client.1.smithi157.stdout:4/372: write d3/d77/f56 [90422,93175] 0 2024-02-28T16:27:02.235 INFO:tasks.workunit.client.1.smithi157.stdout:6/337: write d2/d7/d8/da/d31/d3a/f33 [8720958,108561] 0 2024-02-28T16:27:02.236 INFO:tasks.workunit.client.1.smithi157.stdout:8/282: creat d1/d5/d14/d3e/d52/d54/f5b x:0 0 0 2024-02-28T16:27:02.237 INFO:tasks.workunit.client.1.smithi157.stdout:7/360: dread df/f1a [0,4194304] 0 2024-02-28T16:27:02.240 INFO:tasks.workunit.client.1.smithi157.stdout:8/283: mknod d1/d5/d14/d3e/c5c 0 2024-02-28T16:27:02.240 INFO:tasks.workunit.client.1.smithi157.stdout:6/338: getdents d2/d7/d8/da/d4c 0 2024-02-28T16:27:02.241 INFO:tasks.workunit.client.1.smithi157.stdout:3/294: dread d0/d6/f2d [0,4194304] 0 2024-02-28T16:27:02.243 INFO:tasks.workunit.client.1.smithi157.stdout:4/373: creat d3/da/d1f/d22/f83 x:0 0 0 2024-02-28T16:27:02.244 INFO:tasks.workunit.client.1.smithi157.stdout:8/284: creat d1/d5/d14/d3e/d52/d54/f5d x:0 0 0 2024-02-28T16:27:02.245 INFO:tasks.workunit.client.1.smithi157.stdout:6/339: mknod d2/d7/d8/da/d31/d59/c67 0 2024-02-28T16:27:02.245 INFO:tasks.workunit.client.1.smithi157.stdout:9/321: dread d0/d36/d37/f43 [0,4194304] 0 2024-02-28T16:27:02.246 INFO:tasks.workunit.client.1.smithi157.stdout:8/285: write d1/d5/f3b [5142352,37376] 0 2024-02-28T16:27:02.247 INFO:tasks.workunit.client.1.smithi157.stdout:3/295: rename d0/d6/d34/f3a to d0/d6/f5f 0 2024-02-28T16:27:02.247 INFO:tasks.workunit.client.1.smithi157.stdout:6/340: dread - d2/d7/de/d1b/d4d/f62 zero size 2024-02-28T16:27:02.248 INFO:tasks.workunit.client.1.smithi157.stdout:9/322: mknod d0/d19/d30/c6f 0 2024-02-28T16:27:02.249 INFO:tasks.workunit.client.1.smithi157.stdout:9/323: stat d0/d19/l2c 0 2024-02-28T16:27:02.250 INFO:tasks.workunit.client.1.smithi157.stdout:8/286: mkdir d1/d5/d14/d3e/d5e 0 2024-02-28T16:27:02.251 INFO:tasks.workunit.client.1.smithi157.stdout:6/341: truncate d2/d17/f2a 1612629 0 2024-02-28T16:27:02.252 INFO:tasks.workunit.client.1.smithi157.stdout:8/287: write d1/d5/d43/f45 [598801,4772] 0 2024-02-28T16:27:02.252 INFO:tasks.workunit.client.1.smithi157.stdout:6/342: write d2/d7/de/d40/f65 [399980,40115] 0 2024-02-28T16:27:02.253 INFO:tasks.workunit.client.1.smithi157.stdout:8/288: chown d1/d5/d23/d38/d49 2197 1 2024-02-28T16:27:02.254 INFO:tasks.workunit.client.1.smithi157.stdout:9/324: rmdir d0/d36/d6e 0 2024-02-28T16:27:02.254 INFO:tasks.workunit.client.1.smithi157.stdout:6/343: dread - d2/d17/f51 zero size 2024-02-28T16:27:02.256 INFO:tasks.workunit.client.1.smithi157.stdout:8/289: write d1/d5/f3b [1897169,88046] 0 2024-02-28T16:27:02.257 INFO:tasks.workunit.client.1.smithi157.stdout:9/325: symlink d0/d36/d3f/l70 0 2024-02-28T16:27:02.261 INFO:tasks.workunit.client.1.smithi157.stdout:8/290: creat d1/f5f x:0 0 0 2024-02-28T16:27:02.261 INFO:tasks.workunit.client.1.smithi157.stdout:9/326: read d0/f5 [1825246,27340] 0 2024-02-28T16:27:02.266 INFO:tasks.workunit.client.1.smithi157.stdout:9/327: chown d0/c3e 21742839 1 2024-02-28T16:27:02.267 INFO:tasks.workunit.client.1.smithi157.stdout:3/296: dwrite d0/d20/d23/d2b/f32 [0,4194304] 0 2024-02-28T16:27:02.272 INFO:tasks.workunit.client.1.smithi157.stdout:3/297: mknod d0/d6/d34/d43/c60 0 2024-02-28T16:27:02.276 INFO:tasks.workunit.client.1.smithi157.stdout:3/298: dread - d0/d20/d23/f50 zero size 2024-02-28T16:27:02.278 INFO:tasks.workunit.client.1.smithi157.stdout:8/291: dread d1/f3c [0,4194304] 0 2024-02-28T16:27:02.283 INFO:tasks.workunit.client.1.smithi157.stdout:3/299: creat d0/d6/d1e/d5b/f61 x:0 0 0 2024-02-28T16:27:02.286 INFO:tasks.workunit.client.1.smithi157.stdout:8/292: chown d1/d5/d14/d3e/d52/d54/f5b 13683 1 2024-02-28T16:27:02.286 INFO:tasks.workunit.client.1.smithi157.stdout:6/344: dwrite d2/d7/d8/da/d31/d37/d2d/d30/f45 [0,4194304] 0 2024-02-28T16:27:02.287 INFO:tasks.workunit.client.1.smithi157.stdout:7/361: truncate df/d25/d4e/d67/f45 257737 0 2024-02-28T16:27:02.291 INFO:tasks.workunit.client.1.smithi157.stdout:9/328: dwrite d0/d36/d37/d40/d5b/f6a [0,4194304] 0 2024-02-28T16:27:02.292 INFO:tasks.workunit.client.1.smithi157.stdout:4/374: truncate d3/da/d1f/f26 2812020 0 2024-02-28T16:27:02.296 INFO:tasks.workunit.client.1.smithi157.stdout:6/345: chown d2/d7/d8/da/d31/d37/c2e 4 1 2024-02-28T16:27:02.298 INFO:tasks.workunit.client.1.smithi157.stdout:9/329: rmdir d0/d36/d37/d4d 39 2024-02-28T16:27:02.298 INFO:tasks.workunit.client.1.smithi157.stdout:4/375: mkdir d3/da/d37/d84 0 2024-02-28T16:27:02.299 INFO:tasks.workunit.client.1.smithi157.stdout:7/362: dread df/d1f/d24/d39/f5f [0,4194304] 0 2024-02-28T16:27:02.301 INFO:tasks.workunit.client.1.smithi157.stdout:4/376: chown d3/da/l19 3 1 2024-02-28T16:27:02.303 INFO:tasks.workunit.client.1.smithi157.stdout:9/330: chown d0/d36/d37/d40/f62 2311941 1 2024-02-28T16:27:02.306 INFO:tasks.workunit.client.1.smithi157.stdout:8/293: dread d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:02.307 INFO:tasks.workunit.client.1.smithi157.stdout:8/294: chown d1/d5/d14/d3e/d5e 16714504 1 2024-02-28T16:27:02.310 INFO:tasks.workunit.client.1.smithi157.stdout:4/377: mknod d3/da/d28/c85 0 2024-02-28T16:27:02.310 INFO:tasks.workunit.client.1.smithi157.stdout:8/295: truncate d1/d5/f31 256671 0 2024-02-28T16:27:02.317 INFO:tasks.workunit.client.1.smithi157.stdout:4/378: rmdir d3/da/d48 39 2024-02-28T16:27:02.319 INFO:tasks.workunit.client.1.smithi157.stdout:3/300: truncate d0/d6/f3d 3395285 0 2024-02-28T16:27:02.320 INFO:tasks.workunit.client.1.smithi157.stdout:7/363: dwrite df/d1f/f5e [0,4194304] 0 2024-02-28T16:27:02.322 INFO:tasks.workunit.client.1.smithi157.stdout:6/346: rename d2/d7/de/d1b/f57 to d2/d7/d8/f68 0 2024-02-28T16:27:02.325 INFO:tasks.workunit.client.1.smithi157.stdout:8/296: unlink d1/d5/l37 0 2024-02-28T16:27:02.327 INFO:tasks.workunit.client.1.smithi157.stdout:6/347: chown d2/d7/d8/da/l4a 14 1 2024-02-28T16:27:02.329 INFO:tasks.workunit.client.1.smithi157.stdout:7/364: mknod df/d25/c76 0 2024-02-28T16:27:02.330 INFO:tasks.workunit.client.1.smithi157.stdout:9/331: rename d0/f20 to d0/d36/d3f/d69/f71 0 2024-02-28T16:27:02.332 INFO:tasks.workunit.client.1.smithi157.stdout:3/301: mkdir d0/d6/d44/d4b/d62 0 2024-02-28T16:27:02.333 INFO:tasks.workunit.client.1.smithi157.stdout:9/332: chown d0/d36/d37/d40/d5b 46824 1 2024-02-28T16:27:02.334 INFO:tasks.workunit.client.1.smithi157.stdout:9/333: readlink d0/l14 0 2024-02-28T16:27:02.336 INFO:tasks.workunit.client.1.smithi157.stdout:9/334: dread - d0/d36/f63 zero size 2024-02-28T16:27:02.340 INFO:tasks.workunit.client.1.smithi157.stdout:8/297: rename d1/d5/d23/d38/d49 to d1/d5/d4d/d60 0 2024-02-28T16:27:02.343 INFO:tasks.workunit.client.1.smithi157.stdout:4/379: dread d3/da/d1f/d22/f3d [0,4194304] 0 2024-02-28T16:27:02.347 INFO:tasks.workunit.client.1.smithi157.stdout:8/298: dread d1/d5/d43/f45 [0,4194304] 0 2024-02-28T16:27:02.350 INFO:tasks.workunit.client.1.smithi157.stdout:6/348: dread d2/d17/f34 [0,4194304] 0 2024-02-28T16:27:02.351 INFO:tasks.workunit.client.1.smithi157.stdout:9/335: mknod d0/d36/d3f/d69/c72 0 2024-02-28T16:27:02.352 INFO:tasks.workunit.client.1.smithi157.stdout:7/365: write f8 [4109168,7633] 0 2024-02-28T16:27:02.358 INFO:tasks.workunit.client.1.smithi157.stdout:4/380: mknod d3/da/d28/c86 0 2024-02-28T16:27:02.362 INFO:tasks.workunit.client.1.smithi157.stdout:8/299: write d1/f2c [9047257,23949] 0 2024-02-28T16:27:02.365 INFO:tasks.workunit.client.1.smithi157.stdout:6/349: write d2/d7/d8/f56 [4004380,118520] 0 2024-02-28T16:27:02.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:01 smithi148 ceph-mon[28767]: pgmap v55: 65 pgs: 65 active+clean; 2.4 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 43 MiB/s rd, 133 MiB/s wr, 288 op/s 2024-02-28T16:27:02.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:01 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:02.376 INFO:tasks.workunit.client.1.smithi157.stdout:7/366: write df/f17 [955335,121913] 0 2024-02-28T16:27:02.377 INFO:tasks.workunit.client.1.smithi157.stdout:8/300: symlink d1/d5/d14/d3e/l61 0 2024-02-28T16:27:02.378 INFO:tasks.workunit.client.1.smithi157.stdout:9/336: mknod d0/d36/c73 0 2024-02-28T16:27:02.378 INFO:tasks.workunit.client.1.smithi157.stdout:0/349: sync 2024-02-28T16:27:02.379 INFO:tasks.workunit.client.1.smithi157.stdout:8/301: write d1/d5/d14/d3e/d52/d54/f5d [721507,127411] 0 2024-02-28T16:27:02.380 INFO:tasks.workunit.client.1.smithi157.stdout:3/302: dread d0/d6/f3d [0,4194304] 0 2024-02-28T16:27:02.382 INFO:tasks.workunit.client.1.smithi157.stdout:3/303: fsync d0/d20/d23/d2b/d2e/f33 0 2024-02-28T16:27:02.382 INFO:tasks.workunit.client.1.smithi157.stdout:4/381: rename d3/l36 to d3/da/d48/l87 0 2024-02-28T16:27:02.388 INFO:tasks.workunit.client.1.smithi157.stdout:9/337: creat d0/d36/d3f/f74 x:0 0 0 2024-02-28T16:27:02.390 INFO:tasks.workunit.client.1.smithi157.stdout:0/350: mkdir d1/d13/d57/d76 0 2024-02-28T16:27:02.392 INFO:tasks.workunit.client.1.smithi157.stdout:8/302: creat d1/d5/d4d/f62 x:0 0 0 2024-02-28T16:27:02.393 INFO:tasks.workunit.client.1.smithi157.stdout:3/304: fsync d0/d6/f11 0 2024-02-28T16:27:02.393 INFO:tasks.workunit.client.1.smithi157.stdout:8/303: chown d1/d5/l28 11 1 2024-02-28T16:27:02.394 INFO:tasks.workunit.client.1.smithi157.stdout:7/367: mknod df/d1f/d24/c77 0 2024-02-28T16:27:02.395 INFO:tasks.workunit.client.1.smithi157.stdout:7/368: fsync df/f1a 0 2024-02-28T16:27:02.397 INFO:tasks.workunit.client.1.smithi157.stdout:7/369: chown df/d1f/d24/d39/d64/f74 7334 1 2024-02-28T16:27:02.398 INFO:tasks.workunit.client.1.smithi157.stdout:4/382: rename d3/f1c to d3/da/d37/f88 0 2024-02-28T16:27:02.398 INFO:tasks.workunit.client.1.smithi157.stdout:7/370: write df/f17 [1736365,21558] 0 2024-02-28T16:27:02.399 INFO:tasks.workunit.client.1.smithi157.stdout:4/383: chown d3/da/d37/d84 141361 1 2024-02-28T16:27:02.401 INFO:tasks.workunit.client.1.smithi157.stdout:9/338: fsync d0/d36/d37/d4d/f5d 0 2024-02-28T16:27:02.403 INFO:tasks.workunit.client.1.smithi157.stdout:0/351: write d1/d13/ff [1827780,70711] 0 2024-02-28T16:27:02.403 INFO:tasks.workunit.client.1.smithi157.stdout:9/339: fdatasync d0/d36/d37/d40/f62 0 2024-02-28T16:27:02.403 INFO:tasks.workunit.client.1.smithi157.stdout:3/305: mknod d0/d6/d44/c63 0 2024-02-28T16:27:02.409 INFO:tasks.workunit.client.1.smithi157.stdout:7/371: creat df/d40/f78 x:0 0 0 2024-02-28T16:27:02.410 INFO:tasks.workunit.client.1.smithi157.stdout:6/350: getdents d2/d7/d8/da/d31/d37/d2d 0 2024-02-28T16:27:02.411 INFO:tasks.workunit.client.1.smithi157.stdout:6/351: chown d2/d17/f21 0 1 2024-02-28T16:27:02.412 INFO:tasks.workunit.client.1.smithi157.stdout:6/352: stat d2/d7/de/f4e 0 2024-02-28T16:27:02.412 INFO:tasks.workunit.client.1.smithi157.stdout:4/384: symlink d3/da/d48/l89 0 2024-02-28T16:27:02.415 INFO:tasks.workunit.client.1.smithi157.stdout:9/340: creat d0/d36/d3f/f75 x:0 0 0 2024-02-28T16:27:02.415 INFO:tasks.workunit.client.1.smithi157.stdout:3/306: mknod d0/d20/d23/c64 0 2024-02-28T16:27:02.418 INFO:tasks.workunit.client.1.smithi157.stdout:7/372: write df/d25/f2a [494939,69617] 0 2024-02-28T16:27:02.421 INFO:tasks.workunit.client.1.smithi157.stdout:8/304: rmdir d1/d5/d14/d3e/d5e 0 2024-02-28T16:27:02.425 INFO:tasks.workunit.client.1.smithi157.stdout:9/341: creat d0/d36/d3f/f76 x:0 0 0 2024-02-28T16:27:02.426 INFO:tasks.workunit.client.1.smithi157.stdout:3/307: mknod d0/d6/d34/c65 0 2024-02-28T16:27:02.428 INFO:tasks.workunit.client.1.smithi157.stdout:7/373: readlink df/d25/d4e/l6f 0 2024-02-28T16:27:02.428 INFO:tasks.workunit.client.1.smithi157.stdout:4/385: dwrite d3/f13 [0,4194304] 0 2024-02-28T16:27:02.429 INFO:tasks.workunit.client.1.smithi157.stdout:6/353: mkdir d2/d7/d8/da/d31/d37/d2d/d53/d69 0 2024-02-28T16:27:02.430 INFO:tasks.workunit.client.1.smithi157.stdout:0/352: getdents d1/d8/d27 0 2024-02-28T16:27:02.430 INFO:tasks.workunit.client.1.smithi157.stdout:7/374: readlink df/d1f/d24/l68 0 2024-02-28T16:27:02.432 INFO:tasks.workunit.client.1.smithi157.stdout:3/308: creat d0/d20/d23/f66 x:0 0 0 2024-02-28T16:27:02.433 INFO:tasks.workunit.client.1.smithi157.stdout:7/375: chown df/d1f/d37/f49 36 1 2024-02-28T16:27:02.435 INFO:tasks.workunit.client.1.smithi157.stdout:3/309: write d0/d6/f13 [3423966,64582] 0 2024-02-28T16:27:02.437 INFO:tasks.workunit.client.1.smithi157.stdout:6/354: symlink d2/d7/d8/da/d31/d37/d2b/l6a 0 2024-02-28T16:27:02.440 INFO:tasks.workunit.client.1.smithi157.stdout:6/355: chown d2/d17/f2a 1896 1 2024-02-28T16:27:02.446 INFO:tasks.workunit.client.1.smithi157.stdout:2/416: sync 2024-02-28T16:27:02.446 INFO:tasks.workunit.client.1.smithi157.stdout:7/376: truncate df/d25/d4e/d67/f45 793928 0 2024-02-28T16:27:02.449 INFO:tasks.workunit.client.1.smithi157.stdout:3/310: rename d0/f38 to d0/d6/f67 0 2024-02-28T16:27:02.453 INFO:tasks.workunit.client.1.smithi157.stdout:2/417: read da/f46 [2752917,33359] 0 2024-02-28T16:27:02.454 INFO:tasks.workunit.client.1.smithi157.stdout:8/305: dread d1/f4 [4194304,4194304] 0 2024-02-28T16:27:02.454 INFO:tasks.workunit.client.1.smithi157.stdout:7/377: mkdir df/d25/d79 0 2024-02-28T16:27:02.454 INFO:tasks.workunit.client.1.smithi157.stdout:0/353: dwrite d1/d8/d27/f3a [4194304,4194304] 0 2024-02-28T16:27:02.456 INFO:tasks.workunit.client.1.smithi157.stdout:0/354: chown d1/d8/d33/d56 7 1 2024-02-28T16:27:02.461 INFO:tasks.workunit.client.1.smithi157.stdout:9/342: dread d0/fb [0,4194304] 0 2024-02-28T16:27:02.462 INFO:tasks.workunit.client.1.smithi157.stdout:6/356: rename d2/d7/c20 to d2/d58/c6b 0 2024-02-28T16:27:02.465 INFO:tasks.workunit.client.1.smithi157.stdout:8/306: symlink d1/d5/d43/l63 0 2024-02-28T16:27:02.468 INFO:tasks.workunit.client.1.smithi157.stdout:0/355: creat d1/d13/d57/f77 x:0 0 0 2024-02-28T16:27:02.468 INFO:tasks.workunit.client.1.smithi157.stdout:7/378: symlink df/d4b/d4c/l7a 0 2024-02-28T16:27:02.470 INFO:tasks.workunit.client.1.smithi157.stdout:2/418: mkdir da/d8c 0 2024-02-28T16:27:02.475 INFO:tasks.workunit.client.1.smithi157.stdout:9/343: symlink d0/d36/d37/d40/d4b/l77 0 2024-02-28T16:27:02.477 INFO:tasks.workunit.client.1.smithi157.stdout:8/307: creat d1/f64 x:0 0 0 2024-02-28T16:27:02.477 INFO:tasks.workunit.client.1.smithi157.stdout:6/357: dwrite d2/d7/f24 [0,4194304] 0 2024-02-28T16:27:02.477 INFO:tasks.workunit.client.1.smithi157.stdout:4/386: dread d3/da/d28/f5a [0,4194304] 0 2024-02-28T16:27:02.477 INFO:tasks.workunit.client.1.smithi157.stdout:9/344: readlink d0/d36/d37/d4d/l5e 0 2024-02-28T16:27:02.478 INFO:tasks.workunit.client.1.smithi157.stdout:0/356: creat d1/d13/d61/d64/f78 x:0 0 0 2024-02-28T16:27:02.487 INFO:tasks.workunit.client.1.smithi157.stdout:7/379: dwrite df/f17 [0,4194304] 0 2024-02-28T16:27:02.488 INFO:tasks.workunit.client.1.smithi157.stdout:2/419: read da/d38/d3e/f5b [7884667,39971] 0 2024-02-28T16:27:02.492 INFO:tasks.workunit.client.1.smithi157.stdout:2/420: write da/d38/d3e/f84 [970136,43955] 0 2024-02-28T16:27:02.495 INFO:tasks.workunit.client.1.smithi157.stdout:6/358: fdatasync d2/d7/d8/da/d31/d37/d2b/f54 0 2024-02-28T16:27:02.497 INFO:tasks.workunit.client.1.smithi157.stdout:8/308: dwrite d1/d5/d14/d3e/d52/d54/f5b [0,4194304] 0 2024-02-28T16:27:02.503 INFO:tasks.workunit.client.1.smithi157.stdout:9/345: fsync d0/d19/f1c 0 2024-02-28T16:27:02.509 INFO:tasks.workunit.client.1.smithi157.stdout:2/421: write da/d2b/f4f [4979387,114563] 0 2024-02-28T16:27:02.509 INFO:tasks.workunit.client.1.smithi157.stdout:4/387: creat d3/f8a x:0 0 0 2024-02-28T16:27:02.511 INFO:tasks.workunit.client.1.smithi157.stdout:0/357: rmdir d1/d13/d57/d76 0 2024-02-28T16:27:02.515 INFO:tasks.workunit.client.1.smithi157.stdout:4/388: write d3/d77/f65 [367875,95011] 0 2024-02-28T16:27:02.515 INFO:tasks.workunit.client.1.smithi157.stdout:7/380: dwrite df/d1f/d24/d39/d64/f74 [0,4194304] 0 2024-02-28T16:27:02.515 INFO:tasks.workunit.client.1.smithi157.stdout:6/359: dread d2/d17/f34 [0,4194304] 0 2024-02-28T16:27:02.515 INFO:tasks.workunit.client.1.smithi157.stdout:9/346: rmdir d0/d36/d37/d40/d5b 39 2024-02-28T16:27:02.515 INFO:tasks.workunit.client.1.smithi157.stdout:0/358: stat d1/d8/d33/f4e 0 2024-02-28T16:27:02.518 INFO:tasks.workunit.client.1.smithi157.stdout:3/311: dread d0/d20/d23/d2b/f31 [0,4194304] 0 2024-02-28T16:27:02.518 INFO:tasks.workunit.client.1.smithi157.stdout:6/360: readlink d2/d7/de/l22 0 2024-02-28T16:27:02.521 INFO:tasks.workunit.client.1.smithi157.stdout:0/359: fsync d1/d8/d33/f44 0 2024-02-28T16:27:02.521 INFO:tasks.workunit.client.1.smithi157.stdout:8/309: creat d1/d5/d23/d53/f65 x:0 0 0 2024-02-28T16:27:02.525 INFO:tasks.workunit.client.1.smithi157.stdout:6/361: write d2/d7/fc [2838721,77927] 0 2024-02-28T16:27:02.527 INFO:tasks.workunit.client.1.smithi157.stdout:6/362: chown d2/d7/f24 1 1 2024-02-28T16:27:02.532 INFO:tasks.workunit.client.1.smithi157.stdout:0/360: unlink d1/d13/f4b 0 2024-02-28T16:27:02.532 INFO:tasks.workunit.client.1.smithi157.stdout:8/310: mkdir d1/d5/d43/d66 0 2024-02-28T16:27:02.534 INFO:tasks.workunit.client.1.smithi157.stdout:3/312: rmdir d0/d6/d34/d43 39 2024-02-28T16:27:02.534 INFO:tasks.workunit.client.1.smithi157.stdout:7/381: mknod df/d1f/d24/d39/c7b 0 2024-02-28T16:27:02.537 INFO:tasks.workunit.client.1.smithi157.stdout:0/361: unlink d1/d13/d57/f77 0 2024-02-28T16:27:02.539 INFO:tasks.workunit.client.1.smithi157.stdout:7/382: write df/f1a [1269685,76653] 0 2024-02-28T16:27:02.542 INFO:tasks.workunit.client.1.smithi157.stdout:2/422: dread da/f46 [0,4194304] 0 2024-02-28T16:27:02.543 INFO:tasks.workunit.client.1.smithi157.stdout:7/383: chown df/d25/c47 25 1 2024-02-28T16:27:02.546 INFO:tasks.workunit.client.1.smithi157.stdout:6/363: dwrite d2/d17/f21 [0,4194304] 0 2024-02-28T16:27:02.549 INFO:tasks.workunit.client.1.smithi157.stdout:4/389: truncate d3/da/d28/f39 433210 0 2024-02-28T16:27:02.554 INFO:tasks.workunit.client.1.smithi157.stdout:1/389: sync 2024-02-28T16:27:02.554 INFO:tasks.workunit.client.1.smithi157.stdout:5/356: sync 2024-02-28T16:27:02.556 INFO:tasks.workunit.client.1.smithi157.stdout:8/311: dwrite d1/d5/d14/d3e/d52/f58 [0,4194304] 0 2024-02-28T16:27:02.556 INFO:tasks.workunit.client.1.smithi157.stdout:1/390: write d10/d11/d3a/f5f [1171918,1587] 0 2024-02-28T16:27:02.558 INFO:tasks.workunit.client.1.smithi157.stdout:8/312: stat d1/d5/d10/c3a 0 2024-02-28T16:27:02.561 INFO:tasks.workunit.client.1.smithi157.stdout:6/364: dread d2/d17/f2a [0,4194304] 0 2024-02-28T16:27:02.562 INFO:tasks.workunit.client.1.smithi157.stdout:7/384: mkdir df/d4b/d4c/d7c 0 2024-02-28T16:27:02.563 INFO:tasks.workunit.client.1.smithi157.stdout:7/385: fsync df/d1f/d24/d39/f5f 0 2024-02-28T16:27:02.573 INFO:tasks.workunit.client.1.smithi157.stdout:8/313: rmdir d1/d5/d4d 39 2024-02-28T16:27:02.574 INFO:tasks.workunit.client.1.smithi157.stdout:3/313: link d0/d20/d23/d2b/c42 d0/d20/d23/d2b/c68 0 2024-02-28T16:27:02.579 INFO:tasks.workunit.client.1.smithi157.stdout:6/365: mkdir d2/d7/de/d1b/d4d/d6c 0 2024-02-28T16:27:02.580 INFO:tasks.workunit.client.1.smithi157.stdout:6/366: read - d2/d17/f51 zero size 2024-02-28T16:27:02.582 INFO:tasks.workunit.client.1.smithi157.stdout:7/386: write df/d1f/d24/d4f/f61 [88462,67873] 0 2024-02-28T16:27:02.583 INFO:tasks.workunit.client.1.smithi157.stdout:4/390: dwrite d3/da/f35 [0,4194304] 0 2024-02-28T16:27:02.584 INFO:tasks.workunit.client.1.smithi157.stdout:2/423: creat da/d65/f8d x:0 0 0 2024-02-28T16:27:02.586 INFO:tasks.workunit.client.1.smithi157.stdout:0/362: link d1/d8/c5b d1/d13/d52/d53/c79 0 2024-02-28T16:27:02.588 INFO:tasks.workunit.client.1.smithi157.stdout:4/391: readlink d3/da/d1f/l68 0 2024-02-28T16:27:02.588 INFO:tasks.workunit.client.1.smithi157.stdout:7/387: chown df/d25/c26 0 1 2024-02-28T16:27:02.592 INFO:tasks.workunit.client.1.smithi157.stdout:3/314: getdents d0/d20/d23 0 2024-02-28T16:27:02.593 INFO:tasks.workunit.client.1.smithi157.stdout:1/391: dwrite d10/d11/d3a/d5c/d6c/d7b/f1e [0,4194304] 0 2024-02-28T16:27:02.595 INFO:tasks.workunit.client.1.smithi157.stdout:8/314: dwrite d1/d5/d14/d3e/d52/d54/f5d [0,4194304] 0 2024-02-28T16:27:02.595 INFO:tasks.workunit.client.1.smithi157.stdout:3/315: write d0/d20/d23/d2b/f32 [2245019,11152] 0 2024-02-28T16:27:02.598 INFO:tasks.workunit.client.1.smithi157.stdout:3/316: write d0/d6/d44/f52 [2715103,61267] 0 2024-02-28T16:27:02.598 INFO:tasks.workunit.client.1.smithi157.stdout:1/392: dread d10/d11/d31/d2a/f4e [0,4194304] 0 2024-02-28T16:27:02.599 INFO:tasks.workunit.client.1.smithi157.stdout:3/317: chown d0/d20/d23/d2b/f57 3 1 2024-02-28T16:27:02.601 INFO:tasks.workunit.client.1.smithi157.stdout:7/388: mknod df/d1f/c7d 0 2024-02-28T16:27:02.602 INFO:tasks.workunit.client.1.smithi157.stdout:7/389: write df/d1f/d24/f53 [663364,23559] 0 2024-02-28T16:27:02.603 INFO:tasks.workunit.client.1.smithi157.stdout:7/390: readlink l7 0 2024-02-28T16:27:02.609 INFO:tasks.workunit.client.1.smithi157.stdout:1/393: creat d10/d11/d3a/d5c/d6c/d6f/f82 x:0 0 0 2024-02-28T16:27:02.614 INFO:tasks.workunit.client.1.smithi157.stdout:0/363: getdents d1 0 2024-02-28T16:27:02.620 INFO:tasks.workunit.client.1.smithi157.stdout:7/391: link df/f11 df/d1f/f7e 0 2024-02-28T16:27:02.621 INFO:tasks.workunit.client.1.smithi157.stdout:3/318: dwrite d0/d6/f5f [0,4194304] 0 2024-02-28T16:27:02.623 INFO:tasks.workunit.client.1.smithi157.stdout:3/319: truncate d0/d20/f5a 368648 0 2024-02-28T16:27:02.626 INFO:tasks.workunit.client.1.smithi157.stdout:7/392: rename l2 to df/d25/d79/l7f 0 2024-02-28T16:27:02.628 INFO:tasks.workunit.client.1.smithi157.stdout:3/320: mkdir d0/d6/d69 0 2024-02-28T16:27:02.629 INFO:tasks.workunit.client.1.smithi157.stdout:7/393: unlink df/l32 0 2024-02-28T16:27:02.630 INFO:tasks.workunit.client.1.smithi157.stdout:3/321: readlink d0/l41 0 2024-02-28T16:27:02.631 INFO:tasks.workunit.client.1.smithi157.stdout:7/394: fsync df/d1f/d24/d38/f51 0 2024-02-28T16:27:02.633 INFO:tasks.workunit.client.1.smithi157.stdout:7/395: read - df/d25/d4e/f6b zero size 2024-02-28T16:27:02.642 INFO:tasks.workunit.client.1.smithi157.stdout:1/394: read d10/d11/d31/d2a/f6d [3540854,85462] 0 2024-02-28T16:27:02.649 INFO:tasks.workunit.client.1.smithi157.stdout:3/322: dread d0/d20/d23/d2b/f32 [0,4194304] 0 2024-02-28T16:27:02.650 INFO:tasks.workunit.client.1.smithi157.stdout:0/364: dread d1/d8/f2c [0,4194304] 0 2024-02-28T16:27:02.651 INFO:tasks.workunit.client.1.smithi157.stdout:3/323: fsync d0/d6/fa 0 2024-02-28T16:27:02.652 INFO:tasks.workunit.client.1.smithi157.stdout:6/367: truncate d2/d7/de/d1b/f28 687779 0 2024-02-28T16:27:02.654 INFO:tasks.workunit.client.1.smithi157.stdout:1/395: rename d10/d11/d31/d2a/f6d to d10/d11/d3a/d5c/d6c/d6f/f83 0 2024-02-28T16:27:02.655 INFO:tasks.workunit.client.1.smithi157.stdout:6/368: dread - d2/d7/de/d40/f47 zero size 2024-02-28T16:27:02.655 INFO:tasks.workunit.client.1.smithi157.stdout:3/324: write d0/d6/f13 [7204298,127819] 0 2024-02-28T16:27:02.655 INFO:tasks.workunit.client.1.smithi157.stdout:7/396: dwrite df/d1f/d37/f49 [0,4194304] 0 2024-02-28T16:27:02.656 INFO:tasks.workunit.client.1.smithi157.stdout:1/396: stat d10/d11/c30 0 2024-02-28T16:27:02.659 INFO:tasks.workunit.client.1.smithi157.stdout:4/392: truncate d3/da/d37/f50 1237602 0 2024-02-28T16:27:02.662 INFO:tasks.workunit.client.1.smithi157.stdout:6/369: mknod d2/d7/de/d1b/c6d 0 2024-02-28T16:27:02.668 INFO:tasks.workunit.client.1.smithi157.stdout:8/315: dwrite d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:02.671 INFO:tasks.workunit.client.1.smithi157.stdout:4/393: unlink d3/f4 0 2024-02-28T16:27:02.671 INFO:tasks.workunit.client.1.smithi157.stdout:3/325: dwrite d0/d20/f5a [0,4194304] 0 2024-02-28T16:27:02.673 INFO:tasks.workunit.client.1.smithi157.stdout:6/370: mkdir d2/d7/d8/da/d31/d37/d2d/d30/d6e 0 2024-02-28T16:27:02.674 INFO:tasks.workunit.client.1.smithi157.stdout:1/397: mkdir d10/d11/d3a/d5c/d84 0 2024-02-28T16:27:02.676 INFO:tasks.workunit.client.1.smithi157.stdout:1/398: chown d10/d11/d31/d2a/d70/l59 2 1 2024-02-28T16:27:02.685 INFO:tasks.workunit.client.1.smithi157.stdout:7/397: rename df/d25/d59 to df/d80 0 2024-02-28T16:27:02.687 INFO:tasks.workunit.client.1.smithi157.stdout:7/398: readlink df/d25/l2f 0 2024-02-28T16:27:02.691 INFO:tasks.workunit.client.1.smithi157.stdout:6/371: dread d2/d7/fc [0,4194304] 0 2024-02-28T16:27:02.696 INFO:tasks.workunit.client.1.smithi157.stdout:6/372: read - d2/d17/f5a zero size 2024-02-28T16:27:02.696 INFO:tasks.workunit.client.1.smithi157.stdout:1/399: symlink d10/d11/d3a/d5c/l85 0 2024-02-28T16:27:02.697 INFO:tasks.workunit.client.1.smithi157.stdout:1/400: chown d10/d7a 127155537 1 2024-02-28T16:27:02.698 INFO:tasks.workunit.client.1.smithi157.stdout:7/399: mknod df/d4b/d4c/c81 0 2024-02-28T16:27:02.699 INFO:tasks.workunit.client.1.smithi157.stdout:8/316: mkdir d1/d5/d23/d38/d67 0 2024-02-28T16:27:02.704 INFO:tasks.workunit.client.1.smithi157.stdout:3/326: truncate d0/f8 3459023 0 2024-02-28T16:27:02.706 INFO:tasks.workunit.client.1.smithi157.stdout:7/400: dread df/d1f/d24/d38/f43 [0,4194304] 0 2024-02-28T16:27:02.709 INFO:tasks.workunit.client.1.smithi157.stdout:6/373: dwrite d2/d7/d8/f56 [4194304,4194304] 0 2024-02-28T16:27:02.709 INFO:tasks.workunit.client.1.smithi157.stdout:1/401: truncate d10/d11/d31/d2a/f4e 1539954 0 2024-02-28T16:27:02.711 INFO:tasks.workunit.client.1.smithi157.stdout:6/374: stat d2/d7/d8/da/d31/d59/c67 0 2024-02-28T16:27:02.713 INFO:tasks.workunit.client.1.smithi157.stdout:1/402: dread - d10/d11/d3a/d5c/d6c/d6f/f82 zero size 2024-02-28T16:27:02.713 INFO:tasks.workunit.client.1.smithi157.stdout:6/375: fsync d2/d7/de/d1b/d4d/f62 0 2024-02-28T16:27:02.714 INFO:tasks.workunit.client.1.smithi157.stdout:1/403: chown d10/d11/d3a/f5f 4492881 1 2024-02-28T16:27:02.715 INFO:tasks.workunit.client.1.smithi157.stdout:8/317: creat d1/d5/d23/f68 x:0 0 0 2024-02-28T16:27:02.725 INFO:tasks.workunit.client.1.smithi157.stdout:3/327: mknod d0/d6/c6a 0 2024-02-28T16:27:02.728 INFO:tasks.workunit.client.1.smithi157.stdout:6/376: dwrite d2/d7/de/d1b/f5d [0,4194304] 0 2024-02-28T16:27:02.730 INFO:tasks.workunit.client.1.smithi157.stdout:3/328: chown d0/d6/d44/c63 2 1 2024-02-28T16:27:02.734 INFO:tasks.workunit.client.1.smithi157.stdout:8/318: dwrite d1/f4f [0,4194304] 0 2024-02-28T16:27:02.735 INFO:tasks.workunit.client.1.smithi157.stdout:7/401: getdents df/d25/d79 0 2024-02-28T16:27:02.737 INFO:tasks.workunit.client.1.smithi157.stdout:6/377: mknod d2/d7/d8/da/d31/d37/c6f 0 2024-02-28T16:27:02.741 INFO:tasks.workunit.client.1.smithi157.stdout:3/329: mkdir d0/d6/d6b 0 2024-02-28T16:27:02.743 INFO:tasks.workunit.client.1.smithi157.stdout:8/319: creat d1/d5/d23/f69 x:0 0 0 2024-02-28T16:27:02.745 INFO:tasks.workunit.client.1.smithi157.stdout:7/402: write df/d1f/d24/d38/f6d [669796,35114] 0 2024-02-28T16:27:02.745 INFO:tasks.workunit.client.1.smithi157.stdout:1/404: dwrite fa [4194304,4194304] 0 2024-02-28T16:27:02.747 INFO:tasks.workunit.client.1.smithi157.stdout:4/394: dwrite d3/da/d37/f50 [0,4194304] 0 2024-02-28T16:27:02.760 INFO:tasks.workunit.client.1.smithi157.stdout:3/330: creat d0/d6/d6b/f6c x:0 0 0 2024-02-28T16:27:02.762 INFO:tasks.workunit.client.1.smithi157.stdout:6/378: rename d2/d7/c19 to d2/d7/de/d1b/c70 0 2024-02-28T16:27:02.775 INFO:tasks.workunit.client.1.smithi157.stdout:1/405: link d10/d11/l3b d10/d11/d31/l86 0 2024-02-28T16:27:02.779 INFO:tasks.workunit.client.1.smithi157.stdout:1/406: write d10/f6b [1005465,91090] 0 2024-02-28T16:27:02.781 INFO:tasks.workunit.client.1.smithi157.stdout:7/403: dwrite df/d25/d4e/f52 [0,4194304] 0 2024-02-28T16:27:02.783 INFO:tasks.workunit.client.1.smithi157.stdout:1/407: write d10/d11/f1c [821817,43922] 0 2024-02-28T16:27:02.786 INFO:tasks.workunit.client.1.smithi157.stdout:6/379: dwrite d2/d17/f21 [0,4194304] 0 2024-02-28T16:27:02.789 INFO:tasks.workunit.client.1.smithi157.stdout:7/404: truncate df/d40/f78 784527 0 2024-02-28T16:27:02.790 INFO:tasks.workunit.client.1.smithi157.stdout:7/405: fsync df/f1a 0 2024-02-28T16:27:02.795 INFO:tasks.workunit.client.1.smithi157.stdout:7/406: read - df/d25/d4e/f6b zero size 2024-02-28T16:27:02.796 INFO:tasks.workunit.client.1.smithi157.stdout:4/395: dread d3/da/d1f/d22/f44 [0,4194304] 0 2024-02-28T16:27:02.796 INFO:tasks.workunit.client.1.smithi157.stdout:3/331: truncate d0/d6/fb 1266150 0 2024-02-28T16:27:02.799 INFO:tasks.workunit.client.1.smithi157.stdout:1/408: unlink d10/d11/f1c 0 2024-02-28T16:27:02.799 INFO:tasks.workunit.client.1.smithi157.stdout:4/396: chown d3/da/c15 161017801 1 2024-02-28T16:27:02.804 INFO:tasks.workunit.client.1.smithi157.stdout:8/320: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:27:02.804 INFO:tasks.workunit.client.1.smithi157.stdout:3/332: mkdir d0/d20/d23/d2b/d6d 0 2024-02-28T16:27:02.808 INFO:tasks.workunit.client.1.smithi157.stdout:0/365: sync 2024-02-28T16:27:02.808 INFO:tasks.workunit.client.1.smithi157.stdout:9/347: sync 2024-02-28T16:27:02.808 INFO:tasks.workunit.client.1.smithi157.stdout:2/424: sync 2024-02-28T16:27:02.808 INFO:tasks.workunit.client.1.smithi157.stdout:5/357: sync 2024-02-28T16:27:02.808 INFO:tasks.workunit.client.1.smithi157.stdout:6/380: mkdir d2/d7/d8/da/d71 0 2024-02-28T16:27:02.813 INFO:tasks.workunit.client.1.smithi157.stdout:4/397: mkdir d3/d8b 0 2024-02-28T16:27:02.814 INFO:tasks.workunit.client.1.smithi157.stdout:9/348: write d0/d36/d37/f67 [649828,98154] 0 2024-02-28T16:27:02.815 INFO:tasks.workunit.client.1.smithi157.stdout:0/366: write d1/f15 [1301090,5933] 0 2024-02-28T16:27:02.820 INFO:tasks.workunit.client.1.smithi157.stdout:0/367: write d1/d13/f71 [916224,68380] 0 2024-02-28T16:27:02.820 INFO:tasks.workunit.client.1.smithi157.stdout:7/407: dwrite df/d40/f6e [0,4194304] 0 2024-02-28T16:27:02.821 INFO:tasks.workunit.client.1.smithi157.stdout:1/409: creat d10/d11/d3a/d5c/f87 x:0 0 0 2024-02-28T16:27:02.825 INFO:tasks.workunit.client.1.smithi157.stdout:8/321: rename d1/d5/l29 to d1/d5/d14/d3e/d52/d54/l6a 0 2024-02-28T16:27:02.827 INFO:tasks.workunit.client.1.smithi157.stdout:3/333: rmdir d0/d6/d44/d4b/d62 0 2024-02-28T16:27:02.831 INFO:tasks.workunit.client.1.smithi157.stdout:8/322: creat d1/d5/d23/f6b x:0 0 0 2024-02-28T16:27:02.834 INFO:tasks.workunit.client.1.smithi157.stdout:4/398: dread d3/da/d1f/f26 [0,4194304] 0 2024-02-28T16:27:02.834 INFO:tasks.workunit.client.1.smithi157.stdout:8/323: dread d1/d5/f31 [0,4194304] 0 2024-02-28T16:27:02.836 INFO:tasks.workunit.client.1.smithi157.stdout:1/410: mknod d10/d11/d3a/d5c/c88 0 2024-02-28T16:27:02.838 INFO:tasks.workunit.client.1.smithi157.stdout:0/368: link d1/da/f58 d1/d8/d27/f7a 0 2024-02-28T16:27:02.841 INFO:tasks.workunit.client.1.smithi157.stdout:3/334: unlink d0/d6/d34/d43/c60 0 2024-02-28T16:27:02.843 INFO:tasks.workunit.client.1.smithi157.stdout:4/399: mknod d3/da/d1f/d22/c8c 0 2024-02-28T16:27:02.843 INFO:tasks.workunit.client.1.smithi157.stdout:3/335: dread - d0/d20/d23/d2b/f57 zero size 2024-02-28T16:27:02.844 INFO:tasks.workunit.client.1.smithi157.stdout:0/369: readlink d1/d13/d61/l67 0 2024-02-28T16:27:02.847 INFO:tasks.workunit.client.1.smithi157.stdout:3/336: write d0/d20/d5c/f5e [503972,39301] 0 2024-02-28T16:27:02.850 INFO:tasks.workunit.client.1.smithi157.stdout:8/324: dwrite d1/d5/d23/f69 [0,4194304] 0 2024-02-28T16:27:02.854 INFO:tasks.workunit.client.1.smithi157.stdout:1/411: dwrite d10/f12 [0,4194304] 0 2024-02-28T16:27:02.855 INFO:tasks.workunit.client.1.smithi157.stdout:8/325: creat d1/d5/d23/d53/f6c x:0 0 0 2024-02-28T16:27:02.855 INFO:tasks.workunit.client.1.smithi157.stdout:1/412: stat d10/d11/d31/c63 0 2024-02-28T16:27:02.865 INFO:tasks.workunit.client.1.smithi157.stdout:8/326: mkdir d1/d5/d23/d38/d67/d6d 0 2024-02-28T16:27:02.865 INFO:tasks.workunit.client.1.smithi157.stdout:4/400: dwrite d3/da/d1f/f6d [0,4194304] 0 2024-02-28T16:27:02.868 INFO:tasks.workunit.client.1.smithi157.stdout:4/401: write d3/da/f12 [3135638,76214] 0 2024-02-28T16:27:02.869 INFO:tasks.workunit.client.1.smithi157.stdout:8/327: unlink d1/d5/d10/l4e 0 2024-02-28T16:27:02.872 INFO:tasks.workunit.client.1.smithi157.stdout:0/370: dread d1/d8/d27/f7a [0,4194304] 0 2024-02-28T16:27:02.873 INFO:tasks.workunit.client.1.smithi157.stdout:3/337: dwrite d0/d6/f67 [0,4194304] 0 2024-02-28T16:27:02.876 INFO:tasks.workunit.client.1.smithi157.stdout:8/328: mkdir d1/d5/d23/d38/d6e 0 2024-02-28T16:27:02.876 INFO:tasks.workunit.client.1.smithi157.stdout:4/402: truncate d3/f5f 1342579 0 2024-02-28T16:27:02.877 INFO:tasks.workunit.client.1.smithi157.stdout:0/371: chown d1/d13/d57/c72 692938 1 2024-02-28T16:27:02.880 INFO:tasks.workunit.client.1.smithi157.stdout:3/338: chown d0/d20/d23/l36 0 1 2024-02-28T16:27:02.880 INFO:tasks.workunit.client.1.smithi157.stdout:1/413: dwrite d10/d11/d3a/d5c/d6c/d7b/f26 [4194304,4194304] 0 2024-02-28T16:27:02.880 INFO:tasks.workunit.client.1.smithi157.stdout:0/372: readlink d1/d13/l4d 0 2024-02-28T16:27:02.883 INFO:tasks.workunit.client.1.smithi157.stdout:4/403: chown d3/da/d28/f76 435038 1 2024-02-28T16:27:02.884 INFO:tasks.workunit.client.1.smithi157.stdout:0/373: mkdir d1/d13/d52/d7b 0 2024-02-28T16:27:02.885 INFO:tasks.workunit.client.1.smithi157.stdout:4/404: readlink d3/da/d1f/l68 0 2024-02-28T16:27:02.888 INFO:tasks.workunit.client.1.smithi157.stdout:3/339: getdents d0/d20/d23 0 2024-02-28T16:27:02.892 INFO:tasks.workunit.client.1.smithi157.stdout:3/340: truncate d0/d6/f5f 4936020 0 2024-02-28T16:27:02.895 INFO:tasks.workunit.client.1.smithi157.stdout:3/341: chown d0/d6/l18 959290 1 2024-02-28T16:27:02.898 INFO:tasks.workunit.client.1.smithi157.stdout:3/342: dread - d0/d20/d23/d2b/d2e/f54 zero size 2024-02-28T16:27:02.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.915+0000 7f2334000700 1 -- 172.21.15.148:0/1061324094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 msgr2=0x7f232c104ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:02.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.915+0000 7f2334000700 1 --2- 172.21.15.148:0/1061324094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 0x7f232c104ba0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2318004940 tx=0x7f2318009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.916+0000 7f2334000700 1 -- 172.21.15.148:0/1061324094 shutdown_connections 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.916+0000 7f2334000700 1 --2- 172.21.15.148:0/1061324094 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 0x7f232c104ba0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.916+0000 7f2334000700 1 --2- 172.21.15.148:0/1061324094 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 0x7f232c103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.916+0000 7f2334000700 1 -- 172.21.15.148:0/1061324094 >> 172.21.15.148:0/1061324094 conn(0x7f232c0727d0 msgr2=0x7f232c074c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.916+0000 7f2334000700 1 -- 172.21.15.148:0/1061324094 shutdown_connections 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.916+0000 7f2334000700 1 -- 172.21.15.148:0/1061324094 wait complete. 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.918+0000 7f2334000700 1 Processor -- start 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.918+0000 7f2334000700 1 -- start start 2024-02-28T16:27:02.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.919+0000 7f2334000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 0x7f232c06f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:02.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.919+0000 7f2334000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 0x7f232c06f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:02.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.919+0000 7f2334000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c06fd30 con 0x7f232c104750 2024-02-28T16:27:02.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.919+0000 7f2334000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c076b70 con 0x7f232c103540 2024-02-28T16:27:02.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.920+0000 7f2331600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 0x7f232c06f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:02.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.920+0000 7f2331600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 0x7f232c06f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:47910/0 (socket says 172.21.15.148:47910) 2024-02-28T16:27:02.909 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.920+0000 7f2331600700 1 -- 172.21.15.148:0/3929858024 learned_addr learned my addr 172.21.15.148:0/3929858024 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:02.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.921+0000 7f2330c00700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 0x7f232c06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:02.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.921+0000 7f2331600700 1 -- 172.21.15.148:0/3929858024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 msgr2=0x7f232c06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:02.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.921+0000 7f2331600700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 0x7f232c06f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:02.910 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.921+0000 7f2331600700 1 -- 172.21.15.148:0/3929858024 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318005040 con 0x7f232c103540 2024-02-28T16:27:02.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.922+0000 7f2330c00700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 0x7f232c06f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:27:02.912 INFO:tasks.workunit.client.1.smithi157.stdout:3/343: link d0/d6/f17 d0/d6/d44/d48/f6e 0 2024-02-28T16:27:02.913 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.924+0000 7f2331600700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 0x7f232c06f1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2320002a80 tx=0x7f2320004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:02.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.924+0000 7f2329600700 1 -- 172.21.15.148:0/3929858024 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2320007cc0 con 0x7f232c103540 2024-02-28T16:27:02.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.924+0000 7f2329600700 1 -- 172.21.15.148:0/3929858024 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f232000f040 con 0x7f232c103540 2024-02-28T16:27:02.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.924+0000 7f2329600700 1 -- 172.21.15.148:0/3929858024 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f232000dad0 con 0x7f232c103540 2024-02-28T16:27:02.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.925+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c076e50 con 0x7f232c103540 2024-02-28T16:27:02.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.925+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c077390 con 0x7f232c103540 2024-02-28T16:27:02.915 INFO:tasks.workunit.client.1.smithi157.stdout:1/414: dread f2 [0,4194304] 0 2024-02-28T16:27:02.916 INFO:tasks.workunit.client.1.smithi157.stdout:3/344: symlink d0/d6/d44/l6f 0 2024-02-28T16:27:02.916 INFO:tasks.workunit.client.1.smithi157.stdout:0/374: dwrite d1/da/f43 [0,4194304] 0 2024-02-28T16:27:02.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.927+0000 7f2329600700 1 -- 172.21.15.148:0/3929858024 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f232000dc30 con 0x7f232c103540 2024-02-28T16:27:02.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.928+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c069110 con 0x7f232c103540 2024-02-28T16:27:02.918 INFO:tasks.workunit.client.1.smithi157.stdout:8/329: dread d1/d5/d10/f22 [0,4194304] 0 2024-02-28T16:27:02.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.929+0000 7f2329600700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f231406b1d0 0x7f231406d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:02.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.929+0000 7f2329600700 1 -- 172.21.15.148:0/3929858024 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f23200898a0 con 0x7f232c103540 2024-02-28T16:27:02.918 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.929+0000 7f2330c00700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f231406b1d0 0x7f231406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:02.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.930+0000 7f2330c00700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f231406b1d0 0x7f231406d680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f231800b7a0 tx=0x7f2318009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:02.920 INFO:tasks.workunit.client.1.smithi157.stdout:1/415: fsync f4 0 2024-02-28T16:27:02.921 INFO:tasks.workunit.client.1.smithi157.stdout:3/345: mkdir d0/d6/d44/d70 0 2024-02-28T16:27:02.923 INFO:tasks.workunit.client.1.smithi157.stdout:8/330: write d1/d5/f31 [329470,44191] 0 2024-02-28T16:27:02.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:02.936+0000 7f2329600700 1 -- 172.21.15.148:0/3929858024 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2320057580 con 0x7f232c103540 2024-02-28T16:27:02.926 INFO:tasks.workunit.client.1.smithi157.stdout:1/416: chown d10/d11/d31/l36 596 1 2024-02-28T16:27:02.928 INFO:tasks.workunit.client.1.smithi157.stdout:8/331: truncate d1/d5/d23/f68 841103 0 2024-02-28T16:27:02.929 INFO:tasks.workunit.client.1.smithi157.stdout:3/346: mkdir d0/d6/d44/d70/d71 0 2024-02-28T16:27:02.934 INFO:tasks.workunit.client.1.smithi157.stdout:1/417: unlink d10/d11/d3a/d5c/d6c/d7b/f58 0 2024-02-28T16:27:02.934 INFO:tasks.workunit.client.1.smithi157.stdout:0/375: dwrite d1/d13/f71 [0,4194304] 0 2024-02-28T16:27:02.936 INFO:tasks.workunit.client.1.smithi157.stdout:0/376: chown d1/da/c18 26626 1 2024-02-28T16:27:02.937 INFO:tasks.workunit.client.1.smithi157.stdout:0/377: readlink d1/l23 0 2024-02-28T16:27:02.938 INFO:tasks.workunit.client.1.smithi157.stdout:0/378: truncate d1/f5e 500713 0 2024-02-28T16:27:02.943 INFO:tasks.workunit.client.1.smithi157.stdout:8/332: dread d1/d5/d23/f69 [0,4194304] 0 2024-02-28T16:27:02.945 INFO:tasks.workunit.client.1.smithi157.stdout:8/333: fdatasync d1/d5/d23/d53/f6c 0 2024-02-28T16:27:02.946 INFO:tasks.workunit.client.1.smithi157.stdout:1/418: read d10/f21 [10798,5416] 0 2024-02-28T16:27:02.948 INFO:tasks.workunit.client.1.smithi157.stdout:8/334: mknod d1/d5/d10/c6f 0 2024-02-28T16:27:02.950 INFO:tasks.workunit.client.1.smithi157.stdout:3/347: dwrite d0/d6/d1e/f1f [0,4194304] 0 2024-02-28T16:27:02.950 INFO:tasks.workunit.client.1.smithi157.stdout:1/419: symlink d10/d11/d3a/d5c/d6a/l89 0 2024-02-28T16:27:02.953 INFO:tasks.workunit.client.1.smithi157.stdout:1/420: rmdir d10/d11/d31/d2a 39 2024-02-28T16:27:02.955 INFO:tasks.workunit.client.1.smithi157.stdout:1/421: readlink d10/d11/d3a/d5c/l85 0 2024-02-28T16:27:02.955 INFO:tasks.workunit.client.1.smithi157.stdout:8/335: creat d1/d5/f70 x:0 0 0 2024-02-28T16:27:02.956 INFO:tasks.workunit.client.1.smithi157.stdout:3/348: symlink d0/d6/d44/d48/l72 0 2024-02-28T16:27:02.957 INFO:tasks.workunit.client.1.smithi157.stdout:8/336: chown d1/d5/d23/f6b 497131 1 2024-02-28T16:27:02.957 INFO:tasks.workunit.client.1.smithi157.stdout:1/422: dread - d10/d11/d3a/d5c/d6c/d7b/f4f zero size 2024-02-28T16:27:02.958 INFO:tasks.workunit.client.1.smithi157.stdout:3/349: chown d0/d20/d23/d2b/d2e/f54 1 1 2024-02-28T16:27:02.958 INFO:tasks.workunit.client.1.smithi157.stdout:8/337: write d1/d5/d14/f42 [144520,47425] 0 2024-02-28T16:27:02.966 INFO:tasks.workunit.client.1.smithi157.stdout:8/338: creat d1/d5/f71 x:0 0 0 2024-02-28T16:27:02.970 INFO:tasks.workunit.client.1.smithi157.stdout:8/339: mkdir d1/d5/d14/d3e/d52/d54/d72 0 2024-02-28T16:27:02.971 INFO:tasks.workunit.client.1.smithi157.stdout:8/340: chown d1/d5/d14/f47 4080 1 2024-02-28T16:27:02.976 INFO:tasks.workunit.client.1.smithi157.stdout:8/341: creat d1/d5/d14/d3e/f73 x:0 0 0 2024-02-28T16:27:02.993 INFO:tasks.workunit.client.1.smithi157.stdout:7/408: dread df/f1a [0,4194304] 0 2024-02-28T16:27:02.998 INFO:tasks.workunit.client.1.smithi157.stdout:7/409: write df/d1f/d37/f49 [4884965,123126] 0 2024-02-28T16:27:03.000 INFO:tasks.workunit.client.1.smithi157.stdout:8/342: dwrite d1/d5/d23/f69 [0,4194304] 0 2024-02-28T16:27:03.011 INFO:tasks.workunit.client.1.smithi157.stdout:7/410: dread df/d1f/d24/d38/f43 [0,4194304] 0 2024-02-28T16:27:03.014 INFO:tasks.workunit.client.1.smithi157.stdout:9/349: truncate d0/d36/d3f/f60 2346784 0 2024-02-28T16:27:03.015 INFO:tasks.workunit.client.1.smithi157.stdout:8/343: getdents d1/d5/d23 0 2024-02-28T16:27:03.018 INFO:tasks.workunit.client.1.smithi157.stdout:2/425: dread da/f1f [0,4194304] 0 2024-02-28T16:27:03.018 INFO:tasks.workunit.client.1.smithi157.stdout:7/411: creat df/d25/d79/f82 x:0 0 0 2024-02-28T16:27:03.022 INFO:tasks.workunit.client.1.smithi157.stdout:8/344: mkdir d1/d5/d10/d74 0 2024-02-28T16:27:03.029 INFO:tasks.workunit.client.1.smithi157.stdout:7/412: creat df/d1f/d24/d38/f83 x:0 0 0 2024-02-28T16:27:03.029 INFO:tasks.workunit.client.1.smithi157.stdout:7/413: readlink df/d1f/l2e 0 2024-02-28T16:27:03.031 INFO:tasks.workunit.client.1.smithi157.stdout:2/426: mkdir da/d38/d5a/d8e 0 2024-02-28T16:27:03.042 INFO:tasks.workunit.client.1.smithi157.stdout:2/427: write da/f5e [2384932,97417] 0 2024-02-28T16:27:03.043 INFO:tasks.workunit.client.1.smithi157.stdout:4/405: write d3/da/f5e [5082426,55402] 0 2024-02-28T16:27:03.044 INFO:tasks.workunit.client.1.smithi157.stdout:4/406: dread - d3/da/d28/f80 zero size 2024-02-28T16:27:03.048 INFO:tasks.workunit.client.1.smithi157.stdout:8/345: rmdir d1/d5/d14/d3e/d52/d54/d72 0 2024-02-28T16:27:03.050 INFO:tasks.workunit.client.1.smithi157.stdout:4/407: creat d3/da/d1f/d22/f8d x:0 0 0 2024-02-28T16:27:03.052 INFO:tasks.workunit.client.1.smithi157.stdout:4/408: write d3/da/d37/f78 [21208,113503] 0 2024-02-28T16:27:03.053 INFO:tasks.workunit.client.1.smithi157.stdout:8/346: unlink d1/d5/f31 0 2024-02-28T16:27:03.055 INFO:tasks.workunit.client.1.smithi157.stdout:2/428: rmdir da/d35/d58 0 2024-02-28T16:27:03.060 INFO:tasks.workunit.client.1.smithi157.stdout:2/429: unlink da/d2b/d59/c82 0 2024-02-28T16:27:03.064 INFO:tasks.workunit.client.1.smithi157.stdout:8/347: creat d1/d5/d10/d74/f75 x:0 0 0 2024-02-28T16:27:03.065 INFO:tasks.workunit.client.1.smithi157.stdout:2/430: symlink da/d38/d5a/d69/l8f 0 2024-02-28T16:27:03.067 INFO:tasks.workunit.client.1.smithi157.stdout:5/358: sync 2024-02-28T16:27:03.067 INFO:tasks.workunit.client.1.smithi157.stdout:8/348: creat d1/d5/d23/d53/f76 x:0 0 0 2024-02-28T16:27:03.068 INFO:tasks.workunit.client.1.smithi157.stdout:2/431: chown da/c17 14836394 1 2024-02-28T16:27:03.070 INFO:tasks.workunit.client.1.smithi157.stdout:1/423: truncate d10/d11/d31/f3d 3923170 0 2024-02-28T16:27:03.071 INFO:tasks.workunit.client.1.smithi157.stdout:3/350: truncate d0/d6/f3d 967455 0 2024-02-28T16:27:03.074 INFO:tasks.workunit.client.1.smithi157.stdout:2/432: rename da/d3a to da/d65/d90 0 2024-02-28T16:27:03.078 INFO:tasks.workunit.client.1.smithi157.stdout:8/349: creat d1/d5/d4d/d60/f77 x:0 0 0 2024-02-28T16:27:03.079 INFO:tasks.workunit.client.1.smithi157.stdout:8/350: readlink d1/d5/d23/l36 0 2024-02-28T16:27:03.083 INFO:tasks.workunit.client.1.smithi157.stdout:1/424: dread d10/d11/d31/d2a/d70/f53 [0,4194304] 0 2024-02-28T16:27:03.084 INFO:tasks.workunit.client.1.smithi157.stdout:3/351: rename d0/d6/f15 to d0/d6/d6b/f73 0 2024-02-28T16:27:03.090 INFO:tasks.workunit.client.1.smithi157.stdout:9/350: write d0/f3 [726704,45241] 0 2024-02-28T16:27:03.091 INFO:tasks.workunit.client.1.smithi157.stdout:9/351: readlink d0/d36/l68 0 2024-02-28T16:27:03.093 INFO:tasks.workunit.client.1.smithi157.stdout:2/433: rename da/d38/d3e/d83 to da/d38/d4e/d91 0 2024-02-28T16:27:03.095 INFO:tasks.workunit.client.1.smithi157.stdout:7/414: write df/d1f/f7e [54079,67756] 0 2024-02-28T16:27:03.096 INFO:tasks.workunit.client.1.smithi157.stdout:3/352: mknod d0/d20/d23/c74 0 2024-02-28T16:27:03.097 INFO:tasks.workunit.client.1.smithi157.stdout:3/353: readlink d0/d6/d44/l55 0 2024-02-28T16:27:03.098 INFO:tasks.workunit.client.1.smithi157.stdout:6/381: sync 2024-02-28T16:27:03.098 INFO:tasks.workunit.client.1.smithi157.stdout:0/379: sync 2024-02-28T16:27:03.103 INFO:tasks.workunit.client.1.smithi157.stdout:9/352: truncate d0/d19/d30/f39 592035 0 2024-02-28T16:27:03.107 INFO:tasks.workunit.client.1.smithi157.stdout:7/415: dwrite df/d1f/f5e [0,4194304] 0 2024-02-28T16:27:03.112 INFO:tasks.workunit.client.1.smithi157.stdout:4/409: truncate d3/f2e 1151769 0 2024-02-28T16:27:03.115 INFO:tasks.workunit.client.1.smithi157.stdout:4/410: dread - d3/da/d1f/d22/f8d zero size 2024-02-28T16:27:03.117 INFO:tasks.workunit.client.1.smithi157.stdout:9/353: read d0/f21 [4460105,35677] 0 2024-02-28T16:27:03.121 INFO:tasks.workunit.client.1.smithi157.stdout:2/434: getdents da/d47/d67 0 2024-02-28T16:27:03.122 INFO:tasks.workunit.client.1.smithi157.stdout:3/354: getdents d0/d6/d44/d70/d71 0 2024-02-28T16:27:03.123 INFO:tasks.workunit.client.1.smithi157.stdout:6/382: creat d2/d7/d8/da/d4c/f72 x:0 0 0 2024-02-28T16:27:03.124 INFO:tasks.workunit.client.1.smithi157.stdout:5/359: truncate d0/d8/f77 3047260 0 2024-02-28T16:27:03.126 INFO:tasks.workunit.client.1.smithi157.stdout:8/351: rename d1/d5/d10/c2a to d1/d5/c78 0 2024-02-28T16:27:03.131 INFO:tasks.workunit.client.1.smithi157.stdout:3/355: write d0/d6/f2d [2437276,55421] 0 2024-02-28T16:27:03.132 INFO:tasks.workunit.client.1.smithi157.stdout:5/360: readlink d0/l32 0 2024-02-28T16:27:03.134 INFO:tasks.workunit.client.1.smithi157.stdout:6/383: creat d2/d7/d8/da/d31/d37/d2d/d30/f73 x:0 0 0 2024-02-28T16:27:03.134 INFO:tasks.workunit.client.1.smithi157.stdout:9/354: dwrite d0/d19/d30/f32 [0,4194304] 0 2024-02-28T16:27:03.135 INFO:tasks.workunit.client.1.smithi157.stdout:0/380: getdents d1/d13/d46 0 2024-02-28T16:27:03.137 INFO:tasks.workunit.client.1.smithi157.stdout:7/416: rename df/d4b/d4c/d7c to df/d80/d84 0 2024-02-28T16:27:03.139 INFO:tasks.workunit.client.1.smithi157.stdout:8/352: symlink d1/d5/d14/l79 0 2024-02-28T16:27:03.140 INFO:tasks.workunit.client.1.smithi157.stdout:8/353: read d1/d5/f21 [59793,94791] 0 2024-02-28T16:27:03.141 INFO:tasks.workunit.client.1.smithi157.stdout:3/356: rmdir d0/d6/d6b 39 2024-02-28T16:27:03.143 INFO:tasks.workunit.client.1.smithi157.stdout:5/361: readlink d0/d9/d3a/l68 0 2024-02-28T16:27:03.144 INFO:tasks.workunit.client.1.smithi157.stdout:1/425: truncate d10/d11/d31/d2a/f55 517529 0 2024-02-28T16:27:03.146 INFO:tasks.workunit.client.1.smithi157.stdout:9/355: mkdir d0/d19/d30/d78 0 2024-02-28T16:27:03.147 INFO:tasks.workunit.client.1.smithi157.stdout:1/426: fsync d10/d11/d3a/d5c/d6c/d7b/f1e 0 2024-02-28T16:27:03.151 INFO:tasks.workunit.client.1.smithi157.stdout:0/381: unlink d1/d8/d27/c2e 0 2024-02-28T16:27:03.152 INFO:tasks.workunit.client.1.smithi157.stdout:0/382: write d1/f5e [1028007,105775] 0 2024-02-28T16:27:03.157 INFO:tasks.workunit.client.1.smithi157.stdout:6/384: rmdir d2/d7/d8/da/d31/d3a 39 2024-02-28T16:27:03.157 INFO:tasks.workunit.client.1.smithi157.stdout:3/357: dwrite d0/d6/f5f [0,4194304] 0 2024-02-28T16:27:03.158 INFO:tasks.workunit.client.1.smithi157.stdout:6/385: readlink d2/d17/l42 0 2024-02-28T16:27:03.163 INFO:tasks.workunit.client.1.smithi157.stdout:4/411: getdents d3/da/d37 0 2024-02-28T16:27:03.164 INFO:tasks.workunit.client.1.smithi157.stdout:2/435: write da/d38/d3e/f5b [5449071,7772] 0 2024-02-28T16:27:03.166 INFO:tasks.workunit.client.1.smithi157.stdout:5/362: fsync d0/d9/f42 0 2024-02-28T16:27:03.174 INFO:tasks.workunit.client.1.smithi157.stdout:3/358: dread d0/d6/d1e/f1f [0,4194304] 0 2024-02-28T16:27:03.177 INFO:tasks.workunit.client.1.smithi157.stdout:6/386: dwrite d2/d17/f25 [4194304,4194304] 0 2024-02-28T16:27:03.183 INFO:tasks.workunit.client.1.smithi157.stdout:2/436: dwrite da/d38/d3e/f5b [4194304,4194304] 0 2024-02-28T16:27:03.189 INFO:tasks.workunit.client.1.smithi157.stdout:4/412: mkdir d3/da/d48/d8e 0 2024-02-28T16:27:03.194 INFO:tasks.workunit.client.1.smithi157.stdout:5/363: rename d0/d9/d47/d5b/d6a to d0/d9/d47/d78 0 2024-02-28T16:27:03.195 INFO:tasks.workunit.client.1.smithi157.stdout:8/354: truncate d1/f2 2658840 0 2024-02-28T16:27:03.196 INFO:tasks.workunit.client.1.smithi157.stdout:3/359: dwrite d0/d20/d23/d2b/d2e/f33 [0,4194304] 0 2024-02-28T16:27:03.197 INFO:tasks.workunit.client.1.smithi157.stdout:5/364: chown d0/d9/d1b/d36/f38 0 1 2024-02-28T16:27:03.198 INFO:tasks.workunit.client.1.smithi157.stdout:5/365: chown d0/d9/d1b 159 1 2024-02-28T16:27:03.199 INFO:tasks.workunit.client.1.smithi157.stdout:1/427: symlink d10/d11/d3a/d5c/d84/l8a 0 2024-02-28T16:27:03.200 INFO:tasks.workunit.client.1.smithi157.stdout:9/356: write d0/d36/d37/d40/d5b/f6a [2035085,86535] 0 2024-02-28T16:27:03.204 INFO:tasks.workunit.client.1.smithi157.stdout:6/387: mknod d2/d7/de/d1b/c74 0 2024-02-28T16:27:03.208 INFO:tasks.workunit.client.1.smithi157.stdout:4/413: mknod d3/d77/c8f 0 2024-02-28T16:27:03.209 INFO:tasks.workunit.client.1.smithi157.stdout:4/414: chown d3/c18 0 1 2024-02-28T16:27:03.209 INFO:tasks.workunit.client.1.smithi157.stdout:1/428: read d10/d11/d3a/d5c/d6c/d7b/f26 [2781839,2041] 0 2024-02-28T16:27:03.213 INFO:tasks.workunit.client.1.smithi157.stdout:5/366: creat d0/d9/f79 x:0 0 0 2024-02-28T16:27:03.215 INFO:tasks.workunit.client.1.smithi157.stdout:7/417: getdents df/d25/d4e/d67 0 2024-02-28T16:27:03.216 INFO:tasks.workunit.client.1.smithi157.stdout:4/415: read d3/da/d1f/d22/f7a [1372913,75055] 0 2024-02-28T16:27:03.218 INFO:tasks.workunit.client.1.smithi157.stdout:6/388: mknod d2/d7/de/d1b/c75 0 2024-02-28T16:27:03.220 INFO:tasks.workunit.client.1.smithi157.stdout:2/437: dread da/d65/d90/f49 [0,4194304] 0 2024-02-28T16:27:03.221 INFO:tasks.workunit.client.1.smithi157.stdout:3/360: mkdir d0/d6/d6b/d75 0 2024-02-28T16:27:03.222 INFO:tasks.workunit.client.1.smithi157.stdout:2/438: write da/d65/d90/f88 [220997,28384] 0 2024-02-28T16:27:03.228 INFO:tasks.workunit.client.1.smithi157.stdout:0/383: getdents d1/da 0 2024-02-28T16:27:03.229 INFO:tasks.workunit.client.1.smithi157.stdout:7/418: dwrite fd [0,4194304] 0 2024-02-28T16:27:03.231 INFO:tasks.workunit.client.1.smithi157.stdout:5/367: mknod d0/d9/d47/d5c/c7a 0 2024-02-28T16:27:03.237 INFO:tasks.workunit.client.1.smithi157.stdout:9/357: truncate d0/d19/f1c 526781 0 2024-02-28T16:27:03.238 INFO:tasks.workunit.client.1.smithi157.stdout:1/429: dread d10/d11/d31/d2a/f5d [0,4194304] 0 2024-02-28T16:27:03.245 INFO:tasks.workunit.client.1.smithi157.stdout:6/389: mknod d2/d7/d8/da/d31/d59/c76 0 2024-02-28T16:27:03.248 INFO:tasks.workunit.client.1.smithi157.stdout:6/390: write d2/d7/d8/da/d31/d37/d2d/f48 [4154797,30226] 0 2024-02-28T16:27:03.251 INFO:tasks.workunit.client.1.smithi157.stdout:6/391: stat d2/d7/d8/da/d31/d37/d2d/d30/f3e 0 2024-02-28T16:27:03.251 INFO:tasks.workunit.client.1.smithi157.stdout:2/439: rmdir da/d38 39 2024-02-28T16:27:03.252 INFO:tasks.workunit.client.1.smithi157.stdout:8/355: truncate d1/f4 1247708 0 2024-02-28T16:27:03.252 INFO:tasks.workunit.client.1.smithi157.stdout:9/358: dwrite d0/f33 [0,4194304] 0 2024-02-28T16:27:03.255 INFO:tasks.workunit.client.1.smithi157.stdout:0/384: mknod d1/da/c7c 0 2024-02-28T16:27:03.255 INFO:tasks.workunit.client.1.smithi157.stdout:6/392: write d2/d17/f21 [2372120,71578] 0 2024-02-28T16:27:03.258 INFO:tasks.workunit.client.1.smithi157.stdout:6/393: write d2/d7/de/d1b/d4d/f62 [1041081,69454] 0 2024-02-28T16:27:03.258 INFO:tasks.workunit.client.1.smithi157.stdout:7/419: rename df/d1f/d24/l65 to df/d25/d4e/d67/l85 0 2024-02-28T16:27:03.263 INFO:tasks.workunit.client.1.smithi157.stdout:5/368: creat d0/d8/d51/f7b x:0 0 0 2024-02-28T16:27:03.265 INFO:tasks.workunit.client.1.smithi157.stdout:7/420: dread df/d1f/d24/f53 [0,4194304] 0 2024-02-28T16:27:03.266 INFO:tasks.workunit.client.1.smithi157.stdout:5/369: write d0/d8/f2d [3323079,127384] 0 2024-02-28T16:27:03.277 INFO:tasks.workunit.client.1.smithi157.stdout:0/385: chown d1/d13/d52/l66 294916330 1 2024-02-28T16:27:03.285 INFO:tasks.workunit.client.1.smithi157.stdout:6/394: unlink d2/d7/d8/da/d31/d37/c52 0 2024-02-28T16:27:03.286 INFO:tasks.workunit.client.1.smithi157.stdout:7/421: dwrite f3 [0,4194304] 0 2024-02-28T16:27:03.288 INFO:tasks.workunit.client.1.smithi157.stdout:7/422: chown f3 1 1 2024-02-28T16:27:03.288 INFO:tasks.workunit.client.1.smithi157.stdout:1/430: mknod d10/d11/c8b 0 2024-02-28T16:27:03.289 INFO:tasks.workunit.client.1.smithi157.stdout:4/416: creat d3/da/f90 x:0 0 0 2024-02-28T16:27:03.292 INFO:tasks.workunit.client.1.smithi157.stdout:3/361: rmdir d0/d6/d69 0 2024-02-28T16:27:03.297 INFO:tasks.workunit.client.1.smithi157.stdout:1/431: dread ff [0,4194304] 0 2024-02-28T16:27:03.298 INFO:tasks.workunit.client.1.smithi157.stdout:0/386: mkdir d1/da/d7d 0 2024-02-28T16:27:03.300 INFO:tasks.workunit.client.1.smithi157.stdout:1/432: chown d10/d11/d31/d2a/l5a 710494097 1 2024-02-28T16:27:03.301 INFO:tasks.workunit.client.1.smithi157.stdout:1/433: write d10/d11/f65 [1142720,115931] 0 2024-02-28T16:27:03.304 INFO:tasks.workunit.client.1.smithi157.stdout:4/417: rmdir d3/d77 39 2024-02-28T16:27:03.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.316+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f232c077670 con 0x7f231406b1d0 2024-02-28T16:27:03.307 INFO:tasks.workunit.client.1.smithi157.stdout:3/362: creat d0/d6/d1e/f76 x:0 0 0 2024-02-28T16:27:03.307 INFO:tasks.workunit.client.1.smithi157.stdout:2/440: mkdir da/d38/d7e/d92 0 2024-02-28T16:27:03.308 INFO:tasks.workunit.client.1.smithi157.stdout:8/356: dread d1/d5/d14/d3e/d52/d54/f5d [0,4194304] 0 2024-02-28T16:27:03.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.321+0000 7f2329600700 1 -- 172.21.15.148:0/3929858024 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f232c077670 con 0x7f231406b1d0 2024-02-28T16:27:03.312 INFO:tasks.workunit.client.1.smithi157.stdout:9/359: truncate d0/d19/f29 61784 0 2024-02-28T16:27:03.313 INFO:tasks.workunit.client.1.smithi157.stdout:6/395: symlink d2/d7/l77 0 2024-02-28T16:27:03.313 INFO:tasks.workunit.client.1.smithi157.stdout:1/434: mkdir d10/d11/d3a/d5c/d6c/d7b/d8c 0 2024-02-28T16:27:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f231406b1d0 msgr2=0x7f231406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f231406b1d0 0x7f231406d680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f231800b7a0 tx=0x7f2318009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 msgr2=0x7f232c06f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 0x7f232c06f1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2320002a80 tx=0x7f2320004600 comp rx=0 tx=0).stop 2024-02-28T16:27:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 shutdown_connections 2024-02-28T16:27:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f231406b1d0 0x7f231406d680 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f232c103540 0x7f232c06f1f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 --2- 172.21.15.148:0/3929858024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f232c104750 0x7f232c06f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.324+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 >> 172.21.15.148:0/3929858024 conn(0x7f232c0727d0 msgr2=0x7f232c075be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.325+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 shutdown_connections 2024-02-28T16:27:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.325+0000 7f2334000700 1 -- 172.21.15.148:0/3929858024 wait complete. 2024-02-28T16:27:03.316 INFO:tasks.workunit.client.1.smithi157.stdout:0/387: creat d1/da/d7d/f7e x:0 0 0 2024-02-28T16:27:03.317 INFO:tasks.workunit.client.1.smithi157.stdout:9/360: mkdir d0/d19/d30/d79 0 2024-02-28T16:27:03.320 INFO:tasks.workunit.client.1.smithi157.stdout:1/435: mknod d10/c8d 0 2024-02-28T16:27:03.321 INFO:tasks.workunit.client.1.smithi157.stdout:3/363: fsync d0/f8 0 2024-02-28T16:27:03.322 INFO:tasks.workunit.client.1.smithi157.stdout:1/436: readlink d10/d11/d3a/d5c/d6a/l77 0 2024-02-28T16:27:03.323 INFO:tasks.workunit.client.1.smithi157.stdout:8/357: symlink d1/d5/d43/d66/l7a 0 2024-02-28T16:27:03.325 INFO:tasks.workunit.client.1.smithi157.stdout:7/423: link df/d1f/c3a df/d1f/d24/d4f/c86 0 2024-02-28T16:27:03.325 INFO:tasks.workunit.client.1.smithi157.stdout:8/358: write d1/f64 [797901,47491] 0 2024-02-28T16:27:03.326 INFO:tasks.workunit.client.1.smithi157.stdout:9/361: stat d0/d36/d37/d40/f44 0 2024-02-28T16:27:03.330 INFO:tasks.workunit.client.1.smithi157.stdout:0/388: stat d1/d8/d33/f44 0 2024-02-28T16:27:03.331 INFO:tasks.workunit.client.1.smithi157.stdout:5/370: truncate d0/d30/f5f 2982923 0 2024-02-28T16:27:03.331 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:27:03.332 INFO:tasks.workunit.client.1.smithi157.stdout:0/389: write d1/d13/f3e [185239,25694] 0 2024-02-28T16:27:03.333 INFO:tasks.workunit.client.1.smithi157.stdout:2/441: dread da/ff [0,4194304] 0 2024-02-28T16:27:03.334 INFO:tasks.workunit.client.1.smithi157.stdout:7/424: symlink df/d1f/d24/d39/d64/l87 0 2024-02-28T16:27:03.337 INFO:tasks.workunit.client.1.smithi157.stdout:6/396: rename d2/d7/d8/da/d31/d37/d2d/d30 to d2/d7/d8/d78 0 2024-02-28T16:27:03.341 INFO:tasks.workunit.client.1.smithi157.stdout:6/397: write d2/d7/d8/da/d31/d37/d2b/f3f [207720,7080] 0 2024-02-28T16:27:03.341 INFO:tasks.workunit.client.1.smithi157.stdout:8/359: creat d1/d5/d14/d3e/d52/d54/f7b x:0 0 0 2024-02-28T16:27:03.344 INFO:tasks.workunit.client.1.smithi157.stdout:1/437: dwrite d10/d11/d22/f62 [0,4194304] 0 2024-02-28T16:27:03.344 INFO:tasks.workunit.client.1.smithi157.stdout:3/364: creat d0/d20/d23/d2b/d6d/f77 x:0 0 0 2024-02-28T16:27:03.346 INFO:tasks.workunit.client.1.smithi157.stdout:3/365: chown d0/d6/f39 12 1 2024-02-28T16:27:03.351 INFO:tasks.workunit.client.1.smithi157.stdout:5/371: unlink d0/d8/c72 0 2024-02-28T16:27:03.351 INFO:tasks.workunit.client.1.smithi157.stdout:4/418: truncate d3/da/fd 126729 0 2024-02-28T16:27:03.352 INFO:tasks.workunit.client.1.smithi157.stdout:4/419: chown d3/da/d28/l47 124651 1 2024-02-28T16:27:03.355 INFO:tasks.workunit.client.1.smithi157.stdout:2/442: creat da/d38/d4e/f93 x:0 0 0 2024-02-28T16:27:03.356 INFO:tasks.workunit.client.1.smithi157.stdout:2/443: fdatasync da/d38/d4e/f93 0 2024-02-28T16:27:03.361 INFO:tasks.workunit.client.1.smithi157.stdout:7/425: dread df/d4b/d4c/f55 [0,4194304] 0 2024-02-28T16:27:03.361 INFO:tasks.workunit.client.1.smithi157.stdout:1/438: dread d10/d11/d3a/d5c/d6c/d7b/f1e [0,4194304] 0 2024-02-28T16:27:03.363 INFO:tasks.workunit.client.1.smithi157.stdout:1/439: chown d10/d11/d31/d2a/l35 1 1 2024-02-28T16:27:03.366 INFO:tasks.workunit.client.1.smithi157.stdout:8/360: creat d1/d5/d14/d3e/d52/d54/f7c x:0 0 0 2024-02-28T16:27:03.368 INFO:tasks.workunit.client.1.smithi157.stdout:8/361: fdatasync d1/d5/d23/f69 0 2024-02-28T16:27:03.369 INFO:tasks.workunit.client.1.smithi157.stdout:3/366: creat d0/d6/d44/f78 x:0 0 0 2024-02-28T16:27:03.372 INFO:tasks.workunit.client.1.smithi157.stdout:3/367: write d0/d6/d1e/d5b/f61 [714841,21377] 0 2024-02-28T16:27:03.373 INFO:tasks.workunit.client.1.smithi157.stdout:5/372: rename d0/d8/f41 to d0/d9/d47/d78/f7c 0 2024-02-28T16:27:03.385 INFO:tasks.workunit.client.1.smithi157.stdout:5/373: dwrite d0/d9/d47/f54 [0,4194304] 0 2024-02-28T16:27:03.385 INFO:tasks.workunit.client.1.smithi157.stdout:7/426: creat df/d1f/d24/d39/d64/f88 x:0 0 0 2024-02-28T16:27:03.387 INFO:tasks.workunit.client.1.smithi157.stdout:7/427: chown df/d1f/d37/c3d 931 1 2024-02-28T16:27:03.388 INFO:tasks.workunit.client.1.smithi157.stdout:6/398: creat d2/d7/d8/d78/d6e/f79 x:0 0 0 2024-02-28T16:27:03.400 INFO:tasks.workunit.client.1.smithi157.stdout:0/390: dwrite d1/d8/d33/f50 [0,4194304] 0 2024-02-28T16:27:03.401 INFO:tasks.workunit.client.1.smithi157.stdout:0/391: fsync d1/d8/d27/f3a 0 2024-02-28T16:27:03.405 INFO:tasks.workunit.client.1.smithi157.stdout:9/362: rename d0/d19/f2e to d0/d19/f7a 0 2024-02-28T16:27:03.410 INFO:tasks.workunit.client.1.smithi157.stdout:7/428: stat df/d1f/c2b 0 2024-02-28T16:27:03.419 INFO:tasks.workunit.client.1.smithi157.stdout:8/362: chown d1/d5/d23/d38/l39 3238 1 2024-02-28T16:27:03.430 INFO:tasks.workunit.client.1.smithi157.stdout:2/444: truncate da/d38/d5a/f66 629503 0 2024-02-28T16:27:03.432 INFO:tasks.workunit.client.1.smithi157.stdout:2/445: write da/d47/f77 [126551,64045] 0 2024-02-28T16:27:03.438 INFO:tasks.workunit.client.1.smithi157.stdout:0/392: mkdir d1/d13/d7f 0 2024-02-28T16:27:03.440 INFO:tasks.workunit.client.1.smithi157.stdout:5/374: link d0/d9/d3a/l68 d0/d30/l7d 0 2024-02-28T16:27:03.441 INFO:tasks.workunit.client.1.smithi157.stdout:0/393: write d1/d13/f3e [4439001,7402] 0 2024-02-28T16:27:03.442 INFO:tasks.workunit.client.1.smithi157.stdout:1/440: getdents d10/d11/d3a/d5c/d84 0 2024-02-28T16:27:03.444 INFO:tasks.workunit.client.1.smithi157.stdout:3/368: write d0/d6/f3d [1001580,115541] 0 2024-02-28T16:27:03.444 INFO:tasks.workunit.client.1.smithi157.stdout:2/446: symlink da/d38/d5a/d69/l94 0 2024-02-28T16:27:03.448 INFO:tasks.workunit.client.1.smithi157.stdout:3/369: write d0/d6/f39 [761753,118642] 0 2024-02-28T16:27:03.449 INFO:tasks.workunit.client.1.smithi157.stdout:5/375: fsync d0/d8/d51/d61/f76 0 2024-02-28T16:27:03.449 INFO:tasks.workunit.client.1.smithi157.stdout:3/370: readlink d0/d6/l1a 0 2024-02-28T16:27:03.450 INFO:tasks.workunit.client.1.smithi157.stdout:8/363: rename d1/d5/d14/d3e/d52/d54/f7c to d1/d5/d14/f7d 0 2024-02-28T16:27:03.452 INFO:tasks.workunit.client.1.smithi157.stdout:9/363: getdents d0/d36/d37/d40 0 2024-02-28T16:27:03.454 INFO:tasks.workunit.client.1.smithi157.stdout:2/447: creat da/d38/d5a/d69/f95 x:0 0 0 2024-02-28T16:27:03.463 INFO:tasks.workunit.client.1.smithi157.stdout:2/448: rmdir da/d38/d5a/d79 39 2024-02-28T16:27:03.464 INFO:tasks.workunit.client.1.smithi157.stdout:0/394: dread d1/f6 [0,4194304] 0 2024-02-28T16:27:03.466 INFO:tasks.workunit.client.1.smithi157.stdout:1/441: rename d10/d11/d3a/d5c/f67 to d10/d11/f8e 0 2024-02-28T16:27:03.467 INFO:tasks.workunit.client.1.smithi157.stdout:3/371: dwrite d0/d6/f5f [4194304,4194304] 0 2024-02-28T16:27:03.468 INFO:tasks.workunit.client.1.smithi157.stdout:9/364: creat d0/f7b x:0 0 0 2024-02-28T16:27:03.469 INFO:tasks.workunit.client.1.smithi157.stdout:2/449: fdatasync da/d38/f89 0 2024-02-28T16:27:03.474 INFO:tasks.workunit.client.1.smithi157.stdout:3/372: mknod d0/d6/c79 0 2024-02-28T16:27:03.476 INFO:tasks.workunit.client.1.smithi157.stdout:2/450: creat da/f96 x:0 0 0 2024-02-28T16:27:03.478 INFO:tasks.workunit.client.1.smithi157.stdout:5/376: dread d0/f2f [0,4194304] 0 2024-02-28T16:27:03.479 INFO:tasks.workunit.client.1.smithi157.stdout:0/395: write d1/da/f58 [1898333,128446] 0 2024-02-28T16:27:03.480 INFO:tasks.workunit.client.1.smithi157.stdout:3/373: truncate d0/d20/d23/d2b/d2e/f54 371713 0 2024-02-28T16:27:03.486 INFO:tasks.workunit.client.1.smithi157.stdout:2/451: rmdir da/d38/d5a/d8e 0 2024-02-28T16:27:03.488 INFO:tasks.workunit.client.1.smithi157.stdout:3/374: write d0/d20/d23/d2b/f32 [2002437,78367] 0 2024-02-28T16:27:03.491 INFO:tasks.workunit.client.1.smithi157.stdout:2/452: mknod da/d65/d90/c97 0 2024-02-28T16:27:03.491 INFO:tasks.workunit.client.1.smithi157.stdout:1/442: dwrite d10/d11/d31/f42 [0,4194304] 0 2024-02-28T16:27:03.493 INFO:tasks.workunit.client.1.smithi157.stdout:3/375: write d0/d6/f3d [507067,20302] 0 2024-02-28T16:27:03.495 INFO:tasks.workunit.client.1.smithi157.stdout:2/453: dread - da/d38/f57 zero size 2024-02-28T16:27:03.496 INFO:tasks.workunit.client.1.smithi157.stdout:9/365: dwrite d0/d36/d3f/d69/f71 [0,4194304] 0 2024-02-28T16:27:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.518+0000 7fb014a00700 1 -- 172.21.15.148:0/2334891064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0101003b0 msgr2=0x7fb010102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.518+0000 7fb014a00700 1 --2- 172.21.15.148:0/2334891064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0101003b0 0x7fb010102790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faff8004940 tx=0x7faff8009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.519+0000 7fb014a00700 1 -- 172.21.15.148:0/2334891064 shutdown_connections 2024-02-28T16:27:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.519+0000 7fb014a00700 1 --2- 172.21.15.148:0/2334891064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0101003b0 0x7fb010102790 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.519+0000 7fb014a00700 1 --2- 172.21.15.148:0/2334891064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0100fda90 0x7fb0100ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.508 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.519+0000 7fb014a00700 1 -- 172.21.15.148:0/2334891064 >> 172.21.15.148:0/2334891064 conn(0x7fb0100f7510 msgr2=0x7fb0100f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:03.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.519+0000 7fb014a00700 1 -- 172.21.15.148:0/2334891064 shutdown_connections 2024-02-28T16:27:03.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.519+0000 7fb014a00700 1 -- 172.21.15.148:0/2334891064 wait complete. 2024-02-28T16:27:03.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.520+0000 7fb014a00700 1 Processor -- start 2024-02-28T16:27:03.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.520+0000 7fb014a00700 1 -- start start 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.520+0000 7fb014a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0100fda90 0x7fb0100fd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.520+0000 7fb014a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0101003b0 0x7fb0100fb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.520+0000 7fb014a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100fc030 con 0x7fb0100fda90 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.520+0000 7fb014a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0100fc1a0 con 0x7fb0101003b0 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.521+0000 7fb00de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0100fda90 0x7fb0100fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.521+0000 7fb00de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0100fda90 0x7fb0100fd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52484/0 (socket says 172.21.15.148:52484) 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.521+0000 7fb00de00700 1 -- 172.21.15.148:0/2465248374 learned_addr learned my addr 172.21.15.148:0/2465248374 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:03.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.521+0000 7fb00d400700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0101003b0 0x7fb0100fb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:03.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.521+0000 7fb00de00700 1 -- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0101003b0 msgr2=0x7fb0100fb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.521+0000 7fb00de00700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0101003b0 0x7fb0100fb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.521+0000 7fb00de00700 1 -- 172.21.15.148:0/2465248374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8005040 con 0x7fb0100fda90 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.522+0000 7fb00de00700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0100fda90 0x7fb0100fd520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b790 tx=0x7fb000009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.522+0000 7fb006000700 1 -- 172.21.15.148:0/2465248374 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb00000f6f0 con 0x7fb0100fda90 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.522+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0100fc480 con 0x7fb0100fda90 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.522+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0100fc800 con 0x7fb0100fda90 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.522+0000 7fb006000700 1 -- 172.21.15.148:0/2465248374 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb00000fd20 con 0x7fb0100fda90 2024-02-28T16:27:03.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.522+0000 7fb006000700 1 -- 172.21.15.148:0/2465248374 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb000011e90 con 0x7fb0100fda90 2024-02-28T16:27:03.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.523+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec0052e0 con 0x7fb0100fda90 2024-02-28T16:27:03.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.524+0000 7fb006000700 1 -- 172.21.15.148:0/2465248374 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7fb000011400 con 0x7fb0100fda90 2024-02-28T16:27:03.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.525+0000 7fb006000700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7faff406b220 0x7faff406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:03.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.525+0000 7fb006000700 1 -- 172.21.15.148:0/2465248374 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb0000897e0 con 0x7fb0100fda90 2024-02-28T16:27:03.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.528+0000 7fb00d400700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7faff406b220 0x7faff406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:03.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.529+0000 7fb00d400700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7faff406b220 0x7faff406d6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faff800b020 tx=0x7faff8009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:03.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.531+0000 7fb006000700 1 -- 172.21.15.148:0/2465248374 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb000057600 con 0x7fb0100fda90 2024-02-28T16:27:03.582 INFO:tasks.workunit.client.1.smithi157.stdout:0/396: dread d1/d13/f54 [0,4194304] 0 2024-02-28T16:27:03.583 INFO:tasks.workunit.client.1.smithi157.stdout:3/376: creat d0/d6/d6b/f7a x:0 0 0 2024-02-28T16:27:03.585 INFO:tasks.workunit.client.1.smithi157.stdout:9/366: mknod d0/d19/d30/d79/c7c 0 2024-02-28T16:27:03.585 INFO:tasks.workunit.client.1.smithi157.stdout:2/454: rename da/d38 to da/d38/d5a/d79/d7b/d98 22 2024-02-28T16:27:03.587 INFO:tasks.workunit.client.1.smithi157.stdout:5/377: dwrite d0/fe [4194304,4194304] 0 2024-02-28T16:27:03.594 INFO:tasks.workunit.client.1.smithi157.stdout:2/455: creat da/d65/d90/f99 x:0 0 0 2024-02-28T16:27:03.594 INFO:tasks.workunit.client.1.smithi157.stdout:3/377: getdents d0/d6/d6b/d75 0 2024-02-28T16:27:03.596 INFO:tasks.workunit.client.1.smithi157.stdout:1/443: link d10/d11/d22/l48 d10/d11/d3a/d5c/d6c/d6f/l8f 0 2024-02-28T16:27:03.596 INFO:tasks.workunit.client.1.smithi157.stdout:0/397: creat d1/d13/f80 x:0 0 0 2024-02-28T16:27:03.598 INFO:tasks.workunit.client.1.smithi157.stdout:9/367: dread d0/d19/d30/f4c [0,4194304] 0 2024-02-28T16:27:03.599 INFO:tasks.workunit.client.1.smithi157.stdout:3/378: chown d0/d20/d23/f50 105705269 1 2024-02-28T16:27:03.601 INFO:tasks.workunit.client.1.smithi157.stdout:1/444: chown d10/d11/d3a/d5c/d6c/d7b/f1e 0 1 2024-02-28T16:27:03.607 INFO:tasks.workunit.client.1.smithi157.stdout:0/398: creat d1/d13/d52/d53/f81 x:0 0 0 2024-02-28T16:27:03.607 INFO:tasks.workunit.client.1.smithi157.stdout:5/378: getdents d0/d9/d1b 0 2024-02-28T16:27:03.611 INFO:tasks.workunit.client.1.smithi157.stdout:9/368: creat d0/d36/d37/f7d x:0 0 0 2024-02-28T16:27:03.614 INFO:tasks.workunit.client.1.smithi157.stdout:5/379: mkdir d0/d8/d7e 0 2024-02-28T16:27:03.614 INFO:tasks.workunit.client.1.smithi157.stdout:9/369: dread - d0/d36/f63 zero size 2024-02-28T16:27:03.616 INFO:tasks.workunit.client.1.smithi157.stdout:0/399: mknod d1/d13/d46/c82 0 2024-02-28T16:27:03.619 INFO:tasks.workunit.client.1.smithi157.stdout:3/379: creat d0/d20/f7b x:0 0 0 2024-02-28T16:27:03.621 INFO:tasks.workunit.client.1.smithi157.stdout:3/380: stat d0/d6/f11 0 2024-02-28T16:27:03.623 INFO:tasks.workunit.client.1.smithi157.stdout:2/456: dwrite da/f24 [0,4194304] 0 2024-02-28T16:27:03.627 INFO:tasks.workunit.client.1.smithi157.stdout:2/457: write da/d35/f54 [400281,46720] 0 2024-02-28T16:27:03.628 INFO:tasks.workunit.client.1.smithi157.stdout:1/445: truncate d10/f12 2616265 0 2024-02-28T16:27:03.631 INFO:tasks.workunit.client.1.smithi157.stdout:3/381: mkdir d0/d20/d23/d2b/d2e/d7c 0 2024-02-28T16:27:03.638 INFO:tasks.workunit.client.1.smithi157.stdout:1/446: mknod d10/d11/d31/d2a/c90 0 2024-02-28T16:27:03.640 INFO:tasks.workunit.client.1.smithi157.stdout:5/380: dwrite d0/d9/d47/f6d [0,4194304] 0 2024-02-28T16:27:03.644 INFO:tasks.workunit.client.1.smithi157.stdout:2/458: dread da/d38/d3e/f84 [0,4194304] 0 2024-02-28T16:27:03.647 INFO:tasks.workunit.client.1.smithi157.stdout:0/400: dwrite d1/d8/d33/f39 [0,4194304] 0 2024-02-28T16:27:03.648 INFO:tasks.workunit.client.1.smithi157.stdout:9/370: dwrite d0/d36/d37/d40/f62 [0,4194304] 0 2024-02-28T16:27:03.648 INFO:tasks.workunit.client.1.smithi157.stdout:3/382: rename d0/d6/d1e/d5b/f61 to d0/d20/d5c/f7d 0 2024-02-28T16:27:03.650 INFO:tasks.workunit.client.1.smithi157.stdout:0/401: chown d1/d13/d52/d53/f81 318777 1 2024-02-28T16:27:03.653 INFO:tasks.workunit.client.1.smithi157.stdout:5/381: mkdir d0/d30/d50/d7f 0 2024-02-28T16:27:03.654 INFO:tasks.workunit.client.1.smithi157.stdout:3/383: mkdir d0/d20/d23/d2b/d2e/d7e 0 2024-02-28T16:27:03.656 INFO:tasks.workunit.client.1.smithi157.stdout:9/371: creat d0/d19/d30/d78/f7e x:0 0 0 2024-02-28T16:27:03.656 INFO:tasks.workunit.client.1.smithi157.stdout:0/402: mkdir d1/d13/d52/d7b/d83 0 2024-02-28T16:27:03.657 INFO:tasks.workunit.client.1.smithi157.stdout:3/384: readlink d0/d6/d44/d48/l72 0 2024-02-28T16:27:03.658 INFO:tasks.workunit.client.1.smithi157.stdout:5/382: fsync d0/d9/d47/f56 0 2024-02-28T16:27:03.662 INFO:tasks.workunit.client.1.smithi157.stdout:9/372: unlink d0/c1d 0 2024-02-28T16:27:03.666 INFO:tasks.workunit.client.1.smithi157.stdout:3/385: rmdir d0/d6/d6b 39 2024-02-28T16:27:03.668 INFO:tasks.workunit.client.1.smithi157.stdout:5/383: read d0/d9/f42 [2959379,27868] 0 2024-02-28T16:27:03.670 INFO:tasks.workunit.client.1.smithi157.stdout:1/447: dwrite d10/d11/f8e [0,4194304] 0 2024-02-28T16:27:03.677 INFO:tasks.workunit.client.1.smithi157.stdout:2/459: dread da/d2b/f4f [4194304,4194304] 0 2024-02-28T16:27:03.678 INFO:tasks.workunit.client.1.smithi157.stdout:2/460: readlink da/d38/d5a/d79/l7d 0 2024-02-28T16:27:03.679 INFO:tasks.workunit.client.1.smithi157.stdout:5/384: creat d0/d9/d47/d78/f80 x:0 0 0 2024-02-28T16:27:03.680 INFO:tasks.workunit.client.1.smithi157.stdout:2/461: dread - da/d38/d4e/f93 zero size 2024-02-28T16:27:03.684 INFO:tasks.workunit.client.1.smithi157.stdout:0/403: dwrite d1/d8/d27/f3a [4194304,4194304] 0 2024-02-28T16:27:03.687 INFO:tasks.workunit.client.1.smithi157.stdout:1/448: rmdir d10/d11/d3a/d5c 39 2024-02-28T16:27:03.689 INFO:tasks.workunit.client.1.smithi157.stdout:2/462: mkdir da/d38/d7e/d9a 0 2024-02-28T16:27:03.694 INFO:tasks.workunit.client.1.smithi157.stdout:0/404: mknod d1/da/c84 0 2024-02-28T16:27:03.697 INFO:tasks.workunit.client.1.smithi157.stdout:3/386: dwrite d0/d20/d23/d2b/f31 [4194304,4194304] 0 2024-02-28T16:27:03.698 INFO:tasks.workunit.client.1.smithi157.stdout:0/405: truncate d1/d13/d61/f63 235418 0 2024-02-28T16:27:03.699 INFO:tasks.workunit.client.1.smithi157.stdout:2/463: mkdir da/d38/d3e/d9b 0 2024-02-28T16:27:03.699 INFO:tasks.workunit.client.1.smithi157.stdout:1/449: mkdir d10/d7a/d91 0 2024-02-28T16:27:03.702 INFO:tasks.workunit.client.1.smithi157.stdout:9/373: dread d0/d36/d37/d40/f44 [0,4194304] 0 2024-02-28T16:27:03.704 INFO:tasks.workunit.client.1.smithi157.stdout:1/450: readlink d10/d11/d3a/d5c/d6a/l77 0 2024-02-28T16:27:03.708 INFO:tasks.workunit.client.1.smithi157.stdout:2/464: read da/d35/f54 [245917,15703] 0 2024-02-28T16:27:03.708 INFO:tasks.workunit.client.1.smithi157.stdout:1/451: dread - d10/d11/d31/d7f/f81 zero size 2024-02-28T16:27:03.710 INFO:tasks.workunit.client.1.smithi157.stdout:4/420: sync 2024-02-28T16:27:03.710 INFO:tasks.workunit.client.1.smithi157.stdout:2/465: dread - da/d65/d90/f99 zero size 2024-02-28T16:27:03.712 INFO:tasks.workunit.client.1.smithi157.stdout:9/374: rename d0/d19/d30/c6f to d0/d36/d37/d4d/c7f 0 2024-02-28T16:27:03.714 INFO:tasks.workunit.client.1.smithi157.stdout:1/452: dread d10/d11/d22/f3f [0,4194304] 0 2024-02-28T16:27:03.715 INFO:tasks.workunit.client.1.smithi157.stdout:3/387: dread d0/d6/d1e/f1f [0,4194304] 0 2024-02-28T16:27:03.717 INFO:tasks.workunit.client.1.smithi157.stdout:0/406: getdents d1/d8 0 2024-02-28T16:27:03.718 INFO:tasks.workunit.client.1.smithi157.stdout:0/407: stat d1/d8/d33/f44 0 2024-02-28T16:27:03.723 INFO:tasks.workunit.client.1.smithi157.stdout:0/408: chown d1/d13/d52/l66 2006403645 1 2024-02-28T16:27:03.723 INFO:tasks.workunit.client.1.smithi157.stdout:4/421: dread d3/da/fd [0,4194304] 0 2024-02-28T16:27:03.723 INFO:tasks.workunit.client.1.smithi157.stdout:2/466: unlink da/f3b 0 2024-02-28T16:27:03.726 INFO:tasks.workunit.client.1.smithi157.stdout:5/385: dread d0/f34 [0,4194304] 0 2024-02-28T16:27:03.727 INFO:tasks.workunit.client.1.smithi157.stdout:0/409: creat d1/d13/d61/d64/f85 x:0 0 0 2024-02-28T16:27:03.735 INFO:tasks.workunit.client.1.smithi157.stdout:9/375: dwrite d0/d36/d37/d40/d4b/f6d [0,4194304] 0 2024-02-28T16:27:03.737 INFO:tasks.workunit.client.1.smithi157.stdout:2/467: symlink da/d8c/l9c 0 2024-02-28T16:27:03.741 INFO:tasks.workunit.client.1.smithi157.stdout:5/386: mknod d0/c81 0 2024-02-28T16:27:03.741 INFO:tasks.workunit.client.1.smithi157.stdout:0/410: write d1/d8/d33/f49 [2371569,50393] 0 2024-02-28T16:27:03.744 INFO:tasks.workunit.client.1.smithi157.stdout:2/468: fsync da/d65/d90/f88 0 2024-02-28T16:27:03.747 INFO:tasks.workunit.client.1.smithi157.stdout:9/376: symlink d0/d19/d30/l80 0 2024-02-28T16:27:03.752 INFO:tasks.workunit.client.1.smithi157.stdout:4/422: dwrite d3/da/d1f/d22/f8d [0,4194304] 0 2024-02-28T16:27:03.756 INFO:tasks.workunit.client.1.smithi157.stdout:2/469: rmdir da/d38/d3e 39 2024-02-28T16:27:03.761 INFO:tasks.workunit.client.1.smithi157.stdout:2/470: write da/d38/d4e/f93 [85224,110226] 0 2024-02-28T16:27:03.766 INFO:tasks.workunit.client.1.smithi157.stdout:4/423: symlink d3/da/d1f/d22/l91 0 2024-02-28T16:27:03.766 INFO:tasks.workunit.client.1.smithi157.stdout:5/387: dread d0/f2e [0,4194304] 0 2024-02-28T16:27:03.767 INFO:tasks.workunit.client.1.smithi157.stdout:1/453: write d10/d11/d3a/d5c/d6c/d7b/f26 [480145,117306] 0 2024-02-28T16:27:03.768 INFO:tasks.workunit.client.1.smithi157.stdout:8/364: sync 2024-02-28T16:27:03.768 INFO:tasks.workunit.client.1.smithi157.stdout:7/429: sync 2024-02-28T16:27:03.768 INFO:tasks.workunit.client.1.smithi157.stdout:6/399: sync 2024-02-28T16:27:03.770 INFO:tasks.workunit.client.1.smithi157.stdout:9/377: dread d0/d36/d37/d40/f44 [0,4194304] 0 2024-02-28T16:27:03.771 INFO:tasks.workunit.client.1.smithi157.stdout:4/424: rmdir d3/da/d48/d4a 39 2024-02-28T16:27:03.771 INFO:tasks.workunit.client.1.smithi157.stdout:5/388: write d0/d9/f48 [142289,66613] 0 2024-02-28T16:27:03.773 INFO:tasks.workunit.client.1.smithi157.stdout:3/388: truncate d0/d6/d6b/f73 2013076 0 2024-02-28T16:27:03.777 INFO:tasks.workunit.client.1.smithi157.stdout:8/365: dread d1/d5/d23/f68 [0,4194304] 0 2024-02-28T16:27:03.780 INFO:tasks.workunit.client.1.smithi157.stdout:9/378: write d0/d36/d37/f67 [888433,20347] 0 2024-02-28T16:27:03.780 INFO:tasks.workunit.client.1.smithi157.stdout:4/425: write d3/da/d37/d71/f73 [830368,26095] 0 2024-02-28T16:27:03.784 INFO:tasks.workunit.client.1.smithi157.stdout:7/430: mknod df/d1f/d24/c89 0 2024-02-28T16:27:03.785 INFO:tasks.workunit.client.1.smithi157.stdout:0/411: truncate d1/da/f58 3913897 0 2024-02-28T16:27:03.787 INFO:tasks.workunit.client.1.smithi157.stdout:2/471: truncate da/d2b/f4f 2354753 0 2024-02-28T16:27:03.788 INFO:tasks.workunit.client.1.smithi157.stdout:4/426: read d3/da/d1f/d22/f44 [991726,23837] 0 2024-02-28T16:27:03.789 INFO:tasks.workunit.client.1.smithi157.stdout:2/472: readlink da/l41 0 2024-02-28T16:27:03.789 INFO:tasks.workunit.client.1.smithi157.stdout:7/431: dread - df/d1f/d24/d38/f70 zero size 2024-02-28T16:27:03.790 INFO:tasks.workunit.client.1.smithi157.stdout:8/366: write d1/d5/d23/d53/f6c [120059,3702] 0 2024-02-28T16:27:03.792 INFO:tasks.workunit.client.1.smithi157.stdout:6/400: creat d2/d7/d8/da/d31/d37/d2b/f7a x:0 0 0 2024-02-28T16:27:03.792 INFO:tasks.workunit.client.1.smithi157.stdout:9/379: symlink d0/d19/d30/l81 0 2024-02-28T16:27:03.793 INFO:tasks.workunit.client.1.smithi157.stdout:5/389: mkdir d0/d8/d7e/d82 0 2024-02-28T16:27:03.796 INFO:tasks.workunit.client.1.smithi157.stdout:7/432: readlink df/d25/d4e/d67/l85 0 2024-02-28T16:27:03.797 INFO:tasks.workunit.client.1.smithi157.stdout:2/473: creat da/d38/d7e/d92/f9d x:0 0 0 2024-02-28T16:27:03.797 INFO:tasks.workunit.client.1.smithi157.stdout:1/454: dread d10/d11/d3a/d5c/d6c/d7b/f1e [0,4194304] 0 2024-02-28T16:27:03.804 INFO:tasks.workunit.client.1.smithi157.stdout:0/412: link d1/d13/fe d1/d13/d52/d53/f86 0 2024-02-28T16:27:03.808 INFO:tasks.workunit.client.1.smithi157.stdout:3/389: dwrite d0/d20/d23/d2b/d6d/f77 [0,4194304] 0 2024-02-28T16:27:03.814 INFO:tasks.workunit.client.1.smithi157.stdout:0/413: chown d1/d8/d27/l28 3721448 1 2024-02-28T16:27:03.816 INFO:tasks.workunit.client.1.smithi157.stdout:3/390: chown d0/d20/d23/d2b/c3b 1 1 2024-02-28T16:27:03.819 INFO:tasks.workunit.client.1.smithi157.stdout:8/367: getdents d1/d5/d4d 0 2024-02-28T16:27:03.829 INFO:tasks.workunit.client.1.smithi157.stdout:9/380: dwrite d0/d36/d3f/f6c [0,4194304] 0 2024-02-28T16:27:03.833 INFO:tasks.workunit.client.1.smithi157.stdout:8/368: chown d1/d5/l28 908906968 1 2024-02-28T16:27:03.833 INFO:tasks.workunit.client.1.smithi157.stdout:3/391: creat d0/d6/d44/d48/f7f x:0 0 0 2024-02-28T16:27:03.835 INFO:tasks.workunit.client.1.smithi157.stdout:6/401: dwrite d2/d7/de/d1b/f5d [0,4194304] 0 2024-02-28T16:27:03.842 INFO:tasks.workunit.client.1.smithi157.stdout:7/433: dwrite df/f31 [0,4194304] 0 2024-02-28T16:27:03.845 INFO:tasks.workunit.client.1.smithi157.stdout:3/392: readlink d0/d6/d44/d48/l72 0 2024-02-28T16:27:03.846 INFO:tasks.workunit.client.1.smithi157.stdout:8/369: chown d1/d5/d43 0 1 2024-02-28T16:27:03.847 INFO:tasks.workunit.client.1.smithi157.stdout:1/455: dwrite d10/d11/d31/d2a/f2d [0,4194304] 0 2024-02-28T16:27:03.850 INFO:tasks.workunit.client.1.smithi157.stdout:9/381: mknod d0/d36/d37/c82 0 2024-02-28T16:27:03.851 INFO:tasks.workunit.client.1.smithi157.stdout:3/393: chown d0/d6/d1e/d5b 784845 1 2024-02-28T16:27:03.852 INFO:tasks.workunit.client.1.smithi157.stdout:6/402: fsync d2/d7/d8/f56 0 2024-02-28T16:27:03.857 INFO:tasks.workunit.client.1.smithi157.stdout:2/474: dwrite da/f37 [0,4194304] 0 2024-02-28T16:27:03.858 INFO:tasks.workunit.client.1.smithi157.stdout:5/390: dread d0/d30/f5f [0,4194304] 0 2024-02-28T16:27:03.861 INFO:tasks.workunit.client.1.smithi157.stdout:2/475: fdatasync da/d38/f6f 0 2024-02-28T16:27:03.862 INFO:tasks.workunit.client.1.smithi157.stdout:7/434: creat df/d1f/f8a x:0 0 0 2024-02-28T16:27:03.864 INFO:tasks.workunit.client.1.smithi157.stdout:2/476: chown da/d47/d67/f7f 33070107 1 2024-02-28T16:27:03.864 INFO:tasks.workunit.client.1.smithi157.stdout:0/414: dwrite d1/d8/f45 [0,4194304] 0 2024-02-28T16:27:03.871 INFO:tasks.workunit.client.1.smithi157.stdout:0/415: stat d1/d13/d52 0 2024-02-28T16:27:03.871 INFO:tasks.workunit.client.1.smithi157.stdout:2/477: dread - da/d65/d90/f99 zero size 2024-02-28T16:27:03.873 INFO:tasks.workunit.client.1.smithi157.stdout:8/370: dread d1/d5/d43/f45 [0,4194304] 0 2024-02-28T16:27:03.874 INFO:tasks.workunit.client.1.smithi157.stdout:6/403: getdents d2/d7/de/d1b/d4d/d5b 0 2024-02-28T16:27:03.877 INFO:tasks.workunit.client.1.smithi157.stdout:2/478: write da/f5e [4238148,78789] 0 2024-02-28T16:27:03.879 INFO:tasks.workunit.client.1.smithi157.stdout:3/394: rename d0/d20 to d0/d6/d34/d80 0 2024-02-28T16:27:03.881 INFO:tasks.workunit.client.1.smithi157.stdout:6/404: chown d2/d7/de/d40/f47 139 1 2024-02-28T16:27:03.886 INFO:tasks.workunit.client.1.smithi157.stdout:8/371: rmdir d1/d5/d23/d38 39 2024-02-28T16:27:03.886 INFO:tasks.workunit.client.1.smithi157.stdout:1/456: dwrite d10/d11/d3a/d5c/f87 [0,4194304] 0 2024-02-28T16:27:03.889 INFO:tasks.workunit.client.1.smithi157.stdout:5/391: rename d0/d8/f2d to d0/d9/d47/d5c/f83 0 2024-02-28T16:27:03.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.900+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafec000bf0 con 0x7faff406b220 2024-02-28T16:27:03.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.902+0000 7fb006000700 1 -- 172.21.15.148:0/2465248374 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fafec000bf0 con 0x7faff406b220 2024-02-28T16:27:03.892 INFO:tasks.workunit.client.1.smithi157.stdout:1/457: write d10/d11/d3a/d5c/d6c/d7b/f4f [1040417,26961] 0 2024-02-28T16:27:03.893 INFO:tasks.workunit.client.1.smithi157.stdout:8/372: unlink d1/d5/d10/f22 0 2024-02-28T16:27:03.894 INFO:tasks.workunit.client.1.smithi157.stdout:6/405: read d2/d7/d8/da/d31/d3a/f2f [4075451,74811] 0 2024-02-28T16:27:03.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.905+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7faff406b220 msgr2=0x7faff406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.905+0000 7fb014a00700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7faff406b220 0x7faff406d6d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faff800b020 tx=0x7faff8009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.905+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0100fda90 msgr2=0x7fb0100fd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.905+0000 7fb014a00700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0100fda90 0x7fb0100fd520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb00000b790 tx=0x7fb000009250 comp rx=0 tx=0).stop 2024-02-28T16:27:03.895 INFO:tasks.workunit.client.1.smithi157.stdout:1/458: fsync d10/d11/d3a/d5c/d6c/d7b/f1e 0 2024-02-28T16:27:03.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.906+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 shutdown_connections 2024-02-28T16:27:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.906+0000 7fb014a00700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7faff406b220 0x7faff406d6d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.906+0000 7fb014a00700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0100fda90 0x7fb0100fd520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.906+0000 7fb014a00700 1 --2- 172.21.15.148:0/2465248374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0101003b0 0x7fb0100fb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.906+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 >> 172.21.15.148:0/2465248374 conn(0x7fb0100f7510 msgr2=0x7fb0100f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.906+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 shutdown_connections 2024-02-28T16:27:03.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:03.906+0000 7fb014a00700 1 -- 172.21.15.148:0/2465248374 wait complete. 2024-02-28T16:27:03.898 INFO:tasks.workunit.client.1.smithi157.stdout:9/382: write d0/d19/f25 [595352,122166] 0 2024-02-28T16:27:03.904 INFO:tasks.workunit.client.1.smithi157.stdout:2/479: creat da/d38/f9e x:0 0 0 2024-02-28T16:27:03.905 INFO:tasks.workunit.client.1.smithi157.stdout:7/435: write df/d1f/d24/f53 [957639,29938] 0 2024-02-28T16:27:03.914 INFO:tasks.workunit.client.1.smithi157.stdout:9/383: mknod d0/d36/d37/d4d/c83 0 2024-02-28T16:27:03.915 INFO:tasks.workunit.client.1.smithi157.stdout:0/416: write d1/d8/fc [4503937,118399] 0 2024-02-28T16:27:03.917 INFO:tasks.workunit.client.1.smithi157.stdout:7/436: mknod df/d80/d84/c8b 0 2024-02-28T16:27:03.918 INFO:tasks.workunit.client.1.smithi157.stdout:6/406: dwrite d2/d7/d8/da/d31/d37/d2d/f48 [0,4194304] 0 2024-02-28T16:27:03.919 INFO:tasks.workunit.client.1.smithi157.stdout:8/373: write d1/d5/d43/f45 [853446,53946] 0 2024-02-28T16:27:03.922 INFO:tasks.workunit.client.1.smithi157.stdout:9/384: write d0/d36/d37/d40/d4b/f6d [2371781,63701] 0 2024-02-28T16:27:03.924 INFO:tasks.workunit.client.1.smithi157.stdout:3/395: write d0/d6/d34/d80/d23/f66 [753182,98514] 0 2024-02-28T16:27:03.926 INFO:tasks.workunit.client.1.smithi157.stdout:1/459: truncate d10/d11/d3a/d5c/d6c/d7b/f5e 3012552 0 2024-02-28T16:27:03.930 INFO:tasks.workunit.client.1.smithi157.stdout:5/392: getdents d0/d8/d7e 0 2024-02-28T16:27:03.931 INFO:tasks.workunit.client.1.smithi157.stdout:2/480: dwrite da/d38/d5a/d79/d7b/f81 [0,4194304] 0 2024-02-28T16:27:03.935 INFO:tasks.workunit.client.1.smithi157.stdout:9/385: write d0/f12 [6968953,127836] 0 2024-02-28T16:27:03.936 INFO:tasks.workunit.client.1.smithi157.stdout:3/396: mkdir d0/d6/d34/d80/d23/d2b/d81 0 2024-02-28T16:27:03.940 INFO:tasks.workunit.client.1.smithi157.stdout:0/417: dwrite d1/d8/d27/f2b [0,4194304] 0 2024-02-28T16:27:03.940 INFO:tasks.workunit.client.1.smithi157.stdout:7/437: unlink c5 0 2024-02-28T16:27:03.942 INFO:tasks.workunit.client.1.smithi157.stdout:7/438: stat df/d1f/d24/d4f 0 2024-02-28T16:27:03.944 INFO:tasks.workunit.client.1.smithi157.stdout:2/481: rmdir da/d38 39 2024-02-28T16:27:03.951 INFO:tasks.workunit.client.1.smithi157.stdout:0/418: dread d1/d8/d27/d55/f5f [0,4194304] 0 2024-02-28T16:27:03.965 INFO:tasks.workunit.client.1.smithi157.stdout:7/439: creat df/d1f/d24/d39/f8c x:0 0 0 2024-02-28T16:27:03.966 INFO:tasks.workunit.client.1.smithi157.stdout:7/440: chown df/d1f/d24/d39/f5f 1102 1 2024-02-28T16:27:03.968 INFO:tasks.workunit.client.1.smithi157.stdout:7/441: write df/d1f/d24/d39/f58 [961508,126954] 0 2024-02-28T16:27:03.969 INFO:tasks.workunit.client.1.smithi157.stdout:4/427: sync 2024-02-28T16:27:03.972 INFO:tasks.workunit.client.1.smithi157.stdout:9/386: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:27:04.030 INFO:tasks.workunit.client.1.smithi157.stdout:8/374: creat d1/d5/d23/d38/d67/d6d/f7e x:0 0 0 2024-02-28T16:27:04.047 INFO:tasks.workunit.client.1.smithi157.stdout:8/375: dwrite d1/d5/d10/d74/f75 [0,4194304] 0 2024-02-28T16:27:04.049 INFO:tasks.workunit.client.1.smithi157.stdout:8/376: dread - d1/d5/d4d/d60/f77 zero size 2024-02-28T16:27:04.068 INFO:tasks.workunit.client.1.smithi157.stdout:1/460: truncate d10/d11/d31/f42 361517 0 2024-02-28T16:27:04.070 INFO:tasks.workunit.client.1.smithi157.stdout:1/461: readlink d10/d11/d3a/d5c/d6a/l77 0 2024-02-28T16:27:04.072 INFO:tasks.workunit.client.1.smithi157.stdout:7/442: symlink df/d1f/d37/l8d 0 2024-02-28T16:27:04.073 INFO:tasks.workunit.client.1.smithi157.stdout:1/462: read d10/f1b [2029409,45560] 0 2024-02-28T16:27:04.075 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:03 smithi157 ceph-mon[38346]: pgmap v56: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 72 MiB/s rd, 222 MiB/s wr, 463 op/s 2024-02-28T16:27:04.081 INFO:tasks.workunit.client.1.smithi157.stdout:4/428: mknod d3/da/d37/c92 0 2024-02-28T16:27:04.084 INFO:tasks.workunit.client.1.smithi157.stdout:6/407: getdents d2/d7/d8/da/d31/d37/d2d 0 2024-02-28T16:27:04.092 INFO:tasks.workunit.client.1.smithi157.stdout:1/463: dread d10/d11/d22/f62 [0,4194304] 0 2024-02-28T16:27:04.092 INFO:tasks.workunit.client.1.smithi157.stdout:9/387: chown d0/d19/d30/c65 965042 1 2024-02-28T16:27:04.096 INFO:tasks.workunit.client.1.smithi157.stdout:1/464: write d10/d11/d3a/f5f [482013,19326] 0 2024-02-28T16:27:04.097 INFO:tasks.workunit.client.1.smithi157.stdout:8/377: rmdir d1/d5/d14/d3e 39 2024-02-28T16:27:04.105 INFO:tasks.workunit.client.1.smithi157.stdout:9/388: dread d0/f5 [0,4194304] 0 2024-02-28T16:27:04.113 INFO:tasks.workunit.client.1.smithi157.stdout:4/429: fsync d3/d77/f65 0 2024-02-28T16:27:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.125+0000 7f8868600700 1 -- 172.21.15.148:0/1413545642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860072890 msgr2=0x7f8860072ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.125+0000 7f8868600700 1 --2- 172.21.15.148:0/1413545642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860072890 0x7f8860072ca0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8854004940 tx=0x7f8854009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.125+0000 7f8868600700 1 -- 172.21.15.148:0/1413545642 shutdown_connections 2024-02-28T16:27:04.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.125+0000 7f8868600700 1 --2- 172.21.15.148:0/1413545642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860073af0 0x7f8860073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.125+0000 7f8868600700 1 --2- 172.21.15.148:0/1413545642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860072890 0x7f8860072ca0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.125+0000 7f8868600700 1 -- 172.21.15.148:0/1413545642 >> 172.21.15.148:0/1413545642 conn(0x7f88600fa920 msgr2=0x7f88600fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:04.115 INFO:tasks.workunit.client.1.smithi157.stdout:4/430: chown d3/da/d1f/d22/f8d 35517663 1 2024-02-28T16:27:04.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.126+0000 7f8868600700 1 -- 172.21.15.148:0/1413545642 shutdown_connections 2024-02-28T16:27:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.126+0000 7f8868600700 1 -- 172.21.15.148:0/1413545642 wait complete. 2024-02-28T16:27:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.127+0000 7f8868600700 1 Processor -- start 2024-02-28T16:27:04.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.127+0000 7f8868600700 1 -- start start 2024-02-28T16:27:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.127+0000 7f8868600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860072890 0x7f8860113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.127+0000 7f8868600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860073af0 0x7f88601144c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.127+0000 7f8868600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860114ac0 con 0x7f8860073af0 2024-02-28T16:27:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.127+0000 7f8868600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860115360 con 0x7f8860072890 2024-02-28T16:27:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.128+0000 7f8865200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860073af0 0x7f88601144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:04.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.128+0000 7f8865c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860072890 0x7f8860113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.128+0000 7f8865c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860072890 0x7f8860113f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:47944/0 (socket says 172.21.15.148:47944) 2024-02-28T16:27:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.128+0000 7f8865c00700 1 -- 172.21.15.148:0/1036737425 learned_addr learned my addr 172.21.15.148:0/1036737425 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.129+0000 7f8865c00700 1 -- 172.21.15.148:0/1036737425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860073af0 msgr2=0x7f88601144c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.129+0000 7f8865c00700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860073af0 0x7f88601144c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.129+0000 7f8865c00700 1 -- 172.21.15.148:0/1036737425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854005040 con 0x7f8860072890 2024-02-28T16:27:04.118 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.129+0000 7f8865c00700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860072890 0x7f8860113f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88540093b0 tx=0x7f8854009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.129+0000 7f885d600700 1 -- 172.21.15.148:0/1036737425 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f885400e040 con 0x7f8860072890 2024-02-28T16:27:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.130+0000 7f885d600700 1 -- 172.21.15.148:0/1036737425 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f885400bcc0 con 0x7f8860072890 2024-02-28T16:27:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.130+0000 7f885d600700 1 -- 172.21.15.148:0/1036737425 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f885401c630 con 0x7f8860072890 2024-02-28T16:27:04.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.130+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88601155e0 con 0x7f8860072890 2024-02-28T16:27:04.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.130+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8860115b20 con 0x7f8860072890 2024-02-28T16:27:04.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.132+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886004bed0 con 0x7f8860072890 2024-02-28T16:27:04.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.133+0000 7f885d600700 1 -- 172.21.15.148:0/1036737425 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f88540139f0 con 0x7f8860072890 2024-02-28T16:27:04.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.134+0000 7f885d600700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f884806b1c0 0x7f884806d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:04.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.134+0000 7f885d600700 1 -- 172.21.15.148:0/1036737425 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f885408aef0 con 0x7f8860072890 2024-02-28T16:27:04.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.134+0000 7f8865200700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f884806b1c0 0x7f884806d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:04.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.135+0000 7f8865200700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f884806b1c0 0x7f884806d670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f884c007fd0 tx=0x7f884c009040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:04.126 INFO:tasks.workunit.client.1.smithi157.stdout:8/378: creat d1/d5/d23/d38/d67/d6d/f7f x:0 0 0 2024-02-28T16:27:04.127 INFO:tasks.workunit.client.1.smithi157.stdout:1/465: creat d10/d11/d3a/d5c/d6c/f92 x:0 0 0 2024-02-28T16:27:04.130 INFO:tasks.workunit.client.1.smithi157.stdout:8/379: write d1/d5/f70 [597390,110182] 0 2024-02-28T16:27:04.130 INFO:tasks.workunit.client.1.smithi157.stdout:5/393: getdents d0/d9/d47/d5b 0 2024-02-28T16:27:04.132 INFO:tasks.workunit.client.1.smithi157.stdout:3/397: getdents d0/d6 0 2024-02-28T16:27:04.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.144+0000 7f885d600700 1 -- 172.21.15.148:0/1036737425 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8854058c50 con 0x7f8860072890 2024-02-28T16:27:04.135 INFO:tasks.workunit.client.1.smithi157.stdout:8/380: write d1/d5/d23/d53/f6c [1027123,21650] 0 2024-02-28T16:27:04.135 INFO:tasks.workunit.client.1.smithi157.stdout:3/398: write d0/d6/d6b/f7a [921906,74035] 0 2024-02-28T16:27:04.138 INFO:tasks.workunit.client.1.smithi157.stdout:9/389: mknod d0/d36/d37/d40/d4b/c84 0 2024-02-28T16:27:04.138 INFO:tasks.workunit.client.1.smithi157.stdout:3/399: chown d0/d6/d34/d80/d5c/f5e 2135 1 2024-02-28T16:27:04.141 INFO:tasks.workunit.client.1.smithi157.stdout:2/482: creat da/d38/d5a/f9f x:0 0 0 2024-02-28T16:27:04.142 INFO:tasks.workunit.client.1.smithi157.stdout:2/483: write da/d47/f77 [244053,116094] 0 2024-02-28T16:27:04.144 INFO:tasks.workunit.client.1.smithi157.stdout:5/394: mknod d0/d8/d51/d61/c84 0 2024-02-28T16:27:04.151 INFO:tasks.workunit.client.1.smithi157.stdout:2/484: creat da/d2b/d59/fa0 x:0 0 0 2024-02-28T16:27:04.152 INFO:tasks.workunit.client.1.smithi157.stdout:8/381: fdatasync d1/d5/d14/f47 0 2024-02-28T16:27:04.153 INFO:tasks.workunit.client.1.smithi157.stdout:3/400: mknod d0/d6/d44/d70/d71/c82 0 2024-02-28T16:27:04.154 INFO:tasks.workunit.client.1.smithi157.stdout:8/382: fdatasync d1/d5/f70 0 2024-02-28T16:27:04.156 INFO:tasks.workunit.client.1.smithi157.stdout:3/401: write d0/d6/d34/d80/d23/f66 [762383,84715] 0 2024-02-28T16:27:04.159 INFO:tasks.workunit.client.1.smithi157.stdout:8/383: fdatasync d1/d5/d23/f68 0 2024-02-28T16:27:04.164 INFO:tasks.workunit.client.1.smithi157.stdout:3/402: mknod d0/d6/d1e/c83 0 2024-02-28T16:27:04.166 INFO:tasks.workunit.client.1.smithi157.stdout:5/395: link d0/d9/c28 d0/c85 0 2024-02-28T16:27:04.167 INFO:tasks.workunit.client.1.smithi157.stdout:5/396: chown d0/c81 15912744 1 2024-02-28T16:27:04.170 INFO:tasks.workunit.client.1.smithi157.stdout:3/403: truncate d0/d6/f17 1229020 0 2024-02-28T16:27:04.171 INFO:tasks.workunit.client.1.smithi157.stdout:8/384: getdents d1/d5/d4d/d60 0 2024-02-28T16:27:04.172 INFO:tasks.workunit.client.1.smithi157.stdout:2/485: dwrite da/d35/f54 [0,4194304] 0 2024-02-28T16:27:04.173 INFO:tasks.workunit.client.1.smithi157.stdout:5/397: creat d0/d9/f86 x:0 0 0 2024-02-28T16:27:04.175 INFO:tasks.workunit.client.1.smithi157.stdout:2/486: rmdir da/d38/d7e 39 2024-02-28T16:27:04.178 INFO:tasks.workunit.client.1.smithi157.stdout:2/487: dread - da/d47/d67/f7f zero size 2024-02-28T16:27:04.183 INFO:tasks.workunit.client.1.smithi157.stdout:5/398: creat d0/d8/d51/f87 x:0 0 0 2024-02-28T16:27:04.183 INFO:tasks.workunit.client.1.smithi157.stdout:4/431: creat d3/da/d48/f93 x:0 0 0 2024-02-28T16:27:04.190 INFO:tasks.workunit.client.1.smithi157.stdout:5/399: mknod d0/d9/d47/c88 0 2024-02-28T16:27:04.192 INFO:tasks.workunit.client.1.smithi157.stdout:4/432: mknod d3/da/d37/d84/c94 0 2024-02-28T16:27:04.195 INFO:tasks.workunit.client.1.smithi157.stdout:2/488: dwrite da/d65/d90/f88 [0,4194304] 0 2024-02-28T16:27:04.197 INFO:tasks.workunit.client.1.smithi157.stdout:2/489: read - da/d65/f8d zero size 2024-02-28T16:27:04.214 INFO:tasks.workunit.client.1.smithi157.stdout:2/490: dwrite da/d65/d90/f53 [0,4194304] 0 2024-02-28T16:27:04.215 INFO:tasks.workunit.client.1.smithi157.stdout:2/491: stat da/d35/f54 0 2024-02-28T16:27:04.219 INFO:tasks.workunit.client.1.smithi157.stdout:0/419: rename d1/d13/d52/d53/f86 to d1/d13/f87 0 2024-02-28T16:27:04.219 INFO:tasks.workunit.client.1.smithi157.stdout:6/408: rename d2 to d2/d7/d8/da/d31/d3a/d7b 22 2024-02-28T16:27:04.236 INFO:tasks.workunit.client.1.smithi157.stdout:4/433: dread d3/da/d1f/d22/f7a [0,4194304] 0 2024-02-28T16:27:04.237 INFO:tasks.workunit.client.1.smithi157.stdout:0/420: dwrite d1/d8/f1d [0,4194304] 0 2024-02-28T16:27:04.238 INFO:tasks.workunit.client.1.smithi157.stdout:2/492: dread da/f46 [0,4194304] 0 2024-02-28T16:27:04.239 INFO:tasks.workunit.client.1.smithi157.stdout:6/409: dwrite d2/d17/f25 [0,4194304] 0 2024-02-28T16:27:04.249 INFO:tasks.workunit.client.1.smithi157.stdout:2/493: creat da/d38/d5a/d79/fa1 x:0 0 0 2024-02-28T16:27:04.249 INFO:tasks.workunit.client.1.smithi157.stdout:2/494: stat da/f1f 0 2024-02-28T16:27:04.250 INFO:tasks.workunit.client.1.smithi157.stdout:0/421: symlink d1/d13/l88 0 2024-02-28T16:27:04.257 INFO:tasks.workunit.client.1.smithi157.stdout:6/410: dwrite d2/d17/f25 [4194304,4194304] 0 2024-02-28T16:27:04.258 INFO:tasks.workunit.client.1.smithi157.stdout:2/495: mknod da/d2b/d59/ca2 0 2024-02-28T16:27:04.260 INFO:tasks.workunit.client.1.smithi157.stdout:6/411: chown d2/d7/de/d1b/c75 7956675 1 2024-02-28T16:27:04.261 INFO:tasks.workunit.client.1.smithi157.stdout:2/496: write da/d65/d90/f53 [294107,94637] 0 2024-02-28T16:27:04.266 INFO:tasks.workunit.client.1.smithi157.stdout:0/422: dwrite d1/d8/f1d [0,4194304] 0 2024-02-28T16:27:04.268 INFO:tasks.workunit.client.1.smithi157.stdout:2/497: rename da/d47/d67 to da/d38/d3e/d9b/da3 0 2024-02-28T16:27:04.270 INFO:tasks.workunit.client.1.smithi157.stdout:6/412: read d2/d7/d8/d78/f3e [1264029,116160] 0 2024-02-28T16:27:04.271 INFO:tasks.workunit.client.1.smithi157.stdout:0/423: symlink d1/d13/d46/l89 0 2024-02-28T16:27:04.285 INFO:tasks.workunit.client.1.smithi157.stdout:0/424: dread d1/d8/d33/f39 [0,4194304] 0 2024-02-28T16:27:04.287 INFO:tasks.workunit.client.1.smithi157.stdout:6/413: rmdir d2/d7/de/d1b/d4d/d5b 0 2024-02-28T16:27:04.290 INFO:tasks.workunit.client.1.smithi157.stdout:2/498: getdents da/d38/d5a/d79/d7b 0 2024-02-28T16:27:04.291 INFO:tasks.workunit.client.1.smithi157.stdout:0/425: symlink d1/d13/d46/l8a 0 2024-02-28T16:27:04.295 INFO:tasks.workunit.client.1.smithi157.stdout:0/426: mknod d1/da/d6c/c8b 0 2024-02-28T16:27:04.296 INFO:tasks.workunit.client.1.smithi157.stdout:6/414: creat d2/d7/d8/da/d31/d37/d2d/d53/d69/f7c x:0 0 0 2024-02-28T16:27:04.296 INFO:tasks.workunit.client.1.smithi157.stdout:0/427: write d1/d13/f3e [2087187,99478] 0 2024-02-28T16:27:04.310 INFO:tasks.workunit.client.1.smithi157.stdout:0/428: dwrite d1/d8/f59 [0,4194304] 0 2024-02-28T16:27:04.315 INFO:tasks.workunit.client.1.smithi157.stdout:0/429: symlink d1/d13/d52/d53/l8c 0 2024-02-28T16:27:04.315 INFO:tasks.workunit.client.1.smithi157.stdout:2/499: dread da/d38/f89 [0,4194304] 0 2024-02-28T16:27:04.320 INFO:tasks.workunit.client.1.smithi157.stdout:0/430: symlink d1/d8/d33/d56/l8d 0 2024-02-28T16:27:04.321 INFO:tasks.workunit.client.1.smithi157.stdout:3/404: truncate d0/d6/d6b/f7a 852736 0 2024-02-28T16:27:04.323 INFO:tasks.workunit.client.1.smithi157.stdout:2/500: rename da/d38/c7c to da/d38/d5a/d5c/ca4 0 2024-02-28T16:27:04.325 INFO:tasks.workunit.client.1.smithi157.stdout:2/501: fdatasync da/d65/d90/f43 0 2024-02-28T16:27:04.326 INFO:tasks.workunit.client.1.smithi157.stdout:3/405: unlink d0/d6/fb 0 2024-02-28T16:27:04.327 INFO:tasks.workunit.client.1.smithi157.stdout:8/385: dwrite d1/d5/d10/f35 [0,4194304] 0 2024-02-28T16:27:04.330 INFO:tasks.workunit.client.1.smithi157.stdout:0/431: mkdir d1/d13/d61/d8e 0 2024-02-28T16:27:04.331 INFO:tasks.workunit.client.1.smithi157.stdout:5/400: rmdir d0/d9/d47 39 2024-02-28T16:27:04.336 INFO:tasks.workunit.client.1.smithi157.stdout:5/401: read d0/f5a [369164,35810] 0 2024-02-28T16:27:04.336 INFO:tasks.workunit.client.1.smithi157.stdout:2/502: symlink da/d38/d3e/d9b/la5 0 2024-02-28T16:27:04.337 INFO:tasks.workunit.client.1.smithi157.stdout:3/406: chown d0/f4d 2984199 1 2024-02-28T16:27:04.338 INFO:tasks.workunit.client.1.smithi157.stdout:4/434: getdents d3/da/d37/d84 0 2024-02-28T16:27:04.339 INFO:tasks.workunit.client.1.smithi157.stdout:0/432: mknod d1/d8/d33/d56/c8f 0 2024-02-28T16:27:04.342 INFO:tasks.workunit.client.1.smithi157.stdout:2/503: symlink da/d38/d5a/la6 0 2024-02-28T16:27:04.344 INFO:tasks.workunit.client.1.smithi157.stdout:2/504: readlink da/l1c 0 2024-02-28T16:27:04.346 INFO:tasks.workunit.client.1.smithi157.stdout:0/433: write d1/d13/f54 [1671138,6935] 0 2024-02-28T16:27:04.347 INFO:tasks.workunit.client.1.smithi157.stdout:5/402: rename d0/d9/d47/d5c to d0/d9/d47/d5b/d89 0 2024-02-28T16:27:04.348 INFO:tasks.workunit.client.1.smithi157.stdout:8/386: dwrite d1/d5/d23/d38/d67/d6d/f7e [0,4194304] 0 2024-02-28T16:27:04.349 INFO:tasks.workunit.client.1.smithi157.stdout:5/403: dread - d0/d9/f79 zero size 2024-02-28T16:27:04.352 INFO:tasks.workunit.client.1.smithi157.stdout:0/434: read d1/da/f58 [17865,3063] 0 2024-02-28T16:27:04.353 INFO:tasks.workunit.client.1.smithi157.stdout:5/404: truncate d0/d30/d50/f63 40727 0 2024-02-28T16:27:04.354 INFO:tasks.workunit.client.1.smithi157.stdout:7/443: rmdir df/d1f/d37 39 2024-02-28T16:27:04.354 INFO:tasks.workunit.client.1.smithi157.stdout:7/444: fdatasync f3 0 2024-02-28T16:27:04.357 INFO:tasks.workunit.client.1.smithi157.stdout:4/435: dwrite d3/da/d1f/f6d [0,4194304] 0 2024-02-28T16:27:04.361 INFO:tasks.workunit.client.1.smithi157.stdout:8/387: symlink d1/d5/d4d/d60/l80 0 2024-02-28T16:27:04.361 INFO:tasks.workunit.client.1.smithi157.stdout:0/435: mknod d1/da/d6c/c90 0 2024-02-28T16:27:04.366 INFO:tasks.workunit.client.1.smithi157.stdout:7/445: chown df/d1f/d37/l50 2218 1 2024-02-28T16:27:04.367 INFO:tasks.workunit.client.1.smithi157.stdout:4/436: dread d3/da/d1f/f67 [0,4194304] 0 2024-02-28T16:27:04.369 INFO:tasks.workunit.client.1.smithi157.stdout:5/405: truncate d0/f34 4042143 0 2024-02-28T16:27:04.369 INFO:tasks.workunit.client.1.smithi157.stdout:4/437: write d3/f33 [3872418,10828] 0 2024-02-28T16:27:04.371 INFO:tasks.workunit.client.1.smithi157.stdout:4/438: chown d3/da/d1f/c4e 43869230 1 2024-02-28T16:27:04.373 INFO:tasks.workunit.client.1.smithi157.stdout:0/436: unlink d1/d13/d46/l89 0 2024-02-28T16:27:04.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:03 smithi148 ceph-mon[28767]: pgmap v56: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 72 MiB/s rd, 222 MiB/s wr, 463 op/s 2024-02-28T16:27:04.374 INFO:tasks.workunit.client.1.smithi157.stdout:0/437: readlink d1/d13/l4d 0 2024-02-28T16:27:04.374 INFO:tasks.workunit.client.1.smithi157.stdout:4/439: truncate d3/da/d28/f5b 855575 0 2024-02-28T16:27:04.376 INFO:tasks.workunit.client.1.smithi157.stdout:7/446: dread df/d1f/f7e [0,4194304] 0 2024-02-28T16:27:04.378 INFO:tasks.workunit.client.1.smithi157.stdout:7/447: dread - df/d1f/d24/d38/f62 zero size 2024-02-28T16:27:04.384 INFO:tasks.workunit.client.1.smithi157.stdout:8/388: rename d1/d5/d14/l2f to d1/d5/d23/d38/d6e/l81 0 2024-02-28T16:27:04.385 INFO:tasks.workunit.client.1.smithi157.stdout:8/389: readlink d1/d5/d43/l63 0 2024-02-28T16:27:04.387 INFO:tasks.workunit.client.1.smithi157.stdout:0/438: symlink d1/d13/d61/d64/l91 0 2024-02-28T16:27:04.389 INFO:tasks.workunit.client.1.smithi157.stdout:7/448: mknod df/d1f/d24/d4f/c8e 0 2024-02-28T16:27:04.396 INFO:tasks.workunit.client.1.smithi157.stdout:4/440: creat d3/da/d48/d8e/f95 x:0 0 0 2024-02-28T16:27:04.396 INFO:tasks.workunit.client.1.smithi157.stdout:8/390: truncate d1/d5/d14/d3e/d52/d54/f7b 2748 0 2024-02-28T16:27:04.398 INFO:tasks.workunit.client.1.smithi157.stdout:8/391: readlink d1/d5/d43/d66/l7a 0 2024-02-28T16:27:04.398 INFO:tasks.workunit.client.1.smithi157.stdout:0/439: symlink d1/d13/d61/l92 0 2024-02-28T16:27:04.402 INFO:tasks.workunit.client.1.smithi157.stdout:7/449: dwrite f8 [4194304,4194304] 0 2024-02-28T16:27:04.405 INFO:tasks.workunit.client.1.smithi157.stdout:4/441: dread d3/da/f5e [4194304,4194304] 0 2024-02-28T16:27:04.407 INFO:tasks.workunit.client.1.smithi157.stdout:4/442: write d3/da/d28/f76 [907897,78905] 0 2024-02-28T16:27:04.411 INFO:tasks.workunit.client.1.smithi157.stdout:8/392: mknod d1/d5/d14/d3e/c82 0 2024-02-28T16:27:04.413 INFO:tasks.workunit.client.1.smithi157.stdout:7/450: creat df/d25/d79/f8f x:0 0 0 2024-02-28T16:27:04.416 INFO:tasks.workunit.client.1.smithi157.stdout:5/406: getdents d0/d8/d51/d61 0 2024-02-28T16:27:04.417 INFO:tasks.workunit.client.1.smithi157.stdout:0/440: dwrite d1/d13/f48 [0,4194304] 0 2024-02-28T16:27:04.422 INFO:tasks.workunit.client.1.smithi157.stdout:0/441: truncate d1/d8/d33/d56/f75 507491 0 2024-02-28T16:27:04.422 INFO:tasks.workunit.client.1.smithi157.stdout:0/442: readlink d1/l60 0 2024-02-28T16:27:04.434 INFO:tasks.workunit.client.1.smithi157.stdout:7/451: dwrite df/d25/f2a [0,4194304] 0 2024-02-28T16:27:04.438 INFO:tasks.workunit.client.1.smithi157.stdout:3/407: mknod d0/d6/d1e/c84 0 2024-02-28T16:27:04.443 INFO:tasks.workunit.client.1.smithi157.stdout:7/452: chown df/d25/d4e/c6a 1258497882 1 2024-02-28T16:27:04.444 INFO:tasks.workunit.client.1.smithi157.stdout:4/443: dwrite d3/da/d1f/d22/f3d [0,4194304] 0 2024-02-28T16:27:04.444 INFO:tasks.workunit.client.1.smithi157.stdout:8/393: link d1/c59 d1/d5/d23/d38/d67/c83 0 2024-02-28T16:27:04.444 INFO:tasks.workunit.client.1.smithi157.stdout:0/443: dwrite d1/d8/f1d [0,4194304] 0 2024-02-28T16:27:04.451 INFO:tasks.workunit.client.1.smithi157.stdout:8/394: readlink d1/d5/d23/l30 0 2024-02-28T16:27:04.452 INFO:tasks.workunit.client.1.smithi157.stdout:5/407: link d0/d9/d1b/d36/l17 d0/l8a 0 2024-02-28T16:27:04.455 INFO:tasks.workunit.client.1.smithi157.stdout:2/505: dwrite da/d2b/f3d [0,4194304] 0 2024-02-28T16:27:04.457 INFO:tasks.workunit.client.1.smithi157.stdout:7/453: creat df/d4b/d4c/f90 x:0 0 0 2024-02-28T16:27:04.458 INFO:tasks.workunit.client.1.smithi157.stdout:3/408: dread d0/d6/d34/d80/d23/d2b/d2e/f54 [0,4194304] 0 2024-02-28T16:27:04.458 INFO:tasks.workunit.client.1.smithi157.stdout:0/444: write d1/d8/f59 [2799492,125071] 0 2024-02-28T16:27:04.460 INFO:tasks.workunit.client.1.smithi157.stdout:5/408: mknod d0/d9/d47/d5b/d89/c8b 0 2024-02-28T16:27:04.469 INFO:tasks.workunit.client.1.smithi157.stdout:2/506: rename da/d65/d90/c52 to da/d47/ca7 0 2024-02-28T16:27:04.473 INFO:tasks.workunit.client.1.smithi157.stdout:1/466: sync 2024-02-28T16:27:04.473 INFO:tasks.workunit.client.1.smithi157.stdout:9/390: sync 2024-02-28T16:27:04.479 INFO:tasks.workunit.client.1.smithi157.stdout:8/395: dwrite d1/f3c [0,4194304] 0 2024-02-28T16:27:04.481 INFO:tasks.workunit.client.1.smithi157.stdout:4/444: dwrite d3/da/d28/f5a [0,4194304] 0 2024-02-28T16:27:04.484 INFO:tasks.workunit.client.1.smithi157.stdout:5/409: link d0/d8/f77 d0/d30/d50/d7f/f8c 0 2024-02-28T16:27:04.485 INFO:tasks.workunit.client.1.smithi157.stdout:2/507: dwrite da/f37 [0,4194304] 0 2024-02-28T16:27:04.486 INFO:tasks.workunit.client.1.smithi157.stdout:0/445: rename d1/da/d6c/c90 to d1/d13/c93 0 2024-02-28T16:27:04.487 INFO:tasks.workunit.client.1.smithi157.stdout:2/508: chown da/f5e 12009558 1 2024-02-28T16:27:04.489 INFO:tasks.workunit.client.1.smithi157.stdout:1/467: creat d10/d7a/d91/f93 x:0 0 0 2024-02-28T16:27:04.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.503+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f886010ab80 con 0x7f884806b1c0 2024-02-28T16:27:04.495 INFO:tasks.workunit.client.1.smithi157.stdout:4/445: write d3/d77/f55 [410839,57217] 0 2024-02-28T16:27:04.497 INFO:tasks.workunit.client.1.smithi157.stdout:7/454: rename f3 to df/d4b/f91 0 2024-02-28T16:27:04.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.521+0000 7f885d600700 1 -- 172.21.15.148:0/1036737425 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f886010ab80 con 0x7f884806b1c0 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 starting - - - - 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (12m) 92s ago 12m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (11m) 96s ago 11m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 starting - - - - 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (4m) 92s ago 4m 11.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (4m) 92s ago 4m 109M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (4m) 96s ago 4m 11.8M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (4m) 96s ago 4m 11.9M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:9283 running (14m) 92s ago 14m 319M - 17.2.7-535-gc0f02e60 1c37ed371348 0efadaac859c 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (2m) 96s ago 10m 490M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1ed96a6b633e 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (14m) 92s ago 14m 46.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (10m) 96s ago 10m 37.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:27:04.512 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 starting - - - - 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (10m) 96s ago 10m 7944k - 1.5.0 0da6a335fe13 e10955ca2cb2 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (9m) 92s ago 9m 76.1M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (8m) 92s ago 8m 67.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (8m) 92s ago 8m 65.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (7m) 96s ago 7m 71.0M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (7m) 96s ago 7m 71.1M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (6m) 96s ago 6m 62.7M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 starting - - - - 2024-02-28T16:27:04.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.524+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f884806b1c0 msgr2=0x7f884806d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.524+0000 7f8868600700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f884806b1c0 0x7f884806d670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f884c007fd0 tx=0x7f884c009040 comp rx=0 tx=0).stop 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.524+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860072890 msgr2=0x7f8860113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.524+0000 7f8868600700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860072890 0x7f8860113f80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88540093b0 tx=0x7f8854009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.525+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 shutdown_connections 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.525+0000 7f8868600700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f884806b1c0 0x7f884806d670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.525+0000 7f8868600700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8860072890 0x7f8860113f80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.525+0000 7f8868600700 1 --2- 172.21.15.148:0/1036737425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8860073af0 0x7f88601144c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.525+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 >> 172.21.15.148:0/1036737425 conn(0x7f88600fa920 msgr2=0x7f8860109460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:04.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.525+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 shutdown_connections 2024-02-28T16:27:04.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.525+0000 7f8868600700 1 -- 172.21.15.148:0/1036737425 wait complete. 2024-02-28T16:27:04.593 INFO:tasks.workunit.client.1.smithi157.stdout:1/468: mkdir d10/d94 0 2024-02-28T16:27:04.600 INFO:tasks.workunit.client.1.smithi157.stdout:5/410: dwrite d0/d9/d47/f4d [0,4194304] 0 2024-02-28T16:27:04.617 INFO:tasks.workunit.client.1.smithi157.stdout:1/469: truncate f2 2087148 0 2024-02-28T16:27:04.624 INFO:tasks.workunit.client.1.smithi157.stdout:4/446: dwrite d3/da/d48/f66 [0,4194304] 0 2024-02-28T16:27:04.637 INFO:tasks.workunit.client.1.smithi157.stdout:2/509: dwrite da/d2b/d59/f64 [0,4194304] 0 2024-02-28T16:27:04.638 INFO:tasks.workunit.client.1.smithi157.stdout:7/455: dwrite df/d1f/d24/d39/f8c [0,4194304] 0 2024-02-28T16:27:04.642 INFO:tasks.workunit.client.1.smithi157.stdout:8/396: dread d1/d5/d14/f2d [0,4194304] 0 2024-02-28T16:27:04.642 INFO:tasks.workunit.client.1.smithi157.stdout:1/470: mkdir d10/d11/d3a/d95 0 2024-02-28T16:27:04.642 INFO:tasks.workunit.client.1.smithi157.stdout:9/391: dwrite d0/d19/d30/f4c [0,4194304] 0 2024-02-28T16:27:04.644 INFO:tasks.workunit.client.1.smithi157.stdout:4/447: chown d3/da/d1f/d22/c8c 612 1 2024-02-28T16:27:04.647 INFO:tasks.workunit.client.1.smithi157.stdout:6/415: sync 2024-02-28T16:27:04.647 INFO:tasks.workunit.client.1.smithi157.stdout:5/411: link d0/d9/d47/d78/f7c d0/d30/d50/d7f/f8d 0 2024-02-28T16:27:04.650 INFO:tasks.workunit.client.1.smithi157.stdout:8/397: rename d1/f64 to d1/d5/d14/d3e/f84 0 2024-02-28T16:27:04.659 INFO:tasks.workunit.client.1.smithi157.stdout:2/510: dread da/f46 [0,4194304] 0 2024-02-28T16:27:04.665 INFO:tasks.workunit.client.1.smithi157.stdout:7/456: dwrite fd [0,4194304] 0 2024-02-28T16:27:04.666 INFO:tasks.workunit.client.1.smithi157.stdout:2/511: write da/d38/d5a/d69/f95 [224768,28953] 0 2024-02-28T16:27:04.667 INFO:tasks.workunit.client.1.smithi157.stdout:7/457: readlink df/d1f/l2e 0 2024-02-28T16:27:04.667 INFO:tasks.workunit.client.1.smithi157.stdout:2/512: readlink da/d2b/d59/l70 0 2024-02-28T16:27:04.668 INFO:tasks.workunit.client.1.smithi157.stdout:6/416: creat d2/d7/d8/da/d31/d37/d2d/d53/d69/f7d x:0 0 0 2024-02-28T16:27:04.671 INFO:tasks.workunit.client.1.smithi157.stdout:4/448: write d3/da/d1f/d22/f7a [3120413,47163] 0 2024-02-28T16:27:04.674 INFO:tasks.workunit.client.1.smithi157.stdout:2/513: truncate da/d2b/d59/fa0 941938 0 2024-02-28T16:27:04.674 INFO:tasks.workunit.client.1.smithi157.stdout:5/412: truncate d0/f34 3043017 0 2024-02-28T16:27:04.677 INFO:tasks.workunit.client.1.smithi157.stdout:4/449: read d3/da/d28/f76 [18159,53533] 0 2024-02-28T16:27:04.678 INFO:tasks.workunit.client.1.smithi157.stdout:7/458: dread df/d1f/d24/d38/f6d [0,4194304] 0 2024-02-28T16:27:04.678 INFO:tasks.workunit.client.1.smithi157.stdout:1/471: dread d10/d11/d3a/d5c/d6c/d6f/f83 [0,4194304] 0 2024-02-28T16:27:04.678 INFO:tasks.workunit.client.1.smithi157.stdout:2/514: write da/d35/f8b [2643337,69110] 0 2024-02-28T16:27:04.678 INFO:tasks.workunit.client.1.smithi157.stdout:9/392: link d0/c2a d0/d36/c85 0 2024-02-28T16:27:04.682 INFO:tasks.workunit.client.1.smithi157.stdout:6/417: symlink d2/d7/d8/da/d31/d59/l7e 0 2024-02-28T16:27:04.682 INFO:tasks.workunit.client.1.smithi157.stdout:7/459: chown df/d1f/d24/d38/f6d 695363264 1 2024-02-28T16:27:04.684 INFO:tasks.workunit.client.1.smithi157.stdout:2/515: read da/d38/d5a/d69/f95 [33563,53270] 0 2024-02-28T16:27:04.685 INFO:tasks.workunit.client.1.smithi157.stdout:6/418: fsync d2/d7/d8/d78/f73 0 2024-02-28T16:27:04.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.707+0000 7f4e77600700 1 -- 172.21.15.148:0/1884902874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 msgr2=0x7f4e70070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:04.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.707+0000 7f4e77600700 1 --2- 172.21.15.148:0/1884902874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70070320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4e64004940 tx=0x7f4e64009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:04.697 INFO:tasks.workunit.client.1.smithi157.stdout:7/460: creat df/d25/d4e/d67/f92 x:0 0 0 2024-02-28T16:27:04.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.708+0000 7f4e77600700 1 -- 172.21.15.148:0/1884902874 shutdown_connections 2024-02-28T16:27:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.708+0000 7f4e77600700 1 --2- 172.21.15.148:0/1884902874 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e70070860 0x7f4e70070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.708+0000 7f4e77600700 1 --2- 172.21.15.148:0/1884902874 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70070320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.708+0000 7f4e77600700 1 -- 172.21.15.148:0/1884902874 >> 172.21.15.148:0/1884902874 conn(0x7f4e700f8620 msgr2=0x7f4e700faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.708+0000 7f4e77600700 1 -- 172.21.15.148:0/1884902874 shutdown_connections 2024-02-28T16:27:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.708+0000 7f4e77600700 1 -- 172.21.15.148:0/1884902874 wait complete. 2024-02-28T16:27:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.709+0000 7f4e77600700 1 Processor -- start 2024-02-28T16:27:04.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.709+0000 7f4e77600700 1 -- start start 2024-02-28T16:27:04.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e77600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e70070860 0x7f4e7010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:04.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e77600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:04.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e77600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70110680 con 0x7f4e70071eb0 2024-02-28T16:27:04.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e77600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70110f20 con 0x7f4e70070860 2024-02-28T16:27:04.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e6fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:04.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e6fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52514/0 (socket says 172.21.15.148:52514) 2024-02-28T16:27:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e6fe00700 1 -- 172.21.15.148:0/3563768017 learned_addr learned my addr 172.21.15.148:0/3563768017 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e74c00700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e70070860 0x7f4e7010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e6fe00700 1 -- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e70070860 msgr2=0x7f4e7010fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.710+0000 7f4e6fe00700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e70070860 0x7f4e7010fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:04.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.711+0000 7f4e6fe00700 1 -- 172.21.15.148:0/3563768017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64005040 con 0x7f4e70071eb0 2024-02-28T16:27:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.711+0000 7f4e6fe00700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70110080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c002a50 tx=0x7f4e5c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.711+0000 7f4e6cc00700 1 -- 172.21.15.148:0/3563768017 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e5c007cc0 con 0x7f4e70071eb0 2024-02-28T16:27:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.711+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e70111200 con 0x7f4e70071eb0 2024-02-28T16:27:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.712+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e70111740 con 0x7f4e70071eb0 2024-02-28T16:27:04.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.712+0000 7f4e6cc00700 1 -- 172.21.15.148:0/3563768017 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e5c00f040 con 0x7f4e70071eb0 2024-02-28T16:27:04.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.712+0000 7f4e6cc00700 1 -- 172.21.15.148:0/3563768017 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e5c00da00 con 0x7f4e70071eb0 2024-02-28T16:27:04.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.714+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e500052e0 con 0x7f4e70071eb0 2024-02-28T16:27:04.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.716+0000 7f4e6cc00700 1 -- 172.21.15.148:0/3563768017 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f4e5c00db60 con 0x7f4e70071eb0 2024-02-28T16:27:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.717+0000 7f4e6cc00700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f4e5806b2a0 0x7f4e5806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:04.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.717+0000 7f4e6cc00700 1 -- 172.21.15.148:0/3563768017 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4e5c0897d0 con 0x7f4e70071eb0 2024-02-28T16:27:04.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.717+0000 7f4e74c00700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f4e5806b2a0 0x7f4e5806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:04.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.719+0000 7f4e74c00700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f4e5806b2a0 0x7f4e5806d750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400b7a0 tx=0x7f4e64009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:04.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:04.721+0000 7f4e6cc00700 1 -- 172.21.15.148:0/3563768017 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f4e5c0576e0 con 0x7f4e70071eb0 2024-02-28T16:27:04.731 INFO:tasks.workunit.client.1.smithi157.stdout:2/516: mknod da/d38/d4e/ca8 0 2024-02-28T16:27:04.735 INFO:tasks.workunit.client.1.smithi157.stdout:1/472: write d10/d11/d31/f3d [1544295,2581] 0 2024-02-28T16:27:04.736 INFO:tasks.workunit.client.1.smithi157.stdout:7/461: chown df/d25/c36 870 1 2024-02-28T16:27:04.737 INFO:tasks.workunit.client.1.smithi157.stdout:2/517: write da/d38/f6f [2726027,74720] 0 2024-02-28T16:27:04.742 INFO:tasks.workunit.client.1.smithi157.stdout:9/393: creat d0/d36/f86 x:0 0 0 2024-02-28T16:27:04.744 INFO:tasks.workunit.client.1.smithi157.stdout:1/473: chown d10/d11/d3a/d5c/d84/l8a 118337 1 2024-02-28T16:27:04.750 INFO:tasks.workunit.client.1.smithi157.stdout:2/518: symlink da/d38/d4e/d91/la9 0 2024-02-28T16:27:04.752 INFO:tasks.workunit.client.1.smithi157.stdout:9/394: creat d0/d19/d30/d79/f87 x:0 0 0 2024-02-28T16:27:04.755 INFO:tasks.workunit.client.1.smithi157.stdout:2/519: fsync da/d35/f54 0 2024-02-28T16:27:04.755 INFO:tasks.workunit.client.1.smithi157.stdout:8/398: dwrite d1/f2 [0,4194304] 0 2024-02-28T16:27:04.756 INFO:tasks.workunit.client.1.smithi157.stdout:5/413: dwrite d0/d30/f5f [0,4194304] 0 2024-02-28T16:27:04.763 INFO:tasks.workunit.client.1.smithi157.stdout:2/520: chown da/d38/d5a/la6 973725 1 2024-02-28T16:27:04.768 INFO:tasks.workunit.client.1.smithi157.stdout:8/399: mkdir d1/d5/d23/d38/d6e/d85 0 2024-02-28T16:27:04.772 INFO:tasks.workunit.client.1.smithi157.stdout:5/414: creat d0/d8/d51/d61/f8e x:0 0 0 2024-02-28T16:27:04.774 INFO:tasks.workunit.client.1.smithi157.stdout:5/415: dread - d0/d9/f79 zero size 2024-02-28T16:27:04.775 INFO:tasks.workunit.client.1.smithi157.stdout:7/462: dwrite df/d1f/d24/f2d [0,4194304] 0 2024-02-28T16:27:04.777 INFO:tasks.workunit.client.1.smithi157.stdout:5/416: write d0/d8/fb [2932415,88379] 0 2024-02-28T16:27:04.778 INFO:tasks.workunit.client.1.smithi157.stdout:9/395: symlink d0/d36/l88 0 2024-02-28T16:27:04.779 INFO:tasks.workunit.client.1.smithi157.stdout:2/521: symlink da/d38/laa 0 2024-02-28T16:27:04.779 INFO:tasks.workunit.client.1.smithi157.stdout:7/463: write df/f31 [3360509,130106] 0 2024-02-28T16:27:04.782 INFO:tasks.workunit.client.1.smithi157.stdout:8/400: mkdir d1/d5/d43/d86 0 2024-02-28T16:27:04.783 INFO:tasks.workunit.client.1.smithi157.stdout:8/401: fsync d1/f4f 0 2024-02-28T16:27:04.786 INFO:tasks.workunit.client.1.smithi157.stdout:8/402: chown d1/d5/d4d/d60/f77 2 1 2024-02-28T16:27:04.787 INFO:tasks.workunit.client.1.smithi157.stdout:5/417: creat d0/d30/f8f x:0 0 0 2024-02-28T16:27:04.797 INFO:tasks.workunit.client.1.smithi157.stdout:0/446: sync 2024-02-28T16:27:04.797 INFO:tasks.workunit.client.1.smithi157.stdout:3/409: sync 2024-02-28T16:27:04.800 INFO:tasks.workunit.client.1.smithi157.stdout:0/447: stat d1/da 0 2024-02-28T16:27:04.800 INFO:tasks.workunit.client.1.smithi157.stdout:8/403: creat d1/d5/d23/d38/d6e/f87 x:0 0 0 2024-02-28T16:27:04.801 INFO:tasks.workunit.client.1.smithi157.stdout:5/418: mkdir d0/d8/d90 0 2024-02-28T16:27:04.803 INFO:tasks.workunit.client.1.smithi157.stdout:9/396: dwrite d0/d36/d37/d40/f62 [0,4194304] 0 2024-02-28T16:27:04.804 INFO:tasks.workunit.client.1.smithi157.stdout:9/397: chown d0/l2f 7920 1 2024-02-28T16:27:04.811 INFO:tasks.workunit.client.1.smithi157.stdout:7/464: symlink df/d1f/d24/d4f/d72/d75/l93 0 2024-02-28T16:27:04.812 INFO:tasks.workunit.client.1.smithi157.stdout:0/448: unlink d1/da/c84 0 2024-02-28T16:27:04.813 INFO:tasks.workunit.client.1.smithi157.stdout:1/474: dread d10/d11/f65 [0,4194304] 0 2024-02-28T16:27:04.814 INFO:tasks.workunit.client.1.smithi157.stdout:8/404: creat d1/d5/d4d/f88 x:0 0 0 2024-02-28T16:27:04.817 INFO:tasks.workunit.client.1.smithi157.stdout:7/465: chown df/d1f/d24/d4f/c86 59 1 2024-02-28T16:27:04.820 INFO:tasks.workunit.client.1.smithi157.stdout:0/449: mkdir d1/d13/d7f/d94 0 2024-02-28T16:27:04.824 INFO:tasks.workunit.client.1.smithi157.stdout:7/466: write df/d1f/d24/f2d [3597056,94029] 0 2024-02-28T16:27:04.826 INFO:tasks.workunit.client.1.smithi157.stdout:0/450: chown d1/d8/d27/c37 2387073 1 2024-02-28T16:27:04.833 INFO:tasks.workunit.client.1.smithi157.stdout:6/419: truncate d2/d7/f15 3157303 0 2024-02-28T16:27:04.834 INFO:tasks.workunit.client.1.smithi157.stdout:3/410: dwrite d0/d6/d34/d80/f7b [0,4194304] 0 2024-02-28T16:27:04.837 INFO:tasks.workunit.client.1.smithi157.stdout:3/411: chown d0 22 1 2024-02-28T16:27:04.837 INFO:tasks.workunit.client.1.smithi157.stdout:9/398: dwrite d0/d19/d30/d78/f7e [0,4194304] 0 2024-02-28T16:27:04.842 INFO:tasks.workunit.client.1.smithi157.stdout:0/451: fsync d1/d8/d27/f7a 0 2024-02-28T16:27:04.843 INFO:tasks.workunit.client.1.smithi157.stdout:7/467: creat df/d1f/d24/d4f/d72/f94 x:0 0 0 2024-02-28T16:27:04.847 INFO:tasks.workunit.client.1.smithi157.stdout:5/419: dread d0/d9/f49 [0,4194304] 0 2024-02-28T16:27:04.851 INFO:tasks.workunit.client.1.smithi157.stdout:6/420: creat d2/d7/d8/d78/d6e/f7f x:0 0 0 2024-02-28T16:27:04.852 INFO:tasks.workunit.client.1.smithi157.stdout:3/412: write d0/d6/d44/f78 [164363,44043] 0 2024-02-28T16:27:04.856 INFO:tasks.workunit.client.1.smithi157.stdout:9/399: rename d0/d36/c56 to d0/d36/d3f/c89 0 2024-02-28T16:27:04.858 INFO:tasks.workunit.client.1.smithi157.stdout:2/522: truncate da/d47/f77 291952 0 2024-02-28T16:27:04.860 INFO:tasks.workunit.client.1.smithi157.stdout:7/468: creat df/d4b/f95 x:0 0 0 2024-02-28T16:27:04.864 INFO:tasks.workunit.client.1.smithi157.stdout:6/421: unlink d2/d7/d8/da/d31/d37/d2b/f54 0 2024-02-28T16:27:04.865 INFO:tasks.workunit.client.1.smithi157.stdout:9/400: rmdir d0/d36/d3f/d69 39 2024-02-28T16:27:04.866 INFO:tasks.workunit.client.1.smithi157.stdout:9/401: dread - d0/d36/d37/f7d zero size 2024-02-28T16:27:04.870 INFO:tasks.workunit.client.1.smithi157.stdout:7/469: symlink df/d1f/d24/d39/d64/l96 0 2024-02-28T16:27:04.873 INFO:tasks.workunit.client.1.smithi157.stdout:8/405: truncate d1/d5/d14/f42 650263 0 2024-02-28T16:27:04.875 INFO:tasks.workunit.client.1.smithi157.stdout:5/420: creat d0/d9/f91 x:0 0 0 2024-02-28T16:27:04.876 INFO:tasks.workunit.client.1.smithi157.stdout:0/452: dread d1/d13/d46/f51 [0,4194304] 0 2024-02-28T16:27:04.878 INFO:tasks.workunit.client.1.smithi157.stdout:9/402: creat d0/d36/d37/d40/d5b/f8a x:0 0 0 2024-02-28T16:27:04.880 INFO:tasks.workunit.client.1.smithi157.stdout:9/403: write d0/f12 [5172488,44025] 0 2024-02-28T16:27:04.880 INFO:tasks.workunit.client.1.smithi157.stdout:7/470: rmdir df/d25/d4e/d67 39 2024-02-28T16:27:04.881 INFO:tasks.workunit.client.1.smithi157.stdout:6/422: mkdir d2/d7/d8/da/d71/d80 0 2024-02-28T16:27:04.883 INFO:tasks.workunit.client.1.smithi157.stdout:6/423: dread - d2/d17/f5a zero size 2024-02-28T16:27:04.890 INFO:tasks.workunit.client.1.smithi157.stdout:0/453: mknod d1/d13/d61/d8e/c95 0 2024-02-28T16:27:04.894 INFO:tasks.workunit.client.1.smithi157.stdout:8/406: dwrite d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:04.899 INFO:tasks.workunit.client.1.smithi157.stdout:5/421: dwrite d0/d9/f79 [0,4194304] 0 2024-02-28T16:27:04.904 INFO:tasks.workunit.client.1.smithi157.stdout:9/404: creat d0/d36/d3f/f8b x:0 0 0 2024-02-28T16:27:04.906 INFO:tasks.workunit.client.1.smithi157.stdout:7/471: dwrite df/d25/d4e/f6b [0,4194304] 0 2024-02-28T16:27:04.906 INFO:tasks.workunit.client.1.smithi157.stdout:8/407: mknod d1/d5/d23/d38/d6e/c89 0 2024-02-28T16:27:04.907 INFO:tasks.workunit.client.1.smithi157.stdout:0/454: mkdir d1/d8/d33/d96 0 2024-02-28T16:27:04.910 INFO:tasks.workunit.client.1.smithi157.stdout:7/472: readlink df/d1f/d24/l68 0 2024-02-28T16:27:04.910 INFO:tasks.workunit.client.1.smithi157.stdout:6/424: dwrite d2/d7/d8/d78/f45 [4194304,4194304] 0 2024-02-28T16:27:04.914 INFO:tasks.workunit.client.1.smithi157.stdout:9/405: symlink d0/d36/d37/d40/d5b/l8c 0 2024-02-28T16:27:04.921 INFO:tasks.workunit.client.1.smithi157.stdout:5/422: creat d0/d30/d50/d7f/f92 x:0 0 0 2024-02-28T16:27:04.923 INFO:tasks.workunit.client.1.smithi157.stdout:8/408: read d1/d5/d23/f69 [1101871,99405] 0 2024-02-28T16:27:04.923 INFO:tasks.workunit.client.1.smithi157.stdout:7/473: write df/d1f/d37/f49 [1760723,22706] 0 2024-02-28T16:27:04.926 INFO:tasks.workunit.client.1.smithi157.stdout:5/423: chown d0/d30/d50/d7f/f8c 900 1 2024-02-28T16:27:04.936 INFO:tasks.workunit.client.1.smithi157.stdout:8/409: dread d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:04.939 INFO:tasks.workunit.client.1.smithi157.stdout:6/425: creat d2/d7/d8/da/d71/d80/f81 x:0 0 0 2024-02-28T16:27:04.941 INFO:tasks.workunit.client.1.smithi157.stdout:5/424: dread d0/d9/f1f [0,4194304] 0 2024-02-28T16:27:04.941 INFO:tasks.workunit.client.1.smithi157.stdout:6/426: read - d2/d7/d8/da/d31/d37/d2b/f5f zero size 2024-02-28T16:27:04.942 INFO:tasks.workunit.client.1.smithi157.stdout:0/455: symlink d1/d13/l97 0 2024-02-28T16:27:04.944 INFO:tasks.workunit.client.1.smithi157.stdout:0/456: write d1/d13/f3e [4409689,60776] 0 2024-02-28T16:27:04.945 INFO:tasks.workunit.client.1.smithi157.stdout:0/457: chown d1/da/c7c 11057436 1 2024-02-28T16:27:04.947 INFO:tasks.workunit.client.1.smithi157.stdout:0/458: truncate d1/d13/d61/f63 938291 0 2024-02-28T16:27:04.948 INFO:tasks.workunit.client.1.smithi157.stdout:7/474: rename df/f1a to df/d1f/d24/d4f/d72/f97 0 2024-02-28T16:27:04.949 INFO:tasks.workunit.client.1.smithi157.stdout:7/475: read - df/d1f/d24/d38/f70 zero size 2024-02-28T16:27:04.950 INFO:tasks.workunit.client.1.smithi157.stdout:8/410: mkdir d1/d5/d10/d8a 0 2024-02-28T16:27:04.951 INFO:tasks.workunit.client.1.smithi157.stdout:8/411: stat d1/d5/d4d/f88 0 2024-02-28T16:27:04.952 INFO:tasks.workunit.client.1.smithi157.stdout:5/425: creat d0/d8/f93 x:0 0 0 2024-02-28T16:27:04.959 INFO:tasks.workunit.client.1.smithi157.stdout:9/406: creat d0/d19/f8d x:0 0 0 2024-02-28T16:27:04.960 INFO:tasks.workunit.client.1.smithi157.stdout:5/426: mkdir d0/d30/d50/d7f/d94 0 2024-02-28T16:27:04.964 INFO:tasks.workunit.client.1.smithi157.stdout:7/476: dwrite df/f31 [0,4194304] 0 2024-02-28T16:27:04.967 INFO:tasks.workunit.client.1.smithi157.stdout:7/477: write df/d25/d79/f82 [634122,78943] 0 2024-02-28T16:27:04.973 INFO:tasks.workunit.client.1.smithi157.stdout:0/459: write d1/d8/f20 [445945,69369] 0 2024-02-28T16:27:04.977 INFO:tasks.workunit.client.1.smithi157.stdout:8/412: dwrite d1/f2c [4194304,4194304] 0 2024-02-28T16:27:04.980 INFO:tasks.workunit.client.1.smithi157.stdout:9/407: dwrite d0/d19/f8d [0,4194304] 0 2024-02-28T16:27:04.981 INFO:tasks.workunit.client.1.smithi157.stdout:7/478: rename df/l23 to df/d80/d84/l98 0 2024-02-28T16:27:04.981 INFO:tasks.workunit.client.1.smithi157.stdout:6/427: dread d2/d7/d8/da/d31/d3a/f2f [0,4194304] 0 2024-02-28T16:27:04.981 INFO:tasks.workunit.client.1.smithi157.stdout:8/413: readlink d1/d5/d43/d66/l7a 0 2024-02-28T16:27:04.985 INFO:tasks.workunit.client.1.smithi157.stdout:5/427: truncate d0/d9/d1b/d36/f53 2860469 0 2024-02-28T16:27:04.986 INFO:tasks.workunit.client.1.smithi157.stdout:0/460: mkdir d1/da/d7d/d98 0 2024-02-28T16:27:04.989 INFO:tasks.workunit.client.1.smithi157.stdout:5/428: dread - d0/d8/d51/f7b zero size 2024-02-28T16:27:04.994 INFO:tasks.workunit.client.1.smithi157.stdout:7/479: creat df/d1f/d24/f99 x:0 0 0 2024-02-28T16:27:04.995 INFO:tasks.workunit.client.1.smithi157.stdout:0/461: mkdir d1/d13/d46/d99 0 2024-02-28T16:27:04.998 INFO:tasks.workunit.client.1.smithi157.stdout:5/429: symlink d0/d8/d51/d61/l95 0 2024-02-28T16:27:05.000 INFO:tasks.workunit.client.1.smithi157.stdout:8/414: dwrite d1/d5/d23/d38/d67/d6d/f7f [0,4194304] 0 2024-02-28T16:27:05.003 INFO:tasks.workunit.client.1.smithi157.stdout:9/408: getdents d0 0 2024-02-28T16:27:05.003 INFO:tasks.workunit.client.1.smithi157.stdout:7/480: mkdir df/d25/d79/d9a 0 2024-02-28T16:27:05.006 INFO:tasks.workunit.client.1.smithi157.stdout:7/481: chown df/d25/c42 6573 1 2024-02-28T16:27:05.008 INFO:tasks.workunit.client.1.smithi157.stdout:7/482: dread - df/d1f/d24/d38/f83 zero size 2024-02-28T16:27:05.010 INFO:tasks.workunit.client.1.smithi157.stdout:6/428: getdents d2/d7/d8/da/d71 0 2024-02-28T16:27:05.012 INFO:tasks.workunit.client.1.smithi157.stdout:0/462: truncate d1/d8/d33/f6b 386360 0 2024-02-28T16:27:05.012 INFO:tasks.workunit.client.1.smithi157.stdout:7/483: write df/d1f/d37/f49 [2909454,11001] 0 2024-02-28T16:27:05.012 INFO:tasks.workunit.client.1.smithi157.stdout:5/430: unlink d0/d8/d51/d61/c84 0 2024-02-28T16:27:05.014 INFO:tasks.workunit.client.1.smithi157.stdout:5/431: stat d0/d8/l62 0 2024-02-28T16:27:05.015 INFO:tasks.workunit.client.1.smithi157.stdout:6/429: rmdir d2/d7/d8/da 39 2024-02-28T16:27:05.019 INFO:tasks.workunit.client.1.smithi157.stdout:4/450: sync 2024-02-28T16:27:05.019 INFO:tasks.workunit.client.1.smithi157.stdout:8/415: dwrite d1/f17 [0,4194304] 0 2024-02-28T16:27:05.020 INFO:tasks.workunit.client.1.smithi157.stdout:0/463: rename d1/d13/c93 to d1/d8/c9a 0 2024-02-28T16:27:05.023 INFO:tasks.workunit.client.1.smithi157.stdout:5/432: creat d0/d9/d47/f96 x:0 0 0 2024-02-28T16:27:05.025 INFO:tasks.workunit.client.1.smithi157.stdout:9/409: dwrite d0/d36/d37/f7d [0,4194304] 0 2024-02-28T16:27:05.029 INFO:tasks.workunit.client.1.smithi157.stdout:4/451: write d3/da/d1f/f63 [235247,127004] 0 2024-02-28T16:27:05.030 INFO:tasks.workunit.client.1.smithi157.stdout:6/430: symlink d2/d7/d8/da/d31/d37/l82 0 2024-02-28T16:27:05.030 INFO:tasks.workunit.client.1.smithi157.stdout:5/433: fsync d0/d8/d51/f87 0 2024-02-28T16:27:05.031 INFO:tasks.workunit.client.1.smithi157.stdout:9/410: read d0/f42 [372189,113631] 0 2024-02-28T16:27:05.045 INFO:tasks.workunit.client.1.smithi157.stdout:5/434: mknod d0/d30/c97 0 2024-02-28T16:27:05.045 INFO:tasks.workunit.client.1.smithi157.stdout:6/431: symlink d2/d7/d8/da/d31/d37/l83 0 2024-02-28T16:27:05.046 INFO:tasks.workunit.client.1.smithi157.stdout:0/464: link d1/d13/l88 d1/da/l9b 0 2024-02-28T16:27:05.046 INFO:tasks.workunit.client.1.smithi157.stdout:4/452: symlink d3/da/d1f/l96 0 2024-02-28T16:27:05.046 INFO:tasks.workunit.client.1.smithi157.stdout:8/416: write d1/d5/d10/f18 [2934741,31934] 0 2024-02-28T16:27:05.047 INFO:tasks.workunit.client.1.smithi157.stdout:9/411: mknod d0/d36/d37/c8e 0 2024-02-28T16:27:05.048 INFO:tasks.workunit.client.1.smithi157.stdout:6/432: chown d2/d7/de/f4e 1419946 1 2024-02-28T16:27:05.053 INFO:tasks.workunit.client.1.smithi157.stdout:0/465: rename d1/da/d7d/f7e to d1/d13/d7f/d94/f9c 0 2024-02-28T16:27:05.053 INFO:tasks.workunit.client.1.smithi157.stdout:4/453: symlink d3/da/d1f/l97 0 2024-02-28T16:27:05.057 INFO:tasks.workunit.client.1.smithi157.stdout:9/412: mknod d0/d36/d37/d40/d4b/c8f 0 2024-02-28T16:27:05.133 INFO:tasks.workunit.client.1.smithi157.stdout:7/484: dread f0 [4194304,4194304] 0 2024-02-28T16:27:05.134 INFO:tasks.workunit.client.1.smithi157.stdout:4/454: rename d3/d77/f55 to d3/d77/f98 0 2024-02-28T16:27:05.136 INFO:tasks.workunit.client.1.smithi157.stdout:9/413: creat d0/f90 x:0 0 0 2024-02-28T16:27:05.140 INFO:tasks.workunit.client.1.smithi157.stdout:0/466: readlink d1/d8/l29 0 2024-02-28T16:27:05.141 INFO:tasks.workunit.client.1.smithi157.stdout:4/455: rmdir d3/da/d37 39 2024-02-28T16:27:05.142 INFO:tasks.workunit.client.1.smithi157.stdout:7/485: stat df/d1f/d24/c89 0 2024-02-28T16:27:05.143 INFO:tasks.workunit.client.1.smithi157.stdout:5/435: dwrite d0/d9/d47/f54 [0,4194304] 0 2024-02-28T16:27:05.151 INFO:tasks.workunit.client.1.smithi157.stdout:6/433: dwrite d2/d7/d8/d78/d6e/f79 [0,4194304] 0 2024-02-28T16:27:05.152 INFO:tasks.workunit.client.1.smithi157.stdout:4/456: unlink d3/da/d1f/f67 0 2024-02-28T16:27:05.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.169+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e50005da0 con 0x7f4e70071eb0 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.170+0000 7f4e6cc00700 1 -- 172.21.15.148:0/3563768017 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f4e5c007e20 con 0x7f4e70071eb0 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:27:05.163 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 13, 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:27:05.164 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:27:05.165 INFO:tasks.workunit.client.1.smithi157.stdout:0/467: rename d1/d13/d46/l8a to d1/d13/d52/d53/l9d 0 2024-02-28T16:27:05.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.176+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f4e5806b2a0 msgr2=0x7f4e5806d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:05.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.176+0000 7f4e77600700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f4e5806b2a0 0x7f4e5806d750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400b7a0 tx=0x7f4e64009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:05.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.176+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 msgr2=0x7f4e70110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:05.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.176+0000 7f4e77600700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70110080 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c002a50 tx=0x7f4e5c0046b0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.177+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 shutdown_connections 2024-02-28T16:27:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.177+0000 7f4e77600700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f4e5806b2a0 0x7f4e5806d750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.177+0000 7f4e77600700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e70070860 0x7f4e7010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.177+0000 7f4e77600700 1 --2- 172.21.15.148:0/3563768017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e70071eb0 0x7f4e70110080 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.177+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 >> 172.21.15.148:0/3563768017 conn(0x7f4e700f8620 msgr2=0x7f4e70102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.177+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 shutdown_connections 2024-02-28T16:27:05.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.178+0000 7f4e77600700 1 -- 172.21.15.148:0/3563768017 wait complete. 2024-02-28T16:27:05.170 INFO:tasks.workunit.client.1.smithi157.stdout:9/414: creat d0/d19/f91 x:0 0 0 2024-02-28T16:27:05.170 INFO:tasks.workunit.client.1.smithi157.stdout:7/486: creat df/d25/d4e/f9b x:0 0 0 2024-02-28T16:27:05.171 INFO:tasks.workunit.client.1.smithi157.stdout:5/436: creat d0/d9/f98 x:0 0 0 2024-02-28T16:27:05.173 INFO:tasks.workunit.client.1.smithi157.stdout:7/487: write df/f10 [3003853,74613] 0 2024-02-28T16:27:05.177 INFO:tasks.workunit.client.1.smithi157.stdout:7/488: dread - df/d1f/f8a zero size 2024-02-28T16:27:05.178 INFO:tasks.workunit.client.1.smithi157.stdout:9/415: mkdir d0/d36/d37/d4d/d92 0 2024-02-28T16:27:05.180 INFO:tasks.workunit.client.1.smithi157.stdout:5/437: truncate d0/d9/f42 3787096 0 2024-02-28T16:27:05.182 INFO:tasks.workunit.client.1.smithi157.stdout:7/489: creat df/d80/d84/f9c x:0 0 0 2024-02-28T16:27:05.184 INFO:tasks.workunit.client.1.smithi157.stdout:0/468: dread d1/d8/f59 [0,4194304] 0 2024-02-28T16:27:05.184 INFO:tasks.workunit.client.1.smithi157.stdout:9/416: write d0/f33 [1973213,85280] 0 2024-02-28T16:27:05.185 INFO:tasks.workunit.client.1.smithi157.stdout:5/438: mknod d0/d8/d7e/d82/c99 0 2024-02-28T16:27:05.186 INFO:tasks.workunit.client.1.smithi157.stdout:0/469: chown d1/d13/d7f 1443 1 2024-02-28T16:27:05.187 INFO:tasks.workunit.client.1.smithi157.stdout:7/490: dread - df/d1f/d24/d4f/d72/f94 zero size 2024-02-28T16:27:05.188 INFO:tasks.workunit.client.1.smithi157.stdout:1/475: sync 2024-02-28T16:27:05.188 INFO:tasks.workunit.client.1.smithi157.stdout:3/413: sync 2024-02-28T16:27:05.189 INFO:tasks.workunit.client.1.smithi157.stdout:5/439: chown d0/d9/d47/f4d 1005 1 2024-02-28T16:27:05.191 INFO:tasks.workunit.client.1.smithi157.stdout:5/440: chown d0/d9/d1b/c22 190755 1 2024-02-28T16:27:05.193 INFO:tasks.workunit.client.1.smithi157.stdout:1/476: creat d10/d11/d31/d2a/d70/f96 x:0 0 0 2024-02-28T16:27:05.195 INFO:tasks.workunit.client.1.smithi157.stdout:9/417: creat d0/d36/d3f/f93 x:0 0 0 2024-02-28T16:27:05.197 INFO:tasks.workunit.client.1.smithi157.stdout:9/418: dread - d0/d19/f91 zero size 2024-02-28T16:27:05.202 INFO:tasks.workunit.client.1.smithi157.stdout:5/441: rename d0/d9/d47/f4d to d0/d8/d7e/f9a 0 2024-02-28T16:27:05.204 INFO:tasks.workunit.client.1.smithi157.stdout:9/419: readlink d0/l31 0 2024-02-28T16:27:05.206 INFO:tasks.workunit.client.1.smithi157.stdout:0/470: creat d1/d8/d33/f9e x:0 0 0 2024-02-28T16:27:05.213 INFO:tasks.workunit.client.1.smithi157.stdout:5/442: creat d0/d9/d47/d5b/d89/d75/f9b x:0 0 0 2024-02-28T16:27:05.214 INFO:tasks.workunit.client.1.smithi157.stdout:6/434: dread d2/d17/f21 [0,4194304] 0 2024-02-28T16:27:05.217 INFO:tasks.workunit.client.1.smithi157.stdout:7/491: dwrite df/d1f/d24/d4f/d72/f97 [0,4194304] 0 2024-02-28T16:27:05.218 INFO:tasks.workunit.client.1.smithi157.stdout:4/457: dread d3/da/f12 [4194304,4194304] 0 2024-02-28T16:27:05.220 INFO:tasks.workunit.client.1.smithi157.stdout:1/477: dwrite fa [0,4194304] 0 2024-02-28T16:27:05.223 INFO:tasks.workunit.client.1.smithi157.stdout:7/492: chown df/d1f/d24/f33 820 1 2024-02-28T16:27:05.227 INFO:tasks.workunit.client.1.smithi157.stdout:0/471: creat d1/d13/d46/d99/f9f x:0 0 0 2024-02-28T16:27:05.228 INFO:tasks.workunit.client.1.smithi157.stdout:7/493: fdatasync df/d1f/d37/d46/f5b 0 2024-02-28T16:27:05.233 INFO:tasks.workunit.client.1.smithi157.stdout:4/458: chown d3/da/d48/l87 182331 1 2024-02-28T16:27:05.235 INFO:tasks.workunit.client.1.smithi157.stdout:9/420: dwrite d0/d19/f29 [0,4194304] 0 2024-02-28T16:27:05.235 INFO:tasks.workunit.client.1.smithi157.stdout:7/494: write df/d80/d84/f9c [585697,53401] 0 2024-02-28T16:27:05.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:04 smithi157 ceph-mon[38346]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:05.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:04 smithi157 ceph-mon[38346]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:05.238 INFO:tasks.workunit.client.1.smithi157.stdout:6/435: creat d2/d7/d8/da/d31/d37/d2d/d66/f84 x:0 0 0 2024-02-28T16:27:05.241 INFO:tasks.workunit.client.1.smithi157.stdout:9/421: write d0/d19/d30/f54 [819130,103683] 0 2024-02-28T16:27:05.241 INFO:tasks.workunit.client.1.smithi157.stdout:0/472: dread d1/d8/f20 [0,4194304] 0 2024-02-28T16:27:05.242 INFO:tasks.workunit.client.1.smithi157.stdout:1/478: symlink d10/d94/l97 0 2024-02-28T16:27:05.248 INFO:tasks.workunit.client.1.smithi157.stdout:4/459: rename d3/d77/f74 to d3/d77/f99 0 2024-02-28T16:27:05.250 INFO:tasks.workunit.client.1.smithi157.stdout:6/436: stat d2/c1d 0 2024-02-28T16:27:05.254 INFO:tasks.workunit.client.1.smithi157.stdout:0/473: creat d1/da/d7d/fa0 x:0 0 0 2024-02-28T16:27:05.254 INFO:tasks.workunit.client.1.smithi157.stdout:1/479: rmdir d10/d11/d3a/d5c 39 2024-02-28T16:27:05.256 INFO:tasks.workunit.client.1.smithi157.stdout:5/443: dwrite d0/f5a [0,4194304] 0 2024-02-28T16:27:05.257 INFO:tasks.workunit.client.1.smithi157.stdout:6/437: fdatasync d2/d7/de/f4e 0 2024-02-28T16:27:05.260 INFO:tasks.workunit.client.1.smithi157.stdout:0/474: creat d1/da/d6c/fa1 x:0 0 0 2024-02-28T16:27:05.261 INFO:tasks.workunit.client.1.smithi157.stdout:5/444: write d0/f5a [1300729,19978] 0 2024-02-28T16:27:05.263 INFO:tasks.workunit.client.1.smithi157.stdout:7/495: dwrite df/d1f/d24/d39/f58 [0,4194304] 0 2024-02-28T16:27:05.272 INFO:tasks.workunit.client.1.smithi157.stdout:4/460: getdents d3/d77 0 2024-02-28T16:27:05.275 INFO:tasks.workunit.client.1.smithi157.stdout:9/422: truncate d0/d36/d37/d4d/f51 50388 0 2024-02-28T16:27:05.276 INFO:tasks.workunit.client.1.smithi157.stdout:0/475: dread d1/d13/d46/f51 [4194304,4194304] 0 2024-02-28T16:27:05.277 INFO:tasks.workunit.client.1.smithi157.stdout:2/523: sync 2024-02-28T16:27:05.278 INFO:tasks.workunit.client.1.smithi157.stdout:1/480: fsync d10/d11/d3a/d5c/d6c/d7b/f5e 0 2024-02-28T16:27:05.280 INFO:tasks.workunit.client.1.smithi157.stdout:1/481: chown d10/d11/d31 85246222 1 2024-02-28T16:27:05.283 INFO:tasks.workunit.client.1.smithi157.stdout:5/445: symlink d0/d30/d50/d7f/d94/l9c 0 2024-02-28T16:27:05.290 INFO:tasks.workunit.client.1.smithi157.stdout:6/438: dwrite d2/d17/f2a [0,4194304] 0 2024-02-28T16:27:05.295 INFO:tasks.workunit.client.1.smithi157.stdout:4/461: mkdir d3/da/d37/d84/d9a 0 2024-02-28T16:27:05.296 INFO:tasks.workunit.client.1.smithi157.stdout:5/446: creat d0/d9/d3a/f9d x:0 0 0 2024-02-28T16:27:05.298 INFO:tasks.workunit.client.1.smithi157.stdout:4/462: read d3/da/d37/f78 [110468,62144] 0 2024-02-28T16:27:05.299 INFO:tasks.workunit.client.1.smithi157.stdout:5/447: write d0/d9/f1f [184567,28309] 0 2024-02-28T16:27:05.299 INFO:tasks.workunit.client.1.smithi157.stdout:4/463: dread - d3/da/f90 zero size 2024-02-28T16:27:05.300 INFO:tasks.workunit.client.1.smithi157.stdout:9/423: unlink d0/d19/f58 0 2024-02-28T16:27:05.307 INFO:tasks.workunit.client.1.smithi157.stdout:2/524: unlink da/f23 0 2024-02-28T16:27:05.310 INFO:tasks.workunit.client.1.smithi157.stdout:9/424: dread d0/d36/d37/f7d [0,4194304] 0 2024-02-28T16:27:05.311 INFO:tasks.workunit.client.1.smithi157.stdout:1/482: truncate d10/f12 688765 0 2024-02-28T16:27:05.319 INFO:tasks.workunit.client.1.smithi157.stdout:2/525: dwrite da/d2b/d59/f64 [0,4194304] 0 2024-02-28T16:27:05.319 INFO:tasks.workunit.client.1.smithi157.stdout:5/448: write d0/d8/d7e/f9a [4494677,123564] 0 2024-02-28T16:27:05.322 INFO:tasks.workunit.client.1.smithi157.stdout:5/449: write d0/d30/d50/d7f/f92 [990065,53698] 0 2024-02-28T16:27:05.324 INFO:tasks.workunit.client.1.smithi157.stdout:5/450: write d0/d8/fb [4694089,60439] 0 2024-02-28T16:27:05.326 INFO:tasks.workunit.client.1.smithi157.stdout:5/451: chown d0/d8/d51/f87 11 1 2024-02-28T16:27:05.329 INFO:tasks.workunit.client.1.smithi157.stdout:1/483: symlink d10/d11/d3a/d5c/d84/l98 0 2024-02-28T16:27:05.333 INFO:tasks.workunit.client.1.smithi157.stdout:6/439: link d2/d7/d8/da/d31/d37/d2d/d53/d69/f7c d2/d7/d8/d78/f85 0 2024-02-28T16:27:05.335 INFO:tasks.workunit.client.1.smithi157.stdout:6/440: dread - d2/d17/f5a zero size 2024-02-28T16:27:05.338 INFO:tasks.workunit.client.1.smithi157.stdout:2/526: unlink da/d65/d90/f88 0 2024-02-28T16:27:05.340 INFO:tasks.workunit.client.1.smithi157.stdout:0/476: link d1/d13/l4d d1/d8/d27/la2 0 2024-02-28T16:27:05.342 INFO:tasks.workunit.client.1.smithi157.stdout:5/452: unlink d0/d8/l62 0 2024-02-28T16:27:05.342 INFO:tasks.workunit.client.1.smithi157.stdout:9/425: symlink d0/d19/l94 0 2024-02-28T16:27:05.346 INFO:tasks.workunit.client.1.smithi157.stdout:1/484: dwrite d10/d11/d22/f69 [0,4194304] 0 2024-02-28T16:27:05.349 INFO:tasks.workunit.client.1.smithi157.stdout:2/527: mknod da/d2b/d59/cab 0 2024-02-28T16:27:05.355 INFO:tasks.workunit.client.1.smithi157.stdout:6/441: dread d2/f1f [0,4194304] 0 2024-02-28T16:27:05.356 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:04 smithi148 ceph-mon[28767]: from='client.24423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:05.356 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:04 smithi148 ceph-mon[28767]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:05.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.367+0000 7f594ac00700 1 -- 172.21.15.148:0/99612545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59440708c0 msgr2=0x7f5944070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:05.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.367+0000 7f594ac00700 1 --2- 172.21.15.148:0/99612545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59440708c0 0x7f5944070d10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5930004940 tx=0x7f5930009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:05.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.367+0000 7f594ac00700 1 -- 172.21.15.148:0/99612545 shutdown_connections 2024-02-28T16:27:05.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.367+0000 7f594ac00700 1 --2- 172.21.15.148:0/99612545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f59440708c0 0x7f5944070d10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.367+0000 7f594ac00700 1 --2- 172.21.15.148:0/99612545 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5944071f10 0x7f5944070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.368+0000 7f594ac00700 1 -- 172.21.15.148:0/99612545 >> 172.21.15.148:0/99612545 conn(0x7f59440f8620 msgr2=0x7f59440faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:05.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.369+0000 7f594ac00700 1 -- 172.21.15.148:0/99612545 shutdown_connections 2024-02-28T16:27:05.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.369+0000 7f594ac00700 1 -- 172.21.15.148:0/99612545 wait complete. 2024-02-28T16:27:05.358 INFO:tasks.workunit.client.1.smithi157.stdout:4/464: getdents d3/da/d48 0 2024-02-28T16:27:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.370+0000 7f594ac00700 1 Processor -- start 2024-02-28T16:27:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.370+0000 7f594ac00700 1 -- start start 2024-02-28T16:27:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.371+0000 7f594ac00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59440708c0 0x7f59440fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.371+0000 7f594ac00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5944071f10 0x7f59440fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.371+0000 7f594ac00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440fd8f0 con 0x7f5944071f10 2024-02-28T16:27:05.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.371+0000 7f594ac00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440fe190 con 0x7f59440708c0 2024-02-28T16:27:05.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.371+0000 7f5943e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59440708c0 0x7f59440fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:05.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.371+0000 7f5943400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5944071f10 0x7f59440fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:05.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.372+0000 7f5943400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5944071f10 0x7f59440fd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52528/0 (socket says 172.21.15.148:52528) 2024-02-28T16:27:05.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.372+0000 7f5943e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59440708c0 0x7f59440fcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:47980/0 (socket says 172.21.15.148:47980) 2024-02-28T16:27:05.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.372+0000 7f5943400700 1 -- 172.21.15.148:0/867125829 learned_addr learned my addr 172.21.15.148:0/867125829 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:05.362 INFO:tasks.workunit.client.1.smithi157.stdout:3/414: sync 2024-02-28T16:27:05.362 INFO:tasks.workunit.client.1.smithi157.stdout:8/417: sync 2024-02-28T16:27:05.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.372+0000 7f5943400700 1 -- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59440708c0 msgr2=0x7f59440fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:05.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.372+0000 7f5943400700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59440708c0 0x7f59440fcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.372+0000 7f5943400700 1 -- 172.21.15.148:0/867125829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930005040 con 0x7f5944071f10 2024-02-28T16:27:05.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.373+0000 7f5943400700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5944071f10 0x7f59440fd2a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5930009fd0 tx=0x7f5930009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:05.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.373+0000 7f593be00700 1 -- 172.21.15.148:0/867125829 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593000e030 con 0x7f5944071f10 2024-02-28T16:27:05.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.373+0000 7f593be00700 1 -- 172.21.15.148:0/867125829 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5930009430 con 0x7f5944071f10 2024-02-28T16:27:05.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.373+0000 7f593be00700 1 -- 172.21.15.148:0/867125829 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593001c400 con 0x7f5944071f10 2024-02-28T16:27:05.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.374+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59440fe410 con 0x7f5944071f10 2024-02-28T16:27:05.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.374+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440fe920 con 0x7f5944071f10 2024-02-28T16:27:05.365 INFO:tasks.workunit.client.1.smithi157.stdout:0/477: symlink d1/d8/d33/d96/la3 0 2024-02-28T16:27:05.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.376+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594404bed0 con 0x7f5944071f10 2024-02-28T16:27:05.366 INFO:tasks.workunit.client.1.smithi157.stdout:2/528: dwrite da/d38/d5a/d5c/f7a [0,4194304] 0 2024-02-28T16:27:05.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.377+0000 7f593be00700 1 -- 172.21.15.148:0/867125829 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 26) v1 ==== 88912+0+0 (secure 0 0 0) 0x7f593000bb90 con 0x7f5944071f10 2024-02-28T16:27:05.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.378+0000 7f593be00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f592806b280 0x7f592806d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:05.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.378+0000 7f593be00700 1 -- 172.21.15.148:0/867125829 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f593008aa10 con 0x7f5944071f10 2024-02-28T16:27:05.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.378+0000 7f5943e00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f592806b280 0x7f592806d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:05.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.379+0000 7f5943e00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f592806b280 0x7f592806d730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59340041d0 tx=0x7f59340043c0 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:05.371 INFO:tasks.workunit.client.1.smithi157.stdout:9/426: mknod d0/c95 0 2024-02-28T16:27:05.373 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.383+0000 7f593be00700 1 -- 172.21.15.148:0/867125829 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5930054e20 con 0x7f5944071f10 2024-02-28T16:27:05.378 INFO:tasks.workunit.client.1.smithi157.stdout:6/442: rename d2/d7/d8/da/l4a to d2/d7/de/d1b/d3d/l86 0 2024-02-28T16:27:05.383 INFO:tasks.workunit.client.1.smithi157.stdout:8/418: unlink d1/d5/d43/d66/l7a 0 2024-02-28T16:27:05.386 INFO:tasks.workunit.client.1.smithi157.stdout:2/529: mknod da/d2b/cac 0 2024-02-28T16:27:05.388 INFO:tasks.workunit.client.1.smithi157.stdout:1/485: fsync f2 0 2024-02-28T16:27:05.390 INFO:tasks.workunit.client.1.smithi157.stdout:4/465: mknod d3/da/d1f/c9b 0 2024-02-28T16:27:05.393 INFO:tasks.workunit.client.1.smithi157.stdout:5/453: dwrite d0/d8/d51/d61/f76 [0,4194304] 0 2024-02-28T16:27:05.395 INFO:tasks.workunit.client.1.smithi157.stdout:1/486: read d10/d11/d3a/d5c/d6c/d7b/f45 [77508,124846] 0 2024-02-28T16:27:05.456 INFO:tasks.workunit.client.1.smithi157.stdout:6/443: creat d2/d7/d38/f87 x:0 0 0 2024-02-28T16:27:05.457 INFO:tasks.workunit.client.1.smithi157.stdout:9/427: mkdir d0/d36/d37/d40/d4b/d96 0 2024-02-28T16:27:05.460 INFO:tasks.workunit.client.1.smithi157.stdout:8/419: creat d1/d5/d23/d38/d6e/d85/f8b x:0 0 0 2024-02-28T16:27:05.460 INFO:tasks.workunit.client.1.smithi157.stdout:4/466: readlink d3/da/d28/l75 0 2024-02-28T16:27:05.461 INFO:tasks.workunit.client.1.smithi157.stdout:5/454: creat d0/d9/d47/f9e x:0 0 0 2024-02-28T16:27:05.463 INFO:tasks.workunit.client.1.smithi157.stdout:5/455: fsync d0/fe 0 2024-02-28T16:27:05.465 INFO:tasks.workunit.client.1.smithi157.stdout:4/467: read - d3/f8a zero size 2024-02-28T16:27:05.467 INFO:tasks.workunit.client.1.smithi157.stdout:9/428: chown d0/l17 9 1 2024-02-28T16:27:05.467 INFO:tasks.workunit.client.1.smithi157.stdout:0/478: dwrite d1/d13/d46/f51 [4194304,4194304] 0 2024-02-28T16:27:05.468 INFO:tasks.workunit.client.1.smithi157.stdout:6/444: stat d2/d7/d8/da/d31/d37/d2d 0 2024-02-28T16:27:05.469 INFO:tasks.workunit.client.1.smithi157.stdout:8/420: symlink d1/d5/d43/d86/l8c 0 2024-02-28T16:27:05.472 INFO:tasks.workunit.client.1.smithi157.stdout:0/479: chown d1/d13/l97 214413336 1 2024-02-28T16:27:05.480 INFO:tasks.workunit.client.1.smithi157.stdout:6/445: rmdir d2/d17 39 2024-02-28T16:27:05.482 INFO:tasks.workunit.client.1.smithi157.stdout:4/468: dread d3/da/f20 [0,4194304] 0 2024-02-28T16:27:05.484 INFO:tasks.workunit.client.1.smithi157.stdout:0/480: truncate d1/da/f2f 335851 0 2024-02-28T16:27:05.488 INFO:tasks.workunit.client.1.smithi157.stdout:3/415: dwrite d0/d6/d6b/f73 [0,4194304] 0 2024-02-28T16:27:05.491 INFO:tasks.workunit.client.1.smithi157.stdout:6/446: write d2/d7/d8/da/d31/d37/d2d/d53/d69/f7d [135757,118348] 0 2024-02-28T16:27:05.491 INFO:tasks.workunit.client.1.smithi157.stdout:9/429: link d0/d36/d3f/f60 d0/f97 0 2024-02-28T16:27:05.494 INFO:tasks.workunit.client.1.smithi157.stdout:1/487: dwrite d10/d11/f32 [0,4194304] 0 2024-02-28T16:27:05.500 INFO:tasks.workunit.client.1.smithi157.stdout:3/416: truncate d0/d6/d34/d80/d23/f50 472842 0 2024-02-28T16:27:05.500 INFO:tasks.workunit.client.1.smithi157.stdout:5/456: dwrite d0/d30/f5f [0,4194304] 0 2024-02-28T16:27:05.500 INFO:tasks.workunit.client.1.smithi157.stdout:1/488: write d10/d11/d31/f41 [3569505,98003] 0 2024-02-28T16:27:05.500 INFO:tasks.workunit.client.1.smithi157.stdout:7/496: sync 2024-02-28T16:27:05.500 INFO:tasks.workunit.client.1.smithi157.stdout:8/421: truncate d1/d5/d23/d38/d67/d6d/f7f 896532 0 2024-02-28T16:27:05.512 INFO:tasks.workunit.client.1.smithi157.stdout:4/469: rename d3/da/d37/l64 to d3/da/d1f/l9c 0 2024-02-28T16:27:05.514 INFO:tasks.workunit.client.1.smithi157.stdout:1/489: fsync d10/d11/f28 0 2024-02-28T16:27:05.516 INFO:tasks.workunit.client.1.smithi157.stdout:5/457: symlink d0/d9/d47/l9f 0 2024-02-28T16:27:05.521 INFO:tasks.workunit.client.1.smithi157.stdout:7/497: dread - df/d25/d4e/d67/f92 zero size 2024-02-28T16:27:05.521 INFO:tasks.workunit.client.1.smithi157.stdout:1/490: readlink d10/d11/d31/l36 0 2024-02-28T16:27:05.522 INFO:tasks.workunit.client.1.smithi157.stdout:6/447: dwrite d2/d17/f1e [0,4194304] 0 2024-02-28T16:27:05.524 INFO:tasks.workunit.client.1.smithi157.stdout:9/430: dwrite d0/d19/f29 [0,4194304] 0 2024-02-28T16:27:05.525 INFO:tasks.workunit.client.1.smithi157.stdout:0/481: rename d1/d13/f3e to d1/d13/d46/d99/fa4 0 2024-02-28T16:27:05.528 INFO:tasks.workunit.client.1.smithi157.stdout:7/498: chown df/d25/c36 367 1 2024-02-28T16:27:05.528 INFO:tasks.workunit.client.1.smithi157.stdout:6/448: write d2/f35 [1175845,116479] 0 2024-02-28T16:27:05.528 INFO:tasks.workunit.client.1.smithi157.stdout:5/458: rmdir d0/d9/d47/d5b/d89 39 2024-02-28T16:27:05.534 INFO:tasks.workunit.client.1.smithi157.stdout:8/422: dwrite d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:05.535 INFO:tasks.workunit.client.1.smithi157.stdout:0/482: mknod d1/ca5 0 2024-02-28T16:27:05.536 INFO:tasks.workunit.client.1.smithi157.stdout:7/499: write df/d1f/d24/d38/f57 [822307,98796] 0 2024-02-28T16:27:05.544 INFO:tasks.workunit.client.1.smithi157.stdout:3/417: rename d0/d6/d34/d80/d23/c74 to d0/d6/d6b/d75/c85 0 2024-02-28T16:27:05.550 INFO:tasks.workunit.client.1.smithi157.stdout:7/500: mknod df/d1f/d24/d39/d64/c9d 0 2024-02-28T16:27:05.552 INFO:tasks.workunit.client.1.smithi157.stdout:3/418: write d0/d6/d34/d80/f7b [4031264,33507] 0 2024-02-28T16:27:05.553 INFO:tasks.workunit.client.1.smithi157.stdout:9/431: mknod d0/d36/d37/c98 0 2024-02-28T16:27:05.554 INFO:tasks.workunit.client.1.smithi157.stdout:1/491: rename d10/d73 to d10/d11/d22/d99 0 2024-02-28T16:27:05.555 INFO:tasks.workunit.client.1.smithi157.stdout:5/459: dread d0/f2e [0,4194304] 0 2024-02-28T16:27:05.556 INFO:tasks.workunit.client.1.smithi157.stdout:8/423: mknod d1/d5/d23/c8d 0 2024-02-28T16:27:05.558 INFO:tasks.workunit.client.1.smithi157.stdout:7/501: mkdir df/d25/d79/d9e 0 2024-02-28T16:27:05.564 INFO:tasks.workunit.client.1.smithi157.stdout:1/492: creat d10/d7a/d91/f9a x:0 0 0 2024-02-28T16:27:05.565 INFO:tasks.workunit.client.1.smithi157.stdout:5/460: write d0/f34 [3050254,108148] 0 2024-02-28T16:27:05.568 INFO:tasks.workunit.client.1.smithi157.stdout:9/432: write d0/d36/d37/d40/f49 [5513778,89074] 0 2024-02-28T16:27:05.568 INFO:tasks.workunit.client.1.smithi157.stdout:0/483: dwrite d1/da/d6c/fa1 [0,4194304] 0 2024-02-28T16:27:05.568 INFO:tasks.workunit.client.1.smithi157.stdout:3/419: mknod d0/d6/d34/d80/d23/d2b/d2e/d7e/c86 0 2024-02-28T16:27:05.570 INFO:tasks.workunit.client.1.smithi157.stdout:0/484: chown d1/d13/d46/d99 13090 1 2024-02-28T16:27:05.572 INFO:tasks.workunit.client.1.smithi157.stdout:8/424: creat d1/d5/d23/d53/f8e x:0 0 0 2024-02-28T16:27:05.575 INFO:tasks.workunit.client.1.smithi157.stdout:5/461: mkdir d0/d30/da0 0 2024-02-28T16:27:05.576 INFO:tasks.workunit.client.1.smithi157.stdout:6/449: dwrite d2/d7/d8/da/d31/d37/d2d/f3b [0,4194304] 0 2024-02-28T16:27:05.577 INFO:tasks.workunit.client.1.smithi157.stdout:1/493: mkdir d10/d11/d31/d2a/d70/d9b 0 2024-02-28T16:27:05.583 INFO:tasks.workunit.client.1.smithi157.stdout:0/485: read d1/d8/fc [1847003,23111] 0 2024-02-28T16:27:05.585 INFO:tasks.workunit.client.1.smithi157.stdout:3/420: mkdir d0/d6/d44/d70/d71/d87 0 2024-02-28T16:27:05.589 INFO:tasks.workunit.client.1.smithi157.stdout:9/433: dwrite d0/d36/d37/d40/f62 [0,4194304] 0 2024-02-28T16:27:05.590 INFO:tasks.workunit.client.1.smithi157.stdout:9/434: read - d0/d36/f63 zero size 2024-02-28T16:27:05.598 INFO:tasks.workunit.client.1.smithi157.stdout:2/530: sync 2024-02-28T16:27:05.608 INFO:tasks.workunit.client.1.smithi157.stdout:1/494: rename ff to d10/d11/d31/d2a/d70/f9c 0 2024-02-28T16:27:05.609 INFO:tasks.workunit.client.1.smithi157.stdout:7/502: getdents df/d25 0 2024-02-28T16:27:05.610 INFO:tasks.workunit.client.1.smithi157.stdout:8/425: write d1/d5/d23/f68 [1431877,47400] 0 2024-02-28T16:27:05.610 INFO:tasks.workunit.client.1.smithi157.stdout:7/503: stat df/d25/c3c 0 2024-02-28T16:27:05.611 INFO:tasks.workunit.client.1.smithi157.stdout:5/462: write d0/d30/d50/d7f/f8d [669628,92173] 0 2024-02-28T16:27:05.649 INFO:tasks.workunit.client.1.smithi157.stdout:0/486: rename d1/d8/d33/f6b to d1/d13/d46/d99/fa6 0 2024-02-28T16:27:05.649 INFO:tasks.workunit.client.1.smithi157.stdout:9/435: creat d0/d36/d37/d40/d4b/d96/f99 x:0 0 0 2024-02-28T16:27:05.650 INFO:tasks.workunit.client.1.smithi157.stdout:5/463: dread - d0/d9/f91 zero size 2024-02-28T16:27:05.651 INFO:tasks.workunit.client.1.smithi157.stdout:1/495: creat d10/d11/d3a/d5c/d6c/d7b/f9d x:0 0 0 2024-02-28T16:27:05.652 INFO:tasks.workunit.client.1.smithi157.stdout:7/504: symlink df/d1f/d24/d4f/d72/l9f 0 2024-02-28T16:27:05.652 INFO:tasks.workunit.client.1.smithi157.stdout:9/436: fsync d0/d19/d30/f4c 0 2024-02-28T16:27:05.655 INFO:tasks.workunit.client.1.smithi157.stdout:9/437: write d0/d36/d37/f43 [4195535,114630] 0 2024-02-28T16:27:05.657 INFO:tasks.workunit.client.1.smithi157.stdout:0/487: creat d1/d8/d33/d96/fa7 x:0 0 0 2024-02-28T16:27:05.658 INFO:tasks.workunit.client.1.smithi157.stdout:9/438: write d0/d36/d37/d40/f62 [2476955,24746] 0 2024-02-28T16:27:05.661 INFO:tasks.workunit.client.1.smithi157.stdout:9/439: write d0/d36/d3f/f93 [1012403,88287] 0 2024-02-28T16:27:05.666 INFO:tasks.workunit.client.1.smithi157.stdout:1/496: creat d10/d11/d3a/d5c/d6c/f9e x:0 0 0 2024-02-28T16:27:05.758 INFO:tasks.workunit.client.1.smithi157.stdout:8/426: dwrite d1/d5/d23/d38/d67/d6d/f7e [0,4194304] 0 2024-02-28T16:27:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.725+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59440fee40 con 0x7f592806b280 2024-02-28T16:27:05.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.727+0000 7f593be00700 1 -- 172.21.15.148:0/867125829 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f59440fee40 con 0x7f592806b280 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [], 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "1/2 daemons upgraded", 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "", 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:27:05.761 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f592806b280 msgr2=0x7f592806d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f592806b280 0x7f592806d730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f59340041d0 tx=0x7f59340043c0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5944071f10 msgr2=0x7f59440fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5944071f10 0x7f59440fd2a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5930009fd0 tx=0x7f5930009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 shutdown_connections 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f592806b280 0x7f592806d730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59440708c0 0x7f59440fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 --2- 172.21.15.148:0/867125829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5944071f10 0x7f59440fd2a0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5930009fd0 tx=0x7f5930009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.733+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 >> 172.21.15.148:0/867125829 conn(0x7f59440f8620 msgr2=0x7f5944102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.734+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 shutdown_connections 2024-02-28T16:27:05.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:05.734+0000 7f594ac00700 1 -- 172.21.15.148:0/867125829 wait complete. 2024-02-28T16:27:05.766 INFO:tasks.workunit.client.1.smithi157.stdout:8/427: read d1/d5/f70 [377604,74653] 0 2024-02-28T16:27:05.766 INFO:tasks.workunit.client.1.smithi157.stdout:5/464: mknod d0/d9/d47/d5b/ca1 0 2024-02-28T16:27:05.766 INFO:tasks.workunit.client.1.smithi157.stdout:7/505: write df/d25/f44 [3424917,103413] 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:9/440: dread d0/d19/f8d [0,4194304] 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:2/531: link da/d2b/c2d da/d38/d3e/d9b/da3/cad 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:8/428: creat d1/d5/d14/d3e/f8f x:0 0 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:2/532: write da/d38/d4e/f93 [552835,102516] 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:7/506: rmdir df/d1f/d24/d4f 39 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:4/470: sync 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:0/488: dwrite d1/d8/d27/d55/f5f [4194304,4194304] 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:2/533: rename da/d2b/d59/cab to da/d38/cae 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:4/471: creat d3/da/d37/d71/f9d x:0 0 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:9/441: dread d0/f28 [0,4194304] 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:8/429: rmdir d1/d5/d14/d3e 39 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:4/472: truncate d3/da/d37/f49 859162 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:0/489: mkdir d1/d8/da8 0 2024-02-28T16:27:05.767 INFO:tasks.workunit.client.1.smithi157.stdout:5/465: dwrite d0/d9/d47/f4f [0,4194304] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:9/442: truncate d0/d19/f1c 1092081 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:7/507: truncate df/d1f/d24/f53 719016 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:0/490: creat d1/d13/d52/fa9 x:0 0 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:7/508: read - df/d1f/f8a zero size 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:7/509: write df/d1f/d24/d39/f5f [1489067,71368] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:8/430: dwrite d1/d5/d4d/f88 [0,4194304] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:5/466: dread d0/d9/f79 [0,4194304] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:8/431: write d1/d5/d14/f2d [6946035,77650] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:4/473: write d3/da/f5e [4283337,57984] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:2/534: dread da/f2c [0,4194304] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:9/443: dwrite d0/d36/d37/d40/d5b/f6a [0,4194304] 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:5/467: symlink d0/d30/d50/d7f/d94/la2 0 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:9/444: chown d0/d19/f29 239 1 2024-02-28T16:27:05.768 INFO:tasks.workunit.client.1.smithi157.stdout:8/432: mknod d1/d5/d23/d38/d6e/d85/c90 0 2024-02-28T16:27:05.769 INFO:tasks.workunit.client.1.smithi157.stdout:5/468: chown d0/d9/d47/d5b/ca1 1 1 2024-02-28T16:27:05.769 INFO:tasks.workunit.client.1.smithi157.stdout:7/510: write df/d25/d4e/d67/f45 [171586,120080] 0 2024-02-28T16:27:05.769 INFO:tasks.workunit.client.1.smithi157.stdout:9/445: write d0/d19/d30/f32 [4044158,124455] 0 2024-02-28T16:27:05.769 INFO:tasks.workunit.client.1.smithi157.stdout:4/474: mknod d3/da/d37/d84/d9a/c9e 0 2024-02-28T16:27:05.769 INFO:tasks.workunit.client.1.smithi157.stdout:3/421: sync 2024-02-28T16:27:05.769 INFO:tasks.workunit.client.1.smithi157.stdout:6/450: sync 2024-02-28T16:27:05.770 INFO:tasks.workunit.client.1.smithi157.stdout:0/491: dwrite d1/d13/d61/d64/f68 [0,4194304] 0 2024-02-28T16:27:05.770 INFO:tasks.workunit.client.1.smithi157.stdout:9/446: readlink d0/d36/d37/d4d/l5e 0 2024-02-28T16:27:05.772 INFO:tasks.workunit.client.1.smithi157.stdout:9/447: write d0/f90 [685529,29427] 0 2024-02-28T16:27:05.773 INFO:tasks.workunit.client.1.smithi157.stdout:4/475: chown c1 2119648245 1 2024-02-28T16:27:05.774 INFO:tasks.workunit.client.1.smithi157.stdout:8/433: creat d1/d5/d23/f91 x:0 0 0 2024-02-28T16:27:05.775 INFO:tasks.workunit.client.1.smithi157.stdout:2/535: link da/f12 da/d38/d3e/d9b/da3/faf 0 2024-02-28T16:27:05.775 INFO:tasks.workunit.client.1.smithi157.stdout:0/492: dread - d1/d13/d46/d99/f9f zero size 2024-02-28T16:27:05.777 INFO:tasks.workunit.client.1.smithi157.stdout:5/469: fsync d0/d9/d1b/d36/f38 0 2024-02-28T16:27:05.778 INFO:tasks.workunit.client.1.smithi157.stdout:3/422: rename d0/d6/d34/d80/c29 to d0/d6/d44/d70/c88 0 2024-02-28T16:27:05.779 INFO:tasks.workunit.client.1.smithi157.stdout:6/451: creat d2/d7/d8/da/d31/d37/d2d/f88 x:0 0 0 2024-02-28T16:27:05.781 INFO:tasks.workunit.client.1.smithi157.stdout:2/536: rmdir da/d35 39 2024-02-28T16:27:05.781 INFO:tasks.workunit.client.1.smithi157.stdout:5/470: readlink d0/d9/d47/l4a 0 2024-02-28T16:27:05.783 INFO:tasks.workunit.client.1.smithi157.stdout:9/448: symlink d0/d36/d37/d40/d4b/d96/l9a 0 2024-02-28T16:27:05.783 INFO:tasks.workunit.client.1.smithi157.stdout:0/493: write d1/d13/d52/fa9 [694393,26933] 0 2024-02-28T16:27:05.785 INFO:tasks.workunit.client.1.smithi157.stdout:2/537: fsync da/d38/d4e/f93 0 2024-02-28T16:27:05.785 INFO:tasks.workunit.client.1.smithi157.stdout:8/434: rmdir d1/d5/d10/d8a 0 2024-02-28T16:27:05.786 INFO:tasks.workunit.client.1.smithi157.stdout:3/423: read d0/d6/f5f [4085925,30895] 0 2024-02-28T16:27:05.788 INFO:tasks.workunit.client.1.smithi157.stdout:5/471: mknod d0/d30/ca3 0 2024-02-28T16:27:05.790 INFO:tasks.workunit.client.1.smithi157.stdout:9/449: chown d0/d36/l68 3556 1 2024-02-28T16:27:05.791 INFO:tasks.workunit.client.1.smithi157.stdout:2/538: read da/d65/d90/f49 [3559645,38505] 0 2024-02-28T16:27:05.792 INFO:tasks.workunit.client.1.smithi157.stdout:5/472: read d0/d9/f37 [357490,2015] 0 2024-02-28T16:27:05.793 INFO:tasks.workunit.client.1.smithi157.stdout:9/450: fsync d0/d36/d3f/f74 0 2024-02-28T16:27:05.797 INFO:tasks.workunit.client.1.smithi157.stdout:3/424: dread d0/d6/d34/d80/d5c/f7d [0,4194304] 0 2024-02-28T16:27:05.801 INFO:tasks.workunit.client.1.smithi157.stdout:9/451: read - d0/f7b zero size 2024-02-28T16:27:05.802 INFO:tasks.workunit.client.1.smithi157.stdout:5/473: creat d0/d9/d1b/fa4 x:0 0 0 2024-02-28T16:27:05.802 INFO:tasks.workunit.client.1.smithi157.stdout:8/435: dread d1/f2 [0,4194304] 0 2024-02-28T16:27:05.807 INFO:tasks.workunit.client.1.smithi157.stdout:5/474: write d0/d30/d50/d7f/f92 [979503,97082] 0 2024-02-28T16:27:05.807 INFO:tasks.workunit.client.1.smithi157.stdout:3/425: mkdir d0/d6/d34/d80/d23/d2b/d81/d89 0 2024-02-28T16:27:05.812 INFO:tasks.workunit.client.1.smithi157.stdout:9/452: rmdir d0/d36/d37/d40/d4b 39 2024-02-28T16:27:05.815 INFO:tasks.workunit.client.1.smithi157.stdout:5/475: unlink d0/d9/d47/d78/f7c 0 2024-02-28T16:27:05.817 INFO:tasks.workunit.client.1.smithi157.stdout:4/476: truncate d3/da/f5e 1666271 0 2024-02-28T16:27:05.823 INFO:tasks.workunit.client.1.smithi157.stdout:2/539: truncate da/f37 1494107 0 2024-02-28T16:27:05.826 INFO:tasks.workunit.client.1.smithi157.stdout:4/477: symlink d3/da/d37/l9f 0 2024-02-28T16:27:05.830 INFO:tasks.workunit.client.1.smithi157.stdout:6/452: dwrite d2/d7/d8/da/d31/d37/d2d/d53/d69/f7c [0,4194304] 0 2024-02-28T16:27:05.830 INFO:tasks.workunit.client.1.smithi157.stdout:9/453: creat d0/d36/f9b x:0 0 0 2024-02-28T16:27:05.836 INFO:tasks.workunit.client.1.smithi157.stdout:5/476: creat d0/fa5 x:0 0 0 2024-02-28T16:27:05.837 INFO:tasks.workunit.client.1.smithi157.stdout:8/436: truncate d1/d5/d10/f33 3512982 0 2024-02-28T16:27:05.837 INFO:tasks.workunit.client.1.smithi157.stdout:5/477: readlink d0/l32 0 2024-02-28T16:27:05.838 INFO:tasks.workunit.client.1.smithi157.stdout:8/437: fdatasync d1/d5/d23/f69 0 2024-02-28T16:27:05.839 INFO:tasks.workunit.client.1.smithi157.stdout:5/478: dread - d0/d9/f98 zero size 2024-02-28T16:27:05.843 INFO:tasks.workunit.client.1.smithi157.stdout:3/426: truncate d0/d6/d34/d80/f5a 2405545 0 2024-02-28T16:27:05.847 INFO:tasks.workunit.client.1.smithi157.stdout:6/453: dread d2/d17/f21 [0,4194304] 0 2024-02-28T16:27:05.853 INFO:tasks.workunit.client.1.smithi157.stdout:2/540: link da/ld da/d38/d4e/lb0 0 2024-02-28T16:27:05.853 INFO:tasks.workunit.client.1.smithi157.stdout:5/479: write d0/d9/d1b/f67 [4644995,113976] 0 2024-02-28T16:27:05.856 INFO:tasks.workunit.client.1.smithi157.stdout:6/454: dread d2/d7/de/d40/f65 [0,4194304] 0 2024-02-28T16:27:05.856 INFO:tasks.workunit.client.1.smithi157.stdout:9/454: symlink d0/d36/d3f/l9c 0 2024-02-28T16:27:05.857 INFO:tasks.workunit.client.1.smithi157.stdout:4/478: write d3/f51 [506680,94747] 0 2024-02-28T16:27:05.859 INFO:tasks.workunit.client.1.smithi157.stdout:9/455: chown d0/d19/d30/f39 299363333 1 2024-02-28T16:27:05.859 INFO:tasks.workunit.client.1.smithi157.stdout:6/455: stat d2/d7/d8/da/d31/d37/d2d/d66 0 2024-02-28T16:27:05.861 INFO:tasks.workunit.client.1.smithi157.stdout:8/438: mknod d1/d5/d14/d3e/d52/c92 0 2024-02-28T16:27:05.861 INFO:tasks.workunit.client.1.smithi157.stdout:6/456: dread - d2/d17/f5a zero size 2024-02-28T16:27:05.866 INFO:tasks.workunit.client.1.smithi157.stdout:3/427: link d0/d6/d44/f52 d0/d6/d6b/d75/f8a 0 2024-02-28T16:27:05.906 INFO:tasks.workunit.client.1.smithi157.stdout:1/497: sync 2024-02-28T16:27:05.919 INFO:tasks.workunit.client.1.smithi157.stdout:6/457: read d2/d7/d8/da/d31/d37/d2b/f3f [189535,99594] 0 2024-02-28T16:27:05.921 INFO:tasks.workunit.client.1.smithi157.stdout:8/439: creat d1/d5/d14/d3e/f93 x:0 0 0 2024-02-28T16:27:05.923 INFO:tasks.workunit.client.1.smithi157.stdout:1/498: chown d10/d11/l66 2525407 1 2024-02-28T16:27:05.927 INFO:tasks.workunit.client.1.smithi157.stdout:8/440: chown d1/d5/d23/f69 57583054 1 2024-02-28T16:27:05.928 INFO:tasks.workunit.client.1.smithi157.stdout:2/541: getdents da/d38/d7e/d9a 0 2024-02-28T16:27:05.931 INFO:tasks.workunit.client.1.smithi157.stdout:3/428: write d0/d6/d34/d80/d23/d2b/d2e/f54 [1177798,89743] 0 2024-02-28T16:27:05.935 INFO:tasks.workunit.client.1.smithi157.stdout:4/479: dwrite d3/da/d1f/f63 [0,4194304] 0 2024-02-28T16:27:05.937 INFO:tasks.workunit.client.1.smithi157.stdout:9/456: unlink d0/d36/d37/d40/d5b/f6a 0 2024-02-28T16:27:05.938 INFO:tasks.workunit.client.1.smithi157.stdout:1/499: creat d10/d94/f9f x:0 0 0 2024-02-28T16:27:05.945 INFO:tasks.workunit.client.1.smithi157.stdout:3/429: creat d0/d6/d44/d70/f8b x:0 0 0 2024-02-28T16:27:05.956 INFO:tasks.workunit.client.1.smithi157.stdout:8/441: write d1/d5/f21 [1533526,49894] 0 2024-02-28T16:27:05.958 INFO:tasks.workunit.client.1.smithi157.stdout:2/542: truncate da/f1f 5584899 0 2024-02-28T16:27:05.959 INFO:tasks.workunit.client.1.smithi157.stdout:3/430: unlink d0/d6/d34/d80/d23/d2b/c3b 0 2024-02-28T16:27:05.962 INFO:tasks.workunit.client.1.smithi157.stdout:4/480: dwrite d3/d77/f56 [4194304,4194304] 0 2024-02-28T16:27:05.969 INFO:tasks.workunit.client.1.smithi157.stdout:2/543: chown da/l20 1330 1 2024-02-28T16:27:05.972 INFO:tasks.workunit.client.1.smithi157.stdout:4/481: write d3/da/d1f/d22/f83 [63159,67039] 0 2024-02-28T16:27:05.976 INFO:tasks.workunit.client.1.smithi157.stdout:3/431: rename d0/d6/c79 to d0/d6/d44/d4b/c8c 0 2024-02-28T16:27:05.976 INFO:tasks.workunit.client.1.smithi157.stdout:6/458: dwrite d2/d7/d8/da/d31/d3a/f2f [0,4194304] 0 2024-02-28T16:27:05.977 INFO:tasks.workunit.client.1.smithi157.stdout:1/500: dread d10/d11/d3a/f3c [0,4194304] 0 2024-02-28T16:27:05.980 INFO:tasks.workunit.client.1.smithi157.stdout:9/457: dwrite d0/d36/d37/d40/d4b/d96/f99 [0,4194304] 0 2024-02-28T16:27:05.980 INFO:tasks.workunit.client.1.smithi157.stdout:1/501: fdatasync d10/d11/d31/d2a/d70/f96 0 2024-02-28T16:27:05.983 INFO:tasks.workunit.client.1.smithi157.stdout:2/544: creat da/d38/d5a/d79/fb1 x:0 0 0 2024-02-28T16:27:05.983 INFO:tasks.workunit.client.1.smithi157.stdout:8/442: truncate d1/f2 629327 0 2024-02-28T16:27:05.987 INFO:tasks.workunit.client.1.smithi157.stdout:7/511: sync 2024-02-28T16:27:05.988 INFO:tasks.workunit.client.1.smithi157.stdout:8/443: write d1/f2c [9186813,110005] 0 2024-02-28T16:27:05.989 INFO:tasks.workunit.client.1.smithi157.stdout:7/512: stat df/d25/f44 0 2024-02-28T16:27:05.991 INFO:tasks.workunit.client.1.smithi157.stdout:2/545: symlink da/d38/d4e/d91/lb2 0 2024-02-28T16:27:05.995 INFO:tasks.workunit.client.1.smithi157.stdout:8/444: creat d1/d5/d4d/d60/f94 x:0 0 0 2024-02-28T16:27:05.995 INFO:tasks.workunit.client.1.smithi157.stdout:9/458: creat d0/d19/f9d x:0 0 0 2024-02-28T16:27:05.999 INFO:tasks.workunit.client.1.smithi157.stdout:4/482: dwrite d3/da/d1f/d22/f83 [0,4194304] 0 2024-02-28T16:27:05.999 INFO:tasks.workunit.client.1.smithi157.stdout:7/513: symlink df/d1f/d24/la0 0 2024-02-28T16:27:06.005 INFO:tasks.workunit.client.1.smithi157.stdout:1/502: dread d10/d11/d31/f42 [0,4194304] 0 2024-02-28T16:27:06.011 INFO:tasks.workunit.client.1.smithi157.stdout:8/445: write d1/d5/d14/d3e/f8f [536515,124918] 0 2024-02-28T16:27:06.011 INFO:tasks.workunit.client.1.smithi157.stdout:4/483: rmdir d3/d77 39 2024-02-28T16:27:06.011 INFO:tasks.workunit.client.1.smithi157.stdout:9/459: symlink d0/d36/d37/d40/d4b/d96/l9e 0 2024-02-28T16:27:06.017 INFO:tasks.workunit.client.1.smithi157.stdout:6/459: dwrite d2/d7/f24 [4194304,4194304] 0 2024-02-28T16:27:06.019 INFO:tasks.workunit.client.1.smithi157.stdout:4/484: chown d3/c6 53854 1 2024-02-28T16:27:06.019 INFO:tasks.workunit.client.1.smithi157.stdout:7/514: mkdir df/d1f/da1 0 2024-02-28T16:27:06.021 INFO:tasks.workunit.client.1.smithi157.stdout:1/503: dread - d10/d11/d3a/d5c/d6c/d7b/f9d zero size 2024-02-28T16:27:06.022 INFO:tasks.workunit.client.1.smithi157.stdout:2/546: dread da/d38/d5a/d69/f95 [0,4194304] 0 2024-02-28T16:27:06.027 INFO:tasks.workunit.client.1.smithi157.stdout:4/485: creat d3/da/d37/fa0 x:0 0 0 2024-02-28T16:27:06.028 INFO:tasks.workunit.client.1.smithi157.stdout:9/460: symlink d0/d19/l9f 0 2024-02-28T16:27:06.030 INFO:tasks.workunit.client.1.smithi157.stdout:1/504: mkdir d10/da0 0 2024-02-28T16:27:06.034 INFO:tasks.workunit.client.1.smithi157.stdout:2/547: creat da/d38/d5a/d79/fb3 x:0 0 0 2024-02-28T16:27:06.034 INFO:tasks.workunit.client.1.smithi157.stdout:6/460: mknod d2/d7/d8/da/d31/d37/d2d/d66/c89 0 2024-02-28T16:27:06.038 INFO:tasks.workunit.client.1.smithi157.stdout:1/505: fsync d10/f1b 0 2024-02-28T16:27:06.041 INFO:tasks.workunit.client.1.smithi157.stdout:3/432: dwrite d0/d6/d44/d48/f7f [0,4194304] 0 2024-02-28T16:27:06.041 INFO:tasks.workunit.client.1.smithi157.stdout:7/515: rename df/d1f/d24/d4f/f61 to df/d1f/d37/fa2 0 2024-02-28T16:27:06.044 INFO:tasks.workunit.client.1.smithi157.stdout:6/461: write d2/d7/d8/da/d31/d37/d2d/f60 [489833,63419] 0 2024-02-28T16:27:06.045 INFO:tasks.workunit.client.1.smithi157.stdout:2/548: creat da/d38/d7e/fb4 x:0 0 0 2024-02-28T16:27:06.050 INFO:tasks.workunit.client.1.smithi157.stdout:4/486: rename d3/d77/c5c to d3/d8b/ca1 0 2024-02-28T16:27:06.053 INFO:tasks.workunit.client.1.smithi157.stdout:7/516: write df/d1f/d37/d46/f5b [329967,78014] 0 2024-02-28T16:27:06.060 INFO:tasks.workunit.client.1.smithi157.stdout:6/462: creat d2/f8a x:0 0 0 2024-02-28T16:27:06.063 INFO:tasks.workunit.client.1.smithi157.stdout:0/494: sync 2024-02-28T16:27:06.063 INFO:tasks.workunit.client.1.smithi157.stdout:5/480: sync 2024-02-28T16:27:06.065 INFO:tasks.workunit.client.1.smithi157.stdout:6/463: chown d2/d7/l50 528229992 1 2024-02-28T16:27:06.066 INFO:tasks.workunit.client.1.smithi157.stdout:3/433: truncate d0/d6/d44/d70/f8b 751115 0 2024-02-28T16:27:06.066 INFO:tasks.workunit.client.1.smithi157.stdout:9/461: dwrite d0/d19/d30/f4c [0,4194304] 0 2024-02-28T16:27:06.067 INFO:tasks.workunit.client.1.smithi157.stdout:1/506: dread f2 [0,4194304] 0 2024-02-28T16:27:06.067 INFO:tasks.workunit.client.1.smithi157.stdout:8/446: dwrite d1/f2c [4194304,4194304] 0 2024-02-28T16:27:06.071 INFO:tasks.workunit.client.1.smithi157.stdout:7/517: creat df/d25/d79/d9a/fa3 x:0 0 0 2024-02-28T16:27:06.072 INFO:tasks.workunit.client.1.smithi157.stdout:6/464: symlink d2/d7/d8/d78/l8b 0 2024-02-28T16:27:06.073 INFO:tasks.workunit.client.1.smithi157.stdout:0/495: creat d1/d13/d61/faa x:0 0 0 2024-02-28T16:27:06.077 INFO:tasks.workunit.client.1.smithi157.stdout:4/487: write d3/da/f4f [1465579,28471] 0 2024-02-28T16:27:06.080 INFO:tasks.workunit.client.1.smithi157.stdout:5/481: rename d0/d30/f8f to d0/d8/d7e/d82/fa6 0 2024-02-28T16:27:06.083 INFO:tasks.workunit.client.1.smithi157.stdout:8/447: creat d1/d5/d23/d53/f95 x:0 0 0 2024-02-28T16:27:06.084 INFO:tasks.workunit.client.1.smithi157.stdout:9/462: mknod d0/d36/d3f/ca0 0 2024-02-28T16:27:06.085 INFO:tasks.workunit.client.1.smithi157.stdout:2/549: dwrite da/d38/d5a/d69/f95 [0,4194304] 0 2024-02-28T16:27:06.087 INFO:tasks.workunit.client.1.smithi157.stdout:5/482: write d0/d9/f91 [753194,25389] 0 2024-02-28T16:27:06.096 INFO:tasks.workunit.client.1.smithi157.stdout:3/434: write d0/d6/f56 [370466,94048] 0 2024-02-28T16:27:06.099 INFO:tasks.workunit.client.1.smithi157.stdout:6/465: dwrite d2/d7/de/f4e [0,4194304] 0 2024-02-28T16:27:06.101 INFO:tasks.workunit.client.1.smithi157.stdout:9/463: symlink d0/d36/d37/d40/d4b/d96/la1 0 2024-02-28T16:27:06.103 INFO:tasks.workunit.client.1.smithi157.stdout:1/507: getdents d10/d11/d60 0 2024-02-28T16:27:06.105 INFO:tasks.workunit.client.1.smithi157.stdout:9/464: chown d0/d36/d37/f43 5603833 1 2024-02-28T16:27:06.106 INFO:tasks.workunit.client.1.smithi157.stdout:3/435: stat d0/d6/d34/d80/c22 0 2024-02-28T16:27:06.118 INFO:tasks.workunit.client.1.smithi157.stdout:9/465: dread d0/d36/d37/f67 [0,4194304] 0 2024-02-28T16:27:06.119 INFO:tasks.workunit.client.1.smithi157.stdout:6/466: truncate d2/f5 6740229 0 2024-02-28T16:27:06.124 INFO:tasks.workunit.client.1.smithi157.stdout:9/466: mknod d0/d36/d37/d4d/ca2 0 2024-02-28T16:27:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:05 smithi148 ceph-mon[28767]: pgmap v57: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 168 MiB/s wr, 331 op/s 2024-02-28T16:27:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:05 smithi148 ceph-mon[28767]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:06.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:05 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3563768017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:06.126 INFO:tasks.workunit.client.1.smithi157.stdout:4/488: write d3/da/d28/f76 [1396029,73669] 0 2024-02-28T16:27:06.128 INFO:tasks.workunit.client.1.smithi157.stdout:9/467: chown d0/f21 47408779 1 2024-02-28T16:27:06.129 INFO:tasks.workunit.client.1.smithi157.stdout:3/436: getdents d0/d6/d34/d80/d23/d2b/d2e/d7e 0 2024-02-28T16:27:06.131 INFO:tasks.workunit.client.1.smithi157.stdout:9/468: chown d0/d19/f8d 36207291 1 2024-02-28T16:27:06.134 INFO:tasks.workunit.client.1.smithi157.stdout:5/483: truncate d0/d9/f91 49043 0 2024-02-28T16:27:06.138 INFO:tasks.workunit.client.1.smithi157.stdout:9/469: readlink d0/lc 0 2024-02-28T16:27:06.141 INFO:tasks.workunit.client.1.smithi157.stdout:6/467: truncate d2/d7/fc 719378 0 2024-02-28T16:27:06.142 INFO:tasks.workunit.client.1.smithi157.stdout:1/508: write d10/d11/d31/d2a/f4e [121873,18128] 0 2024-02-28T16:27:06.145 INFO:tasks.workunit.client.1.smithi157.stdout:4/489: write d3/da/d1f/f7d [1140554,32846] 0 2024-02-28T16:27:06.149 INFO:tasks.workunit.client.1.smithi157.stdout:5/484: write d0/d30/d50/f63 [43460,116920] 0 2024-02-28T16:27:06.152 INFO:tasks.workunit.client.1.smithi157.stdout:3/437: rename d0/d6/l12 to d0/d6/d34/d80/l8d 0 2024-02-28T16:27:06.155 INFO:tasks.workunit.client.1.smithi157.stdout:8/448: dwrite d1/d5/d14/f42 [0,4194304] 0 2024-02-28T16:27:06.155 INFO:tasks.workunit.client.1.smithi157.stdout:2/550: dwrite da/d38/d4e/f63 [0,4194304] 0 2024-02-28T16:27:06.155 INFO:tasks.workunit.client.1.smithi157.stdout:4/490: write d3/da/d1f/f32 [76714,41637] 0 2024-02-28T16:27:06.161 INFO:tasks.workunit.client.1.smithi157.stdout:6/468: mkdir d2/d7/d8/da/d31/d37/d2d/d8c 0 2024-02-28T16:27:06.162 INFO:tasks.workunit.client.1.smithi157.stdout:4/491: dread d3/da/f20 [0,4194304] 0 2024-02-28T16:27:06.163 INFO:tasks.workunit.client.1.smithi157.stdout:8/449: write d1/d5/d14/d3e/f8f [1164905,103126] 0 2024-02-28T16:27:06.167 INFO:tasks.workunit.client.1.smithi157.stdout:1/509: write d10/d11/d31/d2a/f55 [951953,48864] 0 2024-02-28T16:27:06.169 INFO:tasks.workunit.client.1.smithi157.stdout:1/510: read - d10/d7a/d91/f93 zero size 2024-02-28T16:27:06.172 INFO:tasks.workunit.client.1.smithi157.stdout:4/492: mknod d3/da/d1f/d22/ca2 0 2024-02-28T16:27:06.179 INFO:tasks.workunit.client.1.smithi157.stdout:9/470: truncate d0/f1f 3210862 0 2024-02-28T16:27:06.182 INFO:tasks.workunit.client.1.smithi157.stdout:9/471: rename d0/d36 to d0/d36/d37/d40/d4b/da3 22 2024-02-28T16:27:06.184 INFO:tasks.workunit.client.1.smithi157.stdout:4/493: creat d3/da/d1f/d22/fa3 x:0 0 0 2024-02-28T16:27:06.185 INFO:tasks.workunit.client.1.smithi157.stdout:9/472: fsync d0/d36/d37/f43 0 2024-02-28T16:27:06.185 INFO:tasks.workunit.client.1.smithi157.stdout:8/450: getdents d1/d5/d23/d53 0 2024-02-28T16:27:06.186 INFO:tasks.workunit.client.1.smithi157.stdout:6/469: write d2/d17/f1e [4978423,46207] 0 2024-02-28T16:27:06.191 INFO:tasks.workunit.client.1.smithi157.stdout:5/485: dwrite d0/d8/d51/f7b [0,4194304] 0 2024-02-28T16:27:06.195 INFO:tasks.workunit.client.1.smithi157.stdout:8/451: stat d1/d5/d23/d38/d6e/d85 0 2024-02-28T16:27:06.196 INFO:tasks.workunit.client.1.smithi157.stdout:9/473: symlink d0/la4 0 2024-02-28T16:27:06.196 INFO:tasks.workunit.client.1.smithi157.stdout:6/470: stat d2/d7/d8/da/d31/d37/d2d/f88 0 2024-02-28T16:27:06.197 INFO:tasks.workunit.client.1.smithi157.stdout:5/486: truncate d0/d9/f98 662007 0 2024-02-28T16:27:06.197 INFO:tasks.workunit.client.1.smithi157.stdout:0/496: dread d1/d8/d33/f39 [0,4194304] 0 2024-02-28T16:27:06.202 INFO:tasks.workunit.client.1.smithi157.stdout:4/494: dread d3/f13 [4194304,4194304] 0 2024-02-28T16:27:06.203 INFO:tasks.workunit.client.1.smithi157.stdout:0/497: unlink d1/d13/f48 0 2024-02-28T16:27:06.209 INFO:tasks.workunit.client.1.smithi157.stdout:4/495: creat d3/da/d37/fa4 x:0 0 0 2024-02-28T16:27:06.209 INFO:tasks.workunit.client.1.smithi157.stdout:0/498: creat d1/da/d6c/fab x:0 0 0 2024-02-28T16:27:06.212 INFO:tasks.workunit.client.1.smithi157.stdout:9/474: link d0/fb d0/d36/d37/d40/d5b/fa5 0 2024-02-28T16:27:06.222 INFO:tasks.workunit.client.1.smithi157.stdout:0/499: link d1/d13/d61/d64/f78 d1/d13/d57/fac 0 2024-02-28T16:27:06.224 INFO:tasks.workunit.client.1.smithi157.stdout:1/511: truncate d10/d11/d3a/d5c/d6c/d7b/f26 6653959 0 2024-02-28T16:27:06.228 INFO:tasks.workunit.client.1.smithi157.stdout:3/438: dread d0/d6/d34/d80/f7b [0,4194304] 0 2024-02-28T16:27:06.228 INFO:tasks.workunit.client.1.smithi157.stdout:6/471: dwrite d2/d17/f2a [0,4194304] 0 2024-02-28T16:27:06.231 INFO:tasks.workunit.client.1.smithi157.stdout:8/452: truncate d1/d5/d10/f35 3274855 0 2024-02-28T16:27:06.237 INFO:tasks.workunit.client.1.smithi157.stdout:9/475: dread d0/d19/f29 [0,4194304] 0 2024-02-28T16:27:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:05 smithi157 ceph-mon[38346]: pgmap v57: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 168 MiB/s wr, 331 op/s 2024-02-28T16:27:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:05 smithi157 ceph-mon[38346]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:06.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:05 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3563768017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:06.240 INFO:tasks.workunit.client.1.smithi157.stdout:7/518: sync 2024-02-28T16:27:06.242 INFO:tasks.workunit.client.1.smithi157.stdout:0/500: dread d1/da/f2f [0,4194304] 0 2024-02-28T16:27:06.245 INFO:tasks.workunit.client.1.smithi157.stdout:4/496: dwrite d3/da/d37/f50 [0,4194304] 0 2024-02-28T16:27:06.245 INFO:tasks.workunit.client.1.smithi157.stdout:3/439: mkdir d0/d6/d44/d8e 0 2024-02-28T16:27:06.247 INFO:tasks.workunit.client.1.smithi157.stdout:6/472: chown d2/d7/d8/da/d31/d37/d2b/f3f 1010655 1 2024-02-28T16:27:06.250 INFO:tasks.workunit.client.1.smithi157.stdout:5/487: dwrite d0/d9/d1b/d36/f2a [0,4194304] 0 2024-02-28T16:27:06.253 INFO:tasks.workunit.client.1.smithi157.stdout:4/497: read d3/da/d37/d71/f73 [720850,97644] 0 2024-02-28T16:27:06.259 INFO:tasks.workunit.client.1.smithi157.stdout:8/453: rename d1/d5/d10/d74 to d1/d5/d43/d86/d96 0 2024-02-28T16:27:06.261 INFO:tasks.workunit.client.1.smithi157.stdout:7/519: mknod df/d4b/d4c/ca4 0 2024-02-28T16:27:06.268 INFO:tasks.workunit.client.1.smithi157.stdout:7/520: write df/d80/d84/f9c [1516806,25285] 0 2024-02-28T16:27:06.270 INFO:tasks.workunit.client.1.smithi157.stdout:3/440: creat d0/d6/d34/d80/d5c/f8f x:0 0 0 2024-02-28T16:27:06.273 INFO:tasks.workunit.client.1.smithi157.stdout:6/473: symlink d2/d7/de/d1b/d4d/d6c/l8d 0 2024-02-28T16:27:06.274 INFO:tasks.workunit.client.1.smithi157.stdout:8/454: read - d1/d5/d23/d38/d6e/f87 zero size 2024-02-28T16:27:06.274 INFO:tasks.workunit.client.1.smithi157.stdout:7/521: read df/d1f/d24/d39/d64/f74 [1639294,24638] 0 2024-02-28T16:27:06.288 INFO:tasks.workunit.client.1.smithi157.stdout:3/441: write d0/d6/d34/d80/d23/d2b/d2e/f54 [1417062,70421] 0 2024-02-28T16:27:06.292 INFO:tasks.workunit.client.1.smithi157.stdout:7/522: chown df/d1f/d24/d4f/d72 696523 1 2024-02-28T16:27:06.292 INFO:tasks.workunit.client.1.smithi157.stdout:4/498: getdents d3/da/d37 0 2024-02-28T16:27:06.293 INFO:tasks.workunit.client.1.smithi157.stdout:6/474: stat d2/d7/d8/da/d31/d37/d2d/f60 0 2024-02-28T16:27:06.293 INFO:tasks.workunit.client.1.smithi157.stdout:8/455: rename d1/d5/d23/d53/f95 to d1/d5/d43/d86/f97 0 2024-02-28T16:27:06.295 INFO:tasks.workunit.client.1.smithi157.stdout:1/512: dread d10/d11/f8e [0,4194304] 0 2024-02-28T16:27:06.298 INFO:tasks.workunit.client.1.smithi157.stdout:5/488: dwrite d0/d9/f98 [0,4194304] 0 2024-02-28T16:27:06.302 INFO:tasks.workunit.client.1.smithi157.stdout:2/551: sync 2024-02-28T16:27:06.306 INFO:tasks.workunit.client.1.smithi157.stdout:7/523: creat df/d1f/d24/d38/fa5 x:0 0 0 2024-02-28T16:27:06.308 INFO:tasks.workunit.client.1.smithi157.stdout:9/476: dwrite d0/f28 [0,4194304] 0 2024-02-28T16:27:06.312 INFO:tasks.workunit.client.1.smithi157.stdout:0/501: dwrite d1/d13/d57/fac [0,4194304] 0 2024-02-28T16:27:06.313 INFO:tasks.workunit.client.1.smithi157.stdout:9/477: fsync d0/d36/d3f/f75 0 2024-02-28T16:27:06.314 INFO:tasks.workunit.client.1.smithi157.stdout:7/524: fsync df/d25/f2a 0 2024-02-28T16:27:06.319 INFO:tasks.workunit.client.1.smithi157.stdout:4/499: write d3/da/d48/f66 [2980383,4946] 0 2024-02-28T16:27:06.319 INFO:tasks.workunit.client.1.smithi157.stdout:2/552: unlink da/d2b/f3f 0 2024-02-28T16:27:06.323 INFO:tasks.workunit.client.1.smithi157.stdout:0/502: stat d1/d8/c34 0 2024-02-28T16:27:06.324 INFO:tasks.workunit.client.1.smithi157.stdout:1/513: mknod d10/d11/d31/d2a/d70/ca1 0 2024-02-28T16:27:06.325 INFO:tasks.workunit.client.1.smithi157.stdout:2/553: rename da/d38/d5a/d5c to da/d38/d5a/d5c/db5 22 2024-02-28T16:27:06.330 INFO:tasks.workunit.client.1.smithi157.stdout:3/442: getdents d0/d6/d1e 0 2024-02-28T16:27:06.331 INFO:tasks.workunit.client.1.smithi157.stdout:9/478: unlink d0/d36/d37/d4d/c83 0 2024-02-28T16:27:06.333 INFO:tasks.workunit.client.1.smithi157.stdout:1/514: write d10/d11/d3a/d5c/f87 [4286654,92361] 0 2024-02-28T16:27:06.335 INFO:tasks.workunit.client.1.smithi157.stdout:6/475: creat d2/d7/d8/da/f8e x:0 0 0 2024-02-28T16:27:06.338 INFO:tasks.workunit.client.1.smithi157.stdout:2/554: symlink da/d2b/lb6 0 2024-02-28T16:27:06.338 INFO:tasks.workunit.client.1.smithi157.stdout:8/456: dwrite d1/d5/d23/f69 [0,4194304] 0 2024-02-28T16:27:06.341 INFO:tasks.workunit.client.1.smithi157.stdout:6/476: stat d2/d7/d8/d78/d6e/f79 0 2024-02-28T16:27:06.343 INFO:tasks.workunit.client.1.smithi157.stdout:1/515: chown d10/d94/f9f 2455025 1 2024-02-28T16:27:06.347 INFO:tasks.workunit.client.1.smithi157.stdout:5/489: getdents d0/d8/d7e 0 2024-02-28T16:27:06.347 INFO:tasks.workunit.client.1.smithi157.stdout:3/443: chown d0/d6/d6b/d75 628528988 1 2024-02-28T16:27:06.348 INFO:tasks.workunit.client.1.smithi157.stdout:2/555: symlink da/d38/d5a/d69/lb7 0 2024-02-28T16:27:06.349 INFO:tasks.workunit.client.1.smithi157.stdout:9/479: rename d0/f1f to d0/d36/d37/d4d/d92/fa6 0 2024-02-28T16:27:06.350 INFO:tasks.workunit.client.1.smithi157.stdout:8/457: symlink d1/d5/d23/d38/l98 0 2024-02-28T16:27:06.353 INFO:tasks.workunit.client.1.smithi157.stdout:7/525: dwrite df/d1f/d37/f49 [4194304,4194304] 0 2024-02-28T16:27:06.354 INFO:tasks.workunit.client.1.smithi157.stdout:4/500: getdents d3/da/d37 0 2024-02-28T16:27:06.362 INFO:tasks.workunit.client.1.smithi157.stdout:3/444: symlink d0/d6/l90 0 2024-02-28T16:27:06.362 INFO:tasks.workunit.client.1.smithi157.stdout:8/458: stat d1/d5/d23/d38/l39 0 2024-02-28T16:27:06.368 INFO:tasks.workunit.client.1.smithi157.stdout:1/516: creat d10/d11/d3a/d5c/d6c/d7b/d8c/fa2 x:0 0 0 2024-02-28T16:27:06.372 INFO:tasks.workunit.client.1.smithi157.stdout:4/501: symlink d3/da/d48/la5 0 2024-02-28T16:27:06.375 INFO:tasks.workunit.client.1.smithi157.stdout:6/477: getdents d2/d7/d8/da/d31/d37/d2d/d53 0 2024-02-28T16:27:06.377 INFO:tasks.workunit.client.1.smithi157.stdout:9/480: creat d0/d36/d3f/d69/fa7 x:0 0 0 2024-02-28T16:27:06.387 INFO:tasks.workunit.client.1.smithi157.stdout:6/478: readlink d2/d7/d8/d78/l36 0 2024-02-28T16:27:06.389 INFO:tasks.workunit.client.1.smithi157.stdout:0/503: dwrite d1/d13/fe [0,4194304] 0 2024-02-28T16:27:06.389 INFO:tasks.workunit.client.1.smithi157.stdout:5/490: dwrite d0/d8/d51/f87 [0,4194304] 0 2024-02-28T16:27:06.391 INFO:tasks.workunit.client.1.smithi157.stdout:2/556: dwrite da/d38/d5a/d5c/f7a [0,4194304] 0 2024-02-28T16:27:06.396 INFO:tasks.workunit.client.1.smithi157.stdout:3/445: mkdir d0/d6/d34/d80/d23/d2b/d2e/d7e/d91 0 2024-02-28T16:27:06.399 INFO:tasks.workunit.client.1.smithi157.stdout:7/526: dwrite df/d1f/d24/d39/f5f [0,4194304] 0 2024-02-28T16:27:06.402 INFO:tasks.workunit.client.1.smithi157.stdout:8/459: rename d1/d5/f21 to d1/d5/f99 0 2024-02-28T16:27:06.404 INFO:tasks.workunit.client.1.smithi157.stdout:7/527: write f0 [9167067,72219] 0 2024-02-28T16:27:06.407 INFO:tasks.workunit.client.1.smithi157.stdout:2/557: fdatasync da/d38/d5a/f66 0 2024-02-28T16:27:06.413 INFO:tasks.workunit.client.1.smithi157.stdout:2/558: stat da/d65 0 2024-02-28T16:27:06.414 INFO:tasks.workunit.client.1.smithi157.stdout:3/446: write d0/d6/d34/d80/f7b [3615831,46197] 0 2024-02-28T16:27:06.417 INFO:tasks.workunit.client.1.smithi157.stdout:8/460: creat d1/d5/d23/d53/f9a x:0 0 0 2024-02-28T16:27:06.421 INFO:tasks.workunit.client.1.smithi157.stdout:6/479: getdents d2/d7/de/d1b/d4d 0 2024-02-28T16:27:06.427 INFO:tasks.workunit.client.1.smithi157.stdout:6/480: stat d2/d17/f51 0 2024-02-28T16:27:06.428 INFO:tasks.workunit.client.1.smithi157.stdout:7/528: rename df/d4b/d4c/f55 to df/d25/d79/fa6 0 2024-02-28T16:27:06.431 INFO:tasks.workunit.client.1.smithi157.stdout:5/491: read d0/d30/d50/d7f/f8c [2000209,125719] 0 2024-02-28T16:27:06.431 INFO:tasks.workunit.client.1.smithi157.stdout:9/481: dwrite d0/d36/d37/d40/d4b/d96/f99 [0,4194304] 0 2024-02-28T16:27:06.434 INFO:tasks.workunit.client.1.smithi157.stdout:0/504: dread d1/da/d6c/fa1 [0,4194304] 0 2024-02-28T16:27:06.436 INFO:tasks.workunit.client.1.smithi157.stdout:9/482: stat d0/d36/c73 0 2024-02-28T16:27:06.442 INFO:tasks.workunit.client.1.smithi157.stdout:0/505: readlink d1/d13/d46/l3d 0 2024-02-28T16:27:06.443 INFO:tasks.workunit.client.1.smithi157.stdout:2/559: dwrite da/f86 [0,4194304] 0 2024-02-28T16:27:06.446 INFO:tasks.workunit.client.1.smithi157.stdout:2/560: readlink da/d38/d5a/l6d 0 2024-02-28T16:27:06.449 INFO:tasks.workunit.client.1.smithi157.stdout:0/506: write d1/d13/f87 [3524589,117539] 0 2024-02-28T16:27:06.449 INFO:tasks.workunit.client.1.smithi157.stdout:6/481: rename d2/d7/d8/d78 to d2/d7/d8/da/d71/d8f 0 2024-02-28T16:27:06.453 INFO:tasks.workunit.client.1.smithi157.stdout:0/507: fsync d1/d13/d61/d64/f78 0 2024-02-28T16:27:06.455 INFO:tasks.workunit.client.1.smithi157.stdout:2/561: mknod da/d2b/cb8 0 2024-02-28T16:27:06.455 INFO:tasks.workunit.client.1.smithi157.stdout:8/461: creat d1/d5/d14/f9b x:0 0 0 2024-02-28T16:27:06.456 INFO:tasks.workunit.client.1.smithi157.stdout:2/562: chown da/d2b 866084 1 2024-02-28T16:27:06.460 INFO:tasks.workunit.client.1.smithi157.stdout:4/502: truncate d3/da/d28/f5b 429638 0 2024-02-28T16:27:06.461 INFO:tasks.workunit.client.1.smithi157.stdout:5/492: link d0/d30/f5f d0/d8/d51/fa7 0 2024-02-28T16:27:06.463 INFO:tasks.workunit.client.1.smithi157.stdout:1/517: dread d10/d7a/f7d [0,4194304] 0 2024-02-28T16:27:06.464 INFO:tasks.workunit.client.1.smithi157.stdout:2/563: truncate da/ff 387935 0 2024-02-28T16:27:06.466 INFO:tasks.workunit.client.1.smithi157.stdout:6/482: fdatasync d2/f5 0 2024-02-28T16:27:06.469 INFO:tasks.workunit.client.1.smithi157.stdout:5/493: creat d0/d8/fa8 x:0 0 0 2024-02-28T16:27:06.477 INFO:tasks.workunit.client.1.smithi157.stdout:5/494: write d0/d8/fb [1031922,121277] 0 2024-02-28T16:27:06.482 INFO:tasks.workunit.client.1.smithi157.stdout:7/529: dread fd [0,4194304] 0 2024-02-28T16:27:06.485 INFO:tasks.workunit.client.1.smithi157.stdout:9/483: truncate d0/f28 1662114 0 2024-02-28T16:27:06.493 INFO:tasks.workunit.client.1.smithi157.stdout:1/518: link d10/d11/d3a/d5c/d84/l8a d10/d11/d31/d2a/d70/la3 0 2024-02-28T16:27:06.506 INFO:tasks.workunit.client.1.smithi157.stdout:3/447: dwrite d0/d6/d34/d80/f5a [0,4194304] 0 2024-02-28T16:27:06.506 INFO:tasks.workunit.client.1.smithi157.stdout:7/530: unlink df/d25/d79/f8f 0 2024-02-28T16:27:06.510 INFO:tasks.workunit.client.1.smithi157.stdout:5/495: rename d0/d30/c97 to d0/d8/ca9 0 2024-02-28T16:27:06.513 INFO:tasks.workunit.client.1.smithi157.stdout:0/508: dwrite d1/d8/d33/f9e [0,4194304] 0 2024-02-28T16:27:06.514 INFO:tasks.workunit.client.1.smithi157.stdout:8/462: dwrite d1/d5/f4a [0,4194304] 0 2024-02-28T16:27:06.522 INFO:tasks.workunit.client.1.smithi157.stdout:5/496: chown d0/d9/d1b/d36/f38 1414460 1 2024-02-28T16:27:06.527 INFO:tasks.workunit.client.1.smithi157.stdout:7/531: truncate fb 1150749 0 2024-02-28T16:27:06.528 INFO:tasks.workunit.client.1.smithi157.stdout:6/483: dwrite d2/f1f [0,4194304] 0 2024-02-28T16:27:06.528 INFO:tasks.workunit.client.1.smithi157.stdout:4/503: dwrite d3/da/d1f/f27 [0,4194304] 0 2024-02-28T16:27:06.529 INFO:tasks.workunit.client.1.smithi157.stdout:8/463: creat d1/f9c x:0 0 0 2024-02-28T16:27:06.532 INFO:tasks.workunit.client.1.smithi157.stdout:1/519: mkdir d10/d11/d3a/d95/da4 0 2024-02-28T16:27:06.542 INFO:tasks.workunit.client.1.smithi157.stdout:1/520: fdatasync d10/d11/d3a/d5c/d6c/d7b/d8c/fa2 0 2024-02-28T16:27:06.542 INFO:tasks.workunit.client.1.smithi157.stdout:6/484: read - d2/d7/d8/da/d31/d37/d2d/d66/f84 zero size 2024-02-28T16:27:06.542 INFO:tasks.workunit.client.1.smithi157.stdout:3/448: read d0/f1c [4084665,130357] 0 2024-02-28T16:27:06.542 INFO:tasks.workunit.client.1.smithi157.stdout:1/521: chown f4 0 1 2024-02-28T16:27:06.544 INFO:tasks.workunit.client.1.smithi157.stdout:0/509: symlink d1/d8/d33/lad 0 2024-02-28T16:27:06.548 INFO:tasks.workunit.client.1.smithi157.stdout:9/484: link d0/d36/d37/d40/c4e d0/d36/ca8 0 2024-02-28T16:27:06.548 INFO:tasks.workunit.client.1.smithi157.stdout:1/522: symlink d10/d7a/la5 0 2024-02-28T16:27:06.549 INFO:tasks.workunit.client.1.smithi157.stdout:5/497: link d0/d9/d47/d5b/d89/f83 d0/d9/d47/d78/faa 0 2024-02-28T16:27:06.550 INFO:tasks.workunit.client.1.smithi157.stdout:4/504: chown d3/f5f 312091 1 2024-02-28T16:27:06.552 INFO:tasks.workunit.client.1.smithi157.stdout:0/510: dread - d1/d13/d61/d64/f85 zero size 2024-02-28T16:27:06.553 INFO:tasks.workunit.client.1.smithi157.stdout:1/523: readlink d10/d11/d3a/d5c/d6c/d7b/l68 0 2024-02-28T16:27:06.554 INFO:tasks.workunit.client.1.smithi157.stdout:5/498: fdatasync d0/d30/f5f 0 2024-02-28T16:27:06.556 INFO:tasks.workunit.client.1.smithi157.stdout:0/511: creat d1/d13/d57/fae x:0 0 0 2024-02-28T16:27:06.558 INFO:tasks.workunit.client.1.smithi157.stdout:5/499: stat d0/d8/d7e/f9a 0 2024-02-28T16:27:06.559 INFO:tasks.workunit.client.1.smithi157.stdout:9/485: read d0/fb [981118,103675] 0 2024-02-28T16:27:06.562 INFO:tasks.workunit.client.1.smithi157.stdout:0/512: write d1/d13/d57/fac [3053859,37968] 0 2024-02-28T16:27:06.565 INFO:tasks.workunit.client.1.smithi157.stdout:9/486: fdatasync d0/d36/d37/f67 0 2024-02-28T16:27:06.570 INFO:tasks.workunit.client.1.smithi157.stdout:5/500: rename d0/d30/d50/d7f/d94 to d0/d9/d47/d5b/d89/d75/dab 0 2024-02-28T16:27:06.572 INFO:tasks.workunit.client.1.smithi157.stdout:5/501: stat d0/f34 0 2024-02-28T16:27:06.573 INFO:tasks.workunit.client.1.smithi157.stdout:1/524: dread d10/d7a/f7d [0,4194304] 0 2024-02-28T16:27:06.574 INFO:tasks.workunit.client.1.smithi157.stdout:5/502: fsync d0/d9/d1b/fa4 0 2024-02-28T16:27:06.574 INFO:tasks.workunit.client.1.smithi157.stdout:0/513: rename d1/d8/c9a to d1/d13/d57/caf 0 2024-02-28T16:27:06.576 INFO:tasks.workunit.client.1.smithi157.stdout:0/514: chown d1/d13/f80 25356365 1 2024-02-28T16:27:06.578 INFO:tasks.workunit.client.1.smithi157.stdout:5/503: mknod d0/d8/cac 0 2024-02-28T16:27:06.578 INFO:tasks.workunit.client.1.smithi157.stdout:0/515: stat d1/d13/d57/fac 0 2024-02-28T16:27:06.581 INFO:tasks.workunit.client.1.smithi157.stdout:5/504: readlink d0/d9/d47/d5b/l6e 0 2024-02-28T16:27:06.584 INFO:tasks.workunit.client.1.smithi157.stdout:0/516: unlink d1/d8/d33/f49 0 2024-02-28T16:27:06.596 INFO:tasks.workunit.client.1.smithi157.stdout:8/464: truncate d1/d5/d4d/f88 1178820 0 2024-02-28T16:27:06.598 INFO:tasks.workunit.client.1.smithi157.stdout:8/465: chown d1/d5/l28 124513 1 2024-02-28T16:27:06.600 INFO:tasks.workunit.client.1.smithi157.stdout:4/505: write d3/da/d1f/f26 [3627987,130054] 0 2024-02-28T16:27:06.600 INFO:tasks.workunit.client.1.smithi157.stdout:5/505: dread d0/d9/f79 [0,4194304] 0 2024-02-28T16:27:06.603 INFO:tasks.workunit.client.1.smithi157.stdout:4/506: chown d3/da/d1f/c43 126 1 2024-02-28T16:27:06.606 INFO:tasks.workunit.client.1.smithi157.stdout:8/466: link d1/d5/fe d1/d5/d23/d38/d6e/d85/f9d 0 2024-02-28T16:27:06.610 INFO:tasks.workunit.client.1.smithi157.stdout:4/507: mknod d3/da/d48/ca6 0 2024-02-28T16:27:06.616 INFO:tasks.workunit.client.1.smithi157.stdout:4/508: rmdir d3/da/d37/d71 39 2024-02-28T16:27:06.622 INFO:tasks.workunit.client.1.smithi157.stdout:3/449: dread d0/d6/d34/d80/d23/d2b/d2e/f33 [0,4194304] 0 2024-02-28T16:27:06.628 INFO:tasks.workunit.client.1.smithi157.stdout:1/525: write f2 [791620,116871] 0 2024-02-28T16:27:06.632 INFO:tasks.workunit.client.1.smithi157.stdout:5/506: dread d0/d30/d50/d7f/f92 [0,4194304] 0 2024-02-28T16:27:06.633 INFO:tasks.workunit.client.1.smithi157.stdout:1/526: fsync d10/d11/d3a/d5c/f87 0 2024-02-28T16:27:06.634 INFO:tasks.workunit.client.1.smithi157.stdout:7/532: dread df/d1f/d24/d39/f5c [0,4194304] 0 2024-02-28T16:27:06.643 INFO:tasks.workunit.client.1.smithi157.stdout:1/527: readlink d10/d11/d31/d2a/d70/l59 0 2024-02-28T16:27:06.644 INFO:tasks.workunit.client.1.smithi157.stdout:3/450: getdents d0/d6/d6b 0 2024-02-28T16:27:06.644 INFO:tasks.workunit.client.1.smithi157.stdout:2/564: dread da/f2a [0,4194304] 0 2024-02-28T16:27:06.644 INFO:tasks.workunit.client.1.smithi157.stdout:8/467: dread d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:06.645 INFO:tasks.workunit.client.1.smithi157.stdout:5/507: read d0/d9/d47/f4f [1785943,92084] 0 2024-02-28T16:27:06.652 INFO:tasks.workunit.client.1.smithi157.stdout:3/451: fsync d0/d6/d34/d80/d23/d2b/d6d/f77 0 2024-02-28T16:27:06.652 INFO:tasks.workunit.client.1.smithi157.stdout:8/468: fdatasync d1/d5/d23/f6b 0 2024-02-28T16:27:06.654 INFO:tasks.workunit.client.1.smithi157.stdout:7/533: rename df/d1f/d24/d4f/d72/d75 to df/d25/da7 0 2024-02-28T16:27:06.654 INFO:tasks.workunit.client.1.smithi157.stdout:4/509: dwrite d3/da/d1f/f40 [0,4194304] 0 2024-02-28T16:27:06.656 INFO:tasks.workunit.client.1.smithi157.stdout:1/528: dread d10/f12 [0,4194304] 0 2024-02-28T16:27:06.658 INFO:tasks.workunit.client.1.smithi157.stdout:2/565: truncate da/f1f 6518358 0 2024-02-28T16:27:06.659 INFO:tasks.workunit.client.1.smithi157.stdout:8/469: mknod d1/d5/d23/d53/c9e 0 2024-02-28T16:27:06.662 INFO:tasks.workunit.client.1.smithi157.stdout:7/534: truncate df/d80/d84/f9c 1779346 0 2024-02-28T16:27:06.663 INFO:tasks.workunit.client.1.smithi157.stdout:9/487: dread d0/d36/d37/d40/d4b/f6d [0,4194304] 0 2024-02-28T16:27:06.664 INFO:tasks.workunit.client.1.smithi157.stdout:5/508: rename d0/d8/d51/d61 to d0/d9/d47/dad 0 2024-02-28T16:27:06.665 INFO:tasks.workunit.client.1.smithi157.stdout:3/452: rmdir d0/d6/d1e 39 2024-02-28T16:27:06.668 INFO:tasks.workunit.client.1.smithi157.stdout:7/535: truncate df/d25/d79/d9a/fa3 741238 0 2024-02-28T16:27:06.669 INFO:tasks.workunit.client.1.smithi157.stdout:8/470: rmdir d1/d5/d14/d3e/d52/d54 39 2024-02-28T16:27:06.670 INFO:tasks.workunit.client.1.smithi157.stdout:7/536: chown df/d25/d79 227826838 1 2024-02-28T16:27:06.672 INFO:tasks.workunit.client.1.smithi157.stdout:9/488: symlink d0/d19/d30/d78/la9 0 2024-02-28T16:27:06.673 INFO:tasks.workunit.client.1.smithi157.stdout:5/509: creat d0/d30/d50/fae x:0 0 0 2024-02-28T16:27:06.675 INFO:tasks.workunit.client.1.smithi157.stdout:1/529: unlink d10/d11/l3b 0 2024-02-28T16:27:06.676 INFO:tasks.workunit.client.1.smithi157.stdout:3/453: creat d0/d6/d34/d80/d23/d2b/d2e/d7e/f92 x:0 0 0 2024-02-28T16:27:06.677 INFO:tasks.workunit.client.1.smithi157.stdout:8/471: write d1/d5/d23/d38/d67/d6d/f7e [3862636,112112] 0 2024-02-28T16:27:06.680 INFO:tasks.workunit.client.1.smithi157.stdout:2/566: creat da/d38/d3e/fb9 x:0 0 0 2024-02-28T16:27:06.683 INFO:tasks.workunit.client.1.smithi157.stdout:9/489: write d0/d19/d30/d79/f87 [702389,68965] 0 2024-02-28T16:27:06.685 INFO:tasks.workunit.client.1.smithi157.stdout:4/510: dwrite d3/f8a [0,4194304] 0 2024-02-28T16:27:06.685 INFO:tasks.workunit.client.1.smithi157.stdout:5/510: mkdir d0/d9/d1b/d36/daf 0 2024-02-28T16:27:06.686 INFO:tasks.workunit.client.1.smithi157.stdout:9/490: fdatasync d0/d36/d37/d40/f62 0 2024-02-28T16:27:06.687 INFO:tasks.workunit.client.1.smithi157.stdout:8/472: symlink d1/d5/d10/l9f 0 2024-02-28T16:27:06.688 INFO:tasks.workunit.client.1.smithi157.stdout:8/473: chown d1/d5/d43 1320782 1 2024-02-28T16:27:06.693 INFO:tasks.workunit.client.1.smithi157.stdout:2/567: read da/f37 [183143,21216] 0 2024-02-28T16:27:06.696 INFO:tasks.workunit.client.1.smithi157.stdout:2/568: chown da/d65/d90/f53 304282 1 2024-02-28T16:27:06.696 INFO:tasks.workunit.client.1.smithi157.stdout:7/537: link df/d25/f44 df/d80/fa8 0 2024-02-28T16:27:06.698 INFO:tasks.workunit.client.1.smithi157.stdout:2/569: chown da/d38/c85 8899 1 2024-02-28T16:27:06.699 INFO:tasks.workunit.client.1.smithi157.stdout:7/538: truncate df/d1f/d24/d39/f5f 4668810 0 2024-02-28T16:27:06.701 INFO:tasks.workunit.client.1.smithi157.stdout:7/539: stat df/d1f/d24/d4f/l56 0 2024-02-28T16:27:06.703 INFO:tasks.workunit.client.1.smithi157.stdout:1/530: rename d10/d11/f65 to d10/d11/d3a/d5c/d6a/fa6 0 2024-02-28T16:27:06.706 INFO:tasks.workunit.client.1.smithi157.stdout:4/511: mknod d3/d77/ca7 0 2024-02-28T16:27:06.707 INFO:tasks.workunit.client.1.smithi157.stdout:3/454: creat d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/f93 x:0 0 0 2024-02-28T16:27:06.717 INFO:tasks.workunit.client.1.smithi157.stdout:2/570: symlink da/d38/d4e/d91/lba 0 2024-02-28T16:27:06.718 INFO:tasks.workunit.client.1.smithi157.stdout:2/571: readlink da/d8c/l9c 0 2024-02-28T16:27:06.723 INFO:tasks.workunit.client.1.smithi157.stdout:7/540: chown df/d25/d79/l7f 9892 1 2024-02-28T16:27:06.724 INFO:tasks.workunit.client.1.smithi157.stdout:7/541: chown df/d1f/d37/d46/l6c 7395 1 2024-02-28T16:27:06.730 INFO:tasks.workunit.client.1.smithi157.stdout:9/491: truncate d0/d36/d37/f43 2506586 0 2024-02-28T16:27:06.731 INFO:tasks.workunit.client.1.smithi157.stdout:8/474: fsync d1/d5/d10/f35 0 2024-02-28T16:27:06.733 INFO:tasks.workunit.client.1.smithi157.stdout:2/572: mkdir da/d38/d7e/dbb 0 2024-02-28T16:27:06.737 INFO:tasks.workunit.client.1.smithi157.stdout:1/531: creat d10/d11/d7e/fa7 x:0 0 0 2024-02-28T16:27:06.738 INFO:tasks.workunit.client.1.smithi157.stdout:7/542: symlink df/d80/la9 0 2024-02-28T16:27:06.740 INFO:tasks.workunit.client.1.smithi157.stdout:7/543: write df/d1f/d24/f33 [6694803,92387] 0 2024-02-28T16:27:06.741 INFO:tasks.workunit.client.1.smithi157.stdout:7/544: readlink df/d1f/d37/l50 0 2024-02-28T16:27:06.742 INFO:tasks.workunit.client.1.smithi157.stdout:4/512: truncate d3/da/d48/f7c 975915 0 2024-02-28T16:27:06.743 INFO:tasks.workunit.client.1.smithi157.stdout:3/455: mknod d0/d6/d44/d70/c94 0 2024-02-28T16:27:06.745 INFO:tasks.workunit.client.1.smithi157.stdout:9/492: write d0/d36/d37/d40/d4b/f6d [3907757,15953] 0 2024-02-28T16:27:06.747 INFO:tasks.workunit.client.1.smithi157.stdout:8/475: rmdir d1/d5/d14/d3e 39 2024-02-28T16:27:06.751 INFO:tasks.workunit.client.1.smithi157.stdout:2/573: creat da/d2b/d59/fbc x:0 0 0 2024-02-28T16:27:06.751 INFO:tasks.workunit.client.1.smithi157.stdout:1/532: creat d10/d7a/d91/fa8 x:0 0 0 2024-02-28T16:27:06.754 INFO:tasks.workunit.client.1.smithi157.stdout:4/513: read d3/da/f2d [2853072,107031] 0 2024-02-28T16:27:06.755 INFO:tasks.workunit.client.1.smithi157.stdout:7/545: creat df/d25/d79/d9a/faa x:0 0 0 2024-02-28T16:27:06.758 INFO:tasks.workunit.client.1.smithi157.stdout:7/546: write df/d25/d4e/d67/f45 [1745444,4177] 0 2024-02-28T16:27:06.761 INFO:tasks.workunit.client.1.smithi157.stdout:9/493: dwrite d0/d19/d30/f54 [0,4194304] 0 2024-02-28T16:27:06.762 INFO:tasks.workunit.client.1.smithi157.stdout:7/547: truncate df/d1f/d24/d38/f83 973194 0 2024-02-28T16:27:06.763 INFO:tasks.workunit.client.1.smithi157.stdout:9/494: chown d0/d19/d30/d78/la9 458043 1 2024-02-28T16:27:06.767 INFO:tasks.workunit.client.1.smithi157.stdout:8/476: creat d1/d5/d23/fa0 x:0 0 0 2024-02-28T16:27:06.770 INFO:tasks.workunit.client.1.smithi157.stdout:9/495: mkdir d0/d36/daa 0 2024-02-28T16:27:06.771 INFO:tasks.workunit.client.1.smithi157.stdout:1/533: mknod d10/d11/d31/d2a/ca9 0 2024-02-28T16:27:06.772 INFO:tasks.workunit.client.1.smithi157.stdout:1/534: chown c8 245439 1 2024-02-28T16:27:06.774 INFO:tasks.workunit.client.1.smithi157.stdout:9/496: stat d0/d36/d37/d40/d4b/d96 0 2024-02-28T16:27:06.775 INFO:tasks.workunit.client.1.smithi157.stdout:8/477: mkdir d1/d5/d23/da1 0 2024-02-28T16:27:06.776 INFO:tasks.workunit.client.1.smithi157.stdout:3/456: dwrite d0/f1c [0,4194304] 0 2024-02-28T16:27:06.776 INFO:tasks.workunit.client.1.smithi157.stdout:9/497: chown d0/d36/c73 1993195 1 2024-02-28T16:27:06.780 INFO:tasks.workunit.client.1.smithi157.stdout:3/457: rmdir d0 39 2024-02-28T16:27:06.792 INFO:tasks.workunit.client.1.smithi157.stdout:9/498: creat d0/fab x:0 0 0 2024-02-28T16:27:06.793 INFO:tasks.workunit.client.1.smithi157.stdout:7/548: dread df/d1f/d24/d4f/d72/f97 [0,4194304] 0 2024-02-28T16:27:06.799 INFO:tasks.workunit.client.1.smithi157.stdout:1/535: dwrite f2 [0,4194304] 0 2024-02-28T16:27:06.799 INFO:tasks.workunit.client.1.smithi157.stdout:7/549: mkdir df/d1f/d24/d4f/d72/dab 0 2024-02-28T16:27:06.802 INFO:tasks.workunit.client.1.smithi157.stdout:7/550: creat df/d1f/d24/d39/fac x:0 0 0 2024-02-28T16:27:06.809 INFO:tasks.workunit.client.1.smithi157.stdout:7/551: symlink df/d25/d4e/lad 0 2024-02-28T16:27:06.809 INFO:tasks.workunit.client.1.smithi157.stdout:7/552: stat df/d1f/d24 0 2024-02-28T16:27:06.814 INFO:tasks.workunit.client.1.smithi157.stdout:7/553: unlink df/d25/d4e/d67/f92 0 2024-02-28T16:27:06.815 INFO:tasks.workunit.client.1.smithi157.stdout:7/554: fdatasync df/d1f/d24/d38/f83 0 2024-02-28T16:27:06.821 INFO:tasks.workunit.client.1.smithi157.stdout:7/555: creat df/fae x:0 0 0 2024-02-28T16:27:06.822 INFO:tasks.workunit.client.1.smithi157.stdout:6/485: sync 2024-02-28T16:27:06.828 INFO:tasks.workunit.client.1.smithi157.stdout:6/486: creat d2/d7/d8/da/d31/d37/d2d/d53/f90 x:0 0 0 2024-02-28T16:27:06.840 INFO:tasks.workunit.client.1.smithi157.stdout:6/487: chown d2/d7/d8/da/d31/d37/d2b/f3f 75792 1 2024-02-28T16:27:06.841 INFO:tasks.workunit.client.1.smithi157.stdout:8/478: dwrite d1/d5/d23/d38/d6e/d85/f9d [0,4194304] 0 2024-02-28T16:27:06.844 INFO:tasks.workunit.client.1.smithi157.stdout:1/536: truncate d10/d11/d22/f69 1194311 0 2024-02-28T16:27:06.845 INFO:tasks.workunit.client.1.smithi157.stdout:3/458: dwrite d0/d6/d44/f52 [4194304,4194304] 0 2024-02-28T16:27:06.856 INFO:tasks.workunit.client.1.smithi157.stdout:6/488: creat d2/d7/d8/da/f91 x:0 0 0 2024-02-28T16:27:06.856 INFO:tasks.workunit.client.1.smithi157.stdout:3/459: write d0/f46 [1846727,72469] 0 2024-02-28T16:27:06.862 INFO:tasks.workunit.client.1.smithi157.stdout:8/479: creat d1/d5/d23/da1/fa2 x:0 0 0 2024-02-28T16:27:06.866 INFO:tasks.workunit.client.1.smithi157.stdout:7/556: truncate df/d1f/d24/d39/f5c 1112383 0 2024-02-28T16:27:06.871 INFO:tasks.workunit.client.1.smithi157.stdout:7/557: write df/d1f/d37/f49 [6929762,109856] 0 2024-02-28T16:27:06.872 INFO:tasks.workunit.client.1.smithi157.stdout:6/489: mkdir d2/d7/d92 0 2024-02-28T16:27:06.873 INFO:tasks.workunit.client.1.smithi157.stdout:8/480: symlink d1/d5/d23/da1/la3 0 2024-02-28T16:27:06.877 INFO:tasks.workunit.client.1.smithi157.stdout:1/537: dwrite d10/d11/d31/d2a/f5d [0,4194304] 0 2024-02-28T16:27:06.884 INFO:tasks.workunit.client.1.smithi157.stdout:7/558: unlink df/d1f/d24/d38/fa5 0 2024-02-28T16:27:06.886 INFO:tasks.workunit.client.1.smithi157.stdout:1/538: rename d10/d11/f2e to d10/d11/d22/faa 0 2024-02-28T16:27:06.888 INFO:tasks.workunit.client.1.smithi157.stdout:8/481: unlink d1/d5/d23/d38/d6e/l81 0 2024-02-28T16:27:06.897 INFO:tasks.workunit.client.1.smithi157.stdout:6/490: dwrite d2/d7/d38/f87 [0,4194304] 0 2024-02-28T16:27:06.897 INFO:tasks.workunit.client.1.smithi157.stdout:8/482: mkdir d1/d5/da4 0 2024-02-28T16:27:06.902 INFO:tasks.workunit.client.1.smithi157.stdout:1/539: read d10/d11/d3a/d5c/d6c/d7b/f26 [1659450,91392] 0 2024-02-28T16:27:06.903 INFO:tasks.workunit.client.1.smithi157.stdout:7/559: link df/d80/d84/c8b df/d25/d79/caf 0 2024-02-28T16:27:06.906 INFO:tasks.workunit.client.1.smithi157.stdout:6/491: mkdir d2/d7/d8/da/d71/d93 0 2024-02-28T16:27:06.909 INFO:tasks.workunit.client.1.smithi157.stdout:3/460: dread d0/d6/d6b/d75/f8a [0,4194304] 0 2024-02-28T16:27:06.922 INFO:tasks.workunit.client.1.smithi157.stdout:3/461: unlink d0/d6/d44/c5d 0 2024-02-28T16:27:06.922 INFO:tasks.workunit.client.1.smithi157.stdout:3/462: stat d0/d6/d1e/f1f 0 2024-02-28T16:27:06.934 INFO:tasks.workunit.client.1.smithi157.stdout:6/492: dwrite d2/d7/d8/da/d31/d3a/f2f [4194304,4194304] 0 2024-02-28T16:27:06.937 INFO:tasks.workunit.client.1.smithi157.stdout:6/493: read - d2/d7/d8/da/d31/d37/d2d/d66/f84 zero size 2024-02-28T16:27:06.943 INFO:tasks.workunit.client.1.smithi157.stdout:1/540: dwrite f4 [0,4194304] 0 2024-02-28T16:27:06.946 INFO:tasks.workunit.client.1.smithi157.stdout:8/483: dwrite d1/d5/d4d/f88 [0,4194304] 0 2024-02-28T16:27:06.949 INFO:tasks.workunit.client.1.smithi157.stdout:1/541: truncate d10/d11/d3a/d5c/d6c/f92 861270 0 2024-02-28T16:27:06.951 INFO:tasks.workunit.client.1.smithi157.stdout:1/542: stat d10/d11/d31/d2a/d70/l4a 0 2024-02-28T16:27:06.953 INFO:tasks.workunit.client.1.smithi157.stdout:6/494: mknod d2/d7/de/d1b/d3d/c94 0 2024-02-28T16:27:06.953 INFO:tasks.workunit.client.1.smithi157.stdout:3/463: creat d0/d6/d44/d70/d71/d87/f95 x:0 0 0 2024-02-28T16:27:06.956 INFO:tasks.workunit.client.1.smithi157.stdout:1/543: mkdir d10/d11/d22/d99/dab 0 2024-02-28T16:27:06.956 INFO:tasks.workunit.client.1.smithi157.stdout:3/464: fsync d0/d6/f2d 0 2024-02-28T16:27:06.961 INFO:tasks.workunit.client.1.smithi157.stdout:3/465: stat d0/d6/d6b 0 2024-02-28T16:27:06.961 INFO:tasks.workunit.client.1.smithi157.stdout:8/484: link d1/d5/d10/c3a d1/d5/d4d/d60/ca5 0 2024-02-28T16:27:06.966 INFO:tasks.workunit.client.1.smithi157.stdout:8/485: unlink d1/d5/d23/d38/l39 0 2024-02-28T16:27:06.967 INFO:tasks.workunit.client.1.smithi157.stdout:8/486: readlink d1/d5/d14/l79 0 2024-02-28T16:27:06.976 INFO:tasks.workunit.client.1.smithi157.stdout:3/466: getdents d0/d6/d34 0 2024-02-28T16:27:06.977 INFO:tasks.workunit.client.1.smithi157.stdout:8/487: write d1/d5/d14/d3e/d52/f58 [1672993,85909] 0 2024-02-28T16:27:06.979 INFO:tasks.workunit.client.1.smithi157.stdout:3/467: dread - d0/d6/d44/d70/d71/d87/f95 zero size 2024-02-28T16:27:06.979 INFO:tasks.workunit.client.1.smithi157.stdout:6/495: dread d2/d7/de/d1b/f5d [0,4194304] 0 2024-02-28T16:27:06.982 INFO:tasks.workunit.client.1.smithi157.stdout:8/488: mkdir d1/d5/d43/d86/da6 0 2024-02-28T16:27:06.985 INFO:tasks.workunit.client.1.smithi157.stdout:3/468: mknod d0/d6/d44/d4b/c96 0 2024-02-28T16:27:06.991 INFO:tasks.workunit.client.1.smithi157.stdout:0/517: sync 2024-02-28T16:27:06.992 INFO:tasks.workunit.client.1.smithi157.stdout:3/469: unlink d0/d6/d34/d80/d23/d2b/f31 0 2024-02-28T16:27:06.993 INFO:tasks.workunit.client.1.smithi157.stdout:0/518: chown d1/da/c7c 1654 1 2024-02-28T16:27:06.997 INFO:tasks.workunit.client.1.smithi157.stdout:1/544: dwrite d10/d11/f28 [0,4194304] 0 2024-02-28T16:27:07.004 INFO:tasks.workunit.client.1.smithi157.stdout:8/489: truncate d1/d5/d14/d3e/d52/f58 478498 0 2024-02-28T16:27:07.008 INFO:tasks.workunit.client.1.smithi157.stdout:1/545: dread d10/d11/d31/d2a/f5d [0,4194304] 0 2024-02-28T16:27:07.008 INFO:tasks.workunit.client.1.smithi157.stdout:0/519: rename d1/d13/d57/fac to d1/d8/da8/fb0 0 2024-02-28T16:27:07.009 INFO:tasks.workunit.client.1.smithi157.stdout:3/470: read d0/d6/d44/d48/f6e [982573,42163] 0 2024-02-28T16:27:07.011 INFO:tasks.workunit.client.1.smithi157.stdout:3/471: write d0/d6/d6b/f6c [539914,124269] 0 2024-02-28T16:27:07.011 INFO:tasks.workunit.client.1.smithi157.stdout:6/496: getdents d2/d7/de 0 2024-02-28T16:27:07.013 INFO:tasks.workunit.client.1.smithi157.stdout:6/497: readlink d2/d7/d8/da/d31/d37/d2b/l6a 0 2024-02-28T16:27:07.016 INFO:tasks.workunit.client.1.smithi157.stdout:1/546: chown d10/d11/d22/faa 521822 1 2024-02-28T16:27:07.016 INFO:tasks.workunit.client.1.smithi157.stdout:0/520: creat d1/d8/d33/d96/fb1 x:0 0 0 2024-02-28T16:27:07.017 INFO:tasks.workunit.client.1.smithi157.stdout:3/472: chown d0/d6/l1a 1 1 2024-02-28T16:27:07.020 INFO:tasks.workunit.client.1.smithi157.stdout:1/547: mknod d10/d7a/d91/cac 0 2024-02-28T16:27:07.021 INFO:tasks.workunit.client.1.smithi157.stdout:3/473: mknod d0/d6/d44/d70/c97 0 2024-02-28T16:27:07.023 INFO:tasks.workunit.client.1.smithi157.stdout:6/498: truncate d2/d7/d8/da/d31/d37/d2d/f48 2388348 0 2024-02-28T16:27:07.023 INFO:tasks.workunit.client.1.smithi157.stdout:3/474: chown d0/d6/f2d 22141 1 2024-02-28T16:27:07.026 INFO:tasks.workunit.client.1.smithi157.stdout:6/499: chown d2/d7/f15 3619005 1 2024-02-28T16:27:07.028 INFO:tasks.workunit.client.1.smithi157.stdout:3/475: symlink d0/d6/d34/d80/d23/l98 0 2024-02-28T16:27:07.031 INFO:tasks.workunit.client.1.smithi157.stdout:8/490: dwrite d1/d5/d14/f7d [0,4194304] 0 2024-02-28T16:27:07.033 INFO:tasks.workunit.client.1.smithi157.stdout:8/491: fsync d1/d5/fe 0 2024-02-28T16:27:07.034 INFO:tasks.workunit.client.1.smithi157.stdout:6/500: creat d2/d7/de/d1b/d4d/d6c/f95 x:0 0 0 2024-02-28T16:27:07.036 INFO:tasks.workunit.client.1.smithi157.stdout:0/521: dwrite d1/d8/f1d [0,4194304] 0 2024-02-28T16:27:07.039 INFO:tasks.workunit.client.1.smithi157.stdout:6/501: mkdir d2/d7/d92/d96 0 2024-02-28T16:27:07.048 INFO:tasks.workunit.client.1.smithi157.stdout:0/522: link d1/d8/da8/fb0 d1/d13/d61/fb2 0 2024-02-28T16:27:07.048 INFO:tasks.workunit.client.1.smithi157.stdout:1/548: write d10/d11/d31/d2a/d70/f9c [2110878,84066] 0 2024-02-28T16:27:07.050 INFO:tasks.workunit.client.1.smithi157.stdout:0/523: chown d1/d13/d46/c82 2784 1 2024-02-28T16:27:07.051 INFO:tasks.workunit.client.1.smithi157.stdout:3/476: write d0/f24 [1703948,74772] 0 2024-02-28T16:27:07.054 INFO:tasks.workunit.client.1.smithi157.stdout:1/549: symlink d10/d11/d3a/d5c/d6a/lad 0 2024-02-28T16:27:07.055 INFO:tasks.workunit.client.1.smithi157.stdout:1/550: dread - d10/d7a/d91/fa8 zero size 2024-02-28T16:27:07.058 INFO:tasks.workunit.client.1.smithi157.stdout:1/551: write d10/f6b [600265,128198] 0 2024-02-28T16:27:07.058 INFO:tasks.workunit.client.1.smithi157.stdout:0/524: rename d1/d13/d61/d64/l91 to d1/d8/d27/lb3 0 2024-02-28T16:27:07.061 INFO:tasks.workunit.client.1.smithi157.stdout:0/525: fdatasync d1/d13/d46/d99/f9f 0 2024-02-28T16:27:07.062 INFO:tasks.workunit.client.1.smithi157.stdout:6/502: dwrite d2/d7/d8/da/d31/d37/d2d/d53/f90 [0,4194304] 0 2024-02-28T16:27:07.065 INFO:tasks.workunit.client.1.smithi157.stdout:1/552: creat d10/d94/fae x:0 0 0 2024-02-28T16:27:07.066 INFO:tasks.workunit.client.1.smithi157.stdout:0/526: creat d1/d8/d33/d56/fb4 x:0 0 0 2024-02-28T16:27:07.077 INFO:tasks.workunit.client.1.smithi157.stdout:0/527: rename d1/d13/d61 to d1/d13/d52/db5 0 2024-02-28T16:27:07.079 INFO:tasks.workunit.client.1.smithi157.stdout:6/503: dwrite d2/d17/f1e [4194304,4194304] 0 2024-02-28T16:27:07.080 INFO:tasks.workunit.client.1.smithi157.stdout:3/477: truncate d0/d6/d44/f78 105920 0 2024-02-28T16:27:07.082 INFO:tasks.workunit.client.1.smithi157.stdout:0/528: rmdir d1/d13/d7f 39 2024-02-28T16:27:07.084 INFO:tasks.workunit.client.1.smithi157.stdout:3/478: dread - d0/d6/d34/d80/d23/d2b/d2e/d7e/f92 zero size 2024-02-28T16:27:07.087 INFO:tasks.workunit.client.1.smithi157.stdout:6/504: read d2/d7/d8/da/d71/d8f/f85 [2668040,26451] 0 2024-02-28T16:27:07.089 INFO:tasks.workunit.client.1.smithi157.stdout:6/505: write d2/d7/de/f4e [7624159,72755] 0 2024-02-28T16:27:07.090 INFO:tasks.workunit.client.1.smithi157.stdout:0/529: fsync d1/d13/d46/f4f 0 2024-02-28T16:27:07.091 INFO:tasks.workunit.client.1.smithi157.stdout:3/479: mkdir d0/d6/d34/d80/d5c/d99 0 2024-02-28T16:27:07.091 INFO:tasks.workunit.client.1.smithi157.stdout:6/506: chown d2/d7 335777198 1 2024-02-28T16:27:07.092 INFO:tasks.workunit.client.1.smithi157.stdout:8/492: dread d1/f4f [0,4194304] 0 2024-02-28T16:27:07.094 INFO:tasks.workunit.client.1.smithi157.stdout:1/553: truncate d10/d11/d31/d2a/d70/f9c 1167425 0 2024-02-28T16:27:07.096 INFO:tasks.workunit.client.1.smithi157.stdout:3/480: unlink d0/d6/d44/d4b/c96 0 2024-02-28T16:27:07.102 INFO:tasks.workunit.client.1.smithi157.stdout:0/530: creat d1/d13/d52/db5/d64/fb6 x:0 0 0 2024-02-28T16:27:07.104 INFO:tasks.workunit.client.1.smithi157.stdout:6/507: fsync d2/d7/d8/da/d31/d37/d2b/f5f 0 2024-02-28T16:27:07.108 INFO:tasks.workunit.client.1.smithi157.stdout:8/493: mknod d1/d5/ca7 0 2024-02-28T16:27:07.109 INFO:tasks.workunit.client.1.smithi157.stdout:8/494: chown d1/d5/d23/l36 0 1 2024-02-28T16:27:07.121 INFO:tasks.workunit.client.1.smithi157.stdout:3/481: dread d0/d6/d34/d80/d23/d2b/f32 [0,4194304] 0 2024-02-28T16:27:07.122 INFO:tasks.workunit.client.1.smithi157.stdout:8/495: link d1/d5/d14/d3e/c82 d1/d5/d23/d38/d67/ca8 0 2024-02-28T16:27:07.123 INFO:tasks.workunit.client.1.smithi157.stdout:8/496: readlink d1/d5/l28 0 2024-02-28T16:27:07.124 INFO:tasks.workunit.client.1.smithi157.stdout:3/482: fsync d0/d6/d34/d80/d23/d2b/f57 0 2024-02-28T16:27:07.127 INFO:tasks.workunit.client.1.smithi157.stdout:6/508: dwrite d2/d17/f21 [0,4194304] 0 2024-02-28T16:27:07.127 INFO:tasks.workunit.client.1.smithi157.stdout:8/497: symlink d1/d5/d43/d66/la9 0 2024-02-28T16:27:07.128 INFO:tasks.workunit.client.1.smithi157.stdout:8/498: stat d1/f9c 0 2024-02-28T16:27:07.131 INFO:tasks.workunit.client.1.smithi157.stdout:6/509: creat d2/d7/d38/f97 x:0 0 0 2024-02-28T16:27:07.132 INFO:tasks.workunit.client.1.smithi157.stdout:6/510: dread - d2/f8a zero size 2024-02-28T16:27:07.136 INFO:tasks.workunit.client.1.smithi157.stdout:6/511: fsync d2/d7/d8/da/d71/d80/f81 0 2024-02-28T16:27:07.136 INFO:tasks.workunit.client.1.smithi157.stdout:1/554: dwrite d10/d11/d31/f42 [0,4194304] 0 2024-02-28T16:27:07.137 INFO:tasks.workunit.client.1.smithi157.stdout:0/531: dread d1/d8/d33/d56/f62 [0,4194304] 0 2024-02-28T16:27:07.141 INFO:tasks.workunit.client.1.smithi157.stdout:6/512: write d2/d7/d8/da/d71/d80/f81 [443624,111393] 0 2024-02-28T16:27:07.142 INFO:tasks.workunit.client.1.smithi157.stdout:1/555: write d10/d11/d31/f41 [73757,81874] 0 2024-02-28T16:27:07.144 INFO:tasks.workunit.client.1.smithi157.stdout:0/532: creat d1/d13/d52/db5/d64/fb7 x:0 0 0 2024-02-28T16:27:07.145 INFO:tasks.workunit.client.1.smithi157.stdout:8/499: truncate d1/d5/f4a 1883338 0 2024-02-28T16:27:07.148 INFO:tasks.workunit.client.1.smithi157.stdout:8/500: read d1/d5/d43/f45 [195270,101725] 0 2024-02-28T16:27:07.149 INFO:tasks.workunit.client.1.smithi157.stdout:1/556: fsync d10/d11/f14 0 2024-02-28T16:27:07.150 INFO:tasks.workunit.client.1.smithi157.stdout:6/513: symlink d2/d7/l98 0 2024-02-28T16:27:07.152 INFO:tasks.workunit.client.1.smithi157.stdout:0/533: creat d1/d8/d27/d55/fb8 x:0 0 0 2024-02-28T16:27:07.153 INFO:tasks.workunit.client.1.smithi157.stdout:5/511: sync 2024-02-28T16:27:07.156 INFO:tasks.workunit.client.1.smithi157.stdout:6/514: write d2/d7/d8/da/d71/d8f/f85 [3030436,106647] 0 2024-02-28T16:27:07.156 INFO:tasks.workunit.client.1.smithi157.stdout:8/501: rmdir d1/d5/d14/d3e/d52/d54 39 2024-02-28T16:27:07.158 INFO:tasks.workunit.client.1.smithi157.stdout:5/512: creat d0/d9/d1b/d36/fb0 x:0 0 0 2024-02-28T16:27:07.160 INFO:tasks.workunit.client.1.smithi157.stdout:0/534: creat d1/d13/d52/d7b/d83/fb9 x:0 0 0 2024-02-28T16:27:07.160 INFO:tasks.workunit.client.1.smithi157.stdout:8/502: rename d1/d5 to d1/d5/d23/daa 22 2024-02-28T16:27:07.164 INFO:tasks.workunit.client.1.smithi157.stdout:8/503: write d1/d5/d43/d86/d96/f75 [2741707,28691] 0 2024-02-28T16:27:07.167 INFO:tasks.workunit.client.1.smithi157.stdout:8/504: truncate d1/f9c 729789 0 2024-02-28T16:27:07.171 INFO:tasks.workunit.client.1.smithi157.stdout:8/505: write d1/d5/d10/f18 [260298,117279] 0 2024-02-28T16:27:07.173 INFO:tasks.workunit.client.1.smithi157.stdout:5/513: getdents d0/d30/d50/d7f 0 2024-02-28T16:27:07.175 INFO:tasks.workunit.client.1.smithi157.stdout:5/514: fsync d0/d8/f93 0 2024-02-28T16:27:07.177 INFO:tasks.workunit.client.1.smithi157.stdout:6/515: write d2/d7/d8/da/d31/d37/d2d/f48 [682813,106598] 0 2024-02-28T16:27:07.181 INFO:tasks.workunit.client.1.smithi157.stdout:8/506: creat d1/d5/d14/d3e/d52/fab x:0 0 0 2024-02-28T16:27:07.181 INFO:tasks.workunit.client.1.smithi157.stdout:5/515: creat d0/d9/d47/d5b/d89/d75/fb1 x:0 0 0 2024-02-28T16:27:07.182 INFO:tasks.workunit.client.1.smithi157.stdout:0/535: dwrite d1/f6 [4194304,4194304] 0 2024-02-28T16:27:07.187 INFO:tasks.workunit.client.1.smithi157.stdout:6/516: mkdir d2/d7/d8/da/d31/d37/d2b/d99 0 2024-02-28T16:27:07.187 INFO:tasks.workunit.client.1.smithi157.stdout:5/516: fdatasync d0/d9/d47/d78/faa 0 2024-02-28T16:27:07.187 INFO:tasks.workunit.client.1.smithi157.stdout:8/507: mknod d1/d5/d23/d38/d67/d6d/cac 0 2024-02-28T16:27:07.189 INFO:tasks.workunit.client.1.smithi157.stdout:6/517: mkdir d2/d7/de/d1b/d4d/d6c/d9a 0 2024-02-28T16:27:07.191 INFO:tasks.workunit.client.1.smithi157.stdout:5/517: mknod d0/d9/d1b/d36/cb2 0 2024-02-28T16:27:07.199 INFO:tasks.workunit.client.1.smithi157.stdout:0/536: dwrite d1/d13/d57/f5c [0,4194304] 0 2024-02-28T16:27:07.199 INFO:tasks.workunit.client.1.smithi157.stdout:5/518: mkdir d0/db3 0 2024-02-28T16:27:07.204 INFO:tasks.workunit.client.1.smithi157.stdout:0/537: symlink d1/da/d7d/lba 0 2024-02-28T16:27:07.207 INFO:tasks.workunit.client.1.smithi157.stdout:0/538: creat d1/da/d6c/fbb x:0 0 0 2024-02-28T16:27:07.209 INFO:tasks.workunit.client.1.smithi157.stdout:0/539: write d1/da/d7d/fa0 [488433,53224] 0 2024-02-28T16:27:07.212 INFO:tasks.workunit.client.1.smithi157.stdout:0/540: dread - d1/d13/f6d zero size 2024-02-28T16:27:07.214 INFO:tasks.workunit.client.1.smithi157.stdout:0/541: chown d1/d8/d27/c37 37 1 2024-02-28T16:27:07.217 INFO:tasks.workunit.client.1.smithi157.stdout:5/519: dwrite d0/f5a [0,4194304] 0 2024-02-28T16:27:07.226 INFO:tasks.workunit.client.1.smithi157.stdout:5/520: getdents d0/d9 0 2024-02-28T16:27:07.228 INFO:tasks.workunit.client.1.smithi157.stdout:5/521: dread - d0/d9/f86 zero size 2024-02-28T16:27:07.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:06 smithi157 ceph-mon[38346]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:07.239 INFO:tasks.workunit.client.1.smithi157.stdout:5/522: dwrite d0/d8/d7e/f9a [0,4194304] 0 2024-02-28T16:27:07.241 INFO:tasks.workunit.client.1.smithi157.stdout:5/523: rmdir d0/d30/d50/d7f 39 2024-02-28T16:27:07.245 INFO:tasks.workunit.client.1.smithi157.stdout:5/524: mkdir d0/d9/d47/dad/db4 0 2024-02-28T16:27:07.247 INFO:tasks.workunit.client.1.smithi157.stdout:5/525: symlink d0/d9/d1b/lb5 0 2024-02-28T16:27:07.250 INFO:tasks.workunit.client.1.smithi157.stdout:5/526: dread - d0/d9/d47/d5b/d89/d75/f9b zero size 2024-02-28T16:27:07.254 INFO:tasks.workunit.client.1.smithi157.stdout:5/527: symlink d0/lb6 0 2024-02-28T16:27:07.258 INFO:tasks.workunit.client.1.smithi157.stdout:5/528: symlink d0/d30/d50/lb7 0 2024-02-28T16:27:07.260 INFO:tasks.workunit.client.1.smithi157.stdout:5/529: dread - d0/d9/d47/f96 zero size 2024-02-28T16:27:07.271 INFO:tasks.workunit.client.1.smithi157.stdout:5/530: write d0/d9/d47/f55 [3974564,22670] 0 2024-02-28T16:27:07.276 INFO:tasks.workunit.client.1.smithi157.stdout:5/531: rename d0/d9/d47/dad/f76 to d0/d9/d47/d5b/d89/fb8 0 2024-02-28T16:27:07.282 INFO:tasks.workunit.client.1.smithi157.stdout:5/532: link d0/d9/d47/dad/f74 d0/d9/d47/d78/fb9 0 2024-02-28T16:27:07.283 INFO:tasks.workunit.client.1.smithi157.stdout:5/533: fsync d0/d9/d47/f55 0 2024-02-28T16:27:07.285 INFO:tasks.workunit.client.1.smithi157.stdout:5/534: write d0/d9/d1b/d36/fb0 [41615,109747] 0 2024-02-28T16:27:07.288 INFO:tasks.workunit.client.1.smithi157.stdout:5/535: mknod d0/d30/cba 0 2024-02-28T16:27:07.289 INFO:tasks.workunit.client.1.smithi157.stdout:5/536: chown d0/d9 266954846 1 2024-02-28T16:27:07.294 INFO:tasks.workunit.client.1.smithi157.stdout:5/537: rmdir d0/d9/d47/d78 39 2024-02-28T16:27:07.307 INFO:tasks.workunit.client.1.smithi157.stdout:5/538: dwrite d0/d9/d1b/d36/fb0 [0,4194304] 0 2024-02-28T16:27:07.332 INFO:tasks.workunit.client.1.smithi157.stdout:5/539: dwrite d0/d9/d1b/d36/f38 [0,4194304] 0 2024-02-28T16:27:07.334 INFO:tasks.workunit.client.1.smithi157.stdout:4/514: sync 2024-02-28T16:27:07.334 INFO:tasks.workunit.client.1.smithi157.stdout:2/574: sync 2024-02-28T16:27:07.334 INFO:tasks.workunit.client.1.smithi157.stdout:9/499: sync 2024-02-28T16:27:07.334 INFO:tasks.workunit.client.1.smithi157.stdout:7/560: sync 2024-02-28T16:27:07.334 INFO:tasks.workunit.client.1.smithi157.stdout:5/540: fdatasync d0/d8/d51/f7b 0 2024-02-28T16:27:07.335 INFO:tasks.workunit.client.1.smithi157.stdout:2/575: fsync da/f46 0 2024-02-28T16:27:07.341 INFO:tasks.workunit.client.1.smithi157.stdout:9/500: fsync d0/f21 0 2024-02-28T16:27:07.345 INFO:tasks.workunit.client.1.smithi157.stdout:2/576: dread da/d38/d3e/d9b/da3/f68 [0,4194304] 0 2024-02-28T16:27:07.347 INFO:tasks.workunit.client.1.smithi157.stdout:4/515: creat d3/da/d37/d84/fa8 x:0 0 0 2024-02-28T16:27:07.347 INFO:tasks.workunit.client.1.smithi157.stdout:2/577: write da/d38/d5a/d5c/f7a [742122,122313] 0 2024-02-28T16:27:07.350 INFO:tasks.workunit.client.1.smithi157.stdout:2/578: write da/d38/d4e/f63 [2446062,108466] 0 2024-02-28T16:27:07.356 INFO:tasks.workunit.client.1.smithi157.stdout:9/501: symlink d0/d19/d30/d78/lac 0 2024-02-28T16:27:07.357 INFO:tasks.workunit.client.1.smithi157.stdout:9/502: fsync d0/d36/f9b 0 2024-02-28T16:27:07.358 INFO:tasks.workunit.client.1.smithi157.stdout:7/561: mknod df/d1f/d24/cb0 0 2024-02-28T16:27:07.364 INFO:tasks.workunit.client.1.smithi157.stdout:5/541: write d0/d9/f2c [3317957,94159] 0 2024-02-28T16:27:07.366 INFO:tasks.workunit.client.1.smithi157.stdout:5/542: stat d0/d9/d3a/f9d 0 2024-02-28T16:27:07.367 INFO:tasks.workunit.client.1.smithi157.stdout:2/579: mkdir da/d47/dbd 0 2024-02-28T16:27:07.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:06 smithi148 ceph-mon[28767]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:07.376 INFO:tasks.workunit.client.1.smithi157.stdout:4/516: symlink d3/da/d48/d8e/la9 0 2024-02-28T16:27:07.379 INFO:tasks.workunit.client.1.smithi157.stdout:7/562: mknod df/d25/d4e/cb1 0 2024-02-28T16:27:07.379 INFO:tasks.workunit.client.1.smithi157.stdout:5/543: mknod d0/d9/d47/dad/db4/cbb 0 2024-02-28T16:27:07.380 INFO:tasks.workunit.client.1.smithi157.stdout:7/563: fdatasync df/fae 0 2024-02-28T16:27:07.386 INFO:tasks.workunit.client.1.smithi157.stdout:9/503: getdents d0/d19 0 2024-02-28T16:27:07.389 INFO:tasks.workunit.client.1.smithi157.stdout:5/544: symlink d0/d9/d47/d5b/lbc 0 2024-02-28T16:27:07.391 INFO:tasks.workunit.client.1.smithi157.stdout:9/504: chown d0/c2a 178307 1 2024-02-28T16:27:07.394 INFO:tasks.workunit.client.1.smithi157.stdout:2/580: write da/f1f [2166217,80996] 0 2024-02-28T16:27:07.395 INFO:tasks.workunit.client.1.smithi157.stdout:5/545: write d0/f2e [2148849,66724] 0 2024-02-28T16:27:07.398 INFO:tasks.workunit.client.1.smithi157.stdout:4/517: write d3/da/f2d [4393061,114381] 0 2024-02-28T16:27:07.400 INFO:tasks.workunit.client.1.smithi157.stdout:7/564: dwrite df/d1f/d24/d38/f51 [8388608,4194304] 0 2024-02-28T16:27:07.401 INFO:tasks.workunit.client.1.smithi157.stdout:9/505: mknod d0/cad 0 2024-02-28T16:27:07.402 INFO:tasks.workunit.client.1.smithi157.stdout:7/565: write df/f31 [5164448,17608] 0 2024-02-28T16:27:07.408 INFO:tasks.workunit.client.1.smithi157.stdout:4/518: mkdir d3/d77/daa 0 2024-02-28T16:27:07.408 INFO:tasks.workunit.client.1.smithi157.stdout:7/566: dread df/d1f/d24/d38/f6d [0,4194304] 0 2024-02-28T16:27:07.409 INFO:tasks.workunit.client.1.smithi157.stdout:4/519: chown d3/da/d1f/c23 21 1 2024-02-28T16:27:07.410 INFO:tasks.workunit.client.1.smithi157.stdout:9/506: symlink d0/d36/d37/d40/d4b/d96/lae 0 2024-02-28T16:27:07.412 INFO:tasks.workunit.client.1.smithi157.stdout:9/507: chown d0/d19/f1c 1 1 2024-02-28T16:27:07.414 INFO:tasks.workunit.client.1.smithi157.stdout:2/581: getdents da/d38/d4e 0 2024-02-28T16:27:07.416 INFO:tasks.workunit.client.1.smithi157.stdout:5/546: rename d0/d8/ca9 to d0/cbd 0 2024-02-28T16:27:07.418 INFO:tasks.workunit.client.1.smithi157.stdout:4/520: mkdir d3/da/d37/d84/d9a/dab 0 2024-02-28T16:27:07.421 INFO:tasks.workunit.client.1.smithi157.stdout:7/567: unlink df/d1f/d24/d39/f5c 0 2024-02-28T16:27:07.425 INFO:tasks.workunit.client.1.smithi157.stdout:7/568: creat df/d1f/d37/d46/fb2 x:0 0 0 2024-02-28T16:27:07.426 INFO:tasks.workunit.client.1.smithi157.stdout:2/582: dread da/d35/f48 [0,4194304] 0 2024-02-28T16:27:07.428 INFO:tasks.workunit.client.1.smithi157.stdout:4/521: creat d3/da/fac x:0 0 0 2024-02-28T16:27:07.429 INFO:tasks.workunit.client.1.smithi157.stdout:2/583: write da/d38/d4e/f63 [4576573,120985] 0 2024-02-28T16:27:07.431 INFO:tasks.workunit.client.1.smithi157.stdout:2/584: truncate da/f86 4726855 0 2024-02-28T16:27:07.433 INFO:tasks.workunit.client.1.smithi157.stdout:2/585: readlink da/d38/d5a/l76 0 2024-02-28T16:27:07.437 INFO:tasks.workunit.client.1.smithi157.stdout:9/508: write d0/d36/d37/d4d/f51 [1045211,57912] 0 2024-02-28T16:27:07.445 INFO:tasks.workunit.client.1.smithi157.stdout:7/569: dwrite df/d1f/d24/d39/fac [0,4194304] 0 2024-02-28T16:27:07.447 INFO:tasks.workunit.client.1.smithi157.stdout:9/509: write d0/f18 [2415889,119593] 0 2024-02-28T16:27:07.449 INFO:tasks.workunit.client.1.smithi157.stdout:9/510: fsync d0/d19/d30/f54 0 2024-02-28T16:27:07.449 INFO:tasks.workunit.client.1.smithi157.stdout:4/522: dwrite d3/da/d48/f66 [0,4194304] 0 2024-02-28T16:27:07.450 INFO:tasks.workunit.client.1.smithi157.stdout:9/511: stat d0/d36 0 2024-02-28T16:27:07.451 INFO:tasks.workunit.client.1.smithi157.stdout:9/512: chown d0 52161941 1 2024-02-28T16:27:07.451 INFO:tasks.workunit.client.1.smithi157.stdout:4/523: chown d3/da/d1f/c34 25652 1 2024-02-28T16:27:07.456 INFO:tasks.workunit.client.1.smithi157.stdout:5/547: dread d0/d9/d1b/d36/f6c [0,4194304] 0 2024-02-28T16:27:07.463 INFO:tasks.workunit.client.1.smithi157.stdout:4/524: creat d3/da/d37/d84/fad x:0 0 0 2024-02-28T16:27:07.466 INFO:tasks.workunit.client.1.smithi157.stdout:5/548: truncate d0/d9/f42 975888 0 2024-02-28T16:27:07.467 INFO:tasks.workunit.client.1.smithi157.stdout:9/513: dread d0/d36/d37/f67 [0,4194304] 0 2024-02-28T16:27:07.468 INFO:tasks.workunit.client.1.smithi157.stdout:4/525: chown d3/d8b/ca1 193858142 1 2024-02-28T16:27:07.470 INFO:tasks.workunit.client.1.smithi157.stdout:2/586: dwrite da/ff [0,4194304] 0 2024-02-28T16:27:07.475 INFO:tasks.workunit.client.1.smithi157.stdout:9/514: symlink d0/d19/d30/d79/laf 0 2024-02-28T16:27:07.481 INFO:tasks.workunit.client.1.smithi157.stdout:2/587: mknod da/d38/d5a/d5c/cbe 0 2024-02-28T16:27:07.488 INFO:tasks.workunit.client.1.smithi157.stdout:2/588: unlink da/d65/d90/f53 0 2024-02-28T16:27:07.490 INFO:tasks.workunit.client.1.smithi157.stdout:5/549: write d0/d9/f49 [3986503,69873] 0 2024-02-28T16:27:07.492 INFO:tasks.workunit.client.1.smithi157.stdout:7/570: dwrite df/d80/fa8 [0,4194304] 0 2024-02-28T16:27:07.494 INFO:tasks.workunit.client.1.smithi157.stdout:3/483: sync 2024-02-28T16:27:07.494 INFO:tasks.workunit.client.1.smithi157.stdout:8/508: sync 2024-02-28T16:27:07.494 INFO:tasks.workunit.client.1.smithi157.stdout:1/557: sync 2024-02-28T16:27:07.495 INFO:tasks.workunit.client.1.smithi157.stdout:6/518: sync 2024-02-28T16:27:07.495 INFO:tasks.workunit.client.1.smithi157.stdout:2/589: chown da/d2b/d59/f64 242 1 2024-02-28T16:27:07.495 INFO:tasks.workunit.client.1.smithi157.stdout:0/542: sync 2024-02-28T16:27:07.503 INFO:tasks.workunit.client.1.smithi157.stdout:0/543: fsync d1/d8/d33/d56/f5d 0 2024-02-28T16:27:07.506 INFO:tasks.workunit.client.1.smithi157.stdout:6/519: dread - d2/d7/d8/da/d71/d8f/f73 zero size 2024-02-28T16:27:07.507 INFO:tasks.workunit.client.1.smithi157.stdout:8/509: truncate d1/d5/d4d/d60/f94 877329 0 2024-02-28T16:27:07.507 INFO:tasks.workunit.client.1.smithi157.stdout:5/550: rename d0/d8/d51/f87 to d0/d9/d47/d5b/d89/fbe 0 2024-02-28T16:27:07.507 INFO:tasks.workunit.client.1.smithi157.stdout:4/526: dwrite d3/da/d37/d71/f9d [0,4194304] 0 2024-02-28T16:27:07.507 INFO:tasks.workunit.client.1.smithi157.stdout:2/590: mknod da/d38/d5a/d79/d7b/cbf 0 2024-02-28T16:27:07.511 INFO:tasks.workunit.client.1.smithi157.stdout:2/591: readlink da/d38/d4e/d91/la9 0 2024-02-28T16:27:07.512 INFO:tasks.workunit.client.1.smithi157.stdout:5/551: write d0/fa5 [304004,69393] 0 2024-02-28T16:27:07.512 INFO:tasks.workunit.client.1.smithi157.stdout:3/484: write d0/d6/d34/d80/d23/d2b/f32 [3809049,68073] 0 2024-02-28T16:27:07.515 INFO:tasks.workunit.client.1.smithi157.stdout:4/527: dread - d3/da/fac zero size 2024-02-28T16:27:07.516 INFO:tasks.workunit.client.1.smithi157.stdout:0/544: creat d1/d13/d46/fbc x:0 0 0 2024-02-28T16:27:07.517 INFO:tasks.workunit.client.1.smithi157.stdout:9/515: dwrite d0/d36/d37/d40/f49 [4194304,4194304] 0 2024-02-28T16:27:07.521 INFO:tasks.workunit.client.1.smithi157.stdout:3/485: fdatasync d0/d6/f3d 0 2024-02-28T16:27:07.524 INFO:tasks.workunit.client.1.smithi157.stdout:2/592: mkdir da/d8c/dc0 0 2024-02-28T16:27:07.526 INFO:tasks.workunit.client.1.smithi157.stdout:0/545: fsync d1/d13/f73 0 2024-02-28T16:27:07.529 INFO:tasks.workunit.client.1.smithi157.stdout:5/552: creat d0/d30/d50/d7f/fbf x:0 0 0 2024-02-28T16:27:07.530 INFO:tasks.workunit.client.1.smithi157.stdout:1/558: getdents d10/d11/d3a/d5c/d6c 0 2024-02-28T16:27:07.532 INFO:tasks.workunit.client.1.smithi157.stdout:4/528: creat d3/d77/daa/fae x:0 0 0 2024-02-28T16:27:07.532 INFO:tasks.workunit.client.1.smithi157.stdout:0/546: dread - d1/d13/d52/db5/d64/fb6 zero size 2024-02-28T16:27:07.535 INFO:tasks.workunit.client.1.smithi157.stdout:3/486: chown d0/d6/f67 145906 1 2024-02-28T16:27:07.539 INFO:tasks.workunit.client.1.smithi157.stdout:5/553: truncate d0/d9/f86 800282 0 2024-02-28T16:27:07.539 INFO:tasks.workunit.client.1.smithi157.stdout:2/593: creat da/d47/dbd/fc1 x:0 0 0 2024-02-28T16:27:07.542 INFO:tasks.workunit.client.1.smithi157.stdout:0/547: symlink d1/da/lbd 0 2024-02-28T16:27:07.546 INFO:tasks.workunit.client.1.smithi157.stdout:5/554: fsync d0/d9/f1d 0 2024-02-28T16:27:07.546 INFO:tasks.workunit.client.1.smithi157.stdout:3/487: write d0/d6/d34/d80/f51 [965401,109089] 0 2024-02-28T16:27:07.546 INFO:tasks.workunit.client.1.smithi157.stdout:8/510: dwrite d1/d5/d4d/f62 [0,4194304] 0 2024-02-28T16:27:07.547 INFO:tasks.workunit.client.1.smithi157.stdout:6/520: dwrite d2/d17/f1e [4194304,4194304] 0 2024-02-28T16:27:07.552 INFO:tasks.workunit.client.1.smithi157.stdout:5/555: chown d0/f2e 13 1 2024-02-28T16:27:07.552 INFO:tasks.workunit.client.1.smithi157.stdout:4/529: getdents d3/da/d48/d4a 0 2024-02-28T16:27:07.557 INFO:tasks.workunit.client.1.smithi157.stdout:0/548: getdents d1/da/d7d/d98 0 2024-02-28T16:27:07.559 INFO:tasks.workunit.client.1.smithi157.stdout:6/521: unlink d2/d7/de/d1b/c6d 0 2024-02-28T16:27:07.563 INFO:tasks.workunit.client.1.smithi157.stdout:5/556: symlink d0/d9/d47/d78/lc0 0 2024-02-28T16:27:07.563 INFO:tasks.workunit.client.1.smithi157.stdout:9/516: dwrite d0/d36/d3f/f75 [0,4194304] 0 2024-02-28T16:27:07.567 INFO:tasks.workunit.client.1.smithi157.stdout:5/557: readlink d0/d9/d47/d5b/lbc 0 2024-02-28T16:27:07.568 INFO:tasks.workunit.client.1.smithi157.stdout:0/549: mkdir d1/d13/d52/dbe 0 2024-02-28T16:27:07.571 INFO:tasks.workunit.client.1.smithi157.stdout:2/594: dwrite da/d35/f8b [0,4194304] 0 2024-02-28T16:27:07.571 INFO:tasks.workunit.client.1.smithi157.stdout:0/550: chown d1/d8/d33/d56/fb4 57480889 1 2024-02-28T16:27:07.574 INFO:tasks.workunit.client.1.smithi157.stdout:4/530: mknod d3/da/d37/caf 0 2024-02-28T16:27:07.575 INFO:tasks.workunit.client.1.smithi157.stdout:3/488: creat d0/d6/d34/d80/d23/d2b/d81/d89/f9a x:0 0 0 2024-02-28T16:27:07.575 INFO:tasks.workunit.client.1.smithi157.stdout:5/558: unlink d0/d9/d47/d5b/d89/l64 0 2024-02-28T16:27:07.575 INFO:tasks.workunit.client.1.smithi157.stdout:4/531: chown d3/da/d1f/c59 3 1 2024-02-28T16:27:07.577 INFO:tasks.workunit.client.1.smithi157.stdout:0/551: mknod d1/d13/d46/d99/cbf 0 2024-02-28T16:27:07.578 INFO:tasks.workunit.client.1.smithi157.stdout:2/595: truncate da/d38/d7e/fb4 194310 0 2024-02-28T16:27:07.578 INFO:tasks.workunit.client.1.smithi157.stdout:3/489: write d0/d6/d44/d70/d71/d87/f95 [734859,110034] 0 2024-02-28T16:27:07.583 INFO:tasks.workunit.client.1.smithi157.stdout:8/511: rename d1/d5/d14/d3e/d52/f58 to d1/d5/d14/fad 0 2024-02-28T16:27:07.584 INFO:tasks.workunit.client.1.smithi157.stdout:0/552: chown d1/d13/d52/dbe 395731 1 2024-02-28T16:27:07.584 INFO:tasks.workunit.client.1.smithi157.stdout:9/517: getdents d0/d36/d37/d4d 0 2024-02-28T16:27:07.586 INFO:tasks.workunit.client.1.smithi157.stdout:4/532: fsync d3/da/fd 0 2024-02-28T16:27:07.588 INFO:tasks.workunit.client.1.smithi157.stdout:8/512: write d1/d5/f3b [5870309,94541] 0 2024-02-28T16:27:07.590 INFO:tasks.workunit.client.1.smithi157.stdout:0/553: readlink d1/d13/l5a 0 2024-02-28T16:27:07.590 INFO:tasks.workunit.client.1.smithi157.stdout:3/490: stat d0/d6/f13 0 2024-02-28T16:27:07.590 INFO:tasks.workunit.client.1.smithi157.stdout:2/596: write da/f24 [1882235,110397] 0 2024-02-28T16:27:07.591 INFO:tasks.workunit.client.1.smithi157.stdout:6/522: dwrite d2/d7/de/d40/f47 [0,4194304] 0 2024-02-28T16:27:07.596 INFO:tasks.workunit.client.1.smithi157.stdout:9/518: mkdir d0/d19/d30/db0 0 2024-02-28T16:27:07.599 INFO:tasks.workunit.client.1.smithi157.stdout:3/491: creat d0/d6/d44/d4b/f9b x:0 0 0 2024-02-28T16:27:07.600 INFO:tasks.workunit.client.1.smithi157.stdout:6/523: chown d2/d7/d8/da/d71/d8f/f85 60818 1 2024-02-28T16:27:07.601 INFO:tasks.workunit.client.1.smithi157.stdout:5/559: creat d0/d9/d1b/d36/daf/fc1 x:0 0 0 2024-02-28T16:27:07.606 INFO:tasks.workunit.client.1.smithi157.stdout:0/554: rename d1/d8/d27/l42 to d1/d13/d57/lc0 0 2024-02-28T16:27:07.608 INFO:tasks.workunit.client.1.smithi157.stdout:3/492: symlink d0/d6/d44/d70/d71/d87/l9c 0 2024-02-28T16:27:07.610 INFO:tasks.workunit.client.1.smithi157.stdout:6/524: chown d2/d7/d8/da/d71/d80/f81 1816203937 1 2024-02-28T16:27:07.610 INFO:tasks.workunit.client.1.smithi157.stdout:0/555: fdatasync d1/d8/d33/f44 0 2024-02-28T16:27:07.615 INFO:tasks.workunit.client.1.smithi157.stdout:5/560: creat d0/d9/d47/d5b/d89/d75/dab/fc2 x:0 0 0 2024-02-28T16:27:07.616 INFO:tasks.workunit.client.1.smithi157.stdout:8/513: dread d1/d5/d23/d38/d6e/d85/f9d [0,4194304] 0 2024-02-28T16:27:07.619 INFO:tasks.workunit.client.1.smithi157.stdout:6/525: dread - d2/d7/de/d1b/d4d/d6c/f95 zero size 2024-02-28T16:27:07.623 INFO:tasks.workunit.client.1.smithi157.stdout:2/597: write da/d38/d3e/f5b [4566468,81913] 0 2024-02-28T16:27:07.627 INFO:tasks.workunit.client.1.smithi157.stdout:4/533: dwrite d3/d77/f65 [0,4194304] 0 2024-02-28T16:27:07.627 INFO:tasks.workunit.client.1.smithi157.stdout:6/526: mknod d2/c9b 0 2024-02-28T16:27:07.629 INFO:tasks.workunit.client.1.smithi157.stdout:8/514: mknod d1/d5/d23/d38/d67/d6d/cae 0 2024-02-28T16:27:07.632 INFO:tasks.workunit.client.1.smithi157.stdout:2/598: symlink da/d35/lc2 0 2024-02-28T16:27:07.637 INFO:tasks.workunit.client.1.smithi157.stdout:9/519: dwrite d0/d36/d37/f67 [0,4194304] 0 2024-02-28T16:27:07.637 INFO:tasks.workunit.client.1.smithi157.stdout:3/493: dwrite d0/d6/f67 [4194304,4194304] 0 2024-02-28T16:27:07.639 INFO:tasks.workunit.client.1.smithi157.stdout:4/534: mkdir d3/da/d37/d71/db0 0 2024-02-28T16:27:07.642 INFO:tasks.workunit.client.1.smithi157.stdout:9/520: readlink d0/d36/l88 0 2024-02-28T16:27:07.647 INFO:tasks.workunit.client.1.smithi157.stdout:4/535: write d3/da/f90 [533993,50500] 0 2024-02-28T16:27:07.651 INFO:tasks.workunit.client.1.smithi157.stdout:6/527: creat d2/d7/d8/da/d31/d37/d2d/d53/f9c x:0 0 0 2024-02-28T16:27:07.652 INFO:tasks.workunit.client.1.smithi157.stdout:3/494: mkdir d0/d6/d1e/d5b/d9d 0 2024-02-28T16:27:07.654 INFO:tasks.workunit.client.1.smithi157.stdout:2/599: creat da/d8c/dc0/fc3 x:0 0 0 2024-02-28T16:27:07.655 INFO:tasks.workunit.client.1.smithi157.stdout:7/571: sync 2024-02-28T16:27:07.660 INFO:tasks.workunit.client.1.smithi157.stdout:6/528: mkdir d2/d7/d92/d9d 0 2024-02-28T16:27:07.661 INFO:tasks.workunit.client.1.smithi157.stdout:9/521: rename d0/c2d to d0/d36/d37/d40/d5b/cb1 0 2024-02-28T16:27:07.662 INFO:tasks.workunit.client.1.smithi157.stdout:0/556: dwrite d1/d13/f47 [0,4194304] 0 2024-02-28T16:27:07.662 INFO:tasks.workunit.client.1.smithi157.stdout:4/536: mkdir d3/da/d48/d8e/db1 0 2024-02-28T16:27:07.668 INFO:tasks.workunit.client.1.smithi157.stdout:5/561: dwrite d0/d9/d47/d5b/d89/d75/f9b [0,4194304] 0 2024-02-28T16:27:07.684 INFO:tasks.workunit.client.1.smithi157.stdout:8/515: dwrite d1/d5/f71 [0,4194304] 0 2024-02-28T16:27:07.685 INFO:tasks.workunit.client.1.smithi157.stdout:7/572: creat df/d1f/d24/d4f/fb3 x:0 0 0 2024-02-28T16:27:07.685 INFO:tasks.workunit.client.1.smithi157.stdout:5/562: write d0/d9/d47/f6d [4417839,89219] 0 2024-02-28T16:27:07.686 INFO:tasks.workunit.client.1.smithi157.stdout:4/537: chown d3/da/d48/c6e 236 1 2024-02-28T16:27:07.688 INFO:tasks.workunit.client.1.smithi157.stdout:0/557: read d1/d13/d52/db5/d64/f78 [3974875,35527] 0 2024-02-28T16:27:07.693 INFO:tasks.workunit.client.1.smithi157.stdout:6/529: write d2/f5 [2884570,77261] 0 2024-02-28T16:27:07.697 INFO:tasks.workunit.client.1.smithi157.stdout:2/600: dwrite da/d38/d4e/d91/f8a [0,4194304] 0 2024-02-28T16:27:07.700 INFO:tasks.workunit.client.1.smithi157.stdout:7/573: write df/d1f/f7e [860826,39878] 0 2024-02-28T16:27:07.701 INFO:tasks.workunit.client.1.smithi157.stdout:8/516: creat d1/d5/d10/faf x:0 0 0 2024-02-28T16:27:07.702 INFO:tasks.workunit.client.1.smithi157.stdout:5/563: rename d0/d9/f49 to d0/d8/d7e/d82/fc3 0 2024-02-28T16:27:07.704 INFO:tasks.workunit.client.1.smithi157.stdout:4/538: unlink d3/da/d28/l47 0 2024-02-28T16:27:07.706 INFO:tasks.workunit.client.1.smithi157.stdout:4/539: write d3/d77/f65 [1873008,5469] 0 2024-02-28T16:27:07.707 INFO:tasks.workunit.client.1.smithi157.stdout:3/495: dwrite d0/d6/d34/d80/f53 [0,4194304] 0 2024-02-28T16:27:07.713 INFO:tasks.workunit.client.1.smithi157.stdout:9/522: link d0/l31 d0/d36/d37/d40/d4b/lb2 0 2024-02-28T16:27:07.717 INFO:tasks.workunit.client.1.smithi157.stdout:3/496: write d0/d6/d34/d80/d23/d2b/f57 [940811,90819] 0 2024-02-28T16:27:07.717 INFO:tasks.workunit.client.1.smithi157.stdout:0/558: dread d1/d13/d52/fa9 [0,4194304] 0 2024-02-28T16:27:07.721 INFO:tasks.workunit.client.1.smithi157.stdout:1/559: sync 2024-02-28T16:27:07.722 INFO:tasks.workunit.client.1.smithi157.stdout:8/517: unlink d1/d5/d23/fa0 0 2024-02-28T16:27:07.725 INFO:tasks.workunit.client.1.smithi157.stdout:2/601: dwrite da/d38/d5a/f9f [0,4194304] 0 2024-02-28T16:27:07.731 INFO:tasks.workunit.client.1.smithi157.stdout:3/497: mkdir d0/d6/d6b/d9e 0 2024-02-28T16:27:07.732 INFO:tasks.workunit.client.1.smithi157.stdout:0/559: chown d1/d8/c5b 7682 1 2024-02-28T16:27:07.737 INFO:tasks.workunit.client.1.smithi157.stdout:8/518: mknod d1/d5/d23/d38/d67/cb0 0 2024-02-28T16:27:07.737 INFO:tasks.workunit.client.1.smithi157.stdout:6/530: dread d2/f5 [0,4194304] 0 2024-02-28T16:27:07.743 INFO:tasks.workunit.client.1.smithi157.stdout:4/540: mkdir d3/da/d37/db2 0 2024-02-28T16:27:07.744 INFO:tasks.workunit.client.1.smithi157.stdout:9/523: mknod d0/cb3 0 2024-02-28T16:27:07.746 INFO:tasks.workunit.client.1.smithi157.stdout:4/541: chown d3/da/f5e 851673435 1 2024-02-28T16:27:07.748 INFO:tasks.workunit.client.1.smithi157.stdout:1/560: dread d10/f6b [0,4194304] 0 2024-02-28T16:27:07.748 INFO:tasks.workunit.client.1.smithi157.stdout:3/498: unlink d0/d6/d34/d80/d5c/f8f 0 2024-02-28T16:27:07.752 INFO:tasks.workunit.client.1.smithi157.stdout:4/542: write d3/d77/f56 [2488884,33322] 0 2024-02-28T16:27:07.753 INFO:tasks.workunit.client.1.smithi157.stdout:8/519: dread d1/d5/f71 [0,4194304] 0 2024-02-28T16:27:07.758 INFO:tasks.workunit.client.1.smithi157.stdout:4/543: chown d3/da/d48/d8e 298753460 1 2024-02-28T16:27:07.759 INFO:tasks.workunit.client.1.smithi157.stdout:6/531: dwrite d2/d7/d8/da/d31/d37/d2b/f7a [0,4194304] 0 2024-02-28T16:27:07.762 INFO:tasks.workunit.client.1.smithi157.stdout:1/561: symlink d10/d11/d3a/laf 0 2024-02-28T16:27:07.763 INFO:tasks.workunit.client.1.smithi157.stdout:7/574: write df/d80/f5d [4415027,23619] 0 2024-02-28T16:27:07.765 INFO:tasks.workunit.client.1.smithi157.stdout:1/562: chown d10/d94 1987651 1 2024-02-28T16:27:07.765 INFO:tasks.workunit.client.1.smithi157.stdout:8/520: creat d1/d5/d14/d3e/fb1 x:0 0 0 2024-02-28T16:27:07.765 INFO:tasks.workunit.client.1.smithi157.stdout:4/544: rmdir d3/da/d37/d84/d9a 39 2024-02-28T16:27:07.766 INFO:tasks.workunit.client.1.smithi157.stdout:7/575: readlink df/d25/d4e/l6f 0 2024-02-28T16:27:07.767 INFO:tasks.workunit.client.1.smithi157.stdout:4/545: read - d3/d77/f99 zero size 2024-02-28T16:27:07.767 INFO:tasks.workunit.client.1.smithi157.stdout:6/532: creat d2/d7/de/d1b/d4d/d6c/f9e x:0 0 0 2024-02-28T16:27:07.769 INFO:tasks.workunit.client.1.smithi157.stdout:9/524: rename d0/d36/l3b to d0/d36/d37/lb4 0 2024-02-28T16:27:07.770 INFO:tasks.workunit.client.1.smithi157.stdout:1/563: creat d10/d11/d22/d99/fb0 x:0 0 0 2024-02-28T16:27:07.773 INFO:tasks.workunit.client.1.smithi157.stdout:5/564: getdents d0/d9/d47/d78 0 2024-02-28T16:27:07.773 INFO:tasks.workunit.client.1.smithi157.stdout:9/525: mkdir d0/d36/d37/d4d/db5 0 2024-02-28T16:27:07.774 INFO:tasks.workunit.client.1.smithi157.stdout:5/565: fsync d0/d9/d47/d78/f80 0 2024-02-28T16:27:07.776 INFO:tasks.workunit.client.1.smithi157.stdout:1/564: fsync d10/d11/d22/f3f 0 2024-02-28T16:27:07.786 INFO:tasks.workunit.client.1.smithi157.stdout:6/533: dread d2/d7/d8/da/d31/d3a/f2f [4194304,4194304] 0 2024-02-28T16:27:07.788 INFO:tasks.workunit.client.1.smithi157.stdout:9/526: getdents d0/d19/d30/db0 0 2024-02-28T16:27:07.788 INFO:tasks.workunit.client.1.smithi157.stdout:0/560: write d1/da/f58 [3673972,117826] 0 2024-02-28T16:27:07.791 INFO:tasks.workunit.client.1.smithi157.stdout:6/534: write d2/d17/f2a [2623120,101047] 0 2024-02-28T16:27:07.791 INFO:tasks.workunit.client.1.smithi157.stdout:9/527: read - d0/d36/f63 zero size 2024-02-28T16:27:07.794 INFO:tasks.workunit.client.1.smithi157.stdout:6/535: chown d2/d7/de/d40/l55 196 1 2024-02-28T16:27:07.794 INFO:tasks.workunit.client.1.smithi157.stdout:7/576: getdents df/d1f/d24/d39/d64 0 2024-02-28T16:27:07.796 INFO:tasks.workunit.client.1.smithi157.stdout:4/546: link d3/da/d1f/d22/f4b d3/da/fb3 0 2024-02-28T16:27:07.797 INFO:tasks.workunit.client.1.smithi157.stdout:0/561: mkdir d1/d13/d52/d7b/dc1 0 2024-02-28T16:27:07.798 INFO:tasks.workunit.client.1.smithi157.stdout:9/528: read d0/d36/d37/d40/d4b/f6d [405927,130041] 0 2024-02-28T16:27:07.802 INFO:tasks.workunit.client.1.smithi157.stdout:7/577: fsync df/d1f/d24/d38/f6d 0 2024-02-28T16:27:07.806 INFO:tasks.workunit.client.1.smithi157.stdout:4/547: truncate d3/da/d48/f93 628032 0 2024-02-28T16:27:07.808 INFO:tasks.workunit.client.1.smithi157.stdout:5/566: dread d0/d9/d47/f54 [0,4194304] 0 2024-02-28T16:27:07.809 INFO:tasks.workunit.client.1.smithi157.stdout:6/536: mknod d2/d7/d8/da/d31/d37/d2d/d8c/c9f 0 2024-02-28T16:27:07.809 INFO:tasks.workunit.client.1.smithi157.stdout:8/521: dread d1/d5/d14/d3e/d52/d54/f5d [0,4194304] 0 2024-02-28T16:27:07.809 INFO:tasks.workunit.client.1.smithi157.stdout:9/529: creat d0/d36/d37/d4d/d92/fb6 x:0 0 0 2024-02-28T16:27:07.810 INFO:tasks.workunit.client.1.smithi157.stdout:2/602: dwrite da/d47/f77 [0,4194304] 0 2024-02-28T16:27:07.813 INFO:tasks.workunit.client.1.smithi157.stdout:2/603: chown da/d8c 984 1 2024-02-28T16:27:07.813 INFO:tasks.workunit.client.1.smithi157.stdout:0/562: write d1/d13/d46/d99/fa4 [3203285,38746] 0 2024-02-28T16:27:07.816 INFO:tasks.workunit.client.1.smithi157.stdout:0/563: fsync d1/f2 0 2024-02-28T16:27:07.816 INFO:tasks.workunit.client.1.smithi157.stdout:6/537: write d2/d17/f21 [3176245,23356] 0 2024-02-28T16:27:07.817 INFO:tasks.workunit.client.1.smithi157.stdout:4/548: chown d3/da/d28/l7b 462693 1 2024-02-28T16:27:07.819 INFO:tasks.workunit.client.1.smithi157.stdout:4/549: readlink d3/da/d1f/l68 0 2024-02-28T16:27:07.824 INFO:tasks.workunit.client.1.smithi157.stdout:7/578: rename df/d1f/f5e to df/d1f/d24/d39/fb4 0 2024-02-28T16:27:07.825 INFO:tasks.workunit.client.1.smithi157.stdout:6/538: chown d2/d7/d8/da/d31/d37/d2d/d53/d69/f7d 2284490 1 2024-02-28T16:27:07.828 INFO:tasks.workunit.client.1.smithi157.stdout:9/530: unlink d0/l3d 0 2024-02-28T16:27:07.831 INFO:tasks.workunit.client.1.smithi157.stdout:9/531: write d0/f90 [1029221,92511] 0 2024-02-28T16:27:07.832 INFO:tasks.workunit.client.1.smithi157.stdout:6/539: write d2/d7/d8/da/d71/d8f/d6e/f7f [671481,30837] 0 2024-02-28T16:27:07.835 INFO:tasks.workunit.client.1.smithi157.stdout:6/540: readlink d2/d17/l43 0 2024-02-28T16:27:07.839 INFO:tasks.workunit.client.1.smithi157.stdout:6/541: stat d2/d7/d8/da/d71/d8f/d6e/f7f 0 2024-02-28T16:27:07.842 INFO:tasks.workunit.client.1.smithi157.stdout:5/567: mkdir d0/d30/d50/d7f/dc4 0 2024-02-28T16:27:07.848 INFO:tasks.workunit.client.1.smithi157.stdout:4/550: mkdir d3/da/d37/d71/db0/db4 0 2024-02-28T16:27:07.848 INFO:tasks.workunit.client.1.smithi157.stdout:7/579: dwrite df/f11 [0,4194304] 0 2024-02-28T16:27:07.850 INFO:tasks.workunit.client.1.smithi157.stdout:0/564: link d1/da/f2f d1/d13/d46/d99/fc2 0 2024-02-28T16:27:07.854 INFO:tasks.workunit.client.1.smithi157.stdout:5/568: unlink d0/d9/d47/c88 0 2024-02-28T16:27:07.854 INFO:tasks.workunit.client.1.smithi157.stdout:8/522: link d1/d5/d4d/d60/l80 d1/d5/d23/d38/d67/lb2 0 2024-02-28T16:27:07.855 INFO:tasks.workunit.client.1.smithi157.stdout:2/604: rename da/d65/f8d to da/d38/fc4 0 2024-02-28T16:27:07.856 INFO:tasks.workunit.client.1.smithi157.stdout:0/565: chown d1/d13/d52/d53/f81 8344 1 2024-02-28T16:27:07.857 INFO:tasks.workunit.client.1.smithi157.stdout:7/580: mkdir df/d25/db5 0 2024-02-28T16:27:07.859 INFO:tasks.workunit.client.1.smithi157.stdout:0/566: stat d1/d13/f87 0 2024-02-28T16:27:07.861 INFO:tasks.workunit.client.1.smithi157.stdout:0/567: chown d1/d13/d46/d99/f9f 411 1 2024-02-28T16:27:07.863 INFO:tasks.workunit.client.1.smithi157.stdout:5/569: write d0/d9/d47/d5b/d89/d75/fb1 [431916,129211] 0 2024-02-28T16:27:07.865 INFO:tasks.workunit.client.1.smithi157.stdout:7/581: dread - df/f60 zero size 2024-02-28T16:27:07.866 INFO:tasks.workunit.client.1.smithi157.stdout:6/542: dwrite d2/f1f [0,4194304] 0 2024-02-28T16:27:07.874 INFO:tasks.workunit.client.1.smithi157.stdout:0/568: fsync d1/d8/f2c 0 2024-02-28T16:27:07.880 INFO:tasks.workunit.client.1.smithi157.stdout:7/582: creat df/d1f/d24/d39/fb6 x:0 0 0 2024-02-28T16:27:07.893 INFO:tasks.workunit.client.1.smithi157.stdout:8/523: dwrite d1/d5/f71 [0,4194304] 0 2024-02-28T16:27:07.900 INFO:tasks.workunit.client.1.smithi157.stdout:1/565: dwrite d10/d11/d22/faa [0,4194304] 0 2024-02-28T16:27:07.902 INFO:tasks.workunit.client.1.smithi157.stdout:7/583: rename df/d25/c3c to df/d1f/d24/d39/cb7 0 2024-02-28T16:27:07.908 INFO:tasks.workunit.client.1.smithi157.stdout:6/543: dwrite d2/d7/d8/da/d31/d37/d2d/f48 [0,4194304] 0 2024-02-28T16:27:07.910 INFO:tasks.workunit.client.1.smithi157.stdout:8/524: write d1/d5/d14/d3e/d52/d54/f7b [599299,28968] 0 2024-02-28T16:27:07.915 INFO:tasks.workunit.client.1.smithi157.stdout:7/584: creat df/d4b/d4c/fb8 x:0 0 0 2024-02-28T16:27:07.915 INFO:tasks.workunit.client.1.smithi157.stdout:2/605: dwrite da/d47/f77 [0,4194304] 0 2024-02-28T16:27:07.916 INFO:tasks.workunit.client.1.smithi157.stdout:9/532: dwrite d0/d19/f8d [0,4194304] 0 2024-02-28T16:27:07.916 INFO:tasks.workunit.client.1.smithi157.stdout:1/566: write d10/d11/d31/d2a/d70/f96 [401446,34979] 0 2024-02-28T16:27:07.917 INFO:tasks.workunit.client.1.smithi157.stdout:8/525: symlink d1/d5/d43/d86/lb3 0 2024-02-28T16:27:07.920 INFO:tasks.workunit.client.1.smithi157.stdout:2/606: dread - da/d38/f57 zero size 2024-02-28T16:27:07.921 INFO:tasks.workunit.client.1.smithi157.stdout:9/533: write d0/d36/f63 [200059,30296] 0 2024-02-28T16:27:07.924 INFO:tasks.workunit.client.1.smithi157.stdout:6/544: mkdir d2/da0 0 2024-02-28T16:27:07.924 INFO:tasks.workunit.client.1.smithi157.stdout:8/526: write d1/d5/d23/d38/d6e/d85/f9d [5226658,45502] 0 2024-02-28T16:27:07.924 INFO:tasks.workunit.client.1.smithi157.stdout:1/567: mknod d10/d11/d22/d99/cb1 0 2024-02-28T16:27:07.925 INFO:tasks.workunit.client.1.smithi157.stdout:2/607: creat da/d38/d3e/d9b/da3/fc5 x:0 0 0 2024-02-28T16:27:07.925 INFO:tasks.workunit.client.1.smithi157.stdout:7/585: truncate fb 647930 0 2024-02-28T16:27:07.925 INFO:tasks.workunit.client.1.smithi157.stdout:6/545: dread - d2/d7/d8/da/f8e zero size 2024-02-28T16:27:07.927 INFO:tasks.workunit.client.1.smithi157.stdout:9/534: mknod d0/d36/d37/d4d/d92/cb7 0 2024-02-28T16:27:07.928 INFO:tasks.workunit.client.1.smithi157.stdout:7/586: write df/d4b/d4c/fb8 [686243,68762] 0 2024-02-28T16:27:07.929 INFO:tasks.workunit.client.1.smithi157.stdout:8/527: write d1/d5/f3b [1925363,27029] 0 2024-02-28T16:27:07.930 INFO:tasks.workunit.client.1.smithi157.stdout:1/568: unlink d10/d11/d3a/laf 0 2024-02-28T16:27:07.944 INFO:tasks.workunit.client.1.smithi157.stdout:8/528: fsync d1/d5/d23/d38/d67/d6d/f7e 0 2024-02-28T16:27:07.948 INFO:tasks.workunit.client.1.smithi157.stdout:8/529: write d1/d5/d23/d53/f76 [156561,100725] 0 2024-02-28T16:27:07.948 INFO:tasks.workunit.client.1.smithi157.stdout:9/535: write d0/d36/d37/d40/f49 [8121933,129729] 0 2024-02-28T16:27:07.949 INFO:tasks.workunit.client.1.smithi157.stdout:2/608: creat da/d38/fc6 x:0 0 0 2024-02-28T16:27:07.952 INFO:tasks.workunit.client.1.smithi157.stdout:8/530: dread - d1/d5/d14/d3e/fb1 zero size 2024-02-28T16:27:07.952 INFO:tasks.workunit.client.1.smithi157.stdout:6/546: mkdir d2/d7/d8/da/da1 0 2024-02-28T16:27:07.954 INFO:tasks.workunit.client.1.smithi157.stdout:4/551: dread d3/da/d37/f50 [0,4194304] 0 2024-02-28T16:27:07.959 INFO:tasks.workunit.client.1.smithi157.stdout:9/536: mknod d0/d36/d37/d40/d4b/cb8 0 2024-02-28T16:27:07.963 INFO:tasks.workunit.client.1.smithi157.stdout:6/547: fsync d2/d7/d8/da/d31/d3a/f2f 0 2024-02-28T16:27:07.972 INFO:tasks.workunit.client.1.smithi157.stdout:3/499: sync 2024-02-28T16:27:07.974 INFO:tasks.workunit.client.1.smithi157.stdout:7/587: dwrite df/f10 [0,4194304] 0 2024-02-28T16:27:07.977 INFO:tasks.workunit.client.1.smithi157.stdout:0/569: dread d1/d13/d52/db5/fb2 [0,4194304] 0 2024-02-28T16:27:07.981 INFO:tasks.workunit.client.1.smithi157.stdout:7/588: chown df/d40/f6e 126307 1 2024-02-28T16:27:07.981 INFO:tasks.workunit.client.1.smithi157.stdout:1/569: write d10/d11/d22/f62 [427735,108889] 0 2024-02-28T16:27:07.984 INFO:tasks.workunit.client.1.smithi157.stdout:0/570: fdatasync d1/d13/f71 0 2024-02-28T16:27:07.988 INFO:tasks.workunit.client.1.smithi157.stdout:2/609: dwrite da/d38/d4e/f63 [0,4194304] 0 2024-02-28T16:27:07.990 INFO:tasks.workunit.client.1.smithi157.stdout:7/589: chown df/d25/d4e/d67/f45 24920783 1 2024-02-28T16:27:07.992 INFO:tasks.workunit.client.1.smithi157.stdout:2/610: stat da/d38/fc4 0 2024-02-28T16:27:07.995 INFO:tasks.workunit.client.1.smithi157.stdout:9/537: write d0/f5 [4235046,6618] 0 2024-02-28T16:27:07.996 INFO:tasks.workunit.client.1.smithi157.stdout:1/570: dread d10/d11/d22/f3f [0,4194304] 0 2024-02-28T16:27:07.996 INFO:tasks.workunit.client.1.smithi157.stdout:4/552: write d3/da/d37/d71/f73 [697272,37561] 0 2024-02-28T16:27:07.997 INFO:tasks.workunit.client.1.smithi157.stdout:7/590: chown df/d1f/d24/d38/f70 1172 1 2024-02-28T16:27:07.999 INFO:tasks.workunit.client.1.smithi157.stdout:6/548: dread d2/f1f [0,4194304] 0 2024-02-28T16:27:08.001 INFO:tasks.workunit.client.1.smithi157.stdout:3/500: truncate d0/d6/f5f 635880 0 2024-02-28T16:27:08.001 INFO:tasks.workunit.client.1.smithi157.stdout:0/571: truncate d1/d13/d52/d53/f81 79837 0 2024-02-28T16:27:08.003 INFO:tasks.workunit.client.1.smithi157.stdout:7/591: chown df/fae 1144093 1 2024-02-28T16:27:08.004 INFO:tasks.workunit.client.1.smithi157.stdout:1/571: read d10/d11/d3a/f5f [639100,106575] 0 2024-02-28T16:27:08.005 INFO:tasks.workunit.client.1.smithi157.stdout:8/531: dread d1/f17 [0,4194304] 0 2024-02-28T16:27:08.011 INFO:tasks.workunit.client.1.smithi157.stdout:1/572: chown d10/d11/d31/d2a/f64 52268 1 2024-02-28T16:27:08.012 INFO:tasks.workunit.client.1.smithi157.stdout:3/501: dread - d0/f4d zero size 2024-02-28T16:27:08.013 INFO:tasks.workunit.client.1.smithi157.stdout:3/502: write d0/d6/d34/d80/d23/f66 [307549,761] 0 2024-02-28T16:27:08.014 INFO:tasks.workunit.client.1.smithi157.stdout:8/532: fdatasync d1/d5/d43/f45 0 2024-02-28T16:27:08.017 INFO:tasks.workunit.client.1.smithi157.stdout:0/572: mknod d1/d13/cc3 0 2024-02-28T16:27:08.019 INFO:tasks.workunit.client.1.smithi157.stdout:9/538: write d0/f21 [837783,112105] 0 2024-02-28T16:27:08.024 INFO:tasks.workunit.client.1.smithi157.stdout:2/611: getdents da/d2b 0 2024-02-28T16:27:08.025 INFO:tasks.workunit.client.1.smithi157.stdout:8/533: symlink d1/d5/d14/d3e/lb4 0 2024-02-28T16:27:08.031 INFO:tasks.workunit.client.1.smithi157.stdout:0/573: rename d1/d13/d52/d7b/d83 to d1/da/d7d/dc4 0 2024-02-28T16:27:08.031 INFO:tasks.workunit.client.1.smithi157.stdout:9/539: mkdir d0/d36/d37/d4d/d92/db9 0 2024-02-28T16:27:08.032 INFO:tasks.workunit.client.1.smithi157.stdout:2/612: creat da/d38/d5a/d79/fc7 x:0 0 0 2024-02-28T16:27:08.032 INFO:tasks.workunit.client.1.smithi157.stdout:8/534: dread - d1/d5/d4d/d60/f77 zero size 2024-02-28T16:27:08.033 INFO:tasks.workunit.client.1.smithi157.stdout:4/553: dwrite d3/da/d1f/d22/f7a [0,4194304] 0 2024-02-28T16:27:08.036 INFO:tasks.workunit.client.1.smithi157.stdout:7/592: truncate df/d1f/d24/d39/fac 912680 0 2024-02-28T16:27:08.039 INFO:tasks.workunit.client.1.smithi157.stdout:5/570: sync 2024-02-28T16:27:08.040 INFO:tasks.workunit.client.1.smithi157.stdout:6/549: dwrite d2/d7/d8/f1a [0,4194304] 0 2024-02-28T16:27:08.040 INFO:tasks.workunit.client.1.smithi157.stdout:7/593: fdatasync df/d4b/d4c/fb8 0 2024-02-28T16:27:08.046 INFO:tasks.workunit.client.1.smithi157.stdout:3/503: dwrite d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/f93 [0,4194304] 0 2024-02-28T16:27:08.052 INFO:tasks.workunit.client.1.smithi157.stdout:7/594: mknod df/d1f/d37/d46/cb9 0 2024-02-28T16:27:08.055 INFO:tasks.workunit.client.1.smithi157.stdout:6/550: creat d2/d7/d8/da/d71/d80/fa2 x:0 0 0 2024-02-28T16:27:08.062 INFO:tasks.workunit.client.1.smithi157.stdout:6/551: write d2/d7/d8/da/d71/d8f/f45 [391985,40058] 0 2024-02-28T16:27:08.064 INFO:tasks.workunit.client.1.smithi157.stdout:7/595: write df/d4b/f91 [3296344,45161] 0 2024-02-28T16:27:08.066 INFO:tasks.workunit.client.1.smithi157.stdout:8/535: link d1/d5/d10/c11 d1/d5/d23/d38/d6e/d85/cb5 0 2024-02-28T16:27:08.066 INFO:tasks.workunit.client.1.smithi157.stdout:2/613: getdents da/d65/d90 0 2024-02-28T16:27:08.070 INFO:tasks.workunit.client.1.smithi157.stdout:2/614: fdatasync da/d38/f9e 0 2024-02-28T16:27:08.071 INFO:tasks.workunit.client.1.smithi157.stdout:0/574: truncate d1/d13/ff 6603353 0 2024-02-28T16:27:08.073 INFO:tasks.workunit.client.1.smithi157.stdout:3/504: dwrite d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/f93 [0,4194304] 0 2024-02-28T16:27:08.075 INFO:tasks.workunit.client.1.smithi157.stdout:7/596: creat df/d1f/d37/d46/fba x:0 0 0 2024-02-28T16:27:08.080 INFO:tasks.workunit.client.1.smithi157.stdout:9/540: dread d0/f21 [0,4194304] 0 2024-02-28T16:27:08.082 INFO:tasks.workunit.client.1.smithi157.stdout:8/536: rename d1/d5/d14/d3e/lb4 to d1/d5/d23/d38/d67/d6d/lb6 0 2024-02-28T16:27:08.083 INFO:tasks.workunit.client.1.smithi157.stdout:7/597: rmdir df/d1f/d24/d39/d64 39 2024-02-28T16:27:08.085 INFO:tasks.workunit.client.1.smithi157.stdout:7/598: chown df/d25/d79 0 1 2024-02-28T16:27:08.087 INFO:tasks.workunit.client.1.smithi157.stdout:8/537: write d1/d5/d23/d38/d6e/f87 [906844,21374] 0 2024-02-28T16:27:08.088 INFO:tasks.workunit.client.1.smithi157.stdout:5/571: truncate d0/d8/d7e/d82/fc3 1062231 0 2024-02-28T16:27:08.090 INFO:tasks.workunit.client.1.smithi157.stdout:3/505: mknod d0/d6/d44/c9f 0 2024-02-28T16:27:08.090 INFO:tasks.workunit.client.1.smithi157.stdout:0/575: mknod d1/d13/d52/dbe/cc5 0 2024-02-28T16:27:08.091 INFO:tasks.workunit.client.1.smithi157.stdout:9/541: mkdir d0/d36/d37/d40/d5b/dba 0 2024-02-28T16:27:08.093 INFO:tasks.workunit.client.1.smithi157.stdout:8/538: stat d1/d5/ca7 0 2024-02-28T16:27:08.096 INFO:tasks.workunit.client.1.smithi157.stdout:4/554: dwrite d3/da/d28/f5b [0,4194304] 0 2024-02-28T16:27:08.099 INFO:tasks.workunit.client.1.smithi157.stdout:6/552: truncate d2/d7/d8/da/d31/d37/d2d/f48 937304 0 2024-02-28T16:27:08.105 INFO:tasks.workunit.client.1.smithi157.stdout:5/572: creat d0/d9/d47/d5b/d89/d75/fc5 x:0 0 0 2024-02-28T16:27:08.108 INFO:tasks.workunit.client.1.smithi157.stdout:9/542: symlink d0/d19/d30/lbb 0 2024-02-28T16:27:08.110 INFO:tasks.workunit.client.1.smithi157.stdout:2/615: dwrite da/d38/f40 [0,4194304] 0 2024-02-28T16:27:08.113 INFO:tasks.workunit.client.1.smithi157.stdout:7/599: unlink df/d1f/d24/f53 0 2024-02-28T16:27:08.115 INFO:tasks.workunit.client.1.smithi157.stdout:8/539: symlink d1/d5/d14/d3e/lb7 0 2024-02-28T16:27:08.116 INFO:tasks.workunit.client.1.smithi157.stdout:0/576: rename d1/d13/f80 to d1/d13/d52/d7b/dc1/fc6 0 2024-02-28T16:27:08.118 INFO:tasks.workunit.client.1.smithi157.stdout:8/540: fdatasync d1/d5/d23/da1/fa2 0 2024-02-28T16:27:08.120 INFO:tasks.workunit.client.1.smithi157.stdout:3/506: dread d0/d6/d44/d48/f6e [0,4194304] 0 2024-02-28T16:27:08.128 INFO:tasks.workunit.client.1.smithi157.stdout:4/555: symlink d3/da/lb5 0 2024-02-28T16:27:08.128 INFO:tasks.workunit.client.1.smithi157.stdout:5/573: dread d0/d9/f86 [0,4194304] 0 2024-02-28T16:27:08.130 INFO:tasks.workunit.client.1.smithi157.stdout:3/507: dread d0/d6/d34/d80/d23/f66 [0,4194304] 0 2024-02-28T16:27:08.132 INFO:tasks.workunit.client.1.smithi157.stdout:0/577: rmdir d1/da/d7d 39 2024-02-28T16:27:08.133 INFO:tasks.workunit.client.1.smithi157.stdout:7/600: truncate df/d25/d4e/f52 4399458 0 2024-02-28T16:27:08.136 INFO:tasks.workunit.client.1.smithi157.stdout:8/541: dwrite d1/d5/d14/f9b [0,4194304] 0 2024-02-28T16:27:08.141 INFO:tasks.workunit.client.1.smithi157.stdout:9/543: dwrite d0/f33 [0,4194304] 0 2024-02-28T16:27:08.145 INFO:tasks.workunit.client.1.smithi157.stdout:4/556: symlink d3/da/d28/lb6 0 2024-02-28T16:27:08.148 INFO:tasks.workunit.client.1.smithi157.stdout:4/557: write d3/da/d37/d71/f9d [1585535,101186] 0 2024-02-28T16:27:08.148 INFO:tasks.workunit.client.1.smithi157.stdout:3/508: chown d0/d6/f17 3 1 2024-02-28T16:27:08.150 INFO:tasks.workunit.client.1.smithi157.stdout:4/558: readlink d3/le 0 2024-02-28T16:27:08.153 INFO:tasks.workunit.client.1.smithi157.stdout:0/578: stat d1/da/d7d/dc4/fb9 0 2024-02-28T16:27:08.155 INFO:tasks.workunit.client.1.smithi157.stdout:0/579: truncate d1/d13/d46/fbc 1001037 0 2024-02-28T16:27:08.156 INFO:tasks.workunit.client.1.smithi157.stdout:0/580: stat d1/d13/d57/fae 0 2024-02-28T16:27:08.158 INFO:tasks.workunit.client.1.smithi157.stdout:8/542: symlink d1/d5/d23/d38/d67/lb8 0 2024-02-28T16:27:08.162 INFO:tasks.workunit.client.1.smithi157.stdout:2/616: rmdir da/d38/d7e/d9a 0 2024-02-28T16:27:08.168 INFO:tasks.workunit.client.1.smithi157.stdout:0/581: mknod d1/d8/d33/d96/cc7 0 2024-02-28T16:27:08.169 INFO:tasks.workunit.client.1.smithi157.stdout:0/582: fdatasync d1/d8/d33/d96/fa7 0 2024-02-28T16:27:08.171 INFO:tasks.workunit.client.1.smithi157.stdout:0/583: chown d1/da/d6c/fab 0 1 2024-02-28T16:27:08.172 INFO:tasks.workunit.client.1.smithi157.stdout:8/543: mkdir d1/d5/d23/d38/d67/db9 0 2024-02-28T16:27:08.175 INFO:tasks.workunit.client.1.smithi157.stdout:7/601: write df/d1f/f7e [4142091,105891] 0 2024-02-28T16:27:08.177 INFO:tasks.workunit.client.1.smithi157.stdout:2/617: creat da/d65/d90/fc8 x:0 0 0 2024-02-28T16:27:08.179 INFO:tasks.workunit.client.1.smithi157.stdout:2/618: read da/f2c [1984643,13734] 0 2024-02-28T16:27:08.181 INFO:tasks.workunit.client.1.smithi157.stdout:0/584: symlink d1/lc8 0 2024-02-28T16:27:08.183 INFO:tasks.workunit.client.1.smithi157.stdout:9/544: creat d0/fbc x:0 0 0 2024-02-28T16:27:08.185 INFO:tasks.workunit.client.1.smithi157.stdout:8/544: mknod d1/d5/d43/d86/d96/cba 0 2024-02-28T16:27:08.185 INFO:tasks.workunit.client.1.smithi157.stdout:9/545: fdatasync d0/d36/d37/d40/d4b/d96/f99 0 2024-02-28T16:27:08.187 INFO:tasks.workunit.client.1.smithi157.stdout:9/546: write d0/f5 [3318010,44904] 0 2024-02-28T16:27:08.187 INFO:tasks.workunit.client.1.smithi157.stdout:5/574: getdents d0/d8/d7e/d82 0 2024-02-28T16:27:08.190 INFO:tasks.workunit.client.1.smithi157.stdout:5/575: write d0/d9/d47/d5b/d89/fb8 [5057525,122284] 0 2024-02-28T16:27:08.192 INFO:tasks.workunit.client.1.smithi157.stdout:7/602: rename df/d25/d4e/f52 to df/d1f/d37/fbb 0 2024-02-28T16:27:08.194 INFO:tasks.workunit.client.1.smithi157.stdout:7/603: chown df/d1f/d37/fa2 2766838 1 2024-02-28T16:27:08.197 INFO:tasks.workunit.client.1.smithi157.stdout:3/509: dwrite d0/d6/f11 [0,4194304] 0 2024-02-28T16:27:08.197 INFO:tasks.workunit.client.1.smithi157.stdout:9/547: symlink d0/d36/d3f/lbd 0 2024-02-28T16:27:08.198 INFO:tasks.workunit.client.1.smithi157.stdout:5/576: mkdir d0/d9/d47/d5b/dc6 0 2024-02-28T16:27:08.199 INFO:tasks.workunit.client.1.smithi157.stdout:9/548: chown d0/lc 556 1 2024-02-28T16:27:08.200 INFO:tasks.workunit.client.1.smithi157.stdout:9/549: stat d0/d36/l88 0 2024-02-28T16:27:08.204 INFO:tasks.workunit.client.1.smithi157.stdout:2/619: truncate da/d47/f77 2356702 0 2024-02-28T16:27:08.204 INFO:tasks.workunit.client.1.smithi157.stdout:7/604: getdents df/d25/d79/d9e 0 2024-02-28T16:27:08.205 INFO:tasks.workunit.client.1.smithi157.stdout:0/585: rename d1/d13/d52/dbe to d1/d13/dc9 0 2024-02-28T16:27:08.206 INFO:tasks.workunit.client.1.smithi157.stdout:7/605: write df/d4b/d4c/fb8 [203006,60804] 0 2024-02-28T16:27:08.207 INFO:tasks.workunit.client.1.smithi157.stdout:3/510: creat d0/d6/d6b/d9e/fa0 x:0 0 0 2024-02-28T16:27:08.207 INFO:tasks.workunit.client.1.smithi157.stdout:2/620: mknod da/d38/d5a/d79/cc9 0 2024-02-28T16:27:08.208 INFO:tasks.workunit.client.1.smithi157.stdout:1/573: sync 2024-02-28T16:27:08.214 INFO:tasks.workunit.client.1.smithi157.stdout:8/545: rename d1/d5/d23/d38/d67/d6d/lb6 to d1/d5/d4d/lbb 0 2024-02-28T16:27:08.214 INFO:tasks.workunit.client.1.smithi157.stdout:2/621: write da/d38/d5a/d79/d7b/f81 [2396966,89638] 0 2024-02-28T16:27:08.217 INFO:tasks.workunit.client.1.smithi157.stdout:2/622: chown da/d38/f89 1 1 2024-02-28T16:27:08.218 INFO:tasks.workunit.client.1.smithi157.stdout:5/577: dread d0/d9/d47/f54 [0,4194304] 0 2024-02-28T16:27:08.218 INFO:tasks.workunit.client.1.smithi157.stdout:0/586: write d1/da/d7d/dc4/fb9 [3224,39094] 0 2024-02-28T16:27:08.219 INFO:tasks.workunit.client.1.smithi157.stdout:1/574: creat d10/d11/d31/d2a/fb2 x:0 0 0 2024-02-28T16:27:08.220 INFO:tasks.workunit.client.1.smithi157.stdout:9/550: rename d0/d19/d30/db0 to d0/d36/daa/dbe 0 2024-02-28T16:27:08.221 INFO:tasks.workunit.client.1.smithi157.stdout:8/546: mkdir d1/d5/d14/d3e/d52/d54/dbc 0 2024-02-28T16:27:08.223 INFO:tasks.workunit.client.1.smithi157.stdout:2/623: mkdir da/d47/dca 0 2024-02-28T16:27:08.225 INFO:tasks.workunit.client.1.smithi157.stdout:8/547: write d1/d5/d23/d38/d6e/d85/f9d [2241223,99838] 0 2024-02-28T16:27:08.226 INFO:tasks.workunit.client.1.smithi157.stdout:3/511: dread d0/d6/d34/d80/f53 [0,4194304] 0 2024-02-28T16:27:08.227 INFO:tasks.workunit.client.1.smithi157.stdout:8/548: chown d1/d5/d10/l2e 78464 1 2024-02-28T16:27:08.232 INFO:tasks.workunit.client.1.smithi157.stdout:1/575: creat d10/d94/fb3 x:0 0 0 2024-02-28T16:27:08.233 INFO:tasks.workunit.client.1.smithi157.stdout:9/551: creat d0/d36/d37/d4d/d92/fbf x:0 0 0 2024-02-28T16:27:08.237 INFO:tasks.workunit.client.1.smithi157.stdout:5/578: rename d0/d30/d50/d7f/dc4 to d0/d8/d7e/d82/dc7 0 2024-02-28T16:27:08.239 INFO:tasks.workunit.client.1.smithi157.stdout:2/624: dwrite da/d38/d4e/d91/f8a [0,4194304] 0 2024-02-28T16:27:08.242 INFO:tasks.workunit.client.1.smithi157.stdout:7/606: getdents df/d1f/d24/d39 0 2024-02-28T16:27:08.269 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:07 smithi157 ceph-mon[38346]: pgmap v58: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 168 MiB/s wr, 331 op/s 2024-02-28T16:27:08.305 INFO:tasks.workunit.client.1.smithi157.stdout:3/512: creat d0/d6/d34/d80/d23/d2b/d2e/d7e/fa1 x:0 0 0 2024-02-28T16:27:08.310 INFO:tasks.workunit.client.1.smithi157.stdout:5/579: mknod d0/cc8 0 2024-02-28T16:27:08.312 INFO:tasks.workunit.client.1.smithi157.stdout:8/549: dwrite d1/d5/d23/f91 [0,4194304] 0 2024-02-28T16:27:08.314 INFO:tasks.workunit.client.1.smithi157.stdout:5/580: write d0/d9/d47/f6d [1835848,2838] 0 2024-02-28T16:27:08.315 INFO:tasks.workunit.client.1.smithi157.stdout:3/513: rmdir d0/d6/d6b/d9e 39 2024-02-28T16:27:08.315 INFO:tasks.workunit.client.1.smithi157.stdout:0/587: dwrite d1/d13/d52/db5/fb2 [0,4194304] 0 2024-02-28T16:27:08.318 INFO:tasks.workunit.client.1.smithi157.stdout:3/514: chown d0/d6/d34/d80/d23/l36 4 1 2024-02-28T16:27:08.326 INFO:tasks.workunit.client.1.smithi157.stdout:0/588: creat d1/da/d7d/fca x:0 0 0 2024-02-28T16:27:08.327 INFO:tasks.workunit.client.1.smithi157.stdout:7/607: dwrite df/d25/d79/f82 [0,4194304] 0 2024-02-28T16:27:08.328 INFO:tasks.workunit.client.1.smithi157.stdout:9/552: write d0/d36/d37/f43 [1638562,59112] 0 2024-02-28T16:27:08.330 INFO:tasks.workunit.client.1.smithi157.stdout:8/550: mkdir d1/d5/d23/dbd 0 2024-02-28T16:27:08.337 INFO:tasks.workunit.client.1.smithi157.stdout:3/515: fdatasync d0/d6/d44/f78 0 2024-02-28T16:27:08.341 INFO:tasks.workunit.client.1.smithi157.stdout:2/625: dwrite da/d38/d3e/d9b/da3/f68 [0,4194304] 0 2024-02-28T16:27:08.347 INFO:tasks.workunit.client.1.smithi157.stdout:6/553: sync 2024-02-28T16:27:08.348 INFO:tasks.workunit.client.1.smithi157.stdout:9/553: mkdir d0/dc0 0 2024-02-28T16:27:08.352 INFO:tasks.workunit.client.1.smithi157.stdout:5/581: dwrite d0/d9/f42 [0,4194304] 0 2024-02-28T16:27:08.373 INFO:tasks.workunit.client.1.smithi157.stdout:5/582: creat d0/d9/d47/d5b/d89/fc9 x:0 0 0 2024-02-28T16:27:08.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:07 smithi148 ceph-mon[28767]: pgmap v58: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 168 MiB/s wr, 331 op/s 2024-02-28T16:27:08.374 INFO:tasks.workunit.client.1.smithi157.stdout:7/608: truncate df/d1f/d24/d39/fb4 1814347 0 2024-02-28T16:27:08.376 INFO:tasks.workunit.client.1.smithi157.stdout:8/551: write d1/d5/f4a [497214,63947] 0 2024-02-28T16:27:08.376 INFO:tasks.workunit.client.1.smithi157.stdout:7/609: chown df/d25/c36 5 1 2024-02-28T16:27:08.377 INFO:tasks.workunit.client.1.smithi157.stdout:3/516: rename d0/d6/d34/d80/f53 to d0/d6/d6b/d9e/fa2 0 2024-02-28T16:27:08.378 INFO:tasks.workunit.client.1.smithi157.stdout:2/626: truncate da/f46 4007532 0 2024-02-28T16:27:08.380 INFO:tasks.workunit.client.1.smithi157.stdout:3/517: fsync d0/d6/d34/d80/d23/d2b/f32 0 2024-02-28T16:27:08.383 INFO:tasks.workunit.client.1.smithi157.stdout:8/552: mknod d1/d5/d23/da1/cbe 0 2024-02-28T16:27:08.384 INFO:tasks.workunit.client.1.smithi157.stdout:6/554: creat d2/fa3 x:0 0 0 2024-02-28T16:27:08.385 INFO:tasks.workunit.client.1.smithi157.stdout:7/610: mknod df/d25/d79/cbc 0 2024-02-28T16:27:08.386 INFO:tasks.workunit.client.1.smithi157.stdout:0/589: getdents d1/d13/d7f 0 2024-02-28T16:27:08.387 INFO:tasks.workunit.client.1.smithi157.stdout:9/554: link d0/f12 d0/d36/d37/d4d/d92/db9/fc1 0 2024-02-28T16:27:08.390 INFO:tasks.workunit.client.1.smithi157.stdout:5/583: dwrite d0/d9/d47/d5b/d89/d75/dab/fc2 [0,4194304] 0 2024-02-28T16:27:08.396 INFO:tasks.workunit.client.1.smithi157.stdout:9/555: unlink d0/d36/d37/d4d/f5d 0 2024-02-28T16:27:08.398 INFO:tasks.workunit.client.1.smithi157.stdout:5/584: mkdir d0/d30/dca 0 2024-02-28T16:27:08.404 INFO:tasks.workunit.client.1.smithi157.stdout:7/611: dwrite df/f31 [4194304,4194304] 0 2024-02-28T16:27:08.409 INFO:tasks.workunit.client.1.smithi157.stdout:3/518: getdents d0/d6/d34/d80/d23/d2b/d81 0 2024-02-28T16:27:08.412 INFO:tasks.workunit.client.1.smithi157.stdout:8/553: getdents d1/d5/d23/d38/d6e/d85 0 2024-02-28T16:27:08.415 INFO:tasks.workunit.client.1.smithi157.stdout:7/612: creat df/d25/da7/fbd x:0 0 0 2024-02-28T16:27:08.417 INFO:tasks.workunit.client.1.smithi157.stdout:7/613: dread - df/fae zero size 2024-02-28T16:27:08.417 INFO:tasks.workunit.client.1.smithi157.stdout:9/556: dwrite d0/d36/d3f/f93 [0,4194304] 0 2024-02-28T16:27:08.418 INFO:tasks.workunit.client.1.smithi157.stdout:6/555: getdents d2/d7/d8/da/d4c 0 2024-02-28T16:27:08.428 INFO:tasks.workunit.client.1.smithi157.stdout:3/519: creat d0/fa3 x:0 0 0 2024-02-28T16:27:08.428 INFO:tasks.workunit.client.1.smithi157.stdout:9/557: mkdir d0/d36/dc2 0 2024-02-28T16:27:08.430 INFO:tasks.workunit.client.1.smithi157.stdout:5/585: rename d0/d9/f98 to d0/d9/d47/d5b/fcb 0 2024-02-28T16:27:08.435 INFO:tasks.workunit.client.1.smithi157.stdout:5/586: dread - d0/d30/d50/fae zero size 2024-02-28T16:27:08.435 INFO:tasks.workunit.client.1.smithi157.stdout:8/554: dwrite d1/d5/f3b [0,4194304] 0 2024-02-28T16:27:08.439 INFO:tasks.workunit.client.1.smithi157.stdout:9/558: symlink d0/d36/d37/d40/d4b/d96/lc3 0 2024-02-28T16:27:08.439 INFO:tasks.workunit.client.1.smithi157.stdout:0/590: dread d1/d13/d57/f5c [0,4194304] 0 2024-02-28T16:27:08.443 INFO:tasks.workunit.client.1.smithi157.stdout:8/555: write d1/d5/d23/d38/d6e/d85/f9d [2233987,60814] 0 2024-02-28T16:27:08.445 INFO:tasks.workunit.client.1.smithi157.stdout:6/556: dwrite d2/d7/d8/da/d31/d37/d2d/f60 [0,4194304] 0 2024-02-28T16:27:08.445 INFO:tasks.workunit.client.1.smithi157.stdout:9/559: write d0/d36/d37/d40/f62 [454994,87429] 0 2024-02-28T16:27:08.446 INFO:tasks.workunit.client.1.smithi157.stdout:3/520: creat d0/d6/d1e/d5b/d9d/fa4 x:0 0 0 2024-02-28T16:27:08.449 INFO:tasks.workunit.client.1.smithi157.stdout:6/557: readlink d2/d7/de/d40/l44 0 2024-02-28T16:27:08.451 INFO:tasks.workunit.client.1.smithi157.stdout:5/587: truncate d0/d30/d50/d7f/f8c 238793 0 2024-02-28T16:27:08.456 INFO:tasks.workunit.client.1.smithi157.stdout:9/560: chown d0/d36/d37/d40/d5b/fa5 44 1 2024-02-28T16:27:08.461 INFO:tasks.workunit.client.1.smithi157.stdout:9/561: chown d0/d19/d30/d79/f87 35141303 1 2024-02-28T16:27:08.464 INFO:tasks.workunit.client.1.smithi157.stdout:7/614: dread df/f17 [0,4194304] 0 2024-02-28T16:27:08.465 INFO:tasks.workunit.client.1.smithi157.stdout:6/558: rename d2/d7/d8/da/d31/d37/d2d to d2/d7/de/d1b/d3d/da4 0 2024-02-28T16:27:08.467 INFO:tasks.workunit.client.1.smithi157.stdout:0/591: write d1/d8/d33/d56/f5d [464007,29685] 0 2024-02-28T16:27:08.469 INFO:tasks.workunit.client.1.smithi157.stdout:8/556: dwrite d1/d5/d14/f9b [0,4194304] 0 2024-02-28T16:27:08.471 INFO:tasks.workunit.client.1.smithi157.stdout:7/615: symlink df/d80/lbe 0 2024-02-28T16:27:08.472 INFO:tasks.workunit.client.1.smithi157.stdout:0/592: chown d1/d8/f1d 372907715 1 2024-02-28T16:27:08.473 INFO:tasks.workunit.client.1.smithi157.stdout:5/588: rename d0/c81 to d0/d9/d47/d5b/d89/d75/ccc 0 2024-02-28T16:27:08.474 INFO:tasks.workunit.client.1.smithi157.stdout:8/557: dread - d1/d5/d10/faf zero size 2024-02-28T16:27:08.474 INFO:tasks.workunit.client.1.smithi157.stdout:3/521: dwrite d0/d6/f2d [0,4194304] 0 2024-02-28T16:27:08.482 INFO:tasks.workunit.client.1.smithi157.stdout:0/593: rmdir d1/d13 39 2024-02-28T16:27:08.486 INFO:tasks.workunit.client.1.smithi157.stdout:9/562: link d0/d36/d37/c82 d0/d36/d37/d4d/d92/cc4 0 2024-02-28T16:27:08.487 INFO:tasks.workunit.client.1.smithi157.stdout:4/559: sync 2024-02-28T16:27:08.488 INFO:tasks.workunit.client.1.smithi157.stdout:6/559: creat d2/d7/d8/da/d71/d93/fa5 x:0 0 0 2024-02-28T16:27:08.494 INFO:tasks.workunit.client.1.smithi157.stdout:4/560: mkdir d3/da/d48/d4a/db7 0 2024-02-28T16:27:08.495 INFO:tasks.workunit.client.1.smithi157.stdout:0/594: symlink d1/d13/d46/lcb 0 2024-02-28T16:27:08.496 INFO:tasks.workunit.client.1.smithi157.stdout:7/616: link df/d25/c26 df/d1f/cbf 0 2024-02-28T16:27:08.497 INFO:tasks.workunit.client.1.smithi157.stdout:6/560: mkdir d2/d7/de/d1b/d3d/da4/d53/da6 0 2024-02-28T16:27:08.498 INFO:tasks.workunit.client.1.smithi157.stdout:3/522: dwrite d0/d6/d6b/f73 [0,4194304] 0 2024-02-28T16:27:08.501 INFO:tasks.workunit.client.1.smithi157.stdout:0/595: creat d1/d13/d7f/fcc x:0 0 0 2024-02-28T16:27:08.502 INFO:tasks.workunit.client.1.smithi157.stdout:5/589: dwrite d0/d9/d47/f56 [0,4194304] 0 2024-02-28T16:27:08.503 INFO:tasks.workunit.client.1.smithi157.stdout:0/596: write d1/d13/f73 [1715417,67640] 0 2024-02-28T16:27:08.505 INFO:tasks.workunit.client.1.smithi157.stdout:5/590: write d0/d8/f18 [2492216,69571] 0 2024-02-28T16:27:08.506 INFO:tasks.workunit.client.1.smithi157.stdout:0/597: chown d1/da/d7d/dc4/fb9 95479307 1 2024-02-28T16:27:08.507 INFO:tasks.workunit.client.1.smithi157.stdout:4/561: symlink d3/da/lb8 0 2024-02-28T16:27:08.508 INFO:tasks.workunit.client.1.smithi157.stdout:7/617: symlink df/d1f/d37/d46/lc0 0 2024-02-28T16:27:08.510 INFO:tasks.workunit.client.1.smithi157.stdout:9/563: write d0/d36/d3f/f93 [5030974,124829] 0 2024-02-28T16:27:08.511 INFO:tasks.workunit.client.1.smithi157.stdout:7/618: chown df/d1f/d24/f99 12768320 1 2024-02-28T16:27:08.513 INFO:tasks.workunit.client.1.smithi157.stdout:3/523: mknod d0/d6/d34/d80/d5c/ca5 0 2024-02-28T16:27:08.515 INFO:tasks.workunit.client.1.smithi157.stdout:8/558: dread d1/d5/d14/f42 [0,4194304] 0 2024-02-28T16:27:08.516 INFO:tasks.workunit.client.1.smithi157.stdout:5/591: chown d0/d9/d1b 48307 1 2024-02-28T16:27:08.517 INFO:tasks.workunit.client.1.smithi157.stdout:7/619: symlink df/d25/lc1 0 2024-02-28T16:27:08.520 INFO:tasks.workunit.client.1.smithi157.stdout:3/524: readlink d0/l41 0 2024-02-28T16:27:08.523 INFO:tasks.workunit.client.1.smithi157.stdout:6/561: creat d2/d7/d8/fa7 x:0 0 0 2024-02-28T16:27:08.523 INFO:tasks.workunit.client.1.smithi157.stdout:9/564: creat d0/d36/d37/d40/d4b/d96/fc5 x:0 0 0 2024-02-28T16:27:08.524 INFO:tasks.workunit.client.1.smithi157.stdout:7/620: write df/d1f/d24/d38/f57 [966104,27553] 0 2024-02-28T16:27:08.526 INFO:tasks.workunit.client.1.smithi157.stdout:0/598: read d1/d13/ff [788248,130768] 0 2024-02-28T16:27:08.529 INFO:tasks.workunit.client.1.smithi157.stdout:6/562: symlink d2/d7/de/la8 0 2024-02-28T16:27:08.530 INFO:tasks.workunit.client.1.smithi157.stdout:6/563: dread - d2/fa3 zero size 2024-02-28T16:27:08.531 INFO:tasks.workunit.client.1.smithi157.stdout:0/599: creat d1/da/d7d/fcd x:0 0 0 2024-02-28T16:27:08.532 INFO:tasks.workunit.client.1.smithi157.stdout:6/564: write d2/d17/f25 [7195385,98345] 0 2024-02-28T16:27:08.537 INFO:tasks.workunit.client.1.smithi157.stdout:5/592: getdents d0/d30/d50/d7f 0 2024-02-28T16:27:08.539 INFO:tasks.workunit.client.1.smithi157.stdout:4/562: dread d3/da/d1f/d22/f83 [0,4194304] 0 2024-02-28T16:27:08.542 INFO:tasks.workunit.client.1.smithi157.stdout:0/600: rename d1/d13/d52/db5/d8e/c95 to d1/d13/d52/d7b/dc1/cce 0 2024-02-28T16:27:08.543 INFO:tasks.workunit.client.1.smithi157.stdout:3/525: dwrite d0/d6/d34/d80/d23/d2b/f57 [0,4194304] 0 2024-02-28T16:27:08.544 INFO:tasks.workunit.client.1.smithi157.stdout:0/601: write d1/d8/f2c [862692,100901] 0 2024-02-28T16:27:08.547 INFO:tasks.workunit.client.1.smithi157.stdout:6/565: symlink d2/d7/la9 0 2024-02-28T16:27:08.547 INFO:tasks.workunit.client.1.smithi157.stdout:5/593: mknod d0/d9/d1b/d36/daf/ccd 0 2024-02-28T16:27:08.550 INFO:tasks.workunit.client.1.smithi157.stdout:6/566: dread - d2/d7/d8/da/d4c/f72 zero size 2024-02-28T16:27:08.550 INFO:tasks.workunit.client.1.smithi157.stdout:0/602: mkdir d1/d13/d52/d7b/dcf 0 2024-02-28T16:27:08.551 INFO:tasks.workunit.client.1.smithi157.stdout:8/559: truncate d1/d5/d23/d53/f6c 130817 0 2024-02-28T16:27:08.554 INFO:tasks.workunit.client.1.smithi157.stdout:8/560: readlink d1/d5/d10/l1f 0 2024-02-28T16:27:08.555 INFO:tasks.workunit.client.1.smithi157.stdout:9/565: truncate d0/d19/d30/f48 488921 0 2024-02-28T16:27:08.556 INFO:tasks.workunit.client.1.smithi157.stdout:5/594: mknod d0/d8/d7e/d82/cce 0 2024-02-28T16:27:08.557 INFO:tasks.workunit.client.1.smithi157.stdout:2/627: sync 2024-02-28T16:27:08.557 INFO:tasks.workunit.client.1.smithi157.stdout:1/576: sync 2024-02-28T16:27:08.557 INFO:tasks.workunit.client.1.smithi157.stdout:9/566: fsync d0/d19/f8d 0 2024-02-28T16:27:08.559 INFO:tasks.workunit.client.1.smithi157.stdout:6/567: unlink d2/d7/d8/da/d4c/f72 0 2024-02-28T16:27:08.563 INFO:tasks.workunit.client.1.smithi157.stdout:8/561: symlink d1/d5/d43/d86/lbf 0 2024-02-28T16:27:08.563 INFO:tasks.workunit.client.1.smithi157.stdout:4/563: dwrite d3/da/d37/fa0 [0,4194304] 0 2024-02-28T16:27:08.565 INFO:tasks.workunit.client.1.smithi157.stdout:3/526: dwrite d0/d6/d44/d70/d71/d87/f95 [0,4194304] 0 2024-02-28T16:27:08.565 INFO:tasks.workunit.client.1.smithi157.stdout:6/568: write d2/d7/de/d1b/d3d/da4/d66/f84 [257844,20704] 0 2024-02-28T16:27:08.567 INFO:tasks.workunit.client.1.smithi157.stdout:0/603: mknod d1/d13/d52/d7b/dcf/cd0 0 2024-02-28T16:27:08.567 INFO:tasks.workunit.client.1.smithi157.stdout:2/628: rmdir da/d38/d3e 39 2024-02-28T16:27:08.568 INFO:tasks.workunit.client.1.smithi157.stdout:3/527: fdatasync d0/d6/d1e/d5b/d9d/fa4 0 2024-02-28T16:27:08.570 INFO:tasks.workunit.client.1.smithi157.stdout:1/577: fsync d10/d11/d3a/d5c/d6a/fa6 0 2024-02-28T16:27:08.576 INFO:tasks.workunit.client.1.smithi157.stdout:8/562: chown d1/d5/d14/l24 1169301641 1 2024-02-28T16:27:08.580 INFO:tasks.workunit.client.1.smithi157.stdout:0/604: dread d1/d13/d52/d53/f81 [0,4194304] 0 2024-02-28T16:27:08.585 INFO:tasks.workunit.client.1.smithi157.stdout:4/564: symlink d3/da/d48/lb9 0 2024-02-28T16:27:08.586 INFO:tasks.workunit.client.1.smithi157.stdout:1/578: write d10/f6b [1479682,77394] 0 2024-02-28T16:27:08.588 INFO:tasks.workunit.client.1.smithi157.stdout:3/528: truncate d0/d6/f5f 859587 0 2024-02-28T16:27:08.598 INFO:tasks.workunit.client.1.smithi157.stdout:9/567: dwrite d0/d36/d37/d40/d4b/d96/f99 [0,4194304] 0 2024-02-28T16:27:08.601 INFO:tasks.workunit.client.1.smithi157.stdout:3/529: mkdir d0/d6/d44/d4b/da6 0 2024-02-28T16:27:08.606 INFO:tasks.workunit.client.1.smithi157.stdout:2/629: dwrite da/d38/d4e/d91/f8a [4194304,4194304] 0 2024-02-28T16:27:08.606 INFO:tasks.workunit.client.1.smithi157.stdout:9/568: truncate d0/f12 5217550 0 2024-02-28T16:27:08.619 INFO:tasks.workunit.client.1.smithi157.stdout:6/569: dwrite d2/d7/d8/f56 [4194304,4194304] 0 2024-02-28T16:27:08.619 INFO:tasks.workunit.client.1.smithi157.stdout:2/630: chown da/d38/d5a/d79 21489576 1 2024-02-28T16:27:08.619 INFO:tasks.workunit.client.1.smithi157.stdout:5/595: dread d0/d9/f79 [0,4194304] 0 2024-02-28T16:27:08.621 INFO:tasks.workunit.client.1.smithi157.stdout:8/563: truncate d1/d5/d23/d38/d6e/d85/f9d 1396936 0 2024-02-28T16:27:08.629 INFO:tasks.workunit.client.1.smithi157.stdout:1/579: dwrite d10/d11/d22/d99/fb0 [0,4194304] 0 2024-02-28T16:27:08.629 INFO:tasks.workunit.client.1.smithi157.stdout:6/570: readlink d2/d7/de/d1b/l41 0 2024-02-28T16:27:08.631 INFO:tasks.workunit.client.1.smithi157.stdout:4/565: dwrite d3/da/d37/d71/f73 [0,4194304] 0 2024-02-28T16:27:08.631 INFO:tasks.workunit.client.1.smithi157.stdout:0/605: dwrite d1/d13/d52/db5/d64/fb7 [0,4194304] 0 2024-02-28T16:27:08.643 INFO:tasks.workunit.client.1.smithi157.stdout:0/606: truncate d1/d13/d46/d99/fa4 5466543 0 2024-02-28T16:27:08.646 INFO:tasks.workunit.client.1.smithi157.stdout:0/607: write d1/d13/d46/f51 [1229842,93656] 0 2024-02-28T16:27:08.651 INFO:tasks.workunit.client.1.smithi157.stdout:0/608: chown d1/da/f43 73191580 1 2024-02-28T16:27:08.651 INFO:tasks.workunit.client.1.smithi157.stdout:6/571: mknod d2/d7/d92/d9d/caa 0 2024-02-28T16:27:08.652 INFO:tasks.workunit.client.1.smithi157.stdout:4/566: symlink d3/da/d37/d71/db0/lba 0 2024-02-28T16:27:08.653 INFO:tasks.workunit.client.1.smithi157.stdout:5/596: link d0/lb6 d0/d30/dca/lcf 0 2024-02-28T16:27:08.661 INFO:tasks.workunit.client.1.smithi157.stdout:6/572: fdatasync d2/d7/de/d40/f65 0 2024-02-28T16:27:08.663 INFO:tasks.workunit.client.1.smithi157.stdout:5/597: truncate d0/d30/f5f 1000449 0 2024-02-28T16:27:08.665 INFO:tasks.workunit.client.1.smithi157.stdout:9/569: dread d0/d36/d37/d40/d4b/f6d [0,4194304] 0 2024-02-28T16:27:08.665 INFO:tasks.workunit.client.1.smithi157.stdout:0/609: mkdir d1/dd1 0 2024-02-28T16:27:08.665 INFO:tasks.workunit.client.1.smithi157.stdout:2/631: dwrite da/d38/d3e/f5b [0,4194304] 0 2024-02-28T16:27:08.666 INFO:tasks.workunit.client.1.smithi157.stdout:3/530: truncate d0/d6/d34/d80/f5a 1194099 0 2024-02-28T16:27:08.669 INFO:tasks.workunit.client.1.smithi157.stdout:1/580: dread d10/d11/d31/d2a/d70/f9c [0,4194304] 0 2024-02-28T16:27:08.670 INFO:tasks.workunit.client.1.smithi157.stdout:9/570: write d0/f21 [617376,87272] 0 2024-02-28T16:27:08.673 INFO:tasks.workunit.client.1.smithi157.stdout:2/632: symlink da/d38/lcb 0 2024-02-28T16:27:08.675 INFO:tasks.workunit.client.1.smithi157.stdout:2/633: fdatasync da/d35/f8b 0 2024-02-28T16:27:08.680 INFO:tasks.workunit.client.1.smithi157.stdout:3/531: write d0/d6/d6b/d9e/fa2 [4368332,24459] 0 2024-02-28T16:27:08.680 INFO:tasks.workunit.client.1.smithi157.stdout:4/567: dwrite d3/d77/f98 [0,4194304] 0 2024-02-28T16:27:08.688 INFO:tasks.workunit.client.1.smithi157.stdout:4/568: truncate d3/f51 1527112 0 2024-02-28T16:27:08.689 INFO:tasks.workunit.client.1.smithi157.stdout:1/581: rename d10/d7a to d10/d11/d3a/d5c/d6a/db4 0 2024-02-28T16:27:08.696 INFO:tasks.workunit.client.1.smithi157.stdout:5/598: dwrite d0/d9/d47/d5b/d89/d75/dab/fc2 [4194304,4194304] 0 2024-02-28T16:27:08.699 INFO:tasks.workunit.client.1.smithi157.stdout:3/532: unlink d0/d6/d34/d80/d5c/f5e 0 2024-02-28T16:27:08.703 INFO:tasks.workunit.client.1.smithi157.stdout:5/599: truncate d0/d9/d47/f4f 4475354 0 2024-02-28T16:27:08.704 INFO:tasks.workunit.client.1.smithi157.stdout:1/582: truncate d10/d11/d3a/d5c/d6c/d7b/d8c/fa2 29615 0 2024-02-28T16:27:08.705 INFO:tasks.workunit.client.1.smithi157.stdout:8/564: dread d1/d5/d14/f7d [0,4194304] 0 2024-02-28T16:27:08.705 INFO:tasks.workunit.client.1.smithi157.stdout:6/573: getdents d2/d7/de/d1b/d3d 0 2024-02-28T16:27:08.707 INFO:tasks.workunit.client.1.smithi157.stdout:5/600: fsync d0/d9/d1b/d36/f38 0 2024-02-28T16:27:08.708 INFO:tasks.workunit.client.1.smithi157.stdout:0/610: truncate d1/d8/d33/d56/f75 230013 0 2024-02-28T16:27:08.709 INFO:tasks.workunit.client.1.smithi157.stdout:7/621: sync 2024-02-28T16:27:08.712 INFO:tasks.workunit.client.1.smithi157.stdout:9/571: dwrite d0/d19/f29 [0,4194304] 0 2024-02-28T16:27:08.713 INFO:tasks.workunit.client.1.smithi157.stdout:0/611: truncate d1/d13/d52/db5/faa 655887 0 2024-02-28T16:27:08.715 INFO:tasks.workunit.client.1.smithi157.stdout:0/612: dread - d1/d8/d33/d56/fb4 zero size 2024-02-28T16:27:08.716 INFO:tasks.workunit.client.1.smithi157.stdout:0/613: readlink d1/d13/d52/l66 0 2024-02-28T16:27:08.720 INFO:tasks.workunit.client.1.smithi157.stdout:9/572: dread d0/d36/d37/d4d/f51 [0,4194304] 0 2024-02-28T16:27:08.723 INFO:tasks.workunit.client.1.smithi157.stdout:2/634: dread da/f12 [4194304,4194304] 0 2024-02-28T16:27:08.724 INFO:tasks.workunit.client.1.smithi157.stdout:2/635: fsync da/d38/d5a/f9f 0 2024-02-28T16:27:08.725 INFO:tasks.workunit.client.1.smithi157.stdout:3/533: rename d0/d6/d34/d80/d5c/ca5 to d0/d6/d44/d70/d71/ca7 0 2024-02-28T16:27:08.802 INFO:tasks.workunit.client.1.smithi157.stdout:0/614: rmdir d1/d13/d7f/d94 39 2024-02-28T16:27:08.803 INFO:tasks.workunit.client.1.smithi157.stdout:8/565: creat d1/d5/d14/d3e/d52/d54/dbc/fc0 x:0 0 0 2024-02-28T16:27:08.807 INFO:tasks.workunit.client.1.smithi157.stdout:8/566: fdatasync d1/d5/d14/d3e/f8f 0 2024-02-28T16:27:08.808 INFO:tasks.workunit.client.1.smithi157.stdout:4/569: getdents d3/da/d37/d71/db0 0 2024-02-28T16:27:08.810 INFO:tasks.workunit.client.1.smithi157.stdout:8/567: dread - d1/d5/d14/d3e/f73 zero size 2024-02-28T16:27:08.812 INFO:tasks.workunit.client.1.smithi157.stdout:4/570: chown d3/da/d37/d71/db0/db4 107295 1 2024-02-28T16:27:08.813 INFO:tasks.workunit.client.1.smithi157.stdout:5/601: rename d0/d9/d47/d5b/d89/d75/dab/l9c to d0/d9/d47/ld0 0 2024-02-28T16:27:08.815 INFO:tasks.workunit.client.1.smithi157.stdout:2/636: getdents da/d8c 0 2024-02-28T16:27:08.816 INFO:tasks.workunit.client.1.smithi157.stdout:8/568: mkdir d1/d5/d23/d53/dc1 0 2024-02-28T16:27:08.820 INFO:tasks.workunit.client.1.smithi157.stdout:8/569: fdatasync d1/d5/d14/d3e/f73 0 2024-02-28T16:27:08.823 INFO:tasks.workunit.client.1.smithi157.stdout:5/602: symlink d0/d8/ld1 0 2024-02-28T16:27:08.825 INFO:tasks.workunit.client.1.smithi157.stdout:5/603: chown d0/d9/d47/d5b 1473 1 2024-02-28T16:27:08.825 INFO:tasks.workunit.client.1.smithi157.stdout:9/573: rename d0/d19/f91 to d0/fc6 0 2024-02-28T16:27:08.826 INFO:tasks.workunit.client.1.smithi157.stdout:1/583: dwrite d10/d11/d31/f80 [0,4194304] 0 2024-02-28T16:27:08.826 INFO:tasks.workunit.client.1.smithi157.stdout:4/571: mknod d3/da/d37/d71/db0/db4/cbb 0 2024-02-28T16:27:08.828 INFO:tasks.workunit.client.1.smithi157.stdout:8/570: symlink d1/d5/d23/da1/lc2 0 2024-02-28T16:27:08.831 INFO:tasks.workunit.client.1.smithi157.stdout:2/637: write da/d38/d3e/f84 [1183962,52140] 0 2024-02-28T16:27:08.832 INFO:tasks.workunit.client.1.smithi157.stdout:3/534: rename d0/d6/d34/d80/d23/d2b/d81/d89 to d0/d6/d44/d8e/da8 0 2024-02-28T16:27:08.833 INFO:tasks.workunit.client.1.smithi157.stdout:2/638: fdatasync da/d38/d4e/d91/f8a 0 2024-02-28T16:27:08.835 INFO:tasks.workunit.client.1.smithi157.stdout:9/574: rmdir d0/d36/d37/d4d/d92 39 2024-02-28T16:27:08.836 INFO:tasks.workunit.client.1.smithi157.stdout:2/639: fsync da/d38/f40 0 2024-02-28T16:27:08.836 INFO:tasks.workunit.client.1.smithi157.stdout:8/571: creat d1/d5/d14/d3e/d52/d54/fc3 x:0 0 0 2024-02-28T16:27:08.843 INFO:tasks.workunit.client.1.smithi157.stdout:0/615: rename d1/d13/d52/d53/l8c to d1/d8/d33/d56/ld2 0 2024-02-28T16:27:08.849 INFO:tasks.workunit.client.1.smithi157.stdout:2/640: truncate da/d38/d5a/f66 1393488 0 2024-02-28T16:27:08.850 INFO:tasks.workunit.client.1.smithi157.stdout:1/584: dwrite d10/d11/d22/f62 [0,4194304] 0 2024-02-28T16:27:08.852 INFO:tasks.workunit.client.1.smithi157.stdout:5/604: dread d0/d9/d47/d78/faa [0,4194304] 0 2024-02-28T16:27:08.853 INFO:tasks.workunit.client.1.smithi157.stdout:4/572: dwrite d3/da/d1f/d22/fa3 [0,4194304] 0 2024-02-28T16:27:08.856 INFO:tasks.workunit.client.1.smithi157.stdout:2/641: chown da/d38/d5a/d69/l94 45196 1 2024-02-28T16:27:08.861 INFO:tasks.workunit.client.1.smithi157.stdout:1/585: creat d10/d11/d3a/d5c/d84/fb5 x:0 0 0 2024-02-28T16:27:08.865 INFO:tasks.workunit.client.1.smithi157.stdout:2/642: chown da/d38/d4e/d91/f8a 1866 1 2024-02-28T16:27:08.865 INFO:tasks.workunit.client.1.smithi157.stdout:8/572: dwrite d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:08.866 INFO:tasks.workunit.client.1.smithi157.stdout:5/605: readlink d0/d9/d3a/l68 0 2024-02-28T16:27:08.868 INFO:tasks.workunit.client.1.smithi157.stdout:2/643: dread - da/d2b/f50 zero size 2024-02-28T16:27:08.874 INFO:tasks.workunit.client.1.smithi157.stdout:9/575: write d0/d19/f8d [3789149,63309] 0 2024-02-28T16:27:08.874 INFO:tasks.workunit.client.1.smithi157.stdout:2/644: chown da/d38/f6f 980059095 1 2024-02-28T16:27:08.879 INFO:tasks.workunit.client.1.smithi157.stdout:8/573: creat d1/d5/d23/dbd/fc4 x:0 0 0 2024-02-28T16:27:08.882 INFO:tasks.workunit.client.1.smithi157.stdout:2/645: unlink da/d35/f36 0 2024-02-28T16:27:08.883 INFO:tasks.workunit.client.1.smithi157.stdout:5/606: fsync d0/d9/d1b/d36/f53 0 2024-02-28T16:27:08.885 INFO:tasks.workunit.client.1.smithi157.stdout:8/574: write d1/d5/d23/dbd/fc4 [285077,75496] 0 2024-02-28T16:27:08.885 INFO:tasks.workunit.client.1.smithi157.stdout:4/573: dwrite d3/da/d1f/f26 [0,4194304] 0 2024-02-28T16:27:08.894 INFO:tasks.workunit.client.1.smithi157.stdout:5/607: fdatasync d0/d9/d47/d5b/d89/fb8 0 2024-02-28T16:27:08.897 INFO:tasks.workunit.client.1.smithi157.stdout:3/535: dwrite d0/d6/d34/d80/f5a [0,4194304] 0 2024-02-28T16:27:08.898 INFO:tasks.workunit.client.1.smithi157.stdout:0/616: dread d1/d8/d27/f2b [0,4194304] 0 2024-02-28T16:27:08.906 INFO:tasks.workunit.client.1.smithi157.stdout:0/617: write d1/d13/fe [1535553,70114] 0 2024-02-28T16:27:08.906 INFO:tasks.workunit.client.1.smithi157.stdout:5/608: read d0/d9/f86 [156919,127806] 0 2024-02-28T16:27:08.906 INFO:tasks.workunit.client.1.smithi157.stdout:3/536: mkdir d0/d6/d44/d70/d71/da9 0 2024-02-28T16:27:08.907 INFO:tasks.workunit.client.1.smithi157.stdout:2/646: creat da/fcc x:0 0 0 2024-02-28T16:27:08.908 INFO:tasks.workunit.client.1.smithi157.stdout:5/609: mknod d0/d9/d47/d78/cd2 0 2024-02-28T16:27:08.911 INFO:tasks.workunit.client.1.smithi157.stdout:3/537: rename d0/d6/d44/c63 to d0/d6/d34/d80/d5c/caa 0 2024-02-28T16:27:08.912 INFO:tasks.workunit.client.1.smithi157.stdout:8/575: dwrite d1/f2c [8388608,4194304] 0 2024-02-28T16:27:08.939 INFO:tasks.workunit.client.1.smithi157.stdout:3/538: creat d0/d6/d34/d80/d23/d2b/fab x:0 0 0 2024-02-28T16:27:08.939 INFO:tasks.workunit.client.1.smithi157.stdout:1/586: dread d10/d11/d3a/d5c/d6c/d7b/f1e [0,4194304] 0 2024-02-28T16:27:08.944 INFO:tasks.workunit.client.1.smithi157.stdout:4/574: dwrite d3/da/d48/d4a/f4c [0,4194304] 0 2024-02-28T16:27:08.948 INFO:tasks.workunit.client.1.smithi157.stdout:2/647: dwrite da/f37 [0,4194304] 0 2024-02-28T16:27:08.948 INFO:tasks.workunit.client.1.smithi157.stdout:5/610: dread d0/d9/f42 [0,4194304] 0 2024-02-28T16:27:08.952 INFO:tasks.workunit.client.1.smithi157.stdout:9/576: dread d0/d36/d3f/f6c [0,4194304] 0 2024-02-28T16:27:08.964 INFO:tasks.workunit.client.1.smithi157.stdout:4/575: dwrite d3/da/f90 [0,4194304] 0 2024-02-28T16:27:08.974 INFO:tasks.workunit.client.1.smithi157.stdout:3/539: mkdir d0/d6/d34/d43/dac 0 2024-02-28T16:27:08.976 INFO:tasks.workunit.client.1.smithi157.stdout:6/574: sync 2024-02-28T16:27:08.979 INFO:tasks.workunit.client.1.smithi157.stdout:6/575: write d2/d7/de/d1b/d3d/da4/d53/f9c [416608,23637] 0 2024-02-28T16:27:08.981 INFO:tasks.workunit.client.1.smithi157.stdout:4/576: unlink d3/da/f12 0 2024-02-28T16:27:08.983 INFO:tasks.workunit.client.1.smithi157.stdout:8/576: creat d1/d5/d14/d3e/d52/fc5 x:0 0 0 2024-02-28T16:27:08.991 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:09 smithi148 ceph-mon[28767]: pgmap v59: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 69 MiB/s rd, 236 MiB/s wr, 483 op/s 2024-02-28T16:27:08.992 INFO:tasks.workunit.client.1.smithi157.stdout:3/540: dwrite d0/d6/d34/d80/f51 [0,4194304] 0 2024-02-28T16:27:08.994 INFO:tasks.workunit.client.1.smithi157.stdout:9/577: dwrite d0/d36/d3f/f6c [4194304,4194304] 0 2024-02-28T16:27:09.022 INFO:tasks.workunit.client.1.smithi157.stdout:1/587: mkdir d10/da0/db6 0 2024-02-28T16:27:09.023 INFO:tasks.workunit.client.1.smithi157.stdout:1/588: chown d10/d11/d22/d99 910 1 2024-02-28T16:27:09.025 INFO:tasks.workunit.client.1.smithi157.stdout:1/589: write d10/d11/d3a/d5c/f87 [209324,72214] 0 2024-02-28T16:27:09.026 INFO:tasks.workunit.client.1.smithi157.stdout:1/590: stat d10/d94 0 2024-02-28T16:27:09.057 INFO:tasks.workunit.client.1.smithi157.stdout:3/541: unlink d0/d6/l90 0 2024-02-28T16:27:09.062 INFO:tasks.workunit.client.1.smithi157.stdout:2/648: dwrite da/f34 [0,4194304] 0 2024-02-28T16:27:09.066 INFO:tasks.workunit.client.1.smithi157.stdout:1/591: fsync d10/d11/d3a/d5c/d6c/d7b/f4f 0 2024-02-28T16:27:09.070 INFO:tasks.workunit.client.1.smithi157.stdout:3/542: symlink d0/d6/d1e/d5b/d9d/lad 0 2024-02-28T16:27:09.072 INFO:tasks.workunit.client.1.smithi157.stdout:3/543: chown d0/d6/d44/d70/d71 253837 1 2024-02-28T16:27:09.073 INFO:tasks.workunit.client.1.smithi157.stdout:3/544: stat d0/d6/d1e/d5b 0 2024-02-28T16:27:09.077 INFO:tasks.workunit.client.1.smithi157.stdout:3/545: write d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/f93 [2813282,115874] 0 2024-02-28T16:27:09.082 INFO:tasks.workunit.client.1.smithi157.stdout:6/576: getdents d2/d7/de/d40 0 2024-02-28T16:27:09.084 INFO:tasks.workunit.client.1.smithi157.stdout:9/578: dread d0/d19/f1e [0,4194304] 0 2024-02-28T16:27:09.091 INFO:tasks.workunit.client.1.smithi157.stdout:6/577: getdents d2/d7/de/d1b/d4d/d6c/d9a 0 2024-02-28T16:27:09.094 INFO:tasks.workunit.client.1.smithi157.stdout:7/622: sync 2024-02-28T16:27:09.094 INFO:tasks.workunit.client.1.smithi157.stdout:0/618: sync 2024-02-28T16:27:09.095 INFO:tasks.workunit.client.1.smithi157.stdout:3/546: dread d0/d6/f67 [0,4194304] 0 2024-02-28T16:27:09.096 INFO:tasks.workunit.client.1.smithi157.stdout:6/578: unlink d2/d7/de/l22 0 2024-02-28T16:27:09.098 INFO:tasks.workunit.client.1.smithi157.stdout:9/579: link d0/d36/d3f/f93 d0/d36/d37/d4d/d92/db9/fc7 0 2024-02-28T16:27:09.099 INFO:tasks.workunit.client.1.smithi157.stdout:0/619: chown d1/d13/l88 796 1 2024-02-28T16:27:09.100 INFO:tasks.workunit.client.1.smithi157.stdout:3/547: dread d0/d6/d44/d70/f8b [0,4194304] 0 2024-02-28T16:27:09.102 INFO:tasks.workunit.client.1.smithi157.stdout:3/548: write d0/f46 [1797254,118950] 0 2024-02-28T16:27:09.106 INFO:tasks.workunit.client.1.smithi157.stdout:0/620: dread d1/da/d7d/fa0 [0,4194304] 0 2024-02-28T16:27:09.108 INFO:tasks.workunit.client.1.smithi157.stdout:0/621: chown d1/d8/d27/l28 2036 1 2024-02-28T16:27:09.111 INFO:tasks.workunit.client.1.smithi157.stdout:3/549: dread d0/d6/d44/d48/f6e [0,4194304] 0 2024-02-28T16:27:09.118 INFO:tasks.workunit.client.1.smithi157.stdout:6/579: mknod d2/d7/de/d1b/d3d/da4/cab 0 2024-02-28T16:27:09.119 INFO:tasks.workunit.client.1.smithi157.stdout:6/580: fdatasync d2/d7/f24 0 2024-02-28T16:27:09.127 INFO:tasks.workunit.client.1.smithi157.stdout:2/649: symlink da/d38/d3e/lcd 0 2024-02-28T16:27:09.128 INFO:tasks.workunit.client.1.smithi157.stdout:6/581: creat d2/d7/d8/da/d71/d8f/fac x:0 0 0 2024-02-28T16:27:09.130 INFO:tasks.workunit.client.1.smithi157.stdout:6/582: write d2/d7/de/d40/f47 [3789886,123379] 0 2024-02-28T16:27:09.130 INFO:tasks.workunit.client.1.smithi157.stdout:2/650: symlink da/d38/d7e/dbb/lce 0 2024-02-28T16:27:09.135 INFO:tasks.workunit.client.1.smithi157.stdout:2/651: symlink da/d38/d7e/dbb/lcf 0 2024-02-28T16:27:09.138 INFO:tasks.workunit.client.1.smithi157.stdout:2/652: mkdir da/d38/d7e/dbb/dd0 0 2024-02-28T16:27:09.141 INFO:tasks.workunit.client.1.smithi157.stdout:2/653: mknod da/d38/d7e/d92/cd1 0 2024-02-28T16:27:09.157 INFO:tasks.workunit.client.1.smithi157.stdout:2/654: dwrite da/f24 [0,4194304] 0 2024-02-28T16:27:09.158 INFO:tasks.workunit.client.1.smithi157.stdout:4/577: dwrite d3/da/d28/f3e [0,4194304] 0 2024-02-28T16:27:09.160 INFO:tasks.workunit.client.1.smithi157.stdout:2/655: dread - da/d38/d3e/d9b/da3/f7f zero size 2024-02-28T16:27:09.162 INFO:tasks.workunit.client.1.smithi157.stdout:2/656: truncate da/d2b/f3d 4375424 0 2024-02-28T16:27:09.169 INFO:tasks.workunit.client.1.smithi157.stdout:4/578: truncate d3/da/fb3 2512148 0 2024-02-28T16:27:09.185 INFO:tasks.workunit.client.1.smithi157.stdout:0/622: write d1/da/f2f [925799,114016] 0 2024-02-28T16:27:09.190 INFO:tasks.workunit.client.1.smithi157.stdout:7/623: dwrite df/d1f/d24/d38/f43 [0,4194304] 0 2024-02-28T16:27:09.192 INFO:tasks.workunit.client.1.smithi157.stdout:0/623: unlink d1/d13/d57/lc0 0 2024-02-28T16:27:09.194 INFO:tasks.workunit.client.1.smithi157.stdout:7/624: mknod df/d25/d4e/cc2 0 2024-02-28T16:27:09.197 INFO:tasks.workunit.client.1.smithi157.stdout:7/625: write df/d80/fa8 [5423363,33541] 0 2024-02-28T16:27:09.199 INFO:tasks.workunit.client.1.smithi157.stdout:7/626: chown df/d4b/c66 2 1 2024-02-28T16:27:09.201 INFO:tasks.workunit.client.1.smithi157.stdout:2/657: dread da/d38/f75 [0,4194304] 0 2024-02-28T16:27:09.201 INFO:tasks.workunit.client.1.smithi157.stdout:9/580: rmdir d0/d36/d37/d4d 39 2024-02-28T16:27:09.202 INFO:tasks.workunit.client.1.smithi157.stdout:8/577: sync 2024-02-28T16:27:09.203 INFO:tasks.workunit.client.1.smithi157.stdout:2/658: chown da/d38/d5a/l76 63 1 2024-02-28T16:27:09.204 INFO:tasks.workunit.client.1.smithi157.stdout:5/611: rename d0/l32 to d0/d9/d47/d5b/d89/ld3 0 2024-02-28T16:27:09.206 INFO:tasks.workunit.client.1.smithi157.stdout:8/578: fdatasync d1/d5/d14/f7d 0 2024-02-28T16:27:09.206 INFO:tasks.workunit.client.1.smithi157.stdout:5/612: fsync d0/d9/d1b/d36/daf/fc1 0 2024-02-28T16:27:09.207 INFO:tasks.workunit.client.1.smithi157.stdout:9/581: mkdir d0/d36/dc2/dc8 0 2024-02-28T16:27:09.209 INFO:tasks.workunit.client.1.smithi157.stdout:3/550: rename d0/d6/d44/f78 to d0/d6/d34/d80/d23/d2b/d6d/fae 0 2024-02-28T16:27:09.214 INFO:tasks.workunit.client.1.smithi157.stdout:6/583: rename d2/d7/de/l13 to d2/d7/de/d1b/d3d/da4/d66/lad 0 2024-02-28T16:27:09.217 INFO:tasks.workunit.client.1.smithi157.stdout:6/584: chown d2/d7/d8/da/d71/d8f/f3e 9905 1 2024-02-28T16:27:09.218 INFO:tasks.workunit.client.1.smithi157.stdout:6/585: chown d2/d7/d8/da/f91 39 1 2024-02-28T16:27:09.220 INFO:tasks.workunit.client.1.smithi157.stdout:5/613: mkdir d0/d30/da0/dd4 0 2024-02-28T16:27:09.220 INFO:tasks.workunit.client.1.smithi157.stdout:4/579: truncate d3/f13 2102136 0 2024-02-28T16:27:09.222 INFO:tasks.workunit.client.1.smithi157.stdout:3/551: creat d0/d6/d44/d4b/da6/faf x:0 0 0 2024-02-28T16:27:09.222 INFO:tasks.workunit.client.1.smithi157.stdout:6/586: dread - d2/d7/d8/da/d71/d8f/fac zero size 2024-02-28T16:27:09.223 INFO:tasks.workunit.client.1.smithi157.stdout:8/579: rmdir d1/d5/d43/d86/da6 0 2024-02-28T16:27:09.225 INFO:tasks.workunit.client.1.smithi157.stdout:3/552: chown d0/d6/f13 1 1 2024-02-28T16:27:09.226 INFO:tasks.workunit.client.1.smithi157.stdout:7/627: dread df/f16 [0,4194304] 0 2024-02-28T16:27:09.226 INFO:tasks.workunit.client.1.smithi157.stdout:0/624: rmdir d1/d13/d57 39 2024-02-28T16:27:09.232 INFO:tasks.workunit.client.1.smithi157.stdout:9/582: dwrite d0/d19/d30/d78/f7e [4194304,4194304] 0 2024-02-28T16:27:09.232 INFO:tasks.workunit.client.1.smithi157.stdout:5/614: dread d0/d30/d50/f63 [0,4194304] 0 2024-02-28T16:27:09.232 INFO:tasks.workunit.client.1.smithi157.stdout:7/628: creat df/d25/fc3 x:0 0 0 2024-02-28T16:27:09.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:09 smithi157 ceph-mon[38346]: pgmap v59: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 69 MiB/s rd, 236 MiB/s wr, 483 op/s 2024-02-28T16:27:09.239 INFO:tasks.workunit.client.1.smithi157.stdout:0/625: rename d1/da/c18 to d1/da/d7d/cd3 0 2024-02-28T16:27:09.241 INFO:tasks.workunit.client.1.smithi157.stdout:3/553: write d0/d6/d6b/d9e/fa0 [469406,121271] 0 2024-02-28T16:27:09.251 INFO:tasks.workunit.client.1.smithi157.stdout:4/580: dwrite d3/da/d37/fa4 [0,4194304] 0 2024-02-28T16:27:09.256 INFO:tasks.workunit.client.1.smithi157.stdout:9/583: fdatasync d0/d36/d37/d4d/d92/fa6 0 2024-02-28T16:27:09.256 INFO:tasks.workunit.client.1.smithi157.stdout:0/626: creat d1/d13/d52/d7b/dc1/fd4 x:0 0 0 2024-02-28T16:27:09.257 INFO:tasks.workunit.client.1.smithi157.stdout:2/659: dwrite da/f46 [0,4194304] 0 2024-02-28T16:27:09.259 INFO:tasks.workunit.client.1.smithi157.stdout:8/580: dwrite d1/d5/d23/d53/f76 [0,4194304] 0 2024-02-28T16:27:09.259 INFO:tasks.workunit.client.1.smithi157.stdout:3/554: readlink d0/d6/d34/d80/l8d 0 2024-02-28T16:27:09.263 INFO:tasks.workunit.client.1.smithi157.stdout:4/581: mkdir d3/d77/dbc 0 2024-02-28T16:27:09.264 INFO:tasks.workunit.client.1.smithi157.stdout:6/587: dwrite d2/d7/d8/da/f8e [0,4194304] 0 2024-02-28T16:27:09.265 INFO:tasks.workunit.client.1.smithi157.stdout:9/584: chown d0/d36/d3f/c89 94358 1 2024-02-28T16:27:09.269 INFO:tasks.workunit.client.1.smithi157.stdout:8/581: mkdir d1/d5/d23/d53/dc1/dc6 0 2024-02-28T16:27:09.270 INFO:tasks.workunit.client.1.smithi157.stdout:9/585: chown d0/d19/d30/lbb 3520 1 2024-02-28T16:27:09.271 INFO:tasks.workunit.client.1.smithi157.stdout:0/627: rename d1/l23 to d1/d8/d27/d55/ld5 0 2024-02-28T16:27:09.272 INFO:tasks.workunit.client.1.smithi157.stdout:5/615: dread d0/d9/d47/d78/faa [0,4194304] 0 2024-02-28T16:27:09.274 INFO:tasks.workunit.client.1.smithi157.stdout:2/660: mkdir da/d38/d7e/d92/dd2 0 2024-02-28T16:27:09.277 INFO:tasks.workunit.client.1.smithi157.stdout:5/616: mkdir d0/d30/da0/dd5 0 2024-02-28T16:27:09.279 INFO:tasks.workunit.client.1.smithi157.stdout:2/661: symlink da/d47/dca/ld3 0 2024-02-28T16:27:09.282 INFO:tasks.workunit.client.1.smithi157.stdout:2/662: chown da/d38/d5a/l62 837481964 1 2024-02-28T16:27:09.285 INFO:tasks.workunit.client.1.smithi157.stdout:0/628: write d1/da/f43 [4391359,78601] 0 2024-02-28T16:27:09.293 INFO:tasks.workunit.client.1.smithi157.stdout:2/663: write da/d38/d3e/f84 [557026,90303] 0 2024-02-28T16:27:09.301 INFO:tasks.workunit.client.1.smithi157.stdout:6/588: dwrite d2/d7/de/d1b/d3d/da4/d66/f84 [0,4194304] 0 2024-02-28T16:27:09.302 INFO:tasks.workunit.client.1.smithi157.stdout:2/664: mknod da/d47/cd4 0 2024-02-28T16:27:09.303 INFO:tasks.workunit.client.1.smithi157.stdout:9/586: dwrite d0/d36/d37/f43 [0,4194304] 0 2024-02-28T16:27:09.306 INFO:tasks.workunit.client.1.smithi157.stdout:9/587: readlink d0/l17 0 2024-02-28T16:27:09.306 INFO:tasks.workunit.client.1.smithi157.stdout:4/582: dwrite d3/da/f90 [4194304,4194304] 0 2024-02-28T16:27:09.316 INFO:tasks.workunit.client.1.smithi157.stdout:4/583: chown d3/da/d37/fa0 6714226 1 2024-02-28T16:27:09.318 INFO:tasks.workunit.client.1.smithi157.stdout:1/592: sync 2024-02-28T16:27:09.319 INFO:tasks.workunit.client.1.smithi157.stdout:2/665: creat da/d38/d5a/d5c/fd5 x:0 0 0 2024-02-28T16:27:09.319 INFO:tasks.workunit.client.1.smithi157.stdout:0/629: dwrite d1/f24 [0,4194304] 0 2024-02-28T16:27:09.319 INFO:tasks.workunit.client.1.smithi157.stdout:9/588: creat d0/d36/d37/d40/d5b/dba/fc9 x:0 0 0 2024-02-28T16:27:09.321 INFO:tasks.workunit.client.1.smithi157.stdout:4/584: mkdir d3/d77/dbd 0 2024-02-28T16:27:09.322 INFO:tasks.workunit.client.1.smithi157.stdout:6/589: truncate d2/d7/d8/da/d31/d3a/f33 1825312 0 2024-02-28T16:27:09.324 INFO:tasks.workunit.client.1.smithi157.stdout:9/589: dread - d0/d19/f9d zero size 2024-02-28T16:27:09.328 INFO:tasks.workunit.client.1.smithi157.stdout:5/617: dread d0/d9/d47/d5b/d89/fb8 [0,4194304] 0 2024-02-28T16:27:09.328 INFO:tasks.workunit.client.1.smithi157.stdout:2/666: creat da/d38/d3e/d9b/da3/fd6 x:0 0 0 2024-02-28T16:27:09.328 INFO:tasks.workunit.client.1.smithi157.stdout:6/590: mkdir d2/d7/d8/da/d31/d59/dae 0 2024-02-28T16:27:09.330 INFO:tasks.workunit.client.1.smithi157.stdout:5/618: dread - d0/d30/d50/d7f/fbf zero size 2024-02-28T16:27:09.332 INFO:tasks.workunit.client.1.smithi157.stdout:9/590: mknod d0/d36/d3f/cca 0 2024-02-28T16:27:09.332 INFO:tasks.workunit.client.1.smithi157.stdout:6/591: write d2/d7/de/d1b/d4d/d6c/f95 [818672,55728] 0 2024-02-28T16:27:09.338 INFO:tasks.workunit.client.1.smithi157.stdout:4/585: creat d3/fbe x:0 0 0 2024-02-28T16:27:09.343 INFO:tasks.workunit.client.1.smithi157.stdout:5/619: mknod d0/d9/d47/cd6 0 2024-02-28T16:27:09.345 INFO:tasks.workunit.client.1.smithi157.stdout:5/620: chown d0/d9/d47/f96 29 1 2024-02-28T16:27:09.346 INFO:tasks.workunit.client.1.smithi157.stdout:4/586: symlink d3/da/d48/d4a/lbf 0 2024-02-28T16:27:09.347 INFO:tasks.workunit.client.1.smithi157.stdout:2/667: dwrite da/f2c [0,4194304] 0 2024-02-28T16:27:09.348 INFO:tasks.workunit.client.1.smithi157.stdout:4/587: read - d3/d77/f62 zero size 2024-02-28T16:27:09.354 INFO:tasks.workunit.client.1.smithi157.stdout:4/588: mknod d3/da/d37/cc0 0 2024-02-28T16:27:09.358 INFO:tasks.workunit.client.1.smithi157.stdout:5/621: dread d0/d9/d47/f4e [0,4194304] 0 2024-02-28T16:27:09.358 INFO:tasks.workunit.client.1.smithi157.stdout:9/591: write d0/f42 [1143054,11316] 0 2024-02-28T16:27:09.362 INFO:tasks.workunit.client.1.smithi157.stdout:9/592: mkdir d0/d19/d30/d78/dcb 0 2024-02-28T16:27:09.365 INFO:tasks.workunit.client.1.smithi157.stdout:6/592: dread d2/d7/f15 [0,4194304] 0 2024-02-28T16:27:09.369 INFO:tasks.workunit.client.1.smithi157.stdout:9/593: rename d0/d36/l88 to d0/d36/d37/d40/d4b/lcc 0 2024-02-28T16:27:09.369 INFO:tasks.workunit.client.1.smithi157.stdout:6/593: chown d2/d7/f24 58847 1 2024-02-28T16:27:09.369 INFO:tasks.workunit.client.1.smithi157.stdout:1/593: dread d10/d11/f32 [0,4194304] 0 2024-02-28T16:27:09.370 INFO:tasks.workunit.client.1.smithi157.stdout:2/668: dread da/d38/d4e/f93 [0,4194304] 0 2024-02-28T16:27:09.372 INFO:tasks.workunit.client.1.smithi157.stdout:9/594: fsync d0/d19/d30/d78/f7e 0 2024-02-28T16:27:09.375 INFO:tasks.workunit.client.1.smithi157.stdout:6/594: symlink d2/d7/d8/da/d71/d8f/laf 0 2024-02-28T16:27:09.375 INFO:tasks.workunit.client.1.smithi157.stdout:2/669: creat da/d38/d7e/d92/dd2/fd7 x:0 0 0 2024-02-28T16:27:09.377 INFO:tasks.workunit.client.1.smithi157.stdout:2/670: readlink da/d2b/lb6 0 2024-02-28T16:27:09.377 INFO:tasks.workunit.client.1.smithi157.stdout:5/622: dwrite d0/d9/d47/f56 [0,4194304] 0 2024-02-28T16:27:09.378 INFO:tasks.workunit.client.1.smithi157.stdout:9/595: mknod d0/d36/d37/d40/d5b/ccd 0 2024-02-28T16:27:09.379 INFO:tasks.workunit.client.1.smithi157.stdout:4/589: dread d3/d77/f56 [0,4194304] 0 2024-02-28T16:27:09.380 INFO:tasks.workunit.client.1.smithi157.stdout:6/595: dread - d2/d7/d8/da/d71/d8f/f73 zero size 2024-02-28T16:27:09.380 INFO:tasks.workunit.client.1.smithi157.stdout:9/596: readlink d0/lc 0 2024-02-28T16:27:09.381 INFO:tasks.workunit.client.1.smithi157.stdout:6/596: dread - d2/f8a zero size 2024-02-28T16:27:09.381 INFO:tasks.workunit.client.1.smithi157.stdout:2/671: mknod da/d2b/cd8 0 2024-02-28T16:27:09.384 INFO:tasks.workunit.client.1.smithi157.stdout:4/590: rmdir d3/d77 39 2024-02-28T16:27:09.390 INFO:tasks.workunit.client.1.smithi157.stdout:6/597: symlink d2/d7/d38/lb0 0 2024-02-28T16:27:09.394 INFO:tasks.workunit.client.1.smithi157.stdout:1/594: dwrite d10/d94/fb3 [0,4194304] 0 2024-02-28T16:27:09.396 INFO:tasks.workunit.client.1.smithi157.stdout:4/591: getdents d3/da/d48 0 2024-02-28T16:27:09.400 INFO:tasks.workunit.client.1.smithi157.stdout:4/592: chown d3/fbe 108993 1 2024-02-28T16:27:09.402 INFO:tasks.workunit.client.1.smithi157.stdout:6/598: creat d2/d7/d8/da/d31/d37/d2b/d99/fb1 x:0 0 0 2024-02-28T16:27:09.405 INFO:tasks.workunit.client.1.smithi157.stdout:5/623: dwrite d0/d9/d47/dad/f8e [0,4194304] 0 2024-02-28T16:27:09.408 INFO:tasks.workunit.client.1.smithi157.stdout:9/597: dwrite d0/fc6 [0,4194304] 0 2024-02-28T16:27:09.410 INFO:tasks.workunit.client.1.smithi157.stdout:2/672: dwrite da/d38/d5a/d5c/f7a [0,4194304] 0 2024-02-28T16:27:09.410 INFO:tasks.workunit.client.1.smithi157.stdout:1/595: getdents d10/d11/d60 0 2024-02-28T16:27:09.429 INFO:tasks.workunit.client.1.smithi157.stdout:9/598: symlink d0/d19/lce 0 2024-02-28T16:27:09.429 INFO:tasks.workunit.client.1.smithi157.stdout:1/596: creat d10/d11/d31/fb7 x:0 0 0 2024-02-28T16:27:09.432 INFO:tasks.workunit.client.1.smithi157.stdout:2/673: link da/d38/laa da/d47/ld9 0 2024-02-28T16:27:09.462 INFO:tasks.workunit.client.1.smithi157.stdout:6/599: dwrite d2/d7/de/d1b/d3d/da4/d53/d69/f7d [0,4194304] 0 2024-02-28T16:27:09.463 INFO:tasks.workunit.client.1.smithi157.stdout:1/597: symlink d10/d11/d31/d2a/lb8 0 2024-02-28T16:27:09.465 INFO:tasks.workunit.client.1.smithi157.stdout:2/674: creat da/d38/d5a/d79/fda x:0 0 0 2024-02-28T16:27:09.466 INFO:tasks.workunit.client.1.smithi157.stdout:5/624: dwrite d0/d9/d1b/d36/f2a [0,4194304] 0 2024-02-28T16:27:09.470 INFO:tasks.workunit.client.1.smithi157.stdout:1/598: unlink d10/l13 0 2024-02-28T16:27:09.470 INFO:tasks.workunit.client.1.smithi157.stdout:9/599: dread d0/f42 [0,4194304] 0 2024-02-28T16:27:09.480 INFO:tasks.workunit.client.1.smithi157.stdout:9/600: chown d0/lf 1173298 1 2024-02-28T16:27:09.481 INFO:tasks.workunit.client.1.smithi157.stdout:1/599: symlink d10/da0/db6/lb9 0 2024-02-28T16:27:09.485 INFO:tasks.workunit.client.1.smithi157.stdout:2/675: dwrite da/f86 [4194304,4194304] 0 2024-02-28T16:27:09.489 INFO:tasks.workunit.client.1.smithi157.stdout:9/601: unlink d0/d36/d37/d40/d5b/cb1 0 2024-02-28T16:27:09.489 INFO:tasks.workunit.client.1.smithi157.stdout:1/600: creat d10/d11/d22/d99/fba x:0 0 0 2024-02-28T16:27:09.490 INFO:tasks.workunit.client.1.smithi157.stdout:1/601: readlink d10/d94/l97 0 2024-02-28T16:27:09.493 INFO:tasks.workunit.client.1.smithi157.stdout:1/602: write d10/d11/d22/f62 [4230125,2271] 0 2024-02-28T16:27:09.494 INFO:tasks.workunit.client.1.smithi157.stdout:5/625: dwrite d0/d9/d47/d5b/d89/d75/dab/fc2 [4194304,4194304] 0 2024-02-28T16:27:09.494 INFO:tasks.workunit.client.1.smithi157.stdout:2/676: creat da/d38/d5a/fdb x:0 0 0 2024-02-28T16:27:09.500 INFO:tasks.workunit.client.1.smithi157.stdout:2/677: mkdir da/d38/d5a/d79/ddc 0 2024-02-28T16:27:09.506 INFO:tasks.workunit.client.1.smithi157.stdout:5/626: rename d0/d9/f79 to d0/d8/d51/fd7 0 2024-02-28T16:27:09.510 INFO:tasks.workunit.client.1.smithi157.stdout:5/627: mknod d0/d30/cd8 0 2024-02-28T16:27:09.517 INFO:tasks.workunit.client.1.smithi157.stdout:9/602: dread d0/d19/f8d [0,4194304] 0 2024-02-28T16:27:09.520 INFO:tasks.workunit.client.1.smithi157.stdout:9/603: rmdir d0/d36/d37 39 2024-02-28T16:27:09.528 INFO:tasks.workunit.client.1.smithi157.stdout:2/678: dread da/d35/f8b [0,4194304] 0 2024-02-28T16:27:09.528 INFO:tasks.workunit.client.1.smithi157.stdout:9/604: rename d0/l14 to d0/d36/d3f/lcf 0 2024-02-28T16:27:09.530 INFO:tasks.workunit.client.1.smithi157.stdout:1/603: truncate d10/d11/f28 1102023 0 2024-02-28T16:27:09.531 INFO:tasks.workunit.client.1.smithi157.stdout:9/605: chown d0/d36/d3f/l9c 157190 1 2024-02-28T16:27:09.541 INFO:tasks.workunit.client.1.smithi157.stdout:5/628: dread d0/d8/d51/f7b [0,4194304] 0 2024-02-28T16:27:09.544 INFO:tasks.workunit.client.1.smithi157.stdout:1/604: dread d10/d11/f32 [0,4194304] 0 2024-02-28T16:27:09.546 INFO:tasks.workunit.client.1.smithi157.stdout:5/629: mkdir d0/d9/d47/d5b/dd9 0 2024-02-28T16:27:09.547 INFO:tasks.workunit.client.1.smithi157.stdout:2/679: dwrite da/d2b/d59/f64 [4194304,4194304] 0 2024-02-28T16:27:09.551 INFO:tasks.workunit.client.1.smithi157.stdout:2/680: write da/d35/f8b [8216769,4756] 0 2024-02-28T16:27:09.551 INFO:tasks.workunit.client.1.smithi157.stdout:9/606: dwrite d0/d36/d37/f43 [0,4194304] 0 2024-02-28T16:27:09.555 INFO:tasks.workunit.client.1.smithi157.stdout:1/605: rename d10/d11/d31/f42 to d10/d11/d31/d2a/fbb 0 2024-02-28T16:27:09.564 INFO:tasks.workunit.client.1.smithi157.stdout:9/607: unlink d0/d36/d37/d40/d4b/d96/l9a 0 2024-02-28T16:27:09.565 INFO:tasks.workunit.client.1.smithi157.stdout:2/681: getdents da/d38/d4e/d91 0 2024-02-28T16:27:09.572 INFO:tasks.workunit.client.1.smithi157.stdout:5/630: dread d0/d9/d47/f6d [0,4194304] 0 2024-02-28T16:27:09.576 INFO:tasks.workunit.client.1.smithi157.stdout:2/682: dread da/d38/d5a/f66 [0,4194304] 0 2024-02-28T16:27:09.579 INFO:tasks.workunit.client.1.smithi157.stdout:2/683: chown da/d38/d3e/d9b/da3/faf 28213 1 2024-02-28T16:27:09.583 INFO:tasks.workunit.client.1.smithi157.stdout:9/608: dwrite d0/d36/d37/d4d/f51 [0,4194304] 0 2024-02-28T16:27:09.591 INFO:tasks.workunit.client.1.smithi157.stdout:5/631: dwrite d0/d9/d47/d5b/d89/fb8 [0,4194304] 0 2024-02-28T16:27:09.596 INFO:tasks.workunit.client.1.smithi157.stdout:5/632: creat d0/d9/d1b/d36/fda x:0 0 0 2024-02-28T16:27:09.603 INFO:tasks.workunit.client.1.smithi157.stdout:5/633: mknod d0/d30/da0/dd5/cdb 0 2024-02-28T16:27:09.603 INFO:tasks.workunit.client.1.smithi157.stdout:9/609: dwrite d0/fab [0,4194304] 0 2024-02-28T16:27:09.607 INFO:tasks.workunit.client.1.smithi157.stdout:9/610: fsync d0/d36/d37/f43 0 2024-02-28T16:27:09.607 INFO:tasks.workunit.client.1.smithi157.stdout:5/634: getdents d0/d30/da0/dd4 0 2024-02-28T16:27:09.608 INFO:tasks.workunit.client.1.smithi157.stdout:9/611: write d0/f90 [1742656,7397] 0 2024-02-28T16:27:09.619 INFO:tasks.workunit.client.1.smithi157.stdout:9/612: link d0/c34 d0/d36/d37/d4d/db5/cd0 0 2024-02-28T16:27:09.622 INFO:tasks.workunit.client.1.smithi157.stdout:5/635: dread d0/d30/f5f [0,4194304] 0 2024-02-28T16:27:09.625 INFO:tasks.workunit.client.1.smithi157.stdout:5/636: symlink d0/d8/d7e/d82/ldc 0 2024-02-28T16:27:09.628 INFO:tasks.workunit.client.1.smithi157.stdout:9/613: link d0/d19/d30/f39 d0/d36/daa/fd1 0 2024-02-28T16:27:09.630 INFO:tasks.workunit.client.1.smithi157.stdout:9/614: write d0/d19/d30/d79/f87 [403307,119734] 0 2024-02-28T16:27:09.630 INFO:tasks.workunit.client.1.smithi157.stdout:7/629: sync 2024-02-28T16:27:09.631 INFO:tasks.workunit.client.1.smithi157.stdout:3/555: sync 2024-02-28T16:27:09.634 INFO:tasks.workunit.client.1.smithi157.stdout:3/556: creat d0/d6/d34/d80/d23/d2b/fb0 x:0 0 0 2024-02-28T16:27:09.636 INFO:tasks.workunit.client.1.smithi157.stdout:9/615: rename d0/d36/d37/d40/d5b/fa5 to d0/d36/d37/d40/d5b/dba/fd2 0 2024-02-28T16:27:09.638 INFO:tasks.workunit.client.1.smithi157.stdout:9/616: write d0/d36/d3f/f8b [169740,61404] 0 2024-02-28T16:27:09.643 INFO:tasks.workunit.client.1.smithi157.stdout:5/637: write d0/d30/f5f [1721952,97515] 0 2024-02-28T16:27:09.644 INFO:tasks.workunit.client.1.smithi157.stdout:5/638: fdatasync d0/f5a 0 2024-02-28T16:27:09.646 INFO:tasks.workunit.client.1.smithi157.stdout:7/630: dwrite df/d1f/d24/f99 [0,4194304] 0 2024-02-28T16:27:09.656 INFO:tasks.workunit.client.1.smithi157.stdout:9/617: dwrite d0/d19/d30/f32 [4194304,4194304] 0 2024-02-28T16:27:09.658 INFO:tasks.workunit.client.1.smithi157.stdout:7/631: creat df/d25/d4e/d67/fc4 x:0 0 0 2024-02-28T16:27:09.658 INFO:tasks.workunit.client.1.smithi157.stdout:3/557: dwrite d0/d6/d44/d48/f4e [0,4194304] 0 2024-02-28T16:27:09.659 INFO:tasks.workunit.client.1.smithi157.stdout:9/618: chown d0/d36/d37/d4d/d92/db9/fc7 23 1 2024-02-28T16:27:09.664 INFO:tasks.workunit.client.1.smithi157.stdout:7/632: read df/d25/d79/f82 [2124063,23922] 0 2024-02-28T16:27:09.666 INFO:tasks.workunit.client.1.smithi157.stdout:3/558: unlink d0/d6/d34/d80/c21 0 2024-02-28T16:27:09.668 INFO:tasks.workunit.client.1.smithi157.stdout:7/633: symlink df/d1f/d24/d39/d64/lc5 0 2024-02-28T16:27:09.671 INFO:tasks.workunit.client.1.smithi157.stdout:7/634: chown df/d1f/d24/d39/f5f 34 1 2024-02-28T16:27:09.677 INFO:tasks.workunit.client.1.smithi157.stdout:3/559: getdents d0 0 2024-02-28T16:27:09.678 INFO:tasks.workunit.client.1.smithi157.stdout:9/619: dwrite d0/d36/d37/d4d/d92/fbf [0,4194304] 0 2024-02-28T16:27:09.685 INFO:tasks.workunit.client.1.smithi157.stdout:9/620: truncate d0/fb 619202 0 2024-02-28T16:27:09.716 INFO:tasks.workunit.client.1.smithi157.stdout:9/621: readlink d0/d36/d37/d40/l59 0 2024-02-28T16:27:09.724 INFO:tasks.workunit.client.1.smithi157.stdout:9/622: readlink d0/l2f 0 2024-02-28T16:27:09.724 INFO:tasks.workunit.client.1.smithi157.stdout:3/560: dread d0/d6/d34/d80/d23/d2b/d6d/f77 [0,4194304] 0 2024-02-28T16:27:09.726 INFO:tasks.workunit.client.1.smithi157.stdout:9/623: symlink d0/d19/d30/d78/ld3 0 2024-02-28T16:27:09.728 INFO:tasks.workunit.client.1.smithi157.stdout:5/639: dread d0/d9/f1d [0,4194304] 0 2024-02-28T16:27:09.729 INFO:tasks.workunit.client.1.smithi157.stdout:9/624: dread - d0/d36/d37/d40/d4b/d96/fc5 zero size 2024-02-28T16:27:09.732 INFO:tasks.workunit.client.1.smithi157.stdout:9/625: chown d0/c27 118990 1 2024-02-28T16:27:09.734 INFO:tasks.workunit.client.1.smithi157.stdout:5/640: symlink d0/d9/d47/d5b/ldd 0 2024-02-28T16:27:09.736 INFO:tasks.workunit.client.1.smithi157.stdout:9/626: creat d0/d36/d3f/d69/fd4 x:0 0 0 2024-02-28T16:27:09.739 INFO:tasks.workunit.client.1.smithi157.stdout:5/641: getdents d0/d9/d47/d5b/dd9 0 2024-02-28T16:27:09.743 INFO:tasks.workunit.client.1.smithi157.stdout:5/642: mknod d0/d9/d47/d5b/cde 0 2024-02-28T16:27:09.744 INFO:tasks.workunit.client.1.smithi157.stdout:3/561: write d0/d6/d34/d80/f51 [5022375,102307] 0 2024-02-28T16:27:09.746 INFO:tasks.workunit.client.1.smithi157.stdout:3/562: chown d0/d6/f11 1525 1 2024-02-28T16:27:09.748 INFO:tasks.workunit.client.1.smithi157.stdout:5/643: creat d0/d9/d47/d5b/d89/d75/fdf x:0 0 0 2024-02-28T16:27:09.750 INFO:tasks.workunit.client.1.smithi157.stdout:3/563: creat d0/d6/d44/d4b/fb1 x:0 0 0 2024-02-28T16:27:09.754 INFO:tasks.workunit.client.1.smithi157.stdout:3/564: creat d0/d6/d1e/d5b/d9d/fb2 x:0 0 0 2024-02-28T16:27:09.764 INFO:tasks.workunit.client.1.smithi157.stdout:8/582: sync 2024-02-28T16:27:09.765 INFO:tasks.workunit.client.1.smithi157.stdout:4/593: sync 2024-02-28T16:27:09.765 INFO:tasks.workunit.client.1.smithi157.stdout:0/630: sync 2024-02-28T16:27:09.770 INFO:tasks.workunit.client.1.smithi157.stdout:4/594: mkdir d3/da/d1f/dc1 0 2024-02-28T16:27:09.772 INFO:tasks.workunit.client.1.smithi157.stdout:3/565: dread d0/d6/f5f [0,4194304] 0 2024-02-28T16:27:09.772 INFO:tasks.workunit.client.1.smithi157.stdout:0/631: stat d1/d8/d27/lb3 0 2024-02-28T16:27:09.776 INFO:tasks.workunit.client.1.smithi157.stdout:8/583: write d1/d5/d14/f42 [1629318,72122] 0 2024-02-28T16:27:09.781 INFO:tasks.workunit.client.1.smithi157.stdout:3/566: rename d0/d6/d34/d80/c4c to d0/cb3 0 2024-02-28T16:27:09.795 INFO:tasks.workunit.client.1.smithi157.stdout:8/584: truncate d1/d5/d23/d38/f48 1780665 0 2024-02-28T16:27:09.796 INFO:tasks.workunit.client.1.smithi157.stdout:8/585: stat d1/d5/l28 0 2024-02-28T16:27:09.797 INFO:tasks.workunit.client.1.smithi157.stdout:4/595: rmdir d3/d77/dbc 0 2024-02-28T16:27:09.798 INFO:tasks.workunit.client.1.smithi157.stdout:8/586: chown d1/f4f 41804 1 2024-02-28T16:27:09.807 INFO:tasks.workunit.client.1.smithi157.stdout:0/632: dread d1/d13/f73 [0,4194304] 0 2024-02-28T16:27:09.816 INFO:tasks.workunit.client.1.smithi157.stdout:8/587: link d1/d5/d23/d53/f6c d1/d5/d14/d3e/d52/d54/fc7 0 2024-02-28T16:27:09.817 INFO:tasks.workunit.client.1.smithi157.stdout:4/596: dwrite d3/da/d28/f3e [0,4194304] 0 2024-02-28T16:27:09.818 INFO:tasks.workunit.client.1.smithi157.stdout:5/644: write d0/d9/d47/d5b/d89/f83 [3159180,127774] 0 2024-02-28T16:27:09.822 INFO:tasks.workunit.client.1.smithi157.stdout:4/597: write d3/da/f2d [4844941,95992] 0 2024-02-28T16:27:09.822 INFO:tasks.workunit.client.1.smithi157.stdout:0/633: getdents d1/d13/d52/d7b 0 2024-02-28T16:27:09.826 INFO:tasks.workunit.client.1.smithi157.stdout:8/588: mknod d1/d5/d43/d86/cc8 0 2024-02-28T16:27:09.828 INFO:tasks.workunit.client.1.smithi157.stdout:6/600: sync 2024-02-28T16:27:09.829 INFO:tasks.workunit.client.1.smithi157.stdout:5/645: symlink d0/d30/da0/dd4/le0 0 2024-02-28T16:27:09.830 INFO:tasks.workunit.client.1.smithi157.stdout:8/589: rmdir d1/d5/d14 39 2024-02-28T16:27:09.833 INFO:tasks.workunit.client.1.smithi157.stdout:4/598: creat d3/da/d1f/d22/fc2 x:0 0 0 2024-02-28T16:27:09.834 INFO:tasks.workunit.client.1.smithi157.stdout:4/599: readlink d3/da/l14 0 2024-02-28T16:27:09.836 INFO:tasks.workunit.client.1.smithi157.stdout:8/590: rmdir d1/d5/d23/dbd 39 2024-02-28T16:27:09.839 INFO:tasks.workunit.client.1.smithi157.stdout:6/601: dread d2/d7/f15 [0,4194304] 0 2024-02-28T16:27:09.839 INFO:tasks.workunit.client.1.smithi157.stdout:5/646: rename d0/d9/f37 to d0/db3/fe1 0 2024-02-28T16:27:09.841 INFO:tasks.workunit.client.1.smithi157.stdout:5/647: chown d0/d9/d47/d5b/l6e 29 1 2024-02-28T16:27:09.843 INFO:tasks.workunit.client.1.smithi157.stdout:5/648: readlink d0/d9/d47/d5b/d89/d75/dab/la2 0 2024-02-28T16:27:09.850 INFO:tasks.workunit.client.1.smithi157.stdout:5/649: chown d0/d9/f1f 3 1 2024-02-28T16:27:09.851 INFO:tasks.workunit.client.1.smithi157.stdout:3/567: write d0/f1c [1181812,22882] 0 2024-02-28T16:27:09.855 INFO:tasks.workunit.client.1.smithi157.stdout:4/600: rmdir d3/da 39 2024-02-28T16:27:09.857 INFO:tasks.workunit.client.1.smithi157.stdout:4/601: write d3/d77/f98 [4514921,11972] 0 2024-02-28T16:27:09.858 INFO:tasks.workunit.client.1.smithi157.stdout:4/602: stat d3/f16 0 2024-02-28T16:27:09.858 INFO:tasks.workunit.client.1.smithi157.stdout:5/650: rename d0/d9/d3a/f9d to d0/d9/d47/dad/fe2 0 2024-02-28T16:27:09.859 INFO:tasks.workunit.client.1.smithi157.stdout:0/634: dread d1/d8/d33/f50 [0,4194304] 0 2024-02-28T16:27:09.860 INFO:tasks.workunit.client.1.smithi157.stdout:5/651: chown d0/fa5 1 1 2024-02-28T16:27:09.861 INFO:tasks.workunit.client.1.smithi157.stdout:5/652: write d0/d30/f5f [1734573,97310] 0 2024-02-28T16:27:09.865 INFO:tasks.workunit.client.1.smithi157.stdout:8/591: getdents d1/d5/d23/da1 0 2024-02-28T16:27:09.867 INFO:tasks.workunit.client.1.smithi157.stdout:4/603: rmdir d3/da/d1f 39 2024-02-28T16:27:09.869 INFO:tasks.workunit.client.1.smithi157.stdout:3/568: rename d0/d6/d34/d80/d5c/caa to d0/d6/d44/d70/d71/da9/cb4 0 2024-02-28T16:27:09.871 INFO:tasks.workunit.client.1.smithi157.stdout:4/604: creat d3/da/d37/d71/db0/db4/fc3 x:0 0 0 2024-02-28T16:27:09.873 INFO:tasks.workunit.client.1.smithi157.stdout:8/592: mkdir d1/d5/d23/dbd/dc9 0 2024-02-28T16:27:09.874 INFO:tasks.workunit.client.1.smithi157.stdout:0/635: dwrite d1/d13/d52/db5/d64/f85 [0,4194304] 0 2024-02-28T16:27:09.880 INFO:tasks.workunit.client.1.smithi157.stdout:0/636: unlink d1/d8/l29 0 2024-02-28T16:27:09.886 INFO:tasks.workunit.client.1.smithi157.stdout:0/637: readlink d1/d8/l38 0 2024-02-28T16:27:09.889 INFO:tasks.workunit.client.1.smithi157.stdout:0/638: mknod d1/d13/cd6 0 2024-02-28T16:27:09.893 INFO:tasks.workunit.client.1.smithi157.stdout:0/639: write d1/d13/d52/db5/d64/f85 [1456009,75751] 0 2024-02-28T16:27:09.894 INFO:tasks.workunit.client.1.smithi157.stdout:3/569: dwrite d0/d6/d1e/f76 [0,4194304] 0 2024-02-28T16:27:09.896 INFO:tasks.workunit.client.1.smithi157.stdout:4/605: dread d3/f8a [0,4194304] 0 2024-02-28T16:27:09.897 INFO:tasks.workunit.client.1.smithi157.stdout:3/570: rmdir d0/d6/d1e 39 2024-02-28T16:27:09.899 INFO:tasks.workunit.client.1.smithi157.stdout:0/640: write d1/d13/d57/f5c [4957146,48249] 0 2024-02-28T16:27:09.902 INFO:tasks.workunit.client.1.smithi157.stdout:0/641: write d1/d8/d27/f7a [2079001,98275] 0 2024-02-28T16:27:09.904 INFO:tasks.workunit.client.1.smithi157.stdout:0/642: dread - d1/d8/d33/d96/fb1 zero size 2024-02-28T16:27:09.904 INFO:tasks.workunit.client.1.smithi157.stdout:4/606: fdatasync d3/da/d1f/f7d 0 2024-02-28T16:27:09.906 INFO:tasks.workunit.client.1.smithi157.stdout:4/607: readlink d3/da/d37/l6a 0 2024-02-28T16:27:09.906 INFO:tasks.workunit.client.1.smithi157.stdout:3/571: creat d0/d6/d44/d4b/da6/fb5 x:0 0 0 2024-02-28T16:27:09.910 INFO:tasks.workunit.client.1.smithi157.stdout:8/593: dread d1/d5/d23/d38/d67/d6d/f7e [0,4194304] 0 2024-02-28T16:27:09.912 INFO:tasks.workunit.client.1.smithi157.stdout:0/643: creat d1/d13/d52/d53/fd7 x:0 0 0 2024-02-28T16:27:09.913 INFO:tasks.workunit.client.1.smithi157.stdout:3/572: creat d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/fb6 x:0 0 0 2024-02-28T16:27:09.922 INFO:tasks.workunit.client.1.smithi157.stdout:8/594: rename d1/d5/d14/d3e/d52/c5a to d1/d5/d14/d3e/d52/d54/dbc/cca 0 2024-02-28T16:27:09.925 INFO:tasks.workunit.client.1.smithi157.stdout:8/595: mkdir d1/d5/d23/dbd/dcb 0 2024-02-28T16:27:09.927 INFO:tasks.workunit.client.1.smithi157.stdout:4/608: dread d3/da/d37/f50 [0,4194304] 0 2024-02-28T16:27:09.928 INFO:tasks.workunit.client.1.smithi157.stdout:0/644: dwrite d1/d13/d52/db5/d64/fb7 [0,4194304] 0 2024-02-28T16:27:09.928 INFO:tasks.workunit.client.1.smithi157.stdout:8/596: symlink d1/d5/d4d/lcc 0 2024-02-28T16:27:09.930 INFO:tasks.workunit.client.1.smithi157.stdout:3/573: dwrite d0/d6/d44/f52 [4194304,4194304] 0 2024-02-28T16:27:09.933 INFO:tasks.workunit.client.1.smithi157.stdout:8/597: read d1/d5/d23/f91 [3140526,79206] 0 2024-02-28T16:27:09.933 INFO:tasks.workunit.client.1.smithi157.stdout:4/609: creat d3/d77/daa/fc4 x:0 0 0 2024-02-28T16:27:09.944 INFO:tasks.workunit.client.1.smithi157.stdout:8/598: creat d1/d5/d4d/d60/fcd x:0 0 0 2024-02-28T16:27:09.946 INFO:tasks.workunit.client.1.smithi157.stdout:8/599: chown d1/d5/d4d/d60/f94 56976 1 2024-02-28T16:27:09.969 INFO:tasks.workunit.client.1.smithi157.stdout:9/627: sync 2024-02-28T16:27:09.969 INFO:tasks.workunit.client.1.smithi157.stdout:2/684: sync 2024-02-28T16:27:09.969 INFO:tasks.workunit.client.1.smithi157.stdout:7/635: sync 2024-02-28T16:27:09.969 INFO:tasks.workunit.client.1.smithi157.stdout:1/606: sync 2024-02-28T16:27:09.972 INFO:tasks.workunit.client.1.smithi157.stdout:2/685: write da/d38/d3e/fb9 [37933,59414] 0 2024-02-28T16:27:09.973 INFO:tasks.workunit.client.1.smithi157.stdout:3/574: dwrite d0/d6/f39 [0,4194304] 0 2024-02-28T16:27:09.974 INFO:tasks.workunit.client.1.smithi157.stdout:7/636: truncate df/d25/d4e/d67/fc4 406820 0 2024-02-28T16:27:09.975 INFO:tasks.workunit.client.1.smithi157.stdout:2/686: write da/d38/d3e/d9b/da3/fd6 [373345,130238] 0 2024-02-28T16:27:09.985 INFO:tasks.workunit.client.1.smithi157.stdout:9/628: dwrite d0/f21 [4194304,4194304] 0 2024-02-28T16:27:09.995 INFO:tasks.workunit.client.1.smithi157.stdout:8/600: mkdir d1/d5/d23/d53/dce 0 2024-02-28T16:27:09.997 INFO:tasks.workunit.client.1.smithi157.stdout:8/601: stat d1/d5/d10/faf 0 2024-02-28T16:27:09.997 INFO:tasks.workunit.client.1.smithi157.stdout:0/645: getdents d1/d8 0 2024-02-28T16:27:09.998 INFO:tasks.workunit.client.1.smithi157.stdout:3/575: dread d0/d6/d44/d70/d71/d87/f95 [0,4194304] 0 2024-02-28T16:27:09.999 INFO:tasks.workunit.client.1.smithi157.stdout:0/646: fsync d1/d13/d7f/fcc 0 2024-02-28T16:27:09.999 INFO:tasks.workunit.client.1.smithi157.stdout:4/610: rename d3/da/d28/c7e to d3/da/d37/d84/d9a/dab/cc5 0 2024-02-28T16:27:10.000 INFO:tasks.workunit.client.1.smithi157.stdout:8/602: write d1/d5/f71 [1553453,19398] 0 2024-02-28T16:27:10.001 INFO:tasks.workunit.client.1.smithi157.stdout:0/647: chown d1/d8/d33/f44 10 1 2024-02-28T16:27:10.002 INFO:tasks.workunit.client.1.smithi157.stdout:0/648: stat d1/da/c41 0 2024-02-28T16:27:10.004 INFO:tasks.workunit.client.1.smithi157.stdout:1/607: rmdir d10/d11/d7e 39 2024-02-28T16:27:10.006 INFO:tasks.workunit.client.1.smithi157.stdout:7/637: mknod df/d4b/cc6 0 2024-02-28T16:27:10.009 INFO:tasks.workunit.client.1.smithi157.stdout:2/687: unlink da/d38/d5a/d69/lb7 0 2024-02-28T16:27:10.013 INFO:tasks.workunit.client.1.smithi157.stdout:6/602: sync 2024-02-28T16:27:10.015 INFO:tasks.workunit.client.1.smithi157.stdout:3/576: dwrite d0/d6/d34/d80/d23/d2b/f32 [4194304,4194304] 0 2024-02-28T16:27:10.015 INFO:tasks.workunit.client.1.smithi157.stdout:6/603: write d2/d7/de/d1b/d3d/da4/f88 [557285,65500] 0 2024-02-28T16:27:10.023 INFO:tasks.workunit.client.1.smithi157.stdout:9/629: fsync d0/d19/f7a 0 2024-02-28T16:27:10.025 INFO:tasks.workunit.client.1.smithi157.stdout:2/688: creat da/d35/fdd x:0 0 0 2024-02-28T16:27:10.025 INFO:tasks.workunit.client.1.smithi157.stdout:2/689: stat da/f24 0 2024-02-28T16:27:10.027 INFO:tasks.workunit.client.1.smithi157.stdout:2/690: chown da/d38/d5a/d79/fda 224696 1 2024-02-28T16:27:10.028 INFO:tasks.workunit.client.1.smithi157.stdout:8/603: mknod d1/d5/ccf 0 2024-02-28T16:27:10.029 INFO:tasks.workunit.client.1.smithi157.stdout:6/604: dwrite d2/d7/d8/f56 [0,4194304] 0 2024-02-28T16:27:10.029 INFO:tasks.workunit.client.1.smithi157.stdout:2/691: chown da/d38/d7e/d92/dd2 0 1 2024-02-28T16:27:10.031 INFO:tasks.workunit.client.1.smithi157.stdout:2/692: fdatasync da/f34 0 2024-02-28T16:27:10.032 INFO:tasks.workunit.client.1.smithi157.stdout:6/605: chown d2/d7/de/d1b/d3d/da4/f3b 252 1 2024-02-28T16:27:10.032 INFO:tasks.workunit.client.1.smithi157.stdout:2/693: stat da/d2b/cb8 0 2024-02-28T16:27:10.034 INFO:tasks.workunit.client.1.smithi157.stdout:6/606: dread - d2/d7/d8/da/d71/d93/fa5 zero size 2024-02-28T16:27:10.035 INFO:tasks.workunit.client.1.smithi157.stdout:0/649: mknod d1/da/cd8 0 2024-02-28T16:27:10.037 INFO:tasks.workunit.client.1.smithi157.stdout:6/607: write d2/d7/de/d1b/d3d/da4/f3b [3703879,80888] 0 2024-02-28T16:27:10.038 INFO:tasks.workunit.client.1.smithi157.stdout:0/650: write d1/d8/d27/d55/fb8 [687331,42994] 0 2024-02-28T16:27:10.048 INFO:tasks.workunit.client.1.smithi157.stdout:2/694: dread da/d2b/d59/fa0 [0,4194304] 0 2024-02-28T16:27:10.052 INFO:tasks.workunit.client.1.smithi157.stdout:1/608: rename d10/d11/d3a/d5c/d6c/d7b/l68 to d10/d11/d3a/lbc 0 2024-02-28T16:27:10.054 INFO:tasks.workunit.client.1.smithi157.stdout:9/630: mknod d0/d36/d37/cd5 0 2024-02-28T16:27:10.055 INFO:tasks.workunit.client.1.smithi157.stdout:6/608: creat d2/d7/de/d1b/d4d/d6c/d9a/fb2 x:0 0 0 2024-02-28T16:27:10.059 INFO:tasks.workunit.client.1.smithi157.stdout:3/577: rename d0/d6/d44/d4b/da6/faf to d0/d6/d44/d8e/da8/fb7 0 2024-02-28T16:27:10.060 INFO:tasks.workunit.client.1.smithi157.stdout:7/638: dwrite df/d4b/d4c/f90 [0,4194304] 0 2024-02-28T16:27:10.060 INFO:tasks.workunit.client.1.smithi157.stdout:1/609: creat d10/d11/d3a/d5c/d6c/fbd x:0 0 0 2024-02-28T16:27:10.060 INFO:tasks.workunit.client.1.smithi157.stdout:4/611: truncate d3/da/d28/f3e 2115295 0 2024-02-28T16:27:10.067 INFO:tasks.workunit.client.1.smithi157.stdout:8/604: rename d1/d5/d43/c4c to d1/d5/d23/d38/d67/d6d/cd0 0 2024-02-28T16:27:10.068 INFO:tasks.workunit.client.1.smithi157.stdout:3/578: rmdir d0/d6/d44/d8e 39 2024-02-28T16:27:10.071 INFO:tasks.workunit.client.1.smithi157.stdout:8/605: write d1/d5/f70 [1567044,105013] 0 2024-02-28T16:27:10.075 INFO:tasks.workunit.client.1.smithi157.stdout:7/639: symlink df/d1f/d24/d38/lc7 0 2024-02-28T16:27:10.077 INFO:tasks.workunit.client.1.smithi157.stdout:6/609: dwrite d2/d7/d8/da/d31/d37/d2b/f5f [0,4194304] 0 2024-02-28T16:27:10.078 INFO:tasks.workunit.client.1.smithi157.stdout:1/610: mkdir d10/d11/d3a/d5c/d6a/db4/d91/dbe 0 2024-02-28T16:27:10.081 INFO:tasks.workunit.client.1.smithi157.stdout:0/651: rename d1/d8/d27/f3a to d1/d8/d33/d56/fd9 0 2024-02-28T16:27:10.083 INFO:tasks.workunit.client.1.smithi157.stdout:4/612: dwrite d3/da/d28/f76 [0,4194304] 0 2024-02-28T16:27:10.083 INFO:tasks.workunit.client.1.smithi157.stdout:1/611: write d10/d94/fae [470400,77494] 0 2024-02-28T16:27:10.088 INFO:tasks.workunit.client.1.smithi157.stdout:7/640: mknod df/d80/cc8 0 2024-02-28T16:27:10.088 INFO:tasks.workunit.client.1.smithi157.stdout:4/613: readlink d3/da/d1f/d22/l91 0 2024-02-28T16:27:10.091 INFO:tasks.workunit.client.1.smithi157.stdout:3/579: dread d0/d6/d6b/d75/f8a [4194304,4194304] 0 2024-02-28T16:27:10.092 INFO:tasks.workunit.client.1.smithi157.stdout:1/612: mkdir d10/d11/d22/d99/dbf 0 2024-02-28T16:27:10.094 INFO:tasks.workunit.client.1.smithi157.stdout:1/613: write d10/d11/d31/f41 [4323156,97757] 0 2024-02-28T16:27:10.099 INFO:tasks.workunit.client.1.smithi157.stdout:2/695: rename da/d65/d90 to da/d47/dbd/dde 0 2024-02-28T16:27:10.100 INFO:tasks.workunit.client.1.smithi157.stdout:0/652: symlink d1/d13/d46/lda 0 2024-02-28T16:27:10.102 INFO:tasks.workunit.client.1.smithi157.stdout:6/610: dwrite d2/d7/de/d40/f47 [0,4194304] 0 2024-02-28T16:27:10.102 INFO:tasks.workunit.client.1.smithi157.stdout:0/653: stat d1/da/d6c/c8b 0 2024-02-28T16:27:10.105 INFO:tasks.workunit.client.1.smithi157.stdout:7/641: mknod df/d25/da7/cc9 0 2024-02-28T16:27:10.111 INFO:tasks.workunit.client.1.smithi157.stdout:4/614: dwrite d3/da/f5e [0,4194304] 0 2024-02-28T16:27:10.112 INFO:tasks.workunit.client.1.smithi157.stdout:1/614: rename d10/d11/d22/f3f to d10/d11/d31/d2a/d70/fc0 0 2024-02-28T16:27:10.114 INFO:tasks.workunit.client.1.smithi157.stdout:4/615: chown d3/da/d1f/l3b 2928245 1 2024-02-28T16:27:10.117 INFO:tasks.workunit.client.1.smithi157.stdout:4/616: dread - d3/da/d1f/d22/fc2 zero size 2024-02-28T16:27:10.120 INFO:tasks.workunit.client.1.smithi157.stdout:2/696: dwrite da/d38/d5a/d79/fc7 [0,4194304] 0 2024-02-28T16:27:10.128 INFO:tasks.workunit.client.1.smithi157.stdout:2/697: dread da/d38/d3e/fb9 [0,4194304] 0 2024-02-28T16:27:10.129 INFO:tasks.workunit.client.1.smithi157.stdout:3/580: link d0/d6/f3d d0/d6/d34/d80/d23/d2b/fb8 0 2024-02-28T16:27:10.134 INFO:tasks.workunit.client.1.smithi157.stdout:2/698: truncate da/d38/d3e/d9b/da3/f7f 43620 0 2024-02-28T16:27:10.135 INFO:tasks.workunit.client.1.smithi157.stdout:4/617: dwrite d3/da/d1f/f7d [0,4194304] 0 2024-02-28T16:27:10.136 INFO:tasks.workunit.client.1.smithi157.stdout:0/654: rename d1/da/c41 to d1/d13/d7f/d94/cdb 0 2024-02-28T16:27:10.138 INFO:tasks.workunit.client.1.smithi157.stdout:8/606: write d1/d5/d23/d38/d6e/d85/f9d [1536823,24572] 0 2024-02-28T16:27:10.143 INFO:tasks.workunit.client.1.smithi157.stdout:7/642: mknod df/d1f/d24/d4f/d72/dab/cca 0 2024-02-28T16:27:10.143 INFO:tasks.workunit.client.1.smithi157.stdout:5/653: sync 2024-02-28T16:27:10.146 INFO:tasks.workunit.client.1.smithi157.stdout:5/654: write d0/d9/d47/d5b/d89/d75/f9b [3379706,17525] 0 2024-02-28T16:27:10.150 INFO:tasks.workunit.client.1.smithi157.stdout:1/615: mkdir d10/d11/d3a/d5c/dc1 0 2024-02-28T16:27:10.153 INFO:tasks.workunit.client.1.smithi157.stdout:3/581: creat d0/d6/d44/d70/d71/d87/fb9 x:0 0 0 2024-02-28T16:27:10.156 INFO:tasks.workunit.client.1.smithi157.stdout:4/618: creat d3/da/d37/d84/d9a/dab/fc6 x:0 0 0 2024-02-28T16:27:10.158 INFO:tasks.workunit.client.1.smithi157.stdout:0/655: mknod d1/d13/d57/cdc 0 2024-02-28T16:27:10.161 INFO:tasks.workunit.client.1.smithi157.stdout:8/607: rename d1/d5/d14/f7d to d1/fd1 0 2024-02-28T16:27:10.162 INFO:tasks.workunit.client.1.smithi157.stdout:8/608: fdatasync d1/d5/d4d/d60/fcd 0 2024-02-28T16:27:10.163 INFO:tasks.workunit.client.1.smithi157.stdout:9/631: sync 2024-02-28T16:27:10.164 INFO:tasks.workunit.client.1.smithi157.stdout:7/643: chown df/l22 3978937 1 2024-02-28T16:27:10.168 INFO:tasks.workunit.client.1.smithi157.stdout:1/616: readlink d10/d11/d31/d2a/d70/la3 0 2024-02-28T16:27:10.171 INFO:tasks.workunit.client.1.smithi157.stdout:6/611: getdents d2/d7/de/d1b/d4d/d6c 0 2024-02-28T16:27:10.173 INFO:tasks.workunit.client.1.smithi157.stdout:6/612: fsync d2/d7/de/d40/f47 0 2024-02-28T16:27:10.173 INFO:tasks.workunit.client.1.smithi157.stdout:3/582: write d0/d6/f67 [7005758,51340] 0 2024-02-28T16:27:10.176 INFO:tasks.workunit.client.1.smithi157.stdout:4/619: symlink d3/da/d28/lc7 0 2024-02-28T16:27:10.177 INFO:tasks.workunit.client.1.smithi157.stdout:4/620: chown d3/da/d1f/f27 444489 1 2024-02-28T16:27:10.179 INFO:tasks.workunit.client.1.smithi157.stdout:0/656: rmdir d1/d8/d33/d96 39 2024-02-28T16:27:10.183 INFO:tasks.workunit.client.1.smithi157.stdout:3/583: dread d0/d6/d6b/d75/f8a [4194304,4194304] 0 2024-02-28T16:27:10.189 INFO:tasks.workunit.client.1.smithi157.stdout:2/699: creat da/fdf x:0 0 0 2024-02-28T16:27:10.190 INFO:tasks.workunit.client.1.smithi157.stdout:1/617: creat d10/da0/db6/fc2 x:0 0 0 2024-02-28T16:27:10.197 INFO:tasks.workunit.client.1.smithi157.stdout:0/657: mkdir d1/d13/d46/d99/ddd 0 2024-02-28T16:27:10.198 INFO:tasks.workunit.client.1.smithi157.stdout:0/658: chown d1/d8/d33/d56/l8d 179422789 1 2024-02-28T16:27:10.199 INFO:tasks.workunit.client.1.smithi157.stdout:0/659: chown d1/d13/d46/l6a 5552538 1 2024-02-28T16:27:10.200 INFO:tasks.workunit.client.1.smithi157.stdout:9/632: rename d0/d19/d30/f39 to d0/d36/d37/d40/d4b/fd6 0 2024-02-28T16:27:10.201 INFO:tasks.workunit.client.1.smithi157.stdout:4/621: write d3/da/f46 [113131,120446] 0 2024-02-28T16:27:10.202 INFO:tasks.workunit.client.1.smithi157.stdout:9/633: chown d0/d19/d30/c65 170121748 1 2024-02-28T16:27:10.203 INFO:tasks.workunit.client.1.smithi157.stdout:5/655: rmdir d0/d8/d7e/d82/dc7 0 2024-02-28T16:27:10.203 INFO:tasks.workunit.client.1.smithi157.stdout:2/700: dread - da/f96 zero size 2024-02-28T16:27:10.207 INFO:tasks.workunit.client.1.smithi157.stdout:7/644: creat df/d1f/fcb x:0 0 0 2024-02-28T16:27:10.210 INFO:tasks.workunit.client.1.smithi157.stdout:3/584: unlink d0/f46 0 2024-02-28T16:27:10.215 INFO:tasks.workunit.client.1.smithi157.stdout:7/645: dread df/d80/d84/f9c [0,4194304] 0 2024-02-28T16:27:10.215 INFO:tasks.workunit.client.1.smithi157.stdout:0/660: symlink d1/d13/d46/d99/lde 0 2024-02-28T16:27:10.219 INFO:tasks.workunit.client.1.smithi157.stdout:8/609: getdents d1/d5/d43/d66 0 2024-02-28T16:27:10.221 INFO:tasks.workunit.client.1.smithi157.stdout:2/701: creat da/d38/d3e/d9b/fe0 x:0 0 0 2024-02-28T16:27:10.225 INFO:tasks.workunit.client.1.smithi157.stdout:1/618: dwrite d10/d11/d31/d2a/f55 [4194304,4194304] 0 2024-02-28T16:27:10.228 INFO:tasks.workunit.client.1.smithi157.stdout:7/646: rmdir df/d1f/d24/d4f 39 2024-02-28T16:27:10.232 INFO:tasks.workunit.client.1.smithi157.stdout:9/634: truncate d0/d19/f7a 534027 0 2024-02-28T16:27:10.236 INFO:tasks.workunit.client.1.smithi157.stdout:0/661: dread d1/d8/fc [0,4194304] 0 2024-02-28T16:27:10.238 INFO:tasks.workunit.client.1.smithi157.stdout:1/619: creat d10/d94/fc3 x:0 0 0 2024-02-28T16:27:10.246 INFO:tasks.workunit.client.1.smithi157.stdout:5/656: write d0/d9/d47/d78/fb9 [48916,33044] 0 2024-02-28T16:27:10.247 INFO:tasks.workunit.client.1.smithi157.stdout:4/622: truncate d3/da/d1f/f40 3037275 0 2024-02-28T16:27:10.254 INFO:tasks.workunit.client.1.smithi157.stdout:9/635: rmdir d0/d36/d37/d40/d5b 39 2024-02-28T16:27:10.255 INFO:tasks.workunit.client.1.smithi157.stdout:9/636: read d0/fab [1294154,22563] 0 2024-02-28T16:27:10.256 INFO:tasks.workunit.client.1.smithi157.stdout:0/662: symlink d1/d13/d57/ldf 0 2024-02-28T16:27:10.257 INFO:tasks.workunit.client.1.smithi157.stdout:9/637: write d0/d36/d3f/f8b [1203703,66479] 0 2024-02-28T16:27:10.259 INFO:tasks.workunit.client.1.smithi157.stdout:0/663: truncate d1/d13/d46/d99/fc2 1625507 0 2024-02-28T16:27:10.261 INFO:tasks.workunit.client.1.smithi157.stdout:3/585: creat d0/d6/d1e/d5b/fba x:0 0 0 2024-02-28T16:27:10.269 INFO:tasks.workunit.client.1.smithi157.stdout:2/702: creat da/fe1 x:0 0 0 2024-02-28T16:27:10.271 INFO:tasks.workunit.client.1.smithi157.stdout:5/657: rename d0/d30/ca3 to d0/d30/dca/ce3 0 2024-02-28T16:27:10.272 INFO:tasks.workunit.client.1.smithi157.stdout:2/703: write da/d38/d5a/d79/fb1 [151670,16567] 0 2024-02-28T16:27:10.275 INFO:tasks.workunit.client.1.smithi157.stdout:8/610: link d1/d5/d23/da1/cbe d1/d5/d23/d38/d67/cd2 0 2024-02-28T16:27:10.277 INFO:tasks.workunit.client.1.smithi157.stdout:8/611: fsync d1/d5/f16 0 2024-02-28T16:27:10.282 INFO:tasks.workunit.client.1.smithi157.stdout:1/620: dwrite d10/d11/d3a/f5f [0,4194304] 0 2024-02-28T16:27:10.283 INFO:tasks.workunit.client.1.smithi157.stdout:0/664: symlink d1/d13/d46/le0 0 2024-02-28T16:27:10.285 INFO:tasks.workunit.client.1.smithi157.stdout:4/623: write d3/da/d37/f78 [404381,122461] 0 2024-02-28T16:27:10.287 INFO:tasks.workunit.client.1.smithi157.stdout:7/647: creat df/fcc x:0 0 0 2024-02-28T16:27:10.289 INFO:tasks.workunit.client.1.smithi157.stdout:8/612: dread d1/d5/d14/d3e/f8f [0,4194304] 0 2024-02-28T16:27:10.291 INFO:tasks.workunit.client.1.smithi157.stdout:5/658: creat d0/d30/d50/d7f/fe4 x:0 0 0 2024-02-28T16:27:10.298 INFO:tasks.workunit.client.1.smithi157.stdout:9/638: creat d0/d36/d37/d40/d5b/fd7 x:0 0 0 2024-02-28T16:27:10.301 INFO:tasks.workunit.client.1.smithi157.stdout:3/586: mknod d0/d6/cbb 0 2024-02-28T16:27:10.303 INFO:tasks.workunit.client.1.smithi157.stdout:0/665: creat d1/d13/d52/db5/d64/fe1 x:0 0 0 2024-02-28T16:27:10.305 INFO:tasks.workunit.client.1.smithi157.stdout:5/659: dwrite d0/d9/d47/d78/f80 [0,4194304] 0 2024-02-28T16:27:10.305 INFO:tasks.workunit.client.1.smithi157.stdout:4/624: unlink d3/da/d37/cc0 0 2024-02-28T16:27:10.307 INFO:tasks.workunit.client.1.smithi157.stdout:4/625: chown d3/da/c15 4171441 1 2024-02-28T16:27:10.308 INFO:tasks.workunit.client.1.smithi157.stdout:5/660: dread d0/d9/d47/dad/f74 [0,4194304] 0 2024-02-28T16:27:10.311 INFO:tasks.workunit.client.1.smithi157.stdout:5/661: stat d0/d8/c58 0 2024-02-28T16:27:10.312 INFO:tasks.workunit.client.1.smithi157.stdout:8/613: mkdir d1/d5/d23/da1/dd3 0 2024-02-28T16:27:10.314 INFO:tasks.workunit.client.1.smithi157.stdout:2/704: creat da/d38/d7e/dbb/dd0/fe2 x:0 0 0 2024-02-28T16:27:10.315 INFO:tasks.workunit.client.1.smithi157.stdout:1/621: write d10/f38 [2811645,8560] 0 2024-02-28T16:27:10.315 INFO:tasks.workunit.client.1.smithi157.stdout:2/705: chown da/d38/d5a/la6 4003732 1 2024-02-28T16:27:10.318 INFO:tasks.workunit.client.1.smithi157.stdout:2/706: dread - da/d38/d5a/d79/fda zero size 2024-02-28T16:27:10.318 INFO:tasks.workunit.client.1.smithi157.stdout:1/622: write d10/da0/db6/fc2 [300645,70127] 0 2024-02-28T16:27:10.324 INFO:tasks.workunit.client.1.smithi157.stdout:8/614: mknod d1/d5/d14/d3e/d52/d54/cd4 0 2024-02-28T16:27:10.326 INFO:tasks.workunit.client.1.smithi157.stdout:9/639: symlink d0/d36/d37/d4d/d92/db9/ld8 0 2024-02-28T16:27:10.327 INFO:tasks.workunit.client.1.smithi157.stdout:0/666: mkdir d1/da/d7d/d98/de2 0 2024-02-28T16:27:10.327 INFO:tasks.workunit.client.1.smithi157.stdout:4/626: write d3/da/d28/f5a [319524,26793] 0 2024-02-28T16:27:10.328 INFO:tasks.workunit.client.1.smithi157.stdout:3/587: rename d0/cd to d0/d6/d44/d70/d71/da9/cbc 0 2024-02-28T16:27:10.329 INFO:tasks.workunit.client.1.smithi157.stdout:7/648: dwrite df/d4b/f95 [0,4194304] 0 2024-02-28T16:27:10.329 INFO:tasks.workunit.client.1.smithi157.stdout:4/627: stat d3/d77 0 2024-02-28T16:27:10.331 INFO:tasks.workunit.client.1.smithi157.stdout:5/662: dwrite d0/d9/d47/dad/f74 [0,4194304] 0 2024-02-28T16:27:10.334 INFO:tasks.workunit.client.1.smithi157.stdout:8/615: mknod d1/d5/d23/d38/d67/d6d/cd5 0 2024-02-28T16:27:10.335 INFO:tasks.workunit.client.1.smithi157.stdout:7/649: write df/f10 [3442519,3031] 0 2024-02-28T16:27:10.336 INFO:tasks.workunit.client.1.smithi157.stdout:9/640: fsync d0/d36/d37/d40/d4b/f6d 0 2024-02-28T16:27:10.339 INFO:tasks.workunit.client.1.smithi157.stdout:7/650: readlink l7 0 2024-02-28T16:27:10.343 INFO:tasks.workunit.client.1.smithi157.stdout:5/663: unlink d0/d9/d47/dad/f74 0 2024-02-28T16:27:10.347 INFO:tasks.workunit.client.1.smithi157.stdout:0/667: symlink d1/da/le3 0 2024-02-28T16:27:10.348 INFO:tasks.workunit.client.1.smithi157.stdout:3/588: dwrite d0/d6/d44/d48/f4e [0,4194304] 0 2024-02-28T16:27:10.352 INFO:tasks.workunit.client.1.smithi157.stdout:6/613: sync 2024-02-28T16:27:10.352 INFO:tasks.workunit.client.1.smithi157.stdout:4/628: unlink d3/da/d37/l6a 0 2024-02-28T16:27:10.353 INFO:tasks.workunit.client.1.smithi157.stdout:4/629: readlink d3/da/d28/l38 0 2024-02-28T16:27:10.353 INFO:tasks.workunit.client.1.smithi157.stdout:6/614: stat d2/d7/d8/da/d71/d8f/d6e 0 2024-02-28T16:27:10.356 INFO:tasks.workunit.client.1.smithi157.stdout:7/651: fsync df/d1f/d24/d39/f8c 0 2024-02-28T16:27:10.359 INFO:tasks.workunit.client.1.smithi157.stdout:5/664: mkdir d0/d9/d3a/de5 0 2024-02-28T16:27:10.361 INFO:tasks.workunit.client.1.smithi157.stdout:4/630: dread d3/da/f4f [0,4194304] 0 2024-02-28T16:27:10.363 INFO:tasks.workunit.client.1.smithi157.stdout:3/589: mkdir d0/d6/d6b/d75/dbd 0 2024-02-28T16:27:10.374 INFO:tasks.workunit.client.1.smithi157.stdout:6/615: creat d2/d7/de/d1b/d3d/fb3 x:0 0 0 2024-02-28T16:27:10.375 INFO:tasks.workunit.client.1.smithi157.stdout:0/668: dwrite d1/d8/d33/d96/fb1 [0,4194304] 0 2024-02-28T16:27:10.376 INFO:tasks.workunit.client.1.smithi157.stdout:0/669: readlink d1/d8/d27/la2 0 2024-02-28T16:27:10.379 INFO:tasks.workunit.client.1.smithi157.stdout:1/623: link d10/d11/d31/d2a/l56 d10/d11/d31/d7f/lc4 0 2024-02-28T16:27:10.381 INFO:tasks.workunit.client.1.smithi157.stdout:1/624: write f2 [4978272,29556] 0 2024-02-28T16:27:10.381 INFO:tasks.workunit.client.1.smithi157.stdout:5/665: creat d0/d30/dca/fe6 x:0 0 0 2024-02-28T16:27:10.390 INFO:tasks.workunit.client.1.smithi157.stdout:6/616: dwrite d2/d17/f5a [0,4194304] 0 2024-02-28T16:27:10.391 INFO:tasks.workunit.client.1.smithi157.stdout:6/617: readlink d2/d7/de/d40/l44 0 2024-02-28T16:27:10.394 INFO:tasks.workunit.client.1.smithi157.stdout:7/652: dread df/d1f/d24/d4f/d72/f97 [0,4194304] 0 2024-02-28T16:27:10.394 INFO:tasks.workunit.client.1.smithi157.stdout:6/618: fdatasync d2/d7/d8/da/f91 0 2024-02-28T16:27:10.396 INFO:tasks.workunit.client.1.smithi157.stdout:4/631: mkdir d3/da/d1f/dc1/dc8 0 2024-02-28T16:27:10.397 INFO:tasks.workunit.client.1.smithi157.stdout:6/619: readlink d2/d7/d8/da/d71/d8f/l36 0 2024-02-28T16:27:10.399 INFO:tasks.workunit.client.1.smithi157.stdout:4/632: write d3/da/d48/f7c [1135492,40515] 0 2024-02-28T16:27:10.399 INFO:tasks.workunit.client.1.smithi157.stdout:3/590: rename d0/d6/d44/d70/d71/ca7 to d0/d6/d34/d80/d23/d2b/d2e/d7e/cbe 0 2024-02-28T16:27:10.400 INFO:tasks.workunit.client.1.smithi157.stdout:1/625: dwrite d10/d11/d3a/d5c/d6c/d7b/f4f [0,4194304] 0 2024-02-28T16:27:10.402 INFO:tasks.workunit.client.1.smithi157.stdout:8/616: getdents d1/d5/d23/d53/dc1 0 2024-02-28T16:27:10.404 INFO:tasks.workunit.client.1.smithi157.stdout:5/666: symlink d0/d9/d47/le7 0 2024-02-28T16:27:10.416 INFO:tasks.workunit.client.1.smithi157.stdout:6/620: dwrite d2/d7/de/d1b/d3d/da4/d53/d69/f7c [4194304,4194304] 0 2024-02-28T16:27:10.426 INFO:tasks.workunit.client.1.smithi157.stdout:8/617: mkdir d1/d5/d4d/dd6 0 2024-02-28T16:27:10.427 INFO:tasks.workunit.client.1.smithi157.stdout:3/591: mknod d0/d6/d34/d80/d5c/cbf 0 2024-02-28T16:27:10.434 INFO:tasks.workunit.client.1.smithi157.stdout:4/633: mkdir d3/da/d37/d84/dc9 0 2024-02-28T16:27:10.435 INFO:tasks.workunit.client.1.smithi157.stdout:6/621: mkdir d2/d7/d8/da/d71/d8f/db4 0 2024-02-28T16:27:10.435 INFO:tasks.workunit.client.1.smithi157.stdout:0/670: dread d1/d13/d46/f51 [0,4194304] 0 2024-02-28T16:27:10.437 INFO:tasks.workunit.client.1.smithi157.stdout:7/653: dwrite df/d1f/d24/d38/f62 [0,4194304] 0 2024-02-28T16:27:10.438 INFO:tasks.workunit.client.1.smithi157.stdout:6/622: chown d2/d7/d8/da/f8e 524564 1 2024-02-28T16:27:10.442 INFO:tasks.workunit.client.1.smithi157.stdout:8/618: dwrite d1/d5/d43/d86/d96/f75 [0,4194304] 0 2024-02-28T16:27:10.443 INFO:tasks.workunit.client.1.smithi157.stdout:0/671: symlink d1/da/d6c/le4 0 2024-02-28T16:27:10.444 INFO:tasks.workunit.client.1.smithi157.stdout:0/672: chown d1/d13/d52 178741 1 2024-02-28T16:27:10.444 INFO:tasks.workunit.client.1.smithi157.stdout:5/667: link d0/d9/d47/d5b/d89/d75/dab/la2 d0/d9/d1b/le8 0 2024-02-28T16:27:10.444 INFO:tasks.workunit.client.1.smithi157.stdout:8/619: chown d1/d5/d10/f35 73759 1 2024-02-28T16:27:10.446 INFO:tasks.workunit.client.1.smithi157.stdout:0/673: truncate d1/d13/d52/d53/fd7 1012108 0 2024-02-28T16:27:10.449 INFO:tasks.workunit.client.1.smithi157.stdout:4/634: rmdir d3 39 2024-02-28T16:27:10.452 INFO:tasks.workunit.client.1.smithi157.stdout:8/620: symlink d1/d5/d23/da1/ld7 0 2024-02-28T16:27:10.454 INFO:tasks.workunit.client.1.smithi157.stdout:3/592: write d0/d6/d44/d48/f6e [1013974,70731] 0 2024-02-28T16:27:10.462 INFO:tasks.workunit.client.1.smithi157.stdout:3/593: creat d0/d6/d6b/d75/fc0 x:0 0 0 2024-02-28T16:27:10.465 INFO:tasks.workunit.client.1.smithi157.stdout:0/674: creat d1/da/fe5 x:0 0 0 2024-02-28T16:27:10.466 INFO:tasks.workunit.client.1.smithi157.stdout:9/641: sync 2024-02-28T16:27:10.466 INFO:tasks.workunit.client.1.smithi157.stdout:2/707: sync 2024-02-28T16:27:10.468 INFO:tasks.workunit.client.1.smithi157.stdout:0/675: chown d1/d13/dc9/cc5 178883 1 2024-02-28T16:27:10.470 INFO:tasks.workunit.client.1.smithi157.stdout:4/635: read d3/da/d37/fa4 [3403494,111663] 0 2024-02-28T16:27:10.470 INFO:tasks.workunit.client.1.smithi157.stdout:3/594: symlink d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/lc1 0 2024-02-28T16:27:10.474 INFO:tasks.workunit.client.1.smithi157.stdout:5/668: dwrite d0/f2f [0,4194304] 0 2024-02-28T16:27:10.477 INFO:tasks.workunit.client.1.smithi157.stdout:9/642: mknod d0/d36/d37/d40/d5b/cd9 0 2024-02-28T16:27:10.478 INFO:tasks.workunit.client.1.smithi157.stdout:5/669: stat d0/d9/d1b/f73 0 2024-02-28T16:27:10.479 INFO:tasks.workunit.client.1.smithi157.stdout:8/621: dwrite d1/d5/d4d/d60/f94 [0,4194304] 0 2024-02-28T16:27:10.480 INFO:tasks.workunit.client.1.smithi157.stdout:4/636: creat d3/da/d37/d71/db0/fca x:0 0 0 2024-02-28T16:27:10.481 INFO:tasks.workunit.client.1.smithi157.stdout:5/670: truncate d0/d8/fa8 166648 0 2024-02-28T16:27:10.486 INFO:tasks.workunit.client.1.smithi157.stdout:6/623: dread d2/f35 [0,4194304] 0 2024-02-28T16:27:10.488 INFO:tasks.workunit.client.1.smithi157.stdout:0/676: rename d1/d8/d33/d56/fd9 to d1/d8/d33/d96/fe6 0 2024-02-28T16:27:10.489 INFO:tasks.workunit.client.1.smithi157.stdout:9/643: creat d0/d36/d37/d40/d4b/d96/fda x:0 0 0 2024-02-28T16:27:10.492 INFO:tasks.workunit.client.1.smithi157.stdout:6/624: fdatasync d2/d7/de/d1b/d4d/d6c/f95 0 2024-02-28T16:27:10.493 INFO:tasks.workunit.client.1.smithi157.stdout:0/677: fsync d1/d13/d52/db5/d64/f78 0 2024-02-28T16:27:10.493 INFO:tasks.workunit.client.1.smithi157.stdout:9/644: fdatasync d0/d36/f63 0 2024-02-28T16:27:10.494 INFO:tasks.workunit.client.1.smithi157.stdout:3/595: rename d0/d6/d44/d48/l72 to d0/d6/d34/d43/lc2 0 2024-02-28T16:27:10.497 INFO:tasks.workunit.client.1.smithi157.stdout:4/637: rmdir d3/d77/dbd 0 2024-02-28T16:27:10.498 INFO:tasks.workunit.client.1.smithi157.stdout:8/622: fdatasync d1/d5/d4d/d60/f94 0 2024-02-28T16:27:10.499 INFO:tasks.workunit.client.1.smithi157.stdout:2/708: getdents da/d38/d3e/d9b/da3 0 2024-02-28T16:27:10.504 INFO:tasks.workunit.client.1.smithi157.stdout:3/596: rename d0/d6/l1a to d0/d6/d34/lc3 0 2024-02-28T16:27:10.506 INFO:tasks.workunit.client.1.smithi157.stdout:9/645: creat d0/dc0/fdb x:0 0 0 2024-02-28T16:27:10.506 INFO:tasks.workunit.client.1.smithi157.stdout:5/671: dwrite d0/d9/d47/f6d [0,4194304] 0 2024-02-28T16:27:10.506 INFO:tasks.workunit.client.1.smithi157.stdout:2/709: write da/d38/fc4 [785248,27519] 0 2024-02-28T16:27:10.509 INFO:tasks.workunit.client.1.smithi157.stdout:2/710: dread - da/d38/f57 zero size 2024-02-28T16:27:10.509 INFO:tasks.workunit.client.1.smithi157.stdout:9/646: chown d0/d36/d3f/f76 109 1 2024-02-28T16:27:10.514 INFO:tasks.workunit.client.1.smithi157.stdout:4/638: rename d3/d77/c54 to d3/da/ccb 0 2024-02-28T16:27:10.514 INFO:tasks.workunit.client.1.smithi157.stdout:5/672: fsync d0/d9/d47/d5b/d89/d75/fc5 0 2024-02-28T16:27:10.519 INFO:tasks.workunit.client.1.smithi157.stdout:0/678: dwrite d1/d13/d52/fa9 [0,4194304] 0 2024-02-28T16:27:10.520 INFO:tasks.workunit.client.1.smithi157.stdout:0/679: dread - d1/d13/d52/db5/d64/fb6 zero size 2024-02-28T16:27:10.524 INFO:tasks.workunit.client.1.smithi157.stdout:4/639: unlink d3/d77/f65 0 2024-02-28T16:27:10.527 INFO:tasks.workunit.client.1.smithi157.stdout:2/711: write da/d38/d5a/d79/fa1 [723696,85826] 0 2024-02-28T16:27:10.528 INFO:tasks.workunit.client.1.smithi157.stdout:0/680: write d1/d8/d33/d96/fe6 [3937774,82591] 0 2024-02-28T16:27:10.528 INFO:tasks.workunit.client.1.smithi157.stdout:2/712: stat da/d8c/dc0 0 2024-02-28T16:27:10.536 INFO:tasks.workunit.client.1.smithi157.stdout:8/623: rename d1/d5/d14/d3e to d1/d5/dd8 0 2024-02-28T16:27:10.538 INFO:tasks.workunit.client.1.smithi157.stdout:8/624: dread - d1/d5/dd8/d52/d54/fc3 zero size 2024-02-28T16:27:10.538 INFO:tasks.workunit.client.1.smithi157.stdout:0/681: truncate d1/d13/d46/f4f 830097 0 2024-02-28T16:27:10.540 INFO:tasks.workunit.client.1.smithi157.stdout:8/625: readlink d1/d5/d43/l63 0 2024-02-28T16:27:10.540 INFO:tasks.workunit.client.1.smithi157.stdout:0/682: readlink d1/l1e 0 2024-02-28T16:27:10.544 INFO:tasks.workunit.client.1.smithi157.stdout:5/673: rename d0/d30/d50/d7f/f8c to d0/d9/d47/d5b/d89/d75/fe9 0 2024-02-28T16:27:10.545 INFO:tasks.workunit.client.1.smithi157.stdout:2/713: link da/d2b/f50 da/d8c/dc0/fe3 0 2024-02-28T16:27:10.547 INFO:tasks.workunit.client.1.smithi157.stdout:8/626: dread d1/d5/d23/dbd/fc4 [0,4194304] 0 2024-02-28T16:27:10.549 INFO:tasks.workunit.client.1.smithi157.stdout:0/683: unlink d1/d13/d52/d7b/dc1/fd4 0 2024-02-28T16:27:10.553 INFO:tasks.workunit.client.1.smithi157.stdout:2/714: creat da/d38/d5a/d79/d7b/fe4 x:0 0 0 2024-02-28T16:27:10.553 INFO:tasks.workunit.client.1.smithi157.stdout:0/684: chown d1/cb 17483678 1 2024-02-28T16:27:10.553 INFO:tasks.workunit.client.1.smithi157.stdout:5/674: unlink d0/d9/d47/d5b/d89/d75/dab/la2 0 2024-02-28T16:27:10.553 INFO:tasks.workunit.client.1.smithi157.stdout:9/647: dread d0/d19/f64 [0,4194304] 0 2024-02-28T16:27:10.555 INFO:tasks.workunit.client.1.smithi157.stdout:4/640: dread d3/da/fb3 [0,4194304] 0 2024-02-28T16:27:10.555 INFO:tasks.workunit.client.1.smithi157.stdout:8/627: unlink d1/d5/d23/d38/d67/lb8 0 2024-02-28T16:27:10.556 INFO:tasks.workunit.client.1.smithi157.stdout:3/597: dwrite d0/d6/d34/d80/d5c/f7d [0,4194304] 0 2024-02-28T16:27:10.558 INFO:tasks.workunit.client.1.smithi157.stdout:9/648: fdatasync d0/d36/d3f/d69/fd4 0 2024-02-28T16:27:10.561 INFO:tasks.workunit.client.1.smithi157.stdout:3/598: read d0/d6/d6b/d9e/fa0 [271409,130599] 0 2024-02-28T16:27:10.565 INFO:tasks.workunit.client.1.smithi157.stdout:1/626: sync 2024-02-28T16:27:10.565 INFO:tasks.workunit.client.1.smithi157.stdout:4/641: mkdir d3/dcc 0 2024-02-28T16:27:10.569 INFO:tasks.workunit.client.1.smithi157.stdout:9/649: creat d0/d36/d37/d40/d4b/fdc x:0 0 0 2024-02-28T16:27:10.571 INFO:tasks.workunit.client.1.smithi157.stdout:2/715: dwrite da/d38/d5a/d79/fb3 [0,4194304] 0 2024-02-28T16:27:10.574 INFO:tasks.workunit.client.1.smithi157.stdout:2/716: write da/d35/f8b [7652801,13405] 0 2024-02-28T16:27:10.574 INFO:tasks.workunit.client.1.smithi157.stdout:5/675: dread d0/d30/d50/f63 [0,4194304] 0 2024-02-28T16:27:10.577 INFO:tasks.workunit.client.1.smithi157.stdout:3/599: read d0/d6/d44/d70/f8b [300228,73846] 0 2024-02-28T16:27:10.578 INFO:tasks.workunit.client.1.smithi157.stdout:0/685: link d1/d13/d52/db5/f63 d1/d13/d52/d53/fe7 0 2024-02-28T16:27:10.581 INFO:tasks.workunit.client.1.smithi157.stdout:4/642: truncate d3/da/d1f/f6d 1464682 0 2024-02-28T16:27:10.585 INFO:tasks.workunit.client.1.smithi157.stdout:1/627: dwrite d10/d94/f9f [0,4194304] 0 2024-02-28T16:27:10.590 INFO:tasks.workunit.client.1.smithi157.stdout:1/628: read d10/d11/d3a/d5c/f87 [1295833,7298] 0 2024-02-28T16:27:10.593 INFO:tasks.workunit.client.1.smithi157.stdout:4/643: rename d3/da/f5e to d3/da/d37/d84/dc9/fcd 0 2024-02-28T16:27:10.596 INFO:tasks.workunit.client.1.smithi157.stdout:8/628: getdents d1/d5/d43 0 2024-02-28T16:27:10.600 INFO:tasks.workunit.client.1.smithi157.stdout:5/676: link d0/d9/d47/f56 d0/d30/da0/dd5/fea 0 2024-02-28T16:27:10.601 INFO:tasks.workunit.client.1.smithi157.stdout:3/600: dread d0/d6/d34/d80/d23/d2b/fb8 [0,4194304] 0 2024-02-28T16:27:10.605 INFO:tasks.workunit.client.1.smithi157.stdout:2/717: dwrite da/d38/d3e/d9b/da3/f7f [0,4194304] 0 2024-02-28T16:27:10.607 INFO:tasks.workunit.client.1.smithi157.stdout:0/686: dread d1/d8/d33/d56/f62 [0,4194304] 0 2024-02-28T16:27:10.607 INFO:tasks.workunit.client.1.smithi157.stdout:2/718: write da/ff [3054800,122339] 0 2024-02-28T16:27:10.613 INFO:tasks.workunit.client.1.smithi157.stdout:8/629: chown d1/f2 607 1 2024-02-28T16:27:10.616 INFO:tasks.workunit.client.1.smithi157.stdout:8/630: write d1/f9c [269695,98607] 0 2024-02-28T16:27:10.616 INFO:tasks.workunit.client.1.smithi157.stdout:1/629: unlink d10/d11/d31/c63 0 2024-02-28T16:27:10.620 INFO:tasks.workunit.client.1.smithi157.stdout:3/601: write d0/f24 [2340712,21985] 0 2024-02-28T16:27:10.622 INFO:tasks.workunit.client.1.smithi157.stdout:9/650: dread d0/f18 [0,4194304] 0 2024-02-28T16:27:10.622 INFO:tasks.workunit.client.1.smithi157.stdout:5/677: mkdir d0/d9/d47/dad/deb 0 2024-02-28T16:27:10.623 INFO:tasks.workunit.client.1.smithi157.stdout:6/625: sync 2024-02-28T16:27:10.623 INFO:tasks.workunit.client.1.smithi157.stdout:7/654: sync 2024-02-28T16:27:10.626 INFO:tasks.workunit.client.1.smithi157.stdout:6/626: fsync d2/d7/de/d1b/d3d/da4/f3b 0 2024-02-28T16:27:10.636 INFO:tasks.workunit.client.1.smithi157.stdout:2/719: dread da/f1f [0,4194304] 0 2024-02-28T16:27:10.637 INFO:tasks.workunit.client.1.smithi157.stdout:2/720: stat c5 0 2024-02-28T16:27:10.637 INFO:tasks.workunit.client.1.smithi157.stdout:1/630: mknod d10/d11/d3a/d5c/d6c/d7b/d8c/cc5 0 2024-02-28T16:27:10.639 INFO:tasks.workunit.client.1.smithi157.stdout:3/602: creat d0/d6/d34/d80/d23/d2b/d2e/fc4 x:0 0 0 2024-02-28T16:27:10.639 INFO:tasks.workunit.client.1.smithi157.stdout:8/631: dread d1/d5/d14/fad [0,4194304] 0 2024-02-28T16:27:10.640 INFO:tasks.workunit.client.1.smithi157.stdout:3/603: chown d0/d6/d44/l6f 3748 1 2024-02-28T16:27:10.641 INFO:tasks.workunit.client.1.smithi157.stdout:9/651: symlink d0/d36/d37/d40/d5b/dba/ldd 0 2024-02-28T16:27:10.644 INFO:tasks.workunit.client.1.smithi157.stdout:4/644: link d3/da/d1f/d22/c8c d3/dcc/cce 0 2024-02-28T16:27:10.645 INFO:tasks.workunit.client.1.smithi157.stdout:2/721: readlink da/d47/ld9 0 2024-02-28T16:27:10.646 INFO:tasks.workunit.client.1.smithi157.stdout:2/722: fdatasync da/d38/d7e/d92/dd2/fd7 0 2024-02-28T16:27:10.647 INFO:tasks.workunit.client.1.smithi157.stdout:5/678: chown d0/d9/d1b/d36/c65 0 1 2024-02-28T16:27:10.649 INFO:tasks.workunit.client.1.smithi157.stdout:2/723: read da/d38/d3e/f5b [3943571,90927] 0 2024-02-28T16:27:10.650 INFO:tasks.workunit.client.1.smithi157.stdout:0/687: creat d1/d13/fe8 x:0 0 0 2024-02-28T16:27:10.671 INFO:tasks.workunit.client.1.smithi157.stdout:8/632: unlink d1/d5/dd8/d52/d54/fc7 0 2024-02-28T16:27:10.671 INFO:tasks.workunit.client.1.smithi157.stdout:7/655: creat df/d25/d4e/fcd x:0 0 0 2024-02-28T16:27:10.673 INFO:tasks.workunit.client.1.smithi157.stdout:6/627: getdents d2/d7/de/d1b/d4d/d6c 0 2024-02-28T16:27:10.675 INFO:tasks.workunit.client.1.smithi157.stdout:0/688: truncate d1/d8/d33/f44 116733 0 2024-02-28T16:27:10.675 INFO:tasks.workunit.client.1.smithi157.stdout:4/645: symlink d3/da/d1f/lcf 0 2024-02-28T16:27:10.676 INFO:tasks.workunit.client.1.smithi157.stdout:5/679: mknod d0/cec 0 2024-02-28T16:27:10.679 INFO:tasks.workunit.client.1.smithi157.stdout:7/656: truncate df/d80/d84/f9c 1259559 0 2024-02-28T16:27:10.807 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:10.807 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:10.807 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:27:10.807 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:27:10.807 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:27:10.807 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:27:10.807 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:27:10.808 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:27:10.808 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:10.808 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: Upgrade: Need to upgrade myself (mgr.smithi157.cmcxzj) 2024-02-28T16:27:10.808 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:10 smithi148 ceph-mon[28767]: Upgrade: Need to upgrade myself (mgr.smithi157.cmcxzj) 2024-02-28T16:27:10.828 INFO:tasks.workunit.client.1.smithi157.stdout:0/689: read d1/d8/d33/f44 [64251,112411] 0 2024-02-28T16:27:10.832 INFO:tasks.workunit.client.1.smithi157.stdout:9/652: dwrite d0/d19/f9d [0,4194304] 0 2024-02-28T16:27:10.833 INFO:tasks.workunit.client.1.smithi157.stdout:4/646: creat d3/da/d37/d71/db0/fd0 x:0 0 0 2024-02-28T16:27:10.834 INFO:tasks.workunit.client.1.smithi157.stdout:2/724: dwrite da/d38/d3e/d9b/da3/f68 [0,4194304] 0 2024-02-28T16:27:10.838 INFO:tasks.workunit.client.1.smithi157.stdout:7/657: chown df/d1f/d24/d38/lc7 266415459 1 2024-02-28T16:27:10.841 INFO:tasks.workunit.client.1.smithi157.stdout:1/631: dread d10/d11/d3a/d5c/f87 [0,4194304] 0 2024-02-28T16:27:10.842 INFO:tasks.workunit.client.1.smithi157.stdout:2/725: rename da/f34 to da/d35/fe5 0 2024-02-28T16:27:10.842 INFO:tasks.workunit.client.1.smithi157.stdout:7/658: dread - df/d1f/fcb zero size 2024-02-28T16:27:10.843 INFO:tasks.workunit.client.1.smithi157.stdout:4/647: write d3/da/d1f/d22/f7a [2199670,128082] 0 2024-02-28T16:27:10.846 INFO:tasks.workunit.client.1.smithi157.stdout:8/633: dwrite d1/d5/f71 [4194304,4194304] 0 2024-02-28T16:27:10.847 INFO:tasks.workunit.client.1.smithi157.stdout:9/653: mknod d0/d36/d37/cde 0 2024-02-28T16:27:10.848 INFO:tasks.workunit.client.1.smithi157.stdout:7/659: fdatasync df/d25/d4e/d67/fc4 0 2024-02-28T16:27:10.854 INFO:tasks.workunit.client.1.smithi157.stdout:4/648: fdatasync d3/da/d1f/d22/f3d 0 2024-02-28T16:27:10.855 INFO:tasks.workunit.client.1.smithi157.stdout:1/632: truncate d10/d11/d22/f52 320686 0 2024-02-28T16:27:10.859 INFO:tasks.workunit.client.1.smithi157.stdout:1/633: fdatasync d10/d11/d3a/d5c/d6c/fbd 0 2024-02-28T16:27:10.861 INFO:tasks.workunit.client.1.smithi157.stdout:3/604: sync 2024-02-28T16:27:10.862 INFO:tasks.workunit.client.1.smithi157.stdout:8/634: creat d1/d5/d23/d53/dc1/fd9 x:0 0 0 2024-02-28T16:27:10.862 INFO:tasks.workunit.client.1.smithi157.stdout:9/654: creat d0/d36/dc2/dc8/fdf x:0 0 0 2024-02-28T16:27:10.864 INFO:tasks.workunit.client.1.smithi157.stdout:7/660: mknod df/d1f/cce 0 2024-02-28T16:27:10.864 INFO:tasks.workunit.client.1.smithi157.stdout:5/680: dwrite d0/d30/dca/fe6 [0,4194304] 0 2024-02-28T16:27:10.867 INFO:tasks.workunit.client.1.smithi157.stdout:3/605: fdatasync d0/d6/d1e/d5b/d9d/fa4 0 2024-02-28T16:27:10.874 INFO:tasks.workunit.client.1.smithi157.stdout:1/634: fsync d10/d11/d3a/d5c/f87 0 2024-02-28T16:27:10.876 INFO:tasks.workunit.client.1.smithi157.stdout:7/661: write df/d25/d4e/d67/f45 [782986,8917] 0 2024-02-28T16:27:10.882 INFO:tasks.workunit.client.1.smithi157.stdout:3/606: creat d0/d6/d44/d70/d71/fc5 x:0 0 0 2024-02-28T16:27:10.884 INFO:tasks.workunit.client.1.smithi157.stdout:1/635: dread - d10/d11/d3a/d5c/d6a/db4/d91/f9a zero size 2024-02-28T16:27:10.893 INFO:tasks.workunit.client.1.smithi157.stdout:2/726: dread da/f2c [0,4194304] 0 2024-02-28T16:27:10.893 INFO:tasks.workunit.client.1.smithi157.stdout:3/607: mknod d0/cc6 0 2024-02-28T16:27:10.893 INFO:tasks.workunit.client.1.smithi157.stdout:5/681: truncate d0/d9/d47/d5b/d89/d75/fe9 1083596 0 2024-02-28T16:27:10.894 INFO:tasks.workunit.client.1.smithi157.stdout:4/649: dwrite d3/da/d28/f5b [0,4194304] 0 2024-02-28T16:27:10.896 INFO:tasks.workunit.client.1.smithi157.stdout:0/690: dread d1/da/f43 [0,4194304] 0 2024-02-28T16:27:10.898 INFO:tasks.workunit.client.1.smithi157.stdout:8/635: dwrite d1/d5/d23/f68 [0,4194304] 0 2024-02-28T16:27:10.901 INFO:tasks.workunit.client.1.smithi157.stdout:4/650: write d3/da/d1f/d22/f7a [997805,111995] 0 2024-02-28T16:27:10.904 INFO:tasks.workunit.client.1.smithi157.stdout:2/727: symlink da/d38/d7e/d92/le6 0 2024-02-28T16:27:10.905 INFO:tasks.workunit.client.1.smithi157.stdout:4/651: chown d3/da/d1f/d22/f83 228 1 2024-02-28T16:27:10.905 INFO:tasks.workunit.client.1.smithi157.stdout:2/728: fsync da/f37 0 2024-02-28T16:27:10.905 INFO:tasks.workunit.client.1.smithi157.stdout:3/608: truncate d0/d6/d44/d4b/da6/fb5 997183 0 2024-02-28T16:27:10.906 INFO:tasks.workunit.client.1.smithi157.stdout:9/655: dread d0/d19/f8d [0,4194304] 0 2024-02-28T16:27:10.909 INFO:tasks.workunit.client.1.smithi157.stdout:0/691: mkdir d1/da/d7d/d98/de2/de9 0 2024-02-28T16:27:10.915 INFO:tasks.workunit.client.1.smithi157.stdout:2/729: mknod da/d38/d5a/d79/d7b/ce7 0 2024-02-28T16:27:10.915 INFO:tasks.workunit.client.1.smithi157.stdout:2/730: write da/d35/f8b [718227,7021] 0 2024-02-28T16:27:10.918 INFO:tasks.workunit.client.1.smithi157.stdout:0/692: symlink d1/d8/d27/lea 0 2024-02-28T16:27:10.919 INFO:tasks.workunit.client.1.smithi157.stdout:2/731: dread - da/d38/d5a/d79/d7b/fe4 zero size 2024-02-28T16:27:10.922 INFO:tasks.workunit.client.1.smithi157.stdout:5/682: dread d0/d8/d7e/d82/fc3 [0,4194304] 0 2024-02-28T16:27:10.924 INFO:tasks.workunit.client.1.smithi157.stdout:2/732: dread - da/d35/fdd zero size 2024-02-28T16:27:10.929 INFO:tasks.workunit.client.1.smithi157.stdout:2/733: chown da/d8c/dc0/fc3 428 1 2024-02-28T16:27:10.934 INFO:tasks.workunit.client.1.smithi157.stdout:8/636: dwrite d1/d5/d23/d38/d6e/f87 [0,4194304] 0 2024-02-28T16:27:10.935 INFO:tasks.workunit.client.1.smithi157.stdout:3/609: dwrite d0/d6/d44/d70/d71/fc5 [0,4194304] 0 2024-02-28T16:27:10.938 INFO:tasks.workunit.client.1.smithi157.stdout:5/683: link d0/d8/f93 d0/d9/d47/d5b/d89/d75/fed 0 2024-02-28T16:27:10.939 INFO:tasks.workunit.client.1.smithi157.stdout:2/734: creat da/d8c/dc0/fe8 x:0 0 0 2024-02-28T16:27:10.941 INFO:tasks.workunit.client.1.smithi157.stdout:8/637: readlink d1/d5/d23/l30 0 2024-02-28T16:27:10.943 INFO:tasks.workunit.client.1.smithi157.stdout:7/662: dread df/d1f/d24/d39/f8c [0,4194304] 0 2024-02-28T16:27:10.947 INFO:tasks.workunit.client.1.smithi157.stdout:3/610: creat d0/d6/d34/d80/d5c/fc7 x:0 0 0 2024-02-28T16:27:10.949 INFO:tasks.workunit.client.1.smithi157.stdout:2/735: fdatasync da/d38/d3e/d9b/da3/f7f 0 2024-02-28T16:27:10.952 INFO:tasks.workunit.client.1.smithi157.stdout:5/684: symlink d0/db3/lee 0 2024-02-28T16:27:10.952 INFO:tasks.workunit.client.1.smithi157.stdout:7/663: write df/d25/fc3 [313612,1811] 0 2024-02-28T16:27:10.954 INFO:tasks.workunit.client.1.smithi157.stdout:7/664: chown df/d40 688922886 1 2024-02-28T16:27:10.956 INFO:tasks.workunit.client.1.smithi157.stdout:3/611: read d0/d6/d34/d80/f51 [4445465,82239] 0 2024-02-28T16:27:10.956 INFO:tasks.workunit.client.1.smithi157.stdout:0/693: dwrite d1/d8/d33/d56/f5d [0,4194304] 0 2024-02-28T16:27:10.957 INFO:tasks.workunit.client.1.smithi157.stdout:4/652: dread d3/da/d37/fa4 [0,4194304] 0 2024-02-28T16:27:10.961 INFO:tasks.workunit.client.1.smithi157.stdout:1/636: dread d10/d11/d3a/d5c/d6a/fa6 [0,4194304] 0 2024-02-28T16:27:10.962 INFO:tasks.workunit.client.1.smithi157.stdout:3/612: dread - d0/d6/d34/d80/d23/d2b/fb0 zero size 2024-02-28T16:27:10.965 INFO:tasks.workunit.client.1.smithi157.stdout:0/694: dread - d1/d13/d52/d7b/dc1/fc6 zero size 2024-02-28T16:27:10.966 INFO:tasks.workunit.client.1.smithi157.stdout:6/628: sync 2024-02-28T16:27:10.968 INFO:tasks.workunit.client.1.smithi157.stdout:8/638: dwrite d1/d5/d4d/f62 [0,4194304] 0 2024-02-28T16:27:10.971 INFO:tasks.workunit.client.1.smithi157.stdout:9/656: dread d0/d36/d37/f7d [0,4194304] 0 2024-02-28T16:27:10.981 INFO:tasks.workunit.client.1.smithi157.stdout:0/695: dwrite d1/da/f2f [0,4194304] 0 2024-02-28T16:27:10.982 INFO:tasks.workunit.client.1.smithi157.stdout:0/696: readlink d1/d13/d52/l66 0 2024-02-28T16:27:10.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:10.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:10.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:27:10.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:27:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:27:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:27:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:27:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:27:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: Upgrade: Need to upgrade myself (mgr.smithi157.cmcxzj) 2024-02-28T16:27:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:10 smithi157 ceph-mon[38346]: Upgrade: Need to upgrade myself (mgr.smithi157.cmcxzj) 2024-02-28T16:27:10.988 INFO:tasks.workunit.client.1.smithi157.stdout:5/685: write d0/d30/d50/d7f/fe4 [912432,106250] 0 2024-02-28T16:27:10.989 INFO:tasks.workunit.client.1.smithi157.stdout:4/653: rmdir d3/da/d28 39 2024-02-28T16:27:10.992 INFO:tasks.workunit.client.1.smithi157.stdout:6/629: creat d2/d7/de/d1b/fb5 x:0 0 0 2024-02-28T16:27:10.995 INFO:tasks.workunit.client.1.smithi157.stdout:9/657: rename d0/d36/d37/d40/d4b/d96/fc5 to d0/d36/d37/d4d/d92/fe0 0 2024-02-28T16:27:10.996 INFO:tasks.workunit.client.1.smithi157.stdout:2/736: getdents da/d38/d3e/d9b/da3 0 2024-02-28T16:27:11.002 INFO:tasks.workunit.client.1.smithi157.stdout:4/654: fdatasync d3/da/d1f/d22/f8d 0 2024-02-28T16:27:11.003 INFO:tasks.workunit.client.1.smithi157.stdout:7/665: dread df/f31 [0,4194304] 0 2024-02-28T16:27:11.004 INFO:tasks.workunit.client.1.smithi157.stdout:4/655: truncate d3/da/f46 4376477 0 2024-02-28T16:27:11.005 INFO:tasks.workunit.client.1.smithi157.stdout:7/666: chown df/d1f/d24/d4f 314076014 1 2024-02-28T16:27:11.006 INFO:tasks.workunit.client.1.smithi157.stdout:8/639: symlink d1/d5/d23/da1/dd3/lda 0 2024-02-28T16:27:11.008 INFO:tasks.workunit.client.1.smithi157.stdout:6/630: creat d2/d7/d8/da/d31/d59/fb6 x:0 0 0 2024-02-28T16:27:11.009 INFO:tasks.workunit.client.1.smithi157.stdout:0/697: symlink d1/d13/d7f/leb 0 2024-02-28T16:27:11.013 INFO:tasks.workunit.client.1.smithi157.stdout:2/737: write da/d35/fe5 [4328099,8198] 0 2024-02-28T16:27:11.017 INFO:tasks.workunit.client.1.smithi157.stdout:1/637: dread d10/d11/d22/faa [0,4194304] 0 2024-02-28T16:27:11.017 INFO:tasks.workunit.client.1.smithi157.stdout:7/667: unlink df/d1f/d24/d39/fac 0 2024-02-28T16:27:11.018 INFO:tasks.workunit.client.1.smithi157.stdout:9/658: dread d0/d36/d37/d40/f49 [0,4194304] 0 2024-02-28T16:27:11.019 INFO:tasks.workunit.client.1.smithi157.stdout:8/640: rename d1/d5/d23/d53/dc1/dc6 to d1/d5/d4d/dd6/ddb 0 2024-02-28T16:27:11.021 INFO:tasks.workunit.client.1.smithi157.stdout:8/641: readlink d1/d5/d43/d86/lbf 0 2024-02-28T16:27:11.025 INFO:tasks.workunit.client.1.smithi157.stdout:9/659: write d0/d36/d37/d4d/d92/fbf [1569436,110785] 0 2024-02-28T16:27:11.025 INFO:tasks.workunit.client.1.smithi157.stdout:2/738: symlink da/d38/d4e/le9 0 2024-02-28T16:27:11.025 INFO:tasks.workunit.client.1.smithi157.stdout:8/642: write d1/d5/d23/d38/d6e/f87 [3700447,118081] 0 2024-02-28T16:27:11.026 INFO:tasks.workunit.client.1.smithi157.stdout:1/638: write d10/d11/f8e [3568124,82686] 0 2024-02-28T16:27:11.036 INFO:tasks.workunit.client.1.smithi157.stdout:0/698: dwrite d1/d8/fc [4194304,4194304] 0 2024-02-28T16:27:11.037 INFO:tasks.workunit.client.1.smithi157.stdout:2/739: creat da/d35/fea x:0 0 0 2024-02-28T16:27:11.038 INFO:tasks.workunit.client.1.smithi157.stdout:8/643: creat d1/d5/d23/d38/d6e/d85/fdc x:0 0 0 2024-02-28T16:27:11.039 INFO:tasks.workunit.client.1.smithi157.stdout:2/740: write da/f2a [5055188,122852] 0 2024-02-28T16:27:11.042 INFO:tasks.workunit.client.1.smithi157.stdout:1/639: rename d10/da0/db6/fc2 to d10/d11/d3a/d5c/d6a/db4/fc6 0 2024-02-28T16:27:11.045 INFO:tasks.workunit.client.1.smithi157.stdout:9/660: truncate d0/f28 2383963 0 2024-02-28T16:27:11.052 INFO:tasks.workunit.client.1.smithi157.stdout:2/741: rename da/d38/d7e/fb4 to da/d38/d7e/feb 0 2024-02-28T16:27:11.053 INFO:tasks.workunit.client.1.smithi157.stdout:0/699: rename d1/da/le3 to d1/da/d7d/d98/de2/lec 0 2024-02-28T16:27:11.055 INFO:tasks.workunit.client.1.smithi157.stdout:0/700: stat d1/d8/d33/d56/l8d 0 2024-02-28T16:27:11.056 INFO:tasks.workunit.client.1.smithi157.stdout:1/640: mknod d10/d11/d3a/d5c/d6a/cc7 0 2024-02-28T16:27:11.056 INFO:tasks.workunit.client.1.smithi157.stdout:8/644: dwrite d1/d5/dd8/d52/d54/f7b [0,4194304] 0 2024-02-28T16:27:11.056 INFO:tasks.workunit.client.1.smithi157.stdout:0/701: chown d1/d13/dc9 88776467 1 2024-02-28T16:27:11.057 INFO:tasks.workunit.client.1.smithi157.stdout:9/661: unlink d0/d36/d3f/d69/fa7 0 2024-02-28T16:27:11.057 INFO:tasks.workunit.client.1.smithi157.stdout:8/645: stat d1/d5/d43/d86 0 2024-02-28T16:27:11.058 INFO:tasks.workunit.client.1.smithi157.stdout:9/662: chown d0/f90 1237755 1 2024-02-28T16:27:11.060 INFO:tasks.workunit.client.1.smithi157.stdout:3/613: sync 2024-02-28T16:27:11.064 INFO:tasks.workunit.client.1.smithi157.stdout:6/631: write d2/d7/de/d1b/d3d/da4/f48 [1279528,55335] 0 2024-02-28T16:27:11.065 INFO:tasks.workunit.client.1.smithi157.stdout:1/641: creat d10/fc8 x:0 0 0 2024-02-28T16:27:11.067 INFO:tasks.workunit.client.1.smithi157.stdout:5/686: dwrite d0/db3/fe1 [0,4194304] 0 2024-02-28T16:27:11.067 INFO:tasks.workunit.client.1.smithi157.stdout:6/632: dread - d2/d7/d38/f97 zero size 2024-02-28T16:27:11.068 INFO:tasks.workunit.client.1.smithi157.stdout:4/656: write d3/da/d28/f39 [1344597,23651] 0 2024-02-28T16:27:11.074 INFO:tasks.workunit.client.1.smithi157.stdout:5/687: dread - d0/d9/d1b/d36/daf/fc1 zero size 2024-02-28T16:27:11.076 INFO:tasks.workunit.client.1.smithi157.stdout:3/614: symlink d0/d6/d44/d48/lc8 0 2024-02-28T16:27:11.077 INFO:tasks.workunit.client.1.smithi157.stdout:4/657: chown d3/da/d1f/d22/f44 314498037 1 2024-02-28T16:27:11.080 INFO:tasks.workunit.client.1.smithi157.stdout:4/658: write d3/d77/daa/fc4 [658045,109543] 0 2024-02-28T16:27:11.081 INFO:tasks.workunit.client.1.smithi157.stdout:9/663: dwrite d0/d36/f9b [0,4194304] 0 2024-02-28T16:27:11.086 INFO:tasks.workunit.client.1.smithi157.stdout:5/688: rename d0/d8 to d0/d30/def 0 2024-02-28T16:27:11.092 INFO:tasks.workunit.client.1.smithi157.stdout:4/659: dread d3/da/d28/f39 [0,4194304] 0 2024-02-28T16:27:11.092 INFO:tasks.workunit.client.1.smithi157.stdout:9/664: write d0/f18 [237323,103923] 0 2024-02-28T16:27:11.094 INFO:tasks.workunit.client.1.smithi157.stdout:2/742: truncate da/d38/d7e/feb 85302 0 2024-02-28T16:27:11.096 INFO:tasks.workunit.client.1.smithi157.stdout:9/665: chown d0/d19/d30/l80 4 1 2024-02-28T16:27:11.096 INFO:tasks.workunit.client.1.smithi157.stdout:8/646: getdents d1/d5/d14 0 2024-02-28T16:27:11.096 INFO:tasks.workunit.client.1.smithi157.stdout:7/668: write df/d1f/d24/d39/f8c [2958607,19354] 0 2024-02-28T16:27:11.097 INFO:tasks.workunit.client.1.smithi157.stdout:6/633: rename d2/d7/la9 to d2/d7/lb7 0 2024-02-28T16:27:11.100 INFO:tasks.workunit.client.1.smithi157.stdout:3/615: dwrite d0/d6/d44/d48/f6e [0,4194304] 0 2024-02-28T16:27:11.100 INFO:tasks.workunit.client.1.smithi157.stdout:4/660: unlink d3/da/d48/d4a/f4c 0 2024-02-28T16:27:11.101 INFO:tasks.workunit.client.1.smithi157.stdout:5/689: write d0/d9/d47/d78/f80 [4866748,88941] 0 2024-02-28T16:27:11.101 INFO:tasks.workunit.client.1.smithi157.stdout:2/743: creat da/d38/d5a/d69/fec x:0 0 0 2024-02-28T16:27:11.103 INFO:tasks.workunit.client.1.smithi157.stdout:2/744: chown da/d38/f9e 264103 1 2024-02-28T16:27:11.105 INFO:tasks.workunit.client.1.smithi157.stdout:2/745: write da/f46 [4164282,98524] 0 2024-02-28T16:27:11.105 INFO:tasks.workunit.client.1.smithi157.stdout:3/616: readlink d0/d6/d1e/d5b/d9d/lad 0 2024-02-28T16:27:11.106 INFO:tasks.workunit.client.1.smithi157.stdout:6/634: symlink d2/d58/lb8 0 2024-02-28T16:27:11.109 INFO:tasks.workunit.client.1.smithi157.stdout:6/635: chown d2/d7/de 160 1 2024-02-28T16:27:11.113 INFO:tasks.workunit.client.1.smithi157.stdout:4/661: rename d3/da/d37/c57 to d3/da/d48/d8e/cd1 0 2024-02-28T16:27:11.115 INFO:tasks.workunit.client.1.smithi157.stdout:4/662: chown d3/da/d48/la5 1 1 2024-02-28T16:27:11.115 INFO:tasks.workunit.client.1.smithi157.stdout:7/669: dwrite df/d4b/d4c/f90 [0,4194304] 0 2024-02-28T16:27:11.118 INFO:tasks.workunit.client.1.smithi157.stdout:9/666: mknod d0/d36/d37/ce1 0 2024-02-28T16:27:11.122 INFO:tasks.workunit.client.1.smithi157.stdout:5/690: mkdir d0/d30/d50/df0 0 2024-02-28T16:27:11.126 INFO:tasks.workunit.client.1.smithi157.stdout:5/691: write d0/d9/d47/d5b/d89/d75/dab/fc2 [2170509,47002] 0 2024-02-28T16:27:11.126 INFO:tasks.workunit.client.1.smithi157.stdout:4/663: unlink d3/da/d48/f66 0 2024-02-28T16:27:11.129 INFO:tasks.workunit.client.1.smithi157.stdout:5/692: readlink d0/d9/d47/le7 0 2024-02-28T16:27:11.130 INFO:tasks.workunit.client.1.smithi157.stdout:2/746: dwrite da/d38/d3e/d9b/fe0 [0,4194304] 0 2024-02-28T16:27:11.131 INFO:tasks.workunit.client.1.smithi157.stdout:9/667: write d0/d36/d3f/f50 [1589125,65050] 0 2024-02-28T16:27:11.135 INFO:tasks.workunit.client.1.smithi157.stdout:8/647: getdents d1/d5/dd8 0 2024-02-28T16:27:11.138 INFO:tasks.workunit.client.1.smithi157.stdout:7/670: symlink df/d1f/d24/d39/lcf 0 2024-02-28T16:27:11.138 INFO:tasks.workunit.client.1.smithi157.stdout:5/693: mkdir d0/d30/df1 0 2024-02-28T16:27:11.140 INFO:tasks.workunit.client.1.smithi157.stdout:5/694: read d0/d30/def/f77 [947922,72094] 0 2024-02-28T16:27:11.140 INFO:tasks.workunit.client.1.smithi157.stdout:9/668: unlink d0/d36/d37/d40/d4b/fdc 0 2024-02-28T16:27:11.142 INFO:tasks.workunit.client.1.smithi157.stdout:3/617: creat d0/d6/d34/fc9 x:0 0 0 2024-02-28T16:27:11.143 INFO:tasks.workunit.client.1.smithi157.stdout:8/648: creat d1/d5/d23/d53/fdd x:0 0 0 2024-02-28T16:27:11.154 INFO:tasks.workunit.client.1.smithi157.stdout:8/649: symlink d1/d5/dd8/d52/d54/lde 0 2024-02-28T16:27:11.155 INFO:tasks.workunit.client.1.smithi157.stdout:7/671: write df/d25/d79/fa6 [1035990,123871] 0 2024-02-28T16:27:11.155 INFO:tasks.workunit.client.1.smithi157.stdout:4/664: chown d3/da/d48/f7c 307664 1 2024-02-28T16:27:11.157 INFO:tasks.workunit.client.1.smithi157.stdout:6/636: dread d2/d7/f24 [0,4194304] 0 2024-02-28T16:27:11.158 INFO:tasks.workunit.client.1.smithi157.stdout:7/672: write df/d4b/f95 [3365881,130736] 0 2024-02-28T16:27:11.160 INFO:tasks.workunit.client.1.smithi157.stdout:9/669: mknod d0/d36/d37/ce2 0 2024-02-28T16:27:11.161 INFO:tasks.workunit.client.1.smithi157.stdout:6/637: fsync d2/d7/d8/da/d71/d8f/f73 0 2024-02-28T16:27:11.162 INFO:tasks.workunit.client.1.smithi157.stdout:8/650: dread d1/f2 [0,4194304] 0 2024-02-28T16:27:11.163 INFO:tasks.workunit.client.1.smithi157.stdout:8/651: fdatasync d1/f2c 0 2024-02-28T16:27:11.163 INFO:tasks.workunit.client.1.smithi157.stdout:5/695: link d0/db3/fe1 d0/d9/d47/dad/ff2 0 2024-02-28T16:27:11.164 INFO:tasks.workunit.client.1.smithi157.stdout:3/618: creat d0/d6/d34/d80/d5c/fca x:0 0 0 2024-02-28T16:27:11.167 INFO:tasks.workunit.client.1.smithi157.stdout:2/747: link da/d38/d3e/c6c da/d38/d4e/d91/ced 0 2024-02-28T16:27:11.167 INFO:tasks.workunit.client.1.smithi157.stdout:3/619: truncate d0/d6/d1e/d5b/fba 182215 0 2024-02-28T16:27:11.169 INFO:tasks.workunit.client.1.smithi157.stdout:9/670: mkdir d0/dc0/de3 0 2024-02-28T16:27:11.173 INFO:tasks.workunit.client.1.smithi157.stdout:0/702: sync 2024-02-28T16:27:11.178 INFO:tasks.workunit.client.1.smithi157.stdout:4/665: link d3/d77/f99 d3/da/d1f/d22/fd2 0 2024-02-28T16:27:11.181 INFO:tasks.workunit.client.1.smithi157.stdout:3/620: mknod d0/d6/d34/d80/d23/d2b/d2e/ccb 0 2024-02-28T16:27:11.183 INFO:tasks.workunit.client.1.smithi157.stdout:7/673: truncate df/d1f/d37/fbb 1011472 0 2024-02-28T16:27:11.184 INFO:tasks.workunit.client.1.smithi157.stdout:9/671: mknod d0/d36/d37/d40/d4b/d96/ce4 0 2024-02-28T16:27:11.186 INFO:tasks.workunit.client.1.smithi157.stdout:8/652: rename d1/d5/d23/l27 to d1/ldf 0 2024-02-28T16:27:11.187 INFO:tasks.workunit.client.1.smithi157.stdout:0/703: creat d1/d8/fed x:0 0 0 2024-02-28T16:27:11.187 INFO:tasks.workunit.client.1.smithi157.stdout:5/696: dwrite d0/d9/d1b/d36/f6c [8388608,4194304] 0 2024-02-28T16:27:11.190 INFO:tasks.workunit.client.1.smithi157.stdout:6/638: rename d2/d7/d8/da/d31/d37/d2b/f3f to d2/d7/d8/da/d31/d59/fb9 0 2024-02-28T16:27:11.190 INFO:tasks.workunit.client.1.smithi157.stdout:8/653: dread - d1/f5f zero size 2024-02-28T16:27:11.191 INFO:tasks.workunit.client.1.smithi157.stdout:2/748: creat da/d38/fee x:0 0 0 2024-02-28T16:27:11.193 INFO:tasks.workunit.client.1.smithi157.stdout:7/674: mknod df/d1f/d24/cd0 0 2024-02-28T16:27:11.199 INFO:tasks.workunit.client.1.smithi157.stdout:4/666: link d3/da/d1f/f7d d3/da/d48/d8e/fd3 0 2024-02-28T16:27:11.200 INFO:tasks.workunit.client.1.smithi157.stdout:8/654: symlink d1/d5/d23/d38/d67/d6d/le0 0 2024-02-28T16:27:11.203 INFO:tasks.workunit.client.1.smithi157.stdout:9/672: rename d0/d19/l9f to d0/d19/d30/d78/le5 0 2024-02-28T16:27:11.207 INFO:tasks.workunit.client.1.smithi157.stdout:6/639: truncate d2/d7/de/d1b/f28 1156765 0 2024-02-28T16:27:11.208 INFO:tasks.workunit.client.1.smithi157.stdout:7/675: dwrite df/d1f/d24/d38/f51 [0,4194304] 0 2024-02-28T16:27:11.208 INFO:tasks.workunit.client.1.smithi157.stdout:6/640: chown d2/d17/f51 977 1 2024-02-28T16:27:11.215 INFO:tasks.workunit.client.1.smithi157.stdout:5/697: fsync d0/d9/d1b/d36/f6c 0 2024-02-28T16:27:11.216 INFO:tasks.workunit.client.1.smithi157.stdout:2/749: rename da/d8c/dc0/fc3 to da/d38/d7e/dbb/fef 0 2024-02-28T16:27:11.217 INFO:tasks.workunit.client.1.smithi157.stdout:9/673: creat d0/d36/dc2/dc8/fe6 x:0 0 0 2024-02-28T16:27:11.218 INFO:tasks.workunit.client.1.smithi157.stdout:2/750: chown da/d38/d4e/d91/f8a 1434700 1 2024-02-28T16:27:11.220 INFO:tasks.workunit.client.1.smithi157.stdout:4/667: creat d3/da/d1f/dc1/dc8/fd4 x:0 0 0 2024-02-28T16:27:11.226 INFO:tasks.workunit.client.1.smithi157.stdout:0/704: dwrite d1/d13/d52/db5/f63 [0,4194304] 0 2024-02-28T16:27:11.228 INFO:tasks.workunit.client.1.smithi157.stdout:9/674: creat d0/d36/d37/d4d/d92/fe7 x:0 0 0 2024-02-28T16:27:11.229 INFO:tasks.workunit.client.1.smithi157.stdout:2/751: mkdir da/d8c/df0 0 2024-02-28T16:27:11.231 INFO:tasks.workunit.client.1.smithi157.stdout:7/676: truncate df/d1f/d24/d39/d64/f74 168127 0 2024-02-28T16:27:11.234 INFO:tasks.workunit.client.1.smithi157.stdout:4/668: creat d3/da/d48/d8e/fd5 x:0 0 0 2024-02-28T16:27:11.235 INFO:tasks.workunit.client.1.smithi157.stdout:5/698: fsync d0/d9/d47/d78/fb9 0 2024-02-28T16:27:11.236 INFO:tasks.workunit.client.1.smithi157.stdout:8/655: truncate d1/d5/d23/f69 1675113 0 2024-02-28T16:27:11.263 INFO:tasks.workunit.client.1.smithi157.stdout:1/642: sync 2024-02-28T16:27:11.274 INFO:tasks.workunit.client.1.smithi157.stdout:9/675: symlink d0/d36/d37/d4d/d92/db9/le8 0 2024-02-28T16:27:11.275 INFO:tasks.workunit.client.1.smithi157.stdout:5/699: write d0/d30/def/d7e/f9a [4910499,117368] 0 2024-02-28T16:27:11.278 INFO:tasks.workunit.client.1.smithi157.stdout:0/705: symlink d1/da/d7d/d98/de2/de9/lee 0 2024-02-28T16:27:11.279 INFO:tasks.workunit.client.1.smithi157.stdout:2/752: mkdir da/d38/df1 0 2024-02-28T16:27:11.280 INFO:tasks.workunit.client.1.smithi157.stdout:5/700: readlink d0/d9/d47/l57 0 2024-02-28T16:27:11.281 INFO:tasks.workunit.client.1.smithi157.stdout:7/677: fsync fb 0 2024-02-28T16:27:11.281 INFO:tasks.workunit.client.1.smithi157.stdout:8/656: symlink d1/d5/d4d/dd6/le1 0 2024-02-28T16:27:11.281 INFO:tasks.workunit.client.1.smithi157.stdout:9/676: chown d0/d19/d30/d78/ld3 3 1 2024-02-28T16:27:11.284 INFO:tasks.workunit.client.1.smithi157.stdout:5/701: rmdir d0/d9/d1b 39 2024-02-28T16:27:11.285 INFO:tasks.workunit.client.1.smithi157.stdout:1/643: link d10/d11/c30 d10/d11/d3a/d5c/d6a/db4/cc9 0 2024-02-28T16:27:11.287 INFO:tasks.workunit.client.1.smithi157.stdout:2/753: unlink da/d38/d5a/d5c/fd5 0 2024-02-28T16:27:11.287 INFO:tasks.workunit.client.1.smithi157.stdout:4/669: dwrite d3/da/d1f/f27 [0,4194304] 0 2024-02-28T16:27:11.296 INFO:tasks.workunit.client.1.smithi157.stdout:0/706: creat d1/da/fef x:0 0 0 2024-02-28T16:27:11.297 INFO:tasks.workunit.client.1.smithi157.stdout:9/677: getdents d0/dc0/de3 0 2024-02-28T16:27:11.297 INFO:tasks.workunit.client.1.smithi157.stdout:4/670: dread d3/da/d37/f78 [0,4194304] 0 2024-02-28T16:27:11.299 INFO:tasks.workunit.client.1.smithi157.stdout:1/644: readlink d10/d11/d3a/d5c/d6c/d6f/l8f 0 2024-02-28T16:27:11.301 INFO:tasks.workunit.client.1.smithi157.stdout:0/707: rmdir d1/d13/d57 39 2024-02-28T16:27:11.303 INFO:tasks.workunit.client.1.smithi157.stdout:1/645: chown d10/d11/d31/d2a/d70/f5b 106423114 1 2024-02-28T16:27:11.303 INFO:tasks.workunit.client.1.smithi157.stdout:2/754: link da/d35/fdd da/d38/d5a/ff2 0 2024-02-28T16:27:11.304 INFO:tasks.workunit.client.1.smithi157.stdout:7/678: link df/d1f/d24/d39/f58 df/fd1 0 2024-02-28T16:27:11.307 INFO:tasks.workunit.client.1.smithi157.stdout:4/671: mknod d3/da/d37/cd6 0 2024-02-28T16:27:11.307 INFO:tasks.workunit.client.1.smithi157.stdout:2/755: fdatasync da/d38/d5a/d69/f95 0 2024-02-28T16:27:11.308 INFO:tasks.workunit.client.1.smithi157.stdout:9/678: truncate d0/d36/f86 422508 0 2024-02-28T16:27:11.310 INFO:tasks.workunit.client.1.smithi157.stdout:5/702: dwrite d0/d9/d47/f6d [0,4194304] 0 2024-02-28T16:27:11.312 INFO:tasks.workunit.client.1.smithi157.stdout:0/708: dread - d1/d8/d33/d96/fa7 zero size 2024-02-28T16:27:11.315 INFO:tasks.workunit.client.1.smithi157.stdout:9/679: readlink d0/d19/l94 0 2024-02-28T16:27:11.316 INFO:tasks.workunit.client.1.smithi157.stdout:5/703: symlink d0/db3/lf3 0 2024-02-28T16:27:11.321 INFO:tasks.workunit.client.1.smithi157.stdout:2/756: link da/f2c da/d38/d3e/d9b/ff3 0 2024-02-28T16:27:11.326 INFO:tasks.workunit.client.1.smithi157.stdout:0/709: creat d1/d8/d27/ff0 x:0 0 0 2024-02-28T16:27:11.327 INFO:tasks.workunit.client.1.smithi157.stdout:7/679: link df/d1f/d24/d4f/c8e df/d1f/cd2 0 2024-02-28T16:27:11.329 INFO:tasks.workunit.client.1.smithi157.stdout:1/646: dwrite d10/d11/d3a/d5c/d6c/d7b/f1e [4194304,4194304] 0 2024-02-28T16:27:11.329 INFO:tasks.workunit.client.1.smithi157.stdout:9/680: rename d0/d36/d37/lb4 to d0/d36/d37/d40/d4b/le9 0 2024-02-28T16:27:11.329 INFO:tasks.workunit.client.1.smithi157.stdout:5/704: mkdir d0/d9/d47/d5b/df4 0 2024-02-28T16:27:11.330 INFO:tasks.workunit.client.1.smithi157.stdout:2/757: mkdir da/d38/df1/df4 0 2024-02-28T16:27:11.332 INFO:tasks.workunit.client.1.smithi157.stdout:8/657: dread d1/f2c [8388608,4194304] 0 2024-02-28T16:27:11.340 INFO:tasks.workunit.client.1.smithi157.stdout:4/672: dwrite d3/d77/f62 [0,4194304] 0 2024-02-28T16:27:11.341 INFO:tasks.workunit.client.1.smithi157.stdout:2/758: symlink da/lf5 0 2024-02-28T16:27:11.342 INFO:tasks.workunit.client.1.smithi157.stdout:4/673: chown d3/d77/daa 0 1 2024-02-28T16:27:11.342 INFO:tasks.workunit.client.1.smithi157.stdout:2/759: write da/f24 [697933,79280] 0 2024-02-28T16:27:11.343 INFO:tasks.workunit.client.1.smithi157.stdout:1/647: fsync d10/d11/d3a/d5c/d6c/d7b/f45 0 2024-02-28T16:27:11.347 INFO:tasks.workunit.client.1.smithi157.stdout:0/710: rename d1/f2 to d1/da/ff1 0 2024-02-28T16:27:11.348 INFO:tasks.workunit.client.1.smithi157.stdout:1/648: dread d10/d11/d31/d2a/d70/f96 [0,4194304] 0 2024-02-28T16:27:11.348 INFO:tasks.workunit.client.1.smithi157.stdout:0/711: readlink d1/da/d6c/le4 0 2024-02-28T16:27:11.349 INFO:tasks.workunit.client.1.smithi157.stdout:3/621: sync 2024-02-28T16:27:11.349 INFO:tasks.workunit.client.1.smithi157.stdout:1/649: readlink d10/d11/d22/l47 0 2024-02-28T16:27:11.350 INFO:tasks.workunit.client.1.smithi157.stdout:0/712: chown d1/cb 2619870 1 2024-02-28T16:27:11.351 INFO:tasks.workunit.client.1.smithi157.stdout:8/658: symlink d1/d5/dd8/le2 0 2024-02-28T16:27:11.353 INFO:tasks.workunit.client.1.smithi157.stdout:9/681: write d0/d36/d37/d4d/f53 [4520787,90657] 0 2024-02-28T16:27:11.354 INFO:tasks.workunit.client.1.smithi157.stdout:5/705: write d0/d9/d47/f4e [89779,91356] 0 2024-02-28T16:27:11.359 INFO:tasks.workunit.client.1.smithi157.stdout:7/680: dwrite df/d1f/d24/d4f/d72/f94 [0,4194304] 0 2024-02-28T16:27:11.360 INFO:tasks.workunit.client.1.smithi157.stdout:2/760: creat da/d35/ff6 x:0 0 0 2024-02-28T16:27:11.378 INFO:tasks.workunit.client.1.smithi157.stdout:0/713: mknod d1/da/d7d/dc4/cf2 0 2024-02-28T16:27:11.380 INFO:tasks.workunit.client.1.smithi157.stdout:8/659: creat d1/d5/d23/da1/dd3/fe3 x:0 0 0 2024-02-28T16:27:11.380 INFO:tasks.workunit.client.1.smithi157.stdout:4/674: write d3/da/d48/d8e/fd3 [315259,83084] 0 2024-02-28T16:27:11.386 INFO:tasks.workunit.client.1.smithi157.stdout:4/675: dread d3/da/d28/f39 [0,4194304] 0 2024-02-28T16:27:11.386 INFO:tasks.workunit.client.1.smithi157.stdout:3/622: dwrite d0/d6/f3d [0,4194304] 0 2024-02-28T16:27:11.389 INFO:tasks.workunit.client.1.smithi157.stdout:7/681: creat df/d25/da7/fd3 x:0 0 0 2024-02-28T16:27:11.417 INFO:tasks.workunit.client.1.smithi157.stdout:2/761: creat da/d38/df1/ff7 x:0 0 0 2024-02-28T16:27:11.418 INFO:tasks.workunit.client.1.smithi157.stdout:1/650: mknod d10/d11/d3a/d5c/dc1/cca 0 2024-02-28T16:27:11.419 INFO:tasks.workunit.client.1.smithi157.stdout:5/706: getdents d0/d30/def/d90 0 2024-02-28T16:27:11.421 INFO:tasks.workunit.client.1.smithi157.stdout:7/682: dread - df/d1f/d37/d46/fb2 zero size 2024-02-28T16:27:11.422 INFO:tasks.workunit.client.1.smithi157.stdout:9/682: truncate d0/d36/d37/f67 702788 0 2024-02-28T16:27:11.423 INFO:tasks.workunit.client.1.smithi157.stdout:2/762: mkdir da/d8c/dc0/df8 0 2024-02-28T16:27:11.424 INFO:tasks.workunit.client.1.smithi157.stdout:4/676: symlink d3/da/d1f/ld7 0 2024-02-28T16:27:11.424 INFO:tasks.workunit.client.1.smithi157.stdout:2/763: chown da/d2b 0 1 2024-02-28T16:27:11.426 INFO:tasks.workunit.client.1.smithi157.stdout:7/683: read df/d40/f78 [21206,115615] 0 2024-02-28T16:27:11.428 INFO:tasks.workunit.client.1.smithi157.stdout:2/764: write da/d38/fee [609077,124293] 0 2024-02-28T16:27:11.428 INFO:tasks.workunit.client.1.smithi157.stdout:5/707: fsync d0/d9/f48 0 2024-02-28T16:27:11.429 INFO:tasks.workunit.client.1.smithi157.stdout:1/651: mkdir d10/d11/d31/dcb 0 2024-02-28T16:27:11.431 INFO:tasks.workunit.client.1.smithi157.stdout:9/683: mkdir d0/d36/dc2/dc8/dea 0 2024-02-28T16:27:11.432 INFO:tasks.workunit.client.1.smithi157.stdout:4/677: symlink d3/da/d1f/d22/ld8 0 2024-02-28T16:27:11.433 INFO:tasks.workunit.client.1.smithi157.stdout:2/765: write da/d2b/f3d [3079647,74756] 0 2024-02-28T16:27:11.436 INFO:tasks.workunit.client.1.smithi157.stdout:1/652: dread - d10/d11/d3a/d5c/d6a/db4/d91/f93 zero size 2024-02-28T16:27:11.436 INFO:tasks.workunit.client.1.smithi157.stdout:9/684: read d0/f21 [1068646,107603] 0 2024-02-28T16:27:11.438 INFO:tasks.workunit.client.1.smithi157.stdout:7/684: dread df/d1f/d24/d38/f57 [0,4194304] 0 2024-02-28T16:27:11.440 INFO:tasks.workunit.client.1.smithi157.stdout:2/766: write da/d8c/dc0/fe8 [380873,121965] 0 2024-02-28T16:27:11.442 INFO:tasks.workunit.client.1.smithi157.stdout:7/685: chown df/d1f/d24 211 1 2024-02-28T16:27:11.444 INFO:tasks.workunit.client.1.smithi157.stdout:8/660: dwrite d1/d5/dd8/f84 [0,4194304] 0 2024-02-28T16:27:11.448 INFO:tasks.workunit.client.1.smithi157.stdout:3/623: dwrite d0/d6/d44/d70/f8b [0,4194304] 0 2024-02-28T16:27:11.448 INFO:tasks.workunit.client.1.smithi157.stdout:4/678: rename d3/da/d28/f5b to d3/d8b/fd9 0 2024-02-28T16:27:11.450 INFO:tasks.workunit.client.1.smithi157.stdout:2/767: chown da/d47/dca/ld3 149 1 2024-02-28T16:27:11.451 INFO:tasks.workunit.client.1.smithi157.stdout:9/685: read - d0/d36/d3f/f76 zero size 2024-02-28T16:27:11.452 INFO:tasks.workunit.client.1.smithi157.stdout:2/768: write da/d35/f8b [8908270,89439] 0 2024-02-28T16:27:11.459 INFO:tasks.workunit.client.1.smithi157.stdout:9/686: readlink d0/d36/d37/d40/d5b/dba/ldd 0 2024-02-28T16:27:11.459 INFO:tasks.workunit.client.1.smithi157.stdout:4/679: fsync d3/d77/f99 0 2024-02-28T16:27:11.465 INFO:tasks.workunit.client.1.smithi157.stdout:7/686: creat df/d1f/d24/d39/fd4 x:0 0 0 2024-02-28T16:27:11.466 INFO:tasks.workunit.client.1.smithi157.stdout:9/687: chown d0/d36/d37/d40/d4b/lb2 5 1 2024-02-28T16:27:11.466 INFO:tasks.workunit.client.1.smithi157.stdout:6/641: sync 2024-02-28T16:27:11.467 INFO:tasks.workunit.client.1.smithi157.stdout:2/769: symlink da/d38/d5a/lf9 0 2024-02-28T16:27:11.470 INFO:tasks.workunit.client.1.smithi157.stdout:4/680: symlink d3/d8b/lda 0 2024-02-28T16:27:11.471 INFO:tasks.workunit.client.1.smithi157.stdout:5/708: dwrite d0/d30/da0/dd5/fea [4194304,4194304] 0 2024-02-28T16:27:11.474 INFO:tasks.workunit.client.1.smithi157.stdout:1/653: dwrite d10/d11/d3a/d5c/d6c/d7b/f9d [0,4194304] 0 2024-02-28T16:27:11.478 INFO:tasks.workunit.client.1.smithi157.stdout:7/687: read df/d25/d79/d9a/fa3 [229131,21628] 0 2024-02-28T16:27:11.478 INFO:tasks.workunit.client.1.smithi157.stdout:4/681: rmdir d3/da/d37/d71 39 2024-02-28T16:27:11.479 INFO:tasks.workunit.client.1.smithi157.stdout:9/688: symlink d0/d36/d37/d40/d5b/leb 0 2024-02-28T16:27:11.481 INFO:tasks.workunit.client.1.smithi157.stdout:8/661: dwrite d1/d5/dd8/d52/d54/fc3 [0,4194304] 0 2024-02-28T16:27:11.482 INFO:tasks.workunit.client.1.smithi157.stdout:2/770: link da/f46 da/d35/ffa 0 2024-02-28T16:27:11.484 INFO:tasks.workunit.client.1.smithi157.stdout:4/682: chown d3/da/d37/cd6 497 1 2024-02-28T16:27:11.486 INFO:tasks.workunit.client.1.smithi157.stdout:8/662: chown d1/d5/dd8/l61 82003 1 2024-02-28T16:27:11.486 INFO:tasks.workunit.client.1.smithi157.stdout:5/709: rename d0/d9/d3a/l6f to d0/d30/da0/dd5/lf5 0 2024-02-28T16:27:11.488 INFO:tasks.workunit.client.1.smithi157.stdout:3/624: truncate d0/d6/d34/d80/d23/d2b/f57 2814738 0 2024-02-28T16:27:11.490 INFO:tasks.workunit.client.1.smithi157.stdout:7/688: mknod df/d25/cd5 0 2024-02-28T16:27:11.491 INFO:tasks.workunit.client.1.smithi157.stdout:0/714: sync 2024-02-28T16:27:11.491 INFO:tasks.workunit.client.1.smithi157.stdout:9/689: creat d0/d19/d30/d78/fec x:0 0 0 2024-02-28T16:27:11.499 INFO:tasks.workunit.client.1.smithi157.stdout:2/771: rmdir da/d38 39 2024-02-28T16:27:11.502 INFO:tasks.workunit.client.1.smithi157.stdout:6/642: rename d2/d7/d8/da/d71/d8f/f3e to d2/d7/de/d1b/fba 0 2024-02-28T16:27:11.503 INFO:tasks.workunit.client.1.smithi157.stdout:6/643: stat d2/d7/de/d1b/d3d/da4/d8c 0 2024-02-28T16:27:11.503 INFO:tasks.workunit.client.1.smithi157.stdout:8/663: mkdir d1/d5/d4d/d60/de4 0 2024-02-28T16:27:11.505 INFO:tasks.workunit.client.1.smithi157.stdout:8/664: fsync d1/d5/d23/d53/f76 0 2024-02-28T16:27:11.506 INFO:tasks.workunit.client.1.smithi157.stdout:3/625: rmdir d0/d6/d34/d80/d5c 39 2024-02-28T16:27:11.508 INFO:tasks.workunit.client.1.smithi157.stdout:0/715: rmdir d1/da 39 2024-02-28T16:27:11.510 INFO:tasks.workunit.client.1.smithi157.stdout:7/689: mkdir df/d1f/d24/d4f/d72/dab/dd6 0 2024-02-28T16:27:11.512 INFO:tasks.workunit.client.1.smithi157.stdout:9/690: creat d0/dc0/fed x:0 0 0 2024-02-28T16:27:11.513 INFO:tasks.workunit.client.1.smithi157.stdout:7/690: write df/d1f/d24/f99 [798990,50721] 0 2024-02-28T16:27:11.513 INFO:tasks.workunit.client.1.smithi157.stdout:2/772: readlink da/l21 0 2024-02-28T16:27:11.514 INFO:tasks.workunit.client.1.smithi157.stdout:1/654: link d10/d11/c75 d10/d11/d3a/d5c/d6c/ccc 0 2024-02-28T16:27:11.515 INFO:tasks.workunit.client.1.smithi157.stdout:7/691: dread - df/d25/da7/fbd zero size 2024-02-28T16:27:11.520 INFO:tasks.workunit.client.1.smithi157.stdout:6/644: rename d2/d7/d92/d9d/caa to d2/d7/d8/da/d71/d80/cbb 0 2024-02-28T16:27:11.525 INFO:tasks.workunit.client.1.smithi157.stdout:4/683: dwrite d3/da/d48/d8e/f95 [0,4194304] 0 2024-02-28T16:27:11.527 INFO:tasks.workunit.client.1.smithi157.stdout:3/626: dwrite d0/d6/d34/d80/d23/d2b/d2e/fc4 [0,4194304] 0 2024-02-28T16:27:11.531 INFO:tasks.workunit.client.1.smithi157.stdout:7/692: creat df/d1f/d24/d4f/d72/fd7 x:0 0 0 2024-02-28T16:27:11.536 INFO:tasks.workunit.client.1.smithi157.stdout:5/710: dwrite d0/d9/d47/dad/ff2 [4194304,4194304] 0 2024-02-28T16:27:11.539 INFO:tasks.workunit.client.1.smithi157.stdout:9/691: mknod d0/d36/d37/d4d/cee 0 2024-02-28T16:27:11.541 INFO:tasks.workunit.client.1.smithi157.stdout:5/711: chown d0/d9/d47/d5b/d89/d75 583532 1 2024-02-28T16:27:11.542 INFO:tasks.workunit.client.1.smithi157.stdout:6/645: mknod d2/d7/d8/da/d31/d37/d2b/d99/cbc 0 2024-02-28T16:27:11.542 INFO:tasks.workunit.client.1.smithi157.stdout:1/655: symlink d10/d11/d7e/lcd 0 2024-02-28T16:27:11.543 INFO:tasks.workunit.client.1.smithi157.stdout:5/712: stat d0/d30/def/c45 0 2024-02-28T16:27:11.543 INFO:tasks.workunit.client.1.smithi157.stdout:7/693: fsync fd 0 2024-02-28T16:27:11.549 INFO:tasks.workunit.client.1.smithi157.stdout:0/716: getdents d1/d8/d27/d55 0 2024-02-28T16:27:11.554 INFO:tasks.workunit.client.1.smithi157.stdout:7/694: chown df/d1f/d24/d38/f57 3588 1 2024-02-28T16:27:11.555 INFO:tasks.workunit.client.1.smithi157.stdout:0/717: chown d1/d13/d52/db5/d8e 520724 1 2024-02-28T16:27:11.556 INFO:tasks.workunit.client.1.smithi157.stdout:6/646: creat d2/d7/de/d1b/d3d/da4/d8c/fbd x:0 0 0 2024-02-28T16:27:11.556 INFO:tasks.workunit.client.1.smithi157.stdout:8/665: dread d1/f3c [0,4194304] 0 2024-02-28T16:27:11.559 INFO:tasks.workunit.client.1.smithi157.stdout:3/627: dwrite d0/d6/d6b/d75/fc0 [0,4194304] 0 2024-02-28T16:27:11.562 INFO:tasks.workunit.client.1.smithi157.stdout:3/628: stat d0/d6/d34/d80/d23/c64 0 2024-02-28T16:27:11.562 INFO:tasks.workunit.client.1.smithi157.stdout:2/773: dwrite da/d38/d5a/d79/fb3 [0,4194304] 0 2024-02-28T16:27:11.562 INFO:tasks.workunit.client.1.smithi157.stdout:5/713: mknod d0/d9/d47/dad/db4/cf6 0 2024-02-28T16:27:11.566 INFO:tasks.workunit.client.1.smithi157.stdout:1/656: creat d10/d11/d31/fce x:0 0 0 2024-02-28T16:27:11.566 INFO:tasks.workunit.client.1.smithi157.stdout:0/718: fsync d1/d13/f87 0 2024-02-28T16:27:11.566 INFO:tasks.workunit.client.1.smithi157.stdout:9/692: link d0/d36/l45 d0/d36/d37/d4d/lef 0 2024-02-28T16:27:11.567 INFO:tasks.workunit.client.1.smithi157.stdout:6/647: rmdir d2/d7/d8/da/d71 39 2024-02-28T16:27:11.568 INFO:tasks.workunit.client.1.smithi157.stdout:0/719: readlink d1/d13/d46/lda 0 2024-02-28T16:27:11.571 INFO:tasks.workunit.client.1.smithi157.stdout:8/666: write d1/d5/d43/d86/f97 [643962,68531] 0 2024-02-28T16:27:11.571 INFO:tasks.workunit.client.1.smithi157.stdout:3/629: unlink d0/d6/d6b/d9e/fa2 0 2024-02-28T16:27:11.573 INFO:tasks.workunit.client.1.smithi157.stdout:5/714: creat d0/d9/d3a/ff7 x:0 0 0 2024-02-28T16:27:11.576 INFO:tasks.workunit.client.1.smithi157.stdout:2/774: chown da/d38/d5a/d79/fb3 39 1 2024-02-28T16:27:11.577 INFO:tasks.workunit.client.1.smithi157.stdout:0/720: rmdir d1/d13/d52/db5 39 2024-02-28T16:27:11.580 INFO:tasks.workunit.client.1.smithi157.stdout:8/667: creat d1/fe5 x:0 0 0 2024-02-28T16:27:11.583 INFO:tasks.workunit.client.1.smithi157.stdout:8/668: chown d1/f2 26839273 1 2024-02-28T16:27:11.583 INFO:tasks.workunit.client.1.smithi157.stdout:2/775: chown da/d38/c85 60115 1 2024-02-28T16:27:11.584 INFO:tasks.workunit.client.1.smithi157.stdout:6/648: truncate d2/d7/de/d1b/d4d/d6c/d9a/fb2 562118 0 2024-02-28T16:27:11.589 INFO:tasks.workunit.client.1.smithi157.stdout:5/715: truncate d0/d9/d3a/ff7 4014 0 2024-02-28T16:27:11.592 INFO:tasks.workunit.client.1.smithi157.stdout:6/649: fdatasync d2/d17/f34 0 2024-02-28T16:27:11.593 INFO:tasks.workunit.client.1.smithi157.stdout:0/721: creat d1/d13/d52/db5/ff3 x:0 0 0 2024-02-28T16:27:11.598 INFO:tasks.workunit.client.1.smithi157.stdout:5/716: truncate d0/d30/d50/fae 497015 0 2024-02-28T16:27:11.599 INFO:tasks.workunit.client.1.smithi157.stdout:0/722: mkdir d1/da/d6c/df4 0 2024-02-28T16:27:11.599 INFO:tasks.workunit.client.1.smithi157.stdout:4/684: dread d3/da/d37/d71/f9d [0,4194304] 0 2024-02-28T16:27:11.600 INFO:tasks.workunit.client.1.smithi157.stdout:1/657: dread d10/d11/d3a/d5c/d6c/d7b/f5e [0,4194304] 0 2024-02-28T16:27:11.601 INFO:tasks.workunit.client.1.smithi157.stdout:8/669: link d1/d5/dd8/c82 d1/d5/d10/ce6 0 2024-02-28T16:27:11.602 INFO:tasks.workunit.client.1.smithi157.stdout:5/717: chown d0/l4b 7 1 2024-02-28T16:27:11.602 INFO:tasks.workunit.client.1.smithi157.stdout:0/723: fdatasync d1/da/f2f 0 2024-02-28T16:27:11.604 INFO:tasks.workunit.client.1.smithi157.stdout:4/685: chown d3/da/d1f/f27 1 1 2024-02-28T16:27:11.604 INFO:tasks.workunit.client.1.smithi157.stdout:7/695: dread df/fd1 [0,4194304] 0 2024-02-28T16:27:11.604 INFO:tasks.workunit.client.1.smithi157.stdout:9/693: dwrite d0/d36/d37/d40/d5b/dba/fd2 [0,4194304] 0 2024-02-28T16:27:11.608 INFO:tasks.workunit.client.1.smithi157.stdout:5/718: chown d0/d30/da0/dd5/cdb 88 1 2024-02-28T16:27:11.611 INFO:tasks.workunit.client.1.smithi157.stdout:0/724: truncate d1/d8/d27/ff0 55527 0 2024-02-28T16:27:11.613 INFO:tasks.workunit.client.1.smithi157.stdout:7/696: fsync df/f60 0 2024-02-28T16:27:11.613 INFO:tasks.workunit.client.1.smithi157.stdout:8/670: truncate d1/d5/d23/d53/f8e 261815 0 2024-02-28T16:27:11.615 INFO:tasks.workunit.client.1.smithi157.stdout:9/694: fsync d0/d36/d37/d4d/d92/fe0 0 2024-02-28T16:27:11.615 INFO:tasks.workunit.client.1.smithi157.stdout:3/630: dwrite d0/d6/d44/d8e/da8/fb7 [0,4194304] 0 2024-02-28T16:27:11.617 INFO:tasks.workunit.client.1.smithi157.stdout:0/725: truncate d1/d8/fed 127600 0 2024-02-28T16:27:11.618 INFO:tasks.workunit.client.1.smithi157.stdout:5/719: creat d0/d30/def/d7e/d82/ff8 x:0 0 0 2024-02-28T16:27:11.618 INFO:tasks.workunit.client.1.smithi157.stdout:1/658: dread d10/d11/d31/f3d [0,4194304] 0 2024-02-28T16:27:11.619 INFO:tasks.workunit.client.1.smithi157.stdout:8/671: write d1/d5/d23/d53/f9a [971946,79702] 0 2024-02-28T16:27:11.632 INFO:tasks.workunit.client.1.smithi157.stdout:5/720: readlink d0/d9/d47/d5b/d89/ld3 0 2024-02-28T16:27:11.632 INFO:tasks.workunit.client.1.smithi157.stdout:8/672: read d1/d5/d23/d38/f48 [1597715,65873] 0 2024-02-28T16:27:11.634 INFO:tasks.workunit.client.1.smithi157.stdout:5/721: write d0/f5a [5049287,117008] 0 2024-02-28T16:27:11.641 INFO:tasks.workunit.client.1.smithi157.stdout:4/686: dwrite d3/f33 [0,4194304] 0 2024-02-28T16:27:11.641 INFO:tasks.workunit.client.1.smithi157.stdout:8/673: chown d1/d5/d43/d86/f97 3 1 2024-02-28T16:27:11.641 INFO:tasks.workunit.client.1.smithi157.stdout:3/631: rename d0/d6/d34/d80/d23/d2b/d2e/d7e/f92 to d0/d6/d34/d80/d5c/d99/fcc 0 2024-02-28T16:27:11.644 INFO:tasks.workunit.client.1.smithi157.stdout:7/697: getdents df/d80/d84 0 2024-02-28T16:27:11.644 INFO:tasks.workunit.client.1.smithi157.stdout:3/632: write d0/d6/d1e/f76 [4109309,28203] 0 2024-02-28T16:27:11.645 INFO:tasks.workunit.client.1.smithi157.stdout:9/695: dwrite d0/d36/d37/d40/d5b/dba/fd2 [0,4194304] 0 2024-02-28T16:27:11.647 INFO:tasks.workunit.client.1.smithi157.stdout:4/687: symlink d3/d77/ldb 0 2024-02-28T16:27:11.648 INFO:tasks.workunit.client.1.smithi157.stdout:8/674: mknod d1/d5/dd8/ce7 0 2024-02-28T16:27:11.650 INFO:tasks.workunit.client.1.smithi157.stdout:0/726: getdents d1/da/d7d 0 2024-02-28T16:27:11.653 INFO:tasks.workunit.client.1.smithi157.stdout:7/698: creat df/d25/d79/d9e/fd8 x:0 0 0 2024-02-28T16:27:11.654 INFO:tasks.workunit.client.1.smithi157.stdout:3/633: read d0/d6/d44/d70/d71/d87/f95 [1133192,64814] 0 2024-02-28T16:27:11.654 INFO:tasks.workunit.client.1.smithi157.stdout:8/675: fdatasync d1/d5/d23/da1/dd3/fe3 0 2024-02-28T16:27:11.656 INFO:tasks.workunit.client.1.smithi157.stdout:5/722: dwrite d0/d9/d47/dad/f8e [0,4194304] 0 2024-02-28T16:27:11.658 INFO:tasks.workunit.client.1.smithi157.stdout:0/727: mkdir d1/d8/df5 0 2024-02-28T16:27:11.658 INFO:tasks.workunit.client.1.smithi157.stdout:4/688: mkdir d3/da/d48/d4a/db7/ddc 0 2024-02-28T16:27:11.661 INFO:tasks.workunit.client.1.smithi157.stdout:8/676: truncate d1/d5/d23/d53/fdd 200537 0 2024-02-28T16:27:11.662 INFO:tasks.workunit.client.1.smithi157.stdout:8/677: stat d1/d5/dd8/fb1 0 2024-02-28T16:27:11.665 INFO:tasks.workunit.client.1.smithi157.stdout:1/659: dread d10/d94/fb3 [0,4194304] 0 2024-02-28T16:27:11.669 INFO:tasks.workunit.client.1.smithi157.stdout:3/634: creat d0/d6/d34/d80/d23/d2b/d2e/d7e/fcd x:0 0 0 2024-02-28T16:27:11.672 INFO:tasks.workunit.client.1.smithi157.stdout:7/699: link df/d1f/d24/la0 df/d1f/d24/ld9 0 2024-02-28T16:27:11.672 INFO:tasks.workunit.client.1.smithi157.stdout:1/660: creat d10/d11/d31/d7f/fcf x:0 0 0 2024-02-28T16:27:11.675 INFO:tasks.workunit.client.1.smithi157.stdout:1/661: write f4 [4878730,3395] 0 2024-02-28T16:27:11.676 INFO:tasks.workunit.client.1.smithi157.stdout:5/723: getdents d0/d30/da0/dd5 0 2024-02-28T16:27:11.677 INFO:tasks.workunit.client.1.smithi157.stdout:8/678: link d1/d5/dd8/d52/d54/cd4 d1/d5/d23/dbd/dc9/ce8 0 2024-02-28T16:27:11.678 INFO:tasks.workunit.client.1.smithi157.stdout:1/662: stat d10/d11/d31/d2a/f64 0 2024-02-28T16:27:11.678 INFO:tasks.workunit.client.1.smithi157.stdout:7/700: write df/d1f/d24/d4f/d72/f94 [4937724,120733] 0 2024-02-28T16:27:11.681 INFO:tasks.workunit.client.1.smithi157.stdout:8/679: chown d1/c26 1935367 1 2024-02-28T16:27:11.681 INFO:tasks.workunit.client.1.smithi157.stdout:9/696: dread d0/d36/d37/d4d/d92/db9/fc7 [0,4194304] 0 2024-02-28T16:27:11.682 INFO:tasks.workunit.client.1.smithi157.stdout:7/701: write df/d1f/d37/d46/f5b [595820,125719] 0 2024-02-28T16:27:11.682 INFO:tasks.workunit.client.1.smithi157.stdout:5/724: write d0/d30/def/d7e/f9a [5552260,43645] 0 2024-02-28T16:27:11.684 INFO:tasks.workunit.client.1.smithi157.stdout:4/689: write d3/da/f35 [4111234,115278] 0 2024-02-28T16:27:11.685 INFO:tasks.workunit.client.1.smithi157.stdout:9/697: write d0/d19/d30/f32 [5443152,63714] 0 2024-02-28T16:27:11.685 INFO:tasks.workunit.client.1.smithi157.stdout:1/663: mknod d10/d11/d3a/d95/cd0 0 2024-02-28T16:27:11.688 INFO:tasks.workunit.client.1.smithi157.stdout:1/664: chown d10/c8d 820007865 1 2024-02-28T16:27:11.689 INFO:tasks.workunit.client.1.smithi157.stdout:4/690: readlink d3/da/d37/d71/db0/lba 0 2024-02-28T16:27:11.692 INFO:tasks.workunit.client.1.smithi157.stdout:4/691: write d3/da/d48/d8e/f95 [2334111,100904] 0 2024-02-28T16:27:11.693 INFO:tasks.workunit.client.1.smithi157.stdout:9/698: read d0/f12 [3996076,27149] 0 2024-02-28T16:27:11.695 INFO:tasks.workunit.client.1.smithi157.stdout:1/665: mkdir d10/da0/db6/dd1 0 2024-02-28T16:27:11.697 INFO:tasks.workunit.client.1.smithi157.stdout:4/692: read d3/d77/f62 [909065,30425] 0 2024-02-28T16:27:11.699 INFO:tasks.workunit.client.1.smithi157.stdout:9/699: chown d0/c34 1 1 2024-02-28T16:27:11.701 INFO:tasks.workunit.client.1.smithi157.stdout:1/666: rmdir d10/d11/d3a/d5c/d84 39 2024-02-28T16:27:11.702 INFO:tasks.workunit.client.1.smithi157.stdout:3/635: dwrite d0/d6/d34/d80/d23/f50 [0,4194304] 0 2024-02-28T16:27:11.704 INFO:tasks.workunit.client.1.smithi157.stdout:1/667: write d10/f12 [2806451,27541] 0 2024-02-28T16:27:11.706 INFO:tasks.workunit.client.1.smithi157.stdout:4/693: creat d3/da/d48/d4a/fdd x:0 0 0 2024-02-28T16:27:11.708 INFO:tasks.workunit.client.1.smithi157.stdout:5/725: dwrite d0/db3/fe1 [0,4194304] 0 2024-02-28T16:27:11.709 INFO:tasks.workunit.client.1.smithi157.stdout:3/636: fsync d0/fa3 0 2024-02-28T16:27:11.709 INFO:tasks.workunit.client.1.smithi157.stdout:1/668: stat d10/d11/d31/d2a/d70/l4a 0 2024-02-28T16:27:11.711 INFO:tasks.workunit.client.1.smithi157.stdout:8/680: dwrite d1/f5f [0,4194304] 0 2024-02-28T16:27:11.715 INFO:tasks.workunit.client.1.smithi157.stdout:4/694: truncate d3/da/f4f 289662 0 2024-02-28T16:27:11.717 INFO:tasks.workunit.client.1.smithi157.stdout:3/637: write d0/d6/d44/f52 [949489,83428] 0 2024-02-28T16:27:11.719 INFO:tasks.workunit.client.1.smithi157.stdout:3/638: chown d0/d6/d1e/d5b/fba 1371 1 2024-02-28T16:27:11.723 INFO:tasks.workunit.client.1.smithi157.stdout:1/669: mkdir d10/d11/d22/d99/dbf/dd2 0 2024-02-28T16:27:11.723 INFO:tasks.workunit.client.1.smithi157.stdout:4/695: mkdir d3/da/d1f/dc1/dde 0 2024-02-28T16:27:11.752 INFO:tasks.workunit.client.1.smithi157.stdout:6/650: sync 2024-02-28T16:27:11.752 INFO:tasks.workunit.client.1.smithi157.stdout:2/776: sync 2024-02-28T16:27:11.756 INFO:tasks.workunit.client.1.smithi157.stdout:3/639: fsync d0/d6/d1e/f1f 0 2024-02-28T16:27:11.756 INFO:tasks.workunit.client.1.smithi157.stdout:8/681: write d1/d5/dd8/d52/d54/f5d [552116,9804] 0 2024-02-28T16:27:11.760 INFO:tasks.workunit.client.1.smithi157.stdout:4/696: read d3/da/d1f/d22/f8d [3320817,96852] 0 2024-02-28T16:27:11.762 INFO:tasks.workunit.client.1.smithi157.stdout:2/777: mknod da/d38/d3e/cfb 0 2024-02-28T16:27:11.763 INFO:tasks.workunit.client.1.smithi157.stdout:4/697: readlink d3/da/d37/l69 0 2024-02-28T16:27:11.766 INFO:tasks.workunit.client.1.smithi157.stdout:4/698: readlink d3/da/d37/l81 0 2024-02-28T16:27:11.766 INFO:tasks.workunit.client.1.smithi157.stdout:9/700: dread d0/d19/d30/d78/f7e [0,4194304] 0 2024-02-28T16:27:11.767 INFO:tasks.workunit.client.1.smithi157.stdout:1/670: truncate d10/d11/d3a/d5c/d6a/db4/d91/f93 1030624 0 2024-02-28T16:27:11.768 INFO:tasks.workunit.client.1.smithi157.stdout:6/651: getdents d2/d7/de/d1b 0 2024-02-28T16:27:11.777 INFO:tasks.workunit.client.1.smithi157.stdout:6/652: write d2/d7/de/d1b/d3d/da4/f60 [2638653,77698] 0 2024-02-28T16:27:11.779 INFO:tasks.workunit.client.1.smithi157.stdout:6/653: chown d2/fa3 2432 1 2024-02-28T16:27:11.782 INFO:tasks.workunit.client.1.smithi157.stdout:6/654: write d2/f5 [4754938,34903] 0 2024-02-28T16:27:11.783 INFO:tasks.workunit.client.1.smithi157.stdout:1/671: rename d10/d11/l15 to d10/da0/ld3 0 2024-02-28T16:27:11.789 INFO:tasks.workunit.client.1.smithi157.stdout:2/778: link da/d47/dbd/dde/f43 da/d38/d4e/d91/ffc 0 2024-02-28T16:27:11.796 INFO:tasks.workunit.client.1.smithi157.stdout:4/699: dwrite d3/da/d48/f7c [0,4194304] 0 2024-02-28T16:27:11.806 INFO:tasks.workunit.client.1.smithi157.stdout:1/672: mkdir d10/d11/d3a/d5c/d84/dd4 0 2024-02-28T16:27:11.810 INFO:tasks.workunit.client.1.smithi157.stdout:1/673: write d10/d11/d3a/d5c/d6a/fa6 [3918761,123999] 0 2024-02-28T16:27:11.810 INFO:tasks.workunit.client.1.smithi157.stdout:2/779: symlink da/d38/df1/df4/lfd 0 2024-02-28T16:27:11.811 INFO:tasks.workunit.client.1.smithi157.stdout:9/701: rename d0/cb3 to d0/d36/d37/d40/cf0 0 2024-02-28T16:27:11.811 INFO:tasks.workunit.client.1.smithi157.stdout:1/674: chown d10/d11/c8b 57554967 1 2024-02-28T16:27:11.815 INFO:tasks.workunit.client.1.smithi157.stdout:4/700: mknod d3/da/d48/d8e/db1/cdf 0 2024-02-28T16:27:11.816 INFO:tasks.workunit.client.1.smithi157.stdout:1/675: write d10/d11/d3a/d5c/d6c/d7b/d8c/fa2 [785319,64349] 0 2024-02-28T16:27:11.818 INFO:tasks.workunit.client.1.smithi157.stdout:0/728: sync 2024-02-28T16:27:11.818 INFO:tasks.workunit.client.1.smithi157.stdout:5/726: sync 2024-02-28T16:27:11.818 INFO:tasks.workunit.client.1.smithi157.stdout:7/702: sync 2024-02-28T16:27:11.822 INFO:tasks.workunit.client.1.smithi157.stdout:4/701: creat d3/da/d48/d4a/fe0 x:0 0 0 2024-02-28T16:27:11.825 INFO:tasks.workunit.client.1.smithi157.stdout:2/780: creat da/d38/d5a/ffe x:0 0 0 2024-02-28T16:27:11.826 INFO:tasks.workunit.client.1.smithi157.stdout:5/727: mknod d0/db3/cf9 0 2024-02-28T16:27:11.829 INFO:tasks.workunit.client.1.smithi157.stdout:7/703: mknod df/d1f/d24/d38/cda 0 2024-02-28T16:27:11.831 INFO:tasks.workunit.client.1.smithi157.stdout:0/729: rename d1/f5e to d1/d13/dc9/ff6 0 2024-02-28T16:27:11.832 INFO:tasks.workunit.client.1.smithi157.stdout:2/781: dread - da/d38/df1/ff7 zero size 2024-02-28T16:27:11.832 INFO:tasks.workunit.client.1.smithi157.stdout:9/702: dwrite d0/d36/d37/d4d/d92/fb6 [0,4194304] 0 2024-02-28T16:27:11.834 INFO:tasks.workunit.client.1.smithi157.stdout:1/676: creat d10/d11/d3a/d95/da4/fd5 x:0 0 0 2024-02-28T16:27:11.835 INFO:tasks.workunit.client.1.smithi157.stdout:5/728: write d0/d9/d47/f55 [158889,87975] 0 2024-02-28T16:27:11.836 INFO:tasks.workunit.client.1.smithi157.stdout:4/702: truncate d3/da/d37/d71/db0/fca 267293 0 2024-02-28T16:27:11.840 INFO:tasks.workunit.client.1.smithi157.stdout:7/704: write df/d1f/d24/d39/f8c [2298437,95233] 0 2024-02-28T16:27:11.840 INFO:tasks.workunit.client.1.smithi157.stdout:9/703: fsync d0/d36/d3f/d69/f71 0 2024-02-28T16:27:11.843 INFO:tasks.workunit.client.1.smithi157.stdout:2/782: truncate da/d38/d4e/d91/f8a 8794349 0 2024-02-28T16:27:11.846 INFO:tasks.workunit.client.1.smithi157.stdout:9/704: chown d0/d19/lce 122956 1 2024-02-28T16:27:11.848 INFO:tasks.workunit.client.1.smithi157.stdout:9/705: dread - d0/d36/d37/d40/d4b/d96/fda zero size 2024-02-28T16:27:11.850 INFO:tasks.workunit.client.1.smithi157.stdout:9/706: readlink d0/d36/d37/d40/d4b/l77 0 2024-02-28T16:27:11.851 INFO:tasks.workunit.client.1.smithi157.stdout:2/783: rmdir da/d8c/dc0 39 2024-02-28T16:27:11.851 INFO:tasks.workunit.client.1.smithi157.stdout:0/730: link d1/da/d7d/lba d1/d13/d52/d53/lf7 0 2024-02-28T16:27:11.853 INFO:tasks.workunit.client.1.smithi157.stdout:7/705: rename df/d25/d4e/l6f to df/d1f/d24/ldb 0 2024-02-28T16:27:11.857 INFO:tasks.workunit.client.1.smithi157.stdout:2/784: rename da/c17 to da/d38/d5a/d79/d7b/cff 0 2024-02-28T16:27:11.860 INFO:tasks.workunit.client.1.smithi157.stdout:9/707: getdents d0/d36 0 2024-02-28T16:27:11.860 INFO:tasks.workunit.client.1.smithi157.stdout:7/706: symlink df/d1f/d24/d4f/d72/dab/ldc 0 2024-02-28T16:27:11.861 INFO:tasks.workunit.client.1.smithi157.stdout:0/731: getdents d1/d8 0 2024-02-28T16:27:11.864 INFO:tasks.workunit.client.1.smithi157.stdout:2/785: rename da/d35/f8b to da/d47/dca/f100 0 2024-02-28T16:27:11.865 INFO:tasks.workunit.client.1.smithi157.stdout:8/682: truncate d1/d5/d23/d38/d6e/f87 3795185 0 2024-02-28T16:27:11.868 INFO:tasks.workunit.client.1.smithi157.stdout:7/707: rename df/d1f/d24/f2d to df/d25/fdd 0 2024-02-28T16:27:11.869 INFO:tasks.workunit.client.1.smithi157.stdout:1/677: dread d10/d11/d31/d2a/f2d [0,4194304] 0 2024-02-28T16:27:11.869 INFO:tasks.workunit.client.1.smithi157.stdout:6/655: write d2/d7/fc [625793,99764] 0 2024-02-28T16:27:11.869 INFO:tasks.workunit.client.1.smithi157.stdout:0/732: mkdir d1/d13/df8 0 2024-02-28T16:27:11.875 INFO:tasks.workunit.client.1.smithi157.stdout:0/733: chown d1/d8/da8/fb0 3396 1 2024-02-28T16:27:11.877 INFO:tasks.workunit.client.1.smithi157.stdout:6/656: fdatasync d2/d7/de/d1b/d3d/da4/f48 0 2024-02-28T16:27:11.877 INFO:tasks.workunit.client.1.smithi157.stdout:3/640: dwrite d0/d6/d34/d80/d23/d2b/f57 [0,4194304] 0 2024-02-28T16:27:11.879 INFO:tasks.workunit.client.1.smithi157.stdout:1/678: creat d10/d11/d3a/d95/fd6 x:0 0 0 2024-02-28T16:27:11.879 INFO:tasks.workunit.client.1.smithi157.stdout:4/703: dread d3/da/d37/d84/dc9/fcd [0,4194304] 0 2024-02-28T16:27:11.881 INFO:tasks.workunit.client.1.smithi157.stdout:6/657: stat d2/d7/l61 0 2024-02-28T16:27:11.887 INFO:tasks.workunit.client.1.smithi157.stdout:3/641: dread - d0/d6/d44/d8e/da8/f9a zero size 2024-02-28T16:27:11.887 INFO:tasks.workunit.client.1.smithi157.stdout:9/708: dwrite d0/d36/d3f/f75 [4194304,4194304] 0 2024-02-28T16:27:11.890 INFO:tasks.workunit.client.1.smithi157.stdout:7/708: creat df/d1f/d24/d39/fde x:0 0 0 2024-02-28T16:27:11.891 INFO:tasks.workunit.client.1.smithi157.stdout:9/709: fdatasync d0/d36/d3f/f6c 0 2024-02-28T16:27:11.891 INFO:tasks.workunit.client.1.smithi157.stdout:5/729: truncate d0/d9/f42 4064799 0 2024-02-28T16:27:11.895 INFO:tasks.workunit.client.1.smithi157.stdout:7/709: truncate df/d4b/f95 5093150 0 2024-02-28T16:27:11.895 INFO:tasks.workunit.client.1.smithi157.stdout:5/730: readlink d0/d30/da0/dd5/lf5 0 2024-02-28T16:27:11.896 INFO:tasks.workunit.client.1.smithi157.stdout:0/734: truncate d1/da/ff1 292694 0 2024-02-28T16:27:11.899 INFO:tasks.workunit.client.1.smithi157.stdout:8/683: dread d1/d5/d4d/f62 [0,4194304] 0 2024-02-28T16:27:11.899 INFO:tasks.workunit.client.1.smithi157.stdout:7/710: write df/d25/d4e/fcd [745097,75385] 0 2024-02-28T16:27:11.902 INFO:tasks.workunit.client.1.smithi157.stdout:3/642: rmdir d0/d6/d44 39 2024-02-28T16:27:11.905 INFO:tasks.workunit.client.1.smithi157.stdout:4/704: dwrite d3/da/fac [0,4194304] 0 2024-02-28T16:27:11.912 INFO:tasks.workunit.client.1.smithi157.stdout:5/731: write d0/d9/d47/d78/faa [1668232,99042] 0 2024-02-28T16:27:11.918 INFO:tasks.workunit.client.1.smithi157.stdout:0/735: rename d1/d8/d27 to d1/d13/dc9/df9 0 2024-02-28T16:27:11.919 INFO:tasks.workunit.client.1.smithi157.stdout:2/786: dwrite da/d38/d3e/fb9 [0,4194304] 0 2024-02-28T16:27:11.919 INFO:tasks.workunit.client.1.smithi157.stdout:6/658: link d2/d17/f5a d2/d7/d8/da/da1/fbe 0 2024-02-28T16:27:11.922 INFO:tasks.workunit.client.1.smithi157.stdout:7/711: creat df/d4b/d4c/fdf x:0 0 0 2024-02-28T16:27:11.925 INFO:tasks.workunit.client.1.smithi157.stdout:8/684: mknod d1/d5/d43/d86/ce9 0 2024-02-28T16:27:11.925 INFO:tasks.workunit.client.1.smithi157.stdout:7/712: write df/d1f/d37/d46/fb2 [1047067,105655] 0 2024-02-28T16:27:11.929 INFO:tasks.workunit.client.1.smithi157.stdout:3/643: creat d0/d6/d34/d80/d5c/d99/fce x:0 0 0 2024-02-28T16:27:11.929 INFO:tasks.workunit.client.1.smithi157.stdout:9/710: write d0/f21 [5769877,81399] 0 2024-02-28T16:27:11.929 INFO:tasks.workunit.client.1.smithi157.stdout:4/705: creat d3/da/d48/d8e/fe1 x:0 0 0 2024-02-28T16:27:11.931 INFO:tasks.workunit.client.1.smithi157.stdout:1/679: write d10/d11/d31/d2a/d70/fc0 [481644,114006] 0 2024-02-28T16:27:11.934 INFO:tasks.workunit.client.1.smithi157.stdout:3/644: truncate d0/d6/d1e/f76 4926753 0 2024-02-28T16:27:11.936 INFO:tasks.workunit.client.1.smithi157.stdout:0/736: mkdir d1/da/d7d/d98/de2/de9/dfa 0 2024-02-28T16:27:11.937 INFO:tasks.workunit.client.1.smithi157.stdout:2/787: dread da/d38/d7e/feb [0,4194304] 0 2024-02-28T16:27:11.937 INFO:tasks.workunit.client.1.smithi157.stdout:0/737: write d1/d13/f47 [2594905,34302] 0 2024-02-28T16:27:11.938 INFO:tasks.workunit.client.1.smithi157.stdout:2/788: chown da/d2b/d59 880 1 2024-02-28T16:27:11.938 INFO:tasks.workunit.client.1.smithi157.stdout:6/659: creat d2/d7/de/d1b/d4d/d6c/d9a/fbf x:0 0 0 2024-02-28T16:27:11.940 INFO:tasks.workunit.client.1.smithi157.stdout:6/660: dread - d2/d7/de/d1b/d4d/d6c/f9e zero size 2024-02-28T16:27:11.941 INFO:tasks.workunit.client.1.smithi157.stdout:8/685: creat d1/fea x:0 0 0 2024-02-28T16:27:11.993 INFO:tasks.workunit.client.1.smithi157.stdout:6/661: stat d2/d7/d8/da/d31/d59/l7e 0 2024-02-28T16:27:11.995 INFO:tasks.workunit.client.1.smithi157.stdout:6/662: stat d2/d17/f1e 0 2024-02-28T16:27:11.995 INFO:tasks.workunit.client.1.smithi157.stdout:1/680: dread d10/d11/d31/d2a/d70/f9c [0,4194304] 0 2024-02-28T16:27:11.996 INFO:tasks.workunit.client.1.smithi157.stdout:0/738: read d1/d13/d52/d53/f81 [64980,19558] 0 2024-02-28T16:27:11.996 INFO:tasks.workunit.client.1.smithi157.stdout:7/713: link df/d25/d79/f82 df/d25/db5/fe0 0 2024-02-28T16:27:11.996 INFO:tasks.workunit.client.1.smithi157.stdout:6/663: chown d2/d7 927 1 2024-02-28T16:27:11.996 INFO:tasks.workunit.client.1.smithi157.stdout:8/686: rmdir d1/d5/d4d/d60 39 2024-02-28T16:27:12.000 INFO:tasks.workunit.client.1.smithi157.stdout:8/687: write d1/f2c [11754499,86476] 0 2024-02-28T16:27:12.001 INFO:tasks.workunit.client.1.smithi157.stdout:9/711: dread d0/d36/d37/f67 [0,4194304] 0 2024-02-28T16:27:12.010 INFO:tasks.workunit.client.1.smithi157.stdout:2/789: dwrite da/d8c/dc0/fe8 [0,4194304] 0 2024-02-28T16:27:12.012 INFO:tasks.workunit.client.1.smithi157.stdout:5/732: creat d0/d30/d50/d7f/ffa x:0 0 0 2024-02-28T16:27:12.013 INFO:tasks.workunit.client.1.smithi157.stdout:3/645: mknod d0/d6/d44/d70/d71/d87/ccf 0 2024-02-28T16:27:12.015 INFO:tasks.workunit.client.1.smithi157.stdout:7/714: symlink df/d25/da7/le1 0 2024-02-28T16:27:12.017 INFO:tasks.workunit.client.1.smithi157.stdout:7/715: truncate df/d25/da7/fbd 665700 0 2024-02-28T16:27:12.017 INFO:tasks.workunit.client.1.smithi157.stdout:0/739: rename d1/da/c2a to d1/d13/d52/d53/cfb 0 2024-02-28T16:27:12.018 INFO:tasks.workunit.client.1.smithi157.stdout:6/664: mkdir d2/d7/de/d1b/d3d/da4/d66/dc0 0 2024-02-28T16:27:12.020 INFO:tasks.workunit.client.1.smithi157.stdout:1/681: truncate d10/d11/d31/d7f/f81 250368 0 2024-02-28T16:27:12.020 INFO:tasks.workunit.client.1.smithi157.stdout:0/740: write d1/da/d6c/fbb [308020,114307] 0 2024-02-28T16:27:12.021 INFO:tasks.workunit.client.1.smithi157.stdout:8/688: symlink d1/d5/d23/d38/d67/leb 0 2024-02-28T16:27:12.022 INFO:tasks.workunit.client.1.smithi157.stdout:9/712: fdatasync d0/d36/d3f/f74 0 2024-02-28T16:27:12.026 INFO:tasks.workunit.client.1.smithi157.stdout:9/713: read d0/f33 [3267475,111781] 0 2024-02-28T16:27:12.027 INFO:tasks.workunit.client.1.smithi157.stdout:3/646: creat d0/d6/d1e/fd0 x:0 0 0 2024-02-28T16:27:12.029 INFO:tasks.workunit.client.1.smithi157.stdout:3/647: dread - d0/d6/d1e/d5b/d9d/fb2 zero size 2024-02-28T16:27:12.029 INFO:tasks.workunit.client.1.smithi157.stdout:5/733: dwrite d0/d30/dca/fe6 [0,4194304] 0 2024-02-28T16:27:12.031 INFO:tasks.workunit.client.1.smithi157.stdout:2/790: rename da/d35/l3c to da/d38/d5a/d69/l101 0 2024-02-28T16:27:12.040 INFO:tasks.workunit.client.1.smithi157.stdout:1/682: mknod d10/d11/d3a/d5c/d6c/cd7 0 2024-02-28T16:27:12.043 INFO:tasks.workunit.client.1.smithi157.stdout:8/689: fdatasync d1/d5/d43/f45 0 2024-02-28T16:27:12.046 INFO:tasks.workunit.client.1.smithi157.stdout:9/714: mkdir d0/d19/d30/d78/df1 0 2024-02-28T16:27:12.052 INFO:tasks.workunit.client.1.smithi157.stdout:7/716: rename df/d1f/d24/d4f/d72/f97 to df/d80/d84/fe2 0 2024-02-28T16:27:12.054 INFO:tasks.workunit.client.1.smithi157.stdout:2/791: fsync da/d38/d7e/feb 0 2024-02-28T16:27:12.059 INFO:tasks.workunit.client.1.smithi157.stdout:1/683: fdatasync d10/d11/d31/f3d 0 2024-02-28T16:27:12.060 INFO:tasks.workunit.client.1.smithi157.stdout:1/684: readlink d10/d11/d31/d2a/l35 0 2024-02-28T16:27:12.062 INFO:tasks.workunit.client.1.smithi157.stdout:8/690: symlink d1/lec 0 2024-02-28T16:27:12.067 INFO:tasks.workunit.client.1.smithi157.stdout:3/648: rename d0/d6/d1e/d5b to d0/d6/d44/d70/d71/d87/dd1 0 2024-02-28T16:27:12.068 INFO:tasks.workunit.client.1.smithi157.stdout:4/706: sync 2024-02-28T16:27:12.069 INFO:tasks.workunit.client.1.smithi157.stdout:7/717: mknod df/d1f/d24/d38/ce3 0 2024-02-28T16:27:12.070 INFO:tasks.workunit.client.1.smithi157.stdout:3/649: write d0/d6/d6b/d75/fc0 [4034262,32825] 0 2024-02-28T16:27:12.073 INFO:tasks.workunit.client.1.smithi157.stdout:2/792: symlink da/d2b/d59/l102 0 2024-02-28T16:27:12.075 INFO:tasks.workunit.client.1.smithi157.stdout:0/741: rmdir d1/da/d6c/df4 0 2024-02-28T16:27:12.079 INFO:tasks.workunit.client.1.smithi157.stdout:1/685: mkdir d10/d11/d3a/d95/da4/dd8 0 2024-02-28T16:27:12.081 INFO:tasks.workunit.client.1.smithi157.stdout:8/691: mknod d1/d5/dd8/ced 0 2024-02-28T16:27:12.082 INFO:tasks.workunit.client.1.smithi157.stdout:8/692: chown d1/d5/d23/da1/dd3 1968 1 2024-02-28T16:27:12.084 INFO:tasks.workunit.client.1.smithi157.stdout:5/734: dwrite d0/d30/def/d7e/d82/fc3 [0,4194304] 0 2024-02-28T16:27:12.087 INFO:tasks.workunit.client.1.smithi157.stdout:9/715: rename d0/f7b to d0/dc0/ff2 0 2024-02-28T16:27:12.091 INFO:tasks.workunit.client.1.smithi157.stdout:4/707: write d3/da/d48/f93 [682444,47281] 0 2024-02-28T16:27:12.093 INFO:tasks.workunit.client.1.smithi157.stdout:3/650: symlink d0/d6/d34/d80/d23/d2b/d6d/ld2 0 2024-02-28T16:27:12.095 INFO:tasks.workunit.client.1.smithi157.stdout:4/708: write d3/da/d37/d71/f73 [624213,62640] 0 2024-02-28T16:27:12.096 INFO:tasks.workunit.client.1.smithi157.stdout:7/718: rmdir df/d1f/d24 39 2024-02-28T16:27:12.097 INFO:tasks.workunit.client.1.smithi157.stdout:4/709: stat d3/da/d37/l9f 0 2024-02-28T16:27:12.101 INFO:tasks.workunit.client.1.smithi157.stdout:9/716: creat d0/d36/d37/d40/d4b/d96/ff3 x:0 0 0 2024-02-28T16:27:12.103 INFO:tasks.workunit.client.1.smithi157.stdout:6/665: getdents d2/d7/d8/da/d71/d8f/d6e 0 2024-02-28T16:27:12.106 INFO:tasks.workunit.client.1.smithi157.stdout:2/793: mknod da/c103 0 2024-02-28T16:27:12.106 INFO:tasks.workunit.client.1.smithi157.stdout:1/686: symlink d10/d11/d31/dcb/ld9 0 2024-02-28T16:27:12.109 INFO:tasks.workunit.client.1.smithi157.stdout:0/742: chown d1/d8/fc 6738 1 2024-02-28T16:27:12.112 INFO:tasks.workunit.client.1.smithi157.stdout:4/710: symlink d3/da/d37/d84/d9a/le2 0 2024-02-28T16:27:12.113 INFO:tasks.workunit.client.1.smithi157.stdout:4/711: fdatasync d3/da/d37/d71/db0/db4/fc3 0 2024-02-28T16:27:12.116 INFO:tasks.workunit.client.1.smithi157.stdout:9/717: mkdir d0/d36/d37/d40/d4b/d96/df4 0 2024-02-28T16:27:12.117 INFO:tasks.workunit.client.1.smithi157.stdout:3/651: truncate d0/d6/f56 1807321 0 2024-02-28T16:27:12.118 INFO:tasks.workunit.client.1.smithi157.stdout:2/794: dread da/d38/d3e/fb9 [0,4194304] 0 2024-02-28T16:27:12.119 INFO:tasks.workunit.client.1.smithi157.stdout:6/666: truncate d2/d7/d8/da/d71/d8f/d6e/f79 2161435 0 2024-02-28T16:27:12.120 INFO:tasks.workunit.client.1.smithi157.stdout:3/652: read d0/d6/f11 [1889009,106919] 0 2024-02-28T16:27:12.121 INFO:tasks.workunit.client.1.smithi157.stdout:1/687: creat d10/d11/d7e/fda x:0 0 0 2024-02-28T16:27:12.123 INFO:tasks.workunit.client.1.smithi157.stdout:2/795: write da/d35/fea [157160,35754] 0 2024-02-28T16:27:12.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:11 smithi148 ceph-mon[28767]: pgmap v60: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 48 MiB/s rd, 157 MiB/s wr, 327 op/s 2024-02-28T16:27:12.124 INFO:tasks.workunit.client.1.smithi157.stdout:8/693: rename d1/d5/d4d/d60/ca5 to d1/d5/d23/d53/dce/cee 0 2024-02-28T16:27:12.125 INFO:tasks.workunit.client.1.smithi157.stdout:7/719: dwrite df/f17 [0,4194304] 0 2024-02-28T16:27:12.126 INFO:tasks.workunit.client.1.smithi157.stdout:4/712: creat d3/d77/fe3 x:0 0 0 2024-02-28T16:27:12.131 INFO:tasks.workunit.client.1.smithi157.stdout:9/718: creat d0/d36/ff5 x:0 0 0 2024-02-28T16:27:12.136 INFO:tasks.workunit.client.1.smithi157.stdout:5/735: creat d0/d30/d50/d7f/ffb x:0 0 0 2024-02-28T16:27:12.138 INFO:tasks.workunit.client.1.smithi157.stdout:5/736: chown d0/d30/d50/d7f 5 1 2024-02-28T16:27:12.141 INFO:tasks.workunit.client.1.smithi157.stdout:8/694: dwrite d1/d5/d10/faf [0,4194304] 0 2024-02-28T16:27:12.144 INFO:tasks.workunit.client.1.smithi157.stdout:8/695: write d1/f2c [1798667,49119] 0 2024-02-28T16:27:12.144 INFO:tasks.workunit.client.1.smithi157.stdout:2/796: mkdir da/d38/d3e/d9b/d104 0 2024-02-28T16:27:12.145 INFO:tasks.workunit.client.1.smithi157.stdout:7/720: symlink df/d4b/d4c/le4 0 2024-02-28T16:27:12.148 INFO:tasks.workunit.client.1.smithi157.stdout:4/713: mknod d3/da/d37/d84/d9a/dab/ce4 0 2024-02-28T16:27:12.154 INFO:tasks.workunit.client.1.smithi157.stdout:6/667: creat d2/d7/de/d1b/d3d/da4/d53/da6/fc1 x:0 0 0 2024-02-28T16:27:12.155 INFO:tasks.workunit.client.1.smithi157.stdout:1/688: mknod d10/d11/d22/d99/dab/cdb 0 2024-02-28T16:27:12.157 INFO:tasks.workunit.client.1.smithi157.stdout:5/737: dwrite d0/d9/d47/d78/faa [4194304,4194304] 0 2024-02-28T16:27:12.157 INFO:tasks.workunit.client.1.smithi157.stdout:8/696: creat d1/d5/d23/d38/d6e/fef x:0 0 0 2024-02-28T16:27:12.161 INFO:tasks.workunit.client.1.smithi157.stdout:6/668: read - d2/d7/d8/da/d71/d80/fa2 zero size 2024-02-28T16:27:12.161 INFO:tasks.workunit.client.1.smithi157.stdout:4/714: creat d3/d77/fe5 x:0 0 0 2024-02-28T16:27:12.161 INFO:tasks.workunit.client.1.smithi157.stdout:0/743: rename d1/f6 to d1/d8/d33/ffc 0 2024-02-28T16:27:12.162 INFO:tasks.workunit.client.1.smithi157.stdout:5/738: write d0/d30/d50/fae [468493,77400] 0 2024-02-28T16:27:12.165 INFO:tasks.workunit.client.1.smithi157.stdout:9/719: rmdir d0/d36/d37/d40 39 2024-02-28T16:27:12.166 INFO:tasks.workunit.client.1.smithi157.stdout:5/739: fdatasync d0/d30/d50/d7f/fbf 0 2024-02-28T16:27:12.168 INFO:tasks.workunit.client.1.smithi157.stdout:3/653: rename d0/d6/d44/d70/d71/d87/dd1/d9d/lad to d0/d6/d34/d80/d5c/ld3 0 2024-02-28T16:27:12.180 INFO:tasks.workunit.client.1.smithi157.stdout:5/740: write d0/d9/d47/d5b/d89/d75/fb1 [574535,68182] 0 2024-02-28T16:27:12.183 INFO:tasks.workunit.client.1.smithi157.stdout:7/721: getdents df/d25/da7 0 2024-02-28T16:27:12.184 INFO:tasks.workunit.client.1.smithi157.stdout:2/797: rename da/d8c/l9c to da/d38/df1/df4/l105 0 2024-02-28T16:27:12.186 INFO:tasks.workunit.client.1.smithi157.stdout:4/715: write d3/da/d1f/d22/f3d [3010669,24196] 0 2024-02-28T16:27:12.187 INFO:tasks.workunit.client.1.smithi157.stdout:9/720: fsync d0/d19/d30/f48 0 2024-02-28T16:27:12.189 INFO:tasks.workunit.client.1.smithi157.stdout:7/722: read df/f10 [810039,61882] 0 2024-02-28T16:27:12.190 INFO:tasks.workunit.client.1.smithi157.stdout:2/798: creat da/d2b/f106 x:0 0 0 2024-02-28T16:27:12.191 INFO:tasks.workunit.client.1.smithi157.stdout:3/654: creat d0/d6/d34/d80/fd4 x:0 0 0 2024-02-28T16:27:12.192 INFO:tasks.workunit.client.1.smithi157.stdout:4/716: symlink d3/d8b/le6 0 2024-02-28T16:27:12.193 INFO:tasks.workunit.client.1.smithi157.stdout:0/744: dwrite d1/d13/d7f/fcc [0,4194304] 0 2024-02-28T16:27:12.195 INFO:tasks.workunit.client.1.smithi157.stdout:1/689: dread d10/d11/d22/d99/fb0 [0,4194304] 0 2024-02-28T16:27:12.198 INFO:tasks.workunit.client.1.smithi157.stdout:6/669: dwrite d2/d7/de/d1b/f28 [0,4194304] 0 2024-02-28T16:27:12.202 INFO:tasks.workunit.client.1.smithi157.stdout:4/717: stat d3/da/f4f 0 2024-02-28T16:27:12.202 INFO:tasks.workunit.client.1.smithi157.stdout:5/741: rmdir d0/d30/def/d90 0 2024-02-28T16:27:12.211 INFO:tasks.workunit.client.1.smithi157.stdout:4/718: write d3/da/d48/d4a/fdd [747994,50977] 0 2024-02-28T16:27:12.216 INFO:tasks.workunit.client.1.smithi157.stdout:0/745: dread d1/d13/fe [0,4194304] 0 2024-02-28T16:27:12.219 INFO:tasks.workunit.client.1.smithi157.stdout:7/723: dwrite df/f10 [0,4194304] 0 2024-02-28T16:27:12.222 INFO:tasks.workunit.client.1.smithi157.stdout:2/799: write da/f28 [384415,21277] 0 2024-02-28T16:27:12.228 INFO:tasks.workunit.client.1.smithi157.stdout:3/655: dread d0/d6/f11 [0,4194304] 0 2024-02-28T16:27:12.228 INFO:tasks.workunit.client.1.smithi157.stdout:0/746: mknod d1/d13/d52/db5/d64/cfd 0 2024-02-28T16:27:12.229 INFO:tasks.workunit.client.1.smithi157.stdout:6/670: creat d2/d7/d8/da/fc2 x:0 0 0 2024-02-28T16:27:12.231 INFO:tasks.workunit.client.1.smithi157.stdout:2/800: creat da/d38/d7e/d92/f107 x:0 0 0 2024-02-28T16:27:12.232 INFO:tasks.workunit.client.1.smithi157.stdout:1/690: truncate d10/d11/d3a/d5c/d6c/d7b/d8c/fa2 40113 0 2024-02-28T16:27:12.233 INFO:tasks.workunit.client.1.smithi157.stdout:3/656: write d0/d6/d44/d4b/fb1 [195509,18636] 0 2024-02-28T16:27:12.234 INFO:tasks.workunit.client.1.smithi157.stdout:4/719: creat d3/da/d48/fe7 x:0 0 0 2024-02-28T16:27:12.236 INFO:tasks.workunit.client.1.smithi157.stdout:2/801: rmdir da/d38/d5a 39 2024-02-28T16:27:12.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:11 smithi157 ceph-mon[38346]: pgmap v60: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 48 MiB/s rd, 157 MiB/s wr, 327 op/s 2024-02-28T16:27:12.238 INFO:tasks.workunit.client.1.smithi157.stdout:6/671: write d2/d7/d8/da/d71/d80/f81 [19576,70608] 0 2024-02-28T16:27:12.238 INFO:tasks.workunit.client.1.smithi157.stdout:5/742: dwrite d0/d30/d50/d7f/f8d [0,4194304] 0 2024-02-28T16:27:12.246 INFO:tasks.workunit.client.1.smithi157.stdout:4/720: mknod d3/da/d37/d84/d9a/ce8 0 2024-02-28T16:27:12.247 INFO:tasks.workunit.client.1.smithi157.stdout:4/721: write d3/da/f90 [6916310,47907] 0 2024-02-28T16:27:12.248 INFO:tasks.workunit.client.1.smithi157.stdout:1/691: rename d10/d11/d3a/d5c/dc1/cca to d10/d11/d3a/d5c/d6c/d7b/d8c/cdc 0 2024-02-28T16:27:12.254 INFO:tasks.workunit.client.1.smithi157.stdout:5/743: creat d0/d30/def/d51/ffc x:0 0 0 2024-02-28T16:27:12.255 INFO:tasks.workunit.client.1.smithi157.stdout:2/802: truncate da/d38/d7e/d92/f9d 986546 0 2024-02-28T16:27:12.258 INFO:tasks.workunit.client.1.smithi157.stdout:7/724: getdents df/d1f/d24/d39/d64 0 2024-02-28T16:27:12.260 INFO:tasks.workunit.client.1.smithi157.stdout:8/697: sync 2024-02-28T16:27:12.261 INFO:tasks.workunit.client.1.smithi157.stdout:0/747: rmdir d1/d8/df5 0 2024-02-28T16:27:12.265 INFO:tasks.workunit.client.1.smithi157.stdout:2/803: fsync da/f96 0 2024-02-28T16:27:12.269 INFO:tasks.workunit.client.1.smithi157.stdout:4/722: rename d3/da/d48/d8e/fd5 to d3/da/d1f/d22/fe9 0 2024-02-28T16:27:12.272 INFO:tasks.workunit.client.1.smithi157.stdout:0/748: mknod d1/d13/dc9/cfe 0 2024-02-28T16:27:12.274 INFO:tasks.workunit.client.1.smithi157.stdout:8/698: symlink d1/d5/d43/d66/lf0 0 2024-02-28T16:27:12.277 INFO:tasks.workunit.client.1.smithi157.stdout:6/672: truncate d2/f5 3955309 0 2024-02-28T16:27:12.277 INFO:tasks.workunit.client.1.smithi157.stdout:1/692: dread d10/d11/d3a/d5c/d6c/d6f/f83 [0,4194304] 0 2024-02-28T16:27:12.278 INFO:tasks.workunit.client.1.smithi157.stdout:1/693: chown d10/d11/d22/l48 990825 1 2024-02-28T16:27:12.280 INFO:tasks.workunit.client.1.smithi157.stdout:4/723: dread d3/da/d48/d8e/fd3 [0,4194304] 0 2024-02-28T16:27:12.281 INFO:tasks.workunit.client.1.smithi157.stdout:3/657: truncate d0/d6/d6b/f73 2313452 0 2024-02-28T16:27:12.285 INFO:tasks.workunit.client.1.smithi157.stdout:3/658: write d0/d6/d34/d80/d23/d2b/d2e/d7e/fcd [418838,119183] 0 2024-02-28T16:27:12.288 INFO:tasks.workunit.client.1.smithi157.stdout:5/744: dread d0/f34 [0,4194304] 0 2024-02-28T16:27:12.291 INFO:tasks.workunit.client.1.smithi157.stdout:4/724: mknod d3/da/d28/cea 0 2024-02-28T16:27:12.294 INFO:tasks.workunit.client.1.smithi157.stdout:2/804: rmdir da/d38/d5a/d5c 39 2024-02-28T16:27:12.294 INFO:tasks.workunit.client.1.smithi157.stdout:4/725: write d3/da/f35 [3205799,18481] 0 2024-02-28T16:27:12.295 INFO:tasks.workunit.client.1.smithi157.stdout:7/725: truncate df/d4b/f91 2808526 0 2024-02-28T16:27:12.295 INFO:tasks.workunit.client.1.smithi157.stdout:6/673: dwrite d2/d17/f2a [0,4194304] 0 2024-02-28T16:27:12.299 INFO:tasks.workunit.client.1.smithi157.stdout:0/749: mkdir d1/d8/da8/dff 0 2024-02-28T16:27:12.304 INFO:tasks.workunit.client.1.smithi157.stdout:2/805: mknod da/d38/d5a/d79/d7b/c108 0 2024-02-28T16:27:12.305 INFO:tasks.workunit.client.1.smithi157.stdout:0/750: symlink d1/d13/d52/d7b/dc1/l100 0 2024-02-28T16:27:12.308 INFO:tasks.workunit.client.1.smithi157.stdout:3/659: rename d0/d6/fa to d0/d6/d34/d80/d23/d2b/fd5 0 2024-02-28T16:27:12.310 INFO:tasks.workunit.client.1.smithi157.stdout:4/726: fsync d3/da/d28/f3e 0 2024-02-28T16:27:12.311 INFO:tasks.workunit.client.1.smithi157.stdout:7/726: symlink df/d1f/d24/d39/le5 0 2024-02-28T16:27:12.313 INFO:tasks.workunit.client.1.smithi157.stdout:4/727: stat d3/d77/f98 0 2024-02-28T16:27:12.314 INFO:tasks.workunit.client.1.smithi157.stdout:8/699: truncate d1/d5/d14/f9b 3148417 0 2024-02-28T16:27:12.316 INFO:tasks.workunit.client.1.smithi157.stdout:5/745: rename d0/d9/d47/d78 to d0/d30/da0/dfd 0 2024-02-28T16:27:12.319 INFO:tasks.workunit.client.1.smithi157.stdout:5/746: readlink d0/d30/d50/lb7 0 2024-02-28T16:27:12.321 INFO:tasks.workunit.client.1.smithi157.stdout:5/747: truncate d0/d30/d50/d7f/fbf 818210 0 2024-02-28T16:27:12.322 INFO:tasks.workunit.client.1.smithi157.stdout:8/700: dread d1/f2 [0,4194304] 0 2024-02-28T16:27:12.322 INFO:tasks.workunit.client.1.smithi157.stdout:7/727: creat df/d1f/d24/d39/d64/fe6 x:0 0 0 2024-02-28T16:27:12.326 INFO:tasks.workunit.client.1.smithi157.stdout:4/728: creat d3/d8b/feb x:0 0 0 2024-02-28T16:27:12.326 INFO:tasks.workunit.client.1.smithi157.stdout:6/674: dread d2/d17/f1e [0,4194304] 0 2024-02-28T16:27:12.328 INFO:tasks.workunit.client.1.smithi157.stdout:6/675: write d2/fa3 [456502,97162] 0 2024-02-28T16:27:12.328 INFO:tasks.workunit.client.1.smithi157.stdout:2/806: rename da/d38/d3e/d9b/da3 to da/d2b/d59/d109 0 2024-02-28T16:27:12.336 INFO:tasks.workunit.client.1.smithi157.stdout:8/701: read d1/d5/d23/d38/d67/d6d/f7e [175827,22867] 0 2024-02-28T16:27:12.337 INFO:tasks.workunit.client.1.smithi157.stdout:7/728: fsync df/d1f/d24/d39/d64/f74 0 2024-02-28T16:27:12.338 INFO:tasks.workunit.client.1.smithi157.stdout:2/807: creat da/d38/d7e/dbb/dd0/f10a x:0 0 0 2024-02-28T16:27:12.340 INFO:tasks.workunit.client.1.smithi157.stdout:6/676: stat d2/d7/de/d1b/l41 0 2024-02-28T16:27:12.342 INFO:tasks.workunit.client.1.smithi157.stdout:5/748: creat d0/d9/ffe x:0 0 0 2024-02-28T16:27:12.345 INFO:tasks.workunit.client.1.smithi157.stdout:7/729: creat df/d25/da7/fe7 x:0 0 0 2024-02-28T16:27:12.345 INFO:tasks.workunit.client.1.smithi157.stdout:6/677: mknod d2/d7/de/cc3 0 2024-02-28T16:27:12.346 INFO:tasks.workunit.client.1.smithi157.stdout:0/751: dread d1/d13/d52/d53/fe7 [0,4194304] 0 2024-02-28T16:27:12.347 INFO:tasks.workunit.client.1.smithi157.stdout:6/678: stat d2/f35 0 2024-02-28T16:27:12.348 INFO:tasks.workunit.client.1.smithi157.stdout:3/660: truncate d0/d6/f13 457505 0 2024-02-28T16:27:12.350 INFO:tasks.workunit.client.1.smithi157.stdout:0/752: chown d1/d8/d33/f39 0 1 2024-02-28T16:27:12.351 INFO:tasks.workunit.client.1.smithi157.stdout:4/729: dwrite d3/da/d37/d71/db0/fca [0,4194304] 0 2024-02-28T16:27:12.353 INFO:tasks.workunit.client.1.smithi157.stdout:7/730: creat df/d1f/d24/d4f/d72/dab/dd6/fe8 x:0 0 0 2024-02-28T16:27:12.355 INFO:tasks.workunit.client.1.smithi157.stdout:6/679: creat d2/d7/de/d1b/d3d/da4/d53/fc4 x:0 0 0 2024-02-28T16:27:12.355 INFO:tasks.workunit.client.1.smithi157.stdout:8/702: dwrite d1/f2c [0,4194304] 0 2024-02-28T16:27:12.382 INFO:tasks.workunit.client.1.smithi157.stdout:9/721: sync 2024-02-28T16:27:12.392 INFO:tasks.workunit.client.1.smithi157.stdout:5/749: symlink d0/d9/d1b/lff 0 2024-02-28T16:27:12.394 INFO:tasks.workunit.client.1.smithi157.stdout:4/730: dread - d3/da/d28/f80 zero size 2024-02-28T16:27:12.394 INFO:tasks.workunit.client.1.smithi157.stdout:0/753: creat d1/d13/d46/d99/f101 x:0 0 0 2024-02-28T16:27:12.394 INFO:tasks.workunit.client.1.smithi157.stdout:2/808: dwrite da/d38/d5a/d5c/f7a [0,4194304] 0 2024-02-28T16:27:12.397 INFO:tasks.workunit.client.1.smithi157.stdout:7/731: mkdir df/d1f/d24/de9 0 2024-02-28T16:27:12.399 INFO:tasks.workunit.client.1.smithi157.stdout:9/722: dread - d0/d36/d37/d40/d5b/fd7 zero size 2024-02-28T16:27:12.399 INFO:tasks.workunit.client.1.smithi157.stdout:0/754: dread - d1/d13/d7f/d94/f9c zero size 2024-02-28T16:27:12.400 INFO:tasks.workunit.client.1.smithi157.stdout:2/809: symlink da/d35/l10b 0 2024-02-28T16:27:12.403 INFO:tasks.workunit.client.1.smithi157.stdout:0/755: write d1/da/fe5 [803049,82469] 0 2024-02-28T16:27:12.403 INFO:tasks.workunit.client.1.smithi157.stdout:6/680: dwrite d2/d17/f21 [4194304,4194304] 0 2024-02-28T16:27:12.405 INFO:tasks.workunit.client.1.smithi157.stdout:4/731: creat d3/da/d48/fec x:0 0 0 2024-02-28T16:27:12.409 INFO:tasks.workunit.client.1.smithi157.stdout:7/732: creat df/d25/fea x:0 0 0 2024-02-28T16:27:12.411 INFO:tasks.workunit.client.1.smithi157.stdout:9/723: readlink d0/d36/d37/d4d/lef 0 2024-02-28T16:27:12.420 INFO:tasks.workunit.client.1.smithi157.stdout:9/724: mkdir d0/d36/d37/d4d/d92/df6 0 2024-02-28T16:27:12.424 INFO:tasks.workunit.client.1.smithi157.stdout:4/732: getdents d3/dcc 0 2024-02-28T16:27:12.424 INFO:tasks.workunit.client.1.smithi157.stdout:0/756: dwrite d1/d8/d33/d96/fb1 [0,4194304] 0 2024-02-28T16:27:12.427 INFO:tasks.workunit.client.1.smithi157.stdout:6/681: truncate d2/d7/d8/da/f8e 3814261 0 2024-02-28T16:27:12.428 INFO:tasks.workunit.client.1.smithi157.stdout:9/725: mkdir d0/d19/df7 0 2024-02-28T16:27:12.432 INFO:tasks.workunit.client.1.smithi157.stdout:2/810: dwrite da/f46 [0,4194304] 0 2024-02-28T16:27:12.434 INFO:tasks.workunit.client.1.smithi157.stdout:2/811: chown da/d35/c6e 441379230 1 2024-02-28T16:27:12.436 INFO:tasks.workunit.client.1.smithi157.stdout:7/733: dwrite df/d25/f2a [0,4194304] 0 2024-02-28T16:27:12.442 INFO:tasks.workunit.client.1.smithi157.stdout:6/682: creat d2/d7/de/d1b/d4d/d6c/d9a/fc5 x:0 0 0 2024-02-28T16:27:12.444 INFO:tasks.workunit.client.1.smithi157.stdout:4/733: getdents d3/da/d48/d4a/db7 0 2024-02-28T16:27:12.449 INFO:tasks.workunit.client.1.smithi157.stdout:6/683: mkdir d2/d7/d8/da/d31/d3a/dc6 0 2024-02-28T16:27:12.450 INFO:tasks.workunit.client.1.smithi157.stdout:9/726: getdents d0/d36/d3f/d69 0 2024-02-28T16:27:12.454 INFO:tasks.workunit.client.1.smithi157.stdout:2/812: dwrite da/d38/d5a/ffe [0,4194304] 0 2024-02-28T16:27:12.457 INFO:tasks.workunit.client.1.smithi157.stdout:9/727: rename d0/l17 to d0/d36/d37/d4d/d92/lf8 0 2024-02-28T16:27:12.490 INFO:tasks.workunit.client.1.smithi157.stdout:1/694: sync 2024-02-28T16:27:12.495 INFO:tasks.workunit.client.1.smithi157.stdout:2/813: fdatasync da/d47/dbd/dde/f99 0 2024-02-28T16:27:12.496 INFO:tasks.workunit.client.1.smithi157.stdout:6/684: rename d2/d7/d8/da/d31/d37/d2b/f7a to d2/d7/d8/da/d31/d3a/fc7 0 2024-02-28T16:27:12.496 INFO:tasks.workunit.client.1.smithi157.stdout:9/728: creat d0/d36/d37/d40/d5b/ff9 x:0 0 0 2024-02-28T16:27:12.497 INFO:tasks.workunit.client.1.smithi157.stdout:0/757: dread d1/d13/f47 [0,4194304] 0 2024-02-28T16:27:12.498 INFO:tasks.workunit.client.1.smithi157.stdout:6/685: fdatasync d2/d7/d8/da/d71/d93/fa5 0 2024-02-28T16:27:12.499 INFO:tasks.workunit.client.1.smithi157.stdout:0/758: write d1/d13/d7f/fcc [474422,411] 0 2024-02-28T16:27:12.504 INFO:tasks.workunit.client.1.smithi157.stdout:1/695: link d10/f38 d10/d11/d3a/d5c/d6c/d7b/fdd 0 2024-02-28T16:27:12.507 INFO:tasks.workunit.client.1.smithi157.stdout:0/759: creat d1/d13/f102 x:0 0 0 2024-02-28T16:27:12.507 INFO:tasks.workunit.client.1.smithi157.stdout:1/696: dread - d10/d11/d31/d7f/fcf zero size 2024-02-28T16:27:12.514 INFO:tasks.workunit.client.1.smithi157.stdout:6/686: dwrite d2/d7/de/d1b/d3d/da4/d53/d69/f7c [0,4194304] 0 2024-02-28T16:27:12.514 INFO:tasks.workunit.client.1.smithi157.stdout:1/697: mknod d10/d11/d3a/d5c/d84/dd4/cde 0 2024-02-28T16:27:12.517 INFO:tasks.workunit.client.1.smithi157.stdout:6/687: chown d2/d7/d8/da/d71/d8f/fac 94655 1 2024-02-28T16:27:12.518 INFO:tasks.workunit.client.1.smithi157.stdout:1/698: write d10/d11/d3a/d5c/d6c/d7b/f9d [3399527,126874] 0 2024-02-28T16:27:12.520 INFO:tasks.workunit.client.1.smithi157.stdout:6/688: fdatasync d2/d7/d8/da/d71/d93/fa5 0 2024-02-28T16:27:12.522 INFO:tasks.workunit.client.1.smithi157.stdout:1/699: creat d10/d11/d22/d99/dab/fdf x:0 0 0 2024-02-28T16:27:12.524 INFO:tasks.workunit.client.1.smithi157.stdout:0/760: dwrite d1/d13/d57/f5c [0,4194304] 0 2024-02-28T16:27:12.527 INFO:tasks.workunit.client.1.smithi157.stdout:1/700: chown d10/d11/d3a/d5c/d6c/d7b/f5e 101933015 1 2024-02-28T16:27:12.533 INFO:tasks.workunit.client.1.smithi157.stdout:6/689: link d2/d7/de/d1b/d3d/c94 d2/d7/de/d1b/d4d/d6c/d9a/cc8 0 2024-02-28T16:27:12.539 INFO:tasks.workunit.client.1.smithi157.stdout:6/690: rename d2/d7/d8/da/d31/d37/l83 to d2/d7/d8/da/d71/lc9 0 2024-02-28T16:27:12.540 INFO:tasks.workunit.client.1.smithi157.stdout:6/691: readlink d2/d7/de/la8 0 2024-02-28T16:27:12.543 INFO:tasks.workunit.client.1.smithi157.stdout:0/761: dwrite d1/d8/d33/d96/fb1 [0,4194304] 0 2024-02-28T16:27:12.545 INFO:tasks.workunit.client.1.smithi157.stdout:0/762: fdatasync d1/d13/f47 0 2024-02-28T16:27:12.549 INFO:tasks.workunit.client.1.smithi157.stdout:6/692: link d2/d7/d8/da/fc2 d2/d7/d8/da/d31/fca 0 2024-02-28T16:27:12.549 INFO:tasks.workunit.client.1.smithi157.stdout:0/763: mknod d1/d13/d52/d7b/dcf/c103 0 2024-02-28T16:27:12.560 INFO:tasks.workunit.client.1.smithi157.stdout:0/764: rename d1/d13/dc9/ff6 to d1/d13/d52/f104 0 2024-02-28T16:27:12.560 INFO:tasks.workunit.client.1.smithi157.stdout:1/701: dwrite d10/d11/d3a/f3c [0,4194304] 0 2024-02-28T16:27:12.564 INFO:tasks.workunit.client.1.smithi157.stdout:6/693: dwrite d2/d7/de/d1b/d4d/d6c/f95 [0,4194304] 0 2024-02-28T16:27:12.572 INFO:tasks.workunit.client.1.smithi157.stdout:6/694: creat d2/d7/d8/da/d31/d3a/dc6/fcb x:0 0 0 2024-02-28T16:27:12.572 INFO:tasks.workunit.client.1.smithi157.stdout:3/661: sync 2024-02-28T16:27:12.574 INFO:tasks.workunit.client.1.smithi157.stdout:3/662: chown d0/d6/d44/d48 386117 1 2024-02-28T16:27:12.577 INFO:tasks.workunit.client.1.smithi157.stdout:6/695: creat d2/d7/de/d1b/d4d/d6c/fcc x:0 0 0 2024-02-28T16:27:12.588 INFO:tasks.workunit.client.1.smithi157.stdout:3/663: creat d0/d6/d6b/fd6 x:0 0 0 2024-02-28T16:27:12.590 INFO:tasks.workunit.client.1.smithi157.stdout:6/696: creat d2/d7/d8/da/fcd x:0 0 0 2024-02-28T16:27:12.591 INFO:tasks.workunit.client.1.smithi157.stdout:6/697: chown d2/d7/d8/da 13765124 1 2024-02-28T16:27:12.591 INFO:tasks.workunit.client.1.smithi157.stdout:3/664: truncate d0/d6/f5f 562548 0 2024-02-28T16:27:12.595 INFO:tasks.workunit.client.1.smithi157.stdout:6/698: creat d2/d7/d8/da/d31/d37/fce x:0 0 0 2024-02-28T16:27:12.597 INFO:tasks.workunit.client.1.smithi157.stdout:3/665: fdatasync d0/d6/f17 0 2024-02-28T16:27:12.600 INFO:tasks.workunit.client.1.smithi157.stdout:6/699: creat d2/d7/de/d1b/d3d/da4/d8c/fcf x:0 0 0 2024-02-28T16:27:12.601 INFO:tasks.workunit.client.1.smithi157.stdout:0/765: truncate d1/f24 154848 0 2024-02-28T16:27:12.609 INFO:tasks.workunit.client.1.smithi157.stdout:1/702: dwrite d10/d11/d31/d2a/d70/f5b [0,4194304] 0 2024-02-28T16:27:12.613 INFO:tasks.workunit.client.1.smithi157.stdout:0/766: mknod d1/d13/d7f/c105 0 2024-02-28T16:27:12.616 INFO:tasks.workunit.client.1.smithi157.stdout:6/700: getdents d2 0 2024-02-28T16:27:12.618 INFO:tasks.workunit.client.1.smithi157.stdout:1/703: dread d10/d11/d3a/d5c/d6a/db4/fc6 [0,4194304] 0 2024-02-28T16:27:12.619 INFO:tasks.workunit.client.1.smithi157.stdout:6/701: dread - d2/d7/de/d1b/d3d/da4/d8c/fbd zero size 2024-02-28T16:27:12.625 INFO:tasks.workunit.client.1.smithi157.stdout:1/704: rmdir d10/d11/d3a/d5c/d6c/d7b/d8c 39 2024-02-28T16:27:12.629 INFO:tasks.workunit.client.1.smithi157.stdout:3/666: dwrite d0/d6/f56 [0,4194304] 0 2024-02-28T16:27:12.630 INFO:tasks.workunit.client.1.smithi157.stdout:1/705: mknod d10/d11/d31/d2a/ce0 0 2024-02-28T16:27:12.633 INFO:tasks.workunit.client.1.smithi157.stdout:3/667: dread - d0/d6/d44/d70/d71/d87/dd1/d9d/fa4 zero size 2024-02-28T16:27:12.634 INFO:tasks.workunit.client.1.smithi157.stdout:0/767: dwrite d1/d8/da8/fb0 [4194304,4194304] 0 2024-02-28T16:27:12.634 INFO:tasks.workunit.client.1.smithi157.stdout:6/702: dread d2/d17/f1e [0,4194304] 0 2024-02-28T16:27:12.638 INFO:tasks.workunit.client.1.smithi157.stdout:0/768: chown d1/d13/d7f/c105 0 1 2024-02-28T16:27:12.639 INFO:tasks.workunit.client.1.smithi157.stdout:3/668: readlink d0/d6/d44/d70/d71/d87/l9c 0 2024-02-28T16:27:12.640 INFO:tasks.workunit.client.1.smithi157.stdout:0/769: chown d1/da/cd8 7751 1 2024-02-28T16:27:12.647 INFO:tasks.workunit.client.1.smithi157.stdout:0/770: read d1/d13/d46/f51 [6988042,60409] 0 2024-02-28T16:27:12.648 INFO:tasks.workunit.client.1.smithi157.stdout:1/706: write d10/d11/d3a/d5c/f87 [1407330,107977] 0 2024-02-28T16:27:12.650 INFO:tasks.workunit.client.1.smithi157.stdout:0/771: truncate d1/d13/d46/d99/f9f 436147 0 2024-02-28T16:27:12.652 INFO:tasks.workunit.client.1.smithi157.stdout:6/703: dread d2/d7/de/d1b/d4d/d6c/f95 [0,4194304] 0 2024-02-28T16:27:12.652 INFO:tasks.workunit.client.1.smithi157.stdout:3/669: link d0/d6/d34/d80/c22 d0/d6/d34/d80/d23/d2b/d2e/d7e/cd7 0 2024-02-28T16:27:12.654 INFO:tasks.workunit.client.1.smithi157.stdout:0/772: mkdir d1/d13/d52/d7b/dc1/d106 0 2024-02-28T16:27:12.655 INFO:tasks.workunit.client.1.smithi157.stdout:1/707: rename d10/d11/d31/d2a/f64 to d10/d11/d22/d99/dab/fe1 0 2024-02-28T16:27:12.656 INFO:tasks.workunit.client.1.smithi157.stdout:1/708: fdatasync d10/d11/d3a/d5c/d6a/fa6 0 2024-02-28T16:27:12.658 INFO:tasks.workunit.client.1.smithi157.stdout:6/704: unlink d2/d7/d8/f1a 0 2024-02-28T16:27:12.661 INFO:tasks.workunit.client.1.smithi157.stdout:1/709: mknod d10/d11/d31/dcb/ce2 0 2024-02-28T16:27:12.666 INFO:tasks.workunit.client.1.smithi157.stdout:1/710: rmdir d10/d11/d31/d2a 39 2024-02-28T16:27:12.667 INFO:tasks.workunit.client.1.smithi157.stdout:3/670: link d0/d6/d44/d48/f7f d0/d6/d34/d43/fd8 0 2024-02-28T16:27:12.672 INFO:tasks.workunit.client.1.smithi157.stdout:0/773: write d1/d13/f6d [532301,62040] 0 2024-02-28T16:27:12.675 INFO:tasks.workunit.client.1.smithi157.stdout:6/705: dread d2/d7/d8/da/d31/d3a/fc7 [0,4194304] 0 2024-02-28T16:27:12.676 INFO:tasks.workunit.client.1.smithi157.stdout:0/774: creat d1/da/d7d/d98/de2/de9/dfa/f107 x:0 0 0 2024-02-28T16:27:12.681 INFO:tasks.workunit.client.1.smithi157.stdout:0/775: symlink d1/d13/d7f/l108 0 2024-02-28T16:27:12.683 INFO:tasks.workunit.client.1.smithi157.stdout:6/706: write d2/d7/d8/da/d31/fca [20300,40680] 0 2024-02-28T16:27:12.687 INFO:tasks.workunit.client.1.smithi157.stdout:1/711: dwrite d10/d11/f28 [0,4194304] 0 2024-02-28T16:27:12.688 INFO:tasks.workunit.client.1.smithi157.stdout:6/707: dread d2/d7/de/d1b/d4d/d6c/d9a/fb2 [0,4194304] 0 2024-02-28T16:27:12.689 INFO:tasks.workunit.client.1.smithi157.stdout:8/703: sync 2024-02-28T16:27:12.689 INFO:tasks.workunit.client.1.smithi157.stdout:5/750: sync 2024-02-28T16:27:12.693 INFO:tasks.workunit.client.1.smithi157.stdout:6/708: creat d2/d7/de/d1b/fd0 x:0 0 0 2024-02-28T16:27:12.694 INFO:tasks.workunit.client.1.smithi157.stdout:8/704: write d1/d5/dd8/d52/d54/dbc/fc0 [46691,55156] 0 2024-02-28T16:27:12.698 INFO:tasks.workunit.client.1.smithi157.stdout:8/705: chown d1/d5/d43/d86/f97 128358950 1 2024-02-28T16:27:12.700 INFO:tasks.workunit.client.1.smithi157.stdout:6/709: symlink d2/d7/d8/da/d31/d3a/ld1 0 2024-02-28T16:27:12.701 INFO:tasks.workunit.client.1.smithi157.stdout:6/710: stat d2/d7/d8/da/d31/d3a/f2f 0 2024-02-28T16:27:12.701 INFO:tasks.workunit.client.1.smithi157.stdout:1/712: link d10/d11/d31/d2a/fbb d10/d11/d3a/d95/fe3 0 2024-02-28T16:27:12.710 INFO:tasks.workunit.client.1.smithi157.stdout:0/776: dread d1/d8/d33/d96/fe6 [0,4194304] 0 2024-02-28T16:27:12.710 INFO:tasks.workunit.client.1.smithi157.stdout:1/713: getdents d10/d11/d3a/d5c/d6a 0 2024-02-28T16:27:12.714 INFO:tasks.workunit.client.1.smithi157.stdout:5/751: dwrite d0/d9/f91 [0,4194304] 0 2024-02-28T16:27:12.718 INFO:tasks.workunit.client.1.smithi157.stdout:0/777: dread d1/da/d7d/fa0 [0,4194304] 0 2024-02-28T16:27:12.718 INFO:tasks.workunit.client.1.smithi157.stdout:1/714: symlink d10/d11/le4 0 2024-02-28T16:27:12.719 INFO:tasks.workunit.client.1.smithi157.stdout:6/711: dread d2/d7/de/d1b/f28 [0,4194304] 0 2024-02-28T16:27:12.720 INFO:tasks.workunit.client.1.smithi157.stdout:8/706: dwrite d1/d5/f99 [0,4194304] 0 2024-02-28T16:27:12.723 INFO:tasks.workunit.client.1.smithi157.stdout:8/707: read d1/d5/d4d/f62 [3974301,95661] 0 2024-02-28T16:27:12.723 INFO:tasks.workunit.client.1.smithi157.stdout:5/752: mknod d0/d9/d47/d5b/d89/d75/dab/c100 0 2024-02-28T16:27:12.725 INFO:tasks.workunit.client.1.smithi157.stdout:0/778: mkdir d1/d13/d52/d7b/dc1/d106/d109 0 2024-02-28T16:27:12.726 INFO:tasks.workunit.client.1.smithi157.stdout:5/753: chown d0/d9/d1b 0 1 2024-02-28T16:27:12.728 INFO:tasks.workunit.client.1.smithi157.stdout:6/712: getdents d2/d7/d8/da/d71/d93 0 2024-02-28T16:27:12.729 INFO:tasks.workunit.client.1.smithi157.stdout:1/715: getdents d10/d11/d3a/d5c/d6a/db4/d91 0 2024-02-28T16:27:12.729 INFO:tasks.workunit.client.1.smithi157.stdout:5/754: dread - d0/d9/d47/f96 zero size 2024-02-28T16:27:12.730 INFO:tasks.workunit.client.1.smithi157.stdout:8/708: creat d1/d5/d4d/ff1 x:0 0 0 2024-02-28T16:27:12.730 INFO:tasks.workunit.client.1.smithi157.stdout:1/716: stat d10/f1b 0 2024-02-28T16:27:12.731 INFO:tasks.workunit.client.1.smithi157.stdout:5/755: fdatasync d0/d9/d47/f96 0 2024-02-28T16:27:12.731 INFO:tasks.workunit.client.1.smithi157.stdout:6/713: chown d2/d7/d8/da/d71/d8f/f85 149366051 1 2024-02-28T16:27:12.732 INFO:tasks.workunit.client.1.smithi157.stdout:1/717: chown d10/d11/d31/fce 428972699 1 2024-02-28T16:27:12.732 INFO:tasks.workunit.client.1.smithi157.stdout:0/779: symlink d1/d13/df8/l10a 0 2024-02-28T16:27:12.733 INFO:tasks.workunit.client.1.smithi157.stdout:8/709: rmdir d1/d5/dd8/d52 39 2024-02-28T16:27:12.738 INFO:tasks.workunit.client.1.smithi157.stdout:6/714: truncate d2/d7/de/d1b/d3d/da4/d53/da6/fc1 322641 0 2024-02-28T16:27:12.745 INFO:tasks.workunit.client.1.smithi157.stdout:1/718: rmdir d10/da0/db6 39 2024-02-28T16:27:12.748 INFO:tasks.workunit.client.1.smithi157.stdout:5/756: symlink d0/d30/df1/l101 0 2024-02-28T16:27:12.749 INFO:tasks.workunit.client.1.smithi157.stdout:6/715: dread d2/d7/de/d1b/d3d/da4/f48 [0,4194304] 0 2024-02-28T16:27:12.752 INFO:tasks.workunit.client.1.smithi157.stdout:0/780: dwrite d1/d13/d46/d99/f9f [0,4194304] 0 2024-02-28T16:27:12.759 INFO:tasks.workunit.client.1.smithi157.stdout:5/757: creat d0/d30/df1/f102 x:0 0 0 2024-02-28T16:27:12.762 INFO:tasks.workunit.client.1.smithi157.stdout:1/719: rename d10/d11/d22/f52 to d10/d11/d3a/d5c/d84/fe5 0 2024-02-28T16:27:12.764 INFO:tasks.workunit.client.1.smithi157.stdout:1/720: chown d10/d11/d60/c76 3930336 1 2024-02-28T16:27:12.764 INFO:tasks.workunit.client.1.smithi157.stdout:8/710: getdents d1/d5/d10 0 2024-02-28T16:27:12.766 INFO:tasks.workunit.client.1.smithi157.stdout:1/721: readlink d10/d11/d3a/d5c/d84/l8a 0 2024-02-28T16:27:12.766 INFO:tasks.workunit.client.1.smithi157.stdout:0/781: symlink d1/da/l10b 0 2024-02-28T16:27:12.771 INFO:tasks.workunit.client.1.smithi157.stdout:8/711: chown d1/d5/d23/d38/d67/d6d/f7f 414 1 2024-02-28T16:27:12.772 INFO:tasks.workunit.client.1.smithi157.stdout:1/722: unlink d10/d11/d31/fb7 0 2024-02-28T16:27:12.777 INFO:tasks.workunit.client.1.smithi157.stdout:9/729: sync 2024-02-28T16:27:12.777 INFO:tasks.workunit.client.1.smithi157.stdout:7/734: sync 2024-02-28T16:27:12.777 INFO:tasks.workunit.client.1.smithi157.stdout:4/734: sync 2024-02-28T16:27:12.777 INFO:tasks.workunit.client.1.smithi157.stdout:2/814: sync 2024-02-28T16:27:12.778 INFO:tasks.workunit.client.1.smithi157.stdout:1/723: creat d10/d11/d60/fe6 x:0 0 0 2024-02-28T16:27:12.780 INFO:tasks.workunit.client.1.smithi157.stdout:9/730: readlink d0/d36/d37/d4d/d92/db9/le8 0 2024-02-28T16:27:12.782 INFO:tasks.workunit.client.1.smithi157.stdout:7/735: unlink df/d25/d79/cbc 0 2024-02-28T16:27:12.783 INFO:tasks.workunit.client.1.smithi157.stdout:7/736: chown df/d25/l27 597932 1 2024-02-28T16:27:12.784 INFO:tasks.workunit.client.1.smithi157.stdout:7/737: readlink df/d1f/d37/d46/lc0 0 2024-02-28T16:27:12.786 INFO:tasks.workunit.client.1.smithi157.stdout:5/758: getdents d0/d9/d47/d5b 0 2024-02-28T16:27:12.786 INFO:tasks.workunit.client.1.smithi157.stdout:2/815: symlink da/d38/d3e/d9b/l10c 0 2024-02-28T16:27:12.786 INFO:tasks.workunit.client.1.smithi157.stdout:5/759: stat d0/d30/def/ld1 0 2024-02-28T16:27:12.787 INFO:tasks.workunit.client.1.smithi157.stdout:6/716: truncate d2/d7/de/d1b/d3d/da4/d53/f90 1731746 0 2024-02-28T16:27:12.789 INFO:tasks.workunit.client.1.smithi157.stdout:6/717: chown d2/d7/d8/da/d31/fca 3822 1 2024-02-28T16:27:12.789 INFO:tasks.workunit.client.1.smithi157.stdout:6/718: stat d2/d17/f21 0 2024-02-28T16:27:12.789 INFO:tasks.workunit.client.1.smithi157.stdout:8/712: truncate d1/d5/dd8/d52/d54/f5b 2765531 0 2024-02-28T16:27:12.790 INFO:tasks.workunit.client.1.smithi157.stdout:4/735: mknod d3/da/d37/d84/ced 0 2024-02-28T16:27:12.792 INFO:tasks.workunit.client.1.smithi157.stdout:8/713: write d1/d5/dd8/d52/d54/f5d [4799984,40830] 0 2024-02-28T16:27:12.822 INFO:tasks.workunit.client.1.smithi157.stdout:9/731: mkdir d0/d36/d37/d40/d4b/dfa 0 2024-02-28T16:27:12.824 INFO:tasks.workunit.client.1.smithi157.stdout:1/724: rename d10/d11/d22/l48 to d10/d11/d3a/d95/da4/dd8/le7 0 2024-02-28T16:27:12.824 INFO:tasks.workunit.client.1.smithi157.stdout:2/816: unlink da/d38/d3e/f84 0 2024-02-28T16:27:12.826 INFO:tasks.workunit.client.1.smithi157.stdout:6/719: symlink d2/d7/de/d1b/d3d/da4/d53/ld2 0 2024-02-28T16:27:12.831 INFO:tasks.workunit.client.1.smithi157.stdout:5/760: creat d0/d30/d50/df0/f103 x:0 0 0 2024-02-28T16:27:12.835 INFO:tasks.workunit.client.1.smithi157.stdout:8/714: rename d1/d5/d4d/ff1 to d1/d5/dd8/d52/d54/ff2 0 2024-02-28T16:27:12.843 INFO:tasks.workunit.client.1.smithi157.stdout:0/782: dwrite d1/d13/d52/db5/d64/f68 [0,4194304] 0 2024-02-28T16:27:12.843 INFO:tasks.workunit.client.1.smithi157.stdout:5/761: readlink d0/d9/d1b/lb5 0 2024-02-28T16:27:12.846 INFO:tasks.workunit.client.1.smithi157.stdout:2/817: rmdir da/d8c/dc0/df8 0 2024-02-28T16:27:12.848 INFO:tasks.workunit.client.1.smithi157.stdout:6/720: rename d2/d7/de/d1b/d4d/d6c/fcc to d2/d7/de/d1b/d3d/da4/d66/fd3 0 2024-02-28T16:27:12.849 INFO:tasks.workunit.client.1.smithi157.stdout:4/736: dwrite d3/da/d1f/d22/fc2 [0,4194304] 0 2024-02-28T16:27:12.852 INFO:tasks.workunit.client.1.smithi157.stdout:0/783: mkdir d1/da/d7d/dc4/d10c 0 2024-02-28T16:27:12.853 INFO:tasks.workunit.client.1.smithi157.stdout:5/762: chown d0/d9/d47/ld0 19815245 1 2024-02-28T16:27:12.854 INFO:tasks.workunit.client.1.smithi157.stdout:2/818: symlink da/d47/dca/l10d 0 2024-02-28T16:27:12.856 INFO:tasks.workunit.client.1.smithi157.stdout:3/671: sync 2024-02-28T16:27:12.859 INFO:tasks.workunit.client.1.smithi157.stdout:8/715: getdents d1/d5/d43/d86 0 2024-02-28T16:27:12.862 INFO:tasks.workunit.client.1.smithi157.stdout:8/716: dread d1/d5/d23/d53/fdd [0,4194304] 0 2024-02-28T16:27:12.865 INFO:tasks.workunit.client.1.smithi157.stdout:0/784: creat d1/d13/d52/d7b/f10d x:0 0 0 2024-02-28T16:27:12.884 INFO:tasks.workunit.client.1.smithi157.stdout:5/763: dwrite d0/d30/def/d7e/d82/ff8 [0,4194304] 0 2024-02-28T16:27:12.885 INFO:tasks.workunit.client.1.smithi157.stdout:1/725: truncate d10/d11/f32 2491980 0 2024-02-28T16:27:12.889 INFO:tasks.workunit.client.1.smithi157.stdout:9/732: dread d0/d36/d37/d40/d4b/d96/f99 [0,4194304] 0 2024-02-28T16:27:12.890 INFO:tasks.workunit.client.1.smithi157.stdout:4/737: write d3/da/d1f/f63 [4224318,69938] 0 2024-02-28T16:27:12.893 INFO:tasks.workunit.client.1.smithi157.stdout:3/672: dwrite d0/d6/d44/d70/d71/d87/dd1/d9d/fa4 [0,4194304] 0 2024-02-28T16:27:12.897 INFO:tasks.workunit.client.1.smithi157.stdout:1/726: dread - d10/d11/d3a/d5c/d6c/fbd zero size 2024-02-28T16:27:12.897 INFO:tasks.workunit.client.1.smithi157.stdout:4/738: readlink d3/da/d28/l38 0 2024-02-28T16:27:12.897 INFO:tasks.workunit.client.1.smithi157.stdout:8/717: fdatasync d1/d5/d14/f9b 0 2024-02-28T16:27:12.902 INFO:tasks.workunit.client.1.smithi157.stdout:4/739: chown d3/da/l19 296779 1 2024-02-28T16:27:12.908 INFO:tasks.workunit.client.1.smithi157.stdout:3/673: write d0/d6/d44/d70/d71/d87/dd1/d9d/fa4 [3096809,102112] 0 2024-02-28T16:27:12.909 INFO:tasks.workunit.client.1.smithi157.stdout:0/785: getdents d1/da/d6c 0 2024-02-28T16:27:12.910 INFO:tasks.workunit.client.1.smithi157.stdout:4/740: dread d3/da/f4f [0,4194304] 0 2024-02-28T16:27:12.913 INFO:tasks.workunit.client.1.smithi157.stdout:2/819: dread da/d2b/f3d [0,4194304] 0 2024-02-28T16:27:12.916 INFO:tasks.workunit.client.1.smithi157.stdout:1/727: mkdir d10/d11/d31/d2a/d70/de8 0 2024-02-28T16:27:12.918 INFO:tasks.workunit.client.1.smithi157.stdout:7/738: sync 2024-02-28T16:27:12.919 INFO:tasks.workunit.client.1.smithi157.stdout:7/739: chown df/d25/l2f 26 1 2024-02-28T16:27:12.924 INFO:tasks.workunit.client.1.smithi157.stdout:5/764: truncate d0/d9/d1b/d36/f6c 657397 0 2024-02-28T16:27:12.935 INFO:tasks.workunit.client.1.smithi157.stdout:1/728: dwrite f2 [4194304,4194304] 0 2024-02-28T16:27:12.935 INFO:tasks.workunit.client.1.smithi157.stdout:2/820: dread da/d38/d5a/f9f [0,4194304] 0 2024-02-28T16:27:12.941 INFO:tasks.workunit.client.1.smithi157.stdout:7/740: write df/d1f/d37/f49 [6976146,120367] 0 2024-02-28T16:27:12.942 INFO:tasks.workunit.client.1.smithi157.stdout:5/765: symlink d0/d30/df1/l104 0 2024-02-28T16:27:12.945 INFO:tasks.workunit.client.1.smithi157.stdout:8/718: rename d1/d5/dd8/d52/d54/dbc/fc0 to d1/d5/d23/d38/ff3 0 2024-02-28T16:27:12.947 INFO:tasks.workunit.client.1.smithi157.stdout:8/719: dread - d1/d5/d23/d38/d6e/d85/fdc zero size 2024-02-28T16:27:12.949 INFO:tasks.workunit.client.1.smithi157.stdout:3/674: creat d0/d6/d34/fd9 x:0 0 0 2024-02-28T16:27:12.952 INFO:tasks.workunit.client.1.smithi157.stdout:3/675: write d0/d6/d6b/d75/f8a [875708,48259] 0 2024-02-28T16:27:12.955 INFO:tasks.workunit.client.1.smithi157.stdout:3/676: dread - d0/d6/d34/d80/d23/d2b/fb0 zero size 2024-02-28T16:27:12.956 INFO:tasks.workunit.client.1.smithi157.stdout:9/733: dread d0/d19/d30/f4c [0,4194304] 0 2024-02-28T16:27:12.957 INFO:tasks.workunit.client.1.smithi157.stdout:3/677: fdatasync d0/d6/d44/d4b/f9b 0 2024-02-28T16:27:12.957 INFO:tasks.workunit.client.1.smithi157.stdout:0/786: rename d1/d8/d33/d56/fb4 to d1/da/d7d/f10e 0 2024-02-28T16:27:12.958 INFO:tasks.workunit.client.1.smithi157.stdout:9/734: readlink d0/d19/lce 0 2024-02-28T16:27:12.959 INFO:tasks.workunit.client.1.smithi157.stdout:2/821: mknod da/c10e 0 2024-02-28T16:27:12.960 INFO:tasks.workunit.client.1.smithi157.stdout:4/741: dwrite d3/da/f20 [0,4194304] 0 2024-02-28T16:27:12.965 INFO:tasks.workunit.client.1.smithi157.stdout:8/720: rename d1/d5/d23/da1/ld7 to d1/lf4 0 2024-02-28T16:27:12.967 INFO:tasks.workunit.client.1.smithi157.stdout:8/721: readlink d1/d5/d43/l63 0 2024-02-28T16:27:12.967 INFO:tasks.workunit.client.1.smithi157.stdout:1/729: dwrite d10/d11/d3a/d5c/d6c/f9e [0,4194304] 0 2024-02-28T16:27:12.972 INFO:tasks.workunit.client.1.smithi157.stdout:3/678: mknod d0/d6/d34/d80/d23/d2b/d2e/d7e/cda 0 2024-02-28T16:27:12.972 INFO:tasks.workunit.client.1.smithi157.stdout:4/742: mkdir d3/da/d1f/dc1/dc8/dee 0 2024-02-28T16:27:12.974 INFO:tasks.workunit.client.1.smithi157.stdout:5/766: creat d0/d9/d47/f105 x:0 0 0 2024-02-28T16:27:12.977 INFO:tasks.workunit.client.1.smithi157.stdout:9/735: unlink d0/d36/d37/d4d/d92/lf8 0 2024-02-28T16:27:12.977 INFO:tasks.workunit.client.1.smithi157.stdout:7/741: getdents df/d1f/d24/d4f/d72/dab/dd6 0 2024-02-28T16:27:12.980 INFO:tasks.workunit.client.1.smithi157.stdout:1/730: creat d10/d11/d60/fe9 x:0 0 0 2024-02-28T16:27:12.980 INFO:tasks.workunit.client.1.smithi157.stdout:9/736: stat d0/d19/f9d 0 2024-02-28T16:27:12.981 INFO:tasks.workunit.client.1.smithi157.stdout:7/742: chown df/c54 449 1 2024-02-28T16:27:12.983 INFO:tasks.workunit.client.1.smithi157.stdout:2/822: dwrite da/d35/ffa [0,4194304] 0 2024-02-28T16:27:12.985 INFO:tasks.workunit.client.1.smithi157.stdout:1/731: read d10/f12 [1084004,9951] 0 2024-02-28T16:27:12.985 INFO:tasks.workunit.client.1.smithi157.stdout:0/787: rename d1/da/d7d/d98/de2/lec to d1/d13/dc9/l10f 0 2024-02-28T16:27:12.988 INFO:tasks.workunit.client.1.smithi157.stdout:3/679: creat d0/d6/d44/d70/d71/da9/fdb x:0 0 0 2024-02-28T16:27:12.991 INFO:tasks.workunit.client.1.smithi157.stdout:6/721: sync 2024-02-28T16:27:12.992 INFO:tasks.workunit.client.1.smithi157.stdout:0/788: write d1/da/d7d/fca [333611,58246] 0 2024-02-28T16:27:12.993 INFO:tasks.workunit.client.1.smithi157.stdout:1/732: fsync d10/d11/d3a/d5c/d6a/db4/d91/f93 0 2024-02-28T16:27:13.001 INFO:tasks.workunit.client.1.smithi157.stdout:7/743: rename df/d4b/d4c/ca4 to df/d1f/d24/d4f/d72/ceb 0 2024-02-28T16:27:13.003 INFO:tasks.workunit.client.1.smithi157.stdout:6/722: write d2/d7/de/d1b/d3d/da4/f3b [1034734,35123] 0 2024-02-28T16:27:13.006 INFO:tasks.workunit.client.1.smithi157.stdout:8/722: truncate d1/d5/dd8/f84 4074399 0 2024-02-28T16:27:13.009 INFO:tasks.workunit.client.1.smithi157.stdout:8/723: stat d1/d5/d23/d38/d67/cd2 0 2024-02-28T16:27:13.009 INFO:tasks.workunit.client.1.smithi157.stdout:5/767: dread d0/d9/d1b/d36/f53 [0,4194304] 0 2024-02-28T16:27:13.011 INFO:tasks.workunit.client.1.smithi157.stdout:6/723: dread d2/d7/d8/da/d71/d80/f81 [0,4194304] 0 2024-02-28T16:27:13.016 INFO:tasks.workunit.client.1.smithi157.stdout:4/743: dread d3/da/f2d [0,4194304] 0 2024-02-28T16:27:13.018 INFO:tasks.workunit.client.1.smithi157.stdout:2/823: dwrite da/d38/f75 [0,4194304] 0 2024-02-28T16:27:13.021 INFO:tasks.workunit.client.1.smithi157.stdout:2/824: dread da/d38/d7e/feb [0,4194304] 0 2024-02-28T16:27:13.024 INFO:tasks.workunit.client.1.smithi157.stdout:7/744: rmdir df/d40 39 2024-02-28T16:27:13.024 INFO:tasks.workunit.client.1.smithi157.stdout:2/825: chown da/f46 360568919 1 2024-02-28T16:27:13.026 INFO:tasks.workunit.client.1.smithi157.stdout:1/733: rename d10/fc8 to d10/d11/d31/d2a/d70/de8/fea 0 2024-02-28T16:27:13.027 INFO:tasks.workunit.client.1.smithi157.stdout:8/724: dwrite d1/d5/f4a [0,4194304] 0 2024-02-28T16:27:13.032 INFO:tasks.workunit.client.1.smithi157.stdout:5/768: dread d0/d30/da0/dfd/f80 [0,4194304] 0 2024-02-28T16:27:13.033 INFO:tasks.workunit.client.1.smithi157.stdout:0/789: read d1/d8/f2c [1655872,9914] 0 2024-02-28T16:27:13.034 INFO:tasks.workunit.client.1.smithi157.stdout:6/724: truncate d2/d7/de/d1b/fba 4485080 0 2024-02-28T16:27:13.041 INFO:tasks.workunit.client.1.smithi157.stdout:3/680: creat d0/d6/d6b/fdc x:0 0 0 2024-02-28T16:27:13.049 INFO:tasks.workunit.client.1.smithi157.stdout:4/744: rename d3/f8a to d3/da/d48/d8e/db1/fef 0 2024-02-28T16:27:13.049 INFO:tasks.workunit.client.1.smithi157.stdout:4/745: fdatasync d3/d77/fe3 0 2024-02-28T16:27:13.050 INFO:tasks.workunit.client.1.smithi157.stdout:2/826: creat da/d47/dbd/dde/f10f x:0 0 0 2024-02-28T16:27:13.051 INFO:tasks.workunit.client.1.smithi157.stdout:7/745: mkdir df/d1f/d24/d4f/d72/dab/dec 0 2024-02-28T16:27:13.052 INFO:tasks.workunit.client.1.smithi157.stdout:7/746: chown df/d1f/d24/d39/d64 137 1 2024-02-28T16:27:13.054 INFO:tasks.workunit.client.1.smithi157.stdout:1/734: creat d10/d11/d31/d7f/feb x:0 0 0 2024-02-28T16:27:13.055 INFO:tasks.workunit.client.1.smithi157.stdout:8/725: creat d1/d5/d43/d86/ff5 x:0 0 0 2024-02-28T16:27:13.056 INFO:tasks.workunit.client.1.smithi157.stdout:1/735: write d10/d11/d3a/d5c/d6c/d7b/f1e [7492277,17068] 0 2024-02-28T16:27:13.061 INFO:tasks.workunit.client.1.smithi157.stdout:0/790: symlink d1/da/d7d/d98/de2/l110 0 2024-02-28T16:27:13.062 INFO:tasks.workunit.client.1.smithi157.stdout:0/791: chown d1/d13/d52/d7b 24 1 2024-02-28T16:27:13.064 INFO:tasks.workunit.client.1.smithi157.stdout:9/737: getdents d0/d36/daa 0 2024-02-28T16:27:13.070 INFO:tasks.workunit.client.1.smithi157.stdout:4/746: creat d3/da/d48/d8e/ff0 x:0 0 0 2024-02-28T16:27:13.073 INFO:tasks.workunit.client.1.smithi157.stdout:7/747: unlink df/d1f/d24/c34 0 2024-02-28T16:27:13.077 INFO:tasks.workunit.client.1.smithi157.stdout:8/726: symlink d1/lf6 0 2024-02-28T16:27:13.079 INFO:tasks.workunit.client.1.smithi157.stdout:1/736: mkdir d10/d11/d31/d2a/d70/de8/dec 0 2024-02-28T16:27:13.089 INFO:tasks.workunit.client.1.smithi157.stdout:1/737: fsync fa 0 2024-02-28T16:27:13.093 INFO:tasks.workunit.client.1.smithi157.stdout:6/725: rename d2/d7/de/d1b/d3d/da4 to d2/d7/d8/dd4 0 2024-02-28T16:27:13.097 INFO:tasks.workunit.client.1.smithi157.stdout:2/827: dwrite da/f96 [0,4194304] 0 2024-02-28T16:27:13.100 INFO:tasks.workunit.client.1.smithi157.stdout:7/748: write df/d80/d84/f9c [991788,34930] 0 2024-02-28T16:27:13.101 INFO:tasks.workunit.client.1.smithi157.stdout:2/828: dread da/d38/d5a/d79/fb1 [0,4194304] 0 2024-02-28T16:27:13.102 INFO:tasks.workunit.client.1.smithi157.stdout:0/792: truncate d1/da/d7d/fca 292983 0 2024-02-28T16:27:13.106 INFO:tasks.workunit.client.1.smithi157.stdout:1/738: mknod d10/d11/d3a/d5c/d84/dd4/ced 0 2024-02-28T16:27:13.108 INFO:tasks.workunit.client.1.smithi157.stdout:4/747: truncate d3/da/f20 4055030 0 2024-02-28T16:27:13.118 INFO:tasks.workunit.client.1.smithi157.stdout:2/829: symlink da/d38/d7e/d92/l110 0 2024-02-28T16:27:13.121 INFO:tasks.workunit.client.1.smithi157.stdout:1/739: creat d10/d11/d3a/d5c/d6a/fee x:0 0 0 2024-02-28T16:27:13.124 INFO:tasks.workunit.client.1.smithi157.stdout:4/748: dwrite d3/da/d37/d71/f73 [4194304,4194304] 0 2024-02-28T16:27:13.129 INFO:tasks.workunit.client.1.smithi157.stdout:7/749: symlink df/d40/led 0 2024-02-28T16:27:13.132 INFO:tasks.workunit.client.1.smithi157.stdout:3/681: rename d0/d6/d34/d80/d23/c25 to d0/d6/d34/d80/cdd 0 2024-02-28T16:27:13.135 INFO:tasks.workunit.client.1.smithi157.stdout:1/740: rmdir d10/d11/d3a/d5c 39 2024-02-28T16:27:13.136 INFO:tasks.workunit.client.1.smithi157.stdout:3/682: read - d0/d6/d34/d80/d23/d2b/fab zero size 2024-02-28T16:27:13.136 INFO:tasks.workunit.client.1.smithi157.stdout:2/830: mknod da/d38/d3e/c111 0 2024-02-28T16:27:13.137 INFO:tasks.workunit.client.1.smithi157.stdout:7/750: creat df/d25/d79/d9e/fee x:0 0 0 2024-02-28T16:27:13.138 INFO:tasks.workunit.client.1.smithi157.stdout:2/831: dread - da/d38/d7e/dbb/fef zero size 2024-02-28T16:27:13.139 INFO:tasks.workunit.client.1.smithi157.stdout:1/741: truncate d10/f12 1519844 0 2024-02-28T16:27:13.140 INFO:tasks.workunit.client.1.smithi157.stdout:4/749: mknod d3/da/d1f/dc1/dc8/dee/cf1 0 2024-02-28T16:27:13.141 INFO:tasks.workunit.client.1.smithi157.stdout:0/793: getdents d1/d13/d57 0 2024-02-28T16:27:13.141 INFO:tasks.workunit.client.1.smithi157.stdout:7/751: truncate df/d1f/d24/d39/fde 435420 0 2024-02-28T16:27:13.143 INFO:tasks.workunit.client.1.smithi157.stdout:7/752: chown df/d1f/d24/d4f/d72/dab/dec 3741 1 2024-02-28T16:27:13.143 INFO:tasks.workunit.client.1.smithi157.stdout:7/753: readlink df/d25/lc1 0 2024-02-28T16:27:13.144 INFO:tasks.workunit.client.1.smithi157.stdout:9/738: rename d0/d36/d37/d40/c4e to d0/d36/dc2/dc8/dea/cfb 0 2024-02-28T16:27:13.144 INFO:tasks.workunit.client.1.smithi157.stdout:7/754: readlink l7 0 2024-02-28T16:27:13.145 INFO:tasks.workunit.client.1.smithi157.stdout:7/755: readlink df/d1f/d37/d46/l6c 0 2024-02-28T16:27:13.146 INFO:tasks.workunit.client.1.smithi157.stdout:3/683: mkdir d0/dde 0 2024-02-28T16:27:13.146 INFO:tasks.workunit.client.1.smithi157.stdout:7/756: readlink df/d25/l2f 0 2024-02-28T16:27:13.146 INFO:tasks.workunit.client.1.smithi157.stdout:2/832: dread da/d38/d7e/d92/f9d [0,4194304] 0 2024-02-28T16:27:13.185 INFO:tasks.workunit.client.1.smithi157.stdout:9/739: write d0/fab [1123777,128972] 0 2024-02-28T16:27:13.185 INFO:tasks.workunit.client.1.smithi157.stdout:6/726: rename d2/d7/l98 to d2/d7/d8/da/d71/d8f/db4/ld5 0 2024-02-28T16:27:13.185 INFO:tasks.workunit.client.1.smithi157.stdout:5/769: sync 2024-02-28T16:27:13.186 INFO:tasks.workunit.client.1.smithi157.stdout:0/794: symlink d1/d8/da8/dff/l111 0 2024-02-28T16:27:13.186 INFO:tasks.workunit.client.1.smithi157.stdout:3/684: creat d0/d6/d1e/fdf x:0 0 0 2024-02-28T16:27:13.189 INFO:tasks.workunit.client.1.smithi157.stdout:5/770: dread - d0/d9/d47/f96 zero size 2024-02-28T16:27:13.189 INFO:tasks.workunit.client.1.smithi157.stdout:1/742: rename d10/d11/f8e to d10/d11/d3a/d95/da4/fef 0 2024-02-28T16:27:13.190 INFO:tasks.workunit.client.1.smithi157.stdout:3/685: write d0/d6/d44/d4b/da6/fb5 [1535497,75206] 0 2024-02-28T16:27:13.193 INFO:tasks.workunit.client.1.smithi157.stdout:7/757: creat df/d1f/d24/d4f/d72/dab/fef x:0 0 0 2024-02-28T16:27:13.194 INFO:tasks.workunit.client.1.smithi157.stdout:7/758: chown df/d1f/d24/d4f/d72/dab 161 1 2024-02-28T16:27:13.204 INFO:tasks.workunit.client.1.smithi157.stdout:1/743: rmdir d10/d11/d3a/d95/da4/dd8 39 2024-02-28T16:27:13.214 INFO:tasks.workunit.client.1.smithi157.stdout:6/727: mkdir d2/d7/d8/da/d31/dd6 0 2024-02-28T16:27:13.215 INFO:tasks.workunit.client.1.smithi157.stdout:5/771: dread d0/d9/d47/f4f [0,4194304] 0 2024-02-28T16:27:13.215 INFO:tasks.workunit.client.1.smithi157.stdout:0/795: truncate d1/d13/d46/f4f 1174493 0 2024-02-28T16:27:13.220 INFO:tasks.workunit.client.1.smithi157.stdout:9/740: write d0/d19/f1c [75665,127358] 0 2024-02-28T16:27:13.220 INFO:tasks.workunit.client.1.smithi157.stdout:7/759: creat df/d1f/d24/d4f/d72/dab/dec/ff0 x:0 0 0 2024-02-28T16:27:13.222 INFO:tasks.workunit.client.1.smithi157.stdout:1/744: truncate d10/d11/d31/d2a/d70/f9c 2054664 0 2024-02-28T16:27:13.223 INFO:tasks.workunit.client.1.smithi157.stdout:7/760: readlink df/d80/d84/l98 0 2024-02-28T16:27:13.223 INFO:tasks.workunit.client.1.smithi157.stdout:6/728: rmdir d2/d7/d8/dd4/d66 39 2024-02-28T16:27:13.225 INFO:tasks.workunit.client.1.smithi157.stdout:3/686: rename d0/d6/d34/d80/d23/d2b/d2e/fc4 to d0/d6/d44/fe0 0 2024-02-28T16:27:13.225 INFO:tasks.workunit.client.1.smithi157.stdout:0/796: rmdir d1/d8/da8/dff 39 2024-02-28T16:27:13.226 INFO:tasks.workunit.client.1.smithi157.stdout:1/745: write d10/d11/d22/f62 [4109056,28033] 0 2024-02-28T16:27:13.227 INFO:tasks.workunit.client.1.smithi157.stdout:7/761: write df/d1f/d24/d39/fd4 [992032,114277] 0 2024-02-28T16:27:13.228 INFO:tasks.workunit.client.1.smithi157.stdout:2/833: getdents da/d38/d7e/d92 0 2024-02-28T16:27:13.235 INFO:tasks.workunit.client.1.smithi157.stdout:5/772: mkdir d0/d30/da0/dfd/d106 0 2024-02-28T16:27:13.237 INFO:tasks.workunit.client.1.smithi157.stdout:3/687: read d0/d6/f5f [252635,95904] 0 2024-02-28T16:27:13.242 INFO:tasks.workunit.client.1.smithi157.stdout:7/762: mknod df/cf1 0 2024-02-28T16:27:13.242 INFO:tasks.workunit.client.1.smithi157.stdout:1/746: mknod d10/d11/d3a/d5c/d6c/cf0 0 2024-02-28T16:27:13.243 INFO:tasks.workunit.client.1.smithi157.stdout:6/729: creat d2/d7/d8/da/fd7 x:0 0 0 2024-02-28T16:27:13.246 INFO:tasks.workunit.client.1.smithi157.stdout:3/688: mknod d0/d6/d1e/ce1 0 2024-02-28T16:27:13.248 INFO:tasks.workunit.client.1.smithi157.stdout:1/747: fdatasync d10/d11/d22/faa 0 2024-02-28T16:27:13.250 INFO:tasks.workunit.client.1.smithi157.stdout:2/834: dread da/d38/d3e/d9b/ff3 [0,4194304] 0 2024-02-28T16:27:13.251 INFO:tasks.workunit.client.1.smithi157.stdout:7/763: mkdir df/d1f/d24/d39/df2 0 2024-02-28T16:27:13.252 INFO:tasks.workunit.client.1.smithi157.stdout:6/730: read d2/d7/d8/dd4/d66/f84 [3514753,53979] 0 2024-02-28T16:27:13.256 INFO:tasks.workunit.client.1.smithi157.stdout:0/797: dwrite d1/d13/d46/f51 [4194304,4194304] 0 2024-02-28T16:27:13.256 INFO:tasks.workunit.client.1.smithi157.stdout:5/773: dwrite d0/d9/d1b/d36/fda [0,4194304] 0 2024-02-28T16:27:13.259 INFO:tasks.workunit.client.1.smithi157.stdout:7/764: mknod df/d1f/d37/d46/cf3 0 2024-02-28T16:27:13.260 INFO:tasks.workunit.client.1.smithi157.stdout:0/798: read d1/d13/dc9/df9/d55/f5f [5664258,70351] 0 2024-02-28T16:27:13.264 INFO:tasks.workunit.client.1.smithi157.stdout:6/731: creat d2/d7/d8/da/d71/d93/fd8 x:0 0 0 2024-02-28T16:27:13.267 INFO:tasks.workunit.client.1.smithi157.stdout:5/774: symlink d0/d9/d47/d5b/d89/l107 0 2024-02-28T16:27:13.275 INFO:tasks.workunit.client.1.smithi157.stdout:3/689: getdents d0/d6 0 2024-02-28T16:27:13.277 INFO:tasks.workunit.client.1.smithi157.stdout:6/732: creat d2/d7/d8/da/d71/d8f/db4/fd9 x:0 0 0 2024-02-28T16:27:13.278 INFO:tasks.workunit.client.1.smithi157.stdout:5/775: write d0/d30/d50/f63 [337604,96925] 0 2024-02-28T16:27:13.279 INFO:tasks.workunit.client.1.smithi157.stdout:1/748: link d10/d11/d3a/d5c/d6a/db4/la5 d10/d11/d7e/lf1 0 2024-02-28T16:27:13.281 INFO:tasks.workunit.client.1.smithi157.stdout:5/776: dread - d0/d30/def/d7e/d82/fa6 zero size 2024-02-28T16:27:13.281 INFO:tasks.workunit.client.1.smithi157.stdout:7/765: symlink df/d1f/d24/de9/lf4 0 2024-02-28T16:27:13.282 INFO:tasks.workunit.client.1.smithi157.stdout:1/749: chown d10/d11/d3a/d5c/d6a/db4/fc6 1615074 1 2024-02-28T16:27:13.283 INFO:tasks.workunit.client.1.smithi157.stdout:2/835: dread da/d38/d4e/f63 [0,4194304] 0 2024-02-28T16:27:13.283 INFO:tasks.workunit.client.1.smithi157.stdout:8/727: sync 2024-02-28T16:27:13.286 INFO:tasks.workunit.client.1.smithi157.stdout:2/836: fsync da/d38/d5a/d79/fda 0 2024-02-28T16:27:13.290 INFO:tasks.workunit.client.1.smithi157.stdout:3/690: fdatasync d0/f4d 0 2024-02-28T16:27:13.293 INFO:tasks.workunit.client.1.smithi157.stdout:2/837: rmdir da/d38/d7e 39 2024-02-28T16:27:13.293 INFO:tasks.workunit.client.1.smithi157.stdout:6/733: dread d2/d7/de/d1b/d4d/d6c/f95 [0,4194304] 0 2024-02-28T16:27:13.294 INFO:tasks.workunit.client.1.smithi157.stdout:5/777: rename d0/d9/d47/d5b/d89/d75/dab/fc2 to d0/d9/d47/d5b/d89/d75/dab/f108 0 2024-02-28T16:27:13.300 INFO:tasks.workunit.client.1.smithi157.stdout:7/766: getdents df/d1f/d24/d38 0 2024-02-28T16:27:13.300 INFO:tasks.workunit.client.1.smithi157.stdout:5/778: rmdir d0/d30/da0/dd4 39 2024-02-28T16:27:13.301 INFO:tasks.workunit.client.1.smithi157.stdout:0/799: truncate d1/d13/d46/d99/fa4 2916513 0 2024-02-28T16:27:13.304 INFO:tasks.workunit.client.1.smithi157.stdout:1/750: dwrite d10/d11/f28 [0,4194304] 0 2024-02-28T16:27:13.305 INFO:tasks.workunit.client.1.smithi157.stdout:6/734: unlink d2/d7/d8/da/d31/d3a/ld1 0 2024-02-28T16:27:13.307 INFO:tasks.workunit.client.1.smithi157.stdout:8/728: dwrite d1/d5/f70 [0,4194304] 0 2024-02-28T16:27:13.310 INFO:tasks.workunit.client.1.smithi157.stdout:7/767: creat df/d1f/d24/de9/ff5 x:0 0 0 2024-02-28T16:27:13.313 INFO:tasks.workunit.client.1.smithi157.stdout:3/691: dwrite d0/d6/d34/fc9 [0,4194304] 0 2024-02-28T16:27:13.315 INFO:tasks.workunit.client.1.smithi157.stdout:0/800: chown d1/d13/d52/f104 442 1 2024-02-28T16:27:13.318 INFO:tasks.workunit.client.1.smithi157.stdout:2/838: write da/d8c/dc0/fe3 [340963,97359] 0 2024-02-28T16:27:13.322 INFO:tasks.workunit.client.1.smithi157.stdout:5/779: truncate d0/d9/d1b/fa4 442574 0 2024-02-28T16:27:13.322 INFO:tasks.workunit.client.1.smithi157.stdout:3/692: creat d0/d6/d44/d48/fe2 x:0 0 0 2024-02-28T16:27:13.323 INFO:tasks.workunit.client.1.smithi157.stdout:8/729: truncate d1/d5/d14/fad 578012 0 2024-02-28T16:27:13.329 INFO:tasks.workunit.client.1.smithi157.stdout:1/751: getdents d10/d11/d22/d99 0 2024-02-28T16:27:13.332 INFO:tasks.workunit.client.1.smithi157.stdout:5/780: creat d0/d30/d50/df0/f109 x:0 0 0 2024-02-28T16:27:13.333 INFO:tasks.workunit.client.1.smithi157.stdout:0/801: link d1/d13/d57/ldf d1/d8/da8/dff/l112 0 2024-02-28T16:27:13.334 INFO:tasks.workunit.client.1.smithi157.stdout:5/781: fdatasync d0/d9/d47/d5b/d89/fc9 0 2024-02-28T16:27:13.340 INFO:tasks.workunit.client.1.smithi157.stdout:2/839: getdents da/d38/d5a 0 2024-02-28T16:27:13.340 INFO:tasks.workunit.client.1.smithi157.stdout:6/735: write d2/d7/d8/f56 [3377115,51238] 0 2024-02-28T16:27:13.340 INFO:tasks.workunit.client.1.smithi157.stdout:8/730: creat d1/d5/dd8/d52/ff7 x:0 0 0 2024-02-28T16:27:13.341 INFO:tasks.workunit.client.1.smithi157.stdout:6/736: fdatasync d2/d17/f21 0 2024-02-28T16:27:13.344 INFO:tasks.workunit.client.1.smithi157.stdout:1/752: symlink d10/d11/d31/lf2 0 2024-02-28T16:27:13.347 INFO:tasks.workunit.client.1.smithi157.stdout:1/753: dread - d10/d11/d3a/d5c/d84/fb5 zero size 2024-02-28T16:27:13.348 INFO:tasks.workunit.client.1.smithi157.stdout:2/840: mknod da/d47/c112 0 2024-02-28T16:27:13.348 INFO:tasks.workunit.client.1.smithi157.stdout:0/802: rename d1/da/d7d/fcd to d1/da/d7d/d98/de2/f113 0 2024-02-28T16:27:13.352 INFO:tasks.workunit.client.1.smithi157.stdout:3/693: dwrite d0/f4d [0,4194304] 0 2024-02-28T16:27:13.353 INFO:tasks.workunit.client.1.smithi157.stdout:6/737: rmdir d2/d7/d8/da 39 2024-02-28T16:27:13.357 INFO:tasks.workunit.client.1.smithi157.stdout:7/768: dread df/d1f/d37/fa2 [0,4194304] 0 2024-02-28T16:27:13.362 INFO:tasks.workunit.client.1.smithi157.stdout:2/841: creat da/d38/df1/df4/f113 x:0 0 0 2024-02-28T16:27:13.364 INFO:tasks.workunit.client.1.smithi157.stdout:5/782: write d0/d9/f86 [1449786,29069] 0 2024-02-28T16:27:13.365 INFO:tasks.workunit.client.1.smithi157.stdout:6/738: creat d2/d7/d8/dd4/d8c/fda x:0 0 0 2024-02-28T16:27:13.366 INFO:tasks.workunit.client.1.smithi157.stdout:7/769: rmdir df/d4b 39 2024-02-28T16:27:13.369 INFO:tasks.workunit.client.1.smithi157.stdout:0/803: write d1/d13/fe [244173,106660] 0 2024-02-28T16:27:13.369 INFO:tasks.workunit.client.1.smithi157.stdout:2/842: symlink da/d38/d5a/d79/l114 0 2024-02-28T16:27:13.373 INFO:tasks.workunit.client.1.smithi157.stdout:2/843: chown da/d2b/d59/fbc 2 1 2024-02-28T16:27:13.374 INFO:tasks.workunit.client.1.smithi157.stdout:3/694: dwrite d0/d6/d34/d80/d23/d2b/fb0 [0,4194304] 0 2024-02-28T16:27:13.374 INFO:tasks.workunit.client.1.smithi157.stdout:5/783: symlink d0/d9/d47/d5b/df4/l10a 0 2024-02-28T16:27:13.375 INFO:tasks.workunit.client.1.smithi157.stdout:6/739: write d2/d7/d8/da/d71/d8f/f85 [8921310,13752] 0 2024-02-28T16:27:13.377 INFO:tasks.workunit.client.1.smithi157.stdout:6/740: chown d2/d7/de/d1b/f28 1848 1 2024-02-28T16:27:13.378 INFO:tasks.workunit.client.1.smithi157.stdout:2/844: write da/d38/d5a/d69/f95 [4233329,3484] 0 2024-02-28T16:27:13.379 INFO:tasks.workunit.client.1.smithi157.stdout:0/804: chown d1/d13/d52/d53/cfb 5347 1 2024-02-28T16:27:13.380 INFO:tasks.workunit.client.1.smithi157.stdout:3/695: stat d0/d6/d44/l55 0 2024-02-28T16:27:13.384 INFO:tasks.workunit.client.1.smithi157.stdout:3/696: chown d0/d6/d34/d80/d23/d2b/f32 159 1 2024-02-28T16:27:13.385 INFO:tasks.workunit.client.1.smithi157.stdout:2/845: unlink da/d2b/l60 0 2024-02-28T16:27:13.387 INFO:tasks.workunit.client.1.smithi157.stdout:1/754: dread d10/d11/d31/d2a/fbb [0,4194304] 0 2024-02-28T16:27:13.387 INFO:tasks.workunit.client.1.smithi157.stdout:6/741: creat d2/d7/d8/da/d31/dd6/fdb x:0 0 0 2024-02-28T16:27:13.388 INFO:tasks.workunit.client.1.smithi157.stdout:3/697: truncate d0/d6/f17 1389983 0 2024-02-28T16:27:13.389 INFO:tasks.workunit.client.1.smithi157.stdout:1/755: dread - d10/d11/d3a/d95/da4/fd5 zero size 2024-02-28T16:27:13.389 INFO:tasks.workunit.client.1.smithi157.stdout:2/846: creat da/d47/dbd/dde/f115 x:0 0 0 2024-02-28T16:27:13.390 INFO:tasks.workunit.client.1.smithi157.stdout:0/805: rename d1/d13/df8 to d1/d13/d7f/d114 0 2024-02-28T16:27:13.393 INFO:tasks.workunit.client.1.smithi157.stdout:1/756: unlink d10/d11/d31/d2a/l56 0 2024-02-28T16:27:13.395 INFO:tasks.workunit.client.1.smithi157.stdout:2/847: mknod da/d38/d3e/c116 0 2024-02-28T16:27:13.397 INFO:tasks.workunit.client.1.smithi157.stdout:3/698: getdents d0/d6/d34/d80/d23 0 2024-02-28T16:27:13.398 INFO:tasks.workunit.client.1.smithi157.stdout:1/757: symlink d10/d11/d22/d99/dbf/lf3 0 2024-02-28T16:27:13.400 INFO:tasks.workunit.client.1.smithi157.stdout:1/758: dread - d10/d11/d22/d99/dab/fdf zero size 2024-02-28T16:27:13.400 INFO:tasks.workunit.client.1.smithi157.stdout:3/699: creat d0/d6/d1e/fe3 x:0 0 0 2024-02-28T16:27:13.403 INFO:tasks.workunit.client.1.smithi157.stdout:3/700: mknod d0/d6/d44/d8e/da8/ce4 0 2024-02-28T16:27:13.405 INFO:tasks.workunit.client.1.smithi157.stdout:1/759: mknod d10/d11/d3a/d5c/d6a/db4/d91/dbe/cf4 0 2024-02-28T16:27:13.405 INFO:tasks.workunit.client.1.smithi157.stdout:5/784: dread d0/fe [0,4194304] 0 2024-02-28T16:27:13.407 INFO:tasks.workunit.client.1.smithi157.stdout:3/701: symlink d0/d6/d44/d8e/da8/le5 0 2024-02-28T16:27:13.408 INFO:tasks.workunit.client.1.smithi157.stdout:1/760: creat d10/d11/d60/ff5 x:0 0 0 2024-02-28T16:27:13.410 INFO:tasks.workunit.client.1.smithi157.stdout:5/785: mknod d0/d9/d1b/d36/daf/c10b 0 2024-02-28T16:27:13.410 INFO:tasks.workunit.client.1.smithi157.stdout:1/761: fdatasync d10/d11/d31/f41 0 2024-02-28T16:27:13.411 INFO:tasks.workunit.client.1.smithi157.stdout:1/762: chown d10/f6b 160 1 2024-02-28T16:27:13.411 INFO:tasks.workunit.client.1.smithi157.stdout:5/786: stat d0/d30/d50/df0/f109 0 2024-02-28T16:27:13.412 INFO:tasks.workunit.client.1.smithi157.stdout:0/806: dread d1/d13/f73 [0,4194304] 0 2024-02-28T16:27:13.417 INFO:tasks.workunit.client.1.smithi157.stdout:5/787: rmdir d0/d9/d47/d5b/d89 39 2024-02-28T16:27:13.419 INFO:tasks.workunit.client.1.smithi157.stdout:5/788: write d0/d30/def/fa8 [1104454,17403] 0 2024-02-28T16:27:13.419 INFO:tasks.workunit.client.1.smithi157.stdout:1/763: creat d10/d11/d31/d2a/d70/de8/ff6 x:0 0 0 2024-02-28T16:27:13.428 INFO:tasks.workunit.client.1.smithi157.stdout:1/764: symlink d10/d11/lf7 0 2024-02-28T16:27:13.429 INFO:tasks.workunit.client.1.smithi157.stdout:1/765: stat d10/d11/d3a/f3c 0 2024-02-28T16:27:13.433 INFO:tasks.workunit.client.1.smithi157.stdout:5/789: dwrite d0/d30/d50/d7f/f8d [0,4194304] 0 2024-02-28T16:27:13.434 INFO:tasks.workunit.client.1.smithi157.stdout:1/766: symlink d10/d11/d3a/d5c/d84/lf8 0 2024-02-28T16:27:13.436 INFO:tasks.workunit.client.1.smithi157.stdout:1/767: chown d10/d11/d3a/d5c/d6c/d7b 3 1 2024-02-28T16:27:13.438 INFO:tasks.workunit.client.1.smithi157.stdout:9/741: sync 2024-02-28T16:27:13.438 INFO:tasks.workunit.client.1.smithi157.stdout:4/750: sync 2024-02-28T16:27:13.438 INFO:tasks.workunit.client.1.smithi157.stdout:1/768: rmdir d10/d11/d22 39 2024-02-28T16:27:13.439 INFO:tasks.workunit.client.1.smithi157.stdout:4/751: stat d3/d8b/feb 0 2024-02-28T16:27:13.442 INFO:tasks.workunit.client.1.smithi157.stdout:5/790: truncate d0/d9/f2c 4208223 0 2024-02-28T16:27:13.447 INFO:tasks.workunit.client.1.smithi157.stdout:9/742: symlink d0/d36/d37/d40/d5b/lfc 0 2024-02-28T16:27:13.448 INFO:tasks.workunit.client.1.smithi157.stdout:3/702: write d0/d6/d44/d48/f7f [1179424,102476] 0 2024-02-28T16:27:13.449 INFO:tasks.workunit.client.1.smithi157.stdout:4/752: creat d3/da/d37/d84/dc9/ff2 x:0 0 0 2024-02-28T16:27:13.450 INFO:tasks.workunit.client.1.smithi157.stdout:9/743: stat d0/d36/d37/d40/d5b/dba/fd2 0 2024-02-28T16:27:13.450 INFO:tasks.workunit.client.1.smithi157.stdout:4/753: stat d3/da/d1f/c59 0 2024-02-28T16:27:13.451 INFO:tasks.workunit.client.1.smithi157.stdout:3/703: dread - d0/d6/d44/d70/d71/da9/fdb zero size 2024-02-28T16:27:13.452 INFO:tasks.workunit.client.1.smithi157.stdout:1/769: fdatasync d10/d11/d22/f69 0 2024-02-28T16:27:13.454 INFO:tasks.workunit.client.1.smithi157.stdout:0/807: write d1/da/d7d/fca [558022,91563] 0 2024-02-28T16:27:13.455 INFO:tasks.workunit.client.1.smithi157.stdout:4/754: chown d3/da/d28/c86 48412 1 2024-02-28T16:27:13.458 INFO:tasks.workunit.client.1.smithi157.stdout:3/704: read - d0/d6/d44/d8e/da8/f9a zero size 2024-02-28T16:27:13.459 INFO:tasks.workunit.client.1.smithi157.stdout:9/744: symlink d0/d36/d37/d4d/lfd 0 2024-02-28T16:27:13.461 INFO:tasks.workunit.client.1.smithi157.stdout:9/745: fdatasync d0/d36/d3f/f6c 0 2024-02-28T16:27:13.461 INFO:tasks.workunit.client.1.smithi157.stdout:3/705: write d0/d6/d34/d80/d5c/d99/fce [1040734,97022] 0 2024-02-28T16:27:13.468 INFO:tasks.workunit.client.1.smithi157.stdout:1/770: write d10/d11/d3a/d5c/d6a/db4/f7d [4223632,53815] 0 2024-02-28T16:27:13.469 INFO:tasks.workunit.client.1.smithi157.stdout:5/791: dwrite d0/d9/d47/d5b/d89/d75/f9b [0,4194304] 0 2024-02-28T16:27:13.470 INFO:tasks.workunit.client.1.smithi157.stdout:1/771: stat d10/d11/d3a/d5c/l85 0 2024-02-28T16:27:13.472 INFO:tasks.workunit.client.1.smithi157.stdout:1/772: stat d10/d11/d3a/d95/fe3 0 2024-02-28T16:27:13.474 INFO:tasks.workunit.client.1.smithi157.stdout:0/808: rename d1/d13/d46/d99/cbf to d1/da/c115 0 2024-02-28T16:27:13.476 INFO:tasks.workunit.client.1.smithi157.stdout:1/773: read d10/d11/d31/f80 [2103497,21024] 0 2024-02-28T16:27:13.479 INFO:tasks.workunit.client.1.smithi157.stdout:9/746: truncate d0/d36/d37/d4d/d92/fbf 4161246 0 2024-02-28T16:27:13.485 INFO:tasks.workunit.client.1.smithi157.stdout:0/809: creat d1/d13/d52/db5/d8e/f116 x:0 0 0 2024-02-28T16:27:13.490 INFO:tasks.workunit.client.1.smithi157.stdout:3/706: rename d0/c3 to d0/d6/d34/d80/d5c/ce6 0 2024-02-28T16:27:13.493 INFO:tasks.workunit.client.1.smithi157.stdout:9/747: mkdir d0/d36/d37/d40/d5b/dba/dfe 0 2024-02-28T16:27:13.494 INFO:tasks.workunit.client.1.smithi157.stdout:3/707: chown d0/d6/d44/d48/f4e 220 1 2024-02-28T16:27:13.495 INFO:tasks.workunit.client.1.smithi157.stdout:5/792: dwrite d0/d30/def/fb [0,4194304] 0 2024-02-28T16:27:13.498 INFO:tasks.workunit.client.1.smithi157.stdout:0/810: rename d1/d13/d46/f51 to d1/d8/d33/d96/f117 0 2024-02-28T16:27:13.499 INFO:tasks.workunit.client.1.smithi157.stdout:3/708: symlink d0/d6/d44/d4b/da6/le7 0 2024-02-28T16:27:13.501 INFO:tasks.workunit.client.1.smithi157.stdout:3/709: readlink d0/d6/d34/d80/l2f 0 2024-02-28T16:27:13.501 INFO:tasks.workunit.client.1.smithi157.stdout:0/811: read d1/d13/dc9/df9/f2b [4826841,92215] 0 2024-02-28T16:27:13.502 INFO:tasks.workunit.client.1.smithi157.stdout:1/774: creat d10/d11/d31/d7f/ff9 x:0 0 0 2024-02-28T16:27:13.505 INFO:tasks.workunit.client.1.smithi157.stdout:5/793: creat d0/d9/d3a/de5/f10c x:0 0 0 2024-02-28T16:27:13.507 INFO:tasks.workunit.client.1.smithi157.stdout:5/794: read d0/d30/def/fa8 [925259,114541] 0 2024-02-28T16:27:13.510 INFO:tasks.workunit.client.1.smithi157.stdout:9/748: getdents d0 0 2024-02-28T16:27:13.512 INFO:tasks.workunit.client.1.smithi157.stdout:3/710: link d0/d6/d34/fc9 d0/d6/d34/d43/dac/fe8 0 2024-02-28T16:27:13.515 INFO:tasks.workunit.client.1.smithi157.stdout:0/812: mknod d1/d8/d33/c118 0 2024-02-28T16:27:13.516 INFO:tasks.workunit.client.1.smithi157.stdout:0/813: readlink d1/d13/l88 0 2024-02-28T16:27:13.517 INFO:tasks.workunit.client.1.smithi157.stdout:0/814: chown d1/d13/d46/d99 342859 1 2024-02-28T16:27:13.519 INFO:tasks.workunit.client.1.smithi157.stdout:1/775: dwrite d10/f6b [0,4194304] 0 2024-02-28T16:27:13.527 INFO:tasks.workunit.client.1.smithi157.stdout:0/815: dread d1/d13/d52/f104 [0,4194304] 0 2024-02-28T16:27:13.528 INFO:tasks.workunit.client.1.smithi157.stdout:3/711: mkdir d0/d6/d6b/d75/dbd/de9 0 2024-02-28T16:27:13.532 INFO:tasks.workunit.client.1.smithi157.stdout:8/731: sync 2024-02-28T16:27:13.532 INFO:tasks.workunit.client.1.smithi157.stdout:0/816: truncate d1/d13/d52/d7b/dc1/fc6 168721 0 2024-02-28T16:27:13.537 INFO:tasks.workunit.client.1.smithi157.stdout:0/817: fdatasync d1/da/fef 0 2024-02-28T16:27:13.537 INFO:tasks.workunit.client.1.smithi157.stdout:3/712: mknod d0/d6/d34/d43/dac/cea 0 2024-02-28T16:27:13.537 INFO:tasks.workunit.client.1.smithi157.stdout:3/713: dread - d0/d6/d6b/fd6 zero size 2024-02-28T16:27:13.545 INFO:tasks.workunit.client.1.smithi157.stdout:3/714: creat d0/feb x:0 0 0 2024-02-28T16:27:13.547 INFO:tasks.workunit.client.1.smithi157.stdout:9/749: dwrite d0/d36/d37/d40/d4b/fd6 [0,4194304] 0 2024-02-28T16:27:13.550 INFO:tasks.workunit.client.1.smithi157.stdout:1/776: dwrite fa [4194304,4194304] 0 2024-02-28T16:27:13.550 INFO:tasks.workunit.client.1.smithi157.stdout:5/795: dread d0/d30/def/d7e/f9a [0,4194304] 0 2024-02-28T16:27:13.553 INFO:tasks.workunit.client.1.smithi157.stdout:9/750: dread - d0/d36/d37/d40/d5b/dba/fc9 zero size 2024-02-28T16:27:13.555 INFO:tasks.workunit.client.1.smithi157.stdout:1/777: symlink d10/d11/d3a/d5c/d6c/d6f/lfa 0 2024-02-28T16:27:13.557 INFO:tasks.workunit.client.1.smithi157.stdout:9/751: readlink d0/d36/d37/d40/d5b/leb 0 2024-02-28T16:27:13.558 INFO:tasks.workunit.client.1.smithi157.stdout:5/796: creat d0/d30/def/f10d x:0 0 0 2024-02-28T16:27:13.560 INFO:tasks.workunit.client.1.smithi157.stdout:1/778: creat d10/d11/d3a/d95/ffb x:0 0 0 2024-02-28T16:27:13.562 INFO:tasks.workunit.client.1.smithi157.stdout:9/752: unlink d0/d36/d3f/f93 0 2024-02-28T16:27:13.564 INFO:tasks.workunit.client.1.smithi157.stdout:5/797: mkdir d0/d9/d47/d10e 0 2024-02-28T16:27:13.565 INFO:tasks.workunit.client.1.smithi157.stdout:1/779: readlink d10/d11/d3a/d95/da4/dd8/le7 0 2024-02-28T16:27:13.566 INFO:tasks.workunit.client.1.smithi157.stdout:3/715: dwrite d0/f8 [0,4194304] 0 2024-02-28T16:27:13.568 INFO:tasks.workunit.client.1.smithi157.stdout:8/732: dread d1/d5/dd8/d52/d54/fc3 [0,4194304] 0 2024-02-28T16:27:13.568 INFO:tasks.workunit.client.1.smithi157.stdout:3/716: chown d0/d6/d1e/f1f 82 1 2024-02-28T16:27:13.569 INFO:tasks.workunit.client.1.smithi157.stdout:1/780: mkdir d10/d11/d31/d2a/dfc 0 2024-02-28T16:27:13.570 INFO:tasks.workunit.client.1.smithi157.stdout:3/717: chown d0/d6/d44/d70/f8b 0 1 2024-02-28T16:27:13.572 INFO:tasks.workunit.client.1.smithi157.stdout:8/733: symlink d1/d5/d23/da1/dd3/lf8 0 2024-02-28T16:27:13.573 INFO:tasks.workunit.client.1.smithi157.stdout:8/734: write d1/f5f [4306475,22200] 0 2024-02-28T16:27:13.577 INFO:tasks.workunit.client.1.smithi157.stdout:1/781: truncate d10/d11/d31/d7f/ff9 717881 0 2024-02-28T16:27:13.578 INFO:tasks.workunit.client.1.smithi157.stdout:3/718: rename d0/dde to d0/d6/d34/d80/d23/d2b/dec 0 2024-02-28T16:27:13.581 INFO:tasks.workunit.client.1.smithi157.stdout:9/753: dwrite d0/d36/d3f/f8b [0,4194304] 0 2024-02-28T16:27:13.583 INFO:tasks.workunit.client.1.smithi157.stdout:5/798: link d0/d9/d47/d5b/d89/d75/fed d0/d30/d50/f10f 0 2024-02-28T16:27:13.584 INFO:tasks.workunit.client.1.smithi157.stdout:9/754: read d0/d19/d30/f4c [2318548,103300] 0 2024-02-28T16:27:13.595 INFO:tasks.workunit.client.1.smithi157.stdout:8/735: write d1/d5/dd8/fb1 [598101,71830] 0 2024-02-28T16:27:13.598 INFO:tasks.workunit.client.1.smithi157.stdout:3/719: dwrite d0/d6/d34/d80/f5a [0,4194304] 0 2024-02-28T16:27:13.606 INFO:tasks.workunit.client.1.smithi157.stdout:3/720: truncate d0/d6/d34/fc9 5220878 0 2024-02-28T16:27:13.606 INFO:tasks.workunit.client.1.smithi157.stdout:8/736: chown d1/d5/c41 1644728645 1 2024-02-28T16:27:13.610 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: Upgrade: Updating mgr.smithi148.gelspy 2024-02-28T16:27:13.610 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:13.610 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:27:13.610 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:27:13.611 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:27:13.611 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:13.611 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: Deploying daemon mgr.smithi148.gelspy on smithi148 2024-02-28T16:27:13.611 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:13 smithi148 ceph-mon[28767]: pgmap v61: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 81 MiB/s rd, 230 MiB/s wr, 498 op/s 2024-02-28T16:27:13.611 INFO:tasks.workunit.client.1.smithi157.stdout:8/737: fdatasync d1/d5/d10/f33 0 2024-02-28T16:27:13.620 INFO:tasks.workunit.client.1.smithi157.stdout:5/799: dwrite d0/d9/f42 [4194304,4194304] 0 2024-02-28T16:27:13.622 INFO:tasks.workunit.client.1.smithi157.stdout:5/800: chown d0/d30/da0/dd5 143 1 2024-02-28T16:27:13.623 INFO:tasks.workunit.client.1.smithi157.stdout:8/738: mknod d1/d5/d4d/d60/de4/cf9 0 2024-02-28T16:27:13.624 INFO:tasks.workunit.client.1.smithi157.stdout:5/801: read d0/d30/d50/f63 [50593,13251] 0 2024-02-28T16:27:13.626 INFO:tasks.workunit.client.1.smithi157.stdout:5/802: stat d0/d9/d47/f9e 0 2024-02-28T16:27:13.632 INFO:tasks.workunit.client.1.smithi157.stdout:8/739: fdatasync d1/d5/d23/f69 0 2024-02-28T16:27:13.634 INFO:tasks.workunit.client.1.smithi157.stdout:5/803: fsync d0/d9/d47/d5b/d89/d75/fed 0 2024-02-28T16:27:13.638 INFO:tasks.workunit.client.1.smithi157.stdout:9/755: dread d0/d19/f8d [0,4194304] 0 2024-02-28T16:27:13.639 INFO:tasks.workunit.client.1.smithi157.stdout:8/740: fsync d1/d5/d23/f69 0 2024-02-28T16:27:13.645 INFO:tasks.workunit.client.1.smithi157.stdout:7/770: sync 2024-02-28T16:27:13.646 INFO:tasks.workunit.client.1.smithi157.stdout:9/756: mkdir d0/d19/d30/dff 0 2024-02-28T16:27:13.647 INFO:tasks.workunit.client.1.smithi157.stdout:7/771: write df/d1f/d24/f99 [5124273,97090] 0 2024-02-28T16:27:13.650 INFO:tasks.workunit.client.1.smithi157.stdout:5/804: rename d0/d30/d50/d7f/ffb to d0/d30/da0/dd4/f110 0 2024-02-28T16:27:13.653 INFO:tasks.workunit.client.1.smithi157.stdout:3/721: dread d0/d6/f2d [0,4194304] 0 2024-02-28T16:27:13.654 INFO:tasks.workunit.client.1.smithi157.stdout:8/741: mknod d1/d5/cfa 0 2024-02-28T16:27:13.660 INFO:tasks.workunit.client.1.smithi157.stdout:9/757: write d0/d36/d37/f67 [1713798,1155] 0 2024-02-28T16:27:13.662 INFO:tasks.workunit.client.1.smithi157.stdout:5/805: creat d0/d9/d47/dad/deb/f111 x:0 0 0 2024-02-28T16:27:13.664 INFO:tasks.workunit.client.1.smithi157.stdout:8/742: mkdir d1/d5/d23/d38/dfb 0 2024-02-28T16:27:13.668 INFO:tasks.workunit.client.1.smithi157.stdout:3/722: dwrite d0/d6/d34/d80/d23/d2b/fb0 [0,4194304] 0 2024-02-28T16:27:13.675 INFO:tasks.workunit.client.1.smithi157.stdout:3/723: rmdir d0/d6/d34/d80/d23/d2b/d2e/d7c 0 2024-02-28T16:27:13.686 INFO:tasks.workunit.client.1.smithi157.stdout:7/772: dwrite df/d25/d4e/f9b [0,4194304] 0 2024-02-28T16:27:13.689 INFO:tasks.workunit.client.1.smithi157.stdout:8/743: dread d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:13.690 INFO:tasks.workunit.client.1.smithi157.stdout:5/806: dread d0/f5a [0,4194304] 0 2024-02-28T16:27:13.691 INFO:tasks.workunit.client.1.smithi157.stdout:7/773: mkdir df/d1f/d24/d39/d64/df6 0 2024-02-28T16:27:13.693 INFO:tasks.workunit.client.1.smithi157.stdout:8/744: mkdir d1/d5/d43/d66/dfc 0 2024-02-28T16:27:13.695 INFO:tasks.workunit.client.1.smithi157.stdout:8/745: write d1/d5/d23/d53/f9a [657185,116786] 0 2024-02-28T16:27:13.696 INFO:tasks.workunit.client.1.smithi157.stdout:5/807: read d0/d9/d1b/d36/f6c [494283,88261] 0 2024-02-28T16:27:13.699 INFO:tasks.workunit.client.1.smithi157.stdout:8/746: dread - d1/d5/dd8/f93 zero size 2024-02-28T16:27:13.702 INFO:tasks.workunit.client.1.smithi157.stdout:5/808: creat d0/d9/d47/d5b/dd9/f112 x:0 0 0 2024-02-28T16:27:13.703 INFO:tasks.workunit.client.1.smithi157.stdout:8/747: write d1/d5/d23/f91 [356876,85053] 0 2024-02-28T16:27:13.706 INFO:tasks.workunit.client.1.smithi157.stdout:7/774: dwrite df/f17 [0,4194304] 0 2024-02-28T16:27:13.707 INFO:tasks.workunit.client.1.smithi157.stdout:5/809: creat d0/d9/d47/d5b/df4/f113 x:0 0 0 2024-02-28T16:27:13.709 INFO:tasks.workunit.client.1.smithi157.stdout:8/748: creat d1/d5/d43/d86/ffd x:0 0 0 2024-02-28T16:27:13.720 INFO:tasks.workunit.client.1.smithi157.stdout:7/775: dwrite df/d1f/d24/d4f/d72/fd7 [0,4194304] 0 2024-02-28T16:27:13.725 INFO:tasks.workunit.client.1.smithi157.stdout:7/776: stat df/d4b/c66 0 2024-02-28T16:27:13.730 INFO:tasks.workunit.client.1.smithi157.stdout:5/810: dwrite d0/d30/def/fa8 [0,4194304] 0 2024-02-28T16:27:13.731 INFO:tasks.workunit.client.1.smithi157.stdout:7/777: symlink df/d25/d79/d9e/lf7 0 2024-02-28T16:27:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: Upgrade: Updating mgr.smithi148.gelspy 2024-02-28T16:27:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:27:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:27:13.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:27:13.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:13.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: Deploying daemon mgr.smithi148.gelspy on smithi148 2024-02-28T16:27:13.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:13 smithi157 ceph-mon[38346]: pgmap v61: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 81 MiB/s rd, 230 MiB/s wr, 498 op/s 2024-02-28T16:27:13.741 INFO:tasks.workunit.client.1.smithi157.stdout:5/811: creat d0/d30/da0/f114 x:0 0 0 2024-02-28T16:27:13.744 INFO:tasks.workunit.client.1.smithi157.stdout:5/812: write d0/d9/d47/d5b/d89/d75/fc5 [703583,13954] 0 2024-02-28T16:27:13.751 INFO:tasks.workunit.client.1.smithi157.stdout:5/813: fsync d0/d9/d1b/f67 0 2024-02-28T16:27:13.756 INFO:tasks.workunit.client.1.smithi157.stdout:5/814: mkdir d0/d30/da0/dd5/d115 0 2024-02-28T16:27:13.758 INFO:tasks.workunit.client.1.smithi157.stdout:5/815: write d0/d9/d47/d5b/d89/d75/fdf [54523,127415] 0 2024-02-28T16:27:13.760 INFO:tasks.workunit.client.1.smithi157.stdout:8/749: dread d1/f4f [0,4194304] 0 2024-02-28T16:27:13.762 INFO:tasks.workunit.client.1.smithi157.stdout:5/816: mknod d0/d9/d47/d5b/df4/c116 0 2024-02-28T16:27:13.763 INFO:tasks.workunit.client.1.smithi157.stdout:7/778: dread df/d25/d4e/d67/f45 [0,4194304] 0 2024-02-28T16:27:13.764 INFO:tasks.workunit.client.1.smithi157.stdout:7/779: dread - df/d25/fea zero size 2024-02-28T16:27:13.767 INFO:tasks.workunit.client.1.smithi157.stdout:7/780: creat df/d25/d4e/d67/ff8 x:0 0 0 2024-02-28T16:27:13.784 INFO:tasks.workunit.client.1.smithi157.stdout:8/750: write d1/d5/d14/f47 [5154161,112504] 0 2024-02-28T16:27:13.788 INFO:tasks.workunit.client.1.smithi157.stdout:5/817: truncate d0/d9/d47/d5b/d89/d75/fdf 80379 0 2024-02-28T16:27:13.789 INFO:tasks.workunit.client.1.smithi157.stdout:8/751: mknod d1/d5/d23/d53/dce/cfe 0 2024-02-28T16:27:13.797 INFO:tasks.workunit.client.1.smithi157.stdout:8/752: mkdir d1/d5/d43/d86/dff 0 2024-02-28T16:27:13.797 INFO:tasks.workunit.client.1.smithi157.stdout:7/781: dread df/d4b/f95 [0,4194304] 0 2024-02-28T16:27:13.798 INFO:tasks.workunit.client.1.smithi157.stdout:5/818: mknod d0/d30/d50/c117 0 2024-02-28T16:27:13.802 INFO:tasks.workunit.client.1.smithi157.stdout:7/782: mknod df/d4b/cf9 0 2024-02-28T16:27:13.804 INFO:tasks.workunit.client.1.smithi157.stdout:7/783: dread - df/d1f/d24/d38/f70 zero size 2024-02-28T16:27:13.805 INFO:tasks.workunit.client.1.smithi157.stdout:8/753: truncate d1/d5/d43/f45 1615804 0 2024-02-28T16:27:13.806 INFO:tasks.workunit.client.1.smithi157.stdout:5/819: mknod d0/d30/da0/dfd/d106/c118 0 2024-02-28T16:27:13.807 INFO:tasks.workunit.client.1.smithi157.stdout:8/754: dread - d1/d5/d43/d86/ff5 zero size 2024-02-28T16:27:13.810 INFO:tasks.workunit.client.1.smithi157.stdout:5/820: fsync d0/d9/d1b/d36/f53 0 2024-02-28T16:27:13.811 INFO:tasks.workunit.client.1.smithi157.stdout:7/784: creat df/d1f/d24/d39/df2/ffa x:0 0 0 2024-02-28T16:27:13.812 INFO:tasks.workunit.client.1.smithi157.stdout:5/821: dread - d0/d9/d47/d5b/d89/d75/fed zero size 2024-02-28T16:27:13.815 INFO:tasks.workunit.client.1.smithi157.stdout:7/785: mknod df/d1f/d24/d4f/cfb 0 2024-02-28T16:27:13.815 INFO:tasks.workunit.client.1.smithi157.stdout:2/848: sync 2024-02-28T16:27:13.815 INFO:tasks.workunit.client.1.smithi157.stdout:6/742: sync 2024-02-28T16:27:13.816 INFO:tasks.workunit.client.1.smithi157.stdout:5/822: symlink d0/d9/d47/d5b/dd9/l119 0 2024-02-28T16:27:13.818 INFO:tasks.workunit.client.1.smithi157.stdout:7/786: fsync df/d40/f6e 0 2024-02-28T16:27:13.824 INFO:tasks.workunit.client.1.smithi157.stdout:7/787: fdatasync df/d1f/d24/d4f/d72/dab/dd6/fe8 0 2024-02-28T16:27:13.827 INFO:tasks.workunit.client.1.smithi157.stdout:8/755: dwrite d1/d5/d4d/f62 [0,4194304] 0 2024-02-28T16:27:13.827 INFO:tasks.workunit.client.1.smithi157.stdout:7/788: chown df/d25/d79/f82 329417984 1 2024-02-28T16:27:13.833 INFO:tasks.workunit.client.1.smithi157.stdout:7/789: fdatasync df/d25/d79/d9e/fd8 0 2024-02-28T16:27:13.834 INFO:tasks.workunit.client.1.smithi157.stdout:5/823: symlink d0/d9/d47/d5b/dc6/l11a 0 2024-02-28T16:27:13.837 INFO:tasks.workunit.client.1.smithi157.stdout:5/824: write d0/d30/d50/df0/f103 [81046,23089] 0 2024-02-28T16:27:13.838 INFO:tasks.workunit.client.1.smithi157.stdout:6/743: dread d2/d7/d8/da/d31/d37/d2b/f5f [0,4194304] 0 2024-02-28T16:27:13.841 INFO:tasks.workunit.client.1.smithi157.stdout:7/790: creat df/d1f/d24/d38/ffc x:0 0 0 2024-02-28T16:27:13.844 INFO:tasks.workunit.client.1.smithi157.stdout:7/791: fdatasync df/d1f/d24/d4f/d72/dab/dd6/fe8 0 2024-02-28T16:27:13.845 INFO:tasks.workunit.client.1.smithi157.stdout:6/744: mkdir d2/d7/d8/da/d31/d3a/ddc 0 2024-02-28T16:27:13.845 INFO:tasks.workunit.client.1.smithi157.stdout:8/756: dwrite d1/d5/d23/f68 [4194304,4194304] 0 2024-02-28T16:27:13.846 INFO:tasks.workunit.client.1.smithi157.stdout:2/849: dread da/d38/f6f [0,4194304] 0 2024-02-28T16:27:13.848 INFO:tasks.workunit.client.1.smithi157.stdout:8/757: chown d1/d5/l46 79557121 1 2024-02-28T16:27:13.849 INFO:tasks.workunit.client.1.smithi157.stdout:7/792: dread - df/d25/d79/d9a/faa zero size 2024-02-28T16:27:13.850 INFO:tasks.workunit.client.1.smithi157.stdout:6/745: truncate d2/d7/d8/da/fd7 116272 0 2024-02-28T16:27:13.851 INFO:tasks.workunit.client.1.smithi157.stdout:8/758: dread - d1/d5/d4d/d60/fcd zero size 2024-02-28T16:27:13.852 INFO:tasks.workunit.client.1.smithi157.stdout:7/793: dread - df/d1f/d24/d38/ffc zero size 2024-02-28T16:27:13.852 INFO:tasks.workunit.client.1.smithi157.stdout:6/746: chown d2/d7/d8/da/d31/d59 43 1 2024-02-28T16:27:13.854 INFO:tasks.workunit.client.1.smithi157.stdout:5/825: dwrite d0/d9/d47/dad/f8e [0,4194304] 0 2024-02-28T16:27:13.855 INFO:tasks.workunit.client.1.smithi157.stdout:2/850: creat da/d38/d7e/d92/dd2/f117 x:0 0 0 2024-02-28T16:27:13.856 INFO:tasks.workunit.client.1.smithi157.stdout:2/851: chown da/d38/d5a/fdb 359993 1 2024-02-28T16:27:13.856 INFO:tasks.workunit.client.1.smithi157.stdout:6/747: creat d2/d7/d8/dd4/d53/da6/fdd x:0 0 0 2024-02-28T16:27:13.858 INFO:tasks.workunit.client.1.smithi157.stdout:6/748: write d2/f5 [533537,124753] 0 2024-02-28T16:27:13.862 INFO:tasks.workunit.client.1.smithi157.stdout:6/749: mknod d2/d7/d8/da/d71/cde 0 2024-02-28T16:27:13.878 INFO:tasks.workunit.client.1.smithi157.stdout:6/750: write d2/d7/d8/fa7 [27420,51017] 0 2024-02-28T16:27:13.882 INFO:tasks.workunit.client.1.smithi157.stdout:5/826: dwrite d0/d9/d1b/d36/f38 [0,4194304] 0 2024-02-28T16:27:13.884 INFO:tasks.workunit.client.1.smithi157.stdout:5/827: stat d0/d9/d1b/lb5 0 2024-02-28T16:27:13.886 INFO:tasks.workunit.client.1.smithi157.stdout:6/751: write d2/d7/d8/dd4/d66/f84 [4055396,100202] 0 2024-02-28T16:27:13.886 INFO:tasks.workunit.client.1.smithi157.stdout:2/852: dread da/f26 [0,4194304] 0 2024-02-28T16:27:13.890 INFO:tasks.workunit.client.1.smithi157.stdout:5/828: mknod d0/d30/da0/c11b 0 2024-02-28T16:27:13.892 INFO:tasks.workunit.client.1.smithi157.stdout:2/853: write da/f26 [213617,47525] 0 2024-02-28T16:27:13.893 INFO:tasks.workunit.client.1.smithi157.stdout:6/752: mknod d2/d7/d8/da/d31/cdf 0 2024-02-28T16:27:13.894 INFO:tasks.workunit.client.1.smithi157.stdout:5/829: write d0/f34 [2202968,110813] 0 2024-02-28T16:27:13.900 INFO:tasks.workunit.client.1.smithi157.stdout:5/830: rmdir d0/d30/def/d7e/d82 39 2024-02-28T16:27:13.902 INFO:tasks.workunit.client.1.smithi157.stdout:6/753: rename d2/d7/de/d1b/c70 to d2/d7/d8/dd4/d66/ce0 0 2024-02-28T16:27:13.902 INFO:tasks.workunit.client.1.smithi157.stdout:5/831: chown d0/d9/d1b/d36/fb0 1 1 2024-02-28T16:27:13.909 INFO:tasks.workunit.client.1.smithi157.stdout:2/854: dwrite da/d35/f54 [0,4194304] 0 2024-02-28T16:27:13.911 INFO:tasks.workunit.client.1.smithi157.stdout:6/754: link d2/d7/d8/da/d31/d3a/f33 d2/d7/d8/dd4/d8c/fe1 0 2024-02-28T16:27:13.912 INFO:tasks.workunit.client.1.smithi157.stdout:2/855: rmdir da/d47/dbd/dde 39 2024-02-28T16:27:13.914 INFO:tasks.workunit.client.1.smithi157.stdout:2/856: read da/f28 [4817,88740] 0 2024-02-28T16:27:13.915 INFO:tasks.workunit.client.1.smithi157.stdout:2/857: write da/f2a [2302544,47304] 0 2024-02-28T16:27:13.916 INFO:tasks.workunit.client.1.smithi157.stdout:6/755: mkdir d2/d7/d8/da/d31/d3a/de2 0 2024-02-28T16:27:13.922 INFO:tasks.workunit.client.1.smithi157.stdout:2/858: truncate da/d2b/d59/fa0 1862339 0 2024-02-28T16:27:13.923 INFO:tasks.workunit.client.1.smithi157.stdout:2/859: stat da/d38/d5a/lf9 0 2024-02-28T16:27:13.926 INFO:tasks.workunit.client.1.smithi157.stdout:2/860: creat da/d38/d7e/dbb/f118 x:0 0 0 2024-02-28T16:27:13.928 INFO:tasks.workunit.client.1.smithi157.stdout:6/756: rmdir d2/d7/d8 39 2024-02-28T16:27:13.929 INFO:tasks.workunit.client.1.smithi157.stdout:6/757: write d2/d17/f2a [3137146,45739] 0 2024-02-28T16:27:13.933 INFO:tasks.workunit.client.1.smithi157.stdout:2/861: getdents da/d38/d5a 0 2024-02-28T16:27:13.938 INFO:tasks.workunit.client.1.smithi157.stdout:6/758: link d2/d7/d8/da/d31/d59/l7e d2/d7/d8/dd4/d66/dc0/le3 0 2024-02-28T16:27:13.942 INFO:tasks.workunit.client.1.smithi157.stdout:6/759: creat d2/d7/d8/da/d31/fe4 x:0 0 0 2024-02-28T16:27:13.946 INFO:tasks.workunit.client.1.smithi157.stdout:2/862: dwrite da/d38/d5a/fdb [0,4194304] 0 2024-02-28T16:27:13.948 INFO:tasks.workunit.client.1.smithi157.stdout:0/818: sync 2024-02-28T16:27:13.948 INFO:tasks.workunit.client.1.smithi157.stdout:4/755: sync 2024-02-28T16:27:13.948 INFO:tasks.workunit.client.1.smithi157.stdout:1/782: sync 2024-02-28T16:27:13.951 INFO:tasks.workunit.client.1.smithi157.stdout:1/783: creat d10/d94/ffd x:0 0 0 2024-02-28T16:27:13.952 INFO:tasks.workunit.client.1.smithi157.stdout:6/760: symlink d2/d7/d8/da/d31/d3a/ddc/le5 0 2024-02-28T16:27:13.955 INFO:tasks.workunit.client.1.smithi157.stdout:2/863: creat da/d38/d5a/d79/ddc/f119 x:0 0 0 2024-02-28T16:27:13.955 INFO:tasks.workunit.client.1.smithi157.stdout:0/819: symlink d1/d13/d52/db5/l119 0 2024-02-28T16:27:13.956 INFO:tasks.workunit.client.1.smithi157.stdout:4/756: fsync d3/da/d1f/d22/f4b 0 2024-02-28T16:27:13.956 INFO:tasks.workunit.client.1.smithi157.stdout:6/761: chown d2/d7/de/d1b/fb5 19356 1 2024-02-28T16:27:13.956 INFO:tasks.workunit.client.1.smithi157.stdout:1/784: write d10/d11/d3a/d5c/d84/fb5 [79265,49057] 0 2024-02-28T16:27:13.957 INFO:tasks.workunit.client.1.smithi157.stdout:4/757: chown d3/da/d1f/ld7 45867756 1 2024-02-28T16:27:13.960 INFO:tasks.workunit.client.1.smithi157.stdout:0/820: dread d1/da/d6c/fbb [0,4194304] 0 2024-02-28T16:27:13.962 INFO:tasks.workunit.client.1.smithi157.stdout:4/758: unlink d3/da/d1f/f27 0 2024-02-28T16:27:13.962 INFO:tasks.workunit.client.1.smithi157.stdout:4/759: dread - d3/d8b/feb zero size 2024-02-28T16:27:13.966 INFO:tasks.workunit.client.1.smithi157.stdout:1/785: mkdir d10/d11/d31/d2a/d70/dfe 0 2024-02-28T16:27:13.971 INFO:tasks.workunit.client.1.smithi157.stdout:0/821: creat d1/da/d7d/d98/de2/de9/dfa/f11a x:0 0 0 2024-02-28T16:27:13.971 INFO:tasks.workunit.client.1.smithi157.stdout:6/762: getdents d2/d7/d8/da/d71/d8f/d6e 0 2024-02-28T16:27:13.973 INFO:tasks.workunit.client.1.smithi157.stdout:6/763: write d2/d7/de/d1b/d3d/fb3 [444137,45279] 0 2024-02-28T16:27:13.976 INFO:tasks.workunit.client.1.smithi157.stdout:4/760: link d3/da/d37/d84/ced d3/da/d37/d71/db0/db4/cf3 0 2024-02-28T16:27:13.977 INFO:tasks.workunit.client.1.smithi157.stdout:0/822: link d1/da/ff1 d1/da/d7d/dc4/d10c/f11b 0 2024-02-28T16:27:13.978 INFO:tasks.workunit.client.1.smithi157.stdout:6/764: read - d2/d7/d8/da/d71/d93/fa5 zero size 2024-02-28T16:27:13.978 INFO:tasks.workunit.client.1.smithi157.stdout:4/761: symlink d3/d77/daa/lf4 0 2024-02-28T16:27:13.982 INFO:tasks.workunit.client.1.smithi157.stdout:0/823: rmdir d1/d13 39 2024-02-28T16:27:13.985 INFO:tasks.workunit.client.1.smithi157.stdout:6/765: mknod d2/d7/d8/da/d31/d37/d2b/d99/ce6 0 2024-02-28T16:27:14.011 INFO:tasks.workunit.client.1.smithi157.stdout:4/762: dread d3/da/d1f/d22/f44 [0,4194304] 0 2024-02-28T16:27:14.066 INFO:tasks.workunit.client.1.smithi157.stdout:6/766: dwrite d2/d7/d8/da/d31/d3a/fc7 [4194304,4194304] 0 2024-02-28T16:27:14.069 INFO:tasks.workunit.client.1.smithi157.stdout:1/786: dwrite d10/d11/d3a/d5c/d6c/d7b/f26 [0,4194304] 0 2024-02-28T16:27:14.073 INFO:tasks.workunit.client.1.smithi157.stdout:6/767: truncate d2/d7/d8/da/d71/d93/fa5 838765 0 2024-02-28T16:27:14.089 INFO:tasks.workunit.client.1.smithi157.stdout:3/724: sync 2024-02-28T16:27:14.090 INFO:tasks.workunit.client.1.smithi157.stdout:9/758: sync 2024-02-28T16:27:14.092 INFO:tasks.workunit.client.1.smithi157.stdout:9/759: write d0/d36/d37/f67 [391767,70027] 0 2024-02-28T16:27:14.092 INFO:tasks.workunit.client.1.smithi157.stdout:3/725: chown d0/d6/d34/d80/d5c/fca 0 1 2024-02-28T16:27:14.137 INFO:tasks.workunit.client.1.smithi157.stdout:4/763: mkdir d3/da/d37/d84/dc9/df5 0 2024-02-28T16:27:14.142 INFO:tasks.workunit.client.1.smithi157.stdout:4/764: chown d3/da/d28/l7b 384876661 1 2024-02-28T16:27:14.145 INFO:tasks.workunit.client.1.smithi157.stdout:3/726: mkdir d0/d6/d34/d80/d5c/ded 0 2024-02-28T16:27:14.148 INFO:tasks.workunit.client.1.smithi157.stdout:1/787: mknod d10/da0/db6/cff 0 2024-02-28T16:27:14.154 INFO:tasks.workunit.client.1.smithi157.stdout:0/824: dwrite d1/d13/d52/db5/f63 [0,4194304] 0 2024-02-28T16:27:14.157 INFO:tasks.workunit.client.1.smithi157.stdout:9/760: symlink d0/d36/d37/d4d/d92/df6/l100 0 2024-02-28T16:27:14.157 INFO:tasks.workunit.client.1.smithi157.stdout:0/825: write d1/da/f2f [354960,4039] 0 2024-02-28T16:27:14.159 INFO:tasks.workunit.client.1.smithi157.stdout:4/765: dwrite d3/da/d1f/f63 [0,4194304] 0 2024-02-28T16:27:14.163 INFO:tasks.workunit.client.1.smithi157.stdout:1/788: dread d10/f6b [0,4194304] 0 2024-02-28T16:27:14.164 INFO:tasks.workunit.client.1.smithi157.stdout:0/826: rmdir d1/d8/da8/dff 39 2024-02-28T16:27:14.166 INFO:tasks.workunit.client.1.smithi157.stdout:1/789: stat d10/d11/d3a/d5c/d6c/d7b/f1e 0 2024-02-28T16:27:14.167 INFO:tasks.workunit.client.1.smithi157.stdout:4/766: symlink d3/da/d37/d84/d9a/lf6 0 2024-02-28T16:27:14.172 INFO:tasks.workunit.client.1.smithi157.stdout:7/794: sync 2024-02-28T16:27:14.172 INFO:tasks.workunit.client.1.smithi157.stdout:8/759: sync 2024-02-28T16:27:14.175 INFO:tasks.workunit.client.1.smithi157.stdout:8/760: stat d1/d5/d23/d38/dfb 0 2024-02-28T16:27:14.176 INFO:tasks.workunit.client.1.smithi157.stdout:1/790: mkdir d10/d11/d60/d100 0 2024-02-28T16:27:14.179 INFO:tasks.workunit.client.1.smithi157.stdout:0/827: rename d1/d13/dc9/df9/f2b to d1/d13/d46/d99/f11c 0 2024-02-28T16:27:14.181 INFO:tasks.workunit.client.1.smithi157.stdout:4/767: creat d3/da/d48/d8e/ff7 x:0 0 0 2024-02-28T16:27:14.183 INFO:tasks.workunit.client.1.smithi157.stdout:9/761: creat d0/d36/d3f/f101 x:0 0 0 2024-02-28T16:27:14.187 INFO:tasks.workunit.client.1.smithi157.stdout:8/761: mkdir d1/d5/dd8/d100 0 2024-02-28T16:27:14.187 INFO:tasks.workunit.client.1.smithi157.stdout:7/795: mkdir df/d1f/d24/d39/d64/df6/dfd 0 2024-02-28T16:27:14.191 INFO:tasks.workunit.client.1.smithi157.stdout:9/762: creat d0/d36/d37/d40/d5b/f102 x:0 0 0 2024-02-28T16:27:14.193 INFO:tasks.workunit.client.1.smithi157.stdout:4/768: rename d3/da/d37/d71 to d3/da/d37/d84/d9a/df8 0 2024-02-28T16:27:14.195 INFO:tasks.workunit.client.1.smithi157.stdout:7/796: symlink df/d80/d84/lfe 0 2024-02-28T16:27:14.196 INFO:tasks.workunit.client.1.smithi157.stdout:8/762: creat d1/d5/d4d/d60/f101 x:0 0 0 2024-02-28T16:27:14.198 INFO:tasks.workunit.client.1.smithi157.stdout:4/769: unlink d3/d8b/feb 0 2024-02-28T16:27:14.199 INFO:tasks.workunit.client.1.smithi157.stdout:9/763: mkdir d0/d36/d3f/d103 0 2024-02-28T16:27:14.202 INFO:tasks.workunit.client.1.smithi157.stdout:8/763: stat d1/d5/d23/d38/d67/c83 0 2024-02-28T16:27:14.204 INFO:tasks.workunit.client.1.smithi157.stdout:4/770: unlink d3/da/d37/d84/d9a/dab/ce4 0 2024-02-28T16:27:14.207 INFO:tasks.workunit.client.1.smithi157.stdout:1/791: dread d10/d11/f14 [0,4194304] 0 2024-02-28T16:27:14.207 INFO:tasks.workunit.client.1.smithi157.stdout:9/764: rename d0/d36/d37/d40/l59 to d0/d36/d37/d40/d4b/l104 0 2024-02-28T16:27:14.208 INFO:tasks.workunit.client.1.smithi157.stdout:8/764: symlink d1/d5/d23/d38/dfb/l102 0 2024-02-28T16:27:14.210 INFO:tasks.workunit.client.1.smithi157.stdout:1/792: chown d10/da0/db6/lb9 12707338 1 2024-02-28T16:27:14.215 INFO:tasks.workunit.client.1.smithi157.stdout:8/765: symlink d1/d5/d23/d38/d67/d6d/l103 0 2024-02-28T16:27:14.215 INFO:tasks.workunit.client.1.smithi157.stdout:0/828: dread d1/d8/f45 [0,4194304] 0 2024-02-28T16:27:14.215 INFO:tasks.workunit.client.1.smithi157.stdout:5/832: sync 2024-02-28T16:27:14.215 INFO:tasks.workunit.client.1.smithi157.stdout:2/864: sync 2024-02-28T16:27:14.218 INFO:tasks.workunit.client.1.smithi157.stdout:0/829: write d1/da/d7d/fca [1180504,45781] 0 2024-02-28T16:27:14.223 INFO:tasks.workunit.client.1.smithi157.stdout:2/865: symlink da/d38/d4e/d91/l11a 0 2024-02-28T16:27:14.224 INFO:tasks.workunit.client.1.smithi157.stdout:8/766: truncate d1/d5/d43/f45 1966889 0 2024-02-28T16:27:14.224 INFO:tasks.workunit.client.1.smithi157.stdout:2/866: write da/d38/d5a/d69/f95 [822882,130920] 0 2024-02-28T16:27:14.230 INFO:tasks.workunit.client.1.smithi157.stdout:8/767: symlink d1/d5/dd8/d52/d54/l104 0 2024-02-28T16:27:14.234 INFO:tasks.workunit.client.1.smithi157.stdout:8/768: symlink d1/d5/d23/d38/dfb/l105 0 2024-02-28T16:27:14.236 INFO:tasks.workunit.client.1.smithi157.stdout:4/771: dread d3/da/f35 [0,4194304] 0 2024-02-28T16:27:14.237 INFO:tasks.workunit.client.1.smithi157.stdout:4/772: stat d3/da/d37/d84/c94 0 2024-02-28T16:27:14.239 INFO:tasks.workunit.client.1.smithi157.stdout:8/769: rename d1/d5/d23/l30 to d1/d5/d43/d66/dfc/l106 0 2024-02-28T16:27:14.240 INFO:tasks.workunit.client.1.smithi157.stdout:2/867: dwrite da/d38/f75 [0,4194304] 0 2024-02-28T16:27:14.242 INFO:tasks.workunit.client.1.smithi157.stdout:6/768: symlink d2/d7/le7 0 2024-02-28T16:27:14.245 INFO:tasks.workunit.client.1.smithi157.stdout:6/769: stat d2/d7/d8/dd4/f60 0 2024-02-28T16:27:14.245 INFO:tasks.workunit.client.1.smithi157.stdout:2/868: creat da/d2b/d59/d109/f11b x:0 0 0 2024-02-28T16:27:14.247 INFO:tasks.workunit.client.1.smithi157.stdout:8/770: rename d1/d5/d23/d38/ff3 to d1/d5/d4d/dd6/ddb/f107 0 2024-02-28T16:27:14.247 INFO:tasks.workunit.client.1.smithi157.stdout:2/869: fsync da/d38/d7e/d92/f107 0 2024-02-28T16:27:14.248 INFO:tasks.workunit.client.1.smithi157.stdout:5/833: dread d0/f2f [0,4194304] 0 2024-02-28T16:27:14.250 INFO:tasks.workunit.client.1.smithi157.stdout:6/770: dread d2/d7/de/d40/f65 [0,4194304] 0 2024-02-28T16:27:14.252 INFO:tasks.workunit.client.1.smithi157.stdout:6/771: fdatasync d2/d7/d8/dd4/d8c/fcf 0 2024-02-28T16:27:14.252 INFO:tasks.workunit.client.1.smithi157.stdout:3/727: mkdir d0/dee 0 2024-02-28T16:27:14.254 INFO:tasks.workunit.client.1.smithi157.stdout:5/834: mknod d0/d9/d3a/c11c 0 2024-02-28T16:27:14.255 INFO:tasks.workunit.client.1.smithi157.stdout:7/797: rmdir df/d4b 39 2024-02-28T16:27:14.257 INFO:tasks.workunit.client.1.smithi157.stdout:7/798: chown df/d25/d79/d9a/faa 2716 1 2024-02-28T16:27:14.258 INFO:tasks.workunit.client.1.smithi157.stdout:8/771: mkdir d1/d5/d23/dbd/dc9/d108 0 2024-02-28T16:27:14.261 INFO:tasks.workunit.client.1.smithi157.stdout:6/772: rename d2/d7/d8/da/d31/d59/c76 to d2/d7/d8/da/d71/d80/ce8 0 2024-02-28T16:27:14.262 INFO:tasks.workunit.client.1.smithi157.stdout:5/835: mkdir d0/d9/d3a/d11d 0 2024-02-28T16:27:14.265 INFO:tasks.workunit.client.1.smithi157.stdout:6/773: mkdir d2/d7/d8/da/d4c/de9 0 2024-02-28T16:27:14.266 INFO:tasks.workunit.client.1.smithi157.stdout:5/836: rmdir d0 39 2024-02-28T16:27:14.268 INFO:tasks.workunit.client.1.smithi157.stdout:8/772: mkdir d1/d5/d109 0 2024-02-28T16:27:14.274 INFO:tasks.workunit.client.1.smithi157.stdout:8/773: mknod d1/d5/d43/d66/c10a 0 2024-02-28T16:27:14.280 INFO:tasks.workunit.client.1.smithi157.stdout:5/837: creat d0/d9/d47/f11e x:0 0 0 2024-02-28T16:27:14.282 INFO:tasks.workunit.client.1.smithi157.stdout:8/774: mkdir d1/d5/dd8/d52/d10b 0 2024-02-28T16:27:14.291 INFO:tasks.workunit.client.1.smithi157.stdout:9/765: write d0/d19/f7a [1087436,115320] 0 2024-02-28T16:27:14.291 INFO:tasks.workunit.client.1.smithi157.stdout:1/793: write d10/d11/f32 [2590117,4663] 0 2024-02-28T16:27:14.294 INFO:tasks.workunit.client.1.smithi157.stdout:5/838: dwrite d0/d30/def/fb [0,4194304] 0 2024-02-28T16:27:14.295 INFO:tasks.workunit.client.1.smithi157.stdout:1/794: fsync d10/d11/d3a/d5c/d6a/db4/d91/f93 0 2024-02-28T16:27:14.297 INFO:tasks.workunit.client.1.smithi157.stdout:9/766: mkdir d0/d36/daa/dbe/d105 0 2024-02-28T16:27:14.301 INFO:tasks.workunit.client.1.smithi157.stdout:5/839: mknod d0/d9/d1b/d36/c11f 0 2024-02-28T16:27:14.302 INFO:tasks.workunit.client.1.smithi157.stdout:2/870: write da/d47/dbd/dde/f99 [909084,5464] 0 2024-02-28T16:27:14.303 INFO:tasks.workunit.client.1.smithi157.stdout:5/840: chown d0/d9/d3a/c59 0 1 2024-02-28T16:27:14.305 INFO:tasks.workunit.client.1.smithi157.stdout:1/795: truncate d10/d11/d22/faa 130200 0 2024-02-28T16:27:14.307 INFO:tasks.workunit.client.1.smithi157.stdout:7/799: write df/d1f/d24/d38/f6d [687603,14768] 0 2024-02-28T16:27:14.308 INFO:tasks.workunit.client.1.smithi157.stdout:5/841: dread - d0/d30/def/d51/ffc zero size 2024-02-28T16:27:14.312 INFO:tasks.workunit.client.1.smithi157.stdout:2/871: truncate da/f12 4304164 0 2024-02-28T16:27:14.316 INFO:tasks.workunit.client.1.smithi157.stdout:4/773: dwrite d3/f2e [0,4194304] 0 2024-02-28T16:27:14.322 INFO:tasks.workunit.client.1.smithi157.stdout:3/728: dwrite d0/d6/f5f [0,4194304] 0 2024-02-28T16:27:14.342 INFO:tasks.workunit.client.1.smithi157.stdout:6/774: dwrite d2/d7/d8/dd4/d8c/fe1 [0,4194304] 0 2024-02-28T16:27:14.342 INFO:tasks.workunit.client.1.smithi157.stdout:5/842: readlink d0/d9/d1b/l31 0 2024-02-28T16:27:14.347 INFO:tasks.workunit.client.1.smithi157.stdout:8/775: dwrite d1/d5/d14/f9b [0,4194304] 0 2024-02-28T16:27:14.350 INFO:tasks.workunit.client.1.smithi157.stdout:6/775: chown d2/d7/d8/da/d31/d3a/ddc/le5 520 1 2024-02-28T16:27:14.355 INFO:tasks.workunit.client.1.smithi157.stdout:9/767: dread d0/d36/d3f/f50 [0,4194304] 0 2024-02-28T16:27:14.360 INFO:tasks.workunit.client.1.smithi157.stdout:1/796: getdents d10/d11/d22/d99/dbf/dd2 0 2024-02-28T16:27:14.360 INFO:tasks.workunit.client.1.smithi157.stdout:3/729: mknod d0/d6/d1e/cef 0 2024-02-28T16:27:14.360 INFO:tasks.workunit.client.1.smithi157.stdout:8/776: fsync d1/d5/d4d/f62 0 2024-02-28T16:27:14.362 INFO:tasks.workunit.client.1.smithi157.stdout:8/777: read - d1/fea zero size 2024-02-28T16:27:14.366 INFO:tasks.workunit.client.1.smithi157.stdout:3/730: mkdir d0/d6/d6b/d75/df0 0 2024-02-28T16:27:14.369 INFO:tasks.workunit.client.1.smithi157.stdout:7/800: dwrite df/f16 [0,4194304] 0 2024-02-28T16:27:14.374 INFO:tasks.workunit.client.1.smithi157.stdout:9/768: link d0/d19/f1e d0/d36/daa/dbe/f106 0 2024-02-28T16:27:14.376 INFO:tasks.workunit.client.1.smithi157.stdout:9/769: dread - d0/d36/d37/d40/d5b/fd7 zero size 2024-02-28T16:27:14.378 INFO:tasks.workunit.client.1.smithi157.stdout:6/776: dwrite d2/d7/d8/da/d71/d93/fa5 [0,4194304] 0 2024-02-28T16:27:14.378 INFO:tasks.workunit.client.1.smithi157.stdout:3/731: mknod d0/d6/d6b/d75/dbd/de9/cf1 0 2024-02-28T16:27:14.386 INFO:tasks.workunit.client.1.smithi157.stdout:0/830: sync 2024-02-28T16:27:14.388 INFO:tasks.workunit.client.1.smithi157.stdout:5/843: dread d0/d9/f91 [0,4194304] 0 2024-02-28T16:27:14.389 INFO:tasks.workunit.client.1.smithi157.stdout:0/831: truncate d1/d13/d52/d7b/f10d 713645 0 2024-02-28T16:27:14.391 INFO:tasks.workunit.client.1.smithi157.stdout:6/777: unlink d2/d7/de/d40/l64 0 2024-02-28T16:27:14.391 INFO:tasks.workunit.client.1.smithi157.stdout:1/797: truncate d10/d11/d31/d2a/f5d 5001178 0 2024-02-28T16:27:14.392 INFO:tasks.workunit.client.1.smithi157.stdout:0/832: truncate d1/d13/d52/d7b/f10d 791509 0 2024-02-28T16:27:14.393 INFO:tasks.workunit.client.1.smithi157.stdout:6/778: stat d2/d7/d8/dd4/d53/d69/f7c 0 2024-02-28T16:27:14.393 INFO:tasks.workunit.client.1.smithi157.stdout:0/833: chown d1/da/l9b 24193269 1 2024-02-28T16:27:14.394 INFO:tasks.workunit.client.1.smithi157.stdout:5/844: stat d0/d30/dca/ce3 0 2024-02-28T16:27:14.394 INFO:tasks.workunit.client.1.smithi157.stdout:9/770: creat d0/d36/f107 x:0 0 0 2024-02-28T16:27:14.397 INFO:tasks.workunit.client.1.smithi157.stdout:5/845: dread - d0/d30/da0/f114 zero size 2024-02-28T16:27:14.397 INFO:tasks.workunit.client.1.smithi157.stdout:1/798: mkdir d10/d11/d3a/d5c/d6a/db4/d91/dbe/d101 0 2024-02-28T16:27:14.397 INFO:tasks.workunit.client.1.smithi157.stdout:3/732: link d0/d6/d34/d80/d5c/cbf d0/d6/d34/d80/d23/d2b/d6d/cf2 0 2024-02-28T16:27:14.397 INFO:tasks.workunit.client.1.smithi157.stdout:4/774: dread d3/da/d28/f3e [0,4194304] 0 2024-02-28T16:27:14.403 INFO:tasks.workunit.client.1.smithi157.stdout:0/834: write d1/d13/dc9/df9/d55/f5f [9351564,78957] 0 2024-02-28T16:27:14.404 INFO:tasks.workunit.client.1.smithi157.stdout:6/779: dread d2/d7/d8/da/d31/d59/fb9 [0,4194304] 0 2024-02-28T16:27:14.406 INFO:tasks.workunit.client.1.smithi157.stdout:3/733: symlink d0/d6/d44/d70/d71/lf3 0 2024-02-28T16:27:14.409 INFO:tasks.workunit.client.1.smithi157.stdout:5/846: rename d0/d9/d47/d5b/dc6/l11a to d0/d9/d47/d5b/df4/l120 0 2024-02-28T16:27:14.411 INFO:tasks.workunit.client.1.smithi157.stdout:8/778: dread d1/f3c [0,4194304] 0 2024-02-28T16:27:14.413 INFO:tasks.workunit.client.1.smithi157.stdout:3/734: creat d0/d6/ff4 x:0 0 0 2024-02-28T16:27:14.424 INFO:tasks.workunit.client.1.smithi157.stdout:9/771: dread d0/d19/f29 [0,4194304] 0 2024-02-28T16:27:14.426 INFO:tasks.workunit.client.1.smithi157.stdout:1/799: dwrite d10/d11/d3a/d5c/d6c/d7b/f45 [0,4194304] 0 2024-02-28T16:27:14.429 INFO:tasks.workunit.client.1.smithi157.stdout:8/779: truncate d1/f5f 2076512 0 2024-02-28T16:27:14.431 INFO:tasks.workunit.client.1.smithi157.stdout:7/801: dread df/d1f/f7e [0,4194304] 0 2024-02-28T16:27:14.433 INFO:tasks.workunit.client.1.smithi157.stdout:9/772: truncate d0/dc0/fdb 543115 0 2024-02-28T16:27:14.437 INFO:tasks.workunit.client.1.smithi157.stdout:6/780: dread d2/f35 [0,4194304] 0 2024-02-28T16:27:14.438 INFO:tasks.workunit.client.1.smithi157.stdout:8/780: creat d1/d5/d23/da1/f10c x:0 0 0 2024-02-28T16:27:14.441 INFO:tasks.workunit.client.1.smithi157.stdout:4/775: dwrite d3/d77/daa/fae [0,4194304] 0 2024-02-28T16:27:14.441 INFO:tasks.workunit.client.1.smithi157.stdout:7/802: write df/f31 [1164004,57095] 0 2024-02-28T16:27:14.443 INFO:tasks.workunit.client.1.smithi157.stdout:0/835: dread d1/d13/d52/fa9 [0,4194304] 0 2024-02-28T16:27:14.448 INFO:tasks.workunit.client.1.smithi157.stdout:5/847: dwrite d0/d30/def/f77 [0,4194304] 0 2024-02-28T16:27:14.448 INFO:tasks.workunit.client.1.smithi157.stdout:2/872: sync 2024-02-28T16:27:14.452 INFO:tasks.workunit.client.1.smithi157.stdout:8/781: unlink d1/d5/d23/d53/f76 0 2024-02-28T16:27:14.453 INFO:tasks.workunit.client.1.smithi157.stdout:4/776: mkdir d3/da/d37/d84/d9a/df9 0 2024-02-28T16:27:14.455 INFO:tasks.workunit.client.1.smithi157.stdout:6/781: getdents d2/da0 0 2024-02-28T16:27:14.456 INFO:tasks.workunit.client.1.smithi157.stdout:5/848: unlink d0/d30/def/ld1 0 2024-02-28T16:27:14.464 INFO:tasks.workunit.client.1.smithi157.stdout:0/836: rename d1/d8/d33/d56/l8d to d1/d13/d52/d7b/dcf/l11d 0 2024-02-28T16:27:14.465 INFO:tasks.workunit.client.1.smithi157.stdout:0/837: stat d1/l1e 0 2024-02-28T16:27:14.466 INFO:tasks.workunit.client.1.smithi157.stdout:5/849: creat d0/d30/def/f121 x:0 0 0 2024-02-28T16:27:14.466 INFO:tasks.workunit.client.1.smithi157.stdout:1/800: dwrite d10/d11/d3a/d95/da4/fef [0,4194304] 0 2024-02-28T16:27:14.470 INFO:tasks.workunit.client.1.smithi157.stdout:7/803: link df/d25/da7/le1 df/d1f/d24/d39/d64/df6/lff 0 2024-02-28T16:27:14.472 INFO:tasks.workunit.client.1.smithi157.stdout:3/735: dread d0/d6/f56 [0,4194304] 0 2024-02-28T16:27:14.473 INFO:tasks.workunit.client.1.smithi157.stdout:4/777: rename d3/da/d48/c61 to d3/d77/daa/cfa 0 2024-02-28T16:27:14.482 INFO:tasks.workunit.client.1.smithi157.stdout:1/801: mknod d10/d11/d31/d2a/d70/d9b/c102 0 2024-02-28T16:27:14.483 INFO:tasks.workunit.client.1.smithi157.stdout:2/873: write da/f26 [365984,108145] 0 2024-02-28T16:27:14.484 INFO:tasks.workunit.client.1.smithi157.stdout:8/782: dread d1/d5/d14/fad [0,4194304] 0 2024-02-28T16:27:14.485 INFO:tasks.workunit.client.1.smithi157.stdout:4/778: mknod d3/da/cfb 0 2024-02-28T16:27:14.488 INFO:tasks.workunit.client.1.smithi157.stdout:6/782: dwrite d2/f5 [0,4194304] 0 2024-02-28T16:27:14.491 INFO:tasks.workunit.client.1.smithi157.stdout:0/838: link d1/d13/d57/ldf d1/da/d7d/d98/de2/de9/dfa/l11e 0 2024-02-28T16:27:14.492 INFO:tasks.workunit.client.1.smithi157.stdout:2/874: mkdir da/d38/d5a/d5c/d11c 0 2024-02-28T16:27:14.493 INFO:tasks.workunit.client.1.smithi157.stdout:9/773: dread d0/d36/d3f/d69/f71 [0,4194304] 0 2024-02-28T16:27:14.493 INFO:tasks.workunit.client.1.smithi157.stdout:4/779: mkdir d3/da/d37/d84/d9a/df8/db0/db4/dfc 0 2024-02-28T16:27:14.495 INFO:tasks.workunit.client.1.smithi157.stdout:8/783: rename d1/d5/d10/c6f to d1/d5/d14/c10d 0 2024-02-28T16:27:14.496 INFO:tasks.workunit.client.1.smithi157.stdout:7/804: dread df/f17 [0,4194304] 0 2024-02-28T16:27:14.497 INFO:tasks.workunit.client.1.smithi157.stdout:4/780: chown d3/da/d48/d4a/lbf 15667 1 2024-02-28T16:27:14.498 INFO:tasks.workunit.client.1.smithi157.stdout:6/783: truncate d2/d7/d8/da/d31/d37/fce 117306 0 2024-02-28T16:27:14.499 INFO:tasks.workunit.client.1.smithi157.stdout:0/839: mkdir d1/d13/d52/d7b/dc1/d11f 0 2024-02-28T16:27:14.500 INFO:tasks.workunit.client.1.smithi157.stdout:9/774: chown d0/d36/d37/f67 0 1 2024-02-28T16:27:14.505 INFO:tasks.workunit.client.1.smithi157.stdout:9/775: stat d0/d19/d30/d79/f87 0 2024-02-28T16:27:14.509 INFO:tasks.workunit.client.1.smithi157.stdout:6/784: creat d2/d17/fea x:0 0 0 2024-02-28T16:27:14.510 INFO:tasks.workunit.client.1.smithi157.stdout:7/805: rename df/d1f/d24/d39/d64/f88 to df/d1f/d24/de9/f100 0 2024-02-28T16:27:14.511 INFO:tasks.workunit.client.1.smithi157.stdout:9/776: rmdir d0/d19/d30 39 2024-02-28T16:27:14.513 INFO:tasks.workunit.client.1.smithi157.stdout:0/840: dread d1/da/d7d/dc4/d10c/f11b [0,4194304] 0 2024-02-28T16:27:14.514 INFO:tasks.workunit.client.1.smithi157.stdout:1/802: dwrite d10/d11/f32 [0,4194304] 0 2024-02-28T16:27:14.515 INFO:tasks.workunit.client.1.smithi157.stdout:5/850: dread d0/d9/d47/d5b/fcb [0,4194304] 0 2024-02-28T16:27:14.515 INFO:tasks.workunit.client.1.smithi157.stdout:4/781: rename d3/da/d28/f80 to d3/da/d1f/dc1/dc8/dee/ffd 0 2024-02-28T16:27:14.524 INFO:tasks.workunit.client.1.smithi157.stdout:9/777: chown d0/d36/d3f/f60 119027313 1 2024-02-28T16:27:14.525 INFO:tasks.workunit.client.1.smithi157.stdout:0/841: mkdir d1/d13/d52/d53/d120 0 2024-02-28T16:27:14.526 INFO:tasks.workunit.client.1.smithi157.stdout:7/806: dwrite df/d25/f44 [4194304,4194304] 0 2024-02-28T16:27:14.530 INFO:tasks.workunit.client.1.smithi157.stdout:5/851: symlink d0/d9/d47/d5b/dd9/l122 0 2024-02-28T16:27:14.538 INFO:tasks.workunit.client.1.smithi157.stdout:9/778: mkdir d0/d36/d37/d4d/d92/d108 0 2024-02-28T16:27:14.540 INFO:tasks.workunit.client.1.smithi157.stdout:1/803: mknod d10/d11/d3a/c103 0 2024-02-28T16:27:14.542 INFO:tasks.workunit.client.1.smithi157.stdout:0/842: rmdir d1/da/d7d/d98 39 2024-02-28T16:27:14.544 INFO:tasks.workunit.client.1.smithi157.stdout:7/807: stat df/d1f/cbf 0 2024-02-28T16:27:14.545 INFO:tasks.workunit.client.1.smithi157.stdout:8/784: write d1/f4f [2229270,80468] 0 2024-02-28T16:27:14.545 INFO:tasks.workunit.client.1.smithi157.stdout:5/852: creat d0/d9/d47/dad/f123 x:0 0 0 2024-02-28T16:27:14.550 INFO:tasks.workunit.client.1.smithi157.stdout:0/843: readlink d1/da/d7d/d98/de2/l110 0 2024-02-28T16:27:14.552 INFO:tasks.workunit.client.1.smithi157.stdout:5/853: rmdir d0/d9/d3a/de5 39 2024-02-28T16:27:14.553 INFO:tasks.workunit.client.1.smithi157.stdout:2/875: dwrite da/d47/f77 [0,4194304] 0 2024-02-28T16:27:14.554 INFO:tasks.workunit.client.1.smithi157.stdout:6/785: write d2/d7/f15 [3552476,69161] 0 2024-02-28T16:27:14.555 INFO:tasks.workunit.client.1.smithi157.stdout:8/785: fsync d1/d5/d4d/d60/f77 0 2024-02-28T16:27:14.556 INFO:tasks.workunit.client.1.smithi157.stdout:6/786: chown d2/d7/d38 59 1 2024-02-28T16:27:14.557 INFO:tasks.workunit.client.1.smithi157.stdout:7/808: creat df/d4b/f101 x:0 0 0 2024-02-28T16:27:14.564 INFO:tasks.workunit.client.1.smithi157.stdout:1/804: dwrite d10/d11/d3a/d95/fe3 [4194304,4194304] 0 2024-02-28T16:27:14.564 INFO:tasks.workunit.client.1.smithi157.stdout:5/854: rmdir d0/d30/d50/df0 39 2024-02-28T16:27:14.565 INFO:tasks.workunit.client.1.smithi157.stdout:4/782: write d3/da/d1f/d22/f8d [598351,16830] 0 2024-02-28T16:27:14.566 INFO:tasks.workunit.client.1.smithi157.stdout:3/736: sync 2024-02-28T16:27:14.567 INFO:tasks.workunit.client.1.smithi157.stdout:7/809: dread df/d1f/d37/d46/f5b [0,4194304] 0 2024-02-28T16:27:14.570 INFO:tasks.workunit.client.1.smithi157.stdout:2/876: creat da/d65/f11d x:0 0 0 2024-02-28T16:27:14.570 INFO:tasks.workunit.client.1.smithi157.stdout:5/855: dread - d0/d30/def/d51/ffc zero size 2024-02-28T16:27:14.573 INFO:tasks.workunit.client.1.smithi157.stdout:2/877: write da/d38/fee [1578884,111190] 0 2024-02-28T16:27:14.574 INFO:tasks.workunit.client.1.smithi157.stdout:8/786: readlink d1/d5/d43/d66/dfc/l106 0 2024-02-28T16:27:14.574 INFO:tasks.workunit.client.1.smithi157.stdout:6/787: mknod d2/d7/d8/da/d71/d80/ceb 0 2024-02-28T16:27:14.581 INFO:tasks.workunit.client.1.smithi157.stdout:3/737: chown d0/d6/d34/d43/dac 10 1 2024-02-28T16:27:14.582 INFO:tasks.workunit.client.1.smithi157.stdout:9/779: getdents d0/d36/d37/d4d/d92/db9 0 2024-02-28T16:27:14.583 INFO:tasks.workunit.client.1.smithi157.stdout:6/788: chown d2/d7/d8/da/d71/d8f/f73 550553 1 2024-02-28T16:27:14.583 INFO:tasks.workunit.client.1.smithi157.stdout:5/856: creat d0/d30/def/d51/f124 x:0 0 0 2024-02-28T16:27:14.585 INFO:tasks.workunit.client.1.smithi157.stdout:8/787: write d1/d5/d43/d86/f97 [1385208,91734] 0 2024-02-28T16:27:14.586 INFO:tasks.workunit.client.1.smithi157.stdout:1/805: creat d10/d11/d31/d7f/f104 x:0 0 0 2024-02-28T16:27:14.588 INFO:tasks.workunit.client.1.smithi157.stdout:7/810: creat df/d1f/f102 x:0 0 0 2024-02-28T16:27:14.589 INFO:tasks.workunit.client.1.smithi157.stdout:9/780: creat d0/d36/daa/f109 x:0 0 0 2024-02-28T16:27:14.592 INFO:tasks.workunit.client.1.smithi157.stdout:5/857: unlink d0/d9/d47/d5b/d89/fbe 0 2024-02-28T16:27:14.592 INFO:tasks.workunit.client.1.smithi157.stdout:0/844: dwrite d1/f15 [0,4194304] 0 2024-02-28T16:27:14.593 INFO:tasks.workunit.client.1.smithi157.stdout:3/738: write d0/d6/d44/fe0 [4917480,100392] 0 2024-02-28T16:27:14.596 INFO:tasks.workunit.client.1.smithi157.stdout:8/788: mkdir d1/d5/d23/d38/d6e/d85/d10e 0 2024-02-28T16:27:14.597 INFO:tasks.workunit.client.1.smithi157.stdout:1/806: creat d10/d11/d3a/d95/da4/dd8/f105 x:0 0 0 2024-02-28T16:27:14.601 INFO:tasks.workunit.client.1.smithi157.stdout:6/789: rename d2/d7/d8/dd4/d66/f84 to d2/d7/d8/da/da1/fec 0 2024-02-28T16:27:14.601 INFO:tasks.workunit.client.1.smithi157.stdout:4/783: write d3/da/d37/fa0 [4294957,22251] 0 2024-02-28T16:27:14.602 INFO:tasks.workunit.client.1.smithi157.stdout:3/739: write d0/d6/d44/d70/d71/d87/dd1/d9d/fa4 [2271320,111378] 0 2024-02-28T16:27:14.604 INFO:tasks.workunit.client.1.smithi157.stdout:2/878: dwrite da/d38/d5a/fdb [0,4194304] 0 2024-02-28T16:27:14.613 INFO:tasks.workunit.client.1.smithi157.stdout:8/789: dread d1/d5/d23/d53/f6c [0,4194304] 0 2024-02-28T16:27:14.614 INFO:tasks.workunit.client.1.smithi157.stdout:9/781: symlink d0/d36/d37/d40/d5b/dba/dfe/l10a 0 2024-02-28T16:27:14.616 INFO:tasks.workunit.client.1.smithi157.stdout:6/790: creat d2/d7/d92/d9d/fed x:0 0 0 2024-02-28T16:27:14.620 INFO:tasks.workunit.client.1.smithi157.stdout:3/740: chown d0/d6/d34/lc3 956956 1 2024-02-28T16:27:14.620 INFO:tasks.workunit.client.1.smithi157.stdout:9/782: truncate d0/d36/d37/d4d/d92/fb6 4638507 0 2024-02-28T16:27:14.621 INFO:tasks.workunit.client.1.smithi157.stdout:3/741: write d0/fa3 [1013792,70641] 0 2024-02-28T16:27:14.622 INFO:tasks.workunit.client.1.smithi157.stdout:9/783: fsync d0/d36/daa/fd1 0 2024-02-28T16:27:14.625 INFO:tasks.workunit.client.1.smithi157.stdout:0/845: creat d1/da/f121 x:0 0 0 2024-02-28T16:27:14.626 INFO:tasks.workunit.client.1.smithi157.stdout:8/790: fsync d1/d5/d4d/dd6/ddb/f107 0 2024-02-28T16:27:14.627 INFO:tasks.workunit.client.1.smithi157.stdout:5/858: rename d0/d30/def/f18 to d0/d30/def/d7e/f125 0 2024-02-28T16:27:14.628 INFO:tasks.workunit.client.1.smithi157.stdout:1/807: creat d10/d11/d31/d7f/f106 x:0 0 0 2024-02-28T16:27:14.630 INFO:tasks.workunit.client.1.smithi157.stdout:0/846: chown d1/d13/cc3 873 1 2024-02-28T16:27:14.631 INFO:tasks.workunit.client.1.smithi157.stdout:7/811: dread df/d25/db5/fe0 [0,4194304] 0 2024-02-28T16:27:14.631 INFO:tasks.workunit.client.1.smithi157.stdout:1/808: write fa [770944,47993] 0 2024-02-28T16:27:14.635 INFO:tasks.workunit.client.1.smithi157.stdout:0/847: fdatasync d1/d13/d46/d99/f101 0 2024-02-28T16:27:14.637 INFO:tasks.workunit.client.1.smithi157.stdout:1/809: creat d10/d11/d7e/f107 x:0 0 0 2024-02-28T16:27:14.637 INFO:tasks.workunit.client.1.smithi157.stdout:7/812: creat df/d1f/d24/d4f/d72/dab/f103 x:0 0 0 2024-02-28T16:27:14.637 INFO:tasks.workunit.client.1.smithi157.stdout:2/879: write da/fcc [605393,111932] 0 2024-02-28T16:27:14.640 INFO:tasks.workunit.client.1.smithi157.stdout:2/880: stat da/d38/c85 0 2024-02-28T16:27:14.642 INFO:tasks.workunit.client.1.smithi157.stdout:5/859: getdents d0/d9/d47/dad/db4 0 2024-02-28T16:27:14.643 INFO:tasks.workunit.client.1.smithi157.stdout:3/742: write d0/d6/d44/d48/f6e [1243973,76525] 0 2024-02-28T16:27:14.645 INFO:tasks.workunit.client.1.smithi157.stdout:8/791: write d1/f4 [647023,87357] 0 2024-02-28T16:27:14.645 INFO:tasks.workunit.client.1.smithi157.stdout:2/881: unlink da/fcc 0 2024-02-28T16:27:14.649 INFO:tasks.workunit.client.1.smithi157.stdout:0/848: creat d1/d13/d7f/f122 x:0 0 0 2024-02-28T16:27:14.651 INFO:tasks.workunit.client.1.smithi157.stdout:4/784: dwrite d3/da/d1f/d22/f44 [4194304,4194304] 0 2024-02-28T16:27:14.651 INFO:tasks.workunit.client.1.smithi157.stdout:3/743: mknod d0/d6/d44/d70/cf5 0 2024-02-28T16:27:14.651 INFO:tasks.workunit.client.1.smithi157.stdout:2/882: dread - da/d38/d7e/d92/dd2/fd7 zero size 2024-02-28T16:27:14.653 INFO:tasks.workunit.client.1.smithi157.stdout:6/791: dread d2/d7/de/d1b/f28 [0,4194304] 0 2024-02-28T16:27:14.654 INFO:tasks.workunit.client.1.smithi157.stdout:5/860: mknod d0/d9/d47/d10e/c126 0 2024-02-28T16:27:14.654 INFO:tasks.workunit.client.1.smithi157.stdout:8/792: mkdir d1/d5/dd8/d52/d54/d10f 0 2024-02-28T16:27:14.656 INFO:tasks.workunit.client.1.smithi157.stdout:1/810: getdents d10/d11/d3a/d5c 0 2024-02-28T16:27:14.659 INFO:tasks.workunit.client.1.smithi157.stdout:0/849: symlink d1/d13/d52/d53/l123 0 2024-02-28T16:27:14.659 INFO:tasks.workunit.client.1.smithi157.stdout:1/811: chown d10/d11/d31/d7f/f106 113857 1 2024-02-28T16:27:14.660 INFO:tasks.workunit.client.1.smithi157.stdout:7/813: getdents df/d1f/d37 0 2024-02-28T16:27:14.663 INFO:tasks.workunit.client.1.smithi157.stdout:7/814: truncate df/d25/da7/fe7 123136 0 2024-02-28T16:27:14.664 INFO:tasks.workunit.client.1.smithi157.stdout:5/861: rmdir d0/d30/da0/dfd/d106 39 2024-02-28T16:27:14.665 INFO:tasks.workunit.client.1.smithi157.stdout:4/785: symlink d3/da/d1f/dc1/dc8/lfe 0 2024-02-28T16:27:14.667 INFO:tasks.workunit.client.1.smithi157.stdout:6/792: creat d2/d7/d8/da/d71/d8f/db4/fee x:0 0 0 2024-02-28T16:27:14.668 INFO:tasks.workunit.client.1.smithi157.stdout:2/883: symlink da/d38/d3e/d9b/d104/l11e 0 2024-02-28T16:27:14.670 INFO:tasks.workunit.client.1.smithi157.stdout:0/850: dread d1/d8/d33/f44 [0,4194304] 0 2024-02-28T16:27:14.670 INFO:tasks.workunit.client.1.smithi157.stdout:5/862: fsync d0/d9/d1b/f67 0 2024-02-28T16:27:14.671 INFO:tasks.workunit.client.1.smithi157.stdout:8/793: mkdir d1/d5/d23/d38/d6e/d85/d10e/d110 0 2024-02-28T16:27:14.673 INFO:tasks.workunit.client.1.smithi157.stdout:7/815: fdatasync df/d1f/d24/d39/fb4 0 2024-02-28T16:27:14.677 INFO:tasks.workunit.client.1.smithi157.stdout:2/884: symlink da/d8c/df0/l11f 0 2024-02-28T16:27:14.677 INFO:tasks.workunit.client.1.smithi157.stdout:3/744: dwrite d0/d6/d34/fd9 [0,4194304] 0 2024-02-28T16:27:14.679 INFO:tasks.workunit.client.1.smithi157.stdout:2/885: read da/d2b/f50 [293399,54926] 0 2024-02-28T16:27:14.682 INFO:tasks.workunit.client.1.smithi157.stdout:4/786: getdents d3/da/d28 0 2024-02-28T16:27:14.723 INFO:tasks.workunit.client.1.smithi157.stdout:1/812: truncate d10/d94/fb3 1224585 0 2024-02-28T16:27:14.724 INFO:tasks.workunit.client.1.smithi157.stdout:5/863: creat d0/d30/dca/f127 x:0 0 0 2024-02-28T16:27:14.724 INFO:tasks.workunit.client.1.smithi157.stdout:8/794: dread - d1/d5/d23/f6b zero size 2024-02-28T16:27:14.725 INFO:tasks.workunit.client.1.smithi157.stdout:3/745: fsync d0/d6/f17 0 2024-02-28T16:27:14.725 INFO:tasks.workunit.client.1.smithi157.stdout:2/886: creat da/d2b/d59/d109/f120 x:0 0 0 2024-02-28T16:27:14.727 INFO:tasks.workunit.client.1.smithi157.stdout:5/864: fsync d0/d30/da0/dfd/fb9 0 2024-02-28T16:27:14.729 INFO:tasks.workunit.client.1.smithi157.stdout:3/746: fsync d0/d6/d44/d8e/da8/f9a 0 2024-02-28T16:27:14.729 INFO:tasks.workunit.client.1.smithi157.stdout:5/865: stat d0/d30/f5f 0 2024-02-28T16:27:14.730 INFO:tasks.workunit.client.1.smithi157.stdout:2/887: fsync da/d2b/d59/d109/f120 0 2024-02-28T16:27:14.733 INFO:tasks.workunit.client.1.smithi157.stdout:2/888: write da/d35/fe5 [2655278,57141] 0 2024-02-28T16:27:14.736 INFO:tasks.workunit.client.1.smithi157.stdout:6/793: link d2/d7/d38/lb0 d2/d7/d8/dd4/lef 0 2024-02-28T16:27:14.736 INFO:tasks.workunit.client.1.smithi157.stdout:8/795: creat d1/d5/d23/dbd/dc9/d108/f111 x:0 0 0 2024-02-28T16:27:14.740 INFO:tasks.workunit.client.1.smithi157.stdout:2/889: symlink da/d8c/df0/l121 0 2024-02-28T16:27:14.742 INFO:tasks.workunit.client.1.smithi157.stdout:5/866: write d0/d30/def/d7e/d82/fc3 [1532631,37682] 0 2024-02-28T16:27:14.742 INFO:tasks.workunit.client.1.smithi157.stdout:0/851: dread d1/d13/ff [0,4194304] 0 2024-02-28T16:27:14.749 INFO:tasks.workunit.client.1.smithi157.stdout:4/787: dwrite d3/da/d1f/d22/f3c [0,4194304] 0 2024-02-28T16:27:14.749 INFO:tasks.workunit.client.1.smithi157.stdout:1/813: dwrite d10/d11/d3a/d5c/d6a/fa6 [0,4194304] 0 2024-02-28T16:27:14.752 INFO:tasks.workunit.client.1.smithi157.stdout:4/788: read d3/da/f4f [198095,71834] 0 2024-02-28T16:27:14.753 INFO:tasks.workunit.client.1.smithi157.stdout:1/814: write d10/d11/d3a/d5c/d6a/fee [595410,4517] 0 2024-02-28T16:27:14.753 INFO:tasks.workunit.client.1.smithi157.stdout:8/796: chown d1/d5/d23/d38/d67/d6d/cd0 0 1 2024-02-28T16:27:14.754 INFO:tasks.workunit.client.1.smithi157.stdout:3/747: dwrite d0/d6/d44/d70/d71/d87/dd1/d9d/fb2 [0,4194304] 0 2024-02-28T16:27:14.754 INFO:tasks.workunit.client.1.smithi157.stdout:6/794: symlink d2/d7/d92/d9d/lf0 0 2024-02-28T16:27:14.757 INFO:tasks.workunit.client.1.smithi157.stdout:1/815: write d10/d11/d31/f41 [2763792,72539] 0 2024-02-28T16:27:14.758 INFO:tasks.workunit.client.1.smithi157.stdout:2/890: unlink da/d38/d7e/dbb/dd0/fe2 0 2024-02-28T16:27:14.764 INFO:tasks.workunit.client.1.smithi157.stdout:1/816: read d10/f6b [2321416,17115] 0 2024-02-28T16:27:14.764 INFO:tasks.workunit.client.1.smithi157.stdout:2/891: truncate da/f28 1522858 0 2024-02-28T16:27:14.764 INFO:tasks.workunit.client.1.smithi157.stdout:0/852: creat d1/da/d7d/d98/f124 x:0 0 0 2024-02-28T16:27:14.768 INFO:tasks.workunit.client.1.smithi157.stdout:3/748: unlink d0/f24 0 2024-02-28T16:27:14.775 INFO:tasks.workunit.client.1.smithi157.stdout:4/789: rename d3/da/d28/f5a to d3/dcc/fff 0 2024-02-28T16:27:14.775 INFO:tasks.workunit.client.1.smithi157.stdout:6/795: dwrite d2/d7/d8/da/f91 [0,4194304] 0 2024-02-28T16:27:14.776 INFO:tasks.workunit.client.1.smithi157.stdout:4/790: chown d3/f5f 74 1 2024-02-28T16:27:14.779 INFO:tasks.workunit.client.1.smithi157.stdout:5/867: write d0/d30/def/f93 [332042,27739] 0 2024-02-28T16:27:14.780 INFO:tasks.workunit.client.1.smithi157.stdout:1/817: unlink d10/d11/d7e/fa7 0 2024-02-28T16:27:14.782 INFO:tasks.workunit.client.1.smithi157.stdout:0/853: stat d1/d8/d33/f4e 0 2024-02-28T16:27:14.782 INFO:tasks.workunit.client.1.smithi157.stdout:1/818: chown d10/d11/d31/d2a/ce0 281438 1 2024-02-28T16:27:14.790 INFO:tasks.workunit.client.1.smithi157.stdout:3/749: fdatasync d0/d6/f5f 0 2024-02-28T16:27:14.793 INFO:tasks.workunit.client.1.smithi157.stdout:4/791: dwrite d3/da/d48/d8e/fe1 [0,4194304] 0 2024-02-28T16:27:14.794 INFO:tasks.workunit.client.1.smithi157.stdout:6/796: rename d2/d7/d8/da/d31/d3a/dc6/fcb to d2/d7/d92/ff1 0 2024-02-28T16:27:14.799 INFO:tasks.workunit.client.1.smithi157.stdout:1/819: symlink d10/d11/d31/d2a/d70/d9b/l108 0 2024-02-28T16:27:14.799 INFO:tasks.workunit.client.1.smithi157.stdout:2/892: mknod da/d38/d3e/c122 0 2024-02-28T16:27:14.800 INFO:tasks.workunit.client.1.smithi157.stdout:2/893: readlink da/l20 0 2024-02-28T16:27:14.800 INFO:tasks.workunit.client.1.smithi157.stdout:5/868: dwrite d0/d9/d47/d5b/d89/d75/fed [0,4194304] 0 2024-02-28T16:27:14.801 INFO:tasks.workunit.client.1.smithi157.stdout:2/894: chown da/d38/d4e 1399983965 1 2024-02-28T16:27:14.802 INFO:tasks.workunit.client.1.smithi157.stdout:8/797: creat d1/d5/d4d/f112 x:0 0 0 2024-02-28T16:27:14.815 INFO:tasks.workunit.client.1.smithi157.stdout:1/820: symlink d10/d11/d31/dcb/l109 0 2024-02-28T16:27:14.818 INFO:tasks.workunit.client.1.smithi157.stdout:9/784: sync 2024-02-28T16:27:14.819 INFO:tasks.workunit.client.1.smithi157.stdout:9/785: write d0/fab [3059715,80206] 0 2024-02-28T16:27:14.823 INFO:tasks.workunit.client.1.smithi157.stdout:5/869: rmdir d0/d30/def/d51 39 2024-02-28T16:27:14.826 INFO:tasks.workunit.client.1.smithi157.stdout:8/798: rename d1/d5/d10/l9f to d1/d5/d23/dbd/dc9/d108/l113 0 2024-02-28T16:27:14.829 INFO:tasks.workunit.client.1.smithi157.stdout:4/792: symlink d3/da/d1f/l100 0 2024-02-28T16:27:14.836 INFO:tasks.workunit.client.1.smithi157.stdout:8/799: unlink d1/f4f 0 2024-02-28T16:27:14.837 INFO:tasks.workunit.client.1.smithi157.stdout:1/821: mknod d10/d11/d31/c10a 0 2024-02-28T16:27:14.838 INFO:tasks.workunit.client.1.smithi157.stdout:2/895: rmdir da/d38/d5a/d5c/d11c 0 2024-02-28T16:27:14.840 INFO:tasks.workunit.client.1.smithi157.stdout:9/786: creat d0/d19/df7/f10b x:0 0 0 2024-02-28T16:27:14.845 INFO:tasks.workunit.client.1.smithi157.stdout:8/800: rename d1/d5/d23/da1/la3 to d1/d5/d23/dbd/dc9/l114 0 2024-02-28T16:27:14.845 INFO:tasks.workunit.client.1.smithi157.stdout:2/896: mkdir da/d65/d123 0 2024-02-28T16:27:14.846 INFO:tasks.workunit.client.1.smithi157.stdout:9/787: creat d0/f10c x:0 0 0 2024-02-28T16:27:14.846 INFO:tasks.workunit.client.1.smithi157.stdout:4/793: creat d3/da/f101 x:0 0 0 2024-02-28T16:27:14.847 INFO:tasks.workunit.client.1.smithi157.stdout:8/801: stat d1/d5/d43/d86/lb3 0 2024-02-28T16:27:14.847 INFO:tasks.workunit.client.1.smithi157.stdout:1/822: mknod d10/d11/d3a/c10b 0 2024-02-28T16:27:14.848 INFO:tasks.workunit.client.1.smithi157.stdout:2/897: unlink da/d38/f89 0 2024-02-28T16:27:14.849 INFO:tasks.workunit.client.1.smithi157.stdout:8/802: stat d1/d5/d43/d86/d96/f75 0 2024-02-28T16:27:14.851 INFO:tasks.workunit.client.1.smithi157.stdout:2/898: chown da/d38/d3e 96586 1 2024-02-28T16:27:14.851 INFO:tasks.workunit.client.1.smithi157.stdout:5/870: dread d0/d9/f42 [4194304,4194304] 0 2024-02-28T16:27:14.854 INFO:tasks.workunit.client.1.smithi157.stdout:0/854: dwrite d1/d8/d33/f9e [0,4194304] 0 2024-02-28T16:27:14.855 INFO:tasks.workunit.client.1.smithi157.stdout:8/803: write d1/d5/d23/d53/dc1/fd9 [151238,69373] 0 2024-02-28T16:27:14.857 INFO:tasks.workunit.client.1.smithi157.stdout:0/855: chown d1/d13/d46/c82 1684 1 2024-02-28T16:27:14.858 INFO:tasks.workunit.client.1.smithi157.stdout:0/856: stat d1/c3f 0 2024-02-28T16:27:14.859 INFO:tasks.workunit.client.1.smithi157.stdout:2/899: symlink da/d38/d7e/d92/dd2/l124 0 2024-02-28T16:27:14.862 INFO:tasks.workunit.client.1.smithi157.stdout:2/900: write da/d38/d7e/d92/dd2/fd7 [700609,130351] 0 2024-02-28T16:27:14.864 INFO:tasks.workunit.client.1.smithi157.stdout:8/804: symlink d1/d5/d109/l115 0 2024-02-28T16:27:14.866 INFO:tasks.workunit.client.1.smithi157.stdout:7/816: sync 2024-02-28T16:27:14.871 INFO:tasks.workunit.client.1.smithi157.stdout:5/871: rename d0/d9/d3a/l68 to d0/d30/d50/d7f/l128 0 2024-02-28T16:27:14.871 INFO:tasks.workunit.client.1.smithi157.stdout:2/901: mkdir da/d38/d7e/dbb/dd0/d125 0 2024-02-28T16:27:14.873 INFO:tasks.workunit.client.1.smithi157.stdout:7/817: truncate df/d1f/d24/d4f/d72/dab/f103 29062 0 2024-02-28T16:27:14.875 INFO:tasks.workunit.client.1.smithi157.stdout:7/818: dread - df/d25/d4e/d67/ff8 zero size 2024-02-28T16:27:14.876 INFO:tasks.workunit.client.1.smithi157.stdout:4/794: dread d3/da/d37/fa4 [0,4194304] 0 2024-02-28T16:27:14.884 INFO:tasks.workunit.client.1.smithi157.stdout:2/902: dread da/d38/fee [0,4194304] 0 2024-02-28T16:27:14.884 INFO:tasks.workunit.client.1.smithi157.stdout:0/857: dwrite d1/d8/d33/d96/f117 [4194304,4194304] 0 2024-02-28T16:27:14.885 INFO:tasks.workunit.client.1.smithi157.stdout:5/872: mkdir d0/d9/d47/dad/deb/d129 0 2024-02-28T16:27:14.893 INFO:tasks.workunit.client.1.smithi157.stdout:3/750: fsync d0/d6/d34/d43/dac/fe8 0 2024-02-28T16:27:14.893 INFO:tasks.workunit.client.1.smithi157.stdout:6/797: dwrite d2/d7/d8/da/da1/fbe [0,4194304] 0 2024-02-28T16:27:14.897 INFO:tasks.workunit.client.1.smithi157.stdout:6/798: chown d2/d17/c18 2862 1 2024-02-28T16:27:14.897 INFO:tasks.workunit.client.1.smithi157.stdout:4/795: mknod d3/da/d1f/dc1/dc8/c102 0 2024-02-28T16:27:14.900 INFO:tasks.workunit.client.1.smithi157.stdout:4/796: read - d3/da/d48/d4a/fe0 zero size 2024-02-28T16:27:14.902 INFO:tasks.workunit.client.1.smithi157.stdout:7/819: symlink df/d1f/d24/d39/df2/l104 0 2024-02-28T16:27:14.903 INFO:tasks.workunit.client.1.smithi157.stdout:3/751: mknod d0/d6/d44/d8e/cf6 0 2024-02-28T16:27:14.906 INFO:tasks.workunit.client.1.smithi157.stdout:6/799: fsync d2/f1f 0 2024-02-28T16:27:14.913 INFO:tasks.workunit.client.1.smithi157.stdout:4/797: creat d3/d77/daa/f103 x:0 0 0 2024-02-28T16:27:14.914 INFO:tasks.workunit.client.1.smithi157.stdout:7/820: creat df/d1f/d24/d4f/d72/dab/f105 x:0 0 0 2024-02-28T16:27:14.920 INFO:tasks.workunit.client.1.smithi157.stdout:0/858: link d1/da/lbd d1/d13/d52/db5/d8e/l125 0 2024-02-28T16:27:14.928 INFO:tasks.workunit.client.1.smithi157.stdout:5/873: getdents d0/d30/dca 0 2024-02-28T16:27:14.928 INFO:tasks.workunit.client.1.smithi157.stdout:4/798: rmdir d3 39 2024-02-28T16:27:14.929 INFO:tasks.workunit.client.1.smithi157.stdout:7/821: readlink df/d1f/d24/ldb 0 2024-02-28T16:27:14.932 INFO:tasks.workunit.client.1.smithi157.stdout:0/859: unlink d1/d13/d52/d53/cfb 0 2024-02-28T16:27:14.932 INFO:tasks.workunit.client.1.smithi157.stdout:3/752: getdents d0/d6/d34/d80/d23/d2b/dec 0 2024-02-28T16:27:14.933 INFO:tasks.workunit.client.1.smithi157.stdout:7/822: write df/d4b/f101 [1040257,17327] 0 2024-02-28T16:27:14.940 INFO:tasks.workunit.client.1.smithi157.stdout:9/788: chown d0/d19/c22 38311 1 2024-02-28T16:27:14.940 INFO:tasks.workunit.client.1.smithi157.stdout:0/860: creat d1/da/d7d/dc4/f126 x:0 0 0 2024-02-28T16:27:14.942 INFO:tasks.workunit.client.1.smithi157.stdout:4/799: creat d3/dcc/f104 x:0 0 0 2024-02-28T16:27:14.943 INFO:tasks.workunit.client.1.smithi157.stdout:3/753: symlink d0/d6/d34/d43/dac/lf7 0 2024-02-28T16:27:14.945 INFO:tasks.workunit.client.1.smithi157.stdout:7/823: creat df/d1f/d24/d4f/d72/dab/dec/f106 x:0 0 0 2024-02-28T16:27:14.948 INFO:tasks.workunit.client.1.smithi157.stdout:0/861: truncate d1/d13/d7f/f122 707265 0 2024-02-28T16:27:14.949 INFO:tasks.workunit.client.1.smithi157.stdout:4/800: symlink d3/da/d1f/dc1/dc8/l105 0 2024-02-28T16:27:14.949 INFO:tasks.workunit.client.1.smithi157.stdout:5/874: dwrite d0/d30/def/fa8 [0,4194304] 0 2024-02-28T16:27:14.950 INFO:tasks.workunit.client.1.smithi157.stdout:7/824: fsync df/d25/d79/d9e/fee 0 2024-02-28T16:27:14.950 INFO:tasks.workunit.client.1.smithi157.stdout:1/823: dwrite d10/f1b [0,4194304] 0 2024-02-28T16:27:14.952 INFO:tasks.workunit.client.1.smithi157.stdout:9/789: mknod d0/dc0/de3/c10d 0 2024-02-28T16:27:14.954 INFO:tasks.workunit.client.1.smithi157.stdout:4/801: creat d3/d77/f106 x:0 0 0 2024-02-28T16:27:14.954 INFO:tasks.workunit.client.1.smithi157.stdout:1/824: chown d10/d11/d3a/d5c/d84/l8a 6 1 2024-02-28T16:27:14.957 INFO:tasks.workunit.client.1.smithi157.stdout:3/754: rename d0/dee to d0/d6/d6b/d75/df0/df8 0 2024-02-28T16:27:14.958 INFO:tasks.workunit.client.1.smithi157.stdout:5/875: write d0/d30/def/d51/ffc [355249,95832] 0 2024-02-28T16:27:14.960 INFO:tasks.workunit.client.1.smithi157.stdout:4/802: chown d3/da/d48/d4a/db7/ddc 918 1 2024-02-28T16:27:14.964 INFO:tasks.workunit.client.1.smithi157.stdout:1/825: chown d10/d11/d31/d2a/f5d 63534822 1 2024-02-28T16:27:14.965 INFO:tasks.workunit.client.1.smithi157.stdout:1/826: fsync d10/d11/d3a/f3c 0 2024-02-28T16:27:14.966 INFO:tasks.workunit.client.1.smithi157.stdout:8/805: write d1/d5/dd8/f84 [397243,51386] 0 2024-02-28T16:27:14.967 INFO:tasks.workunit.client.1.smithi157.stdout:5/876: chown d0/d30/da0/dfd/d106 2271709 1 2024-02-28T16:27:14.968 INFO:tasks.workunit.client.1.smithi157.stdout:7/825: rmdir df/d1f/d24/d39/df2 39 2024-02-28T16:27:14.973 INFO:tasks.workunit.client.1.smithi157.stdout:9/790: dwrite d0/dc0/fed [0,4194304] 0 2024-02-28T16:27:14.977 INFO:tasks.workunit.client.1.smithi157.stdout:2/903: truncate da/d38/d4e/d91/f8a 1196023 0 2024-02-28T16:27:14.977 INFO:tasks.workunit.client.1.smithi157.stdout:8/806: rmdir d1/d5/d14 39 2024-02-28T16:27:14.980 INFO:tasks.workunit.client.1.smithi157.stdout:1/827: mknod d10/d11/d31/d2a/d70/de8/c10c 0 2024-02-28T16:27:14.984 INFO:tasks.workunit.client.1.smithi157.stdout:7/826: symlink df/d1f/d24/d39/d64/l107 0 2024-02-28T16:27:14.984 INFO:tasks.workunit.client.1.smithi157.stdout:0/862: fsync d1/da/d7d/dc4/f126 0 2024-02-28T16:27:14.984 INFO:tasks.workunit.client.1.smithi157.stdout:3/755: dwrite d0/d6/d34/d43/fd8 [0,4194304] 0 2024-02-28T16:27:14.986 INFO:tasks.workunit.client.1.smithi157.stdout:5/877: mkdir d0/d30/da0/d12a 0 2024-02-28T16:27:14.988 INFO:tasks.workunit.client.1.smithi157.stdout:1/828: write d10/d11/d3a/f5f [4854246,21277] 0 2024-02-28T16:27:14.989 INFO:tasks.workunit.client.1.smithi157.stdout:9/791: mkdir d0/d19/d30/d79/d10e 0 2024-02-28T16:27:14.992 INFO:tasks.workunit.client.1.smithi157.stdout:0/863: mknod d1/da/d7d/d98/c127 0 2024-02-28T16:27:14.995 INFO:tasks.workunit.client.1.smithi157.stdout:0/864: chown d1/d13/d46/l3d 78363 1 2024-02-28T16:27:14.996 INFO:tasks.workunit.client.1.smithi157.stdout:3/756: creat d0/d6/d34/d80/d23/d2b/d2e/ff9 x:0 0 0 2024-02-28T16:27:14.998 INFO:tasks.workunit.client.1.smithi157.stdout:5/878: dread d0/d30/def/d51/ffc [0,4194304] 0 2024-02-28T16:27:14.999 INFO:tasks.workunit.client.1.smithi157.stdout:1/829: chown d10/d11/c75 1469 1 2024-02-28T16:27:14.999 INFO:tasks.workunit.client.1.smithi157.stdout:0/865: stat d1/d13/d52/db5/l67 0 2024-02-28T16:27:15.003 INFO:tasks.workunit.client.1.smithi157.stdout:3/757: dread - d0/d6/d34/d80/d23/d2b/fab zero size 2024-02-28T16:27:15.004 INFO:tasks.workunit.client.1.smithi157.stdout:6/800: sync 2024-02-28T16:27:15.005 INFO:tasks.workunit.client.1.smithi157.stdout:4/803: dread d3/da/d1f/f40 [0,4194304] 0 2024-02-28T16:27:15.006 INFO:tasks.workunit.client.1.smithi157.stdout:1/830: chown d10/d11/d31/lf2 6907625 1 2024-02-28T16:27:15.007 INFO:tasks.workunit.client.1.smithi157.stdout:9/792: dread d0/d19/d30/d79/f87 [0,4194304] 0 2024-02-28T16:27:15.007 INFO:tasks.workunit.client.1.smithi157.stdout:8/807: write d1/d5/f3b [5204468,127398] 0 2024-02-28T16:27:15.012 INFO:tasks.workunit.client.1.smithi157.stdout:2/904: write da/f12 [3350847,26183] 0 2024-02-28T16:27:15.013 INFO:tasks.workunit.client.1.smithi157.stdout:0/866: mknod d1/d13/d46/c128 0 2024-02-28T16:27:15.014 INFO:tasks.workunit.client.1.smithi157.stdout:7/827: write df/d1f/d24/d39/fb4 [1494154,55064] 0 2024-02-28T16:27:15.016 INFO:tasks.workunit.client.1.smithi157.stdout:4/804: stat d3/da/d1f/d22/ca2 0 2024-02-28T16:27:15.019 INFO:tasks.workunit.client.1.smithi157.stdout:4/805: read - d3/da/d37/d84/d9a/dab/fc6 zero size 2024-02-28T16:27:15.037 INFO:tasks.workunit.client.1.smithi157.stdout:6/801: mkdir d2/d7/d8/da/d71/d8f/db4/df2 0 2024-02-28T16:27:15.039 INFO:tasks.workunit.client.1.smithi157.stdout:9/793: fsync d0/d36/d37/f43 0 2024-02-28T16:27:15.039 INFO:tasks.workunit.client.1.smithi157.stdout:5/879: creat d0/f12b x:0 0 0 2024-02-28T16:27:15.040 INFO:tasks.workunit.client.1.smithi157.stdout:9/794: chown d0/dc0/de3 6536 1 2024-02-28T16:27:15.041 INFO:tasks.workunit.client.1.smithi157.stdout:9/795: readlink d0/d36/d37/d40/d4b/l77 0 2024-02-28T16:27:15.042 INFO:tasks.workunit.client.1.smithi157.stdout:8/808: rename d1/lec to d1/d5/d43/d86/d96/l116 0 2024-02-28T16:27:15.043 INFO:tasks.workunit.client.1.smithi157.stdout:1/831: dread - d10/d11/d31/d2a/fb2 zero size 2024-02-28T16:27:15.045 INFO:tasks.workunit.client.1.smithi157.stdout:1/832: write d10/d11/d3a/d5c/f87 [5066588,6655] 0 2024-02-28T16:27:15.046 INFO:tasks.workunit.client.1.smithi157.stdout:4/806: creat d3/da/d1f/d22/f107 x:0 0 0 2024-02-28T16:27:15.047 INFO:tasks.workunit.client.1.smithi157.stdout:1/833: write d10/d11/f32 [3156951,19118] 0 2024-02-28T16:27:15.048 INFO:tasks.workunit.client.1.smithi157.stdout:4/807: dread - d3/da/f101 zero size 2024-02-28T16:27:15.049 INFO:tasks.workunit.client.1.smithi157.stdout:9/796: mkdir d0/d19/d30/d10f 0 2024-02-28T16:27:15.050 INFO:tasks.workunit.client.1.smithi157.stdout:8/809: creat d1/d5/d23/d38/dfb/f117 x:0 0 0 2024-02-28T16:27:15.052 INFO:tasks.workunit.client.1.smithi157.stdout:0/867: creat d1/d8/da8/f129 x:0 0 0 2024-02-28T16:27:15.054 INFO:tasks.workunit.client.1.smithi157.stdout:4/808: mkdir d3/d77/daa/d108 0 2024-02-28T16:27:15.055 INFO:tasks.workunit.client.1.smithi157.stdout:8/810: chown d1/d5/d23/f91 22814 1 2024-02-28T16:27:15.061 INFO:tasks.workunit.client.1.smithi157.stdout:4/809: write d3/dcc/fff [1264427,120287] 0 2024-02-28T16:27:15.061 INFO:tasks.workunit.client.1.smithi157.stdout:5/880: dwrite d0/d9/d47/f105 [0,4194304] 0 2024-02-28T16:27:15.064 INFO:tasks.workunit.client.1.smithi157.stdout:8/811: unlink d1/d5/d14/f9b 0 2024-02-28T16:27:15.065 INFO:tasks.workunit.client.1.smithi157.stdout:7/828: dread f8 [0,4194304] 0 2024-02-28T16:27:15.067 INFO:tasks.workunit.client.1.smithi157.stdout:7/829: read - df/fcc zero size 2024-02-28T16:27:15.072 INFO:tasks.workunit.client.1.smithi157.stdout:8/812: write d1/d5/d23/d38/d6e/d85/f9d [1110243,103100] 0 2024-02-28T16:27:15.078 INFO:tasks.workunit.client.1.smithi157.stdout:4/810: symlink d3/da/d28/l109 0 2024-02-28T16:27:15.079 INFO:tasks.workunit.client.1.smithi157.stdout:9/797: link d0/d36/d37/cde d0/d36/d37/d4d/db5/c110 0 2024-02-28T16:27:15.085 INFO:tasks.workunit.client.1.smithi157.stdout:4/811: truncate d3/da/d48/fe7 396620 0 2024-02-28T16:27:15.085 INFO:tasks.workunit.client.1.smithi157.stdout:9/798: mkdir d0/d36/d3f/d69/d111 0 2024-02-28T16:27:15.086 INFO:tasks.workunit.client.1.smithi157.stdout:1/834: dread d10/d11/d31/d2a/f5d [0,4194304] 0 2024-02-28T16:27:15.089 INFO:tasks.workunit.client.1.smithi157.stdout:7/830: dwrite df/d1f/d24/d39/fd4 [0,4194304] 0 2024-02-28T16:27:15.092 INFO:tasks.workunit.client.1.smithi157.stdout:8/813: dwrite d1/fe5 [0,4194304] 0 2024-02-28T16:27:15.092 INFO:tasks.workunit.client.1.smithi157.stdout:0/868: dread d1/da/d6c/fa1 [0,4194304] 0 2024-02-28T16:27:15.094 INFO:tasks.workunit.client.1.smithi157.stdout:4/812: dread d3/da/d37/f78 [0,4194304] 0 2024-02-28T16:27:15.100 INFO:tasks.workunit.client.1.smithi157.stdout:8/814: creat d1/d5/d10/f118 x:0 0 0 2024-02-28T16:27:15.103 INFO:tasks.workunit.client.1.smithi157.stdout:8/815: stat d1/d5/dd8/ce7 0 2024-02-28T16:27:15.104 INFO:tasks.workunit.client.1.smithi157.stdout:0/869: mkdir d1/d13/d52/d12a 0 2024-02-28T16:27:15.108 INFO:tasks.workunit.client.1.smithi157.stdout:8/816: write d1/d5/d4d/dd6/ddb/f107 [75030,80854] 0 2024-02-28T16:27:15.108 INFO:tasks.workunit.client.1.smithi157.stdout:5/881: dwrite d0/d30/def/d51/ffc [0,4194304] 0 2024-02-28T16:27:15.110 INFO:tasks.workunit.client.1.smithi157.stdout:8/817: chown d1/d5/f71 29 1 2024-02-28T16:27:15.113 INFO:tasks.workunit.client.1.smithi157.stdout:9/799: write d0/f33 [3948747,26623] 0 2024-02-28T16:27:15.117 INFO:tasks.workunit.client.1.smithi157.stdout:1/835: getdents d10/d11/d3a/d5c/d6a 0 2024-02-28T16:27:15.118 INFO:tasks.workunit.client.1.smithi157.stdout:0/870: unlink d1/d13/f87 0 2024-02-28T16:27:15.120 INFO:tasks.workunit.client.1.smithi157.stdout:4/813: dwrite d3/da/d1f/d22/f3c [0,4194304] 0 2024-02-28T16:27:15.121 INFO:tasks.workunit.client.1.smithi157.stdout:8/818: mknod d1/d5/d23/d38/d6e/d85/c119 0 2024-02-28T16:27:15.121 INFO:tasks.workunit.client.1.smithi157.stdout:7/831: dread df/d4b/f95 [0,4194304] 0 2024-02-28T16:27:15.123 INFO:tasks.workunit.client.1.smithi157.stdout:5/882: rename d0/d9/d47/d5b/d89/d75/dab/f108 to d0/d30/def/d51/f12c 0 2024-02-28T16:27:15.124 INFO:tasks.workunit.client.1.smithi157.stdout:1/836: truncate d10/d11/d3a/d5c/d6c/d7b/f1e 8520489 0 2024-02-28T16:27:15.136 INFO:tasks.workunit.client.1.smithi157.stdout:9/800: mkdir d0/d36/d37/d112 0 2024-02-28T16:27:15.137 INFO:tasks.workunit.client.1.smithi157.stdout:7/832: creat df/d25/db5/f108 x:0 0 0 2024-02-28T16:27:15.143 INFO:tasks.workunit.client.1.smithi157.stdout:5/883: rename d0/d9/f48 to d0/d9/d47/dad/deb/f12d 0 2024-02-28T16:27:15.148 INFO:tasks.workunit.client.1.smithi157.stdout:7/833: getdents df/d1f/da1 0 2024-02-28T16:27:15.158 INFO:tasks.workunit.client.1.smithi157.stdout:5/884: dread d0/d9/f42 [4194304,4194304] 0 2024-02-28T16:27:15.160 INFO:tasks.workunit.client.1.smithi157.stdout:7/834: rename df/d25/fdd to df/d1f/d24/d4f/d72/f109 0 2024-02-28T16:27:15.161 INFO:tasks.workunit.client.1.smithi157.stdout:4/814: dread d3/da/d48/f7c [0,4194304] 0 2024-02-28T16:27:15.163 INFO:tasks.workunit.client.1.smithi157.stdout:0/871: dwrite d1/d13/d52/db5/d64/f85 [0,4194304] 0 2024-02-28T16:27:15.164 INFO:tasks.workunit.client.1.smithi157.stdout:9/801: write d0/d36/d37/d40/d5b/f8a [562783,5630] 0 2024-02-28T16:27:15.167 INFO:tasks.workunit.client.1.smithi157.stdout:4/815: readlink d3/da/d37/d84/d9a/df8/db0/lba 0 2024-02-28T16:27:15.169 INFO:tasks.workunit.client.1.smithi157.stdout:0/872: read d1/d8/d33/f9e [1316440,121436] 0 2024-02-28T16:27:15.171 INFO:tasks.workunit.client.1.smithi157.stdout:9/802: stat d0/d36/d37/d40/d5b/l8c 0 2024-02-28T16:27:15.172 INFO:tasks.workunit.client.1.smithi157.stdout:1/837: dwrite d10/d11/d31/d2a/d70/f53 [0,4194304] 0 2024-02-28T16:27:15.175 INFO:tasks.workunit.client.1.smithi157.stdout:2/905: sync 2024-02-28T16:27:15.176 INFO:tasks.workunit.client.1.smithi157.stdout:3/758: sync 2024-02-28T16:27:15.177 INFO:tasks.workunit.client.1.smithi157.stdout:3/759: chown d0/d6/d6b 200 1 2024-02-28T16:27:15.179 INFO:tasks.workunit.client.1.smithi157.stdout:3/760: chown d0/d6/d34/d80/d5c/fc7 45457 1 2024-02-28T16:27:15.180 INFO:tasks.workunit.client.1.smithi157.stdout:9/803: unlink d0/d36/d37/d40/d5b/ff9 0 2024-02-28T16:27:15.180 INFO:tasks.workunit.client.1.smithi157.stdout:5/885: dread d0/d9/f86 [0,4194304] 0 2024-02-28T16:27:15.181 INFO:tasks.workunit.client.1.smithi157.stdout:1/838: rmdir d10/d11/d31 39 2024-02-28T16:27:15.182 INFO:tasks.workunit.client.1.smithi157.stdout:8/819: dread d1/d5/d43/d86/d96/f75 [0,4194304] 0 2024-02-28T16:27:15.184 INFO:tasks.workunit.client.1.smithi157.stdout:3/761: dread - d0/d6/d6b/fdc zero size 2024-02-28T16:27:15.189 INFO:tasks.workunit.client.1.smithi157.stdout:0/873: creat d1/f12b x:0 0 0 2024-02-28T16:27:15.189 INFO:tasks.workunit.client.1.smithi157.stdout:8/820: mknod d1/d5/d23/d53/dc1/c11a 0 2024-02-28T16:27:15.194 INFO:tasks.workunit.client.1.smithi157.stdout:2/906: rename da/d47/dbd/dde/f49 to da/d8c/f126 0 2024-02-28T16:27:15.198 INFO:tasks.workunit.client.1.smithi157.stdout:1/839: creat d10/d11/d3a/d5c/d6c/d7b/f10d x:0 0 0 2024-02-28T16:27:15.199 INFO:tasks.workunit.client.1.smithi157.stdout:8/821: write d1/d5/f4a [1965764,85226] 0 2024-02-28T16:27:15.199 INFO:tasks.workunit.client.1.smithi157.stdout:5/886: dread d0/d9/d47/d5b/d89/d75/fb1 [0,4194304] 0 2024-02-28T16:27:15.202 INFO:tasks.workunit.client.1.smithi157.stdout:3/762: rename d0/d6/f17 to d0/d6/d34/d80/d23/d2b/d2e/d7e/ffa 0 2024-02-28T16:27:15.205 INFO:tasks.workunit.client.1.smithi157.stdout:7/835: dread df/f10 [0,4194304] 0 2024-02-28T16:27:15.207 INFO:tasks.workunit.client.1.smithi157.stdout:8/822: dread d1/d5/d23/d53/f6c [0,4194304] 0 2024-02-28T16:27:15.210 INFO:tasks.workunit.client.1.smithi157.stdout:4/816: dread d3/dcc/fff [0,4194304] 0 2024-02-28T16:27:15.211 INFO:tasks.workunit.client.1.smithi157.stdout:9/804: write d0/d19/f25 [441559,15946] 0 2024-02-28T16:27:15.212 INFO:tasks.workunit.client.1.smithi157.stdout:2/907: creat da/d38/d3e/f127 x:0 0 0 2024-02-28T16:27:15.213 INFO:tasks.workunit.client.1.smithi157.stdout:2/908: dread - da/d2b/f106 zero size 2024-02-28T16:27:15.215 INFO:tasks.workunit.client.1.smithi157.stdout:4/817: truncate d3/d77/daa/f103 400362 0 2024-02-28T16:27:15.217 INFO:tasks.workunit.client.1.smithi157.stdout:7/836: rename df/d1f/d37/l69 to df/d25/d79/d9a/l10a 0 2024-02-28T16:27:15.223 INFO:tasks.workunit.client.1.smithi157.stdout:5/887: dwrite d0/d9/d47/dad/ff2 [0,4194304] 0 2024-02-28T16:27:15.225 INFO:tasks.workunit.client.1.smithi157.stdout:6/802: sync 2024-02-28T16:27:15.230 INFO:tasks.workunit.client.1.smithi157.stdout:9/805: mkdir d0/d36/d37/d4d/d92/d108/d113 0 2024-02-28T16:27:15.231 INFO:tasks.workunit.client.1.smithi157.stdout:1/840: truncate d10/d11/d31/f41 115465 0 2024-02-28T16:27:15.233 INFO:tasks.workunit.client.1.smithi157.stdout:9/806: readlink d0/d19/d30/d78/ld3 0 2024-02-28T16:27:15.235 INFO:tasks.workunit.client.1.smithi157.stdout:5/888: readlink d0/d9/d47/d5b/l6e 0 2024-02-28T16:27:15.237 INFO:tasks.workunit.client.1.smithi157.stdout:6/803: symlink d2/d7/d8/da/d31/d3a/de2/lf3 0 2024-02-28T16:27:15.237 INFO:tasks.workunit.client.1.smithi157.stdout:0/874: dread d1/d8/d33/d96/fb1 [0,4194304] 0 2024-02-28T16:27:15.239 INFO:tasks.workunit.client.1.smithi157.stdout:1/841: rmdir d10/d11/d22/d99 39 2024-02-28T16:27:15.239 INFO:tasks.workunit.client.1.smithi157.stdout:9/807: chown d0/d36/d37/ce1 1 1 2024-02-28T16:27:15.241 INFO:tasks.workunit.client.1.smithi157.stdout:7/837: rename df/d1f/d24/d38/f51 to df/d1f/d24/d39/f10b 0 2024-02-28T16:27:15.247 INFO:tasks.workunit.client.1.smithi157.stdout:5/889: write d0/d9/d47/d5b/d89/d75/fe9 [4521936,100417] 0 2024-02-28T16:27:15.250 INFO:tasks.workunit.client.1.smithi157.stdout:8/823: dwrite d1/d5/d23/d53/f8e [0,4194304] 0 2024-02-28T16:27:15.252 INFO:tasks.workunit.client.1.smithi157.stdout:4/818: truncate d3/da/d1f/d22/f3c 2849112 0 2024-02-28T16:27:15.256 INFO:tasks.workunit.client.1.smithi157.stdout:5/890: readlink d0/d30/def/d7e/d82/ldc 0 2024-02-28T16:27:15.257 INFO:tasks.workunit.client.1.smithi157.stdout:0/875: mkdir d1/da/d7d/d12c 0 2024-02-28T16:27:15.258 INFO:tasks.workunit.client.1.smithi157.stdout:2/909: dread da/d35/fe5 [0,4194304] 0 2024-02-28T16:27:15.258 INFO:tasks.workunit.client.1.smithi157.stdout:3/763: dwrite d0/d6/f67 [0,4194304] 0 2024-02-28T16:27:15.260 INFO:tasks.workunit.client.1.smithi157.stdout:1/842: creat d10/d11/d60/d100/f10e x:0 0 0 2024-02-28T16:27:15.261 INFO:tasks.workunit.client.1.smithi157.stdout:7/838: rename df/d80/lbe to df/d1f/da1/l10c 0 2024-02-28T16:27:15.262 INFO:tasks.workunit.client.1.smithi157.stdout:4/819: symlink d3/da/d48/d4a/l10a 0 2024-02-28T16:27:15.270 INFO:tasks.workunit.client.1.smithi157.stdout:5/891: read d0/d9/d47/dad/f8e [2070463,68638] 0 2024-02-28T16:27:15.270 INFO:tasks.workunit.client.1.smithi157.stdout:3/764: mknod d0/cfb 0 2024-02-28T16:27:15.271 INFO:tasks.workunit.client.1.smithi157.stdout:4/820: chown d3/da/d1f/dc1/dc8/fd4 44327542 1 2024-02-28T16:27:15.272 INFO:tasks.workunit.client.1.smithi157.stdout:5/892: fsync d0/d30/d50/d7f/ffa 0 2024-02-28T16:27:15.275 INFO:tasks.workunit.client.1.smithi157.stdout:7/839: symlink df/d1f/d24/d4f/d72/dab/dd6/l10d 0 2024-02-28T16:27:15.284 INFO:tasks.workunit.client.1.smithi157.stdout:3/765: chown d0/d6/cbb 2461749 1 2024-02-28T16:27:15.286 INFO:tasks.workunit.client.1.smithi157.stdout:9/808: dwrite d0/d36/d37/d40/d4b/d96/fda [0,4194304] 0 2024-02-28T16:27:15.290 INFO:tasks.workunit.client.1.smithi157.stdout:0/876: dwrite d1/d13/d52/db5/d8e/f116 [0,4194304] 0 2024-02-28T16:27:15.293 INFO:tasks.workunit.client.1.smithi157.stdout:6/804: dread d2/d7/d8/da/d71/d8f/f45 [4194304,4194304] 0 2024-02-28T16:27:15.294 INFO:tasks.workunit.client.1.smithi157.stdout:8/824: dwrite d1/d5/d23/d53/f65 [0,4194304] 0 2024-02-28T16:27:15.299 INFO:tasks.workunit.client.1.smithi157.stdout:5/893: dwrite d0/d9/d47/d5b/d89/d75/fc5 [0,4194304] 0 2024-02-28T16:27:15.307 INFO:tasks.workunit.client.1.smithi157.stdout:4/821: write d3/f5f [1671883,61753] 0 2024-02-28T16:27:15.308 INFO:tasks.workunit.client.1.smithi157.stdout:4/822: stat d3/da 0 2024-02-28T16:27:15.310 INFO:tasks.workunit.client.1.smithi157.stdout:4/823: dread - d3/da/f101 zero size 2024-02-28T16:27:15.312 INFO:tasks.workunit.client.1.smithi157.stdout:4/824: fdatasync d3/da/d1f/dc1/dc8/fd4 0 2024-02-28T16:27:15.314 INFO:tasks.workunit.client.1.smithi157.stdout:7/840: symlink df/d1f/d24/d39/l10e 0 2024-02-28T16:27:15.314 INFO:tasks.workunit.client.1.smithi157.stdout:4/825: chown d3/da/d1f/d22/f3d 812227 1 2024-02-28T16:27:15.315 INFO:tasks.workunit.client.1.smithi157.stdout:7/841: chown df/d25/db5 2935 1 2024-02-28T16:27:15.316 INFO:tasks.workunit.client.1.smithi157.stdout:4/826: chown d3/da/f31 10609205 1 2024-02-28T16:27:15.316 INFO:tasks.workunit.client.1.smithi157.stdout:1/843: link d10/d11/d31/d2a/d70/de8/fea d10/d11/d22/d99/dab/f10f 0 2024-02-28T16:27:15.317 INFO:tasks.workunit.client.1.smithi157.stdout:4/827: stat d3/dcc 0 2024-02-28T16:27:15.321 INFO:tasks.workunit.client.1.smithi157.stdout:6/805: dread d2/f1f [0,4194304] 0 2024-02-28T16:27:15.324 INFO:tasks.workunit.client.1.smithi157.stdout:9/809: chown d0/d36/c73 6 1 2024-02-28T16:27:15.329 INFO:tasks.workunit.client.1.smithi157.stdout:3/766: unlink d0/d6/l18 0 2024-02-28T16:27:15.333 INFO:tasks.workunit.client.1.smithi157.stdout:2/910: getdents da/d38/d7e/d92/dd2 0 2024-02-28T16:27:15.333 INFO:tasks.workunit.client.1.smithi157.stdout:1/844: fdatasync d10/d11/d3a/d5c/d6a/db4/fc6 0 2024-02-28T16:27:15.336 INFO:tasks.workunit.client.1.smithi157.stdout:0/877: write d1/da/f58 [1944976,41604] 0 2024-02-28T16:27:15.338 INFO:tasks.workunit.client.1.smithi157.stdout:6/806: creat d2/d7/d8/da/d31/d3a/de2/ff4 x:0 0 0 2024-02-28T16:27:15.344 INFO:tasks.workunit.client.1.smithi157.stdout:7/842: dwrite df/d1f/d24/d4f/d72/dab/fef [0,4194304] 0 2024-02-28T16:27:15.348 INFO:tasks.workunit.client.1.smithi157.stdout:6/807: rmdir d2/d7 39 2024-02-28T16:27:15.348 INFO:tasks.workunit.client.1.smithi157.stdout:8/825: dwrite d1/d5/dd8/d52/d54/ff2 [0,4194304] 0 2024-02-28T16:27:15.350 INFO:tasks.workunit.client.1.smithi157.stdout:1/845: mkdir d10/da0/db6/dd1/d110 0 2024-02-28T16:27:15.354 INFO:tasks.workunit.client.1.smithi157.stdout:7/843: readlink df/d1f/d24/la0 0 2024-02-28T16:27:15.358 INFO:tasks.workunit.client.1.smithi157.stdout:3/767: mkdir d0/d6/d34/d80/d23/d2b/d81/dfc 0 2024-02-28T16:27:15.359 INFO:tasks.workunit.client.1.smithi157.stdout:8/826: mkdir d1/d5/d43/d86/d11b 0 2024-02-28T16:27:15.360 INFO:tasks.workunit.client.1.smithi157.stdout:1/846: write d10/d11/d60/fe9 [563189,72796] 0 2024-02-28T16:27:15.364 INFO:tasks.workunit.client.1.smithi157.stdout:6/808: dread - d2/d7/d8/da/d31/dd6/fdb zero size 2024-02-28T16:27:15.366 INFO:tasks.workunit.client.1.smithi157.stdout:4/828: dwrite d3/da/d37/d84/fad [0,4194304] 0 2024-02-28T16:27:15.367 INFO:tasks.workunit.client.1.smithi157.stdout:5/894: dwrite d0/d30/d50/df0/f103 [0,4194304] 0 2024-02-28T16:27:15.370 INFO:tasks.workunit.client.1.smithi157.stdout:4/829: chown d3/da/d1f/c23 416853 1 2024-02-28T16:27:15.371 INFO:tasks.workunit.client.1.smithi157.stdout:7/844: mkdir df/d1f/d24/d4f/d72/dab/d10f 0 2024-02-28T16:27:15.373 INFO:tasks.workunit.client.1.smithi157.stdout:5/895: write d0/f34 [5859069,34130] 0 2024-02-28T16:27:15.374 INFO:tasks.workunit.client.1.smithi157.stdout:6/809: write d2/d7/de/d1b/fb5 [621740,34048] 0 2024-02-28T16:27:15.379 INFO:tasks.workunit.client.1.smithi157.stdout:8/827: mkdir d1/d5/d10/d11c 0 2024-02-28T16:27:15.380 INFO:tasks.workunit.client.1.smithi157.stdout:2/911: dwrite da/d38/d5a/ffe [0,4194304] 0 2024-02-28T16:27:15.380 INFO:tasks.workunit.client.1.smithi157.stdout:3/768: symlink d0/d6/d34/d80/d23/d2b/d6d/lfd 0 2024-02-28T16:27:15.380 INFO:tasks.workunit.client.1.smithi157.stdout:8/828: write d1/d5/f4a [1895808,111446] 0 2024-02-28T16:27:15.381 INFO:tasks.workunit.client.1.smithi157.stdout:1/847: dread - d10/d11/d31/d2a/d70/de8/fea zero size 2024-02-28T16:27:15.391 INFO:tasks.workunit.client.1.smithi157.stdout:4/830: fsync d3/da/d1f/d22/f4b 0 2024-02-28T16:27:15.393 INFO:tasks.workunit.client.1.smithi157.stdout:2/912: chown da/d38/d5a/d79/d7b/cff 21519 1 2024-02-28T16:27:15.393 INFO:tasks.workunit.client.1.smithi157.stdout:4/831: chown d3/da/l19 193809565 1 2024-02-28T16:27:15.395 INFO:tasks.workunit.client.1.smithi157.stdout:2/913: chown da/d38/d5a/d79/cc9 741 1 2024-02-28T16:27:15.395 INFO:tasks.workunit.client.1.smithi157.stdout:8/829: creat d1/d5/d23/d53/dc1/f11d x:0 0 0 2024-02-28T16:27:15.397 INFO:tasks.workunit.client.1.smithi157.stdout:2/914: fsync da/d47/dbd/dde/f10f 0 2024-02-28T16:27:15.400 INFO:tasks.workunit.client.1.smithi157.stdout:3/769: symlink d0/d6/d34/d80/d23/d2b/d2e/lfe 0 2024-02-28T16:27:15.401 INFO:tasks.workunit.client.1.smithi157.stdout:7/845: creat df/d1f/d24/d39/df2/f110 x:0 0 0 2024-02-28T16:27:15.408 INFO:tasks.workunit.client.1.smithi157.stdout:5/896: creat d0/d9/d3a/f12e x:0 0 0 2024-02-28T16:27:15.408 INFO:tasks.workunit.client.1.smithi157.stdout:1/848: write d10/d11/d31/f3d [268033,116948] 0 2024-02-28T16:27:15.410 INFO:tasks.workunit.client.1.smithi157.stdout:4/832: mkdir d3/da/d37/db2/d10b 0 2024-02-28T16:27:15.412 INFO:tasks.workunit.client.1.smithi157.stdout:5/897: write d0/d30/def/fa8 [5068599,43861] 0 2024-02-28T16:27:15.414 INFO:tasks.workunit.client.1.smithi157.stdout:3/770: mkdir d0/d6/d6b/d75/df0/dff 0 2024-02-28T16:27:15.417 INFO:tasks.workunit.client.1.smithi157.stdout:8/830: dwrite d1/d5/d4d/dd6/ddb/f107 [0,4194304] 0 2024-02-28T16:27:15.418 INFO:tasks.workunit.client.1.smithi157.stdout:4/833: chown d3/da/d37/d84/d9a/df8/db0/db4/fc3 0 1 2024-02-28T16:27:15.422 INFO:tasks.workunit.client.1.smithi157.stdout:7/846: dwrite df/f16 [4194304,4194304] 0 2024-02-28T16:27:15.422 INFO:tasks.workunit.client.1.smithi157.stdout:1/849: creat d10/d11/d31/d2a/d70/d9b/f111 x:0 0 0 2024-02-28T16:27:15.426 INFO:tasks.workunit.client.1.smithi157.stdout:2/915: dread da/d38/d5a/d69/f95 [0,4194304] 0 2024-02-28T16:27:15.428 INFO:tasks.workunit.client.1.smithi157.stdout:4/834: chown d3/f13 100 1 2024-02-28T16:27:15.430 INFO:tasks.workunit.client.1.smithi157.stdout:5/898: creat d0/f12f x:0 0 0 2024-02-28T16:27:15.432 INFO:tasks.workunit.client.1.smithi157.stdout:2/916: write da/d38/d5a/d79/fc7 [3510064,24861] 0 2024-02-28T16:27:15.439 INFO:tasks.workunit.client.1.smithi157.stdout:5/899: symlink d0/d9/d1b/d36/daf/l130 0 2024-02-28T16:27:15.441 INFO:tasks.workunit.client.1.smithi157.stdout:5/900: write d0/d30/da0/f114 [531567,122621] 0 2024-02-28T16:27:15.442 INFO:tasks.workunit.client.1.smithi157.stdout:8/831: rename d1/d5/d4d/d60/f101 to d1/d5/dd8/d52/f11e 0 2024-02-28T16:27:15.444 INFO:tasks.workunit.client.1.smithi157.stdout:4/835: mknod d3/da/d37/d84/c10c 0 2024-02-28T16:27:15.444 INFO:tasks.workunit.client.1.smithi157.stdout:1/850: link d10/d11/d7e/lf1 d10/d11/d31/d2a/dfc/l112 0 2024-02-28T16:27:15.447 INFO:tasks.workunit.client.1.smithi157.stdout:8/832: rmdir d1/d5/d14 39 2024-02-28T16:27:15.448 INFO:tasks.workunit.client.1.smithi157.stdout:3/771: dread d0/d6/d34/d80/d5c/f7d [0,4194304] 0 2024-02-28T16:27:15.450 INFO:tasks.workunit.client.1.smithi157.stdout:5/901: getdents d0/d9/d47/dad/db4 0 2024-02-28T16:27:15.451 INFO:tasks.workunit.client.1.smithi157.stdout:4/836: rename d3/da/d1f/l68 to d3/da/d48/d4a/db7/l10d 0 2024-02-28T16:27:15.452 INFO:tasks.workunit.client.1.smithi157.stdout:5/902: stat d0/d30/dca/f127 0 2024-02-28T16:27:15.453 INFO:tasks.workunit.client.1.smithi157.stdout:7/847: write df/d1f/d24/d38/f83 [1037598,8419] 0 2024-02-28T16:27:15.456 INFO:tasks.workunit.client.1.smithi157.stdout:2/917: dwrite da/d38/d5a/d79/fda [0,4194304] 0 2024-02-28T16:27:15.461 INFO:tasks.workunit.client.1.smithi157.stdout:3/772: write d0/d6/d44/d4b/f9b [388322,78248] 0 2024-02-28T16:27:15.461 INFO:tasks.workunit.client.1.smithi157.stdout:8/833: mkdir d1/d5/d23/dbd/dc9/d11f 0 2024-02-28T16:27:15.462 INFO:tasks.workunit.client.1.smithi157.stdout:4/837: creat d3/da/d1f/d22/f10e x:0 0 0 2024-02-28T16:27:15.467 INFO:tasks.workunit.client.1.smithi157.stdout:1/851: dwrite d10/d11/d7e/f107 [0,4194304] 0 2024-02-28T16:27:15.470 INFO:tasks.workunit.client.1.smithi157.stdout:7/848: mknod df/d25/da7/c111 0 2024-02-28T16:27:15.474 INFO:tasks.workunit.client.1.smithi157.stdout:1/852: mkdir d10/d11/d3a/d5c/d6a/db4/d91/d113 0 2024-02-28T16:27:15.477 INFO:tasks.workunit.client.1.smithi157.stdout:3/773: mkdir d0/d6/d44/d100 0 2024-02-28T16:27:15.477 INFO:tasks.workunit.client.1.smithi157.stdout:3/774: chown d0/d6/d34 367890333 1 2024-02-28T16:27:15.478 INFO:tasks.workunit.client.1.smithi157.stdout:5/903: rename d0/db3/fe1 to d0/d30/def/f131 0 2024-02-28T16:27:15.480 INFO:tasks.workunit.client.1.smithi157.stdout:9/810: sync 2024-02-28T16:27:15.484 INFO:tasks.workunit.client.1.smithi157.stdout:4/838: rename d3/da/d1f/l96 to d3/da/d1f/dc1/dc8/dee/l10f 0 2024-02-28T16:27:15.486 INFO:tasks.workunit.client.1.smithi157.stdout:7/849: dread df/d1f/d24/d39/d64/f74 [0,4194304] 0 2024-02-28T16:27:15.486 INFO:tasks.workunit.client.1.smithi157.stdout:2/918: truncate da/d38/d3e/d9b/fe0 3805782 0 2024-02-28T16:27:15.487 INFO:tasks.workunit.client.1.smithi157.stdout:3/775: mknod d0/d6/d44/d48/c101 0 2024-02-28T16:27:15.488 INFO:tasks.workunit.client.1.smithi157.stdout:2/919: readlink da/d2b/d59/l102 0 2024-02-28T16:27:15.490 INFO:tasks.workunit.client.1.smithi157.stdout:7/850: chown df/d1f/d24/d39/d64/lc5 257 1 2024-02-28T16:27:15.490 INFO:tasks.workunit.client.1.smithi157.stdout:3/776: chown d0/d6/d34/d80/d23/l98 43942 1 2024-02-28T16:27:15.491 INFO:tasks.workunit.client.1.smithi157.stdout:5/904: symlink d0/d9/d3a/d11d/l132 0 2024-02-28T16:27:15.495 INFO:tasks.workunit.client.1.smithi157.stdout:8/834: dwrite d1/d5/d23/f6b [0,4194304] 0 2024-02-28T16:27:15.496 INFO:tasks.workunit.client.1.smithi157.stdout:3/777: chown d0/d6/d34/d43/fd8 0 1 2024-02-28T16:27:15.497 INFO:tasks.workunit.client.1.smithi157.stdout:2/920: chown da/d38/d3e/c6c 0 1 2024-02-28T16:27:15.498 INFO:tasks.workunit.client.1.smithi157.stdout:7/851: write df/d25/d79/f82 [478237,76484] 0 2024-02-28T16:27:15.500 INFO:tasks.workunit.client.1.smithi157.stdout:8/835: fsync d1/fe5 0 2024-02-28T16:27:15.504 INFO:tasks.workunit.client.1.smithi157.stdout:1/853: dwrite d10/d11/d3a/d5c/d6c/d7b/f5e [0,4194304] 0 2024-02-28T16:27:15.516 INFO:tasks.workunit.client.1.smithi157.stdout:4/839: dwrite d3/dcc/fff [0,4194304] 0 2024-02-28T16:27:15.516 INFO:tasks.workunit.client.1.smithi157.stdout:7/852: creat df/d1f/d24/d39/d64/df6/f112 x:0 0 0 2024-02-28T16:27:15.516 INFO:tasks.workunit.client.1.smithi157.stdout:8/836: creat d1/d5/d23/d53/f120 x:0 0 0 2024-02-28T16:27:15.519 INFO:tasks.workunit.client.1.smithi157.stdout:9/811: link d0/d36/l45 d0/d36/d37/d4d/d92/df6/l114 0 2024-02-28T16:27:15.521 INFO:tasks.workunit.client.1.smithi157.stdout:7/853: dread - df/d1f/d24/d38/f70 zero size 2024-02-28T16:27:15.525 INFO:tasks.workunit.client.1.smithi157.stdout:5/905: dwrite d0/d9/d1b/d36/daf/fc1 [0,4194304] 0 2024-02-28T16:27:15.529 INFO:tasks.workunit.client.1.smithi157.stdout:7/854: read df/d25/fc3 [131533,91916] 0 2024-02-28T16:27:15.531 INFO:tasks.workunit.client.1.smithi157.stdout:8/837: creat d1/d5/d43/d86/dff/f121 x:0 0 0 2024-02-28T16:27:15.536 INFO:tasks.workunit.client.1.smithi157.stdout:3/778: dwrite d0/d6/d44/d70/d71/d87/dd1/fba [0,4194304] 0 2024-02-28T16:27:15.538 INFO:tasks.workunit.client.1.smithi157.stdout:5/906: mkdir d0/d9/d133 0 2024-02-28T16:27:15.538 INFO:tasks.workunit.client.1.smithi157.stdout:8/838: mkdir d1/d5/d23/dbd/dc9/d108/d122 0 2024-02-28T16:27:15.541 INFO:tasks.workunit.client.1.smithi157.stdout:2/921: truncate da/f46 386993 0 2024-02-28T16:27:15.542 INFO:tasks.workunit.client.1.smithi157.stdout:1/854: write d10/d94/fb3 [1209573,29234] 0 2024-02-28T16:27:15.542 INFO:tasks.workunit.client.1.smithi157.stdout:5/907: chown d0/d30/dca/fe6 2 1 2024-02-28T16:27:15.543 INFO:tasks.workunit.client.1.smithi157.stdout:2/922: chown da/d2b/d59/d109/f68 193 1 2024-02-28T16:27:15.544 INFO:tasks.workunit.client.1.smithi157.stdout:5/908: dread - d0/d30/def/f10d zero size 2024-02-28T16:27:15.546 INFO:tasks.workunit.client.1.smithi157.stdout:3/779: mkdir d0/d6/d6b/d75/df0/dff/d102 0 2024-02-28T16:27:15.549 INFO:tasks.workunit.client.1.smithi157.stdout:3/780: fsync d0/d6/d34/d80/d23/d2b/f57 0 2024-02-28T16:27:15.550 INFO:tasks.workunit.client.1.smithi157.stdout:0/878: sync 2024-02-28T16:27:15.550 INFO:tasks.workunit.client.1.smithi157.stdout:6/810: sync 2024-02-28T16:27:15.555 INFO:tasks.workunit.client.1.smithi157.stdout:4/840: dwrite d3/da/d37/f50 [0,4194304] 0 2024-02-28T16:27:15.562 INFO:tasks.workunit.client.1.smithi157.stdout:1/855: creat d10/d11/d3a/d5c/d6c/d7b/d8c/f114 x:0 0 0 2024-02-28T16:27:15.566 INFO:tasks.workunit.client.1.smithi157.stdout:2/923: stat da/f46 0 2024-02-28T16:27:15.567 INFO:tasks.workunit.client.1.smithi157.stdout:5/909: rename d0/d30/da0/dfd/lc0 to d0/d9/d47/d5b/dd9/l134 0 2024-02-28T16:27:15.569 INFO:tasks.workunit.client.1.smithi157.stdout:3/781: link d0/d6/d44/d70/d71/c82 d0/d6/d6b/d75/dbd/c103 0 2024-02-28T16:27:15.570 INFO:tasks.workunit.client.1.smithi157.stdout:7/855: dwrite df/d25/d79/d9a/fa3 [0,4194304] 0 2024-02-28T16:27:15.577 INFO:tasks.workunit.client.1.smithi157.stdout:2/924: truncate da/d38/f40 1967730 0 2024-02-28T16:27:15.578 INFO:tasks.workunit.client.1.smithi157.stdout:5/910: rename d0/d9/d1b/d36/l4c to d0/d30/df1/l135 0 2024-02-28T16:27:15.578 INFO:tasks.workunit.client.1.smithi157.stdout:3/782: creat d0/d6/d44/d8e/f104 x:0 0 0 2024-02-28T16:27:15.580 INFO:tasks.workunit.client.1.smithi157.stdout:7/856: mkdir df/d1f/d24/d39/d64/df6/d113 0 2024-02-28T16:27:15.583 INFO:tasks.workunit.client.1.smithi157.stdout:8/839: dread d1/d5/d14/f2d [8388608,4194304] 0 2024-02-28T16:27:15.584 INFO:tasks.workunit.client.1.smithi157.stdout:2/925: dread - da/d65/f11d zero size 2024-02-28T16:27:15.584 INFO:tasks.workunit.client.1.smithi157.stdout:0/879: dwrite d1/d8/d33/d96/fb1 [0,4194304] 0 2024-02-28T16:27:15.589 INFO:tasks.workunit.client.1.smithi157.stdout:8/840: readlink d1/d5/d43/d86/lbf 0 2024-02-28T16:27:15.589 INFO:tasks.workunit.client.1.smithi157.stdout:3/783: rmdir d0/d6/d6b/d75/df0/dff 39 2024-02-28T16:27:15.590 INFO:tasks.workunit.client.1.smithi157.stdout:7/857: creat df/d80/f114 x:0 0 0 2024-02-28T16:27:15.590 INFO:tasks.workunit.client.1.smithi157.stdout:0/880: chown d1/da/d7d/dc4/d10c 11416778 1 2024-02-28T16:27:15.594 INFO:tasks.workunit.client.1.smithi157.stdout:4/841: dwrite d3/da/d48/f93 [0,4194304] 0 2024-02-28T16:27:15.594 INFO:tasks.workunit.client.1.smithi157.stdout:1/856: write d10/d11/d31/f80 [390497,112784] 0 2024-02-28T16:27:15.600 INFO:tasks.workunit.client.1.smithi157.stdout:9/812: dread d0/d36/d37/d4d/d92/fb6 [0,4194304] 0 2024-02-28T16:27:15.602 INFO:tasks.workunit.client.1.smithi157.stdout:4/842: chown d3/da/d48/d4a/db7 517 1 2024-02-28T16:27:15.604 INFO:tasks.workunit.client.1.smithi157.stdout:0/881: creat d1/da/d6c/f12d x:0 0 0 2024-02-28T16:27:15.605 INFO:tasks.workunit.client.1.smithi157.stdout:8/841: creat d1/d5/d23/dbd/dc9/d108/f123 x:0 0 0 2024-02-28T16:27:15.611 INFO:tasks.workunit.client.1.smithi157.stdout:1/857: mkdir d10/d11/d3a/d5c/d6c/d7b/d8c/d115 0 2024-02-28T16:27:15.616 INFO:tasks.workunit.client.1.smithi157.stdout:9/813: mknod d0/d36/d37/d40/d5b/dba/c115 0 2024-02-28T16:27:15.617 INFO:tasks.workunit.client.1.smithi157.stdout:0/882: fsync d1/d13/d46/fbc 0 2024-02-28T16:27:15.618 INFO:tasks.workunit.client.1.smithi157.stdout:2/926: dwrite da/d38/f6f [0,4194304] 0 2024-02-28T16:27:15.621 INFO:tasks.workunit.client.1.smithi157.stdout:1/858: symlink d10/d11/d3a/d5c/d84/dd4/l116 0 2024-02-28T16:27:15.621 INFO:tasks.workunit.client.1.smithi157.stdout:4/843: dwrite d3/da/f46 [4194304,4194304] 0 2024-02-28T16:27:15.623 INFO:tasks.workunit.client.1.smithi157.stdout:9/814: write d0/d36/d3f/d69/fd4 [151366,16511] 0 2024-02-28T16:27:15.623 INFO:tasks.workunit.client.1.smithi157.stdout:2/927: creat da/d38/d4e/f128 x:0 0 0 2024-02-28T16:27:15.625 INFO:tasks.workunit.client.1.smithi157.stdout:5/911: truncate d0/d30/da0/dfd/faa 7197280 0 2024-02-28T16:27:15.628 INFO:tasks.workunit.client.1.smithi157.stdout:3/784: dread d0/d6/d34/d80/d23/d2b/fb8 [0,4194304] 0 2024-02-28T16:27:15.628 INFO:tasks.workunit.client.1.smithi157.stdout:0/883: creat d1/d13/dc9/df9/d55/f12e x:0 0 0 2024-02-28T16:27:15.628 INFO:tasks.workunit.client.1.smithi157.stdout:4/844: chown d3/f16 50443076 1 2024-02-28T16:27:15.629 INFO:tasks.workunit.client.1.smithi157.stdout:8/842: link d1/d5/d10/c3a d1/d5/d4d/d60/c124 0 2024-02-28T16:27:15.636 INFO:tasks.workunit.client.1.smithi157.stdout:1/859: read d10/d11/d3a/d5c/d6a/fee [108274,13020] 0 2024-02-28T16:27:15.643 INFO:tasks.workunit.client.1.smithi157.stdout:9/815: getdents d0/d36/daa/dbe/d105 0 2024-02-28T16:27:15.644 INFO:tasks.workunit.client.1.smithi157.stdout:0/884: mknod d1/d8/d33/c12f 0 2024-02-28T16:27:15.650 INFO:tasks.workunit.client.1.smithi157.stdout:3/785: rmdir d0/d6/d6b/d75/df0/df8 0 2024-02-28T16:27:15.659 INFO:tasks.workunit.client.1.smithi157.stdout:0/885: rename d1/d13/d52/db5/fb2 to d1/d13/dc9/f130 0 2024-02-28T16:27:15.660 INFO:tasks.workunit.client.1.smithi157.stdout:2/928: dwrite da/d38/d5a/d79/d7b/f81 [0,4194304] 0 2024-02-28T16:27:15.661 INFO:tasks.workunit.client.1.smithi157.stdout:9/816: mkdir d0/d36/d116 0 2024-02-28T16:27:15.662 INFO:tasks.workunit.client.1.smithi157.stdout:5/912: truncate d0/d9/d47/d5b/d89/fb8 3594545 0 2024-02-28T16:27:15.662 INFO:tasks.workunit.client.1.smithi157.stdout:4/845: dread d3/f13 [0,4194304] 0 2024-02-28T16:27:15.665 INFO:tasks.workunit.client.1.smithi157.stdout:5/913: write d0/d30/def/fb [2828481,23184] 0 2024-02-28T16:27:15.665 INFO:tasks.workunit.client.1.smithi157.stdout:1/860: truncate d10/d94/f9f 3943055 0 2024-02-28T16:27:15.667 INFO:tasks.workunit.client.1.smithi157.stdout:5/914: readlink d0/d9/d47/ld0 0 2024-02-28T16:27:15.669 INFO:tasks.workunit.client.1.smithi157.stdout:1/861: write d10/d11/d3a/f5f [1526757,55167] 0 2024-02-28T16:27:15.673 INFO:tasks.workunit.client.1.smithi157.stdout:4/846: creat d3/da/d37/d84/d9a/f110 x:0 0 0 2024-02-28T16:27:15.675 INFO:tasks.workunit.client.1.smithi157.stdout:3/786: rename d0/d6/d6b/d75/df0/dff to d0/d6/d6b/d9e/d105 0 2024-02-28T16:27:15.678 INFO:tasks.workunit.client.1.smithi157.stdout:5/915: rmdir d0/db3 39 2024-02-28T16:27:15.682 INFO:tasks.workunit.client.1.smithi157.stdout:3/787: dread d0/d6/d44/d4b/fb1 [0,4194304] 0 2024-02-28T16:27:15.683 INFO:tasks.workunit.client.1.smithi157.stdout:2/929: dread da/f96 [0,4194304] 0 2024-02-28T16:27:15.685 INFO:tasks.workunit.client.1.smithi157.stdout:9/817: write d0/d36/d3f/f74 [276245,14303] 0 2024-02-28T16:27:15.693 INFO:tasks.workunit.client.1.smithi157.stdout:5/916: creat d0/d30/df1/f136 x:0 0 0 2024-02-28T16:27:15.694 INFO:tasks.workunit.client.1.smithi157.stdout:5/917: write d0/d30/d50/d7f/ffa [120585,2143] 0 2024-02-28T16:27:15.695 INFO:tasks.workunit.client.1.smithi157.stdout:3/788: stat d0/l14 0 2024-02-28T16:27:15.696 INFO:tasks.workunit.client.1.smithi157.stdout:2/930: symlink da/d2b/d59/d109/l129 0 2024-02-28T16:27:15.697 INFO:tasks.workunit.client.1.smithi157.stdout:3/789: dread - d0/d6/d34/d80/d23/d2b/d2e/ff9 zero size 2024-02-28T16:27:15.699 INFO:tasks.workunit.client.1.smithi157.stdout:1/862: creat d10/d11/d3a/d5c/d6a/db4/d91/d113/f117 x:0 0 0 2024-02-28T16:27:15.701 INFO:tasks.workunit.client.1.smithi157.stdout:4/847: write d3/da/fb3 [383643,108796] 0 2024-02-28T16:27:15.702 INFO:tasks.workunit.client.1.smithi157.stdout:5/918: write d0/d30/def/d7e/f9a [3143866,37960] 0 2024-02-28T16:27:15.702 INFO:tasks.workunit.client.1.smithi157.stdout:6/811: sync 2024-02-28T16:27:15.703 INFO:tasks.workunit.client.1.smithi157.stdout:2/931: rmdir da/d38/d3e/d9b 39 2024-02-28T16:27:15.705 INFO:tasks.workunit.client.1.smithi157.stdout:9/818: truncate d0/d36/f86 1053934 0 2024-02-28T16:27:15.705 INFO:tasks.workunit.client.1.smithi157.stdout:0/886: dwrite d1/d8/f1d [0,4194304] 0 2024-02-28T16:27:15.709 INFO:tasks.workunit.client.1.smithi157.stdout:6/812: read d2/d7/de/d1b/d4d/d6c/f95 [3133468,22972] 0 2024-02-28T16:27:15.712 INFO:tasks.workunit.client.1.smithi157.stdout:6/813: symlink d2/d17/lf5 0 2024-02-28T16:27:15.712 INFO:tasks.workunit.client.1.smithi157.stdout:4/848: mkdir d3/da/d37/d111 0 2024-02-28T16:27:15.714 INFO:tasks.workunit.client.1.smithi157.stdout:3/790: rmdir d0/d6/d34/d80/d5c/ded 0 2024-02-28T16:27:15.718 INFO:tasks.workunit.client.1.smithi157.stdout:2/932: unlink da/l22 0 2024-02-28T16:27:15.720 INFO:tasks.workunit.client.1.smithi157.stdout:2/933: stat da/d38/d4e/d91/la9 0 2024-02-28T16:27:15.720 INFO:tasks.workunit.client.1.smithi157.stdout:4/849: mkdir d3/da/d37/db2/d112 0 2024-02-28T16:27:15.722 INFO:tasks.workunit.client.1.smithi157.stdout:9/819: dread d0/f42 [0,4194304] 0 2024-02-28T16:27:15.723 INFO:tasks.workunit.client.1.smithi157.stdout:6/814: rename d2/d7/d8/da/d31/d3a/de2 to d2/d7/de/df6 0 2024-02-28T16:27:15.723 INFO:tasks.workunit.client.1.smithi157.stdout:2/934: dread - da/d38/df1/ff7 zero size 2024-02-28T16:27:15.725 INFO:tasks.workunit.client.1.smithi157.stdout:0/887: dwrite d1/d13/f6d [0,4194304] 0 2024-02-28T16:27:15.725 INFO:tasks.workunit.client.1.smithi157.stdout:3/791: mknod d0/d6/d34/d80/d23/d2b/c106 0 2024-02-28T16:27:15.726 INFO:tasks.workunit.client.1.smithi157.stdout:1/863: write d10/d11/d31/d2a/d70/f96 [456490,88731] 0 2024-02-28T16:27:15.726 INFO:tasks.workunit.client.1.smithi157.stdout:2/935: fdatasync da/d35/fea 0 2024-02-28T16:27:15.731 INFO:tasks.workunit.client.1.smithi157.stdout:0/888: chown d1/d13/d52/d53/f81 1 1 2024-02-28T16:27:15.732 INFO:tasks.workunit.client.1.smithi157.stdout:5/919: getdents d0/d9/d47/d5b/dc6 0 2024-02-28T16:27:15.736 INFO:tasks.workunit.client.1.smithi157.stdout:2/936: fdatasync da/f1f 0 2024-02-28T16:27:15.737 INFO:tasks.workunit.client.1.smithi157.stdout:1/864: creat d10/d11/d3a/d5c/d84/dd4/f118 x:0 0 0 2024-02-28T16:27:15.738 INFO:tasks.workunit.client.1.smithi157.stdout:3/792: symlink d0/d6/l107 0 2024-02-28T16:27:15.738 INFO:tasks.workunit.client.1.smithi157.stdout:5/920: mkdir d0/d9/d47/d5b/d89/d75/dab/d137 0 2024-02-28T16:27:15.741 INFO:tasks.workunit.client.1.smithi157.stdout:2/937: chown da/d38/d7e/dbb/fef 172893 1 2024-02-28T16:27:15.742 INFO:tasks.workunit.client.1.smithi157.stdout:5/921: symlink d0/d30/l138 0 2024-02-28T16:27:15.746 INFO:tasks.workunit.client.1.smithi157.stdout:2/938: mkdir da/d38/d7e/d92/d12a 0 2024-02-28T16:27:15.746 INFO:tasks.workunit.client.1.smithi157.stdout:9/820: dwrite d0/d36/f107 [0,4194304] 0 2024-02-28T16:27:15.749 INFO:tasks.workunit.client.1.smithi157.stdout:5/922: read d0/d9/d47/d5b/d89/f83 [6435430,24786] 0 2024-02-28T16:27:15.751 INFO:tasks.workunit.client.1.smithi157.stdout:6/815: truncate d2/d7/d8/da/da1/fec 4053227 0 2024-02-28T16:27:15.761 INFO:tasks.workunit.client.1.smithi157.stdout:0/889: dread d1/d13/d52/db5/f63 [0,4194304] 0 2024-02-28T16:27:15.763 INFO:tasks.workunit.client.1.smithi157.stdout:3/793: creat d0/d6/d6b/d75/df0/f108 x:0 0 0 2024-02-28T16:27:15.765 INFO:tasks.workunit.client.1.smithi157.stdout:1/865: rename d10/d11/d31/c10a to d10/d11/d31/d7f/c119 0 2024-02-28T16:27:15.766 INFO:tasks.workunit.client.1.smithi157.stdout:1/866: dread - d10/d11/d31/fce zero size 2024-02-28T16:27:15.770 INFO:tasks.workunit.client.1.smithi157.stdout:6/816: creat d2/d7/d8/dd4/d53/da6/ff7 x:0 0 0 2024-02-28T16:27:15.772 INFO:tasks.workunit.client.1.smithi157.stdout:3/794: creat d0/d6/d44/d70/d71/d87/f109 x:0 0 0 2024-02-28T16:27:15.773 INFO:tasks.workunit.client.1.smithi157.stdout:2/939: rename da/l20 to da/d38/df1/df4/l12b 0 2024-02-28T16:27:15.775 INFO:tasks.workunit.client.1.smithi157.stdout:7/858: sync 2024-02-28T16:27:15.777 INFO:tasks.workunit.client.1.smithi157.stdout:9/821: rmdir d0/d19/d30/d78/dcb 0 2024-02-28T16:27:15.784 INFO:tasks.workunit.client.1.smithi157.stdout:2/940: mknod da/d38/d4e/c12c 0 2024-02-28T16:27:15.787 INFO:tasks.workunit.client.1.smithi157.stdout:6/817: dwrite d2/d7/de/d1b/d4d/d6c/d9a/fc5 [0,4194304] 0 2024-02-28T16:27:15.788 INFO:tasks.workunit.client.1.smithi157.stdout:9/822: chown d0/c1a 58 1 2024-02-28T16:27:15.795 INFO:tasks.workunit.client.1.smithi157.stdout:7/859: dread df/d4b/d4c/fb8 [0,4194304] 0 2024-02-28T16:27:15.797 INFO:tasks.workunit.client.1.smithi157.stdout:0/890: write d1/d8/f2c [1486146,125992] 0 2024-02-28T16:27:15.800 INFO:tasks.workunit.client.1.smithi157.stdout:9/823: mknod d0/dc0/de3/c117 0 2024-02-28T16:27:15.800 INFO:tasks.workunit.client.1.smithi157.stdout:5/923: link d0/d9/d1b/f73 d0/d9/d47/d5b/dc6/f139 0 2024-02-28T16:27:15.800 INFO:tasks.workunit.client.1.smithi157.stdout:7/860: stat df/d1f/d24/d39/d64/lc5 0 2024-02-28T16:27:15.802 INFO:tasks.workunit.client.1.smithi157.stdout:1/867: link d10/d11/d7e/lf1 d10/d11/d60/d100/l11a 0 2024-02-28T16:27:15.803 INFO:tasks.workunit.client.1.smithi157.stdout:0/891: chown d1/d13/d52/d7b/dcf/cd0 12 1 2024-02-28T16:27:15.804 INFO:tasks.workunit.client.1.smithi157.stdout:7/861: fsync df/d25/f2a 0 2024-02-28T16:27:15.804 INFO:tasks.workunit.client.1.smithi157.stdout:6/818: unlink d2/d7/d8/da/d71/d80/ce8 0 2024-02-28T16:27:15.805 INFO:tasks.workunit.client.1.smithi157.stdout:3/795: dwrite d0/d6/d44/d48/f6e [0,4194304] 0 2024-02-28T16:27:15.806 INFO:tasks.workunit.client.1.smithi157.stdout:8/843: sync 2024-02-28T16:27:15.807 INFO:tasks.workunit.client.1.smithi157.stdout:4/850: sync 2024-02-28T16:27:15.808 INFO:tasks.workunit.client.1.smithi157.stdout:2/941: dwrite da/fdf [0,4194304] 0 2024-02-28T16:27:15.809 INFO:tasks.workunit.client.1.smithi157.stdout:1/868: chown d10/d11/d3a/d5c/d6a/db4/f7d 436713051 1 2024-02-28T16:27:15.811 INFO:tasks.workunit.client.1.smithi157.stdout:8/844: stat d1/d5/d10/f18 0 2024-02-28T16:27:15.813 INFO:tasks.workunit.client.1.smithi157.stdout:7/862: chown df/d1f/d24/d38/f57 13422006 1 2024-02-28T16:27:15.815 INFO:tasks.workunit.client.1.smithi157.stdout:9/824: read d0/d36/f63 [59793,93869] 0 2024-02-28T16:27:15.816 INFO:tasks.workunit.client.1.smithi157.stdout:7/863: fdatasync df/d1f/d24/d39/d64/fe6 0 2024-02-28T16:27:15.817 INFO:tasks.workunit.client.1.smithi157.stdout:1/869: write d10/d11/d3a/d95/fd6 [476904,80327] 0 2024-02-28T16:27:15.818 INFO:tasks.workunit.client.1.smithi157.stdout:7/864: stat df/f17 0 2024-02-28T16:27:15.819 INFO:tasks.workunit.client.1.smithi157.stdout:4/851: write d3/da/d1f/d22/fc2 [2998307,106665] 0 2024-02-28T16:27:15.837 INFO:tasks.workunit.client.1.smithi157.stdout:0/892: dread d1/d13/d46/d99/fc2 [0,4194304] 0 2024-02-28T16:27:15.837 INFO:tasks.workunit.client.1.smithi157.stdout:2/942: dwrite da/d2b/d59/d109/f68 [0,4194304] 0 2024-02-28T16:27:15.837 INFO:tasks.workunit.client.1.smithi157.stdout:3/796: dwrite d0/d6/d34/d80/d23/f50 [0,4194304] 0 2024-02-28T16:27:15.838 INFO:tasks.workunit.client.1.smithi157.stdout:5/924: creat d0/d9/d47/d5b/d89/d75/dab/d137/f13a x:0 0 0 2024-02-28T16:27:15.838 INFO:tasks.workunit.client.1.smithi157.stdout:8/845: symlink d1/d5/d43/d66/l125 0 2024-02-28T16:27:15.842 INFO:tasks.workunit.client.1.smithi157.stdout:9/825: mkdir d0/d36/d3f/d69/d111/d118 0 2024-02-28T16:27:15.844 INFO:tasks.workunit.client.1.smithi157.stdout:7/865: dwrite df/d25/db5/fe0 [4194304,4194304] 0 2024-02-28T16:27:15.844 INFO:tasks.workunit.client.1.smithi157.stdout:8/846: chown d1/d5/d4d/f112 19747234 1 2024-02-28T16:27:15.848 INFO:tasks.workunit.client.1.smithi157.stdout:0/893: dread - d1/d13/f102 zero size 2024-02-28T16:27:15.849 INFO:tasks.workunit.client.1.smithi157.stdout:2/943: creat da/d47/f12d x:0 0 0 2024-02-28T16:27:15.850 INFO:tasks.workunit.client.1.smithi157.stdout:9/826: truncate d0/d36/d37/d40/d5b/f8a 1277858 0 2024-02-28T16:27:15.851 INFO:tasks.workunit.client.1.smithi157.stdout:2/944: write da/d38/d5a/d69/fec [393618,18550] 0 2024-02-28T16:27:15.854 INFO:tasks.workunit.client.1.smithi157.stdout:2/945: write da/d38/df1/ff7 [926424,107446] 0 2024-02-28T16:27:15.858 INFO:tasks.workunit.client.1.smithi157.stdout:7/866: rmdir df/d1f/da1 39 2024-02-28T16:27:15.859 INFO:tasks.workunit.client.1.smithi157.stdout:0/894: stat d1/d8/f20 0 2024-02-28T16:27:15.862 INFO:tasks.workunit.client.1.smithi157.stdout:0/895: write d1/d13/d52/db5/ff3 [113524,82072] 0 2024-02-28T16:27:15.862 INFO:tasks.workunit.client.1.smithi157.stdout:4/852: link d3/da/d1f/c43 d3/da/d37/db2/d112/c113 0 2024-02-28T16:27:15.863 INFO:tasks.workunit.client.1.smithi157.stdout:7/867: dread df/d4b/d4c/fb8 [0,4194304] 0 2024-02-28T16:27:15.865 INFO:tasks.workunit.client.1.smithi157.stdout:7/868: chown l7 816 1 2024-02-28T16:27:15.865 INFO:tasks.workunit.client.1.smithi157.stdout:0/896: fsync d1/d8/d33/f4e 0 2024-02-28T16:27:15.868 INFO:tasks.workunit.client.1.smithi157.stdout:2/946: dread - da/d47/dbd/fc1 zero size 2024-02-28T16:27:15.870 INFO:tasks.workunit.client.1.smithi157.stdout:7/869: write df/d1f/d24/d38/f62 [3378057,116258] 0 2024-02-28T16:27:15.873 INFO:tasks.workunit.client.1.smithi157.stdout:3/797: creat d0/d6/d6b/d75/df0/f10a x:0 0 0 2024-02-28T16:27:15.876 INFO:tasks.workunit.client.1.smithi157.stdout:0/897: truncate d1/d13/d52/db5/d64/f85 5201115 0 2024-02-28T16:27:15.883 INFO:tasks.workunit.client.1.smithi157.stdout:3/798: symlink d0/d6/d34/d80/d23/d2b/d81/l10b 0 2024-02-28T16:27:15.884 INFO:tasks.workunit.client.1.smithi157.stdout:0/898: write d1/d13/dc9/df9/d55/f12e [700252,101930] 0 2024-02-28T16:27:15.885 INFO:tasks.workunit.client.1.smithi157.stdout:9/827: link d0/l66 d0/d36/daa/dbe/d105/l119 0 2024-02-28T16:27:15.887 INFO:tasks.workunit.client.1.smithi157.stdout:2/947: dread da/d38/d5a/f66 [0,4194304] 0 2024-02-28T16:27:15.890 INFO:tasks.workunit.client.1.smithi157.stdout:3/799: fdatasync d0/d6/d6b/d75/df0/f10a 0 2024-02-28T16:27:15.893 INFO:tasks.workunit.client.1.smithi157.stdout:2/948: stat da/d47/c51 0 2024-02-28T16:27:15.895 INFO:tasks.workunit.client.1.smithi157.stdout:4/853: link d3/le d3/l114 0 2024-02-28T16:27:15.901 INFO:tasks.workunit.client.1.smithi157.stdout:4/854: dread - d3/da/d1f/d22/fd2 zero size 2024-02-28T16:27:15.902 INFO:tasks.workunit.client.1.smithi157.stdout:6/819: dwrite d2/d7/d8/da/d31/d37/d2b/d99/fb1 [0,4194304] 0 2024-02-28T16:27:15.905 INFO:tasks.workunit.client.1.smithi157.stdout:2/949: mknod da/d38/d7e/c12e 0 2024-02-28T16:27:15.906 INFO:tasks.workunit.client.1.smithi157.stdout:7/870: getdents df/d1f/d24/d4f/d72/dab 0 2024-02-28T16:27:15.908 INFO:tasks.workunit.client.1.smithi157.stdout:1/870: truncate d10/d11/d60/fe9 76540 0 2024-02-28T16:27:15.911 INFO:tasks.workunit.client.1.smithi157.stdout:3/800: write d0/d6/d34/d80/d23/d2b/d2e/d7e/ffa [1615614,61925] 0 2024-02-28T16:27:15.917 INFO:tasks.workunit.client.1.smithi157.stdout:0/899: dread d1/d13/f6d [0,4194304] 0 2024-02-28T16:27:15.922 INFO:tasks.workunit.client.1.smithi157.stdout:6/820: mknod d2/d7/d8/da/d31/d59/cf8 0 2024-02-28T16:27:15.925 INFO:tasks.workunit.client.1.smithi157.stdout:7/871: creat df/d1f/d24/d38/f115 x:0 0 0 2024-02-28T16:27:15.926 INFO:tasks.workunit.client.1.smithi157.stdout:0/900: write d1/f15 [544661,107399] 0 2024-02-28T16:27:15.927 INFO:tasks.workunit.client.1.smithi157.stdout:8/847: write d1/d5/d10/f33 [3453201,85599] 0 2024-02-28T16:27:15.931 INFO:tasks.workunit.client.1.smithi157.stdout:9/828: dwrite d0/d19/f7a [0,4194304] 0 2024-02-28T16:27:15.934 INFO:tasks.workunit.client.1.smithi157.stdout:5/925: dread d0/d9/d47/d5b/d89/d75/fed [0,4194304] 0 2024-02-28T16:27:15.937 INFO:tasks.workunit.client.1.smithi157.stdout:2/950: write da/d38/d5a/ff2 [571053,29260] 0 2024-02-28T16:27:15.940 INFO:tasks.workunit.client.1.smithi157.stdout:1/871: write d10/d11/d31/f41 [684005,49255] 0 2024-02-28T16:27:15.944 INFO:tasks.workunit.client.1.smithi157.stdout:8/848: creat d1/d5/d4d/dd6/f126 x:0 0 0 2024-02-28T16:27:15.944 INFO:tasks.workunit.client.1.smithi157.stdout:7/872: creat df/d1f/d24/d38/f116 x:0 0 0 2024-02-28T16:27:15.947 INFO:tasks.workunit.client.1.smithi157.stdout:9/829: mkdir d0/d36/d37/d40/d5b/dba/dfe/d11a 0 2024-02-28T16:27:15.948 INFO:tasks.workunit.client.1.smithi157.stdout:4/855: dwrite d3/da/d1f/d22/fe9 [0,4194304] 0 2024-02-28T16:27:15.950 INFO:tasks.workunit.client.1.smithi157.stdout:0/901: mknod d1/dd1/c131 0 2024-02-28T16:27:15.954 INFO:tasks.workunit.client.1.smithi157.stdout:6/821: dwrite d2/d7/d38/f97 [0,4194304] 0 2024-02-28T16:27:15.956 INFO:tasks.workunit.client.1.smithi157.stdout:8/849: truncate d1/d5/d23/dbd/fc4 976244 0 2024-02-28T16:27:15.961 INFO:tasks.workunit.client.1.smithi157.stdout:7/873: rmdir df/d1f/d24/d39/df2 39 2024-02-28T16:27:15.963 INFO:tasks.workunit.client.1.smithi157.stdout:4/856: mkdir d3/da/d28/d115 0 2024-02-28T16:27:15.965 INFO:tasks.workunit.client.1.smithi157.stdout:3/801: link d0/d6/d34/d80/d5c/ld3 d0/d6/d34/d80/d23/d2b/d2e/l10c 0 2024-02-28T16:27:15.966 INFO:tasks.workunit.client.1.smithi157.stdout:8/850: fsync d1/d5/dd8/d52/f11e 0 2024-02-28T16:27:15.973 INFO:tasks.workunit.client.1.smithi157.stdout:4/857: symlink d3/da/d28/l116 0 2024-02-28T16:27:15.973 INFO:tasks.workunit.client.1.smithi157.stdout:8/851: truncate d1/d5/d10/f118 510049 0 2024-02-28T16:27:15.974 INFO:tasks.workunit.client.1.smithi157.stdout:1/872: creat d10/d11/d3a/f11b x:0 0 0 2024-02-28T16:27:15.974 INFO:tasks.workunit.client.1.smithi157.stdout:7/874: rename df/d25/d79/d9e/fee to df/d1f/d24/d4f/d72/dab/f117 0 2024-02-28T16:27:15.983 INFO:tasks.workunit.client.1.smithi157.stdout:8/852: write d1/d5/d23/d53/f8e [2449975,90810] 0 2024-02-28T16:27:15.986 INFO:tasks.workunit.client.1.smithi157.stdout:1/873: write d10/d11/d31/d7f/ff9 [851584,114442] 0 2024-02-28T16:27:15.988 INFO:tasks.workunit.client.1.smithi157.stdout:4/858: write d3/d77/f62 [1914430,73654] 0 2024-02-28T16:27:15.991 INFO:tasks.workunit.client.1.smithi157.stdout:2/951: dwrite da/d2b/d59/fbc [0,4194304] 0 2024-02-28T16:27:15.994 INFO:tasks.workunit.client.1.smithi157.stdout:8/853: write d1/d5/d23/da1/f10c [901614,114678] 0 2024-02-28T16:27:15.994 INFO:tasks.workunit.client.1.smithi157.stdout:4/859: stat d3/d8b/le6 0 2024-02-28T16:27:15.996 INFO:tasks.workunit.client.1.smithi157.stdout:5/926: dwrite d0/d30/def/d51/f7b [0,4194304] 0 2024-02-28T16:27:16.000 INFO:tasks.workunit.client.1.smithi157.stdout:2/952: chown da/d35/f54 1374 1 2024-02-28T16:27:16.003 INFO:tasks.workunit.client.1.smithi157.stdout:0/902: dwrite d1/f24 [0,4194304] 0 2024-02-28T16:27:16.007 INFO:tasks.workunit.client.1.smithi157.stdout:1/874: symlink d10/d11/d22/l11c 0 2024-02-28T16:27:16.011 INFO:tasks.workunit.client.1.smithi157.stdout:0/903: readlink d1/d13/d52/db5/l92 0 2024-02-28T16:27:16.012 INFO:tasks.workunit.client.1.smithi157.stdout:8/854: creat d1/d5/d4d/d60/de4/f127 x:0 0 0 2024-02-28T16:27:16.012 INFO:tasks.workunit.client.1.smithi157.stdout:4/860: mknod d3/da/d37/d84/d9a/dab/c117 0 2024-02-28T16:27:16.021 INFO:tasks.workunit.client.1.smithi157.stdout:0/904: chown d1/d13/dc9/cc5 7585218 1 2024-02-28T16:27:16.027 INFO:tasks.workunit.client.1.smithi157.stdout:3/802: dread d0/d6/d34/d80/d23/d2b/d6d/f77 [0,4194304] 0 2024-02-28T16:27:16.028 INFO:tasks.workunit.client.1.smithi157.stdout:5/927: dread d0/d9/d1b/d36/f6c [0,4194304] 0 2024-02-28T16:27:16.029 INFO:tasks.workunit.client.1.smithi157.stdout:7/875: dread df/d1f/d24/d4f/d72/fd7 [0,4194304] 0 2024-02-28T16:27:16.029 INFO:tasks.workunit.client.1.smithi157.stdout:3/803: read - d0/d6/d34/d80/fd4 zero size 2024-02-28T16:27:16.050 INFO:tasks.workunit.client.1.smithi157.stdout:1/875: dread d10/d11/d31/f80 [0,4194304] 0 2024-02-28T16:27:16.051 INFO:tasks.workunit.client.1.smithi157.stdout:2/953: mknod da/d47/dbd/c12f 0 2024-02-28T16:27:16.052 INFO:tasks.workunit.client.1.smithi157.stdout:8/855: rmdir d1/d5/d43/d86/dff 39 2024-02-28T16:27:16.063 INFO:tasks.workunit.client.1.smithi157.stdout:8/856: chown d1/d5/d23/dbd/dc9/d108/l113 0 1 2024-02-28T16:27:16.066 INFO:tasks.workunit.client.1.smithi157.stdout:0/905: creat d1/d8/f132 x:0 0 0 2024-02-28T16:27:16.066 INFO:tasks.workunit.client.1.smithi157.stdout:4/861: link d3/da/d1f/dc1/dc8/dee/cf1 d3/da/d37/d84/dc9/c118 0 2024-02-28T16:27:16.069 INFO:tasks.workunit.client.1.smithi157.stdout:0/906: mknod d1/c133 0 2024-02-28T16:27:16.071 INFO:tasks.workunit.client.1.smithi157.stdout:4/862: creat d3/da/d37/d84/d9a/df8/db0/db4/f119 x:0 0 0 2024-02-28T16:27:16.072 INFO:tasks.workunit.client.1.smithi157.stdout:2/954: dread da/f2a [0,4194304] 0 2024-02-28T16:27:16.074 INFO:tasks.workunit.client.1.smithi157.stdout:0/907: unlink d1/da/d7d/d98/de2/de9/dfa/f107 0 2024-02-28T16:27:16.075 INFO:tasks.workunit.client.1.smithi157.stdout:8/857: dread d1/d5/d4d/dd6/ddb/f107 [0,4194304] 0 2024-02-28T16:27:16.078 INFO:tasks.workunit.client.1.smithi157.stdout:2/955: rmdir da/d38 39 2024-02-28T16:27:16.079 INFO:tasks.workunit.client.1.smithi157.stdout:0/908: dread - d1/d13/d52/db5/d64/fb6 zero size 2024-02-28T16:27:16.082 INFO:tasks.workunit.client.1.smithi157.stdout:0/909: rmdir d1/d8/d33 39 2024-02-28T16:27:16.086 INFO:tasks.workunit.client.1.smithi157.stdout:2/956: rename da/d2b/d59/l70 to da/d38/d7e/dbb/dd0/l130 0 2024-02-28T16:27:16.086 INFO:tasks.workunit.client.1.smithi157.stdout:0/910: symlink d1/d13/d52/db5/l134 0 2024-02-28T16:27:16.088 INFO:tasks.workunit.client.1.smithi157.stdout:2/957: write da/d38/d5a/d79/d7b/f81 [2554124,92552] 0 2024-02-28T16:27:16.091 INFO:tasks.workunit.client.1.smithi157.stdout:0/911: fdatasync d1/da/d7d/dc4/fb9 0 2024-02-28T16:27:16.092 INFO:tasks.workunit.client.1.smithi157.stdout:2/958: mkdir da/d38/d7e/d92/dd2/d131 0 2024-02-28T16:27:16.096 INFO:tasks.workunit.client.1.smithi157.stdout:2/959: creat da/d8c/df0/f132 x:0 0 0 2024-02-28T16:27:16.099 INFO:tasks.workunit.client.1.smithi157.stdout:2/960: read da/d38/d5a/fdb [1076149,52774] 0 2024-02-28T16:27:16.101 INFO:tasks.workunit.client.1.smithi157.stdout:2/961: chown da/d38/d5a/ffe 35709 1 2024-02-28T16:27:16.102 INFO:tasks.workunit.client.1.smithi157.stdout:4/863: dread d3/f5 [0,4194304] 0 2024-02-28T16:27:16.103 INFO:tasks.workunit.client.1.smithi157.stdout:5/928: write d0/fe [2415721,58705] 0 2024-02-28T16:27:16.104 INFO:tasks.workunit.client.1.smithi157.stdout:3/804: write d0/d6/d6b/f6c [790325,114683] 0 2024-02-28T16:27:16.106 INFO:tasks.workunit.client.1.smithi157.stdout:2/962: read da/d2b/d59/d109/f7f [752565,78641] 0 2024-02-28T16:27:16.108 INFO:tasks.workunit.client.1.smithi157.stdout:7/876: truncate df/f17 2073720 0 2024-02-28T16:27:16.109 INFO:tasks.workunit.client.1.smithi157.stdout:7/877: readlink df/d1f/d24/l68 0 2024-02-28T16:27:16.111 INFO:tasks.workunit.client.1.smithi157.stdout:2/963: creat da/d35/f133 x:0 0 0 2024-02-28T16:27:16.112 INFO:tasks.workunit.client.1.smithi157.stdout:3/805: mknod d0/d6/d44/d100/c10d 0 2024-02-28T16:27:16.113 INFO:tasks.workunit.client.1.smithi157.stdout:2/964: stat da/d47/dbd/dde/fc8 0 2024-02-28T16:27:16.114 INFO:tasks.workunit.client.1.smithi157.stdout:5/929: mkdir d0/d9/d133/d13b 0 2024-02-28T16:27:16.115 INFO:tasks.workunit.client.1.smithi157.stdout:4/864: mknod d3/da/d37/d84/d9a/df8/db0/db4/dfc/c11a 0 2024-02-28T16:27:16.116 INFO:tasks.workunit.client.1.smithi157.stdout:7/878: truncate df/fae 165309 0 2024-02-28T16:27:16.120 INFO:tasks.workunit.client.1.smithi157.stdout:7/879: write df/d1f/d24/d38/f6d [49433,37269] 0 2024-02-28T16:27:16.121 INFO:tasks.workunit.client.1.smithi157.stdout:4/865: creat d3/da/d1f/dc1/f11b x:0 0 0 2024-02-28T16:27:16.123 INFO:tasks.workunit.client.1.smithi157.stdout:2/965: creat da/d38/d7e/d92/dd2/d131/f134 x:0 0 0 2024-02-28T16:27:16.126 INFO:tasks.workunit.client.1.smithi157.stdout:4/866: fsync d3/da/d1f/d22/f10e 0 2024-02-28T16:27:16.126 INFO:tasks.workunit.client.1.smithi157.stdout:0/912: dread d1/d8/d33/f50 [0,4194304] 0 2024-02-28T16:27:16.127 INFO:tasks.workunit.client.1.smithi157.stdout:7/880: read fd [1620232,126004] 0 2024-02-28T16:27:16.128 INFO:tasks.workunit.client.1.smithi157.stdout:8/858: dwrite d1/d5/d10/f18 [0,4194304] 0 2024-02-28T16:27:16.130 INFO:tasks.workunit.client.1.smithi157.stdout:6/822: sync 2024-02-28T16:27:16.131 INFO:tasks.workunit.client.1.smithi157.stdout:2/966: creat da/d47/dca/f135 x:0 0 0 2024-02-28T16:27:16.134 INFO:tasks.workunit.client.1.smithi157.stdout:2/967: chown da/d47/dbd/c12f 1697921752 1 2024-02-28T16:27:16.137 INFO:tasks.workunit.client.1.smithi157.stdout:7/881: readlink df/d25/d4e/lad 0 2024-02-28T16:27:16.140 INFO:tasks.workunit.client.1.smithi157.stdout:7/882: write df/d25/d79/fa6 [1689678,27468] 0 2024-02-28T16:27:16.141 INFO:tasks.workunit.client.1.smithi157.stdout:6/823: mkdir d2/d7/d8/da/d71/d8f/df9 0 2024-02-28T16:27:16.145 INFO:tasks.workunit.client.1.smithi157.stdout:4/867: write d3/da/d1f/f32 [219546,78950] 0 2024-02-28T16:27:16.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/913: write d1/d13/ff [577760,83403] 0 2024-02-28T16:27:16.147 INFO:tasks.workunit.client.1.smithi157.stdout:5/930: dwrite d0/d30/d50/f63 [0,4194304] 0 2024-02-28T16:27:16.147 INFO:tasks.workunit.client.1.smithi157.stdout:2/968: fsync da/f37 0 2024-02-28T16:27:16.149 INFO:tasks.workunit.client.1.smithi157.stdout:3/806: dwrite d0/d6/d6b/f73 [0,4194304] 0 2024-02-28T16:27:16.151 INFO:tasks.workunit.client.1.smithi157.stdout:0/914: write d1/f15 [3969093,64930] 0 2024-02-28T16:27:16.154 INFO:tasks.workunit.client.1.smithi157.stdout:7/883: creat df/d4b/d4c/f118 x:0 0 0 2024-02-28T16:27:16.165 INFO:tasks.workunit.client.1.smithi157.stdout:5/931: write d0/d30/def/f93 [626132,5705] 0 2024-02-28T16:27:16.167 INFO:tasks.workunit.client.1.smithi157.stdout:2/969: chown da/d38/d3e/d9b/ff3 620812 1 2024-02-28T16:27:16.168 INFO:tasks.workunit.client.1.smithi157.stdout:0/915: fdatasync d1/d13/f6d 0 2024-02-28T16:27:16.174 INFO:tasks.workunit.client.1.smithi157.stdout:6/824: truncate d2/d7/de/d1b/fba 2586473 0 2024-02-28T16:27:16.174 INFO:tasks.workunit.client.1.smithi157.stdout:8/859: link d1/d5/d43/d86/d96/cba d1/d5/c128 0 2024-02-28T16:27:16.177 INFO:tasks.workunit.client.1.smithi157.stdout:5/932: unlink d0/d9/d47/d5b/d89/f83 0 2024-02-28T16:27:16.180 INFO:tasks.workunit.client.1.smithi157.stdout:6/825: creat d2/d7/d8/da/d71/d93/ffa x:0 0 0 2024-02-28T16:27:16.180 INFO:tasks.workunit.client.1.smithi157.stdout:7/884: truncate df/d1f/d24/d4f/d72/f109 3132829 0 2024-02-28T16:27:16.183 INFO:tasks.workunit.client.1.smithi157.stdout:8/860: getdents d1/d5/dd8/d52/d54/d10f 0 2024-02-28T16:27:16.183 INFO:tasks.workunit.client.1.smithi157.stdout:4/868: dread d3/da/d1f/f26 [0,4194304] 0 2024-02-28T16:27:16.191 INFO:tasks.workunit.client.1.smithi157.stdout:8/861: creat d1/d5/d109/f129 x:0 0 0 2024-02-28T16:27:16.192 INFO:tasks.workunit.client.1.smithi157.stdout:0/916: dwrite d1/da/d6c/f12d [0,4194304] 0 2024-02-28T16:27:16.202 INFO:tasks.workunit.client.1.smithi157.stdout:3/807: dwrite d0/d6/d44/d70/d71/d87/f95 [0,4194304] 0 2024-02-28T16:27:16.202 INFO:tasks.workunit.client.1.smithi157.stdout:7/885: creat df/f119 x:0 0 0 2024-02-28T16:27:16.203 INFO:tasks.workunit.client.1.smithi157.stdout:2/970: dwrite da/fe1 [0,4194304] 0 2024-02-28T16:27:16.203 INFO:tasks.workunit.client.1.smithi157.stdout:9/830: sync 2024-02-28T16:27:16.204 INFO:tasks.workunit.client.1.smithi157.stdout:1/876: sync 2024-02-28T16:27:16.205 INFO:tasks.workunit.client.1.smithi157.stdout:3/808: truncate d0/fa3 1403229 0 2024-02-28T16:27:16.212 INFO:tasks.workunit.client.1.smithi157.stdout:2/971: write da/d65/f11d [466036,78159] 0 2024-02-28T16:27:16.214 INFO:tasks.workunit.client.1.smithi157.stdout:6/826: dread d2/d7/d8/da/d71/d8f/d6e/f79 [0,4194304] 0 2024-02-28T16:27:16.217 INFO:tasks.workunit.client.1.smithi157.stdout:0/917: rename d1/da/d7d/lba to d1/d13/d52/d7b/dcf/l135 0 2024-02-28T16:27:16.220 INFO:tasks.workunit.client.1.smithi157.stdout:7/886: creat df/d1f/da1/f11a x:0 0 0 2024-02-28T16:27:16.220 INFO:tasks.workunit.client.1.smithi157.stdout:4/869: write d3/da/d1f/d22/f83 [4897655,65348] 0 2024-02-28T16:27:16.222 INFO:tasks.workunit.client.1.smithi157.stdout:8/862: dwrite d1/d5/d10/f18 [4194304,4194304] 0 2024-02-28T16:27:16.223 INFO:tasks.workunit.client.1.smithi157.stdout:7/887: readlink df/d25/d79/l7f 0 2024-02-28T16:27:16.223 INFO:tasks.workunit.client.1.smithi157.stdout:9/831: rename d0/d36/d37/d4d/c7f to d0/d19/d30/d78/df1/c11b 0 2024-02-28T16:27:16.223 INFO:tasks.workunit.client.1.smithi157.stdout:2/972: creat da/d38/d3e/d9b/d104/f136 x:0 0 0 2024-02-28T16:27:16.228 INFO:tasks.workunit.client.1.smithi157.stdout:9/832: chown d0/d36/d37/c61 53919 1 2024-02-28T16:27:16.228 INFO:tasks.workunit.client.1.smithi157.stdout:5/933: truncate d0/d9/d47/d5b/d89/d75/fc5 1293626 0 2024-02-28T16:27:16.231 INFO:tasks.workunit.client.1.smithi157.stdout:3/809: getdents d0/d6/d34/d80/d23/d2b/d2e 0 2024-02-28T16:27:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:15 smithi157 ceph-mon[38346]: pgmap v62: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 51 MiB/s rd, 141 MiB/s wr, 322 op/s 2024-02-28T16:27:16.238 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:15 smithi148 ceph-mon[28767]: pgmap v62: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 51 MiB/s rd, 141 MiB/s wr, 322 op/s 2024-02-28T16:27:16.240 INFO:tasks.workunit.client.1.smithi157.stdout:1/877: write d10/d11/d31/d2a/f55 [4501585,64034] 0 2024-02-28T16:27:16.246 INFO:tasks.workunit.client.1.smithi157.stdout:5/934: creat d0/d9/d47/d5b/dc6/f13c x:0 0 0 2024-02-28T16:27:16.249 INFO:tasks.workunit.client.1.smithi157.stdout:6/827: link d2/d7/fc d2/d7/d8/da/d71/d8f/d6e/ffb 0 2024-02-28T16:27:16.249 INFO:tasks.workunit.client.1.smithi157.stdout:3/810: dwrite d0/d6/d34/d80/fd4 [0,4194304] 0 2024-02-28T16:27:16.253 INFO:tasks.workunit.client.1.smithi157.stdout:2/973: truncate da/d35/fea 128022 0 2024-02-28T16:27:16.253 INFO:tasks.workunit.client.1.smithi157.stdout:7/888: write f0 [5540104,112344] 0 2024-02-28T16:27:16.257 INFO:tasks.workunit.client.1.smithi157.stdout:0/918: rename d1/da/d7d/d98/de2/de9/dfa/l11e to d1/d13/d52/d53/l136 0 2024-02-28T16:27:16.259 INFO:tasks.workunit.client.1.smithi157.stdout:6/828: fdatasync d2/d7/d38/f87 0 2024-02-28T16:27:16.262 INFO:tasks.workunit.client.1.smithi157.stdout:3/811: creat d0/d6/d44/d100/f10e x:0 0 0 2024-02-28T16:27:16.264 INFO:tasks.workunit.client.1.smithi157.stdout:8/863: link d1/d5/d23/d38/d67/cb0 d1/d5/d10/c12a 0 2024-02-28T16:27:16.268 INFO:tasks.workunit.client.1.smithi157.stdout:0/919: readlink d1/d13/d52/d53/l9d 0 2024-02-28T16:27:16.269 INFO:tasks.workunit.client.1.smithi157.stdout:6/829: rmdir d2/d7/d8/da/d31/d59 39 2024-02-28T16:27:16.272 INFO:tasks.workunit.client.1.smithi157.stdout:6/830: stat d2/d7/d38/f97 0 2024-02-28T16:27:16.273 INFO:tasks.workunit.client.1.smithi157.stdout:8/864: unlink d1/d5/d14/f2d 0 2024-02-28T16:27:16.275 INFO:tasks.workunit.client.1.smithi157.stdout:9/833: dwrite d0/d19/d30/d79/f87 [0,4194304] 0 2024-02-28T16:27:16.276 INFO:tasks.workunit.client.1.smithi157.stdout:4/870: truncate d3/dcc/fff 2149864 0 2024-02-28T16:27:16.277 INFO:tasks.workunit.client.1.smithi157.stdout:3/812: symlink d0/d6/d44/d70/d71/da9/l10f 0 2024-02-28T16:27:16.279 INFO:tasks.workunit.client.1.smithi157.stdout:1/878: dread d10/d11/d3a/d5c/f87 [0,4194304] 0 2024-02-28T16:27:16.279 INFO:tasks.workunit.client.1.smithi157.stdout:0/920: mkdir d1/d8/d33/d96/d137 0 2024-02-28T16:27:16.286 INFO:tasks.workunit.client.1.smithi157.stdout:2/974: getdents da/d38/d3e 0 2024-02-28T16:27:16.290 INFO:tasks.workunit.client.1.smithi157.stdout:6/831: rmdir d2/d7/d8/da/d71 39 2024-02-28T16:27:16.292 INFO:tasks.workunit.client.1.smithi157.stdout:8/865: chown d1/d5/d23/dbd/dc9/ce8 241 1 2024-02-28T16:27:16.296 INFO:tasks.workunit.client.1.smithi157.stdout:0/921: dwrite d1/d8/d33/d96/fa7 [0,4194304] 0 2024-02-28T16:27:16.299 INFO:tasks.workunit.client.1.smithi157.stdout:4/871: rmdir d3/da/d37/db2/d112 39 2024-02-28T16:27:16.301 INFO:tasks.workunit.client.1.smithi157.stdout:4/872: dread - d3/da/d37/d84/dc9/ff2 zero size 2024-02-28T16:27:16.303 INFO:tasks.workunit.client.1.smithi157.stdout:7/889: dread f8 [0,4194304] 0 2024-02-28T16:27:16.303 INFO:tasks.workunit.client.1.smithi157.stdout:1/879: symlink d10/d11/d31/d2a/d70/d9b/l11d 0 2024-02-28T16:27:16.304 INFO:tasks.workunit.client.1.smithi157.stdout:2/975: fdatasync da/d38/d5a/fdb 0 2024-02-28T16:27:16.306 INFO:tasks.workunit.client.1.smithi157.stdout:6/832: rename d2/d7/l77 to d2/d7/d8/da/d31/d37/d2b/d99/lfc 0 2024-02-28T16:27:16.309 INFO:tasks.workunit.client.1.smithi157.stdout:1/880: write d10/d11/d31/d2a/fbb [8319873,120847] 0 2024-02-28T16:27:16.309 INFO:tasks.workunit.client.1.smithi157.stdout:9/834: link d0/d36/d37/d4d/d92/fe0 d0/d19/d30/d79/f11c 0 2024-02-28T16:27:16.314 INFO:tasks.workunit.client.1.smithi157.stdout:9/835: chown d0/d36/d3f/l5f 7 1 2024-02-28T16:27:16.315 INFO:tasks.workunit.client.1.smithi157.stdout:8/866: dwrite d1/d5/d23/d53/f120 [0,4194304] 0 2024-02-28T16:27:16.316 INFO:tasks.workunit.client.1.smithi157.stdout:9/836: readlink d0/d19/d30/d78/ld3 0 2024-02-28T16:27:16.318 INFO:tasks.workunit.client.1.smithi157.stdout:2/976: truncate da/f37 1932306 0 2024-02-28T16:27:16.322 INFO:tasks.workunit.client.1.smithi157.stdout:2/977: read - da/d38/d7e/dbb/fef zero size 2024-02-28T16:27:16.323 INFO:tasks.workunit.client.1.smithi157.stdout:6/833: chown d2/d7/d8/da/d71/cde 346033997 1 2024-02-28T16:27:16.323 INFO:tasks.workunit.client.1.smithi157.stdout:4/873: symlink d3/da/d37/d84/d9a/df9/l11c 0 2024-02-28T16:27:16.325 INFO:tasks.workunit.client.1.smithi157.stdout:2/978: write da/d8c/dc0/fe8 [619450,98849] 0 2024-02-28T16:27:16.326 INFO:tasks.workunit.client.1.smithi157.stdout:1/881: creat d10/d11/d3a/d5c/d6c/d7b/d8c/f11e x:0 0 0 2024-02-28T16:27:16.328 INFO:tasks.workunit.client.1.smithi157.stdout:2/979: fdatasync da/d38/d7e/d92/dd2/fd7 0 2024-02-28T16:27:16.330 INFO:tasks.workunit.client.1.smithi157.stdout:7/890: creat df/d1f/d24/d39/d64/df6/d113/f11b x:0 0 0 2024-02-28T16:27:16.330 INFO:tasks.workunit.client.1.smithi157.stdout:1/882: dread - d10/d11/d3a/d5c/d6a/db4/d91/d113/f117 zero size 2024-02-28T16:27:16.330 INFO:tasks.workunit.client.1.smithi157.stdout:2/980: write da/fe1 [315366,84343] 0 2024-02-28T16:27:16.332 INFO:tasks.workunit.client.1.smithi157.stdout:7/891: stat df/d1f/d24/f33 0 2024-02-28T16:27:16.333 INFO:tasks.workunit.client.1.smithi157.stdout:3/813: getdents d0/d6/d44/d4b 0 2024-02-28T16:27:16.335 INFO:tasks.workunit.client.1.smithi157.stdout:7/892: chown df/d1f/d24/d38/cda 140431249 1 2024-02-28T16:27:16.336 INFO:tasks.workunit.client.1.smithi157.stdout:9/837: creat d0/d36/d3f/d103/f11d x:0 0 0 2024-02-28T16:27:16.339 INFO:tasks.workunit.client.1.smithi157.stdout:1/883: rmdir d10/d11/d3a/d5c/d84/dd4 39 2024-02-28T16:27:16.343 INFO:tasks.workunit.client.1.smithi157.stdout:7/893: write df/d1f/d24/d4f/d72/dab/fef [484128,69226] 0 2024-02-28T16:27:16.344 INFO:tasks.workunit.client.1.smithi157.stdout:4/874: link d3/da/f46 d3/da/d48/f11d 0 2024-02-28T16:27:16.344 INFO:tasks.workunit.client.1.smithi157.stdout:8/867: dread d1/d5/f4a [0,4194304] 0 2024-02-28T16:27:16.344 INFO:tasks.workunit.client.1.smithi157.stdout:7/894: chown df/d25/c42 5 1 2024-02-28T16:27:16.345 INFO:tasks.workunit.client.1.smithi157.stdout:2/981: dread da/d38/d4e/f93 [0,4194304] 0 2024-02-28T16:27:16.390 INFO:tasks.workunit.client.1.smithi157.stdout:5/935: sync 2024-02-28T16:27:16.392 INFO:tasks.workunit.client.1.smithi157.stdout:4/875: readlink d3/da/d37/d84/d9a/df8/l72 0 2024-02-28T16:27:16.398 INFO:tasks.workunit.client.1.smithi157.stdout:7/895: symlink df/d1f/d24/d39/d64/df6/dfd/l11c 0 2024-02-28T16:27:16.399 INFO:tasks.workunit.client.1.smithi157.stdout:1/884: truncate d10/d11/d22/d99/fb0 2473282 0 2024-02-28T16:27:16.404 INFO:tasks.workunit.client.1.smithi157.stdout:3/814: dwrite d0/d6/ff4 [0,4194304] 0 2024-02-28T16:27:16.404 INFO:tasks.workunit.client.1.smithi157.stdout:1/885: chown d10/d11/d22/l47 42797 1 2024-02-28T16:27:16.405 INFO:tasks.workunit.client.1.smithi157.stdout:5/936: creat d0/d30/da0/dfd/f13d x:0 0 0 2024-02-28T16:27:16.406 INFO:tasks.workunit.client.1.smithi157.stdout:7/896: mkdir df/d4b/d4c/d11d 0 2024-02-28T16:27:16.407 INFO:tasks.workunit.client.1.smithi157.stdout:4/876: creat d3/da/d37/d84/f11e x:0 0 0 2024-02-28T16:27:16.410 INFO:tasks.workunit.client.1.smithi157.stdout:3/815: chown d0/d6/d44/d70/d71/da9/l10f 81 1 2024-02-28T16:27:16.413 INFO:tasks.workunit.client.1.smithi157.stdout:1/886: creat d10/da0/f11f x:0 0 0 2024-02-28T16:27:16.413 INFO:tasks.workunit.client.1.smithi157.stdout:7/897: readlink df/d1f/d24/d38/lc7 0 2024-02-28T16:27:16.414 INFO:tasks.workunit.client.1.smithi157.stdout:8/868: dwrite d1/d5/d23/d53/f6c [0,4194304] 0 2024-02-28T16:27:16.418 INFO:tasks.workunit.client.1.smithi157.stdout:2/982: dwrite da/d2b/d59/d109/fd6 [0,4194304] 0 2024-02-28T16:27:16.418 INFO:tasks.workunit.client.1.smithi157.stdout:1/887: chown d10/d11/d3a/d95/da4 660 1 2024-02-28T16:27:16.421 INFO:tasks.workunit.client.1.smithi157.stdout:3/816: mknod d0/d6/d44/d70/d71/d87/dd1/c110 0 2024-02-28T16:27:16.423 INFO:tasks.workunit.client.1.smithi157.stdout:8/869: write d1/d5/dd8/d52/d54/ff2 [3924498,72487] 0 2024-02-28T16:27:16.426 INFO:tasks.workunit.client.1.smithi157.stdout:4/877: symlink d3/da/d37/d84/d9a/df8/db0/db4/dfc/l11f 0 2024-02-28T16:27:16.431 INFO:tasks.workunit.client.1.smithi157.stdout:2/983: unlink da/d2b/d59/d109/faf 0 2024-02-28T16:27:16.437 INFO:tasks.workunit.client.1.smithi157.stdout:7/898: rename df/fcc to df/d1f/f11e 0 2024-02-28T16:27:16.440 INFO:tasks.workunit.client.1.smithi157.stdout:4/878: rmdir d3/da/d1f/dc1/dc8 39 2024-02-28T16:27:16.441 INFO:tasks.workunit.client.1.smithi157.stdout:7/899: chown df/d1f/d24/d4f/d72/dab/f103 0 1 2024-02-28T16:27:16.448 INFO:tasks.workunit.client.1.smithi157.stdout:5/937: mknod d0/d30/da0/dfd/c13e 0 2024-02-28T16:27:16.449 INFO:tasks.workunit.client.1.smithi157.stdout:3/817: dread d0/d6/f13 [0,4194304] 0 2024-02-28T16:27:16.452 INFO:tasks.workunit.client.1.smithi157.stdout:3/818: read d0/d6/d44/d8e/da8/fb7 [1798027,4836] 0 2024-02-28T16:27:16.453 INFO:tasks.workunit.client.1.smithi157.stdout:2/984: rename da/d38/d3e/cfb to da/d2b/d59/c137 0 2024-02-28T16:27:16.454 INFO:tasks.workunit.client.1.smithi157.stdout:8/870: dread d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:16.455 INFO:tasks.workunit.client.1.smithi157.stdout:2/985: fdatasync da/f28 0 2024-02-28T16:27:16.455 INFO:tasks.workunit.client.1.smithi157.stdout:1/888: dwrite d10/d11/d31/d2a/f2d [0,4194304] 0 2024-02-28T16:27:16.455 INFO:tasks.workunit.client.1.smithi157.stdout:4/879: mkdir d3/d77/daa/d120 0 2024-02-28T16:27:16.461 INFO:tasks.workunit.client.1.smithi157.stdout:7/900: rename df/d25/d79/d9e/fd8 to df/d1f/d24/d4f/d72/f11f 0 2024-02-28T16:27:16.462 INFO:tasks.workunit.client.1.smithi157.stdout:8/871: creat d1/d5/d23/d53/dc1/f12b x:0 0 0 2024-02-28T16:27:16.464 INFO:tasks.workunit.client.1.smithi157.stdout:2/986: symlink da/d47/dbd/dde/l138 0 2024-02-28T16:27:16.471 INFO:tasks.workunit.client.1.smithi157.stdout:3/819: dwrite d0/feb [0,4194304] 0 2024-02-28T16:27:16.474 INFO:tasks.workunit.client.1.smithi157.stdout:2/987: fsync da/d35/f48 0 2024-02-28T16:27:16.476 INFO:tasks.workunit.client.1.smithi157.stdout:0/922: sync 2024-02-28T16:27:16.487 INFO:tasks.workunit.client.1.smithi157.stdout:1/889: symlink d10/d11/d31/d2a/d70/dfe/l120 0 2024-02-28T16:27:16.491 INFO:tasks.workunit.client.1.smithi157.stdout:2/988: dwrite da/d47/f12d [0,4194304] 0 2024-02-28T16:27:16.494 INFO:tasks.workunit.client.1.smithi157.stdout:1/890: truncate d10/d11/d3a/d5c/d6a/db4/d91/f93 1885427 0 2024-02-28T16:27:16.495 INFO:tasks.workunit.client.1.smithi157.stdout:5/938: getdents d0/d9/d47/d5b/dc6 0 2024-02-28T16:27:16.497 INFO:tasks.workunit.client.1.smithi157.stdout:5/939: truncate d0/d30/d50/d7f/ffa 1079574 0 2024-02-28T16:27:16.498 INFO:tasks.workunit.client.1.smithi157.stdout:5/940: dread - d0/d30/d50/df0/f109 zero size 2024-02-28T16:27:16.499 INFO:tasks.workunit.client.1.smithi157.stdout:4/880: link d3/da/l19 d3/da/d37/db2/d112/l121 0 2024-02-28T16:27:16.501 INFO:tasks.workunit.client.1.smithi157.stdout:5/941: write d0/d30/d50/df0/f109 [697633,43840] 0 2024-02-28T16:27:16.505 INFO:tasks.workunit.client.1.smithi157.stdout:5/942: fdatasync d0/d30/d50/df0/f103 0 2024-02-28T16:27:16.509 INFO:tasks.workunit.client.1.smithi157.stdout:3/820: symlink d0/d6/d34/l111 0 2024-02-28T16:27:16.510 INFO:tasks.workunit.client.1.smithi157.stdout:1/891: symlink d10/d11/d3a/d5c/d6c/d6f/l121 0 2024-02-28T16:27:16.511 INFO:tasks.workunit.client.1.smithi157.stdout:7/901: truncate df/d1f/d24/d4f/d72/f94 4443308 0 2024-02-28T16:27:16.511 INFO:tasks.workunit.client.1.smithi157.stdout:3/821: write d0/d6/d44/d48/f7f [3317174,52182] 0 2024-02-28T16:27:16.513 INFO:tasks.workunit.client.1.smithi157.stdout:7/902: stat df/d25/da7/c111 0 2024-02-28T16:27:16.517 INFO:tasks.workunit.client.1.smithi157.stdout:8/872: link d1/d5/d23/dbd/dc9/d108/l113 d1/d5/d23/dbd/dc9/d11f/l12c 0 2024-02-28T16:27:16.518 INFO:tasks.workunit.client.1.smithi157.stdout:5/943: mkdir d0/d9/d47/d10e/d13f 0 2024-02-28T16:27:16.520 INFO:tasks.workunit.client.1.smithi157.stdout:0/923: dwrite d1/d13/d7f/d94/f9c [0,4194304] 0 2024-02-28T16:27:16.527 INFO:tasks.workunit.client.1.smithi157.stdout:3/822: rename d0/d6/d44/f52 to d0/d6/d34/d43/f112 0 2024-02-28T16:27:16.528 INFO:tasks.workunit.client.1.smithi157.stdout:2/989: write da/d47/dbd/dde/f43 [4746401,17285] 0 2024-02-28T16:27:16.532 INFO:tasks.workunit.client.1.smithi157.stdout:4/881: truncate d3/da/d1f/d22/f44 4646509 0 2024-02-28T16:27:16.534 INFO:tasks.workunit.client.1.smithi157.stdout:1/892: dread d10/f12 [0,4194304] 0 2024-02-28T16:27:16.536 INFO:tasks.workunit.client.1.smithi157.stdout:0/924: symlink d1/d13/d46/d99/l138 0 2024-02-28T16:27:16.536 INFO:tasks.workunit.client.1.smithi157.stdout:0/925: chown d1/d13/d52/db5 89240 1 2024-02-28T16:27:16.538 INFO:tasks.workunit.client.1.smithi157.stdout:0/926: write d1/da/f121 [969499,11901] 0 2024-02-28T16:27:16.540 INFO:tasks.workunit.client.1.smithi157.stdout:7/903: rename df/d25/d4e/d67/l4a to df/d1f/d24/d4f/d72/dab/d10f/l120 0 2024-02-28T16:27:16.544 INFO:tasks.workunit.client.1.smithi157.stdout:2/990: chown da/d38/d5a/d5c/ca4 19797248 1 2024-02-28T16:27:16.545 INFO:tasks.workunit.client.1.smithi157.stdout:4/882: mknod d3/da/d28/c122 0 2024-02-28T16:27:16.549 INFO:tasks.workunit.client.1.smithi157.stdout:1/893: rmdir d10/da0 39 2024-02-28T16:27:16.561 INFO:tasks.workunit.client.1.smithi157.stdout:6/834: sync 2024-02-28T16:27:16.561 INFO:tasks.workunit.client.1.smithi157.stdout:9/838: sync 2024-02-28T16:27:16.564 INFO:tasks.workunit.client.1.smithi157.stdout:3/823: truncate d0/d6/d34/d80/d23/d2b/fd5 1984415 0 2024-02-28T16:27:16.565 INFO:tasks.workunit.client.1.smithi157.stdout:1/894: creat d10/d11/d31/d2a/f122 x:0 0 0 2024-02-28T16:27:16.567 INFO:tasks.workunit.client.1.smithi157.stdout:8/873: rename d1/d5/d43/d86/dff to d1/d5/d43/d86/d12d 0 2024-02-28T16:27:16.569 INFO:tasks.workunit.client.1.smithi157.stdout:4/883: symlink d3/da/d37/d84/l123 0 2024-02-28T16:27:16.570 INFO:tasks.workunit.client.1.smithi157.stdout:7/904: dwrite df/d1f/d37/d46/f5b [0,4194304] 0 2024-02-28T16:27:16.573 INFO:tasks.workunit.client.1.smithi157.stdout:4/884: write d3/da/d48/d8e/ff0 [737010,33013] 0 2024-02-28T16:27:16.573 INFO:tasks.workunit.client.1.smithi157.stdout:6/835: mkdir d2/d7/d8/da/da1/dfd 0 2024-02-28T16:27:16.573 INFO:tasks.workunit.client.1.smithi157.stdout:7/905: write df/d25/d79/d9a/fa3 [3860103,97374] 0 2024-02-28T16:27:16.575 INFO:tasks.workunit.client.1.smithi157.stdout:3/824: mknod d0/d6/d44/d4b/c113 0 2024-02-28T16:27:16.575 INFO:tasks.workunit.client.1.smithi157.stdout:5/944: getdents d0/d9/d1b/d36/daf 0 2024-02-28T16:27:16.576 INFO:tasks.workunit.client.1.smithi157.stdout:2/991: rmdir da/d38/d3e/d9b/d104 39 2024-02-28T16:27:16.578 INFO:tasks.workunit.client.1.smithi157.stdout:8/874: mknod d1/d5/d23/da1/c12e 0 2024-02-28T16:27:16.583 INFO:tasks.workunit.client.1.smithi157.stdout:5/945: chown d0/d30/l138 18691 1 2024-02-28T16:27:16.585 INFO:tasks.workunit.client.1.smithi157.stdout:6/836: dread d2/d7/d8/fa7 [0,4194304] 0 2024-02-28T16:27:16.586 INFO:tasks.workunit.client.1.smithi157.stdout:4/885: readlink d3/da/d37/d84/d9a/df9/l11c 0 2024-02-28T16:27:16.591 INFO:tasks.workunit.client.1.smithi157.stdout:1/895: dwrite d10/d11/d3a/d95/fd6 [0,4194304] 0 2024-02-28T16:27:16.592 INFO:tasks.workunit.client.1.smithi157.stdout:9/839: rename d0/d36/dc2 to d0/d36/d37/d40/d11e 0 2024-02-28T16:27:16.596 INFO:tasks.workunit.client.1.smithi157.stdout:9/840: read d0/d36/d37/d40/d4b/d96/fda [2000292,80820] 0 2024-02-28T16:27:16.598 INFO:tasks.workunit.client.1.smithi157.stdout:8/875: mknod d1/d5/c12f 0 2024-02-28T16:27:16.599 INFO:tasks.workunit.client.1.smithi157.stdout:7/906: mknod df/d1f/d24/d39/d64/df6/dfd/c121 0 2024-02-28T16:27:16.600 INFO:tasks.workunit.client.1.smithi157.stdout:9/841: chown d0/d36/d37/d4d/d92/fe0 6599969 1 2024-02-28T16:27:16.608 INFO:tasks.workunit.client.1.smithi157.stdout:2/992: mknod da/c139 0 2024-02-28T16:27:16.608 INFO:tasks.workunit.client.1.smithi157.stdout:3/825: write d0/d6/d34/d80/d5c/fc7 [35028,117891] 0 2024-02-28T16:27:16.608 INFO:tasks.workunit.client.1.smithi157.stdout:5/946: mkdir d0/d9/d1b/d140 0 2024-02-28T16:27:16.613 INFO:tasks.workunit.client.1.smithi157.stdout:1/896: dwrite d10/d11/d31/d2a/d70/d9b/f111 [0,4194304] 0 2024-02-28T16:27:16.614 INFO:tasks.workunit.client.1.smithi157.stdout:6/837: write d2/d7/de/d1b/d4d/f62 [764271,117551] 0 2024-02-28T16:27:16.616 INFO:tasks.workunit.client.1.smithi157.stdout:6/838: chown d2/f4b 942461 1 2024-02-28T16:27:16.621 INFO:tasks.workunit.client.1.smithi157.stdout:4/886: dwrite d3/f16 [0,4194304] 0 2024-02-28T16:27:16.625 INFO:tasks.workunit.client.1.smithi157.stdout:9/842: mkdir d0/d36/d37/d40/d4b/d96/df4/d11f 0 2024-02-28T16:27:16.626 INFO:tasks.workunit.client.1.smithi157.stdout:7/907: symlink df/d1f/d24/d39/l122 0 2024-02-28T16:27:16.626 INFO:tasks.workunit.client.1.smithi157.stdout:4/887: dread d3/da/d48/fe7 [0,4194304] 0 2024-02-28T16:27:16.629 INFO:tasks.workunit.client.1.smithi157.stdout:4/888: write d3/da/d37/d84/d9a/df8/db0/db4/fc3 [859185,89026] 0 2024-02-28T16:27:16.629 INFO:tasks.workunit.client.1.smithi157.stdout:6/839: truncate d2/d7/f24 1519271 0 2024-02-28T16:27:16.630 INFO:tasks.workunit.client.1.smithi157.stdout:4/889: readlink d3/d77/daa/lf4 0 2024-02-28T16:27:16.631 INFO:tasks.workunit.client.1.smithi157.stdout:3/826: mkdir d0/d6/d6b/d75/df0/d114 0 2024-02-28T16:27:16.631 INFO:tasks.workunit.client.1.smithi157.stdout:6/840: chown d2/d7/d8/da/da1 14641 1 2024-02-28T16:27:16.634 INFO:tasks.workunit.client.1.smithi157.stdout:7/908: mknod df/d40/c123 0 2024-02-28T16:27:16.637 INFO:tasks.workunit.client.1.smithi157.stdout:7/909: write df/d1f/d24/de9/ff5 [379573,17100] 0 2024-02-28T16:27:16.638 INFO:tasks.workunit.client.1.smithi157.stdout:1/897: rename d10/d11/d3a/d5c/d6a/db4/la5 to d10/d11/d31/d2a/l123 0 2024-02-28T16:27:16.645 INFO:tasks.workunit.client.1.smithi157.stdout:6/841: symlink d2/d7/d8/dd4/d53/lfe 0 2024-02-28T16:27:16.645 INFO:tasks.workunit.client.1.smithi157.stdout:5/947: write d0/d30/f5f [471271,116732] 0 2024-02-28T16:27:16.647 INFO:tasks.workunit.client.1.smithi157.stdout:9/843: dwrite d0/d36/daa/f109 [0,4194304] 0 2024-02-28T16:27:16.652 INFO:tasks.workunit.client.1.smithi157.stdout:7/910: mkdir df/d1f/da1/d124 0 2024-02-28T16:27:16.653 INFO:tasks.workunit.client.1.smithi157.stdout:3/827: dread d0/d6/d44/d48/f6e [0,4194304] 0 2024-02-28T16:27:16.655 INFO:tasks.workunit.client.1.smithi157.stdout:2/993: dwrite da/d2b/f50 [0,4194304] 0 2024-02-28T16:27:16.656 INFO:tasks.workunit.client.1.smithi157.stdout:6/842: rmdir d2/d7/de/d40 39 2024-02-28T16:27:16.658 INFO:tasks.workunit.client.1.smithi157.stdout:6/843: fsync d2/d7/d8/dd4/d53/da6/fdd 0 2024-02-28T16:27:16.662 INFO:tasks.workunit.client.1.smithi157.stdout:1/898: creat d10/d11/d3a/d95/da4/f124 x:0 0 0 2024-02-28T16:27:16.663 INFO:tasks.workunit.client.1.smithi157.stdout:5/948: mknod d0/d9/c141 0 2024-02-28T16:27:16.663 INFO:tasks.workunit.client.1.smithi157.stdout:4/890: getdents d3/da/d37/d84/d9a/df8/db0/db4/dfc 0 2024-02-28T16:27:16.664 INFO:tasks.workunit.client.1.smithi157.stdout:9/844: mknod d0/d36/d37/d4d/c120 0 2024-02-28T16:27:16.667 INFO:tasks.workunit.client.1.smithi157.stdout:7/911: symlink df/d1f/d24/l125 0 2024-02-28T16:27:16.669 INFO:tasks.workunit.client.1.smithi157.stdout:5/949: mknod d0/d9/d47/dad/c142 0 2024-02-28T16:27:16.670 INFO:tasks.workunit.client.1.smithi157.stdout:6/844: read d2/d7/d38/f87 [3153597,58806] 0 2024-02-28T16:27:16.673 INFO:tasks.workunit.client.1.smithi157.stdout:4/891: creat d3/da/d37/d84/d9a/df9/f124 x:0 0 0 2024-02-28T16:27:16.677 INFO:tasks.workunit.client.1.smithi157.stdout:9/845: rmdir d0/d19/d30/dff 0 2024-02-28T16:27:16.677 INFO:tasks.workunit.client.1.smithi157.stdout:6/845: fsync d2/d7/d8/da/d71/d8f/f85 0 2024-02-28T16:27:16.679 INFO:tasks.workunit.client.1.smithi157.stdout:5/950: dread d0/d9/d3a/ff7 [0,4194304] 0 2024-02-28T16:27:16.684 INFO:tasks.workunit.client.1.smithi157.stdout:7/912: link df/d1f/d24/d4f/d72/fd7 df/d4b/d4c/d11d/f126 0 2024-02-28T16:27:16.685 INFO:tasks.workunit.client.1.smithi157.stdout:6/846: read - d2/d7/d8/f68 zero size 2024-02-28T16:27:16.685 INFO:tasks.workunit.client.1.smithi157.stdout:0/927: sync 2024-02-28T16:27:16.686 INFO:tasks.workunit.client.1.smithi157.stdout:9/846: rmdir d0/d36/d37/d40 39 2024-02-28T16:27:16.687 INFO:tasks.workunit.client.1.smithi157.stdout:5/951: creat d0/d30/f143 x:0 0 0 2024-02-28T16:27:16.688 INFO:tasks.workunit.client.1.smithi157.stdout:1/899: rmdir d10/d11/d3a 39 2024-02-28T16:27:16.689 INFO:tasks.workunit.client.1.smithi157.stdout:2/994: dwrite da/d2b/f3d [0,4194304] 0 2024-02-28T16:27:16.690 INFO:tasks.workunit.client.1.smithi157.stdout:3/828: dwrite d0/d6/d1e/fdf [0,4194304] 0 2024-02-28T16:27:16.691 INFO:tasks.workunit.client.1.smithi157.stdout:7/913: write df/d25/fea [524217,117425] 0 2024-02-28T16:27:16.691 INFO:tasks.workunit.client.1.smithi157.stdout:4/892: link d3/d77/f98 d3/da/d37/db2/f125 0 2024-02-28T16:27:16.696 INFO:tasks.workunit.client.1.smithi157.stdout:0/928: chown d1/da/d6c/c8b 390 1 2024-02-28T16:27:16.698 INFO:tasks.workunit.client.1.smithi157.stdout:5/952: symlink d0/d9/d47/l144 0 2024-02-28T16:27:16.698 INFO:tasks.workunit.client.1.smithi157.stdout:4/893: fsync d3/da/d37/d84/d9a/df9/f124 0 2024-02-28T16:27:16.699 INFO:tasks.workunit.client.1.smithi157.stdout:1/900: readlink d10/d11/d3a/d5c/d6c/d6f/lfa 0 2024-02-28T16:27:16.700 INFO:tasks.workunit.client.1.smithi157.stdout:6/847: mknod d2/d7/d8/da/d31/d37/d2b/cff 0 2024-02-28T16:27:16.706 INFO:tasks.workunit.client.1.smithi157.stdout:2/995: unlink da/d38/d4e/d91/f8a 0 2024-02-28T16:27:16.710 INFO:tasks.workunit.client.1.smithi157.stdout:0/929: rename d1/l1e to d1/d13/d52/d53/l139 0 2024-02-28T16:27:16.712 INFO:tasks.workunit.client.1.smithi157.stdout:0/930: stat d1/da/f58 0 2024-02-28T16:27:16.713 INFO:tasks.workunit.client.1.smithi157.stdout:8/876: sync 2024-02-28T16:27:16.713 INFO:tasks.workunit.client.1.smithi157.stdout:5/953: creat d0/d9/d47/d10e/f145 x:0 0 0 2024-02-28T16:27:16.716 INFO:tasks.workunit.client.1.smithi157.stdout:1/901: dwrite d10/d11/d31/d7f/ff9 [0,4194304] 0 2024-02-28T16:27:16.718 INFO:tasks.workunit.client.1.smithi157.stdout:8/877: fdatasync d1/d5/dd8/d52/d54/f7b 0 2024-02-28T16:27:16.719 INFO:tasks.workunit.client.1.smithi157.stdout:6/848: chown d2/d7/de/d40/c5c 185 1 2024-02-28T16:27:16.722 INFO:tasks.workunit.client.1.smithi157.stdout:9/847: creat d0/d36/d3f/d69/d111/d118/f121 x:0 0 0 2024-02-28T16:27:16.722 INFO:tasks.workunit.client.1.smithi157.stdout:3/829: rename d0/d6/d44/d48/fe2 to d0/d6/d44/d70/d71/f115 0 2024-02-28T16:27:16.723 INFO:tasks.workunit.client.1.smithi157.stdout:8/878: rename d1 to d1/d5/d43/d130 22 2024-02-28T16:27:16.725 INFO:tasks.workunit.client.1.smithi157.stdout:4/894: getdents d3/da/d1f/dc1/dde 0 2024-02-28T16:27:16.726 INFO:tasks.workunit.client.1.smithi157.stdout:5/954: truncate d0/d9/d1b/f67 2986301 0 2024-02-28T16:27:16.727 INFO:tasks.workunit.client.1.smithi157.stdout:4/895: dread - d3/da/d37/d84/d9a/df8/db0/db4/f119 zero size 2024-02-28T16:27:16.730 INFO:tasks.workunit.client.1.smithi157.stdout:1/902: creat d10/d11/d3a/d5c/d6c/f125 x:0 0 0 2024-02-28T16:27:16.730 INFO:tasks.workunit.client.1.smithi157.stdout:6/849: dread d2/d7/d8/da/d31/fca [0,4194304] 0 2024-02-28T16:27:16.734 INFO:tasks.workunit.client.1.smithi157.stdout:2/996: dread da/d35/fe5 [0,4194304] 0 2024-02-28T16:27:16.734 INFO:tasks.workunit.client.1.smithi157.stdout:0/931: truncate d1/da/d7d/dc4/d10c/f11b 1067347 0 2024-02-28T16:27:16.736 INFO:tasks.workunit.client.1.smithi157.stdout:1/903: readlink d10/d11/d3a/d5c/d6c/d6f/l121 0 2024-02-28T16:27:16.742 INFO:tasks.workunit.client.1.smithi157.stdout:2/997: symlink da/d35/l13a 0 2024-02-28T16:27:16.747 INFO:tasks.workunit.client.1.smithi157.stdout:1/904: chown d10/da0/db6 36 1 2024-02-28T16:27:16.747 INFO:tasks.workunit.client.1.smithi157.stdout:4/896: dread d3/da/d1f/f6d [0,4194304] 0 2024-02-28T16:27:16.748 INFO:tasks.workunit.client.1.smithi157.stdout:0/932: creat d1/da/d7d/d98/de2/f13a x:0 0 0 2024-02-28T16:27:16.749 INFO:tasks.workunit.client.1.smithi157.stdout:1/905: stat d10/d11/lf7 0 2024-02-28T16:27:16.750 INFO:tasks.workunit.client.1.smithi157.stdout:7/914: dread df/d1f/d24/d39/f58 [0,4194304] 0 2024-02-28T16:27:16.751 INFO:tasks.workunit.client.1.smithi157.stdout:6/850: symlink d2/d7/d8/da/l100 0 2024-02-28T16:27:16.754 INFO:tasks.workunit.client.1.smithi157.stdout:8/879: creat d1/d5/d23/d38/f131 x:0 0 0 2024-02-28T16:27:16.759 INFO:tasks.workunit.client.1.smithi157.stdout:9/848: link d0/d36/d3f/ca0 d0/d19/c122 0 2024-02-28T16:27:16.759 INFO:tasks.workunit.client.1.smithi157.stdout:3/830: dwrite d0/d6/d44/d8e/da8/fb7 [0,4194304] 0 2024-02-28T16:27:16.760 INFO:tasks.workunit.client.1.smithi157.stdout:0/933: mkdir d1/d8/d33/d56/d13b 0 2024-02-28T16:27:16.762 INFO:tasks.workunit.client.1.smithi157.stdout:2/998: dwrite da/d65/f11d [0,4194304] 0 2024-02-28T16:27:16.763 INFO:tasks.workunit.client.1.smithi157.stdout:3/831: write d0/d6/d44/d4b/da6/fb5 [2521561,14722] 0 2024-02-28T16:27:16.769 INFO:tasks.workunit.client.1.smithi157.stdout:1/906: creat d10/d11/d31/d2a/d70/de8/f126 x:0 0 0 2024-02-28T16:27:16.769 INFO:tasks.workunit.client.1.smithi157.stdout:7/915: chown df/fae 3643961 1 2024-02-28T16:27:16.772 INFO:tasks.workunit.client.1.smithi157.stdout:7/916: write df/d1f/d24/d38/f115 [519429,32162] 0 2024-02-28T16:27:16.772 INFO:tasks.workunit.client.1.smithi157.stdout:1/907: chown d10/d11/d31/d2a/d70/dfe/l120 84022 1 2024-02-28T16:27:16.773 INFO:tasks.workunit.client.1.smithi157.stdout:6/851: creat d2/d7/d8/da/d71/d80/f101 x:0 0 0 2024-02-28T16:27:16.774 INFO:tasks.workunit.client.1.smithi157.stdout:5/955: getdents d0/d9/d47/d5b/d89/d75/dab 0 2024-02-28T16:27:16.777 INFO:tasks.workunit.client.1.smithi157.stdout:8/880: unlink d1/d5/d109/l115 0 2024-02-28T16:27:16.778 INFO:tasks.workunit.client.1.smithi157.stdout:5/956: chown d0/d30/da0/dd4/f110 32764842 1 2024-02-28T16:27:16.782 INFO:tasks.workunit.client.1.smithi157.stdout:3/832: unlink d0/d6/d6b/f73 0 2024-02-28T16:27:16.783 INFO:tasks.workunit.client.1.smithi157.stdout:1/908: mkdir d10/d11/d60/d100/d127 0 2024-02-28T16:27:16.787 INFO:tasks.workunit.client.1.smithi157.stdout:2/999: write da/d38/d7e/dbb/fef [594528,9225] 0 2024-02-28T16:27:16.791 INFO:tasks.workunit.client.1.smithi157.stdout:5/957: dread d0/d9/d1b/fa4 [0,4194304] 0 2024-02-28T16:27:16.793 INFO:tasks.workunit.client.1.smithi157.stdout:8/881: getdents d1/d5/d4d/d60 0 2024-02-28T16:27:16.795 INFO:tasks.workunit.client.1.smithi157.stdout:3/833: write d0/d6/d44/d70/d71/d87/f95 [2831636,18706] 0 2024-02-28T16:27:16.795 INFO:tasks.workunit.client.1.smithi157.stdout:6/852: truncate d2/d7/d8/da/d71/d8f/d6e/ffb 1552561 0 2024-02-28T16:27:16.800 INFO:tasks.workunit.client.1.smithi157.stdout:4/897: write d3/da/f20 [4657116,51818] 0 2024-02-28T16:27:16.803 INFO:tasks.workunit.client.1.smithi157.stdout:3/834: fdatasync d0/d6/d44/d70/f8b 0 2024-02-28T16:27:16.803 INFO:tasks.workunit.client.1.smithi157.stdout:5/958: mknod d0/d9/d47/c146 0 2024-02-28T16:27:16.804 INFO:tasks.workunit.client.1.smithi157.stdout:9/849: dread d0/d36/d37/f67 [0,4194304] 0 2024-02-28T16:27:16.807 INFO:tasks.workunit.client.1.smithi157.stdout:7/917: dwrite df/d1f/d24/d39/fb4 [0,4194304] 0 2024-02-28T16:27:16.808 INFO:tasks.workunit.client.1.smithi157.stdout:0/934: dread d1/d8/d33/d96/fe6 [4194304,4194304] 0 2024-02-28T16:27:16.811 INFO:tasks.workunit.client.1.smithi157.stdout:5/959: unlink d0/d9/d47/l4a 0 2024-02-28T16:27:16.813 INFO:tasks.workunit.client.1.smithi157.stdout:0/935: read - d1/da/d7d/d98/f124 zero size 2024-02-28T16:27:16.816 INFO:tasks.workunit.client.1.smithi157.stdout:5/960: readlink d0/d9/d47/d5b/l6e 0 2024-02-28T16:27:16.819 INFO:tasks.workunit.client.1.smithi157.stdout:6/853: truncate d2/d7/d8/da/d31/dd6/fdb 961218 0 2024-02-28T16:27:16.820 INFO:tasks.workunit.client.1.smithi157.stdout:3/835: mkdir d0/d6/d34/d80/d23/d116 0 2024-02-28T16:27:16.822 INFO:tasks.workunit.client.1.smithi157.stdout:9/850: creat d0/d36/d116/f123 x:0 0 0 2024-02-28T16:27:16.823 INFO:tasks.workunit.client.1.smithi157.stdout:9/851: stat d0/d36/c73 0 2024-02-28T16:27:16.824 INFO:tasks.workunit.client.1.smithi157.stdout:3/836: chown d0/d6/d6b/d9e/fa0 4042 1 2024-02-28T16:27:16.824 INFO:tasks.workunit.client.1.smithi157.stdout:5/961: mknod d0/d9/d47/d5b/d89/d75/c147 0 2024-02-28T16:27:16.825 INFO:tasks.workunit.client.1.smithi157.stdout:9/852: dread - d0/d19/df7/f10b zero size 2024-02-28T16:27:16.826 INFO:tasks.workunit.client.1.smithi157.stdout:8/882: dwrite d1/d5/d23/d53/dc1/f12b [0,4194304] 0 2024-02-28T16:27:16.840 INFO:tasks.workunit.client.1.smithi157.stdout:5/962: unlink d0/d9/d47/d5b/dd9/l122 0 2024-02-28T16:27:16.841 INFO:tasks.workunit.client.1.smithi157.stdout:3/837: dread - d0/d6/d44/d70/d71/d87/fb9 zero size 2024-02-28T16:27:16.845 INFO:tasks.workunit.client.1.smithi157.stdout:7/918: write df/d1f/f7e [29010,38809] 0 2024-02-28T16:27:16.850 INFO:tasks.workunit.client.1.smithi157.stdout:1/909: dwrite d10/d11/d3a/d5c/d6c/d7b/fdd [0,4194304] 0 2024-02-28T16:27:16.855 INFO:tasks.workunit.client.1.smithi157.stdout:4/898: dwrite d3/fbe [0,4194304] 0 2024-02-28T16:27:16.860 INFO:tasks.workunit.client.1.smithi157.stdout:3/838: fsync d0/d6/f5f 0 2024-02-28T16:27:16.860 INFO:tasks.workunit.client.1.smithi157.stdout:5/963: mknod d0/d9/d47/d10e/c148 0 2024-02-28T16:27:16.861 INFO:tasks.workunit.client.1.smithi157.stdout:8/883: link d1/d5/d23/da1/lc2 d1/d5/d23/d53/dce/l132 0 2024-02-28T16:27:16.868 INFO:tasks.workunit.client.1.smithi157.stdout:9/853: dwrite d0/d36/daa/fd1 [0,4194304] 0 2024-02-28T16:27:16.873 INFO:tasks.workunit.client.1.smithi157.stdout:1/910: creat d10/d11/d22/f128 x:0 0 0 2024-02-28T16:27:16.873 INFO:tasks.workunit.client.1.smithi157.stdout:4/899: mkdir d3/da/d37/d84/d9a/df8/db0/db4/dfc/d126 0 2024-02-28T16:27:16.875 INFO:tasks.workunit.client.1.smithi157.stdout:6/854: dwrite d2/d17/f1e [0,4194304] 0 2024-02-28T16:27:16.885 INFO:tasks.workunit.client.1.smithi157.stdout:8/884: rename d1/d5/d23/da1/fa2 to d1/d5/d23/dbd/dc9/f133 0 2024-02-28T16:27:16.888 INFO:tasks.workunit.client.1.smithi157.stdout:4/900: creat d3/da/d1f/d22/f127 x:0 0 0 2024-02-28T16:27:16.895 INFO:tasks.workunit.client.1.smithi157.stdout:1/911: link d10/d11/l66 d10/d11/d3a/d5c/d6a/db4/l129 0 2024-02-28T16:27:16.898 INFO:tasks.workunit.client.1.smithi157.stdout:5/964: rename d0/d9/d47/dad/db4/cf6 to d0/d9/d47/d5b/dd9/c149 0 2024-02-28T16:27:16.904 INFO:tasks.workunit.client.1.smithi157.stdout:3/839: dwrite d0/d6/d44/fe0 [0,4194304] 0 2024-02-28T16:27:16.915 INFO:tasks.workunit.client.1.smithi157.stdout:6/855: truncate d2/f35 84260 0 2024-02-28T16:27:16.916 INFO:tasks.workunit.client.1.smithi157.stdout:9/854: getdents d0/d36/d37/d40/d5b/dba/dfe 0 2024-02-28T16:27:16.917 INFO:tasks.workunit.client.1.smithi157.stdout:1/912: creat d10/d11/d31/d2a/dfc/f12a x:0 0 0 2024-02-28T16:27:16.920 INFO:tasks.workunit.client.1.smithi157.stdout:6/856: fsync d2/d7/d8/f68 0 2024-02-28T16:27:16.922 INFO:tasks.workunit.client.1.smithi157.stdout:0/936: sync 2024-02-28T16:27:16.923 INFO:tasks.workunit.client.1.smithi157.stdout:4/901: link d3/da/d48/d4a/db7/l10d d3/dcc/l128 0 2024-02-28T16:27:16.927 INFO:tasks.workunit.client.1.smithi157.stdout:5/965: link d0/f2e d0/d30/def/d51/f14a 0 2024-02-28T16:27:16.928 INFO:tasks.workunit.client.1.smithi157.stdout:9/855: mkdir d0/d36/d37/d4d/d92/d108/d124 0 2024-02-28T16:27:16.931 INFO:tasks.workunit.client.1.smithi157.stdout:1/913: write d10/d11/d31/d7f/ff9 [3173082,77132] 0 2024-02-28T16:27:16.934 INFO:tasks.workunit.client.1.smithi157.stdout:7/919: dwrite df/d1f/d24/d38/f70 [0,4194304] 0 2024-02-28T16:27:16.937 INFO:tasks.workunit.client.1.smithi157.stdout:6/857: creat d2/d7/d8/da/d71/d80/f102 x:0 0 0 2024-02-28T16:27:16.940 INFO:tasks.workunit.client.1.smithi157.stdout:8/885: dwrite d1/d5/d10/f33 [0,4194304] 0 2024-02-28T16:27:16.941 INFO:tasks.workunit.client.1.smithi157.stdout:4/902: write d3/da/d37/d84/d9a/f110 [757295,28535] 0 2024-02-28T16:27:16.943 INFO:tasks.workunit.client.1.smithi157.stdout:0/937: truncate d1/d13/fe 56586 0 2024-02-28T16:27:16.948 INFO:tasks.workunit.client.1.smithi157.stdout:8/886: stat d1/d5/d43/d86/d11b 0 2024-02-28T16:27:16.948 INFO:tasks.workunit.client.1.smithi157.stdout:3/840: dwrite d0/d6/d34/d43/dac/fe8 [4194304,4194304] 0 2024-02-28T16:27:16.950 INFO:tasks.workunit.client.1.smithi157.stdout:5/966: getdents d0/d9/d3a/de5 0 2024-02-28T16:27:16.955 INFO:tasks.workunit.client.1.smithi157.stdout:4/903: creat d3/da/d37/d84/dc9/f129 x:0 0 0 2024-02-28T16:27:16.956 INFO:tasks.workunit.client.1.smithi157.stdout:3/841: unlink d0/d6/d34/fc9 0 2024-02-28T16:27:16.961 INFO:tasks.workunit.client.1.smithi157.stdout:3/842: readlink d0/d6/d44/d8e/da8/le5 0 2024-02-28T16:27:16.962 INFO:tasks.workunit.client.1.smithi157.stdout:9/856: rename d0/d36/d37/ce1 to d0/d36/d37/d40/c125 0 2024-02-28T16:27:16.966 INFO:tasks.workunit.client.1.smithi157.stdout:4/904: mknod d3/da/d37/d111/c12a 0 2024-02-28T16:27:16.968 INFO:tasks.workunit.client.1.smithi157.stdout:3/843: mkdir d0/d6/d1e/d117 0 2024-02-28T16:27:16.970 INFO:tasks.workunit.client.1.smithi157.stdout:1/914: dwrite d10/d11/d3a/d5c/d6c/d7b/f1e [4194304,4194304] 0 2024-02-28T16:27:16.972 INFO:tasks.workunit.client.1.smithi157.stdout:0/938: dwrite d1/d13/f102 [0,4194304] 0 2024-02-28T16:27:16.972 INFO:tasks.workunit.client.1.smithi157.stdout:9/857: creat d0/d36/d37/d4d/d92/db9/f126 x:0 0 0 2024-02-28T16:27:16.977 INFO:tasks.workunit.client.1.smithi157.stdout:4/905: creat d3/d77/daa/d108/f12b x:0 0 0 2024-02-28T16:27:16.981 INFO:tasks.workunit.client.1.smithi157.stdout:6/858: dread d2/d7/d8/da/f8e [0,4194304] 0 2024-02-28T16:27:16.985 INFO:tasks.workunit.client.1.smithi157.stdout:0/939: creat d1/d13/d52/db5/d8e/f13c x:0 0 0 2024-02-28T16:27:16.992 INFO:tasks.workunit.client.1.smithi157.stdout:6/859: unlink d2/d7/d8/dd4/cab 0 2024-02-28T16:27:16.996 INFO:tasks.workunit.client.1.smithi157.stdout:0/940: fsync d1/da/d7d/d98/de2/f113 0 2024-02-28T16:27:17.001 INFO:tasks.workunit.client.1.smithi157.stdout:0/941: chown d1/d13/ff 988060 1 2024-02-28T16:27:17.003 INFO:tasks.workunit.client.1.smithi157.stdout:4/906: dwrite d3/d77/daa/fc4 [0,4194304] 0 2024-02-28T16:27:17.004 INFO:tasks.workunit.client.1.smithi157.stdout:6/860: mknod d2/d7/d8/da/d4c/de9/c103 0 2024-02-28T16:27:17.007 INFO:tasks.workunit.client.1.smithi157.stdout:6/861: fsync d2/d7/d8/dd4/d8c/fe1 0 2024-02-28T16:27:17.012 INFO:tasks.workunit.client.1.smithi157.stdout:4/907: truncate d3/dcc/f104 497295 0 2024-02-28T16:27:17.013 INFO:tasks.workunit.client.1.smithi157.stdout:3/844: dwrite d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/f93 [0,4194304] 0 2024-02-28T16:27:17.017 INFO:tasks.workunit.client.1.smithi157.stdout:0/942: dread d1/da/ff1 [0,4194304] 0 2024-02-28T16:27:17.017 INFO:tasks.workunit.client.1.smithi157.stdout:6/862: creat d2/d7/d8/da/d31/d3a/dc6/f104 x:0 0 0 2024-02-28T16:27:17.017 INFO:tasks.workunit.client.1.smithi157.stdout:3/845: stat d0/d6/d44/d70/d71/d87/dd1/d9d/fa4 0 2024-02-28T16:27:17.018 INFO:tasks.workunit.client.1.smithi157.stdout:1/915: dread d10/d11/d3a/d5c/d6c/d7b/f5e [0,4194304] 0 2024-02-28T16:27:17.019 INFO:tasks.workunit.client.1.smithi157.stdout:9/858: dread d0/d36/d37/d4d/f51 [0,4194304] 0 2024-02-28T16:27:17.020 INFO:tasks.workunit.client.1.smithi157.stdout:0/943: write d1/da/d6c/f12d [147571,83195] 0 2024-02-28T16:27:17.055 INFO:tasks.workunit.client.1.smithi157.stdout:1/916: creat d10/d11/d31/d2a/dfc/f12b x:0 0 0 2024-02-28T16:27:17.055 INFO:tasks.workunit.client.1.smithi157.stdout:6/863: chown d2/d7/d8/da/d31/d59/l7e 253663 1 2024-02-28T16:27:17.056 INFO:tasks.workunit.client.1.smithi157.stdout:3/846: creat d0/d6/d44/d70/d71/da9/f118 x:0 0 0 2024-02-28T16:27:17.057 INFO:tasks.workunit.client.1.smithi157.stdout:9/859: creat d0/d36/d116/f127 x:0 0 0 2024-02-28T16:27:17.057 INFO:tasks.workunit.client.1.smithi157.stdout:0/944: rmdir d1/d13/d52/d7b/dcf 39 2024-02-28T16:27:17.059 INFO:tasks.workunit.client.1.smithi157.stdout:6/864: rmdir d2/d7/d38 39 2024-02-28T16:27:17.062 INFO:tasks.workunit.client.1.smithi157.stdout:3/847: symlink d0/d6/d34/d80/d23/d2b/d81/l119 0 2024-02-28T16:27:17.062 INFO:tasks.workunit.client.1.smithi157.stdout:6/865: chown d2/d7/d8/da/d71/d8f/fac 120682336 1 2024-02-28T16:27:17.063 INFO:tasks.workunit.client.1.smithi157.stdout:0/945: write d1/d13/d52/fa9 [5084371,62293] 0 2024-02-28T16:27:17.064 INFO:tasks.workunit.client.1.smithi157.stdout:0/946: dread - d1/f12b zero size 2024-02-28T16:27:17.065 INFO:tasks.workunit.client.1.smithi157.stdout:1/917: symlink d10/da0/db6/dd1/d110/l12c 0 2024-02-28T16:27:17.067 INFO:tasks.workunit.client.1.smithi157.stdout:6/866: mkdir d2/d7/de/d1b/d105 0 2024-02-28T16:27:17.067 INFO:tasks.workunit.client.1.smithi157.stdout:0/947: dread - d1/da/d7d/d98/de2/f13a zero size 2024-02-28T16:27:17.071 INFO:tasks.workunit.client.1.smithi157.stdout:3/848: rename d0/d6/f39 to d0/d6/d44/d70/d71/d87/dd1/f11a 0 2024-02-28T16:27:17.071 INFO:tasks.workunit.client.1.smithi157.stdout:1/918: truncate d10/d11/d31/d2a/dfc/f12b 583639 0 2024-02-28T16:27:17.072 INFO:tasks.workunit.client.1.smithi157.stdout:0/948: mknod d1/d8/d33/d96/d137/c13d 0 2024-02-28T16:27:17.073 INFO:tasks.workunit.client.1.smithi157.stdout:6/867: mknod d2/d7/d92/d96/c106 0 2024-02-28T16:27:17.074 INFO:tasks.workunit.client.1.smithi157.stdout:3/849: chown d0/d6/d34/d80/d23/f66 34704391 1 2024-02-28T16:27:17.075 INFO:tasks.workunit.client.1.smithi157.stdout:6/868: fsync d2/d7/d92/d9d/fed 0 2024-02-28T16:27:17.076 INFO:tasks.workunit.client.1.smithi157.stdout:0/949: mknod d1/d13/d46/c13e 0 2024-02-28T16:27:17.077 INFO:tasks.workunit.client.1.smithi157.stdout:3/850: fdatasync d0/d6/d44/d70/d71/fc5 0 2024-02-28T16:27:17.079 INFO:tasks.workunit.client.1.smithi157.stdout:6/869: mknod d2/d7/d92/c107 0 2024-02-28T16:27:17.081 INFO:tasks.workunit.client.1.smithi157.stdout:3/851: creat d0/d6/d44/d48/f11b x:0 0 0 2024-02-28T16:27:17.082 INFO:tasks.workunit.client.1.smithi157.stdout:6/870: dread - d2/d7/d8/da/d71/d8f/db4/fee zero size 2024-02-28T16:27:17.084 INFO:tasks.workunit.client.1.smithi157.stdout:9/860: dread d0/d19/d30/d78/f7e [0,4194304] 0 2024-02-28T16:27:17.085 INFO:tasks.workunit.client.1.smithi157.stdout:3/852: write d0/d6/d34/d80/d23/d2b/d2e/d7e/fcd [247396,101557] 0 2024-02-28T16:27:17.087 INFO:tasks.workunit.client.1.smithi157.stdout:9/861: write d0/d36/d3f/f101 [624812,45155] 0 2024-02-28T16:27:17.092 INFO:tasks.workunit.client.1.smithi157.stdout:3/853: rmdir d0/d6/d34/d80/d5c/d99 39 2024-02-28T16:27:17.097 INFO:tasks.workunit.client.1.smithi157.stdout:3/854: creat d0/d6/d34/d80/d23/f11c x:0 0 0 2024-02-28T16:27:17.098 INFO:tasks.workunit.client.1.smithi157.stdout:9/862: symlink d0/d36/d37/d40/l128 0 2024-02-28T16:27:17.099 INFO:tasks.workunit.client.1.smithi157.stdout:9/863: stat d0/d36/d3f/d69/f71 0 2024-02-28T16:27:17.101 INFO:tasks.workunit.client.1.smithi157.stdout:3/855: rename d0/d6/d6b/f7a to d0/d6/d44/d4b/f11d 0 2024-02-28T16:27:17.105 INFO:tasks.workunit.client.1.smithi157.stdout:3/856: symlink d0/d6/d44/d4b/da6/l11e 0 2024-02-28T16:27:17.107 INFO:tasks.workunit.client.1.smithi157.stdout:3/857: readlink d0/d6/d34/l111 0 2024-02-28T16:27:17.107 INFO:tasks.workunit.client.1.smithi157.stdout:9/864: rename d0/dc0/ff2 to d0/d36/d37/d40/d11e/dc8/f129 0 2024-02-28T16:27:17.109 INFO:tasks.workunit.client.1.smithi157.stdout:6/871: truncate d2/d17/f2a 3900458 0 2024-02-28T16:27:17.109 INFO:tasks.workunit.client.1.smithi157.stdout:0/950: dwrite d1/d8/d33/d56/f5d [0,4194304] 0 2024-02-28T16:27:17.111 INFO:tasks.workunit.client.1.smithi157.stdout:9/865: mkdir d0/d36/d37/d4d/d92/d12a 0 2024-02-28T16:27:17.112 INFO:tasks.workunit.client.1.smithi157.stdout:6/872: mkdir d2/d7/d8/da/d31/d59/d108 0 2024-02-28T16:27:17.113 INFO:tasks.workunit.client.1.smithi157.stdout:0/951: mkdir d1/d13/d52/d7b/dc1/d13f 0 2024-02-28T16:27:17.117 INFO:tasks.workunit.client.1.smithi157.stdout:7/920: sync 2024-02-28T16:27:17.121 INFO:tasks.workunit.client.1.smithi157.stdout:0/952: write d1/d13/d52/db5/ff3 [1189076,63107] 0 2024-02-28T16:27:17.123 INFO:tasks.workunit.client.1.smithi157.stdout:7/921: chown df/d1f/d37/c3d 1711 1 2024-02-28T16:27:17.124 INFO:tasks.workunit.client.1.smithi157.stdout:3/858: dwrite d0/d6/d6b/fdc [0,4194304] 0 2024-02-28T16:27:17.124 INFO:tasks.workunit.client.1.smithi157.stdout:0/953: dread - d1/da/d7d/dc4/f126 zero size 2024-02-28T16:27:17.187 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:16 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:17.202 INFO:tasks.workunit.client.1.smithi157.stdout:7/922: rename df/d25/d4e/d67 to df/d1f/d24/d4f/d72/dab/d127 0 2024-02-28T16:27:17.202 INFO:tasks.workunit.client.1.smithi157.stdout:3/859: rmdir d0/d6/d34/d80/d23/d2b/d2e/d7e/d91 39 2024-02-28T16:27:17.203 INFO:tasks.workunit.client.1.smithi157.stdout:0/954: write d1/d8/f59 [4922145,33212] 0 2024-02-28T16:27:17.209 INFO:tasks.workunit.client.1.smithi157.stdout:7/923: creat df/d25/d79/f128 x:0 0 0 2024-02-28T16:27:17.212 INFO:tasks.workunit.client.1.smithi157.stdout:7/924: fdatasync df/d1f/d24/d39/f8c 0 2024-02-28T16:27:17.215 INFO:tasks.workunit.client.1.smithi157.stdout:3/860: creat d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/f11f x:0 0 0 2024-02-28T16:27:17.215 INFO:tasks.workunit.client.1.smithi157.stdout:9/866: dwrite d0/d19/d30/f32 [8388608,4194304] 0 2024-02-28T16:27:17.219 INFO:tasks.workunit.client.1.smithi157.stdout:3/861: readlink d0/d6/d44/l55 0 2024-02-28T16:27:17.220 INFO:tasks.workunit.client.1.smithi157.stdout:7/925: mknod df/d40/c129 0 2024-02-28T16:27:17.242 INFO:tasks.workunit.client.1.smithi157.stdout:3/862: mkdir d0/d6/d34/d80/d23/d2b/d81/dfc/d120 0 2024-02-28T16:27:17.250 INFO:tasks.workunit.client.1.smithi157.stdout:7/926: truncate df/d1f/d24/d4f/d72/fd7 3948638 0 2024-02-28T16:27:17.251 INFO:tasks.workunit.client.1.smithi157.stdout:9/867: getdents d0/d36/d37/d40/d4b/d96 0 2024-02-28T16:27:17.252 INFO:tasks.workunit.client.1.smithi157.stdout:8/887: sync 2024-02-28T16:27:17.253 INFO:tasks.workunit.client.1.smithi157.stdout:4/908: sync 2024-02-28T16:27:17.253 INFO:tasks.workunit.client.1.smithi157.stdout:5/967: sync 2024-02-28T16:27:17.253 INFO:tasks.workunit.client.1.smithi157.stdout:3/863: mkdir d0/d6/d6b/d9e/d105/d121 0 2024-02-28T16:27:17.257 INFO:tasks.workunit.client.1.smithi157.stdout:9/868: chown d0/l66 1 1 2024-02-28T16:27:17.258 INFO:tasks.workunit.client.1.smithi157.stdout:3/864: dread - d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/f11f zero size 2024-02-28T16:27:17.259 INFO:tasks.workunit.client.1.smithi157.stdout:7/927: unlink df/d25/d4e/lad 0 2024-02-28T16:27:17.264 INFO:tasks.workunit.client.1.smithi157.stdout:8/888: symlink d1/d5/d23/d38/d67/d6d/l134 0 2024-02-28T16:27:17.266 INFO:tasks.workunit.client.1.smithi157.stdout:9/869: mkdir d0/d36/daa/d12b 0 2024-02-28T16:27:17.268 INFO:tasks.workunit.client.1.smithi157.stdout:9/870: fsync d0/d36/f63 0 2024-02-28T16:27:17.270 INFO:tasks.workunit.client.1.smithi157.stdout:5/968: rename d0/d9/d1b/c22 to d0/d9/d1b/d140/c14b 0 2024-02-28T16:27:17.278 INFO:tasks.workunit.client.1.smithi157.stdout:4/909: dwrite d3/da/d1f/d22/f10e [0,4194304] 0 2024-02-28T16:27:17.280 INFO:tasks.workunit.client.1.smithi157.stdout:4/910: fsync d3/f5f 0 2024-02-28T16:27:17.282 INFO:tasks.workunit.client.1.smithi157.stdout:4/911: chown d3/da/d37/d84/dc9/ff2 750 1 2024-02-28T16:27:17.287 INFO:tasks.workunit.client.1.smithi157.stdout:8/889: symlink d1/d5/l135 0 2024-02-28T16:27:17.288 INFO:tasks.workunit.client.1.smithi157.stdout:4/912: fdatasync d3/d77/daa/fae 0 2024-02-28T16:27:17.290 INFO:tasks.workunit.client.1.smithi157.stdout:9/871: dwrite d0/d36/d37/f43 [0,4194304] 0 2024-02-28T16:27:17.291 INFO:tasks.workunit.client.1.smithi157.stdout:4/913: readlink d3/da/d37/d84/d9a/lf6 0 2024-02-28T16:27:17.292 INFO:tasks.workunit.client.1.smithi157.stdout:5/969: mkdir d0/d30/def/d51/d14c 0 2024-02-28T16:27:17.304 INFO:tasks.workunit.client.1.smithi157.stdout:3/865: dread d0/d6/d1e/f76 [0,4194304] 0 2024-02-28T16:27:17.307 INFO:tasks.workunit.client.1.smithi157.stdout:7/928: getdents df/d1f/d24/d4f/d72/dab/d10f 0 2024-02-28T16:27:17.308 INFO:tasks.workunit.client.1.smithi157.stdout:9/872: symlink d0/d19/d30/d79/d10e/l12c 0 2024-02-28T16:27:17.313 INFO:tasks.workunit.client.1.smithi157.stdout:3/866: creat d0/d6/d34/d80/d23/d2b/d81/f122 x:0 0 0 2024-02-28T16:27:17.314 INFO:tasks.workunit.client.1.smithi157.stdout:9/873: write d0/dc0/fed [4023967,63282] 0 2024-02-28T16:27:17.316 INFO:tasks.workunit.client.1.smithi157.stdout:4/914: write d3/da/f4f [123305,78232] 0 2024-02-28T16:27:17.322 INFO:tasks.workunit.client.1.smithi157.stdout:9/874: mkdir d0/d12d 0 2024-02-28T16:27:17.325 INFO:tasks.workunit.client.1.smithi157.stdout:3/867: unlink d0/d6/d34/d80/d5c/ce6 0 2024-02-28T16:27:17.327 INFO:tasks.workunit.client.1.smithi157.stdout:8/890: dread d1/d5/d43/d86/d96/f75 [0,4194304] 0 2024-02-28T16:27:17.329 INFO:tasks.workunit.client.1.smithi157.stdout:5/970: dwrite d0/d9/d1b/d36/fb0 [0,4194304] 0 2024-02-28T16:27:17.332 INFO:tasks.workunit.client.1.smithi157.stdout:7/929: dwrite df/d1f/d24/d39/fd4 [4194304,4194304] 0 2024-02-28T16:27:17.333 INFO:tasks.workunit.client.1.smithi157.stdout:3/868: creat d0/d6/d6b/d9e/d105/f123 x:0 0 0 2024-02-28T16:27:17.336 INFO:tasks.workunit.client.1.smithi157.stdout:7/930: chown df/d1f/d24/d39 70265 1 2024-02-28T16:27:17.336 INFO:tasks.workunit.client.1.smithi157.stdout:4/915: truncate d3/f16 3613136 0 2024-02-28T16:27:17.339 INFO:tasks.workunit.client.1.smithi157.stdout:7/931: write df/d1f/d24/f33 [9275395,97182] 0 2024-02-28T16:27:17.339 INFO:tasks.workunit.client.1.smithi157.stdout:8/891: creat d1/d5/d10/f136 x:0 0 0 2024-02-28T16:27:17.340 INFO:tasks.workunit.client.1.smithi157.stdout:8/892: fdatasync d1/fea 0 2024-02-28T16:27:17.342 INFO:tasks.workunit.client.1.smithi157.stdout:7/932: read df/d1f/d24/d38/f70 [3867188,42945] 0 2024-02-28T16:27:17.344 INFO:tasks.workunit.client.1.smithi157.stdout:3/869: creat d0/d6/d34/d80/d23/d2b/d6d/f124 x:0 0 0 2024-02-28T16:27:17.354 INFO:tasks.workunit.client.1.smithi157.stdout:8/893: mknod d1/d5/d4d/dd6/ddb/c137 0 2024-02-28T16:27:17.358 INFO:tasks.workunit.client.1.smithi157.stdout:7/933: rmdir df/d1f/d24/d39/d64 39 2024-02-28T16:27:17.358 INFO:tasks.workunit.client.1.smithi157.stdout:9/875: dread d0/d36/d37/d4d/d92/db9/fc7 [4194304,4194304] 0 2024-02-28T16:27:17.362 INFO:tasks.workunit.client.1.smithi157.stdout:5/971: dread d0/d30/def/d7e/d82/fc3 [0,4194304] 0 2024-02-28T16:27:17.370 INFO:tasks.workunit.client.1.smithi157.stdout:4/916: creat d3/da/d1f/f12c x:0 0 0 2024-02-28T16:27:17.370 INFO:tasks.workunit.client.1.smithi157.stdout:3/870: write d0/d6/d1e/f76 [2235269,63811] 0 2024-02-28T16:27:17.372 INFO:tasks.workunit.client.1.smithi157.stdout:5/972: stat d0/d9/d1b/c3b 0 2024-02-28T16:27:17.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:16 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:17.374 INFO:tasks.workunit.client.1.smithi157.stdout:1/919: sync 2024-02-28T16:27:17.375 INFO:tasks.workunit.client.1.smithi157.stdout:9/876: mkdir d0/d19/d30/d78/df1/d12e 0 2024-02-28T16:27:17.377 INFO:tasks.workunit.client.1.smithi157.stdout:4/917: mkdir d3/da/d37/d84/d9a/df8/d12d 0 2024-02-28T16:27:17.379 INFO:tasks.workunit.client.1.smithi157.stdout:1/920: creat d10/d11/d3a/d5c/f12d x:0 0 0 2024-02-28T16:27:17.384 INFO:tasks.workunit.client.1.smithi157.stdout:7/934: dread f8 [0,4194304] 0 2024-02-28T16:27:17.384 INFO:tasks.workunit.client.1.smithi157.stdout:5/973: symlink d0/d9/d133/d13b/l14d 0 2024-02-28T16:27:17.389 INFO:tasks.workunit.client.1.smithi157.stdout:3/871: write d0/d6/d1e/f1f [2913120,123778] 0 2024-02-28T16:27:17.389 INFO:tasks.workunit.client.1.smithi157.stdout:1/921: rename d10/d11/d3a/d5c/d6c/d7b/d8c/d115 to d10/d11/d22/d99/dab/d12e 0 2024-02-28T16:27:17.391 INFO:tasks.workunit.client.1.smithi157.stdout:3/872: chown d0/d6/d44/d70/d71/d87/fb9 2 1 2024-02-28T16:27:17.394 INFO:tasks.workunit.client.1.smithi157.stdout:8/894: dread d1/d5/d4d/f88 [0,4194304] 0 2024-02-28T16:27:17.396 INFO:tasks.workunit.client.1.smithi157.stdout:4/918: dwrite d3/da/d37/d84/d9a/f110 [0,4194304] 0 2024-02-28T16:27:17.398 INFO:tasks.workunit.client.1.smithi157.stdout:7/935: mknod df/d1f/d24/d4f/d72/dab/d127/c12a 0 2024-02-28T16:27:17.403 INFO:tasks.workunit.client.1.smithi157.stdout:3/873: mknod d0/d6/d34/d80/d23/d2b/c125 0 2024-02-28T16:27:17.406 INFO:tasks.workunit.client.1.smithi157.stdout:5/974: creat d0/d9/d47/dad/deb/d129/f14e x:0 0 0 2024-02-28T16:27:17.407 INFO:tasks.workunit.client.1.smithi157.stdout:9/877: dwrite d0/d36/d37/d4d/d92/db9/fc7 [0,4194304] 0 2024-02-28T16:27:17.434 INFO:tasks.workunit.client.1.smithi157.stdout:5/975: link d0/d9/d47/f4f d0/d9/d3a/d11d/f14f 0 2024-02-28T16:27:17.438 INFO:tasks.workunit.client.1.smithi157.stdout:3/874: link d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/fb6 d0/d6/d6b/d9e/d105/f126 0 2024-02-28T16:27:17.438 INFO:tasks.workunit.client.1.smithi157.stdout:8/895: dwrite d1/d5/d4d/d60/f77 [0,4194304] 0 2024-02-28T16:27:17.439 INFO:tasks.workunit.client.1.smithi157.stdout:9/878: rename d0/d19/l2c to d0/d36/d37/d40/d4b/d96/l12f 0 2024-02-28T16:27:17.444 INFO:tasks.workunit.client.1.smithi157.stdout:3/875: unlink d0/d6/d34/d80/d23/l30 0 2024-02-28T16:27:17.444 INFO:tasks.workunit.client.1.smithi157.stdout:8/896: fsync d1/d5/dd8/d52/fab 0 2024-02-28T16:27:17.446 INFO:tasks.workunit.client.1.smithi157.stdout:7/936: link df/d1f/d24/c89 df/d1f/d24/d39/d64/df6/dfd/c12b 0 2024-02-28T16:27:17.451 INFO:tasks.workunit.client.1.smithi157.stdout:3/876: read d0/d6/d44/d70/d71/d87/dd1/fba [2658033,122656] 0 2024-02-28T16:27:17.455 INFO:tasks.workunit.client.1.smithi157.stdout:1/922: dwrite d10/d11/d31/d2a/d70/f9c [0,4194304] 0 2024-02-28T16:27:17.458 INFO:tasks.workunit.client.1.smithi157.stdout:3/877: chown d0/d6/d6b/d75/dbd/de9/cf1 95996253 1 2024-02-28T16:27:17.466 INFO:tasks.workunit.client.1.smithi157.stdout:9/879: dwrite d0/d19/d30/f32 [8388608,4194304] 0 2024-02-28T16:27:17.472 INFO:tasks.workunit.client.1.smithi157.stdout:7/937: link df/d1f/d24/d4f/d72/f11f df/d1f/da1/f12c 0 2024-02-28T16:27:17.477 INFO:tasks.workunit.client.1.smithi157.stdout:6/873: sync 2024-02-28T16:27:17.477 INFO:tasks.workunit.client.1.smithi157.stdout:0/955: sync 2024-02-28T16:27:17.479 INFO:tasks.workunit.client.1.smithi157.stdout:5/976: dread d0/f34 [0,4194304] 0 2024-02-28T16:27:17.488 INFO:tasks.workunit.client.1.smithi157.stdout:9/880: unlink d0/d19/d30/d78/le5 0 2024-02-28T16:27:17.493 INFO:tasks.workunit.client.1.smithi157.stdout:9/881: dread d0/d19/f1c [0,4194304] 0 2024-02-28T16:27:17.494 INFO:tasks.workunit.client.1.smithi157.stdout:7/938: symlink df/d1f/d24/d39/df2/l12d 0 2024-02-28T16:27:17.496 INFO:tasks.workunit.client.1.smithi157.stdout:7/939: chown df/d1f/d24/d39/lcf 141 1 2024-02-28T16:27:17.499 INFO:tasks.workunit.client.1.smithi157.stdout:3/878: link d0/d6/d44/d70/cf5 d0/d6/d44/d70/d71/d87/dd1/d9d/c127 0 2024-02-28T16:27:17.502 INFO:tasks.workunit.client.1.smithi157.stdout:7/940: creat df/d25/d79/d9e/f12e x:0 0 0 2024-02-28T16:27:17.503 INFO:tasks.workunit.client.1.smithi157.stdout:0/956: mkdir d1/d13/d52/d12a/d140 0 2024-02-28T16:27:17.506 INFO:tasks.workunit.client.1.smithi157.stdout:7/941: fsync df/d1f/d24/de9/ff5 0 2024-02-28T16:27:17.507 INFO:tasks.workunit.client.1.smithi157.stdout:9/882: rename d0/d36/d37/d40/d4b/fd6 to d0/d36/d37/d4d/f130 0 2024-02-28T16:27:17.510 INFO:tasks.workunit.client.1.smithi157.stdout:5/977: dread d0/f2f [0,4194304] 0 2024-02-28T16:27:17.511 INFO:tasks.workunit.client.1.smithi157.stdout:6/874: dwrite d2/d7/d8/dd4/d66/fd3 [0,4194304] 0 2024-02-28T16:27:17.512 INFO:tasks.workunit.client.1.smithi157.stdout:0/957: mkdir d1/d8/d33/d96/d137/d141 0 2024-02-28T16:27:17.512 INFO:tasks.workunit.client.1.smithi157.stdout:6/875: read - d2/d17/fea zero size 2024-02-28T16:27:17.522 INFO:tasks.workunit.client.1.smithi157.stdout:5/978: symlink d0/d9/d133/l150 0 2024-02-28T16:27:17.524 INFO:tasks.workunit.client.1.smithi157.stdout:3/879: write d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/fb6 [549390,101532] 0 2024-02-28T16:27:17.529 INFO:tasks.workunit.client.1.smithi157.stdout:6/876: rmdir d2/d7/d8/da/d31/d37/d2b/d99 39 2024-02-28T16:27:17.530 INFO:tasks.workunit.client.1.smithi157.stdout:6/877: stat d2/d7/d8/da/d31/d59/dae 0 2024-02-28T16:27:17.530 INFO:tasks.workunit.client.1.smithi157.stdout:9/883: mkdir d0/dc0/d131 0 2024-02-28T16:27:17.532 INFO:tasks.workunit.client.1.smithi157.stdout:9/884: dread - d0/d36/d37/d40/d5b/fd7 zero size 2024-02-28T16:27:17.532 INFO:tasks.workunit.client.1.smithi157.stdout:3/880: mkdir d0/d6/d34/d80/d23/d2b/d2e/d128 0 2024-02-28T16:27:17.534 INFO:tasks.workunit.client.1.smithi157.stdout:7/942: rmdir df/d1f/da1/d124 0 2024-02-28T16:27:17.537 INFO:tasks.workunit.client.1.smithi157.stdout:6/878: write d2/d7/d38/f97 [3140535,102628] 0 2024-02-28T16:27:17.537 INFO:tasks.workunit.client.1.smithi157.stdout:0/958: creat d1/d8/d33/f142 x:0 0 0 2024-02-28T16:27:17.539 INFO:tasks.workunit.client.1.smithi157.stdout:0/959: readlink d1/d13/d52/d7b/dc1/l100 0 2024-02-28T16:27:17.539 INFO:tasks.workunit.client.1.smithi157.stdout:5/979: mknod d0/d9/d47/d5b/c151 0 2024-02-28T16:27:17.543 INFO:tasks.workunit.client.1.smithi157.stdout:6/879: creat d2/d7/d92/d9d/f109 x:0 0 0 2024-02-28T16:27:17.548 INFO:tasks.workunit.client.1.smithi157.stdout:5/980: creat d0/d9/d1b/d140/f152 x:0 0 0 2024-02-28T16:27:17.549 INFO:tasks.workunit.client.1.smithi157.stdout:5/981: dread - d0/d9/d3a/f12e zero size 2024-02-28T16:27:17.559 INFO:tasks.workunit.client.1.smithi157.stdout:3/881: link d0/d6/d34/d80/d23/d2b/d81/f122 d0/d6/d34/d80/d23/d2b/d81/dfc/f129 0 2024-02-28T16:27:17.561 INFO:tasks.workunit.client.1.smithi157.stdout:6/880: creat d2/d7/d8/da/d71/d93/f10a x:0 0 0 2024-02-28T16:27:17.564 INFO:tasks.workunit.client.1.smithi157.stdout:7/943: write df/d1f/d24/d4f/d72/f109 [3269702,102737] 0 2024-02-28T16:27:17.566 INFO:tasks.workunit.client.1.smithi157.stdout:3/882: fsync d0/d6/d34/d80/d23/d2b/fb8 0 2024-02-28T16:27:17.567 INFO:tasks.workunit.client.1.smithi157.stdout:5/982: symlink d0/d30/da0/dd5/d115/l153 0 2024-02-28T16:27:17.568 INFO:tasks.workunit.client.1.smithi157.stdout:9/885: dread d0/d36/d37/d4d/d92/fa6 [0,4194304] 0 2024-02-28T16:27:17.568 INFO:tasks.workunit.client.1.smithi157.stdout:6/881: symlink d2/d7/de/d1b/d4d/d6c/d9a/l10b 0 2024-02-28T16:27:17.569 INFO:tasks.workunit.client.1.smithi157.stdout:0/960: link d1/d13/d57/cdc d1/d13/d46/c143 0 2024-02-28T16:27:17.570 INFO:tasks.workunit.client.1.smithi157.stdout:7/944: dread - df/d1f/d24/d39/fb6 zero size 2024-02-28T16:27:17.572 INFO:tasks.workunit.client.1.smithi157.stdout:6/882: read - d2/d17/fea zero size 2024-02-28T16:27:17.572 INFO:tasks.workunit.client.1.smithi157.stdout:5/983: creat d0/d9/d1b/d140/f154 x:0 0 0 2024-02-28T16:27:17.572 INFO:tasks.workunit.client.1.smithi157.stdout:0/961: readlink d1/d13/l97 0 2024-02-28T16:27:17.573 INFO:tasks.workunit.client.1.smithi157.stdout:9/886: write d0/d36/d37/d40/d5b/f102 [505457,94639] 0 2024-02-28T16:27:17.574 INFO:tasks.workunit.client.1.smithi157.stdout:3/883: rename d0/d6/d34/d80/d23/c45 to d0/d6/d6b/d9e/d105/c12a 0 2024-02-28T16:27:17.575 INFO:tasks.workunit.client.1.smithi157.stdout:5/984: readlink d0/d30/l7d 0 2024-02-28T16:27:17.578 INFO:tasks.workunit.client.1.smithi157.stdout:0/962: fdatasync d1/da/d7d/d98/de2/de9/dfa/f11a 0 2024-02-28T16:27:17.580 INFO:tasks.workunit.client.1.smithi157.stdout:9/887: creat d0/d36/d37/d4d/d92/d108/f132 x:0 0 0 2024-02-28T16:27:17.581 INFO:tasks.workunit.client.1.smithi157.stdout:7/945: getdents df/d25/d4e 0 2024-02-28T16:27:17.581 INFO:tasks.workunit.client.1.smithi157.stdout:5/985: symlink d0/d30/d50/l155 0 2024-02-28T16:27:17.583 INFO:tasks.workunit.client.1.smithi157.stdout:9/888: write d0/d36/d116/f123 [861253,80039] 0 2024-02-28T16:27:17.587 INFO:tasks.workunit.client.1.smithi157.stdout:7/946: symlink df/d1f/d24/d4f/d72/dab/l12f 0 2024-02-28T16:27:17.589 INFO:tasks.workunit.client.1.smithi157.stdout:5/986: unlink d0/d30/d50/d7f/f8d 0 2024-02-28T16:27:17.593 INFO:tasks.workunit.client.1.smithi157.stdout:6/883: dwrite d2/d7/d8/da/d71/d93/fa5 [0,4194304] 0 2024-02-28T16:27:17.593 INFO:tasks.workunit.client.1.smithi157.stdout:5/987: chown d0/d30/d50/d7f/fe4 15 1 2024-02-28T16:27:17.594 INFO:tasks.workunit.client.1.smithi157.stdout:3/884: dwrite d0/d6/d34/d43/fd8 [0,4194304] 0 2024-02-28T16:27:17.594 INFO:tasks.workunit.client.1.smithi157.stdout:0/963: getdents d1/d8/d33/d96/d137 0 2024-02-28T16:27:17.596 INFO:tasks.workunit.client.1.smithi157.stdout:0/964: dread d1/da/ff1 [0,4194304] 0 2024-02-28T16:27:17.596 INFO:tasks.workunit.client.1.smithi157.stdout:5/988: write d0/d30/da0/dfd/f13d [192401,69286] 0 2024-02-28T16:27:17.600 INFO:tasks.workunit.client.1.smithi157.stdout:7/947: write df/d1f/d24/d4f/d72/dab/f117 [257208,103207] 0 2024-02-28T16:27:17.600 INFO:tasks.workunit.client.1.smithi157.stdout:9/889: link d0/d19/f8d d0/dc0/f133 0 2024-02-28T16:27:17.601 INFO:tasks.workunit.client.1.smithi157.stdout:6/884: unlink d2/d7/de/d1b/d4d/d6c/f9e 0 2024-02-28T16:27:17.604 INFO:tasks.workunit.client.1.smithi157.stdout:7/948: read - df/d1f/d24/d38/f116 zero size 2024-02-28T16:27:17.604 INFO:tasks.workunit.client.1.smithi157.stdout:3/885: dread d0/d6/d6b/d9e/d105/f126 [0,4194304] 0 2024-02-28T16:27:17.605 INFO:tasks.workunit.client.1.smithi157.stdout:9/890: chown d0/d36/d3f/d69 333 1 2024-02-28T16:27:17.605 INFO:tasks.workunit.client.1.smithi157.stdout:7/949: chown df/d1f 1 1 2024-02-28T16:27:17.606 INFO:tasks.workunit.client.1.smithi157.stdout:5/989: dread d0/d30/d50/d7f/fbf [0,4194304] 0 2024-02-28T16:27:17.609 INFO:tasks.workunit.client.1.smithi157.stdout:0/965: rename d1/da/d6c/le4 to d1/d13/d52/l144 0 2024-02-28T16:27:17.611 INFO:tasks.workunit.client.1.smithi157.stdout:0/966: chown d1/da/f2f 1796 1 2024-02-28T16:27:17.613 INFO:tasks.workunit.client.1.smithi157.stdout:7/950: creat df/d1f/d24/d39/df2/f130 x:0 0 0 2024-02-28T16:27:17.614 INFO:tasks.workunit.client.1.smithi157.stdout:9/891: unlink d0/f42 0 2024-02-28T16:27:17.614 INFO:tasks.workunit.client.1.smithi157.stdout:6/885: creat d2/da0/f10c x:0 0 0 2024-02-28T16:27:17.615 INFO:tasks.workunit.client.1.smithi157.stdout:7/951: chown df/f119 27051994 1 2024-02-28T16:27:17.616 INFO:tasks.workunit.client.1.smithi157.stdout:3/886: creat d0/f12b x:0 0 0 2024-02-28T16:27:17.616 INFO:tasks.workunit.client.1.smithi157.stdout:4/919: sync 2024-02-28T16:27:17.617 INFO:tasks.workunit.client.1.smithi157.stdout:1/923: sync 2024-02-28T16:27:17.617 INFO:tasks.workunit.client.1.smithi157.stdout:5/990: symlink d0/d9/d47/d5b/l156 0 2024-02-28T16:27:17.617 INFO:tasks.workunit.client.1.smithi157.stdout:8/897: sync 2024-02-28T16:27:17.619 INFO:tasks.workunit.client.1.smithi157.stdout:0/967: mknod d1/d13/d46/d99/ddd/c145 0 2024-02-28T16:27:17.620 INFO:tasks.workunit.client.1.smithi157.stdout:6/886: mknod d2/d7/d8/da/d31/c10d 0 2024-02-28T16:27:17.620 INFO:tasks.workunit.client.1.smithi157.stdout:9/892: truncate d0/d36/d37/d4d/f130 4664947 0 2024-02-28T16:27:17.621 INFO:tasks.workunit.client.1.smithi157.stdout:0/968: read - d1/d8/f132 zero size 2024-02-28T16:27:17.621 INFO:tasks.workunit.client.1.smithi157.stdout:1/924: write d10/d11/d3a/d95/da4/dd8/f105 [720329,54469] 0 2024-02-28T16:27:17.622 INFO:tasks.workunit.client.1.smithi157.stdout:5/991: symlink d0/d30/dca/l157 0 2024-02-28T16:27:17.624 INFO:tasks.workunit.client.1.smithi157.stdout:3/887: creat d0/d6/d44/d70/f12c x:0 0 0 2024-02-28T16:27:17.624 INFO:tasks.workunit.client.1.smithi157.stdout:5/992: read - d0/d30/dca/f127 zero size 2024-02-28T16:27:17.628 INFO:tasks.workunit.client.1.smithi157.stdout:4/920: write d3/d77/f56 [8179746,78404] 0 2024-02-28T16:27:17.628 INFO:tasks.workunit.client.1.smithi157.stdout:5/993: dread - d0/d30/def/d51/f124 zero size 2024-02-28T16:27:17.628 INFO:tasks.workunit.client.1.smithi157.stdout:7/952: rename df/d25/db5/f108 to df/d1f/d24/d39/d64/f131 0 2024-02-28T16:27:17.632 INFO:tasks.workunit.client.1.smithi157.stdout:0/969: truncate d1/d13/dc9/df9/ff0 620695 0 2024-02-28T16:27:17.634 INFO:tasks.workunit.client.1.smithi157.stdout:1/925: rename d10/d11/d31/d2a/f2d to d10/d11/d7e/f12f 0 2024-02-28T16:27:17.635 INFO:tasks.workunit.client.1.smithi157.stdout:7/953: mkdir df/d25/d79/d132 0 2024-02-28T16:27:17.638 INFO:tasks.workunit.client.1.smithi157.stdout:3/888: creat d0/d6/d34/d80/d5c/d99/f12d x:0 0 0 2024-02-28T16:27:17.638 INFO:tasks.workunit.client.1.smithi157.stdout:8/898: dwrite d1/d5/d23/d38/d6e/fef [0,4194304] 0 2024-02-28T16:27:17.650 INFO:tasks.workunit.client.1.smithi157.stdout:7/954: creat df/d1f/d24/d4f/d72/dab/d10f/f133 x:0 0 0 2024-02-28T16:27:17.652 INFO:tasks.workunit.client.1.smithi157.stdout:7/955: chown df/d1f/d24/cd0 447 1 2024-02-28T16:27:17.653 INFO:tasks.workunit.client.1.smithi157.stdout:3/889: mknod d0/d6/d6b/d9e/d105/c12e 0 2024-02-28T16:27:17.656 INFO:tasks.workunit.client.1.smithi157.stdout:6/887: dwrite d2/d7/d8/da/d31/fca [0,4194304] 0 2024-02-28T16:27:17.657 INFO:tasks.workunit.client.1.smithi157.stdout:4/921: symlink d3/da/d37/d84/d9a/df8/db0/db4/dfc/d126/l12e 0 2024-02-28T16:27:17.658 INFO:tasks.workunit.client.1.smithi157.stdout:4/922: stat d3/l7f 0 2024-02-28T16:27:17.658 INFO:tasks.workunit.client.1.smithi157.stdout:6/888: dread - d2/d7/d8/dd4/d8c/fbd zero size 2024-02-28T16:27:17.660 INFO:tasks.workunit.client.1.smithi157.stdout:0/970: write d1/da/d7d/dc4/fb9 [500195,89323] 0 2024-02-28T16:27:17.660 INFO:tasks.workunit.client.1.smithi157.stdout:4/923: chown d3/da/d37/d84/d9a/df8/db0/db4/f119 12 1 2024-02-28T16:27:17.663 INFO:tasks.workunit.client.1.smithi157.stdout:1/926: mknod d10/d11/d60/d100/d127/c130 0 2024-02-28T16:27:17.664 INFO:tasks.workunit.client.1.smithi157.stdout:4/924: truncate d3/da/d1f/d22/f107 571222 0 2024-02-28T16:27:17.668 INFO:tasks.workunit.client.1.smithi157.stdout:3/890: unlink d0/d6/d34/d80/f51 0 2024-02-28T16:27:17.669 INFO:tasks.workunit.client.1.smithi157.stdout:4/925: dread d3/da/d1f/f29 [0,4194304] 0 2024-02-28T16:27:17.670 INFO:tasks.workunit.client.1.smithi157.stdout:8/899: truncate d1/d5/dd8/d52/d54/f5b 2202482 0 2024-02-28T16:27:17.672 INFO:tasks.workunit.client.1.smithi157.stdout:8/900: chown d1/d5/d14/l24 1706 1 2024-02-28T16:27:17.675 INFO:tasks.workunit.client.1.smithi157.stdout:5/994: rename d0/d9/d1b/d36/cb2 to d0/d30/def/d7e/c158 0 2024-02-28T16:27:17.677 INFO:tasks.workunit.client.1.smithi157.stdout:6/889: dwrite d2/d7/d38/f97 [0,4194304] 0 2024-02-28T16:27:17.679 INFO:tasks.workunit.client.1.smithi157.stdout:6/890: chown d2/d7/d8/dd4/d8c/fcf 431 1 2024-02-28T16:27:17.680 INFO:tasks.workunit.client.1.smithi157.stdout:3/891: mkdir d0/d6/d1e/d12f 0 2024-02-28T16:27:17.680 INFO:tasks.workunit.client.1.smithi157.stdout:4/926: truncate d3/da/d37/f49 390239 0 2024-02-28T16:27:17.681 INFO:tasks.workunit.client.1.smithi157.stdout:8/901: creat d1/d5/d43/d86/d12d/f138 x:0 0 0 2024-02-28T16:27:17.683 INFO:tasks.workunit.client.1.smithi157.stdout:8/902: chown d1/d5/f70 16493 1 2024-02-28T16:27:17.683 INFO:tasks.workunit.client.1.smithi157.stdout:1/927: link d10/f6b d10/d11/d3a/d5c/d6a/f131 0 2024-02-28T16:27:17.689 INFO:tasks.workunit.client.1.smithi157.stdout:7/956: getdents df/d1f/d37/d46 0 2024-02-28T16:27:17.690 INFO:tasks.workunit.client.1.smithi157.stdout:3/892: dread d0/d6/d44/d4b/fb1 [0,4194304] 0 2024-02-28T16:27:17.690 INFO:tasks.workunit.client.1.smithi157.stdout:8/903: write d1/d5/d10/f33 [3563113,99736] 0 2024-02-28T16:27:17.690 INFO:tasks.workunit.client.1.smithi157.stdout:5/995: symlink d0/d30/da0/d12a/l159 0 2024-02-28T16:27:17.693 INFO:tasks.workunit.client.1.smithi157.stdout:6/891: truncate d2/d7/d8/dd4/d53/f90 2394166 0 2024-02-28T16:27:17.694 INFO:tasks.workunit.client.1.smithi157.stdout:4/927: mkdir d3/da/d37/d84/dc9/df5/d12f 0 2024-02-28T16:27:17.700 INFO:tasks.workunit.client.1.smithi157.stdout:3/893: write d0/d6/d44/d48/f11b [913592,59639] 0 2024-02-28T16:27:17.701 INFO:tasks.workunit.client.1.smithi157.stdout:0/971: dread d1/d8/d33/f9e [0,4194304] 0 2024-02-28T16:27:17.703 INFO:tasks.workunit.client.1.smithi157.stdout:8/904: creat d1/d5/d14/f139 x:0 0 0 2024-02-28T16:27:17.708 INFO:tasks.workunit.client.1.smithi157.stdout:4/928: fdatasync d3/da/d37/d84/d9a/df8/db0/fca 0 2024-02-28T16:27:17.710 INFO:tasks.workunit.client.1.smithi157.stdout:0/972: chown d1/da/d6c/fa1 137475 1 2024-02-28T16:27:17.710 INFO:tasks.workunit.client.1.smithi157.stdout:1/928: dwrite d10/da0/f11f [0,4194304] 0 2024-02-28T16:27:17.710 INFO:tasks.workunit.client.1.smithi157.stdout:5/996: rename d0/d9/l44 to d0/d9/d47/d5b/d89/d75/dab/l15a 0 2024-02-28T16:27:17.721 INFO:tasks.workunit.client.1.smithi157.stdout:1/929: unlink d10/d11/d3a/d5c/c88 0 2024-02-28T16:27:17.722 INFO:tasks.workunit.client.1.smithi157.stdout:6/892: dwrite d2/f5 [0,4194304] 0 2024-02-28T16:27:17.723 INFO:tasks.workunit.client.1.smithi157.stdout:1/930: stat d10/d11/d60/fe6 0 2024-02-28T16:27:17.731 INFO:tasks.workunit.client.1.smithi157.stdout:4/929: truncate d3/da/d48/d8e/f95 2732614 0 2024-02-28T16:27:17.736 INFO:tasks.workunit.client.1.smithi157.stdout:5/997: rename d0/d9/d47/d5b/d89/d75/fc5 to d0/d9/d1b/d36/daf/f15b 0 2024-02-28T16:27:17.738 INFO:tasks.workunit.client.1.smithi157.stdout:0/973: write d1/d13/d52/db5/d64/fb7 [2143243,96724] 0 2024-02-28T16:27:17.739 INFO:tasks.workunit.client.1.smithi157.stdout:1/931: creat d10/d11/d7e/f132 x:0 0 0 2024-02-28T16:27:17.740 INFO:tasks.workunit.client.1.smithi157.stdout:0/974: fdatasync d1/da/d7d/fca 0 2024-02-28T16:27:17.741 INFO:tasks.workunit.client.1.smithi157.stdout:8/905: dread d1/f17 [0,4194304] 0 2024-02-28T16:27:17.742 INFO:tasks.workunit.client.1.smithi157.stdout:1/932: readlink d10/d11/d3a/d5c/l85 0 2024-02-28T16:27:17.746 INFO:tasks.workunit.client.1.smithi157.stdout:7/957: dread df/d25/d79/fa6 [0,4194304] 0 2024-02-28T16:27:17.748 INFO:tasks.workunit.client.1.smithi157.stdout:7/958: read - df/d1f/d24/d4f/d72/dab/dec/ff0 zero size 2024-02-28T16:27:17.748 INFO:tasks.workunit.client.1.smithi157.stdout:5/998: creat d0/d9/d47/d5b/d89/f15c x:0 0 0 2024-02-28T16:27:17.752 INFO:tasks.workunit.client.1.smithi157.stdout:3/894: truncate d0/d6/d34/d80/d5c/d99/fce 734889 0 2024-02-28T16:27:17.755 INFO:tasks.workunit.client.1.smithi157.stdout:0/975: creat d1/dd1/f146 x:0 0 0 2024-02-28T16:27:17.757 INFO:tasks.workunit.client.1.smithi157.stdout:0/976: chown d1/da/d7d/d98/f124 169661 1 2024-02-28T16:27:17.758 INFO:tasks.workunit.client.1.smithi157.stdout:8/906: mkdir d1/d5/d43/d13a 0 2024-02-28T16:27:17.759 INFO:tasks.workunit.client.1.smithi157.stdout:5/999: mkdir d0/d9/d1b/d140/d15d 0 2024-02-28T16:27:17.759 INFO:tasks.workunit.client.1.smithi157.stdout:0/977: chown d1/d13/d7f/d114/l10a 13518199 1 2024-02-28T16:27:17.760 INFO:tasks.workunit.client.1.smithi157.stdout:6/893: getdents d2/d7/d8/dd4/d8c 0 2024-02-28T16:27:17.761 INFO:tasks.workunit.client.1.smithi157.stdout:3/895: mkdir d0/d6/d34/d80/d23/d2b/d2e/d7e/d91/d130 0 2024-02-28T16:27:17.762 INFO:tasks.workunit.client.1.smithi157.stdout:1/933: symlink d10/d11/d3a/l133 0 2024-02-28T16:27:17.765 INFO:tasks.workunit.client.1.smithi157.stdout:9/893: sync 2024-02-28T16:27:17.766 INFO:tasks.workunit.client.1.smithi157.stdout:7/959: fsync df/d1f/d24/d4f/d72/f94 0 2024-02-28T16:27:17.779 INFO:tasks.workunit.client.1.smithi157.stdout:8/907: rename d1/d5/d10/f33 to d1/d5/dd8/d52/d54/dbc/f13b 0 2024-02-28T16:27:17.782 INFO:tasks.workunit.client.1.smithi157.stdout:7/960: dread df/d25/d4e/f6b [0,4194304] 0 2024-02-28T16:27:17.783 INFO:tasks.workunit.client.1.smithi157.stdout:1/934: mknod d10/d11/d31/d2a/d70/d9b/c134 0 2024-02-28T16:27:17.784 INFO:tasks.workunit.client.1.smithi157.stdout:4/930: getdents d3/da/d37/db2/d112 0 2024-02-28T16:27:17.785 INFO:tasks.workunit.client.1.smithi157.stdout:9/894: rmdir d0/dc0 39 2024-02-28T16:27:17.789 INFO:tasks.workunit.client.1.smithi157.stdout:9/895: write d0/d36/d37/d40/d5b/dba/fc9 [588340,68056] 0 2024-02-28T16:27:17.789 INFO:tasks.workunit.client.1.smithi157.stdout:0/978: creat d1/d13/d52/d53/d120/f147 x:0 0 0 2024-02-28T16:27:17.796 INFO:tasks.workunit.client.1.smithi157.stdout:6/894: dwrite d2/d7/d38/f87 [4194304,4194304] 0 2024-02-28T16:27:17.803 INFO:tasks.workunit.client.1.smithi157.stdout:1/935: dwrite d10/da0/f11f [4194304,4194304] 0 2024-02-28T16:27:17.803 INFO:tasks.workunit.client.1.smithi157.stdout:4/931: fsync d3/d77/f99 0 2024-02-28T16:27:17.805 INFO:tasks.workunit.client.1.smithi157.stdout:8/908: dread d1/d5/f16 [0,4194304] 0 2024-02-28T16:27:17.812 INFO:tasks.workunit.client.1.smithi157.stdout:3/896: fsync d0/d6/d34/d43/dac/fe8 0 2024-02-28T16:27:17.816 INFO:tasks.workunit.client.1.smithi157.stdout:3/897: readlink d0/d6/d44/l55 0 2024-02-28T16:27:17.817 INFO:tasks.workunit.client.1.smithi157.stdout:1/936: creat d10/d11/d60/d100/f135 x:0 0 0 2024-02-28T16:27:17.821 INFO:tasks.workunit.client.1.smithi157.stdout:4/932: creat d3/d77/daa/d108/f130 x:0 0 0 2024-02-28T16:27:17.823 INFO:tasks.workunit.client.1.smithi157.stdout:7/961: write df/fd1 [4129187,94215] 0 2024-02-28T16:27:17.825 INFO:tasks.workunit.client.1.smithi157.stdout:8/909: fsync d1/d5/f16 0 2024-02-28T16:27:17.825 INFO:tasks.workunit.client.1.smithi157.stdout:4/933: write d3/da/d48/d8e/fe1 [3686045,88763] 0 2024-02-28T16:27:17.830 INFO:tasks.workunit.client.1.smithi157.stdout:0/979: getdents d1/d13/d46/d99/ddd 0 2024-02-28T16:27:17.836 INFO:tasks.workunit.client.1.smithi157.stdout:4/934: mkdir d3/da/d48/d131 0 2024-02-28T16:27:17.837 INFO:tasks.workunit.client.1.smithi157.stdout:3/898: dwrite d0/d6/f5f [4194304,4194304] 0 2024-02-28T16:27:17.837 INFO:tasks.workunit.client.1.smithi157.stdout:0/980: symlink d1/d8/d33/d56/d13b/l148 0 2024-02-28T16:27:17.840 INFO:tasks.workunit.client.1.smithi157.stdout:0/981: dread - d1/d13/d46/d99/f101 zero size 2024-02-28T16:27:17.842 INFO:tasks.workunit.client.1.smithi157.stdout:6/895: write d2/d7/d8/da/d71/d80/f81 [990096,41590] 0 2024-02-28T16:27:17.843 INFO:tasks.workunit.client.1.smithi157.stdout:4/935: write d3/da/d37/d84/fad [4989714,91437] 0 2024-02-28T16:27:17.848 INFO:tasks.workunit.client.1.smithi157.stdout:9/896: dread d0/fc6 [0,4194304] 0 2024-02-28T16:27:17.851 INFO:tasks.workunit.client.1.smithi157.stdout:6/896: stat d2/d7/d8/da/d31/d37/d2b 0 2024-02-28T16:27:17.852 INFO:tasks.workunit.client.1.smithi157.stdout:4/936: symlink d3/da/d37/d84/d9a/dab/l132 0 2024-02-28T16:27:17.853 INFO:tasks.workunit.client.1.smithi157.stdout:9/897: chown d0/d36/d37/d4d/f130 179773 1 2024-02-28T16:27:17.856 INFO:tasks.workunit.client.1.smithi157.stdout:4/937: write d3/da/d37/d84/d9a/df9/f124 [96060,7471] 0 2024-02-28T16:27:17.857 INFO:tasks.workunit.client.1.smithi157.stdout:3/899: link d0/d6/d34/d80/d23/d2b/d2e/d7e/cbe d0/d6/d34/d80/d23/d2b/d81/dfc/c131 0 2024-02-28T16:27:17.861 INFO:tasks.workunit.client.1.smithi157.stdout:8/910: dread d1/d5/dd8/d52/d54/f7b [0,4194304] 0 2024-02-28T16:27:17.870 INFO:tasks.workunit.client.1.smithi157.stdout:9/898: link d0/d19/d30/d79/d10e/l12c d0/d36/d37/d4d/db5/l134 0 2024-02-28T16:27:17.877 INFO:tasks.workunit.client.1.smithi157.stdout:8/911: unlink d1/d5/dd8/fb1 0 2024-02-28T16:27:17.885 INFO:tasks.workunit.client.1.smithi157.stdout:0/982: write d1/d13/f54 [335415,54639] 0 2024-02-28T16:27:17.890 INFO:tasks.workunit.client.1.smithi157.stdout:1/937: dread d10/d11/d31/f80 [0,4194304] 0 2024-02-28T16:27:17.891 INFO:tasks.workunit.client.1.smithi157.stdout:7/962: dwrite df/d1f/d24/d39/d64/f74 [0,4194304] 0 2024-02-28T16:27:17.891 INFO:tasks.workunit.client.1.smithi157.stdout:8/912: write d1/d5/d23/d53/dc1/f12b [4173339,10296] 0 2024-02-28T16:27:17.891 INFO:tasks.workunit.client.1.smithi157.stdout:6/897: dwrite d2/d7/d8/da/d71/d93/fd8 [0,4194304] 0 2024-02-28T16:27:17.893 INFO:tasks.workunit.client.1.smithi157.stdout:0/983: fsync d1/d13/f102 0 2024-02-28T16:27:17.899 INFO:tasks.workunit.client.1.smithi157.stdout:7/963: stat df/d1f/d24/d39/d64/l87 0 2024-02-28T16:27:17.899 INFO:tasks.workunit.client.1.smithi157.stdout:6/898: chown d2/d7/d8/da/d71/d8f/l36 3953 1 2024-02-28T16:27:17.900 INFO:tasks.workunit.client.1.smithi157.stdout:8/913: fdatasync d1/d5/d23/d38/d6e/d85/f9d 0 2024-02-28T16:27:17.900 INFO:tasks.workunit.client.1.smithi157.stdout:4/938: dwrite d3/da/d1f/d22/f83 [0,4194304] 0 2024-02-28T16:27:17.905 INFO:tasks.workunit.client.1.smithi157.stdout:8/914: fdatasync d1/d5/d23/f6b 0 2024-02-28T16:27:17.908 INFO:tasks.workunit.client.1.smithi157.stdout:0/984: mknod d1/da/d7d/c149 0 2024-02-28T16:27:17.909 INFO:tasks.workunit.client.1.smithi157.stdout:7/964: dread - df/d1f/d24/de9/f100 zero size 2024-02-28T16:27:17.915 INFO:tasks.workunit.client.1.smithi157.stdout:1/938: dwrite d10/d11/f28 [0,4194304] 0 2024-02-28T16:27:17.917 INFO:tasks.workunit.client.1.smithi157.stdout:1/939: write d10/da0/f11f [367119,43508] 0 2024-02-28T16:27:17.920 INFO:tasks.workunit.client.1.smithi157.stdout:7/965: write df/d1f/d24/d38/f115 [2906,103992] 0 2024-02-28T16:27:17.926 INFO:tasks.workunit.client.1.smithi157.stdout:6/899: symlink d2/d7/d8/da/d31/d59/dae/l10e 0 2024-02-28T16:27:17.942 INFO:tasks.workunit.client.1.smithi157.stdout:0/985: unlink d1/d8/d33/d56/ld2 0 2024-02-28T16:27:17.943 INFO:tasks.workunit.client.1.smithi157.stdout:9/899: dread d0/d36/d37/d40/d5b/f102 [0,4194304] 0 2024-02-28T16:27:17.943 INFO:tasks.workunit.client.1.smithi157.stdout:3/900: dwrite d0/d6/d34/d80/d23/d2b/d81/f122 [0,4194304] 0 2024-02-28T16:27:17.945 INFO:tasks.workunit.client.1.smithi157.stdout:6/900: symlink d2/d7/d8/dd4/d8c/l10f 0 2024-02-28T16:27:17.950 INFO:tasks.workunit.client.1.smithi157.stdout:7/966: dwrite df/d1f/d24/d4f/d72/dab/d127/ff8 [0,4194304] 0 2024-02-28T16:27:17.950 INFO:tasks.workunit.client.1.smithi157.stdout:1/940: creat d10/d11/f136 x:0 0 0 2024-02-28T16:27:17.956 INFO:tasks.workunit.client.1.smithi157.stdout:3/901: mkdir d0/d6/d6b/d75/d132 0 2024-02-28T16:27:17.958 INFO:tasks.workunit.client.1.smithi157.stdout:0/986: creat d1/da/d7d/d98/de2/de9/f14a x:0 0 0 2024-02-28T16:27:17.961 INFO:tasks.workunit.client.1.smithi157.stdout:4/939: write d3/da/d37/d84/d9a/df8/db0/fd0 [939654,84347] 0 2024-02-28T16:27:17.966 INFO:tasks.workunit.client.1.smithi157.stdout:7/967: stat df/d80/l71 0 2024-02-28T16:27:17.966 INFO:tasks.workunit.client.1.smithi157.stdout:4/940: chown d3/da/d37/d84/d9a/df8/db0/db4/cbb 7 1 2024-02-28T16:27:17.967 INFO:tasks.workunit.client.1.smithi157.stdout:1/941: creat d10/d11/d3a/d5c/d6c/f137 x:0 0 0 2024-02-28T16:27:17.968 INFO:tasks.workunit.client.1.smithi157.stdout:4/941: fdatasync d3/d77/daa/d108/f130 0 2024-02-28T16:27:17.975 INFO:tasks.workunit.client.1.smithi157.stdout:3/902: rename d0/d6/d34/d80/d23/d2b to d0/d6/d44/d8e/d133 0 2024-02-28T16:27:17.983 INFO:tasks.workunit.client.1.smithi157.stdout:1/942: fdatasync f4 0 2024-02-28T16:27:17.983 INFO:tasks.workunit.client.1.smithi157.stdout:6/901: dwrite d2/d7/d92/ff1 [0,4194304] 0 2024-02-28T16:27:17.987 INFO:tasks.workunit.client.1.smithi157.stdout:4/942: unlink d3/da/d1f/d22/f7a 0 2024-02-28T16:27:17.990 INFO:tasks.workunit.client.1.smithi157.stdout:1/943: write d10/d11/d3a/d5c/d6c/fbd [348840,68506] 0 2024-02-28T16:27:17.993 INFO:tasks.workunit.client.1.smithi157.stdout:6/902: creat d2/d58/f110 x:0 0 0 2024-02-28T16:27:17.995 INFO:tasks.workunit.client.1.smithi157.stdout:7/968: dread df/f10 [0,4194304] 0 2024-02-28T16:27:18.005 INFO:tasks.workunit.client.1.smithi157.stdout:3/903: dwrite d0/d6/d44/d70/d71/da9/f118 [0,4194304] 0 2024-02-28T16:27:18.007 INFO:tasks.workunit.client.1.smithi157.stdout:9/900: dwrite d0/d19/d30/d78/f7e [0,4194304] 0 2024-02-28T16:27:18.007 INFO:tasks.workunit.client.1.smithi157.stdout:4/943: creat d3/da/d37/d84/d9a/df8/d12d/f133 x:0 0 0 2024-02-28T16:27:18.010 INFO:tasks.workunit.client.1.smithi157.stdout:7/969: write df/d4b/f101 [1199762,42200] 0 2024-02-28T16:27:18.012 INFO:tasks.workunit.client.1.smithi157.stdout:6/903: chown d2/d7/d8/da/d31/d37/d2b/d99/lfc 162673354 1 2024-02-28T16:27:18.016 INFO:tasks.workunit.client.1.smithi157.stdout:8/915: dread d1/d5/d14/f42 [0,4194304] 0 2024-02-28T16:27:18.018 INFO:tasks.workunit.client.1.smithi157.stdout:8/916: dread - d1/d5/dd8/d52/f11e zero size 2024-02-28T16:27:18.024 INFO:tasks.workunit.client.1.smithi157.stdout:1/944: dwrite f2 [0,4194304] 0 2024-02-28T16:27:18.035 INFO:tasks.workunit.client.1.smithi157.stdout:9/901: mkdir d0/dc0/d131/d135 0 2024-02-28T16:27:18.036 INFO:tasks.workunit.client.1.smithi157.stdout:3/904: mknod d0/d6/d6b/d75/df0/c134 0 2024-02-28T16:27:18.039 INFO:tasks.workunit.client.1.smithi157.stdout:1/945: chown d10/d11/d3a/d95/da4/fef 1448679825 1 2024-02-28T16:27:18.043 INFO:tasks.workunit.client.1.smithi157.stdout:3/905: read d0/fa3 [525153,58445] 0 2024-02-28T16:27:18.050 INFO:tasks.workunit.client.1.smithi157.stdout:6/904: dwrite d2/d7/de/d1b/fb5 [0,4194304] 0 2024-02-28T16:27:18.051 INFO:tasks.workunit.client.1.smithi157.stdout:7/970: dwrite df/d1f/d24/d4f/d72/f11f [0,4194304] 0 2024-02-28T16:27:18.052 INFO:tasks.workunit.client.1.smithi157.stdout:4/944: dwrite d3/dcc/fff [0,4194304] 0 2024-02-28T16:27:18.065 INFO:tasks.workunit.client.1.smithi157.stdout:7/971: dread df/d1f/d24/d39/fd4 [4194304,4194304] 0 2024-02-28T16:27:18.068 INFO:tasks.workunit.client.1.smithi157.stdout:7/972: stat df/d25/lc1 0 2024-02-28T16:27:18.076 INFO:tasks.workunit.client.1.smithi157.stdout:8/917: truncate d1/d5/d4d/f88 4870792 0 2024-02-28T16:27:18.078 INFO:tasks.workunit.client.1.smithi157.stdout:8/918: chown d1/d5/f16 0 1 2024-02-28T16:27:18.078 INFO:tasks.workunit.client.1.smithi157.stdout:9/902: fsync d0/d19/d30/f48 0 2024-02-28T16:27:18.094 INFO:tasks.workunit.client.1.smithi157.stdout:4/945: dread d3/da/d1f/d22/f10e [0,4194304] 0 2024-02-28T16:27:18.099 INFO:tasks.workunit.client.1.smithi157.stdout:0/987: sync 2024-02-28T16:27:18.099 INFO:tasks.workunit.client.1.smithi157.stdout:7/973: unlink df/d25/da7/cc9 0 2024-02-28T16:27:18.101 INFO:tasks.workunit.client.1.smithi157.stdout:0/988: write d1/da/d7d/d98/de2/f113 [882380,85735] 0 2024-02-28T16:27:18.108 INFO:tasks.workunit.client.1.smithi157.stdout:8/919: rename d1/d5/d14/l79 to d1/d5/d23/dbd/dc9/d108/l13c 0 2024-02-28T16:27:18.112 INFO:tasks.workunit.client.1.smithi157.stdout:9/903: rmdir d0/d36/d37/d40/d11e 39 2024-02-28T16:27:18.120 INFO:tasks.workunit.client.1.smithi157.stdout:6/905: dread d2/d7/de/f4e [0,4194304] 0 2024-02-28T16:27:18.121 INFO:tasks.workunit.client.1.smithi157.stdout:7/974: creat df/d1f/d24/d39/d64/f134 x:0 0 0 2024-02-28T16:27:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:17 smithi148 ceph-mon[28767]: pgmap v63: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 51 MiB/s rd, 141 MiB/s wr, 322 op/s 2024-02-28T16:27:18.124 INFO:tasks.workunit.client.1.smithi157.stdout:8/920: rename d1/d5/f16 to d1/d5/d4d/d60/f13d 0 2024-02-28T16:27:18.126 INFO:tasks.workunit.client.1.smithi157.stdout:7/975: mkdir df/d1f/d24/d39/df2/d135 0 2024-02-28T16:27:18.127 INFO:tasks.workunit.client.1.smithi157.stdout:7/976: stat l7 0 2024-02-28T16:27:18.129 INFO:tasks.workunit.client.1.smithi157.stdout:9/904: creat d0/d36/daa/dbe/d105/f136 x:0 0 0 2024-02-28T16:27:18.130 INFO:tasks.workunit.client.1.smithi157.stdout:7/977: fsync df/d1f/d24/d4f/d72/dab/dec/ff0 0 2024-02-28T16:27:18.130 INFO:tasks.workunit.client.1.smithi157.stdout:8/921: mkdir d1/d5/d43/d86/d11b/d13e 0 2024-02-28T16:27:18.134 INFO:tasks.workunit.client.1.smithi157.stdout:7/978: creat df/d4b/f136 x:0 0 0 2024-02-28T16:27:18.136 INFO:tasks.workunit.client.1.smithi157.stdout:8/922: mknod d1/d5/d23/d38/d67/d6d/c13f 0 2024-02-28T16:27:18.139 INFO:tasks.workunit.client.1.smithi157.stdout:7/979: write df/d1f/d24/d4f/d72/dab/f105 [331086,2765] 0 2024-02-28T16:27:18.140 INFO:tasks.workunit.client.1.smithi157.stdout:8/923: creat d1/d5/d43/d66/dfc/f140 x:0 0 0 2024-02-28T16:27:18.144 INFO:tasks.workunit.client.1.smithi157.stdout:3/906: dwrite d0/d6/d44/d70/d71/d87/fb9 [0,4194304] 0 2024-02-28T16:27:18.145 INFO:tasks.workunit.client.1.smithi157.stdout:0/989: dread d1/d13/d52/db5/d64/f68 [0,4194304] 0 2024-02-28T16:27:18.146 INFO:tasks.workunit.client.1.smithi157.stdout:1/946: truncate d10/d11/d3a/d5c/d6c/d7b/f5e 3037284 0 2024-02-28T16:27:18.146 INFO:tasks.workunit.client.1.smithi157.stdout:0/990: chown d1/d13/l36 38 1 2024-02-28T16:27:18.147 INFO:tasks.workunit.client.1.smithi157.stdout:3/907: readlink d0/d6/d44/d8e/da8/le5 0 2024-02-28T16:27:18.155 INFO:tasks.workunit.client.1.smithi157.stdout:7/980: dread df/d25/d79/fa6 [0,4194304] 0 2024-02-28T16:27:18.162 INFO:tasks.workunit.client.1.smithi157.stdout:3/908: rename d0/d6/d44/d70/d71/d87/fb9 to d0/d6/d1e/d12f/f135 0 2024-02-28T16:27:18.163 INFO:tasks.workunit.client.1.smithi157.stdout:7/981: write df/d1f/d24/f33 [10255356,16237] 0 2024-02-28T16:27:18.168 INFO:tasks.workunit.client.1.smithi157.stdout:4/946: dwrite d3/f13 [0,4194304] 0 2024-02-28T16:27:18.171 INFO:tasks.workunit.client.1.smithi157.stdout:7/982: creat df/d25/f137 x:0 0 0 2024-02-28T16:27:18.177 INFO:tasks.workunit.client.1.smithi157.stdout:0/991: dwrite d1/d13/d46/d99/f11c [8388608,4194304] 0 2024-02-28T16:27:18.177 INFO:tasks.workunit.client.1.smithi157.stdout:4/947: chown d3/da/d37/d84/d9a/c9e 189 1 2024-02-28T16:27:18.177 INFO:tasks.workunit.client.1.smithi157.stdout:9/905: dwrite d0/d36/d3f/f76 [0,4194304] 0 2024-02-28T16:27:18.181 INFO:tasks.workunit.client.1.smithi157.stdout:3/909: mkdir d0/d6/d44/d8e/d133/d81/dfc/d136 0 2024-02-28T16:27:18.181 INFO:tasks.workunit.client.1.smithi157.stdout:7/983: dread df/d40/f78 [0,4194304] 0 2024-02-28T16:27:18.187 INFO:tasks.workunit.client.1.smithi157.stdout:8/924: dread d1/d5/dd8/d52/d54/f5d [0,4194304] 0 2024-02-28T16:27:18.189 INFO:tasks.workunit.client.1.smithi157.stdout:1/947: dread d10/d11/d22/f62 [0,4194304] 0 2024-02-28T16:27:18.189 INFO:tasks.workunit.client.1.smithi157.stdout:8/925: stat d1/d5/d43/d66/c10a 0 2024-02-28T16:27:18.190 INFO:tasks.workunit.client.1.smithi157.stdout:8/926: fsync d1/d5/f3b 0 2024-02-28T16:27:18.193 INFO:tasks.workunit.client.1.smithi157.stdout:4/948: symlink d3/da/d1f/dc1/dde/l134 0 2024-02-28T16:27:18.193 INFO:tasks.workunit.client.1.smithi157.stdout:7/984: mknod df/c138 0 2024-02-28T16:27:18.197 INFO:tasks.workunit.client.1.smithi157.stdout:0/992: rename d1/d13/d52/d7b/f10d to d1/d8/da8/f14b 0 2024-02-28T16:27:18.198 INFO:tasks.workunit.client.1.smithi157.stdout:7/985: fsync f8 0 2024-02-28T16:27:18.200 INFO:tasks.workunit.client.1.smithi157.stdout:7/986: read df/fae [152645,3055] 0 2024-02-28T16:27:18.202 INFO:tasks.workunit.client.1.smithi157.stdout:9/906: rename d0/d36/d37/ce2 to d0/d19/d30/d79/d10e/c137 0 2024-02-28T16:27:18.204 INFO:tasks.workunit.client.1.smithi157.stdout:9/907: stat d0/d36/d37/d4d/d92 0 2024-02-28T16:27:18.206 INFO:tasks.workunit.client.1.smithi157.stdout:7/987: mknod df/d1f/d24/d4f/c139 0 2024-02-28T16:27:18.209 INFO:tasks.workunit.client.1.smithi157.stdout:4/949: rename d3/da/d1f/d22/f3c to d3/da/d37/d84/d9a/df8/db0/db4/dfc/d126/f135 0 2024-02-28T16:27:18.213 INFO:tasks.workunit.client.1.smithi157.stdout:7/988: creat df/d25/d79/d9e/f13a x:0 0 0 2024-02-28T16:27:18.214 INFO:tasks.workunit.client.1.smithi157.stdout:4/950: symlink d3/da/d48/d8e/db1/l136 0 2024-02-28T16:27:18.216 INFO:tasks.workunit.client.1.smithi157.stdout:4/951: chown d3/f33 2835251 1 2024-02-28T16:27:18.216 INFO:tasks.workunit.client.1.smithi157.stdout:0/993: dread d1/d13/d52/db5/ff3 [0,4194304] 0 2024-02-28T16:27:18.217 INFO:tasks.workunit.client.1.smithi157.stdout:0/994: chown d1/f12b 7647 1 2024-02-28T16:27:18.221 INFO:tasks.workunit.client.1.smithi157.stdout:0/995: symlink d1/d13/d52/d53/l14c 0 2024-02-28T16:27:18.226 INFO:tasks.workunit.client.1.smithi157.stdout:0/996: mkdir d1/da/d7d/d12c/d14d 0 2024-02-28T16:27:18.227 INFO:tasks.workunit.client.1.smithi157.stdout:7/989: getdents df/d1f/d24/d4f 0 2024-02-28T16:27:18.230 INFO:tasks.workunit.client.1.smithi157.stdout:7/990: rmdir df/d4b 39 2024-02-28T16:27:18.230 INFO:tasks.workunit.client.1.smithi157.stdout:9/908: dread d0/d19/f8d [0,4194304] 0 2024-02-28T16:27:18.231 INFO:tasks.workunit.client.1.smithi157.stdout:8/927: dwrite d1/d5/d23/d38/d6e/d85/f8b [0,4194304] 0 2024-02-28T16:27:18.231 INFO:tasks.workunit.client.1.smithi157.stdout:0/997: mknod d1/d13/dc9/c14e 0 2024-02-28T16:27:18.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:17 smithi157 ceph-mon[38346]: pgmap v63: 65 pgs: 65 active+clean; 3.0 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 51 MiB/s rd, 141 MiB/s wr, 322 op/s 2024-02-28T16:27:18.240 INFO:tasks.workunit.client.1.smithi157.stdout:7/991: dread df/d25/fc3 [0,4194304] 0 2024-02-28T16:27:18.243 INFO:tasks.workunit.client.1.smithi157.stdout:8/928: getdents d1/d5/d43 0 2024-02-28T16:27:18.247 INFO:tasks.workunit.client.1.smithi157.stdout:4/952: dwrite d3/da/fac [0,4194304] 0 2024-02-28T16:27:18.248 INFO:tasks.workunit.client.1.smithi157.stdout:8/929: write d1/d5/d43/d86/ff5 [556460,5699] 0 2024-02-28T16:27:18.255 INFO:tasks.workunit.client.1.smithi157.stdout:0/998: dwrite d1/d8/d33/d96/fa7 [0,4194304] 0 2024-02-28T16:27:18.265 INFO:tasks.workunit.client.1.smithi157.stdout:4/953: link d3/da/d37/d84/d9a/f110 d3/da/d37/d84/dc9/f137 0 2024-02-28T16:27:18.265 INFO:tasks.workunit.client.1.smithi157.stdout:8/930: link d1/d5/d4d/dd6/ddb/c137 d1/d5/d23/c141 0 2024-02-28T16:27:18.266 INFO:tasks.workunit.client.1.smithi157.stdout:9/909: dread d0/f21 [4194304,4194304] 0 2024-02-28T16:27:18.269 INFO:tasks.workunit.client.1.smithi157.stdout:4/954: write d3/da/d37/d84/f11e [88402,10305] 0 2024-02-28T16:27:18.271 INFO:tasks.workunit.client.1.smithi157.stdout:9/910: write d0/d36/d116/f123 [815402,13451] 0 2024-02-28T16:27:18.272 INFO:tasks.workunit.client.1.smithi157.stdout:7/992: dread df/d1f/d24/d4f/d72/f109 [0,4194304] 0 2024-02-28T16:27:18.274 INFO:tasks.workunit.client.1.smithi157.stdout:0/999: dwrite d1/da/d6c/f12d [0,4194304] 0 2024-02-28T16:27:18.281 INFO:tasks.workunit.client.1.smithi157.stdout:8/931: dread d1/d5/d14/fad [0,4194304] 0 2024-02-28T16:27:18.282 INFO:tasks.workunit.client.1.smithi157.stdout:6/906: sync 2024-02-28T16:27:18.282 INFO:tasks.workunit.client.1.smithi157.stdout:8/932: readlink d1/d5/d43/d86/lb3 0 2024-02-28T16:27:18.283 INFO:tasks.workunit.client.1.smithi157.stdout:7/993: rename df/d1f/d24/d39 to df/d25/db5/d13b 0 2024-02-28T16:27:18.287 INFO:tasks.workunit.client.1.smithi157.stdout:9/911: dread d0/d36/d37/d4d/d92/db9/fc7 [4194304,4194304] 0 2024-02-28T16:27:18.292 INFO:tasks.workunit.client.1.smithi157.stdout:4/955: truncate d3/da/d1f/dc1/dc8/dee/ffd 879468 0 2024-02-28T16:27:18.294 INFO:tasks.workunit.client.1.smithi157.stdout:4/956: write d3/da/d1f/dc1/dc8/fd4 [968149,23715] 0 2024-02-28T16:27:18.296 INFO:tasks.workunit.client.1.smithi157.stdout:4/957: readlink d3/da/d37/db2/d112/l121 0 2024-02-28T16:27:18.300 INFO:tasks.workunit.client.1.smithi157.stdout:7/994: dwrite df/d1f/d24/d4f/d72/dab/dec/ff0 [0,4194304] 0 2024-02-28T16:27:18.302 INFO:tasks.workunit.client.1.smithi157.stdout:7/995: stat df/d1f/d37/d46/l6c 0 2024-02-28T16:27:18.302 INFO:tasks.workunit.client.1.smithi157.stdout:8/933: truncate d1/d5/d23/da1/f10c 978989 0 2024-02-28T16:27:18.303 INFO:tasks.workunit.client.1.smithi157.stdout:4/958: rename d3/da/d28/l38 to d3/da/d28/l138 0 2024-02-28T16:27:18.304 INFO:tasks.workunit.client.1.smithi157.stdout:8/934: write d1/d5/d4d/d60/f77 [939020,115393] 0 2024-02-28T16:27:18.305 INFO:tasks.workunit.client.1.smithi157.stdout:6/907: truncate d2/d7/d8/da/d71/d8f/d6e/ffb 1462365 0 2024-02-28T16:27:18.307 INFO:tasks.workunit.client.1.smithi157.stdout:6/908: chown d2/d17/fea 28 1 2024-02-28T16:27:18.308 INFO:tasks.workunit.client.1.smithi157.stdout:4/959: fdatasync d3/d8b/fd9 0 2024-02-28T16:27:18.309 INFO:tasks.workunit.client.1.smithi157.stdout:6/909: read d2/d7/d8/da/d31/d59/fb9 [51481,39165] 0 2024-02-28T16:27:18.319 INFO:tasks.workunit.client.1.smithi157.stdout:6/910: dread d2/d7/d8/f56 [0,4194304] 0 2024-02-28T16:27:18.322 INFO:tasks.workunit.client.1.smithi157.stdout:8/935: truncate d1/d5/f3b 1442831 0 2024-02-28T16:27:18.323 INFO:tasks.workunit.client.1.smithi157.stdout:4/960: mknod d3/da/d37/db2/d10b/c139 0 2024-02-28T16:27:18.323 INFO:tasks.workunit.client.1.smithi157.stdout:7/996: getdents df/d25/db5/d13b/df2 0 2024-02-28T16:27:18.325 INFO:tasks.workunit.client.1.smithi157.stdout:8/936: mkdir d1/d5/dd8/d52/d54/d142 0 2024-02-28T16:27:18.326 INFO:tasks.workunit.client.1.smithi157.stdout:4/961: creat d3/d8b/f13a x:0 0 0 2024-02-28T16:27:18.327 INFO:tasks.workunit.client.1.smithi157.stdout:6/911: creat d2/d7/d8/da/d71/d8f/df9/f111 x:0 0 0 2024-02-28T16:27:18.329 INFO:tasks.workunit.client.1.smithi157.stdout:4/962: write d3/da/d37/d84/d9a/df8/db0/fca [3428210,129465] 0 2024-02-28T16:27:18.340 INFO:tasks.workunit.client.1.smithi157.stdout:7/997: write df/d25/d79/d9a/faa [918661,116549] 0 2024-02-28T16:27:18.344 INFO:tasks.workunit.client.1.smithi157.stdout:4/963: dwrite d3/d8b/fd9 [0,4194304] 0 2024-02-28T16:27:18.356 INFO:tasks.workunit.client.1.smithi157.stdout:6/912: dread d2/d7/d8/dd4/d53/d69/f7d [0,4194304] 0 2024-02-28T16:27:18.359 INFO:tasks.workunit.client.1.smithi157.stdout:8/937: dread d1/d5/dd8/d52/d54/dbc/f13b [0,4194304] 0 2024-02-28T16:27:18.361 INFO:tasks.workunit.client.1.smithi157.stdout:7/998: dwrite df/d1f/f8a [0,4194304] 0 2024-02-28T16:27:18.365 INFO:tasks.workunit.client.1.smithi157.stdout:8/938: rename d1/d5/dd8/d52/d54/ff2 to d1/d5/d4d/d60/f143 0 2024-02-28T16:27:18.369 INFO:tasks.workunit.client.1.smithi157.stdout:8/939: dread d1/d5/d10/f118 [0,4194304] 0 2024-02-28T16:27:18.379 INFO:tasks.workunit.client.1.smithi157.stdout:6/913: truncate d2/d7/d8/da/da1/fbe 3649863 0 2024-02-28T16:27:18.381 INFO:tasks.workunit.client.1.smithi157.stdout:4/964: dread d3/da/d1f/f63 [0,4194304] 0 2024-02-28T16:27:18.382 INFO:tasks.workunit.client.1.smithi157.stdout:3/910: sync 2024-02-28T16:27:18.383 INFO:tasks.workunit.client.1.smithi157.stdout:8/940: dwrite d1/d5/d23/d53/f65 [0,4194304] 0 2024-02-28T16:27:18.387 INFO:tasks.workunit.client.1.smithi157.stdout:4/965: mkdir d3/da/d37/db2/d10b/d13b 0 2024-02-28T16:27:18.387 INFO:tasks.workunit.client.1.smithi157.stdout:6/914: dread d2/fa3 [0,4194304] 0 2024-02-28T16:27:18.389 INFO:tasks.workunit.client.1.smithi157.stdout:8/941: rename d1/d5/d23/d38/d67/cd2 to d1/d5/d4d/d60/de4/c144 0 2024-02-28T16:27:18.395 INFO:tasks.workunit.client.1.smithi157.stdout:4/966: rename d3/da/d37/c92 to d3/da/d37/d84/d9a/df9/c13c 0 2024-02-28T16:27:18.399 INFO:tasks.workunit.client.1.smithi157.stdout:7/999: dwrite df/d1f/d24/de9/f100 [0,4194304] 0 2024-02-28T16:27:18.399 INFO:tasks.workunit.client.1.smithi157.stdout:8/942: creat d1/d5/d23/d38/dfb/f145 x:0 0 0 2024-02-28T16:27:18.403 INFO:tasks.workunit.client.1.smithi157.stdout:3/911: dwrite d0/d6/d44/d100/f10e [0,4194304] 0 2024-02-28T16:27:18.415 INFO:tasks.workunit.client.1.smithi157.stdout:3/912: getdents d0/d6/d6b/d9e/d105/d102 0 2024-02-28T16:27:18.416 INFO:tasks.workunit.client.1.smithi157.stdout:9/912: sync 2024-02-28T16:27:18.417 INFO:tasks.workunit.client.1.smithi157.stdout:1/948: sync 2024-02-28T16:27:18.419 INFO:tasks.workunit.client.1.smithi157.stdout:3/913: chown d0/d6/d34/d80/d23/c4a 229090 1 2024-02-28T16:27:18.423 INFO:tasks.workunit.client.1.smithi157.stdout:6/915: dread d2/d7/d8/da/d71/d93/fa5 [0,4194304] 0 2024-02-28T16:27:18.423 INFO:tasks.workunit.client.1.smithi157.stdout:8/943: dwrite d1/d5/d4d/f112 [0,4194304] 0 2024-02-28T16:27:18.424 INFO:tasks.workunit.client.1.smithi157.stdout:1/949: read d10/d11/d3a/d5c/d6a/db4/fc6 [37359,70171] 0 2024-02-28T16:27:18.424 INFO:tasks.workunit.client.1.smithi157.stdout:4/967: dwrite d3/da/f20 [4194304,4194304] 0 2024-02-28T16:27:18.426 INFO:tasks.workunit.client.1.smithi157.stdout:8/944: chown d1/lf6 6711 1 2024-02-28T16:27:18.428 INFO:tasks.workunit.client.1.smithi157.stdout:4/968: readlink d3/da/d37/d84/d9a/df8/db0/db4/dfc/l11f 0 2024-02-28T16:27:18.428 INFO:tasks.workunit.client.1.smithi157.stdout:9/913: creat d0/d36/d3f/f138 x:0 0 0 2024-02-28T16:27:18.429 INFO:tasks.workunit.client.1.smithi157.stdout:4/969: stat d3/d77/fe5 0 2024-02-28T16:27:18.430 INFO:tasks.workunit.client.1.smithi157.stdout:6/916: creat d2/d7/d8/da/d71/d8f/db4/f112 x:0 0 0 2024-02-28T16:27:18.432 INFO:tasks.workunit.client.1.smithi157.stdout:3/914: rename d0/d6/d34/d80/d5c/f7d to d0/d6/d6b/d9e/d105/d121/f137 0 2024-02-28T16:27:18.433 INFO:tasks.workunit.client.1.smithi157.stdout:1/950: symlink d10/d11/d22/d99/dbf/dd2/l138 0 2024-02-28T16:27:18.436 INFO:tasks.workunit.client.1.smithi157.stdout:9/914: symlink d0/d36/d37/d40/d4b/d96/l139 0 2024-02-28T16:27:18.437 INFO:tasks.workunit.client.1.smithi157.stdout:6/917: fsync d2/d7/de/d1b/f5d 0 2024-02-28T16:27:18.438 INFO:tasks.workunit.client.1.smithi157.stdout:4/970: dread d3/da/d48/d8e/ff0 [0,4194304] 0 2024-02-28T16:27:18.442 INFO:tasks.workunit.client.1.smithi157.stdout:9/915: mknod d0/d19/d30/c13a 0 2024-02-28T16:27:18.443 INFO:tasks.workunit.client.1.smithi157.stdout:6/918: creat d2/d58/f113 x:0 0 0 2024-02-28T16:27:18.448 INFO:tasks.workunit.client.1.smithi157.stdout:8/945: rename d1/d5/d10/c56 to d1/d5/dd8/c146 0 2024-02-28T16:27:18.449 INFO:tasks.workunit.client.1.smithi157.stdout:4/971: unlink d3/da/d37/d84/dc9/c118 0 2024-02-28T16:27:18.456 INFO:tasks.workunit.client.1.smithi157.stdout:3/915: rename d0/d6/d34/d80/d5c/fc7 to d0/d6/d44/d8e/f138 0 2024-02-28T16:27:18.457 INFO:tasks.workunit.client.1.smithi157.stdout:8/946: creat d1/d5/d23/d38/d67/f147 x:0 0 0 2024-02-28T16:27:18.458 INFO:tasks.workunit.client.1.smithi157.stdout:3/916: stat d0/d6/d44/d8e/d133/d81/f122 0 2024-02-28T16:27:18.458 INFO:tasks.workunit.client.1.smithi157.stdout:4/972: creat d3/da/d28/f13d x:0 0 0 2024-02-28T16:27:18.460 INFO:tasks.workunit.client.1.smithi157.stdout:3/917: chown d0/d6/d6b/d9e/d105/d121/f137 33347973 1 2024-02-28T16:27:18.460 INFO:tasks.workunit.client.1.smithi157.stdout:6/919: truncate d2/d7/d8/da/d71/d8f/f85 6340961 0 2024-02-28T16:27:18.463 INFO:tasks.workunit.client.1.smithi157.stdout:1/951: rename d10/d11/d22/f69 to d10/d11/d31/dcb/f139 0 2024-02-28T16:27:18.464 INFO:tasks.workunit.client.1.smithi157.stdout:8/947: mknod d1/d5/d14/c148 0 2024-02-28T16:27:18.470 INFO:tasks.workunit.client.1.smithi157.stdout:6/920: rename d2/d7/d8/da/d71/d8f/d6e/f7f to d2/d7/d8/dd4/d66/dc0/f114 0 2024-02-28T16:27:18.474 INFO:tasks.workunit.client.1.smithi157.stdout:8/948: creat d1/d5/dd8/d52/d54/f149 x:0 0 0 2024-02-28T16:27:18.477 INFO:tasks.workunit.client.1.smithi157.stdout:1/952: symlink d10/d11/d3a/l13a 0 2024-02-28T16:27:18.480 INFO:tasks.workunit.client.1.smithi157.stdout:6/921: creat d2/d58/f115 x:0 0 0 2024-02-28T16:27:18.481 INFO:tasks.workunit.client.1.smithi157.stdout:9/916: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:27:18.483 INFO:tasks.workunit.client.1.smithi157.stdout:3/918: dwrite d0/d6/d44/d48/f6e [0,4194304] 0 2024-02-28T16:27:18.489 INFO:tasks.workunit.client.1.smithi157.stdout:1/953: write d10/d11/d3a/d5c/d6c/d7b/f10d [84772,64641] 0 2024-02-28T16:27:18.489 INFO:tasks.workunit.client.1.smithi157.stdout:3/919: chown d0/d6/d44/d4b/c113 4942 1 2024-02-28T16:27:18.491 INFO:tasks.workunit.client.1.smithi157.stdout:4/973: dread d3/da/d37/db2/f125 [0,4194304] 0 2024-02-28T16:27:18.492 INFO:tasks.workunit.client.1.smithi157.stdout:4/974: chown d3/d77/daa 67027 1 2024-02-28T16:27:18.492 INFO:tasks.workunit.client.1.smithi157.stdout:9/917: creat d0/d36/d3f/d69/f13b x:0 0 0 2024-02-28T16:27:18.493 INFO:tasks.workunit.client.1.smithi157.stdout:1/954: stat d10/d11/d3a/d5c/d6c/d7b 0 2024-02-28T16:27:18.495 INFO:tasks.workunit.client.1.smithi157.stdout:4/975: chown d3/f5f 599080 1 2024-02-28T16:27:18.497 INFO:tasks.workunit.client.1.smithi157.stdout:9/918: chown d0/d36/d37/d40/d4b/d96/fda 704076 1 2024-02-28T16:27:18.498 INFO:tasks.workunit.client.1.smithi157.stdout:3/920: dread d0/d6/d6b/d9e/d105/f126 [0,4194304] 0 2024-02-28T16:27:18.499 INFO:tasks.workunit.client.1.smithi157.stdout:1/955: fsync d10/d11/d3a/d5c/d6a/db4/d91/d113/f117 0 2024-02-28T16:27:18.499 INFO:tasks.workunit.client.1.smithi157.stdout:4/976: write d3/da/d37/fa0 [1890530,127410] 0 2024-02-28T16:27:18.503 INFO:tasks.workunit.client.1.smithi157.stdout:4/977: stat d3/da/d37/d111 0 2024-02-28T16:27:18.503 INFO:tasks.workunit.client.1.smithi157.stdout:8/949: rename d1/d5/d4d/d60/de4 to d1/d5/d23/d38/d14a 0 2024-02-28T16:27:18.503 INFO:tasks.workunit.client.1.smithi157.stdout:9/919: write d0/d19/f25 [1206443,8925] 0 2024-02-28T16:27:18.505 INFO:tasks.workunit.client.1.smithi157.stdout:3/921: readlink d0/d6/d44/d8e/d133/d81/l10b 0 2024-02-28T16:27:18.508 INFO:tasks.workunit.client.1.smithi157.stdout:8/950: rmdir d1/d5/dd8/d52 39 2024-02-28T16:27:18.508 INFO:tasks.workunit.client.1.smithi157.stdout:6/922: dwrite d2/d7/d8/da/d31/dd6/fdb [0,4194304] 0 2024-02-28T16:27:18.509 INFO:tasks.workunit.client.1.smithi157.stdout:4/978: readlink d3/da/d48/d4a/db7/l10d 0 2024-02-28T16:27:18.510 INFO:tasks.workunit.client.1.smithi157.stdout:9/920: fdatasync d0/d19/d30/f54 0 2024-02-28T16:27:18.511 INFO:tasks.workunit.client.1.smithi157.stdout:6/923: fsync d2/d7/de/d1b/d4d/f62 0 2024-02-28T16:27:18.512 INFO:tasks.workunit.client.1.smithi157.stdout:1/956: rename d10/d94/f9f to d10/d11/d60/d100/d127/f13b 0 2024-02-28T16:27:18.513 INFO:tasks.workunit.client.1.smithi157.stdout:6/924: write d2/d7/f15 [1777818,71946] 0 2024-02-28T16:27:18.518 INFO:tasks.workunit.client.1.smithi157.stdout:3/922: symlink d0/d6/d6b/l139 0 2024-02-28T16:27:18.525 INFO:tasks.workunit.client.1.smithi157.stdout:9/921: mknod d0/d36/d37/d40/d4b/d96/df4/c13c 0 2024-02-28T16:27:18.527 INFO:tasks.workunit.client.1.smithi157.stdout:1/957: symlink d10/d11/d3a/d95/l13c 0 2024-02-28T16:27:18.530 INFO:tasks.workunit.client.1.smithi157.stdout:6/925: mkdir d2/d7/d92/d9d/d116 0 2024-02-28T16:27:18.530 INFO:tasks.workunit.client.1.smithi157.stdout:1/958: read d10/d11/d3a/f5f [2234655,39326] 0 2024-02-28T16:27:18.530 INFO:tasks.workunit.client.1.smithi157.stdout:8/951: truncate d1/d5/d23/d38/d6e/f87 4308619 0 2024-02-28T16:27:18.533 INFO:tasks.workunit.client.1.smithi157.stdout:9/922: write d0/d19/f8d [4206893,27800] 0 2024-02-28T16:27:18.534 INFO:tasks.workunit.client.1.smithi157.stdout:8/952: truncate d1/d5/d23/d53/dc1/fd9 483803 0 2024-02-28T16:27:18.535 INFO:tasks.workunit.client.1.smithi157.stdout:3/923: fdatasync d0/d6/f56 0 2024-02-28T16:27:18.536 INFO:tasks.workunit.client.1.smithi157.stdout:9/923: chown d0/d36/d37/d40/d4b/cb8 1525478705 1 2024-02-28T16:27:18.537 INFO:tasks.workunit.client.1.smithi157.stdout:1/959: mknod d10/d11/d31/c13d 0 2024-02-28T16:27:18.538 INFO:tasks.workunit.client.1.smithi157.stdout:3/924: rmdir d0/d6/d44/d4b/da6 39 2024-02-28T16:27:18.540 INFO:tasks.workunit.client.1.smithi157.stdout:6/926: truncate d2/d7/d8/da/da1/fbe 1717426 0 2024-02-28T16:27:18.541 INFO:tasks.workunit.client.1.smithi157.stdout:6/927: write d2/d17/fea [954205,17305] 0 2024-02-28T16:27:18.544 INFO:tasks.workunit.client.1.smithi157.stdout:9/924: rename d0/d19/d30/lbb to d0/d19/d30/d79/l13d 0 2024-02-28T16:27:18.546 INFO:tasks.workunit.client.1.smithi157.stdout:9/925: fsync d0/d36/d37/d4d/d92/db9/f126 0 2024-02-28T16:27:18.547 INFO:tasks.workunit.client.1.smithi157.stdout:4/979: dread d3/f16 [0,4194304] 0 2024-02-28T16:27:18.549 INFO:tasks.workunit.client.1.smithi157.stdout:3/925: mknod d0/d6/d44/d100/c13a 0 2024-02-28T16:27:18.551 INFO:tasks.workunit.client.1.smithi157.stdout:8/953: mkdir d1/d5/d23/d38/d6e/d85/d10e/d110/d14b 0 2024-02-28T16:27:18.553 INFO:tasks.workunit.client.1.smithi157.stdout:8/954: write d1/fea [791958,36643] 0 2024-02-28T16:27:18.559 INFO:tasks.workunit.client.1.smithi157.stdout:1/960: dwrite d10/d11/d31/d2a/d70/de8/fea [0,4194304] 0 2024-02-28T16:27:18.561 INFO:tasks.workunit.client.1.smithi157.stdout:1/961: write f2 [4317490,115583] 0 2024-02-28T16:27:18.562 INFO:tasks.workunit.client.1.smithi157.stdout:9/926: dwrite d0/d36/d37/d40/d5b/f8a [0,4194304] 0 2024-02-28T16:27:18.562 INFO:tasks.workunit.client.1.smithi157.stdout:4/980: mknod d3/da/d48/d8e/db1/c13e 0 2024-02-28T16:27:18.565 INFO:tasks.workunit.client.1.smithi157.stdout:3/926: mkdir d0/d6/d44/d8e/d133/d6d/d13b 0 2024-02-28T16:27:18.566 INFO:tasks.workunit.client.1.smithi157.stdout:4/981: fsync d3/d77/daa/fae 0 2024-02-28T16:27:18.567 INFO:tasks.workunit.client.1.smithi157.stdout:8/955: creat d1/d5/d23/da1/dd3/f14c x:0 0 0 2024-02-28T16:27:18.577 INFO:tasks.workunit.client.1.smithi157.stdout:4/982: creat d3/da/d37/d84/d9a/df8/db0/db4/f13f x:0 0 0 2024-02-28T16:27:18.579 INFO:tasks.workunit.client.1.smithi157.stdout:3/927: mkdir d0/d6/d44/d70/d71/d87/d13c 0 2024-02-28T16:27:18.580 INFO:tasks.workunit.client.1.smithi157.stdout:4/983: fsync d3/dcc/fff 0 2024-02-28T16:27:18.582 INFO:tasks.workunit.client.1.smithi157.stdout:1/962: creat d10/da0/f13e x:0 0 0 2024-02-28T16:27:18.589 INFO:tasks.workunit.client.1.smithi157.stdout:6/928: dwrite d2/d7/d8/da/d31/d3a/f2f [0,4194304] 0 2024-02-28T16:27:18.591 INFO:tasks.workunit.client.1.smithi157.stdout:9/927: dwrite d0/d36/d3f/f101 [0,4194304] 0 2024-02-28T16:27:18.593 INFO:tasks.workunit.client.1.smithi157.stdout:8/956: dwrite d1/d5/d23/d53/f120 [0,4194304] 0 2024-02-28T16:27:18.593 INFO:tasks.workunit.client.1.smithi157.stdout:1/963: truncate d10/d11/d31/d2a/d70/d9b/f111 4269077 0 2024-02-28T16:27:18.594 INFO:tasks.workunit.client.1.smithi157.stdout:9/928: chown d0/d36/d37/d4d/l5e 5 1 2024-02-28T16:27:18.594 INFO:tasks.workunit.client.1.smithi157.stdout:8/957: chown d1/d5/d43/d86/d96 13396420 1 2024-02-28T16:27:18.595 INFO:tasks.workunit.client.1.smithi157.stdout:6/929: symlink d2/d7/de/d1b/d3d/l117 0 2024-02-28T16:27:18.605 INFO:tasks.workunit.client.1.smithi157.stdout:6/930: symlink d2/d7/d8/da/d4c/l118 0 2024-02-28T16:27:18.605 INFO:tasks.workunit.client.1.smithi157.stdout:8/958: write d1/d5/d10/f18 [7183446,79619] 0 2024-02-28T16:27:18.606 INFO:tasks.workunit.client.1.smithi157.stdout:9/929: symlink d0/d36/d37/d40/d11e/dc8/l13e 0 2024-02-28T16:27:18.609 INFO:tasks.workunit.client.1.smithi157.stdout:1/964: creat d10/da0/f13f x:0 0 0 2024-02-28T16:27:18.611 INFO:tasks.workunit.client.1.smithi157.stdout:6/931: mknod d2/d7/d8/da/d71/d80/c119 0 2024-02-28T16:27:18.616 INFO:tasks.workunit.client.1.smithi157.stdout:9/930: fdatasync d0/d36/d37/d40/d11e/dc8/f129 0 2024-02-28T16:27:18.620 INFO:tasks.workunit.client.1.smithi157.stdout:6/932: mknod d2/da0/c11a 0 2024-02-28T16:27:18.622 INFO:tasks.workunit.client.1.smithi157.stdout:6/933: truncate d2/d7/d8/f68 785584 0 2024-02-28T16:27:18.626 INFO:tasks.workunit.client.1.smithi157.stdout:8/959: dwrite d1/d5/d43/d86/d96/f75 [4194304,4194304] 0 2024-02-28T16:27:18.635 INFO:tasks.workunit.client.1.smithi157.stdout:6/934: creat d2/d7/d92/d9d/f11b x:0 0 0 2024-02-28T16:27:18.636 INFO:tasks.workunit.client.1.smithi157.stdout:6/935: dread - d2/d58/f110 zero size 2024-02-28T16:27:18.640 INFO:tasks.workunit.client.1.smithi157.stdout:8/960: symlink d1/d5/d23/d38/dfb/l14d 0 2024-02-28T16:27:18.640 INFO:tasks.workunit.client.1.smithi157.stdout:6/936: mkdir d2/da0/d11c 0 2024-02-28T16:27:18.642 INFO:tasks.workunit.client.1.smithi157.stdout:8/961: dread - d1/d5/d23/dbd/dc9/d108/f123 zero size 2024-02-28T16:27:18.643 INFO:tasks.workunit.client.1.smithi157.stdout:1/965: dread d10/f1b [0,4194304] 0 2024-02-28T16:27:18.648 INFO:tasks.workunit.client.1.smithi157.stdout:9/931: truncate d0/f5 3962871 0 2024-02-28T16:27:18.648 INFO:tasks.workunit.client.1.smithi157.stdout:1/966: write d10/d11/d3a/d95/da4/fd5 [320584,47617] 0 2024-02-28T16:27:18.648 INFO:tasks.workunit.client.1.smithi157.stdout:8/962: creat d1/d5/d23/d38/d6e/d85/d10e/f14e x:0 0 0 2024-02-28T16:27:18.654 INFO:tasks.workunit.client.1.smithi157.stdout:6/937: rename d2/d7/d8/da/d31/d3a/dc6/f104 to d2/f11d 0 2024-02-28T16:27:18.660 INFO:tasks.workunit.client.1.smithi157.stdout:6/938: creat d2/d7/d8/da/d4c/f11e x:0 0 0 2024-02-28T16:27:18.662 INFO:tasks.workunit.client.1.smithi157.stdout:9/932: creat d0/d36/d37/f13f x:0 0 0 2024-02-28T16:27:18.665 INFO:tasks.workunit.client.1.smithi157.stdout:1/967: creat d10/d11/d3a/d5c/d6c/d7b/f140 x:0 0 0 2024-02-28T16:27:18.666 INFO:tasks.workunit.client.1.smithi157.stdout:6/939: mkdir d2/d7/d38/d11f 0 2024-02-28T16:27:18.669 INFO:tasks.workunit.client.1.smithi157.stdout:6/940: write d2/d7/d8/da/d31/fca [3253707,73042] 0 2024-02-28T16:27:18.671 INFO:tasks.workunit.client.1.smithi157.stdout:9/933: write d0/d36/d37/d4d/f130 [1370309,109293] 0 2024-02-28T16:27:18.671 INFO:tasks.workunit.client.1.smithi157.stdout:1/968: read d10/d11/d31/d2a/d70/fc0 [217711,24827] 0 2024-02-28T16:27:18.677 INFO:tasks.workunit.client.1.smithi157.stdout:1/969: unlink d10/d11/d31/f80 0 2024-02-28T16:27:18.677 INFO:tasks.workunit.client.1.smithi157.stdout:8/963: dread d1/d5/d10/faf [0,4194304] 0 2024-02-28T16:27:18.681 INFO:tasks.workunit.client.1.smithi157.stdout:9/934: link d0/d19/d30/d78/la9 d0/d19/d30/d78/l140 0 2024-02-28T16:27:18.682 INFO:tasks.workunit.client.1.smithi157.stdout:8/964: mkdir d1/d5/d23/dbd/dcb/d14f 0 2024-02-28T16:27:18.689 INFO:tasks.workunit.client.1.smithi157.stdout:6/941: dread d2/d7/d8/dd4/d8c/fe1 [0,4194304] 0 2024-02-28T16:27:18.690 INFO:tasks.workunit.client.1.smithi157.stdout:8/965: dread d1/d5/d23/d38/d67/d6d/f7f [0,4194304] 0 2024-02-28T16:27:18.693 INFO:tasks.workunit.client.1.smithi157.stdout:8/966: dread - d1/d5/d23/dbd/dc9/d108/f123 zero size 2024-02-28T16:27:18.697 INFO:tasks.workunit.client.1.smithi157.stdout:8/967: chown d1/d5/d23/dbd/dc9/l114 1971131822 1 2024-02-28T16:27:18.701 INFO:tasks.workunit.client.1.smithi157.stdout:9/935: dread d0/d36/d3f/f6c [4194304,4194304] 0 2024-02-28T16:27:18.702 INFO:tasks.workunit.client.1.smithi157.stdout:4/984: sync 2024-02-28T16:27:18.702 INFO:tasks.workunit.client.1.smithi157.stdout:3/928: sync 2024-02-28T16:27:18.703 INFO:tasks.workunit.client.1.smithi157.stdout:6/942: dread d2/d7/d8/da/d71/d8f/d6e/ffb [0,4194304] 0 2024-02-28T16:27:18.704 INFO:tasks.workunit.client.1.smithi157.stdout:6/943: dread - d2/f11d zero size 2024-02-28T16:27:18.704 INFO:tasks.workunit.client.1.smithi157.stdout:4/985: dread d3/dcc/f104 [0,4194304] 0 2024-02-28T16:27:18.705 INFO:tasks.workunit.client.1.smithi157.stdout:1/970: write d10/d94/fae [85705,59922] 0 2024-02-28T16:27:18.710 INFO:tasks.workunit.client.1.smithi157.stdout:8/968: link d1/d5/d23/dbd/dc9/d11f/l12c d1/d5/d23/d38/dfb/l150 0 2024-02-28T16:27:18.718 INFO:tasks.workunit.client.1.smithi157.stdout:6/944: dwrite d2/d7/d8/da/fc2 [0,4194304] 0 2024-02-28T16:27:18.723 INFO:tasks.workunit.client.1.smithi157.stdout:8/969: symlink d1/d5/d23/d38/d6e/d85/d10e/d110/l151 0 2024-02-28T16:27:18.725 INFO:tasks.workunit.client.1.smithi157.stdout:9/936: dread d0/d36/d37/d40/d4b/f6d [0,4194304] 0 2024-02-28T16:27:18.726 INFO:tasks.workunit.client.1.smithi157.stdout:4/986: write d3/da/f31 [1999121,110894] 0 2024-02-28T16:27:18.729 INFO:tasks.workunit.client.1.smithi157.stdout:1/971: write d10/d11/d7e/fda [711763,56948] 0 2024-02-28T16:27:18.731 INFO:tasks.workunit.client.1.smithi157.stdout:1/972: dread - d10/d94/ffd zero size 2024-02-28T16:27:18.732 INFO:tasks.workunit.client.1.smithi157.stdout:8/970: mknod d1/d5/d23/d53/dc1/c152 0 2024-02-28T16:27:18.733 INFO:tasks.workunit.client.1.smithi157.stdout:3/929: link d0/d6/d44/d8e/da8/le5 d0/d6/d34/d80/l13d 0 2024-02-28T16:27:18.736 INFO:tasks.workunit.client.1.smithi157.stdout:4/987: creat d3/da/d37/d84/d9a/df8/db0/f140 x:0 0 0 2024-02-28T16:27:18.736 INFO:tasks.workunit.client.1.smithi157.stdout:3/930: write d0/d6/d44/d70/d71/d87/dd1/d9d/fb2 [1870823,2232] 0 2024-02-28T16:27:18.740 INFO:tasks.workunit.client.1.smithi157.stdout:9/937: mknod d0/d36/d37/d4d/d92/d108/d124/c141 0 2024-02-28T16:27:18.747 INFO:tasks.workunit.client.1.smithi157.stdout:1/973: mkdir d10/d11/d3a/d5c/d84/d141 0 2024-02-28T16:27:18.748 INFO:tasks.workunit.client.1.smithi157.stdout:1/974: stat d10/d94/fae 0 2024-02-28T16:27:18.749 INFO:tasks.workunit.client.1.smithi157.stdout:3/931: rename d0/d6/d44/d70/d71/fc5 to d0/d6/d44/d70/d71/f13e 0 2024-02-28T16:27:18.750 INFO:tasks.workunit.client.1.smithi157.stdout:6/945: dwrite d2/d7/d8/da/d71/d8f/d6e/f79 [0,4194304] 0 2024-02-28T16:27:18.752 INFO:tasks.workunit.client.1.smithi157.stdout:4/988: rename d3/da/d1f/l97 to d3/da/d37/d84/d9a/df8/db0/db4/dfc/d126/l141 0 2024-02-28T16:27:18.755 INFO:tasks.workunit.client.1.smithi157.stdout:1/975: write d10/d11/d31/d2a/d70/f96 [915157,80379] 0 2024-02-28T16:27:18.757 INFO:tasks.workunit.client.1.smithi157.stdout:9/938: dwrite d0/f10c [0,4194304] 0 2024-02-28T16:27:18.759 INFO:tasks.workunit.client.1.smithi157.stdout:6/946: read d2/d7/de/d1b/f28 [672331,55420] 0 2024-02-28T16:27:18.760 INFO:tasks.workunit.client.1.smithi157.stdout:1/976: truncate d10/d11/d3a/d5c/f12d 1006413 0 2024-02-28T16:27:18.761 INFO:tasks.workunit.client.1.smithi157.stdout:8/971: mkdir d1/d5/dd8/d52/d54/d142/d153 0 2024-02-28T16:27:18.767 INFO:tasks.workunit.client.1.smithi157.stdout:6/947: mknod d2/d7/d8/da/d31/d3a/dc6/c120 0 2024-02-28T16:27:18.769 INFO:tasks.workunit.client.1.smithi157.stdout:4/989: unlink d3/da/d1f/dc1/dc8/dee/ffd 0 2024-02-28T16:27:18.771 INFO:tasks.workunit.client.1.smithi157.stdout:4/990: write d3/d77/daa/fae [4888975,86024] 0 2024-02-28T16:27:18.777 INFO:tasks.workunit.client.1.smithi157.stdout:1/977: rename d10/d11/d3a/d5c/d6c/d7b to d10/d11/d3a/d5c/d6a/db4/d91/d113/d142 0 2024-02-28T16:27:18.782 INFO:tasks.workunit.client.1.smithi157.stdout:6/948: dwrite d2/d7/d8/dd4/d8c/fda [0,4194304] 0 2024-02-28T16:27:18.784 INFO:tasks.workunit.client.1.smithi157.stdout:9/939: mknod d0/d36/d37/d40/d5b/dba/dfe/d11a/c142 0 2024-02-28T16:27:18.793 INFO:tasks.workunit.client.1.smithi157.stdout:8/972: dread d1/d5/d23/d38/d6e/d85/f9d [0,4194304] 0 2024-02-28T16:27:18.795 INFO:tasks.workunit.client.1.smithi157.stdout:3/932: write d0/d6/d44/d4b/f11d [295692,121262] 0 2024-02-28T16:27:18.805 INFO:tasks.workunit.client.1.smithi157.stdout:3/933: dread d0/d6/d44/d8e/d133/d2e/d7e/ffa [0,4194304] 0 2024-02-28T16:27:18.807 INFO:tasks.workunit.client.1.smithi157.stdout:3/934: write d0/d6/d1e/f76 [1902842,22935] 0 2024-02-28T16:27:18.813 INFO:tasks.workunit.client.1.smithi157.stdout:8/973: rename d1/d5/c128 to d1/d5/d10/c154 0 2024-02-28T16:27:18.816 INFO:tasks.workunit.client.1.smithi157.stdout:6/949: write d2/d7/d8/da/d71/d8f/f45 [5198215,43251] 0 2024-02-28T16:27:18.818 INFO:tasks.workunit.client.1.smithi157.stdout:6/950: readlink d2/d7/le7 0 2024-02-28T16:27:18.822 INFO:tasks.workunit.client.1.smithi157.stdout:3/935: mknod d0/c13f 0 2024-02-28T16:27:18.824 INFO:tasks.workunit.client.1.smithi157.stdout:3/936: dread - d0/d6/d6b/fd6 zero size 2024-02-28T16:27:18.825 INFO:tasks.workunit.client.1.smithi157.stdout:9/940: write d0/d36/d37/d40/f62 [5158833,50283] 0 2024-02-28T16:27:18.828 INFO:tasks.workunit.client.1.smithi157.stdout:1/978: truncate d10/d11/d31/d2a/d70/f53 3331466 0 2024-02-28T16:27:18.831 INFO:tasks.workunit.client.1.smithi157.stdout:1/979: chown d10/d11/d31/d2a/d70/d9b/f111 70 1 2024-02-28T16:27:18.835 INFO:tasks.workunit.client.1.smithi157.stdout:8/974: dread d1/f5f [0,4194304] 0 2024-02-28T16:27:18.835 INFO:tasks.workunit.client.1.smithi157.stdout:6/951: rename d2/d7/d92/d9d/d116 to d2/d7/d8/d121 0 2024-02-28T16:27:18.836 INFO:tasks.workunit.client.1.smithi157.stdout:3/937: getdents d0/d6/d44/d8e/d133/dec 0 2024-02-28T16:27:18.839 INFO:tasks.workunit.client.1.smithi157.stdout:1/980: symlink d10/d11/d3a/d5c/d84/d141/l143 0 2024-02-28T16:27:18.841 INFO:tasks.workunit.client.1.smithi157.stdout:6/952: symlink d2/d7/de/df6/l122 0 2024-02-28T16:27:18.844 INFO:tasks.workunit.client.1.smithi157.stdout:8/975: mknod d1/d5/d23/d38/d6e/d85/d10e/d110/c155 0 2024-02-28T16:27:18.848 INFO:tasks.workunit.client.1.smithi157.stdout:9/941: dwrite d0/d36/d37/d40/d4b/d96/fda [0,4194304] 0 2024-02-28T16:27:18.853 INFO:tasks.workunit.client.1.smithi157.stdout:6/953: mkdir d2/d17/d123 0 2024-02-28T16:27:18.855 INFO:tasks.workunit.client.1.smithi157.stdout:9/942: truncate d0/d36/d37/d40/d11e/dc8/f129 925463 0 2024-02-28T16:27:18.859 INFO:tasks.workunit.client.1.smithi157.stdout:6/954: write d2/d7/de/d1b/d4d/f62 [1194932,59955] 0 2024-02-28T16:27:18.863 INFO:tasks.workunit.client.1.smithi157.stdout:1/981: dwrite d10/d11/d3a/d5c/d6c/fbd [0,4194304] 0 2024-02-28T16:27:18.865 INFO:tasks.workunit.client.1.smithi157.stdout:8/976: dwrite d1/d5/d10/f136 [0,4194304] 0 2024-02-28T16:27:18.870 INFO:tasks.workunit.client.1.smithi157.stdout:9/943: readlink d0/d36/d37/d4d/d92/db9/ld8 0 2024-02-28T16:27:18.878 INFO:tasks.workunit.client.1.smithi157.stdout:9/944: write d0/d36/d37/d4d/d92/fb6 [4519638,41245] 0 2024-02-28T16:27:18.879 INFO:tasks.workunit.client.1.smithi157.stdout:1/982: dread d10/d11/d3a/d5c/d84/fe5 [0,4194304] 0 2024-02-28T16:27:18.898 INFO:tasks.workunit.client.1.smithi157.stdout:9/945: read d0/f5 [1971607,117186] 0 2024-02-28T16:27:18.903 INFO:tasks.workunit.client.1.smithi157.stdout:8/977: dwrite d1/d5/d23/da1/dd3/f14c [0,4194304] 0 2024-02-28T16:27:18.907 INFO:tasks.workunit.client.1.smithi157.stdout:1/983: rename d10/d11/d3a/d95/fd6 to d10/d11/d31/d2a/d70/f144 0 2024-02-28T16:27:18.914 INFO:tasks.workunit.client.1.smithi157.stdout:9/946: truncate d0/d36/f86 365159 0 2024-02-28T16:27:18.916 INFO:tasks.workunit.client.1.smithi157.stdout:8/978: creat d1/d5/dd8/d52/d54/dbc/f156 x:0 0 0 2024-02-28T16:27:18.920 INFO:tasks.workunit.client.1.smithi157.stdout:1/984: mkdir d10/d11/d60/d145 0 2024-02-28T16:27:18.931 INFO:tasks.workunit.client.1.smithi157.stdout:3/938: dwrite d0/d6/d44/d4b/fb1 [0,4194304] 0 2024-02-28T16:27:18.933 INFO:tasks.workunit.client.1.smithi157.stdout:9/947: dwrite d0/dc0/fed [0,4194304] 0 2024-02-28T16:27:18.934 INFO:tasks.workunit.client.1.smithi157.stdout:1/985: dread d10/d11/d31/f3d [0,4194304] 0 2024-02-28T16:27:18.934 INFO:tasks.workunit.client.1.smithi157.stdout:4/991: sync 2024-02-28T16:27:18.935 INFO:tasks.workunit.client.1.smithi157.stdout:1/986: readlink lc 0 2024-02-28T16:27:18.942 INFO:tasks.workunit.client.1.smithi157.stdout:3/939: rename d0/d6/d6b to d0/d6/d44/d8e/d133/d6d/d140 0 2024-02-28T16:27:18.944 INFO:tasks.workunit.client.1.smithi157.stdout:1/987: symlink d10/da0/db6/l146 0 2024-02-28T16:27:18.945 INFO:tasks.workunit.client.1.smithi157.stdout:4/992: symlink d3/da/d37/d84/d9a/df8/d12d/l142 0 2024-02-28T16:27:18.948 INFO:tasks.workunit.client.1.smithi157.stdout:3/940: creat d0/d6/d44/d70/d71/d87/dd1/d9d/f141 x:0 0 0 2024-02-28T16:27:18.950 INFO:tasks.workunit.client.1.smithi157.stdout:4/993: write d3/da/d37/d84/d9a/df9/f124 [937646,51758] 0 2024-02-28T16:27:18.952 INFO:tasks.workunit.client.1.smithi157.stdout:1/988: mknod d10/d11/d3a/d5c/d84/d141/c147 0 2024-02-28T16:27:18.954 INFO:tasks.workunit.client.1.smithi157.stdout:3/941: read d0/d6/d44/d8e/d133/d2e/d7e/d91/f93 [1277956,13954] 0 2024-02-28T16:27:18.958 INFO:tasks.workunit.client.1.smithi157.stdout:1/989: read - d10/d11/d31/d7f/feb zero size 2024-02-28T16:27:18.958 INFO:tasks.workunit.client.1.smithi157.stdout:4/994: mknod d3/d77/daa/d120/c143 0 2024-02-28T16:27:18.964 INFO:tasks.workunit.client.1.smithi157.stdout:1/990: mkdir d10/d11/d3a/d148 0 2024-02-28T16:27:18.971 INFO:tasks.workunit.client.1.smithi157.stdout:3/942: dread d0/d6/d1e/d12f/f135 [0,4194304] 0 2024-02-28T16:27:18.982 INFO:tasks.workunit.client.1.smithi157.stdout:1/991: creat d10/d11/d3a/d5c/d6a/db4/d91/d113/d142/f149 x:0 0 0 2024-02-28T16:27:18.982 INFO:tasks.workunit.client.1.smithi157.stdout:4/995: link d3/da/d37/d84/d9a/df8/db0/lba d3/da/d37/d84/l144 0 2024-02-28T16:27:18.982 INFO:tasks.workunit.client.1.smithi157.stdout:3/943: mknod d0/d6/d44/c142 0 2024-02-28T16:27:18.986 INFO:tasks.workunit.client.1.smithi157.stdout:1/992: readlink d10/d11/d31/d2a/d70/l4a 0 2024-02-28T16:27:18.989 INFO:tasks.workunit.client.1.smithi157.stdout:8/979: dwrite d1/d5/d14/fad [0,4194304] 0 2024-02-28T16:27:18.989 INFO:tasks.workunit.client.1.smithi157.stdout:9/948: dwrite d0/d36/d3f/f75 [0,4194304] 0 2024-02-28T16:27:18.991 INFO:tasks.workunit.client.1.smithi157.stdout:4/996: read d3/da/d28/f76 [2301279,110403] 0 2024-02-28T16:27:18.993 INFO:tasks.workunit.client.1.smithi157.stdout:6/955: sync 2024-02-28T16:27:18.993 INFO:tasks.workunit.client.1.smithi157.stdout:9/949: write d0/d36/d37/d40/f62 [4557405,50433] 0 2024-02-28T16:27:19.005 INFO:tasks.workunit.client.1.smithi157.stdout:8/980: dread d1/d5/d23/da1/dd3/f14c [0,4194304] 0 2024-02-28T16:27:19.018 INFO:tasks.workunit.client.1.smithi157.stdout:8/981: dread d1/d5/d43/d86/d96/f75 [4194304,4194304] 0 2024-02-28T16:27:19.125 INFO:tasks.workunit.client.1.smithi157.stdout:9/950: creat d0/d36/d3f/d69/f143 x:0 0 0 2024-02-28T16:27:19.134 INFO:tasks.workunit.client.1.smithi157.stdout:8/982: chown d1/d5/d14/c10d 1257591168 1 2024-02-28T16:27:19.221 INFO:tasks.workunit.client.1.smithi157.stdout:3/944: link d0/d6/d44/d8e/d133/d81/dfc/f129 d0/d6/d44/d70/d71/d87/d13c/f143 0 2024-02-28T16:27:19.222 INFO:tasks.workunit.client.1.smithi157.stdout:3/945: chown d0/d6/d1e/fe3 891 1 2024-02-28T16:27:19.224 INFO:tasks.workunit.client.1.smithi157.stdout:4/997: getdents d3/da/d37/db2/d10b/d13b 0 2024-02-28T16:27:19.238 INFO:tasks.workunit.client.1.smithi157.stdout:4/998: fdatasync d3/d77/f99 0 2024-02-28T16:27:19.243 INFO:tasks.workunit.client.1.smithi157.stdout:9/951: mkdir d0/d36/d37/d112/d144 0 2024-02-28T16:27:19.250 INFO:tasks.workunit.client.1.smithi157.stdout:9/952: mknod d0/d36/c145 0 2024-02-28T16:27:19.260 INFO:tasks.workunit.client.1.smithi157.stdout:8/983: dwrite d1/d5/f70 [0,4194304] 0 2024-02-28T16:27:19.264 INFO:tasks.workunit.client.1.smithi157.stdout:8/984: read d1/fe5 [3063410,36216] 0 2024-02-28T16:27:19.284 INFO:tasks.workunit.client.1.smithi157.stdout:9/953: dwrite d0/d36/d37/d40/f49 [0,4194304] 0 2024-02-28T16:27:19.288 INFO:tasks.workunit.client.1.smithi157.stdout:8/985: dwrite d1/d5/d23/dbd/dc9/d108/f111 [0,4194304] 0 2024-02-28T16:27:19.297 INFO:tasks.workunit.client.1.smithi157.stdout:8/986: chown d1/d5/f3b 0 1 2024-02-28T16:27:19.305 INFO:tasks.workunit.client.1.smithi157.stdout:8/987: rmdir d1/d5/d23/d38/dfb 39 2024-02-28T16:27:19.307 INFO:tasks.workunit.client.1.smithi157.stdout:8/988: chown d1/d5/d14/l24 65113031 1 2024-02-28T16:27:19.314 INFO:tasks.workunit.client.1.smithi157.stdout:8/989: rename d1/d5/d23/d38/d67/d6d/cd5 to d1/d5/d23/d53/dc1/c157 0 2024-02-28T16:27:19.319 INFO:tasks.workunit.client.1.smithi157.stdout:8/990: fdatasync d1/f2c 0 2024-02-28T16:27:19.345 INFO:tasks.workunit.client.1.smithi157.stdout:8/991: rename d1/d5/d4d/lbb to d1/d5/d23/d38/d67/d6d/l158 0 2024-02-28T16:27:19.346 INFO:tasks.workunit.client.1.smithi157.stdout:3/946: write d0/d6/d44/d8e/d133/fd5 [2670320,13390] 0 2024-02-28T16:27:19.348 INFO:tasks.workunit.client.1.smithi157.stdout:8/992: write d1/d5/d4d/f112 [2363653,91135] 0 2024-02-28T16:27:19.349 INFO:tasks.workunit.client.1.smithi157.stdout:1/993: mkdir d10/d11/d31/d2a/d14a 0 2024-02-28T16:27:19.352 INFO:tasks.workunit.client.1.smithi157.stdout:8/993: chown d1/d5/d43/d86/lbf 298185077 1 2024-02-28T16:27:19.352 INFO:tasks.workunit.client.1.smithi157.stdout:1/994: chown d10/d11/d31/d2a/lb8 15768 1 2024-02-28T16:27:19.359 INFO:tasks.workunit.client.1.smithi157.stdout:3/947: mknod d0/d6/d44/d8e/d133/d6d/d140/d9e/d105/d102/c144 0 2024-02-28T16:27:19.361 INFO:tasks.workunit.client.1.smithi157.stdout:1/995: mkdir d10/d11/d3a/d148/d14b 0 2024-02-28T16:27:19.364 INFO:tasks.workunit.client.1.smithi157.stdout:3/948: creat d0/d6/d34/d80/d5c/d99/f145 x:0 0 0 2024-02-28T16:27:19.368 INFO:tasks.workunit.client.1.smithi157.stdout:1/996: creat d10/f14c x:0 0 0 2024-02-28T16:27:19.373 INFO:tasks.workunit.client.1.smithi157.stdout:6/956: creat d2/d7/d8/da/f124 x:0 0 0 2024-02-28T16:27:19.377 INFO:tasks.workunit.client.1.smithi157.stdout:9/954: dwrite d0/f5 [0,4194304] 0 2024-02-28T16:27:19.378 INFO:tasks.workunit.client.1.smithi157.stdout:1/997: mkdir d10/d11/d3a/d95/da4/d14d 0 2024-02-28T16:27:19.382 INFO:tasks.workunit.client.1.smithi157.stdout:3/949: link d0/d6/d44/d8e/d133/d2e/d7e/cd7 d0/d6/d1e/c146 0 2024-02-28T16:27:19.391 INFO:tasks.workunit.client.1.smithi157.stdout:3/950: creat d0/d6/d44/d8e/d133/d6d/d140/d9e/d105/d121/f147 x:0 0 0 2024-02-28T16:27:19.392 INFO:tasks.workunit.client.1.smithi157.stdout:1/998: creat d10/d11/d31/d2a/d70/de8/dec/f14e x:0 0 0 2024-02-28T16:27:19.395 INFO:tasks.workunit.client.1.smithi157.stdout:6/957: write d2/d7/de/d1b/d4d/d6c/d9a/fb2 [820245,97737] 0 2024-02-28T16:27:19.408 INFO:tasks.workunit.client.1.smithi157.stdout:9/955: dwrite d0/f12 [4194304,4194304] 0 2024-02-28T16:27:19.410 INFO:tasks.workunit.client.1.smithi157.stdout:9/956: chown d0/d19/f9d 465 1 2024-02-28T16:27:19.422 INFO:tasks.workunit.client.1.smithi157.stdout:1/999: dwrite d10/d11/d3a/d5c/d6a/db4/d91/d113/d142/f10d [0,4194304] 0 2024-02-28T16:27:19.422 INFO:tasks.workunit.client.1.smithi157.stdout:3/951: dwrite d0/d6/d44/d70/d71/d87/dd1/d9d/f141 [0,4194304] 0 2024-02-28T16:27:19.449 INFO:tasks.workunit.client.1.smithi157.stdout:3/952: dwrite d0/d6/d44/fe0 [0,4194304] 0 2024-02-28T16:27:19.450 INFO:tasks.workunit.client.1.smithi157.stdout:6/958: dwrite d2/d7/d8/dd4/d53/da6/fc1 [0,4194304] 0 2024-02-28T16:27:19.451 INFO:tasks.workunit.client.1.smithi157.stdout:9/957: dwrite d0/d36/d37/d4d/d92/fbf [0,4194304] 0 2024-02-28T16:27:19.451 INFO:tasks.workunit.client.1.smithi157.stdout:6/959: chown d2/d7/d38/d11f 1401979986 1 2024-02-28T16:27:19.455 INFO:tasks.workunit.client.1.smithi157.stdout:9/958: dread - d0/d36/d37/d4d/d92/d108/f132 zero size 2024-02-28T16:27:19.464 INFO:tasks.workunit.client.1.smithi157.stdout:3/953: unlink d0/d6/d44/d70/d71/d87/d13c/f143 0 2024-02-28T16:27:19.467 INFO:tasks.workunit.client.1.smithi157.stdout:3/954: write d0/d6/d34/d80/fd4 [2358423,31657] 0 2024-02-28T16:27:19.468 INFO:tasks.workunit.client.1.smithi157.stdout:4/999: sync 2024-02-28T16:27:19.475 INFO:tasks.workunit.client.1.smithi157.stdout:9/959: dwrite d0/d36/d37/d4d/d92/fb6 [0,4194304] 0 2024-02-28T16:27:19.477 INFO:tasks.workunit.client.1.smithi157.stdout:3/955: mkdir d0/d6/d34/d43/dac/d148 0 2024-02-28T16:27:19.483 INFO:tasks.workunit.client.1.smithi157.stdout:3/956: link d0/d6/d44/d8e/d133/c106 d0/d6/d44/d8e/c149 0 2024-02-28T16:27:19.492 INFO:tasks.workunit.client.1.smithi157.stdout:3/957: symlink d0/d6/d44/d8e/d133/d6d/d140/l14a 0 2024-02-28T16:27:19.497 INFO:tasks.workunit.client.1.smithi157.stdout:6/960: write d2/d7/d8/dd4/d66/dc0/f114 [912392,42992] 0 2024-02-28T16:27:19.507 INFO:tasks.workunit.client.1.smithi157.stdout:3/958: dwrite d0/d6/d44/d70/f12c [0,4194304] 0 2024-02-28T16:27:19.513 INFO:tasks.workunit.client.1.smithi157.stdout:9/960: dwrite d0/d36/d37/d40/d5b/f8a [4194304,4194304] 0 2024-02-28T16:27:19.515 INFO:tasks.workunit.client.1.smithi157.stdout:3/959: symlink d0/d6/d44/d8e/d133/dec/l14b 0 2024-02-28T16:27:19.528 INFO:tasks.workunit.client.1.smithi157.stdout:3/960: creat d0/d6/d44/d8e/d133/d2e/f14c x:0 0 0 2024-02-28T16:27:19.529 INFO:tasks.workunit.client.1.smithi157.stdout:6/961: write d2/d7/de/d1b/d3d/fb3 [826358,130238] 0 2024-02-28T16:27:19.530 INFO:tasks.workunit.client.1.smithi157.stdout:9/961: getdents d0/d36/d37/d40/d4b/dfa 0 2024-02-28T16:27:19.533 INFO:tasks.workunit.client.1.smithi157.stdout:6/962: chown d2/d7/l1c 26351 1 2024-02-28T16:27:19.534 INFO:tasks.workunit.client.1.smithi157.stdout:3/961: mkdir d0/d6/d44/d70/d71/d14d 0 2024-02-28T16:27:19.537 INFO:tasks.workunit.client.1.smithi157.stdout:9/962: symlink d0/d36/d37/d4d/l146 0 2024-02-28T16:27:19.540 INFO:tasks.workunit.client.1.smithi157.stdout:3/962: mknod d0/d6/d44/d8e/d133/d6d/d140/d75/dbd/c14e 0 2024-02-28T16:27:19.541 INFO:tasks.workunit.client.1.smithi157.stdout:3/963: chown d0/f12b 3061491 1 2024-02-28T16:27:19.542 INFO:tasks.workunit.client.1.smithi157.stdout:9/963: unlink d0/fc6 0 2024-02-28T16:27:19.544 INFO:tasks.workunit.client.1.smithi157.stdout:3/964: write d0/d6/d1e/fdf [4568284,107258] 0 2024-02-28T16:27:19.544 INFO:tasks.workunit.client.1.smithi157.stdout:8/994: sync 2024-02-28T16:27:19.546 INFO:tasks.workunit.client.1.smithi157.stdout:6/963: dread d2/d7/d8/da/d31/fca [0,4194304] 0 2024-02-28T16:27:19.549 INFO:tasks.workunit.client.1.smithi157.stdout:8/995: dread - d1/d5/d4d/d60/fcd zero size 2024-02-28T16:27:19.555 INFO:tasks.workunit.client.1.smithi157.stdout:3/965: rename d0/d6/d44/d100 to d0/d6/d1e/d12f/d14f 0 2024-02-28T16:27:19.561 INFO:tasks.workunit.client.1.smithi157.stdout:8/996: symlink d1/d5/dd8/d52/d54/l159 0 2024-02-28T16:27:19.568 INFO:tasks.workunit.client.1.smithi157.stdout:6/964: rename d2/d7/lb7 to d2/d7/d8/da/d71/d8f/l125 0 2024-02-28T16:27:19.570 INFO:tasks.workunit.client.1.smithi157.stdout:8/997: readlink d1/d5/d43/d86/d96/l116 0 2024-02-28T16:27:19.572 INFO:tasks.workunit.client.1.smithi157.stdout:3/966: mkdir d0/d6/d44/d4b/d150 0 2024-02-28T16:27:19.572 INFO:tasks.workunit.client.1.smithi157.stdout:8/998: write d1/d5/d23/d53/f8e [3520989,70842] 0 2024-02-28T16:27:19.574 INFO:tasks.workunit.client.1.smithi157.stdout:9/964: getdents d0/d36/d37/d40/d5b 0 2024-02-28T16:27:19.574 INFO:tasks.workunit.client.1.smithi157.stdout:3/967: chown d0/d6/d44/d4b/f11d 5 1 2024-02-28T16:27:19.578 INFO:tasks.workunit.client.1.smithi157.stdout:6/965: rename d2/d7/f24 to d2/d7/d8/d121/f126 0 2024-02-28T16:27:19.583 INFO:tasks.workunit.client.1.smithi157.stdout:8/999: creat d1/d5/f15a x:0 0 0 2024-02-28T16:27:19.589 INFO:tasks.workunit.client.1.smithi157.stdout:3/968: dwrite d0/d6/d34/d80/d23/f50 [0,4194304] 0 2024-02-28T16:27:19.598 INFO:tasks.workunit.client.1.smithi157.stdout:3/969: creat d0/d6/d44/d8e/d133/d81/f151 x:0 0 0 2024-02-28T16:27:19.608 INFO:tasks.workunit.client.1.smithi157.stdout:3/970: creat d0/d6/d44/d8e/d133/d81/dfc/d136/f152 x:0 0 0 2024-02-28T16:27:19.611 INFO:tasks.workunit.client.1.smithi157.stdout:3/971: stat d0/d6/d44/d8e/d133/d6d/d140/d75/df0/d114 0 2024-02-28T16:27:19.612 INFO:tasks.workunit.client.1.smithi157.stdout:6/966: truncate d2/d7/d8/da/d31/d3a/fc7 7255494 0 2024-02-28T16:27:19.612 INFO:tasks.workunit.client.1.smithi157.stdout:9/965: dread d0/d36/d37/d40/d5b/dba/fd2 [0,4194304] 0 2024-02-28T16:27:19.615 INFO:tasks.workunit.client.1.smithi157.stdout:6/967: dread - d2/d7/d8/da/d31/d59/fb6 zero size 2024-02-28T16:27:19.619 INFO:tasks.workunit.client.1.smithi157.stdout:6/968: symlink d2/d7/de/d1b/d105/l127 0 2024-02-28T16:27:19.624 INFO:tasks.workunit.client.1.smithi157.stdout:6/969: creat d2/d7/d8/dd4/d53/d69/f128 x:0 0 0 2024-02-28T16:27:19.628 INFO:tasks.workunit.client.1.smithi157.stdout:3/972: dwrite d0/d6/d44/d8e/d133/fab [0,4194304] 0 2024-02-28T16:27:19.631 INFO:tasks.workunit.client.1.smithi157.stdout:6/970: fsync d2/d7/d8/dd4/d53/fc4 0 2024-02-28T16:27:19.641 INFO:tasks.workunit.client.1.smithi157.stdout:9/966: dread d0/d19/d30/f32 [8388608,4194304] 0 2024-02-28T16:27:19.648 INFO:tasks.workunit.client.1.smithi157.stdout:3/973: dwrite d0/d6/d44/d8e/d133/d6d/f124 [0,4194304] 0 2024-02-28T16:27:19.652 INFO:tasks.workunit.client.1.smithi157.stdout:9/967: creat d0/d36/daa/f147 x:0 0 0 2024-02-28T16:27:19.655 INFO:tasks.workunit.client.1.smithi157.stdout:3/974: symlink d0/d6/d34/d43/dac/l153 0 2024-02-28T16:27:19.659 INFO:tasks.workunit.client.1.smithi157.stdout:3/975: symlink d0/d6/d34/d43/l154 0 2024-02-28T16:27:19.677 INFO:tasks.workunit.client.1.smithi157.stdout:3/976: truncate d0/d6/d44/d70/d71/d87/dd1/d9d/f141 1502076 0 2024-02-28T16:27:19.677 INFO:tasks.workunit.client.1.smithi157.stdout:9/968: dwrite d0/d36/d3f/f8b [0,4194304] 0 2024-02-28T16:27:19.680 INFO:tasks.workunit.client.1.smithi157.stdout:3/977: read d0/d6/d44/d8e/f138 [151137,107557] 0 2024-02-28T16:27:19.682 INFO:tasks.workunit.client.1.smithi157.stdout:9/969: creat d0/d36/daa/dbe/d105/f148 x:0 0 0 2024-02-28T16:27:19.684 INFO:tasks.workunit.client.1.smithi157.stdout:9/970: truncate d0/d36/d37/f13f 740224 0 2024-02-28T16:27:19.687 INFO:tasks.workunit.client.1.smithi157.stdout:3/978: creat d0/d6/d34/d80/d23/d116/f155 x:0 0 0 2024-02-28T16:27:19.692 INFO:tasks.workunit.client.1.smithi157.stdout:9/971: unlink d0/d36/d37/d4d/d92/db9/fc1 0 2024-02-28T16:27:19.694 INFO:tasks.workunit.client.1.smithi157.stdout:9/972: chown d0/d36/d37/d40/d4b/cb8 6051599 1 2024-02-28T16:27:19.696 INFO:tasks.workunit.client.1.smithi157.stdout:3/979: dread d0/d6/d44/d8e/d133/d6d/d140/f6c [0,4194304] 0 2024-02-28T16:27:19.697 INFO:tasks.workunit.client.1.smithi157.stdout:9/973: symlink d0/dc0/de3/l149 0 2024-02-28T16:27:19.699 INFO:tasks.workunit.client.1.smithi157.stdout:9/974: write d0/d36/daa/f109 [1323245,110598] 0 2024-02-28T16:27:19.703 INFO:tasks.workunit.client.1.smithi157.stdout:3/980: unlink d0/d6/d34/d80/c47 0 2024-02-28T16:27:19.710 INFO:tasks.workunit.client.1.smithi157.stdout:9/975: rename d0/d36/d37/d40/d5b/dba/c115 to d0/d36/d3f/d69/d111/d118/c14a 0 2024-02-28T16:27:19.710 INFO:tasks.workunit.client.1.smithi157.stdout:6/971: sync 2024-02-28T16:27:19.710 INFO:tasks.workunit.client.1.smithi157.stdout:3/981: rename d0/d6/d34/d43/dac to d0/d6/d34/d43/dac/d148/d156 22 2024-02-28T16:27:19.717 INFO:tasks.workunit.client.1.smithi157.stdout:6/972: mknod d2/d7/de/d1b/d4d/d6c/c129 0 2024-02-28T16:27:19.720 INFO:tasks.workunit.client.1.smithi157.stdout:6/973: read d2/d7/d8/da/d31/d59/fb9 [165191,83916] 0 2024-02-28T16:27:19.722 INFO:tasks.workunit.client.1.smithi157.stdout:6/974: stat d2/d7/d8/da/d31/d3a/dc6 0 2024-02-28T16:27:19.727 INFO:tasks.workunit.client.1.smithi157.stdout:3/982: mknod d0/d6/d44/d8e/d133/d6d/d140/c157 0 2024-02-28T16:27:19.729 INFO:tasks.workunit.client.1.smithi157.stdout:9/976: write d0/d19/f64 [4520060,20045] 0 2024-02-28T16:27:19.730 INFO:tasks.workunit.client.1.smithi157.stdout:3/983: write d0/d6/d44/d8e/d133/d6d/d140/d75/df0/f10a [420819,99837] 0 2024-02-28T16:27:19.736 INFO:tasks.workunit.client.1.smithi157.stdout:3/984: mknod d0/d6/d44/d48/c158 0 2024-02-28T16:27:19.739 INFO:tasks.workunit.client.1.smithi157.stdout:3/985: chown d0/d6/d44/d70/d71/d87 60 1 2024-02-28T16:27:19.739 INFO:tasks.workunit.client.1.smithi157.stdout:6/975: dwrite d2/d7/d8/dd4/d8c/fe1 [0,4194304] 0 2024-02-28T16:27:19.741 INFO:tasks.workunit.client.1.smithi157.stdout:9/977: rename d0/d36/d37/d40/f62 to d0/d36/d37/d40/d4b/d96/df4/f14b 0 2024-02-28T16:27:19.745 INFO:tasks.workunit.client.1.smithi157.stdout:3/986: mkdir d0/d6/d44/d8e/d133/d6d/d140/d9e/d105/d121/d159 0 2024-02-28T16:27:19.749 INFO:tasks.workunit.client.1.smithi157.stdout:9/978: mkdir d0/d36/d37/d4d/d14c 0 2024-02-28T16:27:19.754 INFO:tasks.workunit.client.1.smithi157.stdout:9/979: mknod d0/d36/d3f/d103/c14d 0 2024-02-28T16:27:19.756 INFO:tasks.workunit.client.1.smithi157.stdout:6/976: dwrite d2/d7/d8/da/d71/d80/f81 [0,4194304] 0 2024-02-28T16:27:19.757 INFO:tasks.workunit.client.1.smithi157.stdout:6/977: fdatasync d2/d7/d8/dd4/d53/d69/f128 0 2024-02-28T16:27:19.762 INFO:tasks.workunit.client.1.smithi157.stdout:6/978: creat d2/f12a x:0 0 0 2024-02-28T16:27:19.774 INFO:tasks.workunit.client.1.smithi157.stdout:9/980: dwrite d0/d36/d3f/f6c [0,4194304] 0 2024-02-28T16:27:19.776 INFO:tasks.workunit.client.1.smithi157.stdout:9/981: chown d0/d19/d30/d79/f11c 184855 1 2024-02-28T16:27:19.783 INFO:tasks.workunit.client.1.smithi157.stdout:3/987: dread d0/d6/d44/d8e/d133/d81/f122 [0,4194304] 0 2024-02-28T16:27:19.795 INFO:tasks.workunit.client.1.smithi157.stdout:3/988: mknod d0/d6/d34/d43/dac/c15a 0 2024-02-28T16:27:19.802 INFO:tasks.workunit.client.1.smithi157.stdout:3/989: creat d0/d6/d44/d8e/d133/d81/dfc/d136/f15b x:0 0 0 2024-02-28T16:27:19.804 INFO:tasks.workunit.client.1.smithi157.stdout:9/982: dwrite d0/d36/d37/d40/d5b/dba/fd2 [0,4194304] 0 2024-02-28T16:27:19.805 INFO:tasks.workunit.client.1.smithi157.stdout:9/983: chown d0/dc0/de3 5068 1 2024-02-28T16:27:19.826 INFO:tasks.workunit.client.1.smithi157.stdout:3/990: dwrite d0/d6/d44/d8e/d133/d6d/d140/fd6 [0,4194304] 0 2024-02-28T16:27:19.843 INFO:tasks.workunit.client.1.smithi157.stdout:3/991: truncate d0/d6/d34/d80/d5c/d99/fce 708164 0 2024-02-28T16:27:19.852 INFO:tasks.workunit.client.1.smithi157.stdout:6/979: sync 2024-02-28T16:27:19.854 INFO:tasks.workunit.client.1.smithi157.stdout:6/980: stat d2/d7/d8/da/l100 0 2024-02-28T16:27:19.857 INFO:tasks.workunit.client.1.smithi157.stdout:6/981: write d2/d7/d8/da/d71/d93/fd8 [238676,2068] 0 2024-02-28T16:27:19.861 INFO:tasks.workunit.client.1.smithi157.stdout:3/992: dwrite d0/d6/d1e/fdf [4194304,4194304] 0 2024-02-28T16:27:19.884 INFO:tasks.workunit.client.1.smithi157.stdout:6/982: link d2/d7/d8/dd4/d53/d69/f7c d2/d7/de/d40/f12b 0 2024-02-28T16:27:19.884 INFO:tasks.workunit.client.1.smithi157.stdout:9/984: write d0/d36/f9b [777108,25365] 0 2024-02-28T16:27:19.889 INFO:tasks.workunit.client.1.smithi157.stdout:6/983: read - d2/d7/d8/da/d71/d93/f10a zero size 2024-02-28T16:27:19.894 INFO:tasks.workunit.client.1.smithi157.stdout:6/984: write d2/d7/d8/fa7 [536886,103271] 0 2024-02-28T16:27:19.897 INFO:tasks.workunit.client.1.smithi157.stdout:6/985: chown d2/d7/d8/dd4/d66/c89 10 1 2024-02-28T16:27:19.900 INFO:tasks.workunit.client.1.smithi157.stdout:9/985: dread d0/f90 [0,4194304] 0 2024-02-28T16:27:19.902 INFO:tasks.workunit.client.1.smithi157.stdout:3/993: write d0/d6/d44/d8e/d133/d2e/d7e/ffa [2445952,87506] 0 2024-02-28T16:27:19.905 INFO:tasks.workunit.client.1.smithi157.stdout:6/986: rmdir d2/d7 39 2024-02-28T16:27:19.906 INFO:tasks.workunit.client.1.smithi157.stdout:9/986: rmdir d0/d36/daa/dbe/d105 39 2024-02-28T16:27:19.906 INFO:tasks.workunit.client.1.smithi157.stdout:3/994: chown d0/d6/d44/d8e/d133/d2e/ff9 972224414 1 2024-02-28T16:27:19.917 INFO:tasks.workunit.client.1.smithi157.stdout:6/987: creat d2/d7/d8/da/d71/d93/f12c x:0 0 0 2024-02-28T16:27:19.918 INFO:tasks.workunit.client.1.smithi157.stdout:6/988: readlink d2/d7/de/d1b/d3d/l117 0 2024-02-28T16:27:19.923 INFO:tasks.workunit.client.1.smithi157.stdout:6/989: symlink d2/d7/d8/dd4/d8c/l12d 0 2024-02-28T16:27:19.924 INFO:tasks.workunit.client.1.smithi157.stdout:9/987: dread d0/d36/f9b [0,4194304] 0 2024-02-28T16:27:19.924 INFO:tasks.workunit.client.1.smithi157.stdout:6/990: read d2/d7/d8/da/fc2 [4103427,75999] 0 2024-02-28T16:27:19.935 INFO:tasks.workunit.client.1.smithi157.stdout:9/988: getdents d0/d36/d37/d4d/db5 0 2024-02-28T16:27:19.939 INFO:tasks.workunit.client.1.smithi157.stdout:9/989: creat d0/d36/d3f/d69/d111/f14e x:0 0 0 2024-02-28T16:27:19.939 INFO:tasks.workunit.client.1.smithi157.stdout:6/991: dwrite d2/f1f [0,4194304] 0 2024-02-28T16:27:19.944 INFO:tasks.workunit.client.1.smithi157.stdout:6/992: dread - d2/d7/d8/da/d71/d8f/db4/fd9 zero size 2024-02-28T16:27:19.945 INFO:tasks.workunit.client.1.smithi157.stdout:9/990: mknod d0/d36/d37/d40/c14f 0 2024-02-28T16:27:19.948 INFO:tasks.workunit.client.1.smithi157.stdout:6/993: symlink d2/d7/d8/da/d71/d8f/l12e 0 2024-02-28T16:27:19.954 INFO:tasks.workunit.client.1.smithi157.stdout:6/994: symlink d2/d7/de/d1b/d4d/d6c/d9a/l12f 0 2024-02-28T16:27:19.955 INFO:tasks.workunit.client.1.smithi157.stdout:9/991: dread d0/d36/f9b [0,4194304] 0 2024-02-28T16:27:19.959 INFO:tasks.workunit.client.1.smithi157.stdout:6/995: symlink d2/d7/d38/d11f/l130 0 2024-02-28T16:27:19.964 INFO:tasks.workunit.client.1.smithi157.stdout:6/996: truncate d2/f4b 1044976 0 2024-02-28T16:27:19.965 INFO:tasks.workunit.client.1.smithi157.stdout:6/997: chown d2/d7/d8/dd4/f3b 13801 1 2024-02-28T16:27:19.966 INFO:tasks.workunit.client.1.smithi157.stdout:6/998: chown d2/d7/d8 40439 1 2024-02-28T16:27:19.970 INFO:tasks.workunit.client.1.smithi157.stdout:9/992: dread d0/d19/d30/f54 [0,4194304] 0 2024-02-28T16:27:19.978 INFO:tasks.workunit.client.1.smithi157.stdout:3/995: sync 2024-02-28T16:27:19.982 INFO:tasks.workunit.client.1.smithi157.stdout:6/999: dwrite d2/d7/d8/da/d31/d37/d2b/d99/fb1 [4194304,4194304] 0 2024-02-28T16:27:19.986 INFO:tasks.workunit.client.1.smithi157.stdout:3/996: creat d0/d6/d44/d70/d71/d87/dd1/d9d/f15c x:0 0 0 2024-02-28T16:27:19.990 INFO:tasks.workunit.client.1.smithi157.stdout:9/993: truncate d0/d36/d37/d4d/d92/db9/fc7 4151951 0 2024-02-28T16:27:19.991 INFO:tasks.workunit.client.1.smithi157.stdout:9/994: chown d0/dc0/de3/c10d 102694763 1 2024-02-28T16:27:19.992 INFO:tasks.workunit.client.1.smithi157.stdout:3/997: creat d0/d6/d44/d8e/d133/d2e/d7e/d91/d130/f15d x:0 0 0 2024-02-28T16:27:20.006 INFO:tasks.workunit.client.1.smithi157.stdout:3/998: dwrite d0/d6/d44/d8e/d133/d6d/d140/fd6 [4194304,4194304] 0 2024-02-28T16:27:20.010 INFO:tasks.workunit.client.1.smithi157.stdout:9/995: link d0/d36/d3f/d69/d111/d118/c14a d0/d36/d37/d40/d11e/c150 0 2024-02-28T16:27:20.012 INFO:tasks.workunit.client.1.smithi157.stdout:3/999: chown d0/d6/d44/d8e/da8/le5 35961 1 2024-02-28T16:27:20.029 INFO:tasks.workunit.client.1.smithi157.stdout:9/996: dread d0/d19/d30/d78/f7e [4194304,4194304] 0 2024-02-28T16:27:20.031 INFO:tasks.workunit.client.1.smithi157.stdout:9/997: write d0/d36/f9b [1717042,37964] 0 2024-02-28T16:27:20.033 INFO:tasks.workunit.client.1.smithi157.stdout:9/998: stat d0/d36/d37/d40/d5b/dba/dfe 0 2024-02-28T16:27:20.061 INFO:tasks.workunit.client.1.smithi157.stdout:9/999: dwrite d0/f97 [0,4194304] 0 2024-02-28T16:27:20.069 INFO:tasks.workunit.client.1.smithi157.stderr:+ rm -rf -- ./tmp.Zusj4b4ANZ 2024-02-28T16:27:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:19 smithi157 ceph-mon[38346]: pgmap v64: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 87 MiB/s rd, 209 MiB/s wr, 497 op/s 2024-02-28T16:27:20.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:19 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:20.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:19 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:20.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:19 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:19 smithi148 ceph-mon[28767]: pgmap v64: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 87 MiB/s rd, 209 MiB/s wr, 497 op/s 2024-02-28T16:27:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:19 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:19 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:19 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:20 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:20 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:20 smithi148 ceph-mon[28767]: pgmap v65: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 140 MiB/s wr, 345 op/s 2024-02-28T16:27:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:20 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:21.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:20 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:21.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:20 smithi157 ceph-mon[38346]: pgmap v65: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 68 MiB/s rd, 140 MiB/s wr, 345 op/s 2024-02-28T16:27:23.548 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:23 smithi148 ceph-mon[28767]: pgmap v66: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 83 MiB/s rd, 171 MiB/s wr, 443 op/s 2024-02-28T16:27:23.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:23 smithi157 ceph-mon[38346]: pgmap v66: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 83 MiB/s rd, 171 MiB/s wr, 443 op/s 2024-02-28T16:27:25.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:25 smithi148 ceph-mon[28767]: pgmap v67: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 98 MiB/s wr, 272 op/s 2024-02-28T16:27:25.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:25 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:25.754 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:25 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:25.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:25 smithi157 ceph-mon[38346]: pgmap v67: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 98 MiB/s wr, 272 op/s 2024-02-28T16:27:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:25 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:25.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:25 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:27 smithi148 ceph-mon[28767]: pgmap v68: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 98 MiB/s wr, 272 op/s 2024-02-28T16:27:27.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:27 smithi157 ceph-mon[38346]: pgmap v68: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 50 MiB/s rd, 98 MiB/s wr, 272 op/s 2024-02-28T16:27:29.699 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:29 smithi148 ceph-mon[28767]: pgmap v69: 65 pgs: 65 active+clean; 2.4 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 50 MiB/s rd, 99 MiB/s wr, 318 op/s 2024-02-28T16:27:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:29 smithi157 ceph-mon[38346]: pgmap v69: 65 pgs: 65 active+clean; 2.4 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 50 MiB/s rd, 99 MiB/s wr, 318 op/s 2024-02-28T16:27:30.241 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T16:27:30.242 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-28T16:27:31.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:30 smithi157 ceph-mon[38346]: Standby manager daemon smithi148.gelspy restarted 2024-02-28T16:27:31.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:30 smithi157 ceph-mon[38346]: Standby manager daemon smithi148.gelspy started 2024-02-28T16:27:31.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:30 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/crt"}]: dispatch 2024-02-28T16:27:31.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:30 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:27:31.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:30 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/key"}]: dispatch 2024-02-28T16:27:31.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:30 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:27:31.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:30 smithi148 ceph-mon[28767]: Standby manager daemon smithi148.gelspy restarted 2024-02-28T16:27:31.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:30 smithi148 ceph-mon[28767]: Standby manager daemon smithi148.gelspy started 2024-02-28T16:27:31.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:30 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/crt"}]: dispatch 2024-02-28T16:27:31.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:30 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:27:31.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:30 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi148.gelspy/key"}]: dispatch 2024-02-28T16:27:31.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:30 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:27:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:31 smithi148 ceph-mon[28767]: pgmap v70: 65 pgs: 65 active+clean; 2.4 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 15 MiB/s rd, 32 MiB/s wr, 143 op/s 2024-02-28T16:27:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:31 smithi148 ceph-mon[28767]: mgrmap e27: smithi157.cmcxzj(active, since 2m), standbys: smithi148.gelspy 2024-02-28T16:27:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:31 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:32.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:31 smithi157 ceph-mon[38346]: pgmap v70: 65 pgs: 65 active+clean; 2.4 GiB data, 8.9 GiB used, 527 GiB / 536 GiB avail; 15 MiB/s rd, 32 MiB/s wr, 143 op/s 2024-02-28T16:27:32.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:31 smithi157 ceph-mon[38346]: mgrmap e27: smithi157.cmcxzj(active, since 2m), standbys: smithi148.gelspy 2024-02-28T16:27:32.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:31 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:34.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:33 smithi157 ceph-mon[38346]: pgmap v71: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 15 MiB/s rd, 32 MiB/s wr, 192 op/s 2024-02-28T16:27:34.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:33 smithi148 ceph-mon[28767]: pgmap v71: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 15 MiB/s rd, 32 MiB/s wr, 192 op/s 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 -- 172.21.15.148:0/1091807413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae100ff150 msgr2=0x7fae100ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 --2- 172.21.15.148:0/1091807413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae100ff150 0x7fae100ff560 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fae00004940 tx=0x7fae00009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 -- 172.21.15.148:0/1091807413 shutdown_connections 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 --2- 172.21.15.148:0/1091807413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 0x7fae101007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 --2- 172.21.15.148:0/1091807413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae100ff150 0x7fae100ff560 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 -- 172.21.15.148:0/1091807413 >> 172.21.15.148:0/1091807413 conn(0x7fae100fa920 msgr2=0x7fae100fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 -- 172.21.15.148:0/1091807413 shutdown_connections 2024-02-28T16:27:35.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.931+0000 7fae16600700 1 -- 172.21.15.148:0/1091807413 wait complete. 2024-02-28T16:27:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.932+0000 7fae16600700 1 Processor -- start 2024-02-28T16:27:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.932+0000 7fae16600700 1 -- start start 2024-02-28T16:27:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.933+0000 7fae16600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae100ff150 0x7fae10113f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.933+0000 7fae16600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 0x7fae10114450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.933+0000 7fae16600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10114a50 con 0x7fae100ff150 2024-02-28T16:27:35.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.933+0000 7fae16600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae101152f0 con 0x7fae10100360 2024-02-28T16:27:35.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.934+0000 7fae0ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 0x7fae10114450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:35.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.934+0000 7fae0ea00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 0x7fae10114450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:38710/0 (socket says 172.21.15.148:38710) 2024-02-28T16:27:35.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.934+0000 7fae0ea00700 1 -- 172.21.15.148:0/3213314583 learned_addr learned my addr 172.21.15.148:0/3213314583 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.935+0000 7fae0ea00700 1 -- 172.21.15.148:0/3213314583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae100ff150 msgr2=0x7fae10113f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.935+0000 7fae0ea00700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae100ff150 0x7fae10113f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.935+0000 7fae0ea00700 1 -- 172.21.15.148:0/3213314583 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00005040 con 0x7fae10100360 2024-02-28T16:27:35.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.935+0000 7fae0ea00700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 0x7fae10114450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00eb40 tx=0x7fadfc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:35.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.940+0000 7fae07400700 1 -- 172.21.15.148:0/3213314583 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc007cc0 con 0x7fae10100360 2024-02-28T16:27:35.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.940+0000 7fae07400700 1 -- 172.21.15.148:0/3213314583 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadfc00f040 con 0x7fae10100360 2024-02-28T16:27:35.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.940+0000 7fae07400700 1 -- 172.21.15.148:0/3213314583 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc009620 con 0x7fae10100360 2024-02-28T16:27:35.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.940+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae10115570 con 0x7fae10100360 2024-02-28T16:27:35.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.940+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae10115ab0 con 0x7fae10100360 2024-02-28T16:27:35.931 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.941+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1004bed0 con 0x7fae10100360 2024-02-28T16:27:35.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.943+0000 7fae07400700 1 -- 172.21.15.148:0/3213314583 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 27) v1 ==== 91201+0+0 (secure 0 0 0) 0x7fadfc009780 con 0x7fae10100360 2024-02-28T16:27:35.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.945+0000 7fae07400700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fadf406d0f0 0x7fadf406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:35.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.945+0000 7fae07400700 1 -- 172.21.15.148:0/3213314583 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fadfc08c080 con 0x7fae10100360 2024-02-28T16:27:35.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.946+0000 7fae0f400700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fadf406d0f0 0x7fadf406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:35.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.947+0000 7fae0f400700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fadf406d0f0 0x7fadf406f5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae00009fd0 tx=0x7fae00009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:35.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:35.962+0000 7fae07400700 1 -- 172.21.15.148:0/3213314583 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fadfc059e90 con 0x7fae10100360 2024-02-28T16:27:36.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:35 smithi157 ceph-mon[38346]: pgmap v72: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 12 KiB/s rd, 684 KiB/s wr, 94 op/s 2024-02-28T16:27:36.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.334+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae100fd960 con 0x7fadf406d0f0 2024-02-28T16:27:36.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:35 smithi148 ceph-mon[28767]: pgmap v72: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 12 KiB/s rd, 684 KiB/s wr, 94 op/s 2024-02-28T16:27:36.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.336+0000 7fae07400700 1 -- 172.21.15.148:0/3213314583 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fae100fd960 con 0x7fadf406d0f0 2024-02-28T16:27:36.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fadf406d0f0 msgr2=0x7fadf406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:36.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fadf406d0f0 0x7fadf406f5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae00009fd0 tx=0x7fae00009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 msgr2=0x7fae10114450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 0x7fae10114450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00eb40 tx=0x7fadfc00b040 comp rx=0 tx=0).stop 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 shutdown_connections 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7fadf406d0f0 0x7fadf406f5a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fae100ff150 0x7fae10113f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 --2- 172.21.15.148:0/3213314583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fae10100360 0x7fae10114450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 >> 172.21.15.148:0/3213314583 conn(0x7fae100fa920 msgr2=0x7fae100fbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 shutdown_connections 2024-02-28T16:27:36.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.339+0000 7fae16600700 1 -- 172.21.15.148:0/3213314583 wait complete. 2024-02-28T16:27:36.346 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:27:36.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.534+0000 7f9de7000700 1 -- 172.21.15.148:0/2750110782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 msgr2=0x7f9de0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:36.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.535+0000 7f9de7000700 1 --2- 172.21.15.148:0/2750110782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de0070d10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc004940 tx=0x7f9dcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:36.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.535+0000 7f9de7000700 1 -- 172.21.15.148:0/2750110782 shutdown_connections 2024-02-28T16:27:36.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.535+0000 7f9de7000700 1 --2- 172.21.15.148:0/2750110782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de0070d10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.535+0000 7f9de7000700 1 --2- 172.21.15.148:0/2750110782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de0071f10 0x7f9de0070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.535+0000 7f9de7000700 1 -- 172.21.15.148:0/2750110782 >> 172.21.15.148:0/2750110782 conn(0x7f9de00f8590 msgr2=0x7f9de00fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:36.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.536+0000 7f9de7000700 1 -- 172.21.15.148:0/2750110782 shutdown_connections 2024-02-28T16:27:36.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.536+0000 7f9de7000700 1 -- 172.21.15.148:0/2750110782 wait complete. 2024-02-28T16:27:36.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.536+0000 7f9de7000700 1 Processor -- start 2024-02-28T16:27:36.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.537+0000 7f9de7000700 1 -- start start 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.537+0000 7f9de7000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de010f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.537+0000 7f9de7000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de0071f10 0x7f9de010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.537+0000 7f9de7000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0110350 con 0x7f9de00708c0 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.537+0000 7f9de7000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0110bf0 con 0x7f9de0071f10 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.538+0000 7f9ddfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de010f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.538+0000 7f9ddfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de010f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42414/0 (socket says 172.21.15.148:42414) 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.538+0000 7f9ddfe00700 1 -- 172.21.15.148:0/2611141539 learned_addr learned my addr 172.21.15.148:0/2611141539 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:36.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.538+0000 7f9ddf400700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de0071f10 0x7f9de010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:36.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.538+0000 7f9ddfe00700 1 -- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de0071f10 msgr2=0x7f9de010fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:36.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.538+0000 7f9ddfe00700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de0071f10 0x7f9de010fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.538+0000 7f9ddfe00700 1 -- 172.21.15.148:0/2611141539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc005040 con 0x7f9de00708c0 2024-02-28T16:27:36.528 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.539+0000 7f9ddfe00700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de010f810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0002a50 tx=0x7f9dd00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:36.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.540+0000 7f9dd7e00700 1 -- 172.21.15.148:0/2611141539 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd0007cc0 con 0x7f9de00708c0 2024-02-28T16:27:36.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.540+0000 7f9dd7e00700 1 -- 172.21.15.148:0/2611141539 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dd000f040 con 0x7f9de00708c0 2024-02-28T16:27:36.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.540+0000 7f9dd7e00700 1 -- 172.21.15.148:0/2611141539 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd000da30 con 0x7f9de00708c0 2024-02-28T16:27:36.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.540+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de0110ed0 con 0x7f9de00708c0 2024-02-28T16:27:36.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.540+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0111410 con 0x7f9de00708c0 2024-02-28T16:27:36.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.541+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de004bed0 con 0x7f9de00708c0 2024-02-28T16:27:36.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.543+0000 7f9dd7e00700 1 -- 172.21.15.148:0/2611141539 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 27) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f9dd000db90 con 0x7f9de00708c0 2024-02-28T16:27:36.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.545+0000 7f9dd7e00700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9dc406d1a0 0x7f9dc406f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:36.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.545+0000 7f9dd7e00700 1 -- 172.21.15.148:0/2611141539 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f9dd008c0d0 con 0x7f9de00708c0 2024-02-28T16:27:36.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.546+0000 7f9ddf400700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9dc406d1a0 0x7f9dc406f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:36.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.547+0000 7f9ddf400700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9dc406d1a0 0x7f9dc406f650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00b3b0 tx=0x7f9dcc009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:36.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.551+0000 7f9dd7e00700 1 -- 172.21.15.148:0/2611141539 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f9dd0059e30 con 0x7f9de00708c0 2024-02-28T16:27:36.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.878+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9de0104150 con 0x7f9dc406d1a0 2024-02-28T16:27:36.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.881+0000 7f9dd7e00700 1 -- 172.21.15.148:0/2611141539 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f9de0104150 con 0x7f9dc406d1a0 2024-02-28T16:27:36.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9dc406d1a0 msgr2=0x7f9dc406f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:36.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9dc406d1a0 0x7f9dc406f650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00b3b0 tx=0x7f9dcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:36.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 msgr2=0x7f9de010f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:36.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de010f810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0002a50 tx=0x7f9dd00046b0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 shutdown_connections 2024-02-28T16:27:36.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f9dc406d1a0 0x7f9dc406f650 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9de00708c0 0x7f9de010f810 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 --2- 172.21.15.148:0/2611141539 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9de0071f10 0x7f9de010fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:36.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.883+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 >> 172.21.15.148:0/2611141539 conn(0x7f9de00f8590 msgr2=0x7f9de00fa890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:36.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.884+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 shutdown_connections 2024-02-28T16:27:36.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:36.884+0000 7f9de7000700 1 -- 172.21.15.148:0/2611141539 wait complete. 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.051+0000 7efd64600700 1 -- 172.21.15.148:0/2900240523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c071eb0 msgr2=0x7efd5c070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.051+0000 7efd64600700 1 --2- 172.21.15.148:0/2900240523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c071eb0 0x7efd5c070320 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efd50004940 tx=0x7efd50009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.051+0000 7efd64600700 1 -- 172.21.15.148:0/2900240523 shutdown_connections 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.051+0000 7efd64600700 1 --2- 172.21.15.148:0/2900240523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd5c070860 0x7efd5c070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.051+0000 7efd64600700 1 --2- 172.21.15.148:0/2900240523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c071eb0 0x7efd5c070320 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.051+0000 7efd64600700 1 -- 172.21.15.148:0/2900240523 >> 172.21.15.148:0/2900240523 conn(0x7efd5c0f8620 msgr2=0x7efd5c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.053+0000 7efd64600700 1 -- 172.21.15.148:0/2900240523 shutdown_connections 2024-02-28T16:27:37.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.053+0000 7efd64600700 1 -- 172.21.15.148:0/2900240523 wait complete. 2024-02-28T16:27:37.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.054+0000 7efd64600700 1 Processor -- start 2024-02-28T16:27:37.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.054+0000 7efd64600700 1 -- start start 2024-02-28T16:27:37.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.054+0000 7efd64600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c070860 0x7efd5c10fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:37.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.054+0000 7efd64600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd5c071eb0 0x7efd5c110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:37.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.054+0000 7efd64600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c110680 con 0x7efd5c070860 2024-02-28T16:27:37.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.054+0000 7efd64600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c110f20 con 0x7efd5c071eb0 2024-02-28T16:27:37.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.055+0000 7efd61c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c070860 0x7efd5c10fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:37.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.055+0000 7efd61c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c070860 0x7efd5c10fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42444/0 (socket says 172.21.15.148:42444) 2024-02-28T16:27:37.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.055+0000 7efd61c00700 1 -- 172.21.15.148:0/3296965983 learned_addr learned my addr 172.21.15.148:0/3296965983 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:37.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.055+0000 7efd61200700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd5c071eb0 0x7efd5c110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:37.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.055+0000 7efd61c00700 1 -- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd5c071eb0 msgr2=0x7efd5c110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:37.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.055+0000 7efd61c00700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd5c071eb0 0x7efd5c110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.055+0000 7efd61c00700 1 -- 172.21.15.148:0/3296965983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd50005040 con 0x7efd5c070860 2024-02-28T16:27:37.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.056+0000 7efd61c00700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c070860 0x7efd5c10fb40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd5000b3b0 tx=0x7efd50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:37.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.056+0000 7efd59600700 1 -- 172.21.15.148:0/3296965983 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5000e040 con 0x7efd5c070860 2024-02-28T16:27:37.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.056+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c1111a0 con 0x7efd5c070860 2024-02-28T16:27:37.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.056+0000 7efd59600700 1 -- 172.21.15.148:0/3296965983 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd5000bd90 con 0x7efd5c070860 2024-02-28T16:27:37.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.056+0000 7efd59600700 1 -- 172.21.15.148:0/3296965983 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd5001c630 con 0x7efd5c070860 2024-02-28T16:27:37.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.056+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c1116e0 con 0x7efd5c070860 2024-02-28T16:27:37.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.058+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c04bed0 con 0x7efd5c070860 2024-02-28T16:27:37.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.059+0000 7efd59600700 1 -- 172.21.15.148:0/3296965983 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 27) v1 ==== 91201+0+0 (secure 0 0 0) 0x7efd500139f0 con 0x7efd5c070860 2024-02-28T16:27:37.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.060+0000 7efd59600700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7efd4406d0f0 0x7efd4406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:37.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.060+0000 7efd59600700 1 -- 172.21.15.148:0/3296965983 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7efd5008d970 con 0x7efd5c070860 2024-02-28T16:27:37.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.061+0000 7efd61200700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7efd4406d0f0 0x7efd4406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:37.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.062+0000 7efd61200700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7efd4406d0f0 0x7efd4406f5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd480041d0 tx=0x7efd48009040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:37.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.068+0000 7efd59600700 1 -- 172.21.15.148:0/3296965983 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efd5005b6d0 con 0x7efd5c070860 2024-02-28T16:27:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.426+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd5c104550 con 0x7efd4406d0f0 2024-02-28T16:27:37.434 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:27:37.434 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 starting - - - - 2024-02-28T16:27:37.434 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (13m) 2m ago 13m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:27:37.434 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (11m) 12s ago 11m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 starting - - - - 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (5m) 2m ago 5m 11.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (4m) 2m ago 4m 109M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (4m) 12s ago 4m 12.4M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (5m) 12s ago 5m 12.5M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 starting - - - - 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (2m) 12s ago 11m 500M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1ed96a6b633e 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (15m) 2m ago 15m 46.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (11m) 12s ago 11m 36.0M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 starting - - - - 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (30s) 12s ago 11m 6874k - 1.5.0 0da6a335fe13 366892c91a77 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (10m) 2m ago 10m 76.1M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:27:37.435 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (9m) 2m ago 9m 67.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (8m) 2m ago 8m 65.0M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (8m) 12s ago 8m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (7m) 12s ago 7m 178M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (7m) 12s ago 7m 186M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 starting - - - - 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.443+0000 7efd59600700 1 -- 172.21.15.148:0/3296965983 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7efd5c104550 con 0x7efd4406d0f0 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7efd4406d0f0 msgr2=0x7efd4406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:37.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7efd4406d0f0 0x7efd4406f5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd480041d0 tx=0x7efd48009040 comp rx=0 tx=0).stop 2024-02-28T16:27:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c070860 msgr2=0x7efd5c10fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c070860 0x7efd5c10fb40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efd5000b3b0 tx=0x7efd50009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:37.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 shutdown_connections 2024-02-28T16:27:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7efd4406d0f0 0x7efd4406f5a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd5c070860 0x7efd5c10fb40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 --2- 172.21.15.148:0/3296965983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd5c071eb0 0x7efd5c110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.447+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 >> 172.21.15.148:0/3296965983 conn(0x7efd5c0f8620 msgr2=0x7efd5c102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.448+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 shutdown_connections 2024-02-28T16:27:37.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.448+0000 7efd64600700 1 -- 172.21.15.148:0/3296965983 wait complete. 2024-02-28T16:27:37.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.635+0000 7f2d11a00700 1 -- 172.21.15.148:0/1894557939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c0ff150 msgr2=0x7f2d0c0ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:37.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.635+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1894557939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c0ff150 0x7f2d0c0ff560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004940 tx=0x7f2cfc009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:37.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.635+0000 7f2d11a00700 1 -- 172.21.15.148:0/1894557939 shutdown_connections 2024-02-28T16:27:37.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.635+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1894557939 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d0c100360 0x7f2d0c1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.635+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1894557939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c0ff150 0x7f2d0c0ff560 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.635+0000 7f2d11a00700 1 -- 172.21.15.148:0/1894557939 >> 172.21.15.148:0/1894557939 conn(0x7f2d0c0fa920 msgr2=0x7f2d0c0fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:37.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.636+0000 7f2d11a00700 1 -- 172.21.15.148:0/1894557939 shutdown_connections 2024-02-28T16:27:37.625 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.636+0000 7f2d11a00700 1 -- 172.21.15.148:0/1894557939 wait complete. 2024-02-28T16:27:37.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.637+0000 7f2d11a00700 1 Processor -- start 2024-02-28T16:27:37.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.637+0000 7f2d11a00700 1 -- start start 2024-02-28T16:27:37.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.637+0000 7f2d11a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d0c0ff150 0x7f2d0c10fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:37.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.637+0000 7f2d11a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c100360 0x7f2d0c110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:37.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.637+0000 7f2d11a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c110700 con 0x7f2d0c100360 2024-02-28T16:27:37.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.637+0000 7f2d11a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c110fa0 con 0x7f2d0c0ff150 2024-02-28T16:27:37.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.638+0000 7f2d0a000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c100360 0x7f2d0c110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:37.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.638+0000 7f2d0a000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c100360 0x7f2d0c110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42472/0 (socket says 172.21.15.148:42472) 2024-02-28T16:27:37.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.638+0000 7f2d0a000700 1 -- 172.21.15.148:0/1392508160 learned_addr learned my addr 172.21.15.148:0/1392508160 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:37.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.638+0000 7f2d0aa00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d0c0ff150 0x7f2d0c10fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:37.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.639+0000 7f2d0a000700 1 -- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d0c0ff150 msgr2=0x7f2d0c10fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:37.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.639+0000 7f2d0a000700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d0c0ff150 0x7f2d0c10fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:37.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.639+0000 7f2d0a000700 1 -- 172.21.15.148:0/1392508160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc005040 con 0x7f2d0c100360 2024-02-28T16:27:37.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.639+0000 7f2d0aa00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d0c0ff150 0x7f2d0c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:27:37.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.640+0000 7f2d0a000700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c100360 0x7f2d0c110100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c830 tx=0x7f2cf8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:37.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.641+0000 7f2d02a00700 1 -- 172.21.15.148:0/1392508160 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf800a760 con 0x7f2d0c100360 2024-02-28T16:27:37.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.641+0000 7f2d02a00700 1 -- 172.21.15.148:0/1392508160 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2cf800ad90 con 0x7f2d0c100360 2024-02-28T16:27:37.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.641+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c111280 con 0x7f2d0c100360 2024-02-28T16:27:37.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.641+0000 7f2d02a00700 1 -- 172.21.15.148:0/1392508160 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cf80113a0 con 0x7f2d0c100360 2024-02-28T16:27:37.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.641+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c1117c0 con 0x7f2d0c100360 2024-02-28T16:27:37.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.642+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c04bed0 con 0x7f2d0c100360 2024-02-28T16:27:37.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.644+0000 7f2d02a00700 1 -- 172.21.15.148:0/1392508160 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 27) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f2cf8011540 con 0x7f2d0c100360 2024-02-28T16:27:37.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.645+0000 7f2d02a00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f2cf006d0f0 0x7f2cf006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:37.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.646+0000 7f2d02a00700 1 -- 172.21.15.148:0/1392508160 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f2cf808c490 con 0x7f2d0c100360 2024-02-28T16:27:37.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.647+0000 7f2d0aa00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f2cf006d0f0 0x7f2cf006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:37.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.648+0000 7f2d0aa00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f2cf006d0f0 0x7f2cf006f5a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b7a0 tx=0x7f2cfc009e30 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:37.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:37.651+0000 7f2d02a00700 1 -- 172.21.15.148:0/1392508160 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2cf805a1f0 con 0x7f2d0c100360 2024-02-28T16:27:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.062+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d0c107c30 con 0x7f2d0c100360 2024-02-28T16:27:38.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.063+0000 7f2d02a00700 1 -- 172.21.15.148:0/1392508160 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f2cf8059d80 con 0x7f2d0c100360 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:27:38.053 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:27:38.054 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:27:38.054 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:27:38.054 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:27:38.054 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:27:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f2cf006d0f0 msgr2=0x7f2cf006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f2cf006d0f0 0x7f2cf006f5a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00b7a0 tx=0x7f2cfc009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:38.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c100360 msgr2=0x7f2d0c110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c100360 0x7f2d0c110100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c830 tx=0x7f2cf8004470 comp rx=0 tx=0).stop 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 shutdown_connections 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7f2cf006d0f0 0x7f2cf006f5a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2d0c0ff150 0x7f2d0c10fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 --2- 172.21.15.148:0/1392508160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2d0c100360 0x7f2d0c110100 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 >> 172.21.15.148:0/1392508160 conn(0x7f2d0c0fa920 msgr2=0x7f2d0c103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 shutdown_connections 2024-02-28T16:27:38.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.066+0000 7f2d11a00700 1 -- 172.21.15.148:0/1392508160 wait complete. 2024-02-28T16:27:38.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:37 smithi157 ceph-mon[38346]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:38.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:37 smithi157 ceph-mon[38346]: pgmap v73: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 12 KiB/s rd, 685 KiB/s wr, 94 op/s 2024-02-28T16:27:38.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:37 smithi157 ceph-mon[38346]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:38.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:38.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:37 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:38.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.270+0000 7ff67d200700 1 -- 172.21.15.148:0/2607775310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806eeb0 msgr2=0x7ff67810b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:38.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.270+0000 7ff67d200700 1 --2- 172.21.15.148:0/2607775310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806eeb0 0x7ff67810b1c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff664004940 tx=0x7ff664009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:38.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.270+0000 7ff67d200700 1 -- 172.21.15.148:0/2607775310 shutdown_connections 2024-02-28T16:27:38.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.270+0000 7ff67d200700 1 --2- 172.21.15.148:0/2607775310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806eeb0 0x7ff67810b1c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.270+0000 7ff67d200700 1 --2- 172.21.15.148:0/2607775310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff67806e560 0x7ff67806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.270+0000 7ff67d200700 1 -- 172.21.15.148:0/2607775310 >> 172.21.15.148:0/2607775310 conn(0x7ff678069e70 msgr2=0x7ff67806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:38.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:37 smithi148 ceph-mon[28767]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:38.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:37 smithi148 ceph-mon[28767]: pgmap v73: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 12 KiB/s rd, 685 KiB/s wr, 94 op/s 2024-02-28T16:27:38.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:37 smithi148 ceph-mon[28767]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:38.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:38.260 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:37 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:38.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.271+0000 7ff67d200700 1 -- 172.21.15.148:0/2607775310 shutdown_connections 2024-02-28T16:27:38.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.271+0000 7ff67d200700 1 -- 172.21.15.148:0/2607775310 wait complete. 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.273+0000 7ff67d200700 1 Processor -- start 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.273+0000 7ff67d200700 1 -- start start 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff67d200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806e560 0x7ff678107550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff67d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff67806eeb0 0x7ff678107a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff67d200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6781080e0 con 0x7ff67806e560 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff67d200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff678108980 con 0x7ff67806eeb0 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff675e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806e560 0x7ff678107550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:38.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff675e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806e560 0x7ff678107550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42496/0 (socket says 172.21.15.148:42496) 2024-02-28T16:27:38.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff675e00700 1 -- 172.21.15.148:0/4275044721 learned_addr learned my addr 172.21.15.148:0/4275044721 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:27:38.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.274+0000 7ff675400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff67806eeb0 0x7ff678107a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:38.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.275+0000 7ff675400700 1 -- 172.21.15.148:0/4275044721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806e560 msgr2=0x7ff678107550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.275+0000 7ff675400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806e560 0x7ff678107550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.275+0000 7ff675400700 1 -- 172.21.15.148:0/4275044721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664005040 con 0x7ff67806eeb0 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.275+0000 7ff675400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff67806eeb0 0x7ff678107a90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff664009fd0 tx=0x7ff664009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.276+0000 7ff66e000700 1 -- 172.21.15.148:0/4275044721 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66400e040 con 0x7ff67806eeb0 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.276+0000 7ff67d200700 1 -- 172.21.15.148:0/4275044721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff678108c00 con 0x7ff67806eeb0 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.276+0000 7ff66e000700 1 -- 172.21.15.148:0/4275044721 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff66400bbf0 con 0x7ff67806eeb0 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.276+0000 7ff66e000700 1 -- 172.21.15.148:0/4275044721 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff66401c3f0 con 0x7ff67806eeb0 2024-02-28T16:27:38.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.277+0000 7ff67d200700 1 -- 172.21.15.148:0/4275044721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff678109140 con 0x7ff67806eeb0 2024-02-28T16:27:38.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.280+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6500052b0 con 0x7ff67806eeb0 2024-02-28T16:27:38.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.280+0000 7ff66e000700 1 -- 172.21.15.148:0/4275044721 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 27) v1 ==== 91201+0+0 (secure 0 0 0) 0x7ff664013420 con 0x7ff67806eeb0 2024-02-28T16:27:38.271 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.282+0000 7ff66e000700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7ff65c06d0f0 0x7ff65c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:27:38.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.282+0000 7ff66e000700 1 -- 172.21.15.148:0/4275044721 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff66408d340 con 0x7ff67806eeb0 2024-02-28T16:27:38.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.283+0000 7ff675e00700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7ff65c06d0f0 0x7ff65c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:27:38.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.284+0000 7ff675e00700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7ff65c06d0f0 0x7ff65c06f5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6781072e0 tx=0x7ff668009040 comp rx=0 tx=0).ready entity=mgr.24351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:27:38.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.291+0000 7ff66e000700 1 -- 172.21.15.148:0/4275044721 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff664057470 con 0x7ff67806eeb0 2024-02-28T16:27:38.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.599+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 --> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff650000bc0 con 0x7ff65c06d0f0 2024-02-28T16:27:38.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.602+0000 7ff66e000700 1 -- 172.21.15.148:0/4275044721 <== mgr.24351 v2:172.21.15.157:6828/3805996438 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7ff650000bc0 con 0x7ff65c06d0f0 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:27:38.592 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:27:38.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7ff65c06d0f0 msgr2=0x7ff65c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:38.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7ff65c06d0f0 0x7ff65c06f5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6781072e0 tx=0x7ff668009040 comp rx=0 tx=0).stop 2024-02-28T16:27:38.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff67806eeb0 msgr2=0x7ff678107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:27:38.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff67806eeb0 0x7ff678107a90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff664009fd0 tx=0x7ff664009e30 comp rx=0 tx=0).stop 2024-02-28T16:27:38.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 shutdown_connections 2024-02-28T16:27:38.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:6828/3805996438,v1:172.21.15.157:6829/3805996438] conn(0x7ff65c06d0f0 0x7ff65c06f5a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff67806e560 0x7ff678107550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 --2- 172.21.15.148:0/4275044721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff67806eeb0 0x7ff678107a90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:27:38.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.605+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 >> 172.21.15.148:0/4275044721 conn(0x7ff678069e70 msgr2=0x7ff678105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:27:38.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.606+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 shutdown_connections 2024-02-28T16:27:38.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:27:38.606+0000 7ff663400700 1 -- 172.21.15.148:0/4275044721 wait complete. 2024-02-28T16:27:39.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:38 smithi157 ceph-mon[38346]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:39.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:38 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1392508160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:39.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:38 smithi148 ceph-mon[28767]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:39.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:38 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1392508160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:27:40.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:39 smithi157 ceph-mon[38346]: pgmap v74: 65 pgs: 65 active+clean; 1.5 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-02-28T16:27:40.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:39 smithi157 ceph-mon[38346]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:40.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:39 smithi148 ceph-mon[28767]: pgmap v74: 65 pgs: 65 active+clean; 1.5 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 141 op/s 2024-02-28T16:27:40.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:39 smithi148 ceph-mon[28767]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:27:41.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:41 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:41.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:41 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:41.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:41 smithi148 ceph-mon[28767]: pgmap v75: 65 pgs: 65 active+clean; 1.5 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 16 KiB/s rd, 817 KiB/s wr, 96 op/s 2024-02-28T16:27:41.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:41 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:41.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:41 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:41.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:41 smithi157 ceph-mon[38346]: pgmap v75: 65 pgs: 65 active+clean; 1.5 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 16 KiB/s rd, 817 KiB/s wr, 96 op/s 2024-02-28T16:27:43.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:43 smithi148 ceph-mon[28767]: pgmap v76: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-02-28T16:27:43.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:43 smithi157 ceph-mon[38346]: pgmap v76: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 27 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-02-28T16:27:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:45 smithi148 ceph-mon[28767]: pgmap v77: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 20 KiB/s rd, 915 KiB/s wr, 85 op/s 2024-02-28T16:27:46.186 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:45 smithi157 ceph-mon[38346]: pgmap v77: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 20 KiB/s rd, 915 KiB/s wr, 85 op/s 2024-02-28T16:27:47.048 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:46 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:46 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:48.079 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:47 smithi148 ceph-mon[28767]: pgmap v78: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 20 KiB/s rd, 915 KiB/s wr, 85 op/s 2024-02-28T16:27:48.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:47 smithi157 ceph-mon[38346]: pgmap v78: 65 pgs: 65 active+clean; 1.1 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 20 KiB/s rd, 915 KiB/s wr, 85 op/s 2024-02-28T16:27:50.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:49 smithi157 ceph-mon[38346]: pgmap v79: 65 pgs: 65 active+clean; 809 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2024-02-28T16:27:50.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:49 smithi148 ceph-mon[28767]: pgmap v79: 65 pgs: 65 active+clean; 809 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 29 KiB/s rd, 1.3 MiB/s wr, 120 op/s 2024-02-28T16:27:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:51.293 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr fail", "who": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr fail", "who": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd='[{"prefix": "mgr fail", "who": "smithi157.cmcxzj"}]': finished 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: mgrmap e28: smithi148.gelspy(active, starting, since 0.0153216s) 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:27:51.294 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:27:51.295 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:27:51.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 172.21.15.157:0/3097224919' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr fail", "who": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "mgr fail", "who": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24351 ' entity='mgr.smithi157.cmcxzj' cmd='[{"prefix": "mgr fail", "who": "smithi157.cmcxzj"}]': finished 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: mgrmap e28: smithi148.gelspy(active, starting, since 0.0153216s) 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:27:51.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:27:51.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:27:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:27:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:27:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:27:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:27:51.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:27:52.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:52 smithi157 ceph-mon[38346]: [28/Feb/2024:16:27:51] ENGINE Bus STARTING 2024-02-28T16:27:52.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:52 smithi157 ceph-mon[38346]: [28/Feb/2024:16:27:51] ENGINE Serving on http://172.21.15.148:8765 2024-02-28T16:27:52.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:52 smithi157 ceph-mon[38346]: [28/Feb/2024:16:27:51] ENGINE Serving on https://172.21.15.148:7150 2024-02-28T16:27:52.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:52 smithi157 ceph-mon[38346]: [28/Feb/2024:16:27:51] ENGINE Bus STARTED 2024-02-28T16:27:52.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:52 smithi157 ceph-mon[38346]: mgrmap e29: smithi148.gelspy(active, since 1.01618s) 2024-02-28T16:27:52.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:52 smithi157 ceph-mon[38346]: pgmap v3: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:52.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:52 smithi148 ceph-mon[28767]: [28/Feb/2024:16:27:51] ENGINE Bus STARTING 2024-02-28T16:27:52.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:52 smithi148 ceph-mon[28767]: [28/Feb/2024:16:27:51] ENGINE Serving on http://172.21.15.148:8765 2024-02-28T16:27:52.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:52 smithi148 ceph-mon[28767]: [28/Feb/2024:16:27:51] ENGINE Serving on https://172.21.15.148:7150 2024-02-28T16:27:52.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:52 smithi148 ceph-mon[28767]: [28/Feb/2024:16:27:51] ENGINE Bus STARTED 2024-02-28T16:27:52.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:52 smithi148 ceph-mon[28767]: mgrmap e29: smithi148.gelspy(active, since 1.01618s) 2024-02-28T16:27:52.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:52 smithi148 ceph-mon[28767]: pgmap v3: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:53.268 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T16:27:53.268 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-28T16:27:53.641 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:53 smithi157 ceph-mon[38346]: pgmap v4: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:53.641 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:53 smithi157 ceph-mon[38346]: mgrmap e30: smithi148.gelspy(active, since 2s) 2024-02-28T16:27:53.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:53 smithi148 ceph-mon[28767]: pgmap v4: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:53.707 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:53 smithi148 ceph-mon[28767]: mgrmap e30: smithi148.gelspy(active, since 2s) 2024-02-28T16:27:55.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:55 smithi157 ceph-mon[38346]: pgmap v5: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:55.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:55 smithi157 ceph-mon[38346]: mgrmap e31: smithi148.gelspy(active, since 4s) 2024-02-28T16:27:55.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:55 smithi148 ceph-mon[28767]: pgmap v5: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:55.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:55 smithi148 ceph-mon[28767]: mgrmap e31: smithi148.gelspy(active, since 4s) 2024-02-28T16:27:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:56 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:56 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:56.983 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:56 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:56.984 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:56 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:57.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:57 smithi148 ceph-mon[28767]: pgmap v6: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:57.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:57 smithi157 ceph-mon[38346]: pgmap v6: 65 pgs: 65 active+clean; 539 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail 2024-02-28T16:27:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:58.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:58 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:58.805 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:58 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:27:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:27:59 smithi148 ceph-mon[28767]: pgmap v7: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 846 KiB/s wr, 97 op/s 2024-02-28T16:27:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:27:59 smithi157 ceph-mon[38346]: pgmap v7: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 50 KiB/s rd, 846 KiB/s wr, 97 op/s 2024-02-28T16:28:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:00 smithi157 ceph-mon[38346]: pgmap v8: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 658 KiB/s wr, 75 op/s 2024-02-28T16:28:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:00 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:28:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:00 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:28:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:00 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:28:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:00 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:28:01.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:00 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:28:01.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:00 smithi148 ceph-mon[28767]: pgmap v8: 65 pgs: 65 active+clean; 291 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 658 KiB/s wr, 75 op/s 2024-02-28T16:28:01.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:00 smithi148 ceph-mon[28767]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:28:01.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:00 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:28:01.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:00 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:28:01.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:00 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:28:01.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:00 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/2982368303' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:28:02.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:01 smithi157 ceph-mon[38346]: mgrmap e32: smithi148.gelspy(active, since 10s), standbys: smithi157.cmcxzj 2024-02-28T16:28:02.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:01 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:28:02.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:01 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:02.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:01 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:02.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:01 smithi148 ceph-mon[28767]: mgrmap e32: smithi148.gelspy(active, since 10s), standbys: smithi157.cmcxzj 2024-02-28T16:28:02.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:01 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:28:02.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:01 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:02.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:01 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:03.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:02 smithi157 ceph-mon[38346]: pgmap v9: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-02-28T16:28:03.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:02 smithi148 ceph-mon[28767]: pgmap v9: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-02-28T16:28:04.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:04 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:04.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:04 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:04.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:04 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:04.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:04 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:05.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:05 smithi148 ceph-mon[28767]: pgmap v10: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-02-28T16:28:05.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:05 smithi157 ceph-mon[38346]: pgmap v10: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-02-28T16:28:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:06 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:06.514 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:06 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:07.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:07 smithi157 ceph-mon[38346]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-02-28T16:28:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:07 smithi148 ceph-mon[28767]: pgmap v11: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-02-28T16:28:08.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.790+0000 7f1f40800700 1 -- 172.21.15.148:0/486991623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 msgr2=0x7f1f38070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:08.779 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.790+0000 7f1f40800700 1 --2- 172.21.15.148:0/486991623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38070320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c004940 tx=0x7f1f2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:08.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.790+0000 7f1f40800700 1 -- 172.21.15.148:0/486991623 shutdown_connections 2024-02-28T16:28:08.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.790+0000 7f1f40800700 1 --2- 172.21.15.148:0/486991623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f38070860 0x7f1f38070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.790+0000 7f1f40800700 1 --2- 172.21.15.148:0/486991623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38070320 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.790+0000 7f1f40800700 1 -- 172.21.15.148:0/486991623 >> 172.21.15.148:0/486991623 conn(0x7f1f380f8620 msgr2=0x7f1f380faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.791+0000 7f1f40800700 1 -- 172.21.15.148:0/486991623 shutdown_connections 2024-02-28T16:28:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.791+0000 7f1f40800700 1 -- 172.21.15.148:0/486991623 wait complete. 2024-02-28T16:28:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.792+0000 7f1f40800700 1 Processor -- start 2024-02-28T16:28:08.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.792+0000 7f1f40800700 1 -- start start 2024-02-28T16:28:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f40800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f38070860 0x7f1f3810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:08.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f40800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f40800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38110680 con 0x7f1f38071eb0 2024-02-28T16:28:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f40800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38110f20 con 0x7f1f38070860 2024-02-28T16:28:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f3d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f3d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47748/0 (socket says 172.21.15.148:47748) 2024-02-28T16:28:08.783 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f3d400700 1 -- 172.21.15.148:0/3537214665 learned_addr learned my addr 172.21.15.148:0/3537214665 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f3d400700 1 -- 172.21.15.148:0/3537214665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f38070860 msgr2=0x7f1f3810fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f3d400700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f38070860 0x7f1f3810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.793+0000 7f1f3d400700 1 -- 172.21.15.148:0/3537214665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c005040 con 0x7f1f38071eb0 2024-02-28T16:28:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.794+0000 7f1f3d400700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38110080 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c830 tx=0x7f1f28004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.794+0000 7f1f32000700 1 -- 172.21.15.148:0/3537214665 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2800a760 con 0x7f1f38071eb0 2024-02-28T16:28:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.794+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f38111200 con 0x7f1f38071eb0 2024-02-28T16:28:08.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.794+0000 7f1f32000700 1 -- 172.21.15.148:0/3537214665 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f2800ad90 con 0x7f1f38071eb0 2024-02-28T16:28:08.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.794+0000 7f1f32000700 1 -- 172.21.15.148:0/3537214665 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f280113a0 con 0x7f1f38071eb0 2024-02-28T16:28:08.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.794+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f38111740 con 0x7f1f38071eb0 2024-02-28T16:28:08.785 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.796+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3804bed0 con 0x7f1f38071eb0 2024-02-28T16:28:08.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.797+0000 7f1f32000700 1 -- 172.21.15.148:0/3537214665 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f1f28012400 con 0x7f1f38071eb0 2024-02-28T16:28:08.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.798+0000 7f1f32000700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1f2006d200 0x7f1f2006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:08.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.798+0000 7f1f32000700 1 -- 172.21.15.148:0/3537214665 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1f2808c710 con 0x7f1f38071eb0 2024-02-28T16:28:08.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.798+0000 7f1f3de00700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1f2006d200 0x7f1f2006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:08.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.799+0000 7f1f3de00700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1f2006d200 0x7f1f2006f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c004f90 tx=0x7f1f2c009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:08.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:08.804+0000 7f1f32000700 1 -- 172.21.15.148:0/3537214665 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1f2805a230 con 0x7f1f38071eb0 2024-02-28T16:28:09.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.117+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f38111390 con 0x7f1f2006d200 2024-02-28T16:28:09.108 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.119+0000 7f1f32000700 1 -- 172.21.15.148:0/3537214665 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f1f38111390 con 0x7f1f2006d200 2024-02-28T16:28:09.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1f2006d200 msgr2=0x7f1f2006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1f2006d200 0x7f1f2006f6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c004f90 tx=0x7f1f2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:09.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 msgr2=0x7f1f38110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38110080 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c830 tx=0x7f1f28004470 comp rx=0 tx=0).stop 2024-02-28T16:28:09.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 shutdown_connections 2024-02-28T16:28:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1f2006d200 0x7f1f2006f6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1f38070860 0x7f1f3810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 --2- 172.21.15.148:0/3537214665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1f38071eb0 0x7f1f38110080 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 >> 172.21.15.148:0/3537214665 conn(0x7f1f380f8620 msgr2=0x7f1f38102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 shutdown_connections 2024-02-28T16:28:09.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.122+0000 7f1f40800700 1 -- 172.21.15.148:0/3537214665 wait complete. 2024-02-28T16:28:09.125 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.308+0000 7efda0000700 1 -- 172.21.15.148:0/639858502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd98071f10 msgr2=0x7efd98070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.308+0000 7efda0000700 1 --2- 172.21.15.148:0/639858502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd98071f10 0x7efd98070380 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd8c004940 tx=0x7efd8c009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.308+0000 7efda0000700 1 -- 172.21.15.148:0/639858502 shutdown_connections 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.308+0000 7efda0000700 1 --2- 172.21.15.148:0/639858502 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd980708c0 0x7efd98070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.308+0000 7efda0000700 1 --2- 172.21.15.148:0/639858502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd98071f10 0x7efd98070380 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.308+0000 7efda0000700 1 -- 172.21.15.148:0/639858502 >> 172.21.15.148:0/639858502 conn(0x7efd980f8620 msgr2=0x7efd980faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.308+0000 7efda0000700 1 -- 172.21.15.148:0/639858502 shutdown_connections 2024-02-28T16:28:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.309+0000 7efda0000700 1 -- 172.21.15.148:0/639858502 wait complete. 2024-02-28T16:28:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.309+0000 7efda0000700 1 Processor -- start 2024-02-28T16:28:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efda0000700 1 -- start start 2024-02-28T16:28:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efda0000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd980708c0 0x7efd98113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efda0000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd98071f10 0x7efd98114470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efda0000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd98114a70 con 0x7efd980708c0 2024-02-28T16:28:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efda0000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd98115310 con 0x7efd98071f10 2024-02-28T16:28:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efd9d600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd980708c0 0x7efd98113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efd9d600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd980708c0 0x7efd98113f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47776/0 (socket says 172.21.15.148:47776) 2024-02-28T16:28:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.310+0000 7efd9d600700 1 -- 172.21.15.148:0/111090777 learned_addr learned my addr 172.21.15.148:0/111090777 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.311+0000 7efd9cc00700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd98071f10 0x7efd98114470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.311+0000 7efd9d600700 1 -- 172.21.15.148:0/111090777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd98071f10 msgr2=0x7efd98114470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.311+0000 7efd9d600700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd98071f10 0x7efd98114470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.311+0000 7efd9d600700 1 -- 172.21.15.148:0/111090777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd8c005040 con 0x7efd980708c0 2024-02-28T16:28:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.311+0000 7efd9d600700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd980708c0 0x7efd98113f30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3b0 tx=0x7efd8c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.312+0000 7efd95600700 1 -- 172.21.15.148:0/111090777 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8c00e040 con 0x7efd980708c0 2024-02-28T16:28:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.312+0000 7efd95600700 1 -- 172.21.15.148:0/111090777 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd8c00bd90 con 0x7efd980708c0 2024-02-28T16:28:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.312+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd98115590 con 0x7efd980708c0 2024-02-28T16:28:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.312+0000 7efd95600700 1 -- 172.21.15.148:0/111090777 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd8c01c630 con 0x7efd980708c0 2024-02-28T16:28:09.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.312+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd98115ad0 con 0x7efd980708c0 2024-02-28T16:28:09.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.313+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd9804bed0 con 0x7efd980708c0 2024-02-28T16:28:09.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.315+0000 7efd95600700 1 -- 172.21.15.148:0/111090777 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7efd8c0139f0 con 0x7efd980708c0 2024-02-28T16:28:09.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.316+0000 7efd95600700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd8006d200 0x7efd8006f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:09.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.316+0000 7efd95600700 1 -- 172.21.15.148:0/111090777 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efd8c08dcd0 con 0x7efd980708c0 2024-02-28T16:28:09.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.317+0000 7efd9cc00700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd8006d200 0x7efd8006f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:09.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.317+0000 7efd9cc00700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd8006d200 0x7efd8006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd84007fd0 tx=0x7efd84009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:09.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.321+0000 7efd95600700 1 -- 172.21.15.148:0/111090777 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efd8c05b6e0 con 0x7efd980708c0 2024-02-28T16:28:09.623 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.633+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd981000a0 con 0x7efd8006d200 2024-02-28T16:28:09.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.635+0000 7efd95600700 1 -- 172.21.15.148:0/111090777 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7efd981000a0 con 0x7efd8006d200 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.638+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd8006d200 msgr2=0x7efd8006f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.638+0000 7efda0000700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd8006d200 0x7efd8006f6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efd84007fd0 tx=0x7efd84009040 comp rx=0 tx=0).stop 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.638+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd980708c0 msgr2=0x7efd98113f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.638+0000 7efda0000700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd980708c0 0x7efd98113f30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3b0 tx=0x7efd8c009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.639+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 shutdown_connections 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.639+0000 7efda0000700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd8006d200 0x7efd8006f6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.639+0000 7efda0000700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd980708c0 0x7efd98113f30 secure :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efd8c00b3b0 tx=0x7efd8c009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.639+0000 7efda0000700 1 --2- 172.21.15.148:0/111090777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd98071f10 0x7efd98114470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.639+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 >> 172.21.15.148:0/111090777 conn(0x7efd980f8620 msgr2=0x7efd980fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:09.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.639+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 shutdown_connections 2024-02-28T16:28:09.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.639+0000 7efda0000700 1 -- 172.21.15.148:0/111090777 wait complete. 2024-02-28T16:28:09.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:09 smithi157 ceph-mon[38346]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-02-28T16:28:09.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 -- 172.21.15.148:0/236872891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14071e90 msgr2=0x7feb14070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 --2- 172.21.15.148:0/236872891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14071e90 0x7feb14070300 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb04004940 tx=0x7feb04009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:09.796 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:09 smithi148 ceph-mon[28767]: pgmap v12: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 -- 172.21.15.148:0/236872891 shutdown_connections 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 --2- 172.21.15.148:0/236872891 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb14070840 0x7feb14070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 --2- 172.21.15.148:0/236872891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14071e90 0x7feb14070300 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 -- 172.21.15.148:0/236872891 >> 172.21.15.148:0/236872891 conn(0x7feb140f8620 msgr2=0x7feb140faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 -- 172.21.15.148:0/236872891 shutdown_connections 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.807+0000 7feb1a800700 1 -- 172.21.15.148:0/236872891 wait complete. 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.808+0000 7feb1a800700 1 Processor -- start 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.808+0000 7feb1a800700 1 -- start start 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.808+0000 7feb1a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14070840 0x7feb1410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.808+0000 7feb1a800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb14071e90 0x7feb14110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:09.799 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.808+0000 7feb1a800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14110710 con 0x7feb14070840 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.808+0000 7feb1a800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb14110f50 con 0x7feb14071e90 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.808+0000 7feb13400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14070840 0x7feb1410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb13400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14070840 0x7feb1410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47798/0 (socket says 172.21.15.148:47798) 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb13400700 1 -- 172.21.15.148:0/693371127 learned_addr learned my addr 172.21.15.148:0/693371127 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb12a00700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb14071e90 0x7feb14110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb13400700 1 -- 172.21.15.148:0/693371127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb14071e90 msgr2=0x7feb14110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb13400700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb14071e90 0x7feb14110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb13400700 1 -- 172.21.15.148:0/693371127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04005040 con 0x7feb14070840 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb13400700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14070840 0x7feb1410fb40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb0400b3b0 tx=0x7feb04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb0b400700 1 -- 172.21.15.148:0/693371127 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb0400e040 con 0x7feb14070840 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb0b400700 1 -- 172.21.15.148:0/693371127 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb0400bd90 con 0x7feb14070840 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.809+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb141111d0 con 0x7feb14070840 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.810+0000 7feb0b400700 1 -- 172.21.15.148:0/693371127 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb0401c630 con 0x7feb14070840 2024-02-28T16:28:09.800 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.810+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb14111710 con 0x7feb14070840 2024-02-28T16:28:09.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.811+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1404bed0 con 0x7feb14070840 2024-02-28T16:28:09.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.812+0000 7feb0b400700 1 -- 172.21.15.148:0/693371127 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7feb040139f0 con 0x7feb14070840 2024-02-28T16:28:09.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.813+0000 7feb0b400700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7feaf806d200 0x7feaf806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.813+0000 7feb0b400700 1 -- 172.21.15.148:0/693371127 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7feb0408dcd0 con 0x7feb14070840 2024-02-28T16:28:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.814+0000 7feb12a00700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7feaf806d200 0x7feaf806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:09.803 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.814+0000 7feb12a00700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7feaf806d200 0x7feaf806f6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb00006fd0 tx=0x7feb00008040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:09.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:09.818+0000 7feb0b400700 1 -- 172.21.15.148:0/693371127 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7feb0405b6e0 con 0x7feb14070840 2024-02-28T16:28:10.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.071+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb14104570 con 0x7feaf806d200 2024-02-28T16:28:10.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.088+0000 7feb0b400700 1 -- 172.21.15.148:0/693371127 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7feb14104570 con 0x7feaf806d200 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (2m) 8s ago 13m 15.3M - 0.25.0 c8568f914cd2 e5165660981e 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (13m) 8s ago 13m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (12m) 14s ago 12m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (112s) 8s ago 13m 75.1M - 9.4.7 954c08fa6188 f71525960747 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (5m) 8s ago 5m 12.7M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (5m) 8s ago 5m 240M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (5m) 14s ago 5m 12.7M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (5m) 14s ago 5m 12.8M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (51s) 8s ago 15m 475M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:28:10.078 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283 running (3m) 14s ago 11m 77.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1ed96a6b633e 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (15m) 8s ago 15m 51.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (11m) 14s ago 11m 39.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (2m) 8s ago 13m 7680k - 1.5.0 0da6a335fe13 b4a9eedc9ace 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (63s) 14s ago 11m 7805k - 1.5.0 0da6a335fe13 366892c91a77 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (10m) 8s ago 10m 172M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (9m) 8s ago 9m 173M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (9m) 8s ago 9m 144M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (8m) 14s ago 8m 197M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (8m) 14s ago 8m 177M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (7m) 14s ago 7m 160M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:28:10.079 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (73s) 8s ago 12m 39.9M - 2.43.0 a07b618ecd1d 50c482d23f1c 2024-02-28T16:28:10.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7feaf806d200 msgr2=0x7feaf806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7feaf806d200 0x7feaf806f6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7feb00006fd0 tx=0x7feb00008040 comp rx=0 tx=0).stop 2024-02-28T16:28:10.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14070840 msgr2=0x7feb1410fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14070840 0x7feb1410fb40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb0400b3b0 tx=0x7feb04009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:10.081 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 shutdown_connections 2024-02-28T16:28:10.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7feaf806d200 0x7feaf806f6b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb14070840 0x7feb1410fb40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 --2- 172.21.15.148:0/693371127 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb14071e90 0x7feb14110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 >> 172.21.15.148:0/693371127 conn(0x7feb140f8620 msgr2=0x7feb14102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:10.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.092+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 shutdown_connections 2024-02-28T16:28:10.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.093+0000 7feb1a800700 1 -- 172.21.15.148:0/693371127 wait complete. 2024-02-28T16:28:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.293+0000 7fcedd800700 1 -- 172.21.15.148:0/2366260370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced80663e0 msgr2=0x7fced80ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.293+0000 7fcedd800700 1 --2- 172.21.15.148:0/2366260370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced80663e0 0x7fced80ffaf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcec8004940 tx=0x7fcec8009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.293+0000 7fcedd800700 1 -- 172.21.15.148:0/2366260370 shutdown_connections 2024-02-28T16:28:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.293+0000 7fcedd800700 1 --2- 172.21.15.148:0/2366260370 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced81000c0 0x7fced8102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.293+0000 7fcedd800700 1 --2- 172.21.15.148:0/2366260370 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced80663e0 0x7fced80ffaf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.293+0000 7fcedd800700 1 -- 172.21.15.148:0/2366260370 >> 172.21.15.148:0/2366260370 conn(0x7fced80f74e0 msgr2=0x7fced80f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.294+0000 7fcedd800700 1 -- 172.21.15.148:0/2366260370 shutdown_connections 2024-02-28T16:28:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.294+0000 7fcedd800700 1 -- 172.21.15.148:0/2366260370 wait complete. 2024-02-28T16:28:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.295+0000 7fcedd800700 1 Processor -- start 2024-02-28T16:28:10.284 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.295+0000 7fcedd800700 1 -- start start 2024-02-28T16:28:10.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fcedd800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced80663e0 0x7fced810fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:10.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fcedd800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81000c0 0x7fced8110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:10.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fcedd800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8110680 con 0x7fced81000c0 2024-02-28T16:28:10.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fcedd800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced8110f20 con 0x7fced80663e0 2024-02-28T16:28:10.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fced6000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81000c0 0x7fced8110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:10.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fced6000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81000c0 0x7fced8110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47822/0 (socket says 172.21.15.148:47822) 2024-02-28T16:28:10.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fced6000700 1 -- 172.21.15.148:0/2156873675 learned_addr learned my addr 172.21.15.148:0/2156873675 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:10.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.296+0000 7fced6a00700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced80663e0 0x7fced810fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fced6000700 1 -- 172.21.15.148:0/2156873675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced80663e0 msgr2=0x7fced810fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fced6000700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced80663e0 0x7fced810fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fced6000700 1 -- 172.21.15.148:0/2156873675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8005040 con 0x7fced81000c0 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fced6000700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81000c0 0x7fced8110080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcec400eb40 tx=0x7fcec400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fcecea00700 1 -- 172.21.15.148:0/2156873675 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec4007cc0 con 0x7fced81000c0 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fcecea00700 1 -- 172.21.15.148:0/2156873675 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcec400f040 con 0x7fced81000c0 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fcecea00700 1 -- 172.21.15.148:0/2156873675 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcec400c9d0 con 0x7fced81000c0 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced81111a0 con 0x7fced81000c0 2024-02-28T16:28:10.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.297+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced8111690 con 0x7fced81000c0 2024-02-28T16:28:10.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.299+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced804bed0 con 0x7fced81000c0 2024-02-28T16:28:10.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.301+0000 7fcecea00700 1 -- 172.21.15.148:0/2156873675 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7fcec400cc40 con 0x7fced81000c0 2024-02-28T16:28:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.302+0000 7fcecea00700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcebc06d200 0x7fcebc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.302+0000 7fcecea00700 1 -- 172.21.15.148:0/2156873675 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcec408c2f0 con 0x7fced81000c0 2024-02-28T16:28:10.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.302+0000 7fced6a00700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcebc06d200 0x7fcebc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:10.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.303+0000 7fced6a00700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcebc06d200 0x7fcebc06f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcec80136a0 tx=0x7fcec8009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:10.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.308+0000 7fcecea00700 1 -- 172.21.15.148:0/2156873675 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcec4059cb0 con 0x7fced81000c0 2024-02-28T16:28:10.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:10 smithi148 ceph-mon[28767]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:10.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:10 smithi148 ceph-mon[28767]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:10.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.710+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fced8111b50 con 0x7fced81000c0 2024-02-28T16:28:10.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.711+0000 7fcecea00700 1 -- 172.21.15.148:0/2156873675 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fcec4059840 con 0x7fced81000c0 2024-02-28T16:28:10.700 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:10.701 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:28:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:28:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:28:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:28:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:10.702 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:28:10.702 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:28:10.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcebc06d200 msgr2=0x7fcebc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcebc06d200 0x7fcebc06f6b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcec80136a0 tx=0x7fcec8009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:10.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81000c0 msgr2=0x7fced8110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81000c0 0x7fced8110080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcec400eb40 tx=0x7fcec400b040 comp rx=0 tx=0).stop 2024-02-28T16:28:10.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 shutdown_connections 2024-02-28T16:28:10.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcebc06d200 0x7fcebc06f6b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fced80663e0 0x7fced810fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 --2- 172.21.15.148:0/2156873675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fced81000c0 0x7fced8110080 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 >> 172.21.15.148:0/2156873675 conn(0x7fced80f74e0 msgr2=0x7fced80fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:10.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 shutdown_connections 2024-02-28T16:28:10.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.714+0000 7fcedd800700 1 -- 172.21.15.148:0/2156873675 wait complete. 2024-02-28T16:28:10.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:10 smithi157 ceph-mon[38346]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:10.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:10 smithi157 ceph-mon[38346]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:10.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 -- 172.21.15.148:0/696523743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fb870 msgr2=0x7faf280fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 --2- 172.21.15.148:0/696523743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fb870 0x7faf280fbc80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf1c004940 tx=0x7faf1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:10.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 -- 172.21.15.148:0/696523743 shutdown_connections 2024-02-28T16:28:10.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 --2- 172.21.15.148:0/696523743 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf280fc1c0 0x7faf280fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 --2- 172.21.15.148:0/696523743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fb870 0x7faf280fbc80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 -- 172.21.15.148:0/696523743 >> 172.21.15.148:0/696523743 conn(0x7faf280f74e0 msgr2=0x7faf280f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:10.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 -- 172.21.15.148:0/696523743 shutdown_connections 2024-02-28T16:28:10.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.889+0000 7faf30800700 1 -- 172.21.15.148:0/696523743 wait complete. 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.890+0000 7faf30800700 1 Processor -- start 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.892+0000 7faf30800700 1 -- start start 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.892+0000 7faf30800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf280fb870 0x7faf28113f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.893+0000 7faf30800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fc1c0 0x7faf28114490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.893+0000 7faf30800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28114b20 con 0x7faf280fc1c0 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.893+0000 7faf30800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28115360 con 0x7faf280fb870 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.893+0000 7faf2d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fc1c0 0x7faf28114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.893+0000 7faf2d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fc1c0 0x7faf28114490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47832/0 (socket says 172.21.15.148:47832) 2024-02-28T16:28:10.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.893+0000 7faf2d400700 1 -- 172.21.15.148:0/1481661278 learned_addr learned my addr 172.21.15.148:0/1481661278 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:10.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.894+0000 7faf2d400700 1 -- 172.21.15.148:0/1481661278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf280fb870 msgr2=0x7faf28113f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:10.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.894+0000 7faf2d400700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf280fb870 0x7faf28113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:10.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.894+0000 7faf2d400700 1 -- 172.21.15.148:0/1481661278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c005040 con 0x7faf280fc1c0 2024-02-28T16:28:10.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.895+0000 7faf2d400700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fc1c0 0x7faf28114490 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b790 tx=0x7faf18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:10.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.895+0000 7faf22000700 1 -- 172.21.15.148:0/1481661278 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1800f770 con 0x7faf280fc1c0 2024-02-28T16:28:10.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.896+0000 7faf22000700 1 -- 172.21.15.148:0/1481661278 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf1800fda0 con 0x7faf280fc1c0 2024-02-28T16:28:10.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.896+0000 7faf22000700 1 -- 172.21.15.148:0/1481661278 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1800d310 con 0x7faf280fc1c0 2024-02-28T16:28:10.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.896+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf28115640 con 0x7faf280fc1c0 2024-02-28T16:28:10.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.897+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf28115b80 con 0x7faf280fc1c0 2024-02-28T16:28:10.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.899+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf28102910 con 0x7faf280fc1c0 2024-02-28T16:28:10.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.900+0000 7faf22000700 1 -- 172.21.15.148:0/1481661278 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7faf1800d4f0 con 0x7faf280fc1c0 2024-02-28T16:28:10.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.903+0000 7faf22000700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faf1006d2d0 0x7faf1006f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:10.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.904+0000 7faf22000700 1 -- 172.21.15.148:0/1481661278 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7faf1808c6e0 con 0x7faf280fc1c0 2024-02-28T16:28:10.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.905+0000 7faf2de00700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faf1006d2d0 0x7faf1006f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:10.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.906+0000 7faf2de00700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faf1006d2d0 0x7faf1006f780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faf1c004f90 tx=0x7faf1c009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:10.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:10.912+0000 7faf22000700 1 -- 172.21.15.148:0/1481661278 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7faf1805b210 con 0x7faf280fc1c0 2024-02-28T16:28:11.237 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.248+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf28115f60 con 0x7faf1006d2d0 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.250+0000 7faf22000700 1 -- 172.21.15.148:0/1481661278 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7faf28115f60 con 0x7faf1006d2d0 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T16:28:11.239 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "", 2024-02-28T16:28:11.240 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:28:11.240 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faf1006d2d0 msgr2=0x7faf1006f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faf1006d2d0 0x7faf1006f780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faf1c004f90 tx=0x7faf1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fc1c0 msgr2=0x7faf28114490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fc1c0 0x7faf28114490 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faf1800b790 tx=0x7faf18009250 comp rx=0 tx=0).stop 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 shutdown_connections 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faf1006d2d0 0x7faf1006f780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf280fb870 0x7faf28113f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 --2- 172.21.15.148:0/1481661278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf280fc1c0 0x7faf28114490 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 >> 172.21.15.148:0/1481661278 conn(0x7faf280f74e0 msgr2=0x7faf280ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:11.243 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.253+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 shutdown_connections 2024-02-28T16:28:11.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:11.254+0000 7faf30800700 1 -- 172.21.15.148:0/1481661278 wait complete. 2024-02-28T16:28:11.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:11 smithi148 ceph-mon[28767]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:11.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:11 smithi148 ceph-mon[28767]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-02-28T16:28:11.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:11 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2156873675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:11.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:11 smithi157 ceph-mon[38346]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:11.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:11 smithi157 ceph-mon[38346]: pgmap v13: 65 pgs: 65 active+clean; 290 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-02-28T16:28:11.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:11 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2156873675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:12.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:12 smithi157 ceph-mon[38346]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:12.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:12 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:12.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:12 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:12.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:12 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:12.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:12 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:12.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:12 smithi148 ceph-mon[28767]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:12.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:12 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:12.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:12 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:12.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:12 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:12.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:12 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:13 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:28:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:13 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:28:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:13 smithi157 ceph-mon[38346]: pgmap v14: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 110 op/s 2024-02-28T16:28:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:13 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:28:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:13 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:28:13.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:13 smithi148 ceph-mon[28767]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:28:13.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:13 smithi148 ceph-mon[28767]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:28:13.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:13 smithi148 ceph-mon[28767]: pgmap v14: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 110 op/s 2024-02-28T16:28:13.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:13 smithi148 ceph-mon[28767]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:28:13.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:13 smithi148 ceph-mon[28767]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:28:14.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:14 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:28:14.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:14 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:28:14.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:14 smithi148 ceph-mon[28767]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:28:14.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:14 smithi148 ceph-mon[28767]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:28:15.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:28:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:28:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: pgmap v15: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-02-28T16:28:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: pgmap v15: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 71 op/s 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:15.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:16.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:16 smithi148 ceph-mon[28767]: Reconfiguring prometheus.smithi148 (dependencies changed)... 2024-02-28T16:28:16.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:16 smithi148 ceph-mon[28767]: Reconfiguring daemon prometheus.smithi148 on smithi148 2024-02-28T16:28:16.876 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:16 smithi157 ceph-mon[38346]: Reconfiguring prometheus.smithi148 (dependencies changed)... 2024-02-28T16:28:16.876 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:16 smithi157 ceph-mon[38346]: Reconfiguring daemon prometheus.smithi148 on smithi148 2024-02-28T16:28:17.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:17 smithi148 ceph-mon[28767]: pgmap v16: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-02-28T16:28:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:17 smithi157 ceph-mon[38346]: pgmap v16: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 74 op/s 2024-02-28T16:28:19.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:19 smithi148 ceph-mon[28767]: pgmap v17: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 116 op/s 2024-02-28T16:28:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:19 smithi157 ceph-mon[38346]: pgmap v17: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 1.9 MiB/s wr, 116 op/s 2024-02-28T16:28:21.098 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:20 smithi148 ceph-mon[28767]: pgmap v18: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-02-28T16:28:21.098 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:20 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:20 smithi157 ceph-mon[38346]: pgmap v18: 65 pgs: 65 active+clean; 299 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-02-28T16:28:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:20 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:23.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:23 smithi157 ceph-mon[38346]: pgmap v19: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-02-28T16:28:23.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:23 smithi148 ceph-mon[28767]: pgmap v19: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-02-28T16:28:25.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:25 smithi148 ceph-mon[28767]: pgmap v20: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 78 op/s 2024-02-28T16:28:25.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:25 smithi157 ceph-mon[38346]: pgmap v20: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.1 MiB/s wr, 78 op/s 2024-02-28T16:28:27.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:27 smithi157 ceph-mon[38346]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.4 MiB/s wr, 96 op/s 2024-02-28T16:28:27.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:27.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:27.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:28:27.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:27.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:27 smithi148 ceph-mon[28767]: pgmap v21: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 1.4 MiB/s wr, 96 op/s 2024-02-28T16:28:27.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:27.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:27.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:28:27.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:28 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:28:28.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:28 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:28:29.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:29 smithi148 ceph-mon[28767]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-02-28T16:28:29.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:29 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:28:29.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:29 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:28:29.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:29 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:29 smithi157 ceph-mon[38346]: pgmap v22: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 110 op/s 2024-02-28T16:28:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:29 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:28:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:29 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:28:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:29 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:30.803 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:30 smithi157 ceph-mon[38346]: Upgrade: Updating mgr.smithi157.cmcxzj 2024-02-28T16:28:30.804 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:30 smithi157 ceph-mon[38346]: Deploying daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:28:30.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:30 smithi148 ceph-mon[28767]: Upgrade: Updating mgr.smithi157.cmcxzj 2024-02-28T16:28:30.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:30 smithi148 ceph-mon[28767]: Deploying daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:28:31.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:31 smithi148 ceph-mon[28767]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 969 KiB/s wr, 68 op/s 2024-02-28T16:28:31.956 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:31 smithi157 ceph-mon[38346]: pgmap v23: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 969 KiB/s wr, 68 op/s 2024-02-28T16:28:33.680 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:33 smithi157 ceph-mon[38346]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 109 op/s 2024-02-28T16:28:33.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:33 smithi148 ceph-mon[28767]: pgmap v24: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 109 op/s 2024-02-28T16:28:35.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:35 smithi157 ceph-mon[38346]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 955 KiB/s wr, 75 op/s 2024-02-28T16:28:35.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:35.805 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:35.806 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:35 smithi148 ceph-mon[28767]: pgmap v25: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 955 KiB/s wr, 75 op/s 2024-02-28T16:28:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:36.762 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:36 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:36.765 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:36 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:37.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:37 smithi157 ceph-mon[38346]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-02-28T16:28:37.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:37 smithi148 ceph-mon[28767]: pgmap v26: 65 pgs: 65 active+clean; 308 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-02-28T16:28:39.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:39 smithi148 ceph-mon[28767]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 102 op/s 2024-02-28T16:28:39.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:39 smithi157 ceph-mon[38346]: pgmap v27: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.2 MiB/s wr, 102 op/s 2024-02-28T16:28:41.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.486+0000 7f16cfa00700 1 -- 172.21.15.148:0/1383742233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 msgr2=0x7f16c80fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:41.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.486+0000 7f16cfa00700 1 --2- 172.21.15.148:0/1383742233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c80fe550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16b4004970 tx=0x7f16b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:41.476 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:41 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:41.476 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:41 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:41.476 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:41 smithi148 ceph-mon[28767]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 86 op/s 2024-02-28T16:28:41.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.486+0000 7f16cfa00700 1 -- 172.21.15.148:0/1383742233 shutdown_connections 2024-02-28T16:28:41.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.486+0000 7f16cfa00700 1 --2- 172.21.15.148:0/1383742233 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c80fe550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:41.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.486+0000 7f16cfa00700 1 --2- 172.21.15.148:0/1383742233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16c80fcef0 0x7f16c80fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:41.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.486+0000 7f16cfa00700 1 -- 172.21.15.148:0/1383742233 >> 172.21.15.148:0/1383742233 conn(0x7f16c80f8620 msgr2=0x7f16c80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:41.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.486+0000 7f16cfa00700 1 -- 172.21.15.148:0/1383742233 shutdown_connections 2024-02-28T16:28:41.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.487+0000 7f16cfa00700 1 -- 172.21.15.148:0/1383742233 wait complete. 2024-02-28T16:28:41.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.488+0000 7f16cfa00700 1 Processor -- start 2024-02-28T16:28:41.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.488+0000 7f16cfa00700 1 -- start start 2024-02-28T16:28:41.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16cfa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16c80fcef0 0x7f16c810b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:41.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16cfa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c810bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:41.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16cfa00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c810c1c0 con 0x7f16c80fcef0 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16cfa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c810ca60 con 0x7f16c80fe0e0 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16c7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c810bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16c7e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c810bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:49976/0 (socket says 172.21.15.148:49976) 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16c7e00700 1 -- 172.21.15.148:0/3149842927 learned_addr learned my addr 172.21.15.148:0/3149842927 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16cd000700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16c80fcef0 0x7f16c810b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.489+0000 7f16c7e00700 1 -- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16c80fcef0 msgr2=0x7f16c810b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.490+0000 7f16c7e00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16c80fcef0 0x7f16c810b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:41.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.490+0000 7f16c7e00700 1 -- 172.21.15.148:0/3149842927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b4005040 con 0x7f16c80fe0e0 2024-02-28T16:28:41.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.490+0000 7f16c7e00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c810bb70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16b400b370 tx=0x7f16b4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:41.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.491+0000 7f16c4c00700 1 -- 172.21.15.148:0/3149842927 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16b400e040 con 0x7f16c80fe0e0 2024-02-28T16:28:41.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.491+0000 7f16c4c00700 1 -- 172.21.15.148:0/3149842927 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f16b4004290 con 0x7f16c80fe0e0 2024-02-28T16:28:41.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.491+0000 7f16c4c00700 1 -- 172.21.15.148:0/3149842927 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16b400bcb0 con 0x7f16c80fe0e0 2024-02-28T16:28:41.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.491+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c810cce0 con 0x7f16c80fe0e0 2024-02-28T16:28:41.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.492+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c810d220 con 0x7f16c80fe0e0 2024-02-28T16:28:41.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.495+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c80fc2a0 con 0x7f16c80fe0e0 2024-02-28T16:28:41.485 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.496+0000 7f16c4c00700 1 -- 172.21.15.148:0/3149842927 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f16b4013c80 con 0x7f16c80fe0e0 2024-02-28T16:28:41.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:41 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:41.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:41 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:41.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:41 smithi157 ceph-mon[38346]: pgmap v28: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.1 MiB/s wr, 86 op/s 2024-02-28T16:28:41.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.498+0000 7f16c4c00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f16b006d3a0 0x7f16b006f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:41.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.498+0000 7f16c4c00700 1 -- 172.21.15.148:0/3149842927 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f16b408da20 con 0x7f16c80fe0e0 2024-02-28T16:28:41.490 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.501+0000 7f16cd000700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f16b006d3a0 0x7f16b006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:41.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.502+0000 7f16cd000700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f16b006d3a0 0x7f16b006f850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f16c810b3c0 tx=0x7f16bc009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:41.493 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.503+0000 7f16c4c00700 1 -- 172.21.15.148:0/3149842927 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f16b40579b0 con 0x7f16c80fe0e0 2024-02-28T16:28:41.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.865+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16c810d5c0 con 0x7f16b006d3a0 2024-02-28T16:28:41.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.866+0000 7f16c4c00700 1 -- 172.21.15.148:0/3149842927 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f16c810d5c0 con 0x7f16b006d3a0 2024-02-28T16:28:41.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f16b006d3a0 msgr2=0x7f16b006f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:41.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f16b006d3a0 0x7f16b006f850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f16c810b3c0 tx=0x7f16bc009040 comp rx=0 tx=0).stop 2024-02-28T16:28:41.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 msgr2=0x7f16c810bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:41.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c810bb70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16b400b370 tx=0x7f16b4009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:41.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 shutdown_connections 2024-02-28T16:28:41.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f16b006d3a0 0x7f16b006f850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:41.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16c80fcef0 0x7f16c810b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:41.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 --2- 172.21.15.148:0/3149842927 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16c80fe0e0 0x7f16c810bb70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:41.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.869+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 >> 172.21.15.148:0/3149842927 conn(0x7f16c80f8620 msgr2=0x7f16c80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:41.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.870+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 shutdown_connections 2024-02-28T16:28:41.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:41.870+0000 7f16cfa00700 1 -- 172.21.15.148:0/3149842927 wait complete. 2024-02-28T16:28:41.878 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:28:42.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 -- 172.21.15.148:0/342646666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 msgr2=0x7fcde0070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 --2- 172.21.15.148:0/342646666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 0x7fcde0070d10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc004940 tx=0x7fcdcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:42.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 -- 172.21.15.148:0/342646666 shutdown_connections 2024-02-28T16:28:42.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 --2- 172.21.15.148:0/342646666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 0x7fcde0070d10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 --2- 172.21.15.148:0/342646666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 0x7fcde0070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 -- 172.21.15.148:0/342646666 >> 172.21.15.148:0/342646666 conn(0x7fcde00f8620 msgr2=0x7fcde00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:42.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 -- 172.21.15.148:0/342646666 shutdown_connections 2024-02-28T16:28:42.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.048+0000 7fcde6a00700 1 -- 172.21.15.148:0/342646666 wait complete. 2024-02-28T16:28:42.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.049+0000 7fcde6a00700 1 Processor -- start 2024-02-28T16:28:42.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.049+0000 7fcde6a00700 1 -- start start 2024-02-28T16:28:42.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcde6a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 0x7fcde010fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:42.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcde6a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 0x7fcde0110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:42.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcde6a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0110650 con 0x7fcde00708c0 2024-02-28T16:28:42.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcde6a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0110ef0 con 0x7fcde0071f10 2024-02-28T16:28:42.039 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcddf400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 0x7fcde0110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:42.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcddfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 0x7fcde010fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:42.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcddf400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 0x7fcde0110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:46962/0 (socket says 172.21.15.148:46962) 2024-02-28T16:28:42.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.050+0000 7fcddf400700 1 -- 172.21.15.148:0/1993620753 learned_addr learned my addr 172.21.15.148:0/1993620753 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:42.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.051+0000 7fcddf400700 1 -- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 msgr2=0x7fcde010fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.051+0000 7fcddf400700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 0x7fcde010fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.051+0000 7fcddf400700 1 -- 172.21.15.148:0/1993620753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc005040 con 0x7fcde0071f10 2024-02-28T16:28:42.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.051+0000 7fcddf400700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 0x7fcde0110050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009fd0 tx=0x7fcdcc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:42.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.052+0000 7fcdd7e00700 1 -- 172.21.15.148:0/1993620753 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdcc021070 con 0x7fcde0071f10 2024-02-28T16:28:42.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.052+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde0111170 con 0x7fcde0071f10 2024-02-28T16:28:42.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.052+0000 7fcdd7e00700 1 -- 172.21.15.148:0/1993620753 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdcc013de0 con 0x7fcde0071f10 2024-02-28T16:28:42.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.052+0000 7fcdd7e00700 1 -- 172.21.15.148:0/1993620753 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdcc00e070 con 0x7fcde0071f10 2024-02-28T16:28:42.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.052+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde01116b0 con 0x7fcde0071f10 2024-02-28T16:28:42.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.053+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde004bed0 con 0x7fcde0071f10 2024-02-28T16:28:42.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.055+0000 7fcdd7e00700 1 -- 172.21.15.148:0/1993620753 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7fcdcc01c690 con 0x7fcde0071f10 2024-02-28T16:28:42.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.056+0000 7fcdd7e00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcdc406d200 0x7fcdc406f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:42.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.056+0000 7fcdd7e00700 1 -- 172.21.15.148:0/1993620753 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcdcc08db10 con 0x7fcde0071f10 2024-02-28T16:28:42.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.056+0000 7fcddfe00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcdc406d200 0x7fcdc406f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:42.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.057+0000 7fcddfe00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcdc406d200 0x7fcdc406f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009b80 tx=0x7fcdd000b040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:42.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.074+0000 7fcdd7e00700 1 -- 172.21.15.148:0/1993620753 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fcdcc05b4a0 con 0x7fcde0071f10 2024-02-28T16:28:42.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.404+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcde0111b70 con 0x7fcdc406d200 2024-02-28T16:28:42.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.406+0000 7fcdd7e00700 1 -- 172.21.15.148:0/1993620753 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fcde0111b70 con 0x7fcdc406d200 2024-02-28T16:28:42.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.409+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcdc406d200 msgr2=0x7fcdc406f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.409+0000 7fcde6a00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcdc406d200 0x7fcdc406f6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009b80 tx=0x7fcdd000b040 comp rx=0 tx=0).stop 2024-02-28T16:28:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.409+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 msgr2=0x7fcde0110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.409+0000 7fcde6a00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 0x7fcde0110050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009fd0 tx=0x7fcdcc009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.410+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 shutdown_connections 2024-02-28T16:28:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.410+0000 7fcde6a00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fcdc406d200 0x7fcdc406f6b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.410+0000 7fcde6a00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde00708c0 0x7fcde010fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.410+0000 7fcde6a00700 1 --2- 172.21.15.148:0/1993620753 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcde0071f10 0x7fcde0110050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.410+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 >> 172.21.15.148:0/1993620753 conn(0x7fcde00f8620 msgr2=0x7fcde0102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:42.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.410+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 shutdown_connections 2024-02-28T16:28:42.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.410+0000 7fcde6a00700 1 -- 172.21.15.148:0/1993620753 wait complete. 2024-02-28T16:28:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.623+0000 7fdc9ee00700 1 -- 172.21.15.148:0/1833963685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc980fcef0 msgr2=0x7fdc980fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.623+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/1833963685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc980fcef0 0x7fdc980fd320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc88004970 tx=0x7fdc88009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.623+0000 7fdc9ee00700 1 -- 172.21.15.148:0/1833963685 shutdown_connections 2024-02-28T16:28:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.623+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/1833963685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc980fe0e0 0x7fdc980fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.623+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/1833963685 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc980fcef0 0x7fdc980fd320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.624+0000 7fdc9ee00700 1 -- 172.21.15.148:0/1833963685 >> 172.21.15.148:0/1833963685 conn(0x7fdc980f8620 msgr2=0x7fdc980faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.624+0000 7fdc9ee00700 1 -- 172.21.15.148:0/1833963685 shutdown_connections 2024-02-28T16:28:42.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.624+0000 7fdc9ee00700 1 -- 172.21.15.148:0/1833963685 wait complete. 2024-02-28T16:28:42.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.626+0000 7fdc9ee00700 1 Processor -- start 2024-02-28T16:28:42.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.627+0000 7fdc9ee00700 1 -- start start 2024-02-28T16:28:42.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.627+0000 7fdc9ee00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc980fe0e0 0x7fdc9810b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:42.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.627+0000 7fdc9ee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc9810bd80 0x7fdc9810cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:42.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.627+0000 7fdc9ee00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9810c240 con 0x7fdc980fe0e0 2024-02-28T16:28:42.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.627+0000 7fdc9ee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9810c380 con 0x7fdc9810bd80 2024-02-28T16:28:42.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.628+0000 7fdc8f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc9810bd80 0x7fdc9810cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:42.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.628+0000 7fdc8f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc9810bd80 0x7fdc9810cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.148:46980/0 (socket says 172.21.15.148:46980) 2024-02-28T16:28:42.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.628+0000 7fdc8f400700 1 -- 172.21.15.148:0/3264048266 learned_addr learned my addr 172.21.15.148:0/3264048266 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:42.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.628+0000 7fdc97e00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc980fe0e0 0x7fdc9810b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:42.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.629+0000 7fdc8f400700 1 -- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc980fe0e0 msgr2=0x7fdc9810b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.629+0000 7fdc8f400700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc980fe0e0 0x7fdc9810b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.618 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.629+0000 7fdc8f400700 1 -- 172.21.15.148:0/3264048266 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88005040 con 0x7fdc9810bd80 2024-02-28T16:28:42.620 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.631+0000 7fdc8f400700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc9810bd80 0x7fdc9810cc70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000ec90 tx=0x7fdc8000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:42.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.631+0000 7fdc94c00700 1 -- 172.21.15.148:0/3264048266 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc80007b30 con 0x7fdc9810bd80 2024-02-28T16:28:42.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.631+0000 7fdc94c00700 1 -- 172.21.15.148:0/3264048266 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc8000f040 con 0x7fdc9810bd80 2024-02-28T16:28:42.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.631+0000 7fdc94c00700 1 -- 172.21.15.148:0/3264048266 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc8000cc80 con 0x7fdc9810bd80 2024-02-28T16:28:42.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.631+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9810d270 con 0x7fdc9810bd80 2024-02-28T16:28:42.621 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.632+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9810d780 con 0x7fdc9810bd80 2024-02-28T16:28:42.622 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.633+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9810da60 con 0x7fdc9810bd80 2024-02-28T16:28:42.624 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.635+0000 7fdc94c00700 1 -- 172.21.15.148:0/3264048266 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7fdc80007c90 con 0x7fdc9810bd80 2024-02-28T16:28:42.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.636+0000 7fdc94c00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fdc7c06d2d0 0x7fdc7c06f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:42.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.636+0000 7fdc94c00700 1 -- 172.21.15.148:0/3264048266 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fdc8008cc50 con 0x7fdc9810bd80 2024-02-28T16:28:42.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.637+0000 7fdc97e00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fdc7c06d2d0 0x7fdc7c06f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:42.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.637+0000 7fdc97e00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fdc7c06d2d0 0x7fdc7c06f780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005010 tx=0x7fdc88009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:42.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.652+0000 7fdc94c00700 1 -- 172.21.15.148:0/3264048266 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fdc80056ab0 con 0x7fdc9810bd80 2024-02-28T16:28:42.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.987+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc980f9930 con 0x7fdc7c06d2d0 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:42.998+0000 7fdc94c00700 1 -- 172.21.15.148:0/3264048266 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdc980f9930 con 0x7fdc7c06d2d0 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (2m) 41s ago 14m 15.3M - 0.25.0 c8568f914cd2 e5165660981e 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (14m) 41s ago 14m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (12m) 2s ago 12m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (2m) 41s ago 13m 75.1M - 9.4.7 954c08fa6188 f71525960747 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (6m) 41s ago 6m 12.7M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (6m) 41s ago 6m 240M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (6m) 2s ago 6m 13.0M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:28:42.988 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (6m) 2s ago 6m 13.1M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (84s) 41s ago 15m 475M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (8s) 2s ago 12m 66.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (16m) 41s ago 16m 51.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (12m) 2s ago 12m 41.8M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (2m) 41s ago 14m 7680k - 1.5.0 0da6a335fe13 b4a9eedc9ace 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (96s) 2s ago 12m 7302k - 1.5.0 0da6a335fe13 366892c91a77 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (11m) 41s ago 11m 172M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (10m) 41s ago 10m 173M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (9m) 41s ago 9m 144M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (9m) 2s ago 9m 215M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (8m) 2s ago 8m 187M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (8m) 2s ago 8m 169M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:28:42.989 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 starting - - - - 2024-02-28T16:28:42.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fdc7c06d2d0 msgr2=0x7fdc7c06f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fdc7c06d2d0 0x7fdc7c06f780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005010 tx=0x7fdc88009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc9810bd80 msgr2=0x7fdc9810cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc9810bd80 0x7fdc9810cc70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc8000ec90 tx=0x7fdc8000b040 comp rx=0 tx=0).stop 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 shutdown_connections 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fdc7c06d2d0 0x7fdc7c06f780 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdc980fe0e0 0x7fdc9810b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 --2- 172.21.15.148:0/3264048266 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdc9810bd80 0x7fdc9810cc70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 >> 172.21.15.148:0/3264048266 conn(0x7fdc980f8620 msgr2=0x7fdc980f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 shutdown_connections 2024-02-28T16:28:42.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.002+0000 7fdc9ee00700 1 -- 172.21.15.148:0/3264048266 wait complete. 2024-02-28T16:28:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.168+0000 7fa30dc00700 1 -- 172.21.15.148:0/2586130463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3080fda80 msgr2=0x7fa3080ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.168+0000 7fa30dc00700 1 --2- 172.21.15.148:0/2586130463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3080fda80 0x7fa3080ffe60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8004940 tx=0x7fa2f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.168+0000 7fa30dc00700 1 -- 172.21.15.148:0/2586130463 shutdown_connections 2024-02-28T16:28:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.168+0000 7fa30dc00700 1 --2- 172.21.15.148:0/2586130463 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3081003a0 0x7fa308102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.168+0000 7fa30dc00700 1 --2- 172.21.15.148:0/2586130463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3080fda80 0x7fa3080ffe60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.168+0000 7fa30dc00700 1 -- 172.21.15.148:0/2586130463 >> 172.21.15.148:0/2586130463 conn(0x7fa3080f7520 msgr2=0x7fa3080f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.169+0000 7fa30dc00700 1 -- 172.21.15.148:0/2586130463 shutdown_connections 2024-02-28T16:28:43.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.169+0000 7fa30dc00700 1 -- 172.21.15.148:0/2586130463 wait complete. 2024-02-28T16:28:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.170+0000 7fa30dc00700 1 Processor -- start 2024-02-28T16:28:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.170+0000 7fa30dc00700 1 -- start start 2024-02-28T16:28:43.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.170+0000 7fa30dc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3080fda80 0x7fa30810fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.170+0000 7fa30dc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3081003a0 0x7fa30810ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.170+0000 7fa30dc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3081105a0 con 0x7fa3081003a0 2024-02-28T16:28:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.170+0000 7fa30dc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308110e40 con 0x7fa3080fda80 2024-02-28T16:28:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.171+0000 7fa306000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3081003a0 0x7fa30810ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.171+0000 7fa306a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3080fda80 0x7fa30810fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.171+0000 7fa306000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3081003a0 0x7fa30810ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42478/0 (socket says 172.21.15.148:42478) 2024-02-28T16:28:43.160 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.171+0000 7fa306000700 1 -- 172.21.15.148:0/1378641884 learned_addr learned my addr 172.21.15.148:0/1378641884 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.171+0000 7fa306a00700 1 -- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3081003a0 msgr2=0x7fa30810ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.171+0000 7fa306a00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3081003a0 0x7fa30810ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.171+0000 7fa306a00700 1 -- 172.21.15.148:0/1378641884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8005040 con 0x7fa3080fda80 2024-02-28T16:28:43.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.172+0000 7fa306a00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3080fda80 0x7fa30810fa60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8000c00 tx=0x7fa2f8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.172+0000 7fa2fea00700 1 -- 172.21.15.148:0/1378641884 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f800e040 con 0x7fa3080fda80 2024-02-28T16:28:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.172+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3081110c0 con 0x7fa3080fda80 2024-02-28T16:28:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.172+0000 7fa2fea00700 1 -- 172.21.15.148:0/1378641884 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2f8004290 con 0x7fa3080fda80 2024-02-28T16:28:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.172+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa308111600 con 0x7fa3080fda80 2024-02-28T16:28:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.172+0000 7fa2fea00700 1 -- 172.21.15.148:0/1378641884 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2f801c3f0 con 0x7fa3080fda80 2024-02-28T16:28:43.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.173+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3080f9050 con 0x7fa3080fda80 2024-02-28T16:28:43.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.174+0000 7fa2fea00700 1 -- 172.21.15.148:0/1378641884 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7fa2f8013420 con 0x7fa3080fda80 2024-02-28T16:28:43.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.175+0000 7fa2fea00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fa2ec06d200 0x7fa2ec06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:43.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.176+0000 7fa2fea00700 1 -- 172.21.15.148:0/1378641884 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fa2f808dad0 con 0x7fa3080fda80 2024-02-28T16:28:43.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.176+0000 7fa306000700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fa2ec06d200 0x7fa2ec06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:43.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.176+0000 7fa306000700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fa2ec06d200 0x7fa2ec06f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40102e0 tx=0x7fa2f400b040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:43.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.181+0000 7fa2fea00700 1 -- 172.21.15.148:0/1378641884 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fa2f805b4e0 con 0x7fa3080fda80 2024-02-28T16:28:43.277 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:43 smithi148 ceph-mon[28767]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:43.277 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:43 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:43.277 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:43 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:43.277 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:43 smithi148 ceph-mon[28767]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:43.277 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:43 smithi148 ceph-mon[28767]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 190 op/s 2024-02-28T16:28:43.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.642+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa30802b360 con 0x7fa3080fda80 2024-02-28T16:28:43.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.643+0000 7fa2fea00700 1 -- 172.21.15.148:0/1378641884 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fa2f805b070 con 0x7fa3080fda80 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:43.633 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:28:43.634 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:28:43.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.646+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fa2ec06d200 msgr2=0x7fa2ec06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.646+0000 7fa30dc00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fa2ec06d200 0x7fa2ec06f6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40102e0 tx=0x7fa2f400b040 comp rx=0 tx=0).stop 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.646+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3080fda80 msgr2=0x7fa30810fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.646+0000 7fa30dc00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3080fda80 0x7fa30810fa60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8000c00 tx=0x7fa2f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.647+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 shutdown_connections 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.647+0000 7fa30dc00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fa2ec06d200 0x7fa2ec06f6b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.647+0000 7fa30dc00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa3080fda80 0x7fa30810fa60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.647+0000 7fa30dc00700 1 --2- 172.21.15.148:0/1378641884 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa3081003a0 0x7fa30810ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.647+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 >> 172.21.15.148:0/1378641884 conn(0x7fa3080f7520 msgr2=0x7fa3080fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.647+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 shutdown_connections 2024-02-28T16:28:43.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.647+0000 7fa30dc00700 1 -- 172.21.15.148:0/1378641884 wait complete. 2024-02-28T16:28:43.647 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:43 smithi157 ceph-mon[38346]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:43.647 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:43 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:43.647 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:43 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:43.647 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:43 smithi157 ceph-mon[38346]: from='client.24491 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:43.647 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:43 smithi157 ceph-mon[38346]: pgmap v29: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 190 op/s 2024-02-28T16:28:43.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.840+0000 7ff63ba00700 1 -- 172.21.15.148:0/3925621301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6340ff150 msgr2=0x7ff6340ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:43.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.840+0000 7ff63ba00700 1 --2- 172.21.15.148:0/3925621301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6340ff150 0x7ff6340ff560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff628004940 tx=0x7ff628009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:43.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.840+0000 7ff63ba00700 1 -- 172.21.15.148:0/3925621301 shutdown_connections 2024-02-28T16:28:43.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.840+0000 7ff63ba00700 1 --2- 172.21.15.148:0/3925621301 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff634100360 0x7ff6341007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.840+0000 7ff63ba00700 1 --2- 172.21.15.148:0/3925621301 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff6340ff150 0x7ff6340ff560 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.840+0000 7ff63ba00700 1 -- 172.21.15.148:0/3925621301 >> 172.21.15.148:0/3925621301 conn(0x7ff6340fa920 msgr2=0x7ff6340fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:43.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.841+0000 7ff63ba00700 1 -- 172.21.15.148:0/3925621301 shutdown_connections 2024-02-28T16:28:43.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.841+0000 7ff63ba00700 1 -- 172.21.15.148:0/3925621301 wait complete. 2024-02-28T16:28:43.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.841+0000 7ff63ba00700 1 Processor -- start 2024-02-28T16:28:43.831 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff63ba00700 1 -- start start 2024-02-28T16:28:43.832 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff63ba00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6340ff150 0x7ff63410fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff63ba00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634100360 0x7ff634110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff63ba00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634110670 con 0x7ff634100360 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff63ba00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340763f0 con 0x7ff6340ff150 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff633e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634100360 0x7ff634110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff633e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634100360 0x7ff634110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:42488/0 (socket says 172.21.15.148:42488) 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.842+0000 7ff633e00700 1 -- 172.21.15.148:0/1483856550 learned_addr learned my addr 172.21.15.148:0/1483856550 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.843+0000 7ff639000700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6340ff150 0x7ff63410fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.843+0000 7ff633e00700 1 -- 172.21.15.148:0/1483856550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6340ff150 msgr2=0x7ff63410fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.843+0000 7ff633e00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6340ff150 0x7ff63410fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.843+0000 7ff633e00700 1 -- 172.21.15.148:0/1483856550 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628005040 con 0x7ff634100360 2024-02-28T16:28:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.843+0000 7ff633e00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634100360 0x7ff634110070 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff620004fa0 tx=0x7ff62000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:43.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.844+0000 7ff630c00700 1 -- 172.21.15.148:0/1483856550 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff620007ea0 con 0x7ff634100360 2024-02-28T16:28:43.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.844+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff634110f10 con 0x7ff634100360 2024-02-28T16:28:43.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.844+0000 7ff630c00700 1 -- 172.21.15.148:0/1483856550 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff62000f040 con 0x7ff634100360 2024-02-28T16:28:43.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.844+0000 7ff630c00700 1 -- 172.21.15.148:0/1483856550 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62000cc30 con 0x7ff634100360 2024-02-28T16:28:43.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.844+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff634111450 con 0x7ff634100360 2024-02-28T16:28:43.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.846+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63404bed0 con 0x7ff634100360 2024-02-28T16:28:43.835 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.846+0000 7ff630c00700 1 -- 172.21.15.148:0/1483856550 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 32) v1 ==== 91303+0+0 (secure 0 0 0) 0x7ff6200090d0 con 0x7ff634100360 2024-02-28T16:28:43.836 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.847+0000 7ff630c00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff61c06d200 0x7ff61c06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:28:43.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.848+0000 7ff630c00700 1 -- 172.21.15.148:0/1483856550 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff62009d870 con 0x7ff634100360 2024-02-28T16:28:43.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.848+0000 7ff639000700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff61c06d200 0x7ff61c06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:28:43.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.849+0000 7ff639000700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff61c06d200 0x7ff61c06f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b0d0 tx=0x7ff628009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:28:43.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:43.855+0000 7ff630c00700 1 -- 172.21.15.148:0/1483856550 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff62006b200 con 0x7ff634100360 2024-02-28T16:28:44.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.270+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6341117f0 con 0x7ff61c06d200 2024-02-28T16:28:44.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.274+0000 7ff630c00700 1 -- 172.21.15.148:0/1483856550 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7ff6341117f0 con 0x7ff61c06d200 2024-02-28T16:28:44.267 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:28:44.267 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:28:44.267 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:28:44.267 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:28:44.267 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:28:44.267 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:28:44.267 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:28:44.268 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T16:28:44.268 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T16:28:44.268 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:28:44.268 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:28:44.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff61c06d200 msgr2=0x7ff61c06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:44.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff61c06d200 0x7ff61c06f6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b0d0 tx=0x7ff628009e30 comp rx=0 tx=0).stop 2024-02-28T16:28:44.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634100360 msgr2=0x7ff634110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:28:44.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634100360 0x7ff634110070 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff620004fa0 tx=0x7ff62000b040 comp rx=0 tx=0).stop 2024-02-28T16:28:44.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 shutdown_connections 2024-02-28T16:28:44.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff61c06d200 0x7ff61c06f6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:44.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff6340ff150 0x7ff63410fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:44.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 --2- 172.21.15.148:0/1483856550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff634100360 0x7ff634110070 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:28:44.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.279+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 >> 172.21.15.148:0/1483856550 conn(0x7ff6340fa920 msgr2=0x7ff634103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:28:44.269 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.280+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 shutdown_connections 2024-02-28T16:28:44.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:28:44.280+0000 7ff63ba00700 1 -- 172.21.15.148:0/1483856550 wait complete. 2024-02-28T16:28:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:44 smithi157 ceph-mon[38346]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:44 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1378641884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:44 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:44 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:44.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:44 smithi148 ceph-mon[28767]: from='client.24495 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:44.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:44 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1378641884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:44.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:44 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:44.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:44 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:45.468 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:45 smithi157 ceph-mon[38346]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:45.468 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:45 smithi157 ceph-mon[38346]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-02-28T16:28:45.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:45 smithi148 ceph-mon[28767]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:28:45.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:45 smithi148 ceph-mon[28767]: pgmap v30: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-02-28T16:28:46.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:46 smithi148 ceph-mon[28767]: Standby manager daemon smithi157.cmcxzj restarted 2024-02-28T16:28:46.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:46 smithi148 ceph-mon[28767]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:28:46.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:46 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:28:46.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:46 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:28:46.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:46 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:28:46.625 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:46 smithi148 ceph-mon[28767]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:28:46.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:46 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj restarted 2024-02-28T16:28:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:46 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:28:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:46 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:28:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:46 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:28:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:46 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:28:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:46 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3309824736' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:28:47.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:47 smithi157 ceph-mon[38346]: mgrmap e33: smithi148.gelspy(active, since 55s), standbys: smithi157.cmcxzj 2024-02-28T16:28:47.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:47 smithi157 ceph-mon[38346]: pgmap v31: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 191 op/s 2024-02-28T16:28:47.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:47 smithi148 ceph-mon[28767]: mgrmap e33: smithi148.gelspy(active, since 55s), standbys: smithi157.cmcxzj 2024-02-28T16:28:47.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:47 smithi148 ceph-mon[28767]: pgmap v31: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 191 op/s 2024-02-28T16:28:49.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:49.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:49.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all mgr 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.gelspy"}]: dispatch 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.6 MiB/s wr, 323 op/s 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.gelspy"}]': finished 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.cmcxzj"}]: dispatch 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.cmcxzj"}]': finished 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all rgw 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all nfs 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:28:49.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:49 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:28:49.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:28:49.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:28:49.490 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all mgr 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.gelspy"}]: dispatch 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: pgmap v32: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.6 MiB/s wr, 323 op/s 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi148.gelspy"}]': finished 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.cmcxzj"}]: dispatch 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi157.cmcxzj"}]': finished 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all rgw 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.491 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.492 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all nfs 2024-02-28T16:28:49.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:49.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:28:49.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:28:49.493 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:49 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:28:51.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:50 smithi157 ceph-mon[38346]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 302 op/s 2024-02-28T16:28:51.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:50 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:51.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:50 smithi148 ceph-mon[28767]: pgmap v33: 65 pgs: 65 active+clean; 302 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.3 MiB/s wr, 302 op/s 2024-02-28T16:28:51.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:50 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:28:53.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:53 smithi157 ceph-mon[38346]: pgmap v34: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 392 op/s 2024-02-28T16:28:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:53 smithi148 ceph-mon[28767]: pgmap v34: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.7 MiB/s wr, 392 op/s 2024-02-28T16:28:55.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:55 smithi157 ceph-mon[38346]: pgmap v35: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 288 op/s 2024-02-28T16:28:55.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:55 smithi148 ceph-mon[28767]: pgmap v35: 65 pgs: 65 active+clean; 296 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 288 op/s 2024-02-28T16:28:57.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:57 smithi148 ceph-mon[28767]: pgmap v36: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 320 op/s 2024-02-28T16:28:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:57 smithi157 ceph-mon[38346]: pgmap v36: 65 pgs: 65 active+clean; 294 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 320 op/s 2024-02-28T16:28:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:59 smithi148 ceph-mon[28767]: pgmap v37: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 328 op/s 2024-02-28T16:28:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:59 smithi148 ceph-mon[28767]: Upgrade: Updating node-exporter.smithi148 (1/2) 2024-02-28T16:28:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:28:59 smithi148 ceph-mon[28767]: Deploying daemon node-exporter.smithi148 on smithi148 2024-02-28T16:28:59.922 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-28T16:28:59.922 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-28T16:28:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:59 smithi157 ceph-mon[38346]: pgmap v37: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 328 op/s 2024-02-28T16:28:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:59 smithi157 ceph-mon[38346]: Upgrade: Updating node-exporter.smithi148 (1/2) 2024-02-28T16:28:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:28:59 smithi157 ceph-mon[38346]: Deploying daemon node-exporter.smithi148 on smithi148 2024-02-28T16:29:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:00 smithi148 ceph-mon[28767]: pgmap v38: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 762 KiB/s wr, 172 op/s 2024-02-28T16:29:01.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:00 smithi157 ceph-mon[38346]: pgmap v38: 65 pgs: 65 active+clean; 293 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 762 KiB/s wr, 172 op/s 2024-02-28T16:29:01.279 DEBUG:teuthology.parallel:result is None 2024-02-28T16:29:03.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:03 smithi157 ceph-mon[38346]: pgmap v39: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 246 op/s 2024-02-28T16:29:03.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:03 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:03.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:03 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:03.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:03 smithi148 ceph-mon[28767]: pgmap v39: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 246 op/s 2024-02-28T16:29:03.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:03 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:03.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:03 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:05.674 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:05 smithi157 ceph-mon[38346]: pgmap v40: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 828 KiB/s wr, 156 op/s 2024-02-28T16:29:05.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:05 smithi148 ceph-mon[28767]: pgmap v40: 65 pgs: 65 active+clean; 280 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 828 KiB/s wr, 156 op/s 2024-02-28T16:29:06.671 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:06 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:06.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:06 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:07.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:07 smithi157 ceph-mon[38346]: Upgrade: Updating node-exporter.smithi157 (2/2) 2024-02-28T16:29:07.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:07 smithi157 ceph-mon[38346]: Deploying daemon node-exporter.smithi157 on smithi157 2024-02-28T16:29:07.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:07 smithi157 ceph-mon[38346]: pgmap v41: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2024-02-28T16:29:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:07 smithi148 ceph-mon[28767]: Upgrade: Updating node-exporter.smithi157 (2/2) 2024-02-28T16:29:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:07 smithi148 ceph-mon[28767]: Deploying daemon node-exporter.smithi157 on smithi157 2024-02-28T16:29:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:07 smithi148 ceph-mon[28767]: pgmap v41: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2024-02-28T16:29:09.809 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:09 smithi157 ceph-mon[38346]: pgmap v42: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 156 op/s 2024-02-28T16:29:09.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:09 smithi148 ceph-mon[28767]: pgmap v42: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 1.0 MiB/s wr, 156 op/s 2024-02-28T16:29:11.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:11 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:11.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:11 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:11.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:11 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:11.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:11 smithi157 ceph-mon[38346]: pgmap v43: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 682 KiB/s wr, 105 op/s 2024-02-28T16:29:11.553 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:11 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:11.554 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:11 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:11.554 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:11 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:11.554 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:11 smithi148 ceph-mon[28767]: pgmap v43: 65 pgs: 65 active+clean; 277 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 682 KiB/s wr, 105 op/s 2024-02-28T16:29:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:13 smithi157 ceph-mon[38346]: pgmap v44: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 948 KiB/s wr, 129 op/s 2024-02-28T16:29:13.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:13 smithi148 ceph-mon[28767]: pgmap v44: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 948 KiB/s wr, 129 op/s 2024-02-28T16:29:14.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.477+0000 7fe407400700 1 -- 172.21.15.148:0/3824267799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 msgr2=0x7fe400102520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.477+0000 7fe407400700 1 --2- 172.21.15.148:0/3824267799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe400102520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec004940 tx=0x7fe3ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.477+0000 7fe407400700 1 -- 172.21.15.148:0/3824267799 shutdown_connections 2024-02-28T16:29:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.477+0000 7fe407400700 1 --2- 172.21.15.148:0/3824267799 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe400102520 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.477+0000 7fe407400700 1 --2- 172.21.15.148:0/3824267799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4000663e0 0x7fe4000ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.477+0000 7fe407400700 1 -- 172.21.15.148:0/3824267799 >> 172.21.15.148:0/3824267799 conn(0x7fe4000f74e0 msgr2=0x7fe4000f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.478+0000 7fe407400700 1 -- 172.21.15.148:0/3824267799 shutdown_connections 2024-02-28T16:29:14.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.478+0000 7fe407400700 1 -- 172.21.15.148:0/3824267799 wait complete. 2024-02-28T16:29:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.478+0000 7fe407400700 1 Processor -- start 2024-02-28T16:29:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe407400700 1 -- start start 2024-02-28T16:29:14.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe407400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4000663e0 0x7fe4000fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe407400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe4000fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe407400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000fbff0 con 0x7fe4001000c0 2024-02-28T16:29:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe407400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000fc160 con 0x7fe4000663e0 2024-02-28T16:29:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe3ffe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe4000fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe3ffe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe4000fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40626/0 (socket says 172.21.15.148:40626) 2024-02-28T16:29:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe3ffe00700 1 -- 172.21.15.148:0/2435779708 learned_addr learned my addr 172.21.15.148:0/2435779708 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:14.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.479+0000 7fe404a00700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4000663e0 0x7fe4000fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.480+0000 7fe3ffe00700 1 -- 172.21.15.148:0/2435779708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4000663e0 msgr2=0x7fe4000fd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.480+0000 7fe3ffe00700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4000663e0 0x7fe4000fd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.480+0000 7fe3ffe00700 1 -- 172.21.15.148:0/2435779708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec005040 con 0x7fe4001000c0 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.480+0000 7fe3ffe00700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe4000fb9f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.480+0000 7fe3fcc00700 1 -- 172.21.15.148:0/2435779708 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3ec00e030 con 0x7fe4001000c0 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.480+0000 7fe3fcc00700 1 -- 172.21.15.148:0/2435779708 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3ec00bbf0 con 0x7fe4001000c0 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.481+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4000fc3e0 con 0x7fe4001000c0 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.481+0000 7fe3fcc00700 1 -- 172.21.15.148:0/2435779708 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3ec01c400 con 0x7fe4001000c0 2024-02-28T16:29:14.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.481+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe400115960 con 0x7fe4001000c0 2024-02-28T16:29:14.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.482+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40004bed0 con 0x7fe4001000c0 2024-02-28T16:29:14.472 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.483+0000 7fe3fcc00700 1 -- 172.21.15.148:0/2435779708 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 33) v1 ==== 91303+0+0 (secure 0 0 0) 0x7fe3ec013420 con 0x7fe4001000c0 2024-02-28T16:29:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.484+0000 7fe3fcc00700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe3e806d250 0x7fe3e806f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.485+0000 7fe3fcc00700 1 -- 172.21.15.148:0/2435779708 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe3ec08de90 con 0x7fe4001000c0 2024-02-28T16:29:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.485+0000 7fe404a00700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe3e806d250 0x7fe3e806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:14.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.485+0000 7fe404a00700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe3e806d250 0x7fe3e806f700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe4000fd300 tx=0x7fe3f4009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.490+0000 7fe3fcc00700 1 -- 172.21.15.148:0/2435779708 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe3ec05b8a0 con 0x7fe4001000c0 2024-02-28T16:29:14.786 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.797+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe400100d60 con 0x7fe3e806d250 2024-02-28T16:29:14.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.799+0000 7fe3fcc00700 1 -- 172.21.15.148:0/2435779708 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fe400100d60 con 0x7fe3e806d250 2024-02-28T16:29:14.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.801+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe3e806d250 msgr2=0x7fe3e806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:14.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.801+0000 7fe407400700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe3e806d250 0x7fe3e806f700 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe4000fd300 tx=0x7fe3f4009040 comp rx=0 tx=0).stop 2024-02-28T16:29:14.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.801+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 msgr2=0x7fe4000fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:14.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.801+0000 7fe407400700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe4000fb9f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec000c00 tx=0x7fe3ec009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:14.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.802+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 shutdown_connections 2024-02-28T16:29:14.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.802+0000 7fe407400700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe3e806d250 0x7fe3e806f700 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.802+0000 7fe407400700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4000663e0 0x7fe4000fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.802+0000 7fe407400700 1 --2- 172.21.15.148:0/2435779708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4001000c0 0x7fe4000fb9f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.802+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 >> 172.21.15.148:0/2435779708 conn(0x7fe4000f74e0 msgr2=0x7fe4000f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:14.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.802+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 shutdown_connections 2024-02-28T16:29:14.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.802+0000 7fe407400700 1 -- 172.21.15.148:0/2435779708 wait complete. 2024-02-28T16:29:14.810 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:29:14.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 -- 172.21.15.148:0/3107191697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c4100360 msgr2=0x7f12c41007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:14.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 --2- 172.21.15.148:0/3107191697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c4100360 0x7f12c41007b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f12b0004940 tx=0x7f12b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:14.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 -- 172.21.15.148:0/3107191697 shutdown_connections 2024-02-28T16:29:14.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 --2- 172.21.15.148:0/3107191697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c4100360 0x7f12c41007b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 --2- 172.21.15.148:0/3107191697 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c40ff150 0x7f12c40ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 -- 172.21.15.148:0/3107191697 >> 172.21.15.148:0/3107191697 conn(0x7f12c40fa920 msgr2=0x7f12c40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:14.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 -- 172.21.15.148:0/3107191697 shutdown_connections 2024-02-28T16:29:14.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.976+0000 7f12cc600700 1 -- 172.21.15.148:0/3107191697 wait complete. 2024-02-28T16:29:14.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.977+0000 7f12cc600700 1 Processor -- start 2024-02-28T16:29:14.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.977+0000 7f12cc600700 1 -- start start 2024-02-28T16:29:14.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12cc600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c40ff150 0x7f12c410fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:14.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12cc600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100360 0x7f12c41100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:14.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12cc600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41106d0 con 0x7f12c40ff150 2024-02-28T16:29:14.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12cc600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4110f70 con 0x7f12c4100360 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12c9c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c40ff150 0x7f12c410fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12c9c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c40ff150 0x7f12c410fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40644/0 (socket says 172.21.15.148:40644) 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12c9c00700 1 -- 172.21.15.148:0/1717525480 learned_addr learned my addr 172.21.15.148:0/1717525480 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.978+0000 7f12c9200700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100360 0x7f12c41100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.979+0000 7f12c9c00700 1 -- 172.21.15.148:0/1717525480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100360 msgr2=0x7f12c41100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.979+0000 7f12c9c00700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100360 0x7f12c41100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.979+0000 7f12c9c00700 1 -- 172.21.15.148:0/1717525480 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0005040 con 0x7f12c40ff150 2024-02-28T16:29:14.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.979+0000 7f12c9200700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100360 0x7f12c41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:29:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.979+0000 7f12c9c00700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c40ff150 0x7f12c410fb90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f12b8002a50 tx=0x7f12b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.980+0000 7f12c1600700 1 -- 172.21.15.148:0/1717525480 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b8007cc0 con 0x7f12c40ff150 2024-02-28T16:29:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.980+0000 7f12c1600700 1 -- 172.21.15.148:0/1717525480 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12b800f040 con 0x7f12c40ff150 2024-02-28T16:29:14.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.980+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c4111250 con 0x7f12c40ff150 2024-02-28T16:29:14.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.980+0000 7f12c1600700 1 -- 172.21.15.148:0/1717525480 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12b800da40 con 0x7f12c40ff150 2024-02-28T16:29:14.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.980+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c4111790 con 0x7f12c40ff150 2024-02-28T16:29:14.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.981+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c404bed0 con 0x7f12c40ff150 2024-02-28T16:29:14.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.982+0000 7f12c1600700 1 -- 172.21.15.148:0/1717525480 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 33) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f12b80097c0 con 0x7f12c40ff150 2024-02-28T16:29:14.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.983+0000 7f12c1600700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f12ac06d200 0x7f12ac06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:14.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.983+0000 7f12c1600700 1 -- 172.21.15.148:0/1717525480 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f12b808c5a0 con 0x7f12c40ff150 2024-02-28T16:29:14.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.984+0000 7f12c9200700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f12ac06d200 0x7f12ac06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:14.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.984+0000 7f12c9200700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f12ac06d200 0x7f12ac06f6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12b0004f90 tx=0x7f12b0009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:14.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:14.989+0000 7f12c1600700 1 -- 172.21.15.148:0/1717525480 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f12b8059c20 con 0x7f12c40ff150 2024-02-28T16:29:15.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.324+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f12c4104cb0 con 0x7f12ac06d200 2024-02-28T16:29:15.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.325+0000 7f12c1600700 1 -- 172.21.15.148:0/1717525480 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f12c4104cb0 con 0x7f12ac06d200 2024-02-28T16:29:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f12ac06d200 msgr2=0x7f12ac06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f12ac06d200 0x7f12ac06f6b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f12b0004f90 tx=0x7f12b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c40ff150 msgr2=0x7f12c410fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c40ff150 0x7f12c410fb90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f12b8002a50 tx=0x7f12b8004600 comp rx=0 tx=0).stop 2024-02-28T16:29:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 shutdown_connections 2024-02-28T16:29:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f12ac06d200 0x7f12ac06f6b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12c40ff150 0x7f12c410fb90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 --2- 172.21.15.148:0/1717525480 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f12c4100360 0x7f12c41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 >> 172.21.15.148:0/1717525480 conn(0x7f12c40fa920 msgr2=0x7f12c4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 shutdown_connections 2024-02-28T16:29:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.328+0000 7f12cc600700 1 -- 172.21.15.148:0/1717525480 wait complete. 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.481+0000 7f2afb600700 1 -- 172.21.15.148:0/2336268008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 msgr2=0x7f2af4104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.481+0000 7f2afb600700 1 --2- 172.21.15.148:0/2336268008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af4104bb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0004940 tx=0x7f2ae0009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.481+0000 7f2afb600700 1 -- 172.21.15.148:0/2336268008 shutdown_connections 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.481+0000 7f2afb600700 1 --2- 172.21.15.148:0/2336268008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af4104bb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.481+0000 7f2afb600700 1 --2- 172.21.15.148:0/2336268008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af41035a0 0x7f2af41039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.481+0000 7f2afb600700 1 -- 172.21.15.148:0/2336268008 >> 172.21.15.148:0/2336268008 conn(0x7f2af4072690 msgr2=0x7f2af4074ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.481+0000 7f2afb600700 1 -- 172.21.15.148:0/2336268008 shutdown_connections 2024-02-28T16:29:15.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.482+0000 7f2afb600700 1 -- 172.21.15.148:0/2336268008 wait complete. 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.482+0000 7f2afb600700 1 Processor -- start 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.482+0000 7f2afb600700 1 -- start start 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2afb600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af41035a0 0x7f2af4113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2afb600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af41144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2afb600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4114ab0 con 0x7f2af4104760 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2afb600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4115350 con 0x7f2af41035a0 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af41144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af41144b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40654/0 (socket says 172.21.15.148:40654) 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af3e00700 1 -- 172.21.15.148:0/2878302310 learned_addr learned my addr 172.21.15.148:0/2878302310 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af8c00700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af41035a0 0x7f2af4113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af3e00700 1 -- 172.21.15.148:0/2878302310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af41035a0 msgr2=0x7f2af4113f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af3e00700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af41035a0 0x7f2af4113f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af3e00700 1 -- 172.21.15.148:0/2878302310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0005040 con 0x7f2af4104760 2024-02-28T16:29:15.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.483+0000 7f2af8c00700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af41035a0 0x7f2af4113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:29:15.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.484+0000 7f2af3e00700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af41144b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009fd0 tx=0x7f2ae0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:15.474 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.484+0000 7f2af0c00700 1 -- 172.21.15.148:0/2878302310 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ae000e040 con 0x7f2af4104760 2024-02-28T16:29:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.484+0000 7f2af0c00700 1 -- 172.21.15.148:0/2878302310 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ae000bcc0 con 0x7f2af4104760 2024-02-28T16:29:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.484+0000 7f2afb600700 1 -- 172.21.15.148:0/2878302310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af41155d0 con 0x7f2af4104760 2024-02-28T16:29:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.484+0000 7f2af0c00700 1 -- 172.21.15.148:0/2878302310 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ae001c630 con 0x7f2af4104760 2024-02-28T16:29:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.484+0000 7f2afb600700 1 -- 172.21.15.148:0/2878302310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af4115b10 con 0x7f2af4104760 2024-02-28T16:29:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.486+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad00052b0 con 0x7f2af4104760 2024-02-28T16:29:15.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.486+0000 7f2af0c00700 1 -- 172.21.15.148:0/2878302310 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 33) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f2ae0013980 con 0x7f2af4104760 2024-02-28T16:29:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.488+0000 7f2af0c00700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f2adc06d200 0x7f2adc06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.489+0000 7f2af0c00700 1 -- 172.21.15.148:0/2878302310 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f2ae008dc60 con 0x7f2af4104760 2024-02-28T16:29:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.489+0000 7f2af8c00700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f2adc06d200 0x7f2adc06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:15.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.489+0000 7f2af8c00700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f2adc06d200 0x7f2adc06f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007fd0 tx=0x7f2ae8009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:15.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.494+0000 7f2af0c00700 1 -- 172.21.15.148:0/2878302310 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f2ae005b670 con 0x7f2af4104760 2024-02-28T16:29:15.615 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:15 smithi148 ceph-mon[28767]: pgmap v45: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 498 KiB/s wr, 55 op/s 2024-02-28T16:29:15.615 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:15.615 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:15.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.781+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ad00052b0 con 0x7f2adc06d200 2024-02-28T16:29:15.789 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.800+0000 7f2af0c00700 1 -- 172.21.15.148:0/2878302310 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2ad00052b0 con 0x7f2adc06d200 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (3m) 31s ago 14m 15.3M - 0.25.0 c8568f914cd2 e5165660981e 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (15m) 31s ago 15m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (13m) 0s ago 13m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (2m) 31s ago 14m 75.5M - 9.4.7 954c08fa6188 f71525960747 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (6m) 31s ago 6m 12.9M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (6m) 31s ago 6m 222M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (6m) 0s ago 6m 13.1M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (6m) 0s ago 6m 13.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (117s) 31s ago 16m 491M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (41s) 0s ago 12m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:29:15.790 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (16m) 31s ago 16m 52.0M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (12m) 0s ago 12m 42.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 starting - - - - 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (6s) 0s ago 12m 2600k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (11m) 31s ago 11m 181M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (11m) 31s ago 11m 185M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (10m) 31s ago 10m 158M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (9m) 0s ago 9m 232M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (9m) 0s ago 9m 204M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (8m) 0s ago 8m 185M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:29:15.791 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (49s) 31s ago 13m 38.2M - 2.43.0 a07b618ecd1d 7b6d16b44508 2024-02-28T16:29:15.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f2adc06d200 msgr2=0x7f2adc06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f2adc06d200 0x7f2adc06f6b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007fd0 tx=0x7f2ae8009040 comp rx=0 tx=0).stop 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 msgr2=0x7f2af41144b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af41144b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009fd0 tx=0x7f2ae0009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 shutdown_connections 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f2adc06d200 0x7f2adc06f6b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2af41035a0 0x7f2af4113f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 --2- 172.21.15.148:0/2878302310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2af4104760 0x7f2af41144b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.803+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 >> 172.21.15.148:0/2878302310 conn(0x7f2af4072690 msgr2=0x7f2af4107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.804+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 shutdown_connections 2024-02-28T16:29:15.793 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.804+0000 7f2ae6000700 1 -- 172.21.15.148:0/2878302310 wait complete. 2024-02-28T16:29:15.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 -- 172.21.15.148:0/4234662004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 msgr2=0x7f69c80fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 --2- 172.21.15.148:0/4234662004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c80fd320 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f69b8004940 tx=0x7f69b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:15.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 -- 172.21.15.148:0/4234662004 shutdown_connections 2024-02-28T16:29:15.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 --2- 172.21.15.148:0/4234662004 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c80fe0e0 0x7f69c80fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 --2- 172.21.15.148:0/4234662004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c80fd320 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 -- 172.21.15.148:0/4234662004 >> 172.21.15.148:0/4234662004 conn(0x7f69c80f8620 msgr2=0x7f69c80faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:15.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 -- 172.21.15.148:0/4234662004 shutdown_connections 2024-02-28T16:29:15.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.959+0000 7f69cd000700 1 -- 172.21.15.148:0/4234662004 wait complete. 2024-02-28T16:29:15.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.960+0000 7f69cd000700 1 Processor -- start 2024-02-28T16:29:15.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.960+0000 7f69cd000700 1 -- start start 2024-02-28T16:29:15.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69cd000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c8071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:15.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69cd000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c80fe0e0 0x7f69c80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69cd000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c80708e0 con 0x7f69c80fcef0 2024-02-28T16:29:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69cd000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c8070a50 con 0x7f69c80fe0e0 2024-02-28T16:29:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69c5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c8071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69c5e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c8071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40678/0 (socket says 172.21.15.148:40678) 2024-02-28T16:29:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69c5e00700 1 -- 172.21.15.148:0/1060811870 learned_addr learned my addr 172.21.15.148:0/1060811870 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:15.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.961+0000 7f69c5400700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c80fe0e0 0x7f69c80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:15.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.962+0000 7f69c5e00700 1 -- 172.21.15.148:0/1060811870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c80fe0e0 msgr2=0x7f69c80702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:15.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.962+0000 7f69c5e00700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c80fe0e0 0x7f69c80702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:15.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.962+0000 7f69c5e00700 1 -- 172.21.15.148:0/1060811870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b8005040 con 0x7f69c80fcef0 2024-02-28T16:29:15.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.962+0000 7f69c5400700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c80fe0e0 0x7f69c80702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:29:15.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.962+0000 7f69c5e00700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c8071e60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000c00 tx=0x7f69b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:15.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.962+0000 7f69be000700 1 -- 172.21.15.148:0/1060811870 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b800e040 con 0x7f69c80fcef0 2024-02-28T16:29:15.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.963+0000 7f69be000700 1 -- 172.21.15.148:0/1060811870 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69b800bbf0 con 0x7f69c80fcef0 2024-02-28T16:29:15.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.963+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c8070cd0 con 0x7f69c80fcef0 2024-02-28T16:29:15.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.963+0000 7f69be000700 1 -- 172.21.15.148:0/1060811870 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69b801c630 con 0x7f69c80fcef0 2024-02-28T16:29:15.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.963+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c81159c0 con 0x7f69c80fcef0 2024-02-28T16:29:15.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.964+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c804bed0 con 0x7f69c80fcef0 2024-02-28T16:29:15.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.965+0000 7f69be000700 1 -- 172.21.15.148:0/1060811870 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 33) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f69b800bd60 con 0x7f69c80fcef0 2024-02-28T16:29:15.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.966+0000 7f69be000700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f69ac06d200 0x7f69ac06f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:15.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.966+0000 7f69be000700 1 -- 172.21.15.148:0/1060811870 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f69b808db20 con 0x7f69c80fcef0 2024-02-28T16:29:15.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.967+0000 7f69c5400700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f69ac06d200 0x7f69ac06f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:15.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.967+0000 7f69c5400700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f69ac06d200 0x7f69ac06f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f69b4010520 tx=0x7f69b400b040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:15.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:15.971+0000 7f69be000700 1 -- 172.21.15.148:0/1060811870 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f69b805b530 con 0x7f69c80fcef0 2024-02-28T16:29:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:15 smithi157 ceph-mon[38346]: pgmap v45: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 498 KiB/s wr, 55 op/s 2024-02-28T16:29:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:16.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.358+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69c8070e60 con 0x7f69c80fcef0 2024-02-28T16:29:16.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.358+0000 7f69be000700 1 -- 172.21.15.148:0/1060811870 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f69c8070e60 con 0x7f69c80fcef0 2024-02-28T16:29:16.347 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:29:16.348 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:29:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:29:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:16.349 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:29:16.349 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:29:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f69ac06d200 msgr2=0x7f69ac06f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f69ac06d200 0x7f69ac06f6b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f69b4010520 tx=0x7f69b400b040 comp rx=0 tx=0).stop 2024-02-28T16:29:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 msgr2=0x7f69c8071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c8071e60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000c00 tx=0x7f69b8009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 shutdown_connections 2024-02-28T16:29:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f69ac06d200 0x7f69ac06f6b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f69c80fcef0 0x7f69c8071e60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 --2- 172.21.15.148:0/1060811870 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69c80fe0e0 0x7f69c80702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 >> 172.21.15.148:0/1060811870 conn(0x7f69c80f8620 msgr2=0x7f69c81013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 shutdown_connections 2024-02-28T16:29:16.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.362+0000 7f69cd000700 1 -- 172.21.15.148:0/1060811870 wait complete. 2024-02-28T16:29:16.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 -- 172.21.15.148:0/2999796710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640708c0 msgr2=0x7f2264070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:16.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 --2- 172.21.15.148:0/2999796710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640708c0 0x7f2264070d10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2250004940 tx=0x7f2250009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:16.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 -- 172.21.15.148:0/2999796710 shutdown_connections 2024-02-28T16:29:16.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 --2- 172.21.15.148:0/2999796710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22640708c0 0x7f2264070d10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 --2- 172.21.15.148:0/2999796710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2264071f10 0x7f2264070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 -- 172.21.15.148:0/2999796710 >> 172.21.15.148:0/2999796710 conn(0x7f22640f8620 msgr2=0x7f22640faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:16.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 -- 172.21.15.148:0/2999796710 shutdown_connections 2024-02-28T16:29:16.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.534+0000 7f226a400700 1 -- 172.21.15.148:0/2999796710 wait complete. 2024-02-28T16:29:16.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.535+0000 7f226a400700 1 Processor -- start 2024-02-28T16:29:16.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.535+0000 7f226a400700 1 -- start start 2024-02-28T16:29:16.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f226a400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22640708c0 0x7f226410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:16.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f226a400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2264071f10 0x7f22641100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f226a400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22641106b0 con 0x7f2264071f10 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f226a400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2264110f50 con 0x7f22640708c0 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2262a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2264071f10 0x7f22641100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2262a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2264071f10 0x7f22641100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40686/0 (socket says 172.21.15.148:40686) 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2262a00700 1 -- 172.21.15.148:0/2133107493 learned_addr learned my addr 172.21.15.148:0/2133107493 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2263400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22640708c0 0x7f226410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2262a00700 1 -- 172.21.15.148:0/2133107493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22640708c0 msgr2=0x7f226410fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2262a00700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22640708c0 0x7f226410fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2262a00700 1 -- 172.21.15.148:0/2133107493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250005040 con 0x7f2264071f10 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2263400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22640708c0 0x7f226410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:29:16.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.536+0000 7f2262a00700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2264071f10 0x7f22641100b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2250009fd0 tx=0x7f2250009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:16.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.537+0000 7f225b400700 1 -- 172.21.15.148:0/2133107493 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f225000e040 con 0x7f2264071f10 2024-02-28T16:29:16.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.537+0000 7f225b400700 1 -- 172.21.15.148:0/2133107493 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2250004290 con 0x7f2264071f10 2024-02-28T16:29:16.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.537+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22641111d0 con 0x7f2264071f10 2024-02-28T16:29:16.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.537+0000 7f225b400700 1 -- 172.21.15.148:0/2133107493 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f225001c630 con 0x7f2264071f10 2024-02-28T16:29:16.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.537+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2264111710 con 0x7f2264071f10 2024-02-28T16:29:16.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.538+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226404bed0 con 0x7f2264071f10 2024-02-28T16:29:16.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.539+0000 7f225b400700 1 -- 172.21.15.148:0/2133107493 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 33) v1 ==== 91303+0+0 (secure 0 0 0) 0x7f225000bc60 con 0x7f2264071f10 2024-02-28T16:29:16.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.540+0000 7f225b400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f224806d200 0x7f224806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:16.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.540+0000 7f225b400700 1 -- 172.21.15.148:0/2133107493 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f225008dd10 con 0x7f2264071f10 2024-02-28T16:29:16.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.541+0000 7f2263400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f224806d200 0x7f224806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:16.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.541+0000 7f2263400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f224806d200 0x7f224806f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2254007fd0 tx=0x7f2254009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:16.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.547+0000 7f225b400700 1 -- 172.21.15.148:0/2133107493 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f225005b620 con 0x7f2264071f10 2024-02-28T16:29:16.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:16 smithi148 ceph-mon[28767]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:16.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:16 smithi148 ceph-mon[28767]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:16.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:16 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1060811870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:16.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.821+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f22641044f0 con 0x7f224806d200 2024-02-28T16:29:16.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.822+0000 7f225b400700 1 -- 172.21.15.148:0/2133107493 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f22641044f0 con 0x7f224806d200 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:29:16.812 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:29:16.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f224806d200 msgr2=0x7f224806f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:16.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f224806d200 0x7f224806f6b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2254007fd0 tx=0x7f2254009040 comp rx=0 tx=0).stop 2024-02-28T16:29:16.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2264071f10 msgr2=0x7f22641100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:16.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2264071f10 0x7f22641100b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2250009fd0 tx=0x7f2250009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:16.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 shutdown_connections 2024-02-28T16:29:16.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f224806d200 0x7f224806f6b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f22640708c0 0x7f226410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 --2- 172.21.15.148:0/2133107493 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2264071f10 0x7f22641100b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:16.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 >> 172.21.15.148:0/2133107493 conn(0x7f22640f8620 msgr2=0x7f2264102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:16.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 shutdown_connections 2024-02-28T16:29:16.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:16.825+0000 7f226a400700 1 -- 172.21.15.148:0/2133107493 wait complete. 2024-02-28T16:29:16.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:16 smithi157 ceph-mon[38346]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:16.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:16 smithi157 ceph-mon[38346]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:16.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:16 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1060811870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:17.834 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:17 smithi148 ceph-mon[28767]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:17.834 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:17 smithi148 ceph-mon[28767]: pgmap v46: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 740 KiB/s wr, 92 op/s 2024-02-28T16:29:17.834 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:17 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:17.834 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:17 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:17 smithi157 ceph-mon[38346]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:17 smithi157 ceph-mon[38346]: pgmap v46: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 740 KiB/s wr, 92 op/s 2024-02-28T16:29:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:17 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:17 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:18.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:18 smithi148 ceph-mon[28767]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:18.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:18 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:18.596 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:18 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:18.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:18 smithi157 ceph-mon[38346]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:18.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:18 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:18.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:18 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:19.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:19 smithi148 ceph-mon[28767]: pgmap v47: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 508 KiB/s wr, 68 op/s 2024-02-28T16:29:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:19 smithi157 ceph-mon[38346]: pgmap v47: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 508 KiB/s wr, 68 op/s 2024-02-28T16:29:21.204 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:20 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:21.204 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:20 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:21.204 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:20 smithi148 ceph-mon[28767]: pgmap v48: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 508 KiB/s wr, 64 op/s 2024-02-28T16:29:21.205 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:20 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:21.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:20 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:21.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:20 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:21.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:20 smithi157 ceph-mon[38346]: pgmap v48: 65 pgs: 65 active+clean; 271 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 508 KiB/s wr, 64 op/s 2024-02-28T16:29:21.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:20 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:23.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:23 smithi148 ceph-mon[28767]: mgrmap e34: smithi148.gelspy(active, since 91s), standbys: smithi157.cmcxzj 2024-02-28T16:29:23.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:23 smithi148 ceph-mon[28767]: pgmap v49: 65 pgs: 65 active+clean; 272 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 741 KiB/s wr, 115 op/s 2024-02-28T16:29:23.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:23 smithi157 ceph-mon[38346]: mgrmap e34: smithi148.gelspy(active, since 91s), standbys: smithi157.cmcxzj 2024-02-28T16:29:23.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:23 smithi157 ceph-mon[38346]: pgmap v49: 65 pgs: 65 active+clean; 272 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 741 KiB/s wr, 115 op/s 2024-02-28T16:29:24.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:24 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:24.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:24 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:24.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:24 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:24.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:24 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:25.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:25 smithi148 ceph-mon[28767]: pgmap v50: 65 pgs: 65 active+clean; 272 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 475 KiB/s wr, 90 op/s 2024-02-28T16:29:25.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:25 smithi157 ceph-mon[38346]: pgmap v50: 65 pgs: 65 active+clean; 272 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 475 KiB/s wr, 90 op/s 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: pgmap v51: 65 pgs: 65 active+clean; 272 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 674 KiB/s wr, 128 op/s 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.739 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:27 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: pgmap v51: 65 pgs: 65 active+clean; 272 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 674 KiB/s wr, 128 op/s 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:27.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:27 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:29.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:29 smithi148 ceph-mon[28767]: pgmap v52: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 431 KiB/s wr, 96 op/s 2024-02-28T16:29:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:29 smithi157 ceph-mon[38346]: pgmap v52: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 431 KiB/s wr, 96 op/s 2024-02-28T16:29:30.775 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:30 smithi148 ceph-mon[28767]: Upgrade: Updating prometheus.smithi148 2024-02-28T16:29:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:30 smithi157 ceph-mon[38346]: Upgrade: Updating prometheus.smithi148 2024-02-28T16:29:31.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:31 smithi148 ceph-mon[28767]: Deploying daemon prometheus.smithi148 on smithi148 2024-02-28T16:29:31.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:31 smithi148 ceph-mon[28767]: pgmap v53: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 431 KiB/s wr, 92 op/s 2024-02-28T16:29:31.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:31 smithi157 ceph-mon[38346]: Deploying daemon prometheus.smithi148 on smithi148 2024-02-28T16:29:31.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:31 smithi157 ceph-mon[38346]: pgmap v53: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 431 KiB/s wr, 92 op/s 2024-02-28T16:29:31.997 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-28T16:29:31.998 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-28T16:29:33.041 DEBUG:teuthology.parallel:result is None 2024-02-28T16:29:33.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T16:29:33.166 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T16:29:33.167 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T16:29:33.285 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T16:29:33.285 DEBUG:teuthology.parallel:result is None 2024-02-28T16:29:33.511 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:33 smithi148 ceph-mon[28767]: pgmap v54: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 647 KiB/s wr, 122 op/s 2024-02-28T16:29:33.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:33 smithi157 ceph-mon[38346]: pgmap v54: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 647 KiB/s wr, 122 op/s 2024-02-28T16:29:35.790 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:35 smithi157 ceph-mon[38346]: pgmap v55: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.2 KiB/s rd, 414 KiB/s wr, 71 op/s 2024-02-28T16:29:35.791 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:35.863 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:35 smithi148 ceph-mon[28767]: pgmap v55: 65 pgs: 65 active+clean; 262 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 9.2 KiB/s rd, 414 KiB/s wr, 71 op/s 2024-02-28T16:29:35.863 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:37.619 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:37 smithi148 ceph-mon[28767]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 467 KiB/s wr, 88 op/s 2024-02-28T16:29:37.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:37 smithi157 ceph-mon[38346]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 13 KiB/s rd, 467 KiB/s wr, 88 op/s 2024-02-28T16:29:39.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:39 smithi148 ceph-mon[28767]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 KiB/s rd, 269 KiB/s wr, 51 op/s 2024-02-28T16:29:39.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:39 smithi157 ceph-mon[38346]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 KiB/s rd, 269 KiB/s wr, 51 op/s 2024-02-28T16:29:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:40 smithi148 ceph-mon[28767]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 KiB/s rd, 269 KiB/s wr, 46 op/s 2024-02-28T16:29:41.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:40 smithi157 ceph-mon[38346]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.0 KiB/s rd, 269 KiB/s wr, 46 op/s 2024-02-28T16:29:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:41 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:41 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:41 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:42.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:41 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:42.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:41 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:42.324 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:41 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:43.253 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:43 smithi148 ceph-mon[28767]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.1 KiB/s rd, 271 KiB/s wr, 47 op/s 2024-02-28T16:29:43.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:43 smithi157 ceph-mon[38346]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 8.1 KiB/s rd, 271 KiB/s wr, 47 op/s 2024-02-28T16:29:45.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:45 smithi148 ceph-mon[28767]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-02-28T16:29:45.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:45 smithi157 ceph-mon[38346]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-02-28T16:29:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.990+0000 7fd3fd400700 1 -- 172.21.15.148:0/1631239737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 msgr2=0x7fd3f8100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.990+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1631239737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8100760 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0004940 tx=0x7fd3e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.990+0000 7fd3fd400700 1 -- 172.21.15.148:0/1631239737 shutdown_connections 2024-02-28T16:29:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.990+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1631239737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8100760 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.990+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1631239737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f80ff100 0x7fd3f80ff510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.990+0000 7fd3fd400700 1 -- 172.21.15.148:0/1631239737 >> 172.21.15.148:0/1631239737 conn(0x7fd3f80fa7c0 msgr2=0x7fd3f80fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.991+0000 7fd3fd400700 1 -- 172.21.15.148:0/1631239737 shutdown_connections 2024-02-28T16:29:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.991+0000 7fd3fd400700 1 -- 172.21.15.148:0/1631239737 wait complete. 2024-02-28T16:29:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.991+0000 7fd3fd400700 1 Processor -- start 2024-02-28T16:29:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3fd400700 1 -- start start 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3fd400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f80ff100 0x7fd3f810fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3fd400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3fd400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8110650 con 0x7fd3f8100310 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3fd400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f8110ef0 con 0x7fd3f80ff100 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3efe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3efe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38838/0 (socket says 172.21.15.148:38838) 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.992+0000 7fd3efe00700 1 -- 172.21.15.148:0/1067670983 learned_addr learned my addr 172.21.15.148:0/1067670983 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3f6800700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f80ff100 0x7fd3f810fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3efe00700 1 -- 172.21.15.148:0/1067670983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f80ff100 msgr2=0x7fd3f810fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3efe00700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f80ff100 0x7fd3f810fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3efe00700 1 -- 172.21.15.148:0/1067670983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0005040 con 0x7fd3f8100310 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3f6800700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f80ff100 0x7fd3f810fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:29:46.982 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3efe00700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8110050 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009360 tx=0x7fd3e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3eea00700 1 -- 172.21.15.148:0/1067670983 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e000e040 con 0x7fd3f8100310 2024-02-28T16:29:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3eea00700 1 -- 172.21.15.148:0/1067670983 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3e000bcc0 con 0x7fd3f8100310 2024-02-28T16:29:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3eea00700 1 -- 172.21.15.148:0/1067670983 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e001c630 con 0x7fd3f8100310 2024-02-28T16:29:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f8111170 con 0x7fd3f8100310 2024-02-28T16:29:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.993+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f81116b0 con 0x7fd3f8100310 2024-02-28T16:29:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.995+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f804bed0 con 0x7fd3f8100310 2024-02-28T16:29:46.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.996+0000 7fd3eea00700 1 -- 172.21.15.148:0/1067670983 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7fd3e00139f0 con 0x7fd3f8100310 2024-02-28T16:29:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.997+0000 7fd3eea00700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fd3d806d0f0 0x7fd3d806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.997+0000 7fd3eea00700 1 -- 172.21.15.148:0/1067670983 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd3e008daa0 con 0x7fd3f8100310 2024-02-28T16:29:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.997+0000 7fd3f6800700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fd3d806d0f0 0x7fd3d806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:46.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:46.998+0000 7fd3f6800700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fd3d806d0f0 0x7fd3d806f5a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8007fd0 tx=0x7fd3e8009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:46.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.002+0000 7fd3eea00700 1 -- 172.21.15.148:0/1067670983 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fd3e005b6d0 con 0x7fd3f8100310 2024-02-28T16:29:47.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.277+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3f8111c90 con 0x7fd3d806d0f0 2024-02-28T16:29:47.268 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.279+0000 7fd3eea00700 1 -- 172.21.15.148:0/1067670983 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fd3f8111c90 con 0x7fd3d806d0f0 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fd3d806d0f0 msgr2=0x7fd3d806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fd3d806d0f0 0x7fd3d806f5a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8007fd0 tx=0x7fd3e8009040 comp rx=0 tx=0).stop 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 msgr2=0x7fd3f8110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8110050 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009360 tx=0x7fd3e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 shutdown_connections 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fd3d806d0f0 0x7fd3d806f5a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd3f80ff100 0x7fd3f810fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 --2- 172.21.15.148:0/1067670983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd3f8100310 0x7fd3f8110050 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.272 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 >> 172.21.15.148:0/1067670983 conn(0x7fd3f80fa7c0 msgr2=0x7fd3f8103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:47.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 shutdown_connections 2024-02-28T16:29:47.273 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.283+0000 7fd3fd400700 1 -- 172.21.15.148:0/1067670983 wait complete. 2024-02-28T16:29:47.287 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 -- 172.21.15.148:0/18191795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 msgr2=0x7f1df00fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 --2- 172.21.15.148:0/18191795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df00fe550 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc004940 tx=0x7f1ddc009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 -- 172.21.15.148:0/18191795 shutdown_connections 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 --2- 172.21.15.148:0/18191795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df00fe550 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 --2- 172.21.15.148:0/18191795 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1df00fcef0 0x7f1df00fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 -- 172.21.15.148:0/18191795 >> 172.21.15.148:0/18191795 conn(0x7f1df00f8620 msgr2=0x7f1df00faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 -- 172.21.15.148:0/18191795 shutdown_connections 2024-02-28T16:29:47.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.440+0000 7f1df4e00700 1 -- 172.21.15.148:0/18191795 wait complete. 2024-02-28T16:29:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.441+0000 7f1df4e00700 1 Processor -- start 2024-02-28T16:29:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.441+0000 7f1df4e00700 1 -- start start 2024-02-28T16:29:47.430 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.441+0000 7f1df4e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1df00fcef0 0x7f1df010fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.441+0000 7f1df4e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df01100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.441+0000 7f1df4e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0110760 con 0x7f1df00fe0e0 2024-02-28T16:29:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.441+0000 7f1df4e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df0110fa0 con 0x7f1df00fcef0 2024-02-28T16:29:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1ded400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df01100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1ded400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df01100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38848/0 (socket says 172.21.15.148:38848) 2024-02-28T16:29:47.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1ded400700 1 -- 172.21.15.148:0/739280669 learned_addr learned my addr 172.21.15.148:0/739280669 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1dede00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1df00fcef0 0x7f1df010fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1ded400700 1 -- 172.21.15.148:0/739280669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1df00fcef0 msgr2=0x7f1df010fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1ded400700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1df00fcef0 0x7f1df010fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1ded400700 1 -- 172.21.15.148:0/739280669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc005040 con 0x7f1df00fe0e0 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.442+0000 7f1ded400700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df01100d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00b3b0 tx=0x7f1ddc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.443+0000 7f1de6000700 1 -- 172.21.15.148:0/739280669 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc00e040 con 0x7f1df00fe0e0 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.443+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df0111220 con 0x7f1df00fe0e0 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.443+0000 7f1de6000700 1 -- 172.21.15.148:0/739280669 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ddc00bd90 con 0x7f1df00fe0e0 2024-02-28T16:29:47.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.443+0000 7f1de6000700 1 -- 172.21.15.148:0/739280669 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ddc01c630 con 0x7f1df00fe0e0 2024-02-28T16:29:47.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.443+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df0111760 con 0x7f1df00fe0e0 2024-02-28T16:29:47.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.444+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df0102210 con 0x7f1df00fe0e0 2024-02-28T16:29:47.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.445+0000 7f1de6000700 1 -- 172.21.15.148:0/739280669 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f1ddc0139f0 con 0x7f1df00fe0e0 2024-02-28T16:29:47.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.446+0000 7f1de6000700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1dd406d0f0 0x7f1dd406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:47.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.446+0000 7f1de6000700 1 -- 172.21.15.148:0/739280669 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f1ddc08da50 con 0x7f1df00fe0e0 2024-02-28T16:29:47.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.446+0000 7f1dede00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1dd406d0f0 0x7f1dd406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:47.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.447+0000 7f1dede00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1dd406d0f0 0x7f1dd406f5a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1de0006fd0 tx=0x7f1de0008040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:47.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.451+0000 7f1de6000700 1 -- 172.21.15.148:0/739280669 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f1ddc05b680 con 0x7f1df00fe0e0 2024-02-28T16:29:47.554 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:47 smithi148 ceph-mon[28767]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-02-28T16:29:47.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.692+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1df0111a70 con 0x7f1dd406d0f0 2024-02-28T16:29:47.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.695+0000 7f1de6000700 1 -- 172.21.15.148:0/739280669 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f1df0111a70 con 0x7f1dd406d0f0 2024-02-28T16:29:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.697+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1dd406d0f0 msgr2=0x7f1dd406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.697+0000 7f1df4e00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1dd406d0f0 0x7f1dd406f5a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1de0006fd0 tx=0x7f1de0008040 comp rx=0 tx=0).stop 2024-02-28T16:29:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 msgr2=0x7f1df01100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df01100d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00b3b0 tx=0x7f1ddc009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 shutdown_connections 2024-02-28T16:29:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f1dd406d0f0 0x7f1dd406f5a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1df00fcef0 0x7f1df010fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 --2- 172.21.15.148:0/739280669 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1df00fe0e0 0x7f1df01100d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 >> 172.21.15.148:0/739280669 conn(0x7f1df00f8620 msgr2=0x7f1df00ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 shutdown_connections 2024-02-28T16:29:47.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.698+0000 7f1df4e00700 1 -- 172.21.15.148:0/739280669 wait complete. 2024-02-28T16:29:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 -- 172.21.15.148:0/798508024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fe0e0 msgr2=0x7fe4980fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 --2- 172.21.15.148:0/798508024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fe0e0 0x7fe4980fe550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe488004940 tx=0x7fe488009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 -- 172.21.15.148:0/798508024 shutdown_connections 2024-02-28T16:29:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 --2- 172.21.15.148:0/798508024 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fe0e0 0x7fe4980fe550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 --2- 172.21.15.148:0/798508024 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4980fcef0 0x7fe4980fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 -- 172.21.15.148:0/798508024 >> 172.21.15.148:0/798508024 conn(0x7fe4980f8620 msgr2=0x7fe4980faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 -- 172.21.15.148:0/798508024 shutdown_connections 2024-02-28T16:29:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.853+0000 7fe4a0800700 1 -- 172.21.15.148:0/798508024 wait complete. 2024-02-28T16:29:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.854+0000 7fe4a0800700 1 Processor -- start 2024-02-28T16:29:47.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.854+0000 7fe4a0800700 1 -- start start 2024-02-28T16:29:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.855+0000 7fe4a0800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fcef0 0x7fe498071e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.855+0000 7fe4a0800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4980fe0e0 0x7fe4980702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.855+0000 7fe4a0800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4980708e0 con 0x7fe4980fcef0 2024-02-28T16:29:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.855+0000 7fe4a0800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe498070a50 con 0x7fe4980fe0e0 2024-02-28T16:29:47.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.855+0000 7fe49de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fcef0 0x7fe498071e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.855+0000 7fe49de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fcef0 0x7fe498071e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38866/0 (socket says 172.21.15.148:38866) 2024-02-28T16:29:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.855+0000 7fe49de00700 1 -- 172.21.15.148:0/2583476489 learned_addr learned my addr 172.21.15.148:0/2583476489 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.856+0000 7fe49d400700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4980fe0e0 0x7fe4980702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.856+0000 7fe49de00700 1 -- 172.21.15.148:0/2583476489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4980fe0e0 msgr2=0x7fe4980702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.856+0000 7fe49de00700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4980fe0e0 0x7fe4980702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:47.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.856+0000 7fe49de00700 1 -- 172.21.15.148:0/2583476489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe488005040 con 0x7fe4980fcef0 2024-02-28T16:29:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.856+0000 7fe49de00700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fcef0 0x7fe498071e60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe48c002a80 tx=0x7fe48c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.856+0000 7fe492000700 1 -- 172.21.15.148:0/2583476489 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c007cc0 con 0x7fe4980fcef0 2024-02-28T16:29:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.857+0000 7fe492000700 1 -- 172.21.15.148:0/2583476489 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe48c00f040 con 0x7fe4980fcef0 2024-02-28T16:29:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.857+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe498070d30 con 0x7fe4980fcef0 2024-02-28T16:29:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.857+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4981159a0 con 0x7fe4980fcef0 2024-02-28T16:29:47.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.857+0000 7fe492000700 1 -- 172.21.15.148:0/2583476489 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe48c00dad0 con 0x7fe4980fcef0 2024-02-28T16:29:47.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.859+0000 7fe492000700 1 -- 172.21.15.148:0/2583476489 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7fe48c00dc30 con 0x7fe4980fcef0 2024-02-28T16:29:47.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.859+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c0052e0 con 0x7fe4980fcef0 2024-02-28T16:29:47.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.860+0000 7fe492000700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe48006d0e0 0x7fe48006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:47.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.860+0000 7fe492000700 1 -- 172.21.15.148:0/2583476489 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe48c08c290 con 0x7fe4980fcef0 2024-02-28T16:29:47.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.860+0000 7fe49d400700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe48006d0e0 0x7fe48006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:47.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.861+0000 7fe49d400700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe48006d0e0 0x7fe48006f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe488004f90 tx=0x7fe488009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:47.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:47.865+0000 7fe492000700 1 -- 172.21.15.148:0/2583476489 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fe48c059ee0 con 0x7fe4980fcef0 2024-02-28T16:29:47.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:47 smithi157 ceph-mon[38346]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 4.2 KiB/s rd, 55 KiB/s wr, 17 op/s 2024-02-28T16:29:48.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.102+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe47c000bf0 con 0x7fe48006d0e0 2024-02-28T16:29:48.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.118+0000 7fe492000700 1 -- 172.21.15.148:0/2583476489 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe47c000bf0 con 0x7fe48006d0e0 2024-02-28T16:29:48.107 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:29:48.107 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (3m) 30s ago 15m 15.3M - 0.25.0 c8568f914cd2 e5165660981e 2024-02-28T16:29:48.107 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (15m) 30s ago 15m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:29:48.107 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (14m) 33s ago 14m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:29:48.107 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (3m) 30s ago 14m 75.6M - 9.4.7 954c08fa6188 f71525960747 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (7m) 30s ago 7m 13.1M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (7m) 30s ago 7m 171M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (7m) 33s ago 7m 13.1M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (7m) 33s ago 7m 13.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (2m) 30s ago 17m 494M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (73s) 33s ago 13m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (17m) 30s ago 17m 52.2M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (13m) 33s ago 13m 42.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (45s) 30s ago 15m 6647k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (38s) 33s ago 13m 2600k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (12m) 30s ago 12m 199M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (11m) 30s ago 11m 202M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (10m) 30s ago 10m 174M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:29:48.108 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (10m) 33s ago 10m 232M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:29:48.109 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (9m) 33s ago 9m 204M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:29:48.109 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (9m) 33s ago 9m 185M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:29:48.109 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 starting - - - - 2024-02-28T16:29:48.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe48006d0e0 msgr2=0x7fe48006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe48006d0e0 0x7fe48006f590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe488004f90 tx=0x7fe488009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fcef0 msgr2=0x7fe498071e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fcef0 0x7fe498071e60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe48c002a80 tx=0x7fe48c004600 comp rx=0 tx=0).stop 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 shutdown_connections 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fe48006d0e0 0x7fe48006f590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe4980fcef0 0x7fe498071e60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 --2- 172.21.15.148:0/2583476489 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4980fe0e0 0x7fe4980702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.121+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 >> 172.21.15.148:0/2583476489 conn(0x7fe4980f8620 msgr2=0x7fe4981013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.122+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 shutdown_connections 2024-02-28T16:29:48.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.122+0000 7fe4a0800700 1 -- 172.21.15.148:0/2583476489 wait complete. 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.263+0000 7f8327000700 1 -- 172.21.15.148:0/3787220680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 msgr2=0x7f8320070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.263+0000 7f8327000700 1 --2- 172.21.15.148:0/3787220680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f8320070d10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8310009ce0 tx=0x7f8310004d10 comp rx=0 tx=0).stop 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.263+0000 7f8327000700 1 -- 172.21.15.148:0/3787220680 shutdown_connections 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.263+0000 7f8327000700 1 --2- 172.21.15.148:0/3787220680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f8320070d10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.263+0000 7f8327000700 1 --2- 172.21.15.148:0/3787220680 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8320071f10 0x7f8320070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.263+0000 7f8327000700 1 -- 172.21.15.148:0/3787220680 >> 172.21.15.148:0/3787220680 conn(0x7f83200f8620 msgr2=0x7f83200faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.264+0000 7f8327000700 1 -- 172.21.15.148:0/3787220680 shutdown_connections 2024-02-28T16:29:48.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.264+0000 7f8327000700 1 -- 172.21.15.148:0/3787220680 wait complete. 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.264+0000 7f8327000700 1 Processor -- start 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f8327000700 1 -- start start 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f8327000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f832010fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f8327000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8320071f10 0x7f8320110350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f8327000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320111110 con 0x7f83200708c0 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f8327000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320111280 con 0x7f8320071f10 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f831fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f832010fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f831fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f832010fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38896/0 (socket says 172.21.15.148:38896) 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.265+0000 7f831fe00700 1 -- 172.21.15.148:0/48893926 learned_addr learned my addr 172.21.15.148:0/48893926 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.266+0000 7f831f400700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8320071f10 0x7f8320110350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.266+0000 7f831fe00700 1 -- 172.21.15.148:0/48893926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8320071f10 msgr2=0x7f8320110350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.266+0000 7f831fe00700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8320071f10 0x7f8320110350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.266+0000 7f831fe00700 1 -- 172.21.15.148:0/48893926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009940 con 0x7f83200708c0 2024-02-28T16:29:48.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.266+0000 7f831fe00700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f832010fe10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8308002a50 tx=0x7f83080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:48.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.266+0000 7f8317e00700 1 -- 172.21.15.148:0/48893926 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8308007cc0 con 0x7f83200708c0 2024-02-28T16:29:48.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.266+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8320111500 con 0x7f83200708c0 2024-02-28T16:29:48.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.267+0000 7f8317e00700 1 -- 172.21.15.148:0/48893926 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f830800f040 con 0x7f83200708c0 2024-02-28T16:29:48.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.267+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8320111a40 con 0x7f83200708c0 2024-02-28T16:29:48.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.267+0000 7f8317e00700 1 -- 172.21.15.148:0/48893926 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f830800db70 con 0x7f83200708c0 2024-02-28T16:29:48.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.268+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc0052e0 con 0x7f83200708c0 2024-02-28T16:29:48.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.269+0000 7f8317e00700 1 -- 172.21.15.148:0/48893926 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f8308009070 con 0x7f83200708c0 2024-02-28T16:29:48.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.270+0000 7f8317e00700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f830406d0e0 0x7f830406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:48.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.270+0000 7f8317e00700 1 -- 172.21.15.148:0/48893926 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f830808bbb0 con 0x7f83200708c0 2024-02-28T16:29:48.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.270+0000 7f831f400700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f830406d0e0 0x7f830406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:48.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.271+0000 7f831f400700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f830406d0e0 0x7f830406f590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f831000b740 tx=0x7f8310004d10 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:48.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.275+0000 7f8317e00700 1 -- 172.21.15.148:0/48893926 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8308092080 con 0x7f83200708c0 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.599+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f82fc005da0 con 0x7f83200708c0 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.600+0000 7f8317e00700 1 -- 172.21.15.148:0/48893926 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f8308017300 con 0x7f83200708c0 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:29:48.589 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:29:48.590 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:29:48.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f830406d0e0 msgr2=0x7f830406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f830406d0e0 0x7f830406f590 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f831000b740 tx=0x7f8310004d10 comp rx=0 tx=0).stop 2024-02-28T16:29:48.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 msgr2=0x7f832010fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f832010fe10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8308002a50 tx=0x7f83080046b0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 shutdown_connections 2024-02-28T16:29:48.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f830406d0e0 0x7f830406f590 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f83200708c0 0x7f832010fe10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 --2- 172.21.15.148:0/48893926 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8320071f10 0x7f8320110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 >> 172.21.15.148:0/48893926 conn(0x7f83200f8620 msgr2=0x7f8320102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:48.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 shutdown_connections 2024-02-28T16:29:48.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.603+0000 7f8327000700 1 -- 172.21.15.148:0/48893926 wait complete. 2024-02-28T16:29:48.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.754+0000 7f704ba00700 1 -- 172.21.15.148:0/334950521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70440708c0 msgr2=0x7f7044070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.754+0000 7f704ba00700 1 --2- 172.21.15.148:0/334950521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70440708c0 0x7f7044070d10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7030004940 tx=0x7f7030009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:48.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.755+0000 7f704ba00700 1 -- 172.21.15.148:0/334950521 shutdown_connections 2024-02-28T16:29:48.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.755+0000 7f704ba00700 1 --2- 172.21.15.148:0/334950521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70440708c0 0x7f7044070d10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.755+0000 7f704ba00700 1 --2- 172.21.15.148:0/334950521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7044071f10 0x7f7044070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.755+0000 7f704ba00700 1 -- 172.21.15.148:0/334950521 >> 172.21.15.148:0/334950521 conn(0x7f70440f8620 msgr2=0x7f70440faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:48.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.755+0000 7f704ba00700 1 -- 172.21.15.148:0/334950521 shutdown_connections 2024-02-28T16:29:48.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.755+0000 7f704ba00700 1 -- 172.21.15.148:0/334950521 wait complete. 2024-02-28T16:29:48.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.756+0000 7f704ba00700 1 Processor -- start 2024-02-28T16:29:48.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.756+0000 7f704ba00700 1 -- start start 2024-02-28T16:29:48.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f704ba00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70440708c0 0x7f704410fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:48.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f704ba00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7044071f10 0x7f70441100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:48.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f704ba00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70441106b0 con 0x7f7044071f10 2024-02-28T16:29:48.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f704ba00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044110f50 con 0x7f70440708c0 2024-02-28T16:29:48.746 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f7043e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7044071f10 0x7f70441100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:48.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f7043e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7044071f10 0x7f70441100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38922/0 (socket says 172.21.15.148:38922) 2024-02-28T16:29:48.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f7043e00700 1 -- 172.21.15.148:0/1454710362 learned_addr learned my addr 172.21.15.148:0/1454710362 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:29:48.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f7049000700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70440708c0 0x7f704410fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:48.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f7043e00700 1 -- 172.21.15.148:0/1454710362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70440708c0 msgr2=0x7f704410fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.757+0000 7f7043e00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70440708c0 0x7f704410fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.758+0000 7f7043e00700 1 -- 172.21.15.148:0/1454710362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030005040 con 0x7f7044071f10 2024-02-28T16:29:48.747 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.758+0000 7f7043e00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7044071f10 0x7f70441100b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7030009fd0 tx=0x7f7030009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:48.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.758+0000 7f7040c00700 1 -- 172.21.15.148:0/1454710362 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703000e040 con 0x7f7044071f10 2024-02-28T16:29:48.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.758+0000 7f7040c00700 1 -- 172.21.15.148:0/1454710362 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7030004290 con 0x7f7044071f10 2024-02-28T16:29:48.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.758+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70441111d0 con 0x7f7044071f10 2024-02-28T16:29:48.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.758+0000 7f7040c00700 1 -- 172.21.15.148:0/1454710362 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f703001c630 con 0x7f7044071f10 2024-02-28T16:29:48.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.758+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7044111710 con 0x7f7044071f10 2024-02-28T16:29:48.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.760+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704404bed0 con 0x7f7044071f10 2024-02-28T16:29:48.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.761+0000 7f7040c00700 1 -- 172.21.15.148:0/1454710362 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f703000bc60 con 0x7f7044071f10 2024-02-28T16:29:48.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.763+0000 7f7040c00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f702c06d0f0 0x7f702c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:29:48.752 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.763+0000 7f7040c00700 1 -- 172.21.15.148:0/1454710362 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f703008d970 con 0x7f7044071f10 2024-02-28T16:29:48.752 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:48 smithi148 ceph-mon[28767]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:48.752 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:48 smithi148 ceph-mon[28767]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:48.753 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:48.753 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:48.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.763+0000 7f7049000700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f702c06d0f0 0x7f702c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:29:48.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.764+0000 7f7049000700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f702c06d0f0 0x7f702c06f5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7038007fd0 tx=0x7f7038009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:29:48.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:48.770+0000 7f7040c00700 1 -- 172.21.15.148:0/1454710362 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f703005b520 con 0x7f7044071f10 2024-02-28T16:29:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:48 smithi157 ceph-mon[38346]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:48 smithi157 ceph-mon[38346]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:48.993 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.004+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7044111bb0 con 0x7f702c06d0f0 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.006+0000 7f7040c00700 1 -- 172.21.15.148:0/1454710362 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f7044111bb0 con 0x7f702c06d0f0 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-28T16:29:48.995 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:29:48.996 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:29:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f702c06d0f0 msgr2=0x7f702c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f702c06d0f0 0x7f702c06f5a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7038007fd0 tx=0x7f7038009040 comp rx=0 tx=0).stop 2024-02-28T16:29:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7044071f10 msgr2=0x7f70441100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7044071f10 0x7f70441100b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7030009fd0 tx=0x7f7030009e30 comp rx=0 tx=0).stop 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 shutdown_connections 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f702c06d0f0 0x7f702c06f5a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70440708c0 0x7f704410fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 --2- 172.21.15.148:0/1454710362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7044071f10 0x7f70441100b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.008+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 >> 172.21.15.148:0/1454710362 conn(0x7f70440f8620 msgr2=0x7f7044102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.009+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 shutdown_connections 2024-02-28T16:29:48.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:29:49.009+0000 7f704ba00700 1 -- 172.21.15.148:0/1454710362 wait complete. 2024-02-28T16:29:49.835 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:49 smithi148 ceph-mon[28767]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:49.835 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:49 smithi148 ceph-mon[28767]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-02-28T16:29:49.835 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:49 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/48893926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:49 smithi157 ceph-mon[38346]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:49 smithi157 ceph-mon[38346]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-02-28T16:29:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:49 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/48893926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:50.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:50 smithi148 ceph-mon[28767]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:50.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:50 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:50.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:50 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:50.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:50 smithi157 ceph-mon[38346]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:29:50.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:50 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:50.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:50 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:51.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:51 smithi148 ceph-mon[28767]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-02-28T16:29:51.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:51 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:51.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:51 smithi157 ceph-mon[38346]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-02-28T16:29:51.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:29:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:53 smithi148 ceph-mon[28767]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-02-28T16:29:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:53 smithi157 ceph-mon[38346]: pgmap v64: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 2.2 KiB/s wr, 0 op/s 2024-02-28T16:29:55.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:55 smithi148 ceph-mon[28767]: pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:29:55.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:55 smithi157 ceph-mon[38346]: pgmap v65: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:29:57.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:57.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:57 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: pgmap v66: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:29:57.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:57.489 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:57 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:29:59.829 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:29:59 smithi148 ceph-mon[28767]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:29:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:29:59 smithi157 ceph-mon[38346]: pgmap v67: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:00.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:00 smithi148 ceph-mon[28767]: Upgrade: Updating alertmanager.smithi148 2024-02-28T16:30:00.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:00 smithi148 ceph-mon[28767]: Deploying daemon alertmanager.smithi148 on smithi148 2024-02-28T16:30:00.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:00 smithi148 ceph-mon[28767]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:30:00.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:00 smithi148 ceph-mon[28767]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:30:00.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:00 smithi148 ceph-mon[28767]: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:30:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:00 smithi157 ceph-mon[38346]: Upgrade: Updating alertmanager.smithi148 2024-02-28T16:30:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:00 smithi157 ceph-mon[38346]: Deploying daemon alertmanager.smithi148 on smithi148 2024-02-28T16:30:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:00 smithi157 ceph-mon[38346]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:30:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:00 smithi157 ceph-mon[38346]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:30:00.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:00 smithi157 ceph-mon[38346]: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:30:01.773 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:01 smithi148 ceph-mon[28767]: pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:01.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:01 smithi157 ceph-mon[38346]: pgmap v68: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:03.561 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:03 smithi148 ceph-mon[28767]: pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:03.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:03 smithi157 ceph-mon[38346]: pgmap v69: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:05.789 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:05 smithi157 ceph-mon[38346]: pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:05.854 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:05 smithi148 ceph-mon[28767]: pgmap v70: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:06.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:06 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:06.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:06 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:07 smithi148 ceph-mon[28767]: pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:07 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:07 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:07 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:07.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:07 smithi157 ceph-mon[38346]: pgmap v71: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:07.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:07 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:07.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:07 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:07.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:07 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:09.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:09 smithi148 ceph-mon[28767]: pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:09.993 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:09 smithi157 ceph-mon[38346]: pgmap v72: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:10 smithi157 ceph-mon[38346]: pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:11.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:10 smithi148 ceph-mon[28767]: pgmap v73: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:13.760 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:13 smithi148 ceph-mon[28767]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:13 smithi157 ceph-mon[38346]: pgmap v74: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:15 smithi148 ceph-mon[28767]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:15 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:15 smithi157 ceph-mon[38346]: pgmap v75: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:15 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:17.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:17 smithi148 ceph-mon[28767]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:17.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:17 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:17.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:17 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:17 smithi157 ceph-mon[38346]: pgmap v76: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:17 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:17 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.165+0000 7efd32600700 1 -- 172.21.15.148:0/2026515156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 msgr2=0x7efd2c070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.165+0000 7efd32600700 1 --2- 172.21.15.148:0/2026515156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c070380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efd1c004940 tx=0x7efd1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.165+0000 7efd32600700 1 -- 172.21.15.148:0/2026515156 shutdown_connections 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.165+0000 7efd32600700 1 --2- 172.21.15.148:0/2026515156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd2c0708c0 0x7efd2c070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.165+0000 7efd32600700 1 --2- 172.21.15.148:0/2026515156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c070380 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.165+0000 7efd32600700 1 -- 172.21.15.148:0/2026515156 >> 172.21.15.148:0/2026515156 conn(0x7efd2c0f8620 msgr2=0x7efd2c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.166+0000 7efd32600700 1 -- 172.21.15.148:0/2026515156 shutdown_connections 2024-02-28T16:30:19.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.166+0000 7efd32600700 1 -- 172.21.15.148:0/2026515156 wait complete. 2024-02-28T16:30:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.167+0000 7efd32600700 1 Processor -- start 2024-02-28T16:30:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.167+0000 7efd32600700 1 -- start start 2024-02-28T16:30:19.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.167+0000 7efd32600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd2c0708c0 0x7efd2c0fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.167+0000 7efd32600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c0fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.167+0000 7efd32600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0fd8f0 con 0x7efd2c071f10 2024-02-28T16:30:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.167+0000 7efd32600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0fe190 con 0x7efd2c0708c0 2024-02-28T16:30:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.167+0000 7efd2aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c0fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.168+0000 7efd2aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c0fd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57434/0 (socket says 172.21.15.148:57434) 2024-02-28T16:30:19.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.168+0000 7efd2aa00700 1 -- 172.21.15.148:0/2513579518 learned_addr learned my addr 172.21.15.148:0/2513579518 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.168+0000 7efd2aa00700 1 -- 172.21.15.148:0/2513579518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd2c0708c0 msgr2=0x7efd2c0fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.168+0000 7efd2aa00700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd2c0708c0 0x7efd2c0fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.168+0000 7efd2aa00700 1 -- 172.21.15.148:0/2513579518 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c005040 con 0x7efd2c071f10 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.168+0000 7efd2aa00700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c0fd2a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c830 tx=0x7efd18004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.169+0000 7efd23400700 1 -- 172.21.15.148:0/2513579518 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd1800a760 con 0x7efd2c071f10 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.169+0000 7efd23400700 1 -- 172.21.15.148:0/2513579518 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd1800ad90 con 0x7efd2c071f10 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.169+0000 7efd23400700 1 -- 172.21.15.148:0/2513579518 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd180113a0 con 0x7efd2c071f10 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.169+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c0fe470 con 0x7efd2c071f10 2024-02-28T16:30:19.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.169+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c0fe960 con 0x7efd2c071f10 2024-02-28T16:30:19.159 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.170+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c04bed0 con 0x7efd2c071f10 2024-02-28T16:30:19.161 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.173+0000 7efd23400700 1 -- 172.21.15.148:0/2513579518 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7efd18012400 con 0x7efd2c071f10 2024-02-28T16:30:19.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.174+0000 7efd23400700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd1006d0f0 0x7efd1006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.174+0000 7efd23400700 1 -- 172.21.15.148:0/2513579518 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7efd1808d070 con 0x7efd2c071f10 2024-02-28T16:30:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.174+0000 7efd2b400700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd1006d0f0 0x7efd1006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:19.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.175+0000 7efd2b400700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd1006d0f0 0x7efd1006f5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efd1c004f90 tx=0x7efd1c009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:19.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.177+0000 7efd23400700 1 -- 172.21.15.148:0/2513579518 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7efd18057230 con 0x7efd2c071f10 2024-02-28T16:30:19.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.420+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd2c1044f0 con 0x7efd1006d0f0 2024-02-28T16:30:19.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.423+0000 7efd23400700 1 -- 172.21.15.148:0/2513579518 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7efd2c1044f0 con 0x7efd1006d0f0 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd1006d0f0 msgr2=0x7efd1006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd1006d0f0 0x7efd1006f5a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efd1c004f90 tx=0x7efd1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 msgr2=0x7efd2c0fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c0fd2a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c830 tx=0x7efd18004470 comp rx=0 tx=0).stop 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 shutdown_connections 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7efd1006d0f0 0x7efd1006f5a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd2c0708c0 0x7efd2c0fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 --2- 172.21.15.148:0/2513579518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd2c071f10 0x7efd2c0fd2a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.425+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 >> 172.21.15.148:0/2513579518 conn(0x7efd2c0f8620 msgr2=0x7efd2c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.426+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 shutdown_connections 2024-02-28T16:30:19.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.426+0000 7efd32600700 1 -- 172.21.15.148:0/2513579518 wait complete. 2024-02-28T16:30:19.431 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:30:19.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.574+0000 7ff451600700 1 -- 172.21.15.148:0/3651900386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c071f10 msgr2=0x7ff44c070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.574+0000 7ff451600700 1 --2- 172.21.15.148:0/3651900386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c071f10 0x7ff44c070380 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff43c004940 tx=0x7ff43c009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.574+0000 7ff451600700 1 -- 172.21.15.148:0/3651900386 shutdown_connections 2024-02-28T16:30:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.574+0000 7ff451600700 1 --2- 172.21.15.148:0/3651900386 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff44c0708c0 0x7ff44c070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.574+0000 7ff451600700 1 --2- 172.21.15.148:0/3651900386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c071f10 0x7ff44c070380 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.574+0000 7ff451600700 1 -- 172.21.15.148:0/3651900386 >> 172.21.15.148:0/3651900386 conn(0x7ff44c0f8620 msgr2=0x7ff44c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.575+0000 7ff451600700 1 -- 172.21.15.148:0/3651900386 shutdown_connections 2024-02-28T16:30:19.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.575+0000 7ff451600700 1 -- 172.21.15.148:0/3651900386 wait complete. 2024-02-28T16:30:19.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.575+0000 7ff451600700 1 Processor -- start 2024-02-28T16:30:19.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff451600700 1 -- start start 2024-02-28T16:30:19.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff451600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0708c0 0x7ff44c10fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff451600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff44c071f10 0x7ff44c1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff451600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c1106e0 con 0x7ff44c0708c0 2024-02-28T16:30:19.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff451600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c110f80 con 0x7ff44c071f10 2024-02-28T16:30:19.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff44aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0708c0 0x7ff44c10fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:19.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff44aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0708c0 0x7ff44c10fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57440/0 (socket says 172.21.15.148:57440) 2024-02-28T16:30:19.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.576+0000 7ff44aa00700 1 -- 172.21.15.148:0/2347660923 learned_addr learned my addr 172.21.15.148:0/2347660923 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:19.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff44aa00700 1 -- 172.21.15.148:0/2347660923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff44c071f10 msgr2=0x7ff44c1100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff44aa00700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff44c071f10 0x7ff44c1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff44aa00700 1 -- 172.21.15.148:0/2347660923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c005040 con 0x7ff44c0708c0 2024-02-28T16:30:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff44aa00700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0708c0 0x7ff44c10fba0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff43c000c00 tx=0x7ff43c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff442a00700 1 -- 172.21.15.148:0/2347660923 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff43c00e040 con 0x7ff44c0708c0 2024-02-28T16:30:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff442a00700 1 -- 172.21.15.148:0/2347660923 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff43c004290 con 0x7ff44c0708c0 2024-02-28T16:30:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff442a00700 1 -- 172.21.15.148:0/2347660923 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff43c01c630 con 0x7ff44c0708c0 2024-02-28T16:30:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c111200 con 0x7ff44c0708c0 2024-02-28T16:30:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.577+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c111740 con 0x7ff44c0708c0 2024-02-28T16:30:19.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.578+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c04bed0 con 0x7ff44c0708c0 2024-02-28T16:30:19.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.580+0000 7ff442a00700 1 -- 172.21.15.148:0/2347660923 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7ff43c00bc60 con 0x7ff44c0708c0 2024-02-28T16:30:19.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.580+0000 7ff442a00700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff43006d0e0 0x7ff43006f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.581+0000 7ff442a00700 1 -- 172.21.15.148:0/2347660923 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff43c08d910 con 0x7ff44c0708c0 2024-02-28T16:30:19.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.581+0000 7ff44a000700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff43006d0e0 0x7ff43006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:19.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.582+0000 7ff44a000700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff43006d0e0 0x7ff43006f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff434004ad0 tx=0x7ff434007d40 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:19.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.586+0000 7ff442a00700 1 -- 172.21.15.148:0/2347660923 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ff43c05b540 con 0x7ff44c0708c0 2024-02-28T16:30:19.685 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:19 smithi148 ceph-mon[28767]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:19.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.828+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff44c1044f0 con 0x7ff43006d0e0 2024-02-28T16:30:19.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.831+0000 7ff442a00700 1 -- 172.21.15.148:0/2347660923 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff44c1044f0 con 0x7ff43006d0e0 2024-02-28T16:30:19.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff43006d0e0 msgr2=0x7ff43006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff43006d0e0 0x7ff43006f590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff434004ad0 tx=0x7ff434007d40 comp rx=0 tx=0).stop 2024-02-28T16:30:19.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0708c0 msgr2=0x7ff44c10fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0708c0 0x7ff44c10fba0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff43c000c00 tx=0x7ff43c009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 shutdown_connections 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ff43006d0e0 0x7ff43006f590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff44c0708c0 0x7ff44c10fba0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 --2- 172.21.15.148:0/2347660923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff44c071f10 0x7ff44c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.833+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 >> 172.21.15.148:0/2347660923 conn(0x7ff44c0f8620 msgr2=0x7ff44c102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.834+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 shutdown_connections 2024-02-28T16:30:19.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.834+0000 7ff451600700 1 -- 172.21.15.148:0/2347660923 wait complete. 2024-02-28T16:30:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 -- 172.21.15.148:0/965715516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fe0e0 msgr2=0x7f6e880fe550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.971 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/965715516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fe0e0 0x7f6e880fe550 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6e74004940 tx=0x7f6e74009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 -- 172.21.15.148:0/965715516 shutdown_connections 2024-02-28T16:30:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/965715516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fe0e0 0x7f6e880fe550 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/965715516 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e880fcef0 0x7f6e880fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 -- 172.21.15.148:0/965715516 >> 172.21.15.148:0/965715516 conn(0x7f6e880f8620 msgr2=0x7f6e880faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 -- 172.21.15.148:0/965715516 shutdown_connections 2024-02-28T16:30:19.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.982+0000 7f6e8cc00700 1 -- 172.21.15.148:0/965715516 wait complete. 2024-02-28T16:30:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.983+0000 7f6e8cc00700 1 Processor -- start 2024-02-28T16:30:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.983+0000 7f6e8cc00700 1 -- start start 2024-02-28T16:30:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e8cc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fcef0 0x7f6e8810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e8cc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e880fe0e0 0x7f6e881100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e8cc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88110740 con 0x7f6e880fcef0 2024-02-28T16:30:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e8cc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88110f80 con 0x7f6e880fe0e0 2024-02-28T16:30:19.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e85e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fcef0 0x7f6e8810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e85e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fcef0 0x7f6e8810fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57460/0 (socket says 172.21.15.148:57460) 2024-02-28T16:30:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e85e00700 1 -- 172.21.15.148:0/113001166 learned_addr learned my addr 172.21.15.148:0/113001166 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.984+0000 7f6e85400700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e880fe0e0 0x7f6e881100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e85e00700 1 -- 172.21.15.148:0/113001166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e880fe0e0 msgr2=0x7f6e881100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e85e00700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e880fe0e0 0x7f6e881100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:19.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e85e00700 1 -- 172.21.15.148:0/113001166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74005040 con 0x7f6e880fcef0 2024-02-28T16:30:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e85e00700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fcef0 0x7f6e8810fb70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800b790 tx=0x7f6e78009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e7e000700 1 -- 172.21.15.148:0/113001166 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7800f6f0 con 0x7f6e880fcef0 2024-02-28T16:30:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e7e000700 1 -- 172.21.15.148:0/113001166 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e7800fd20 con 0x7f6e880fcef0 2024-02-28T16:30:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e88111260 con 0x7f6e880fcef0 2024-02-28T16:30:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e7e000700 1 -- 172.21.15.148:0/113001166 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e780103a0 con 0x7f6e880fcef0 2024-02-28T16:30:19.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.985+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e881117a0 con 0x7f6e880fcef0 2024-02-28T16:30:19.976 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.987+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e680052e0 con 0x7f6e880fcef0 2024-02-28T16:30:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.988+0000 7f6e7e000700 1 -- 172.21.15.148:0/113001166 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f6e7800f850 con 0x7f6e880fcef0 2024-02-28T16:30:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.989+0000 7f6e7e000700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6e6c06d0f0 0x7f6e6c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:19.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.989+0000 7f6e7e000700 1 -- 172.21.15.148:0/113001166 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6e7808c340 con 0x7f6e880fcef0 2024-02-28T16:30:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.989+0000 7f6e85400700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6e6c06d0f0 0x7f6e6c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:19.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.990+0000 7f6e85400700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6e6c06d0f0 0x7f6e6c06f5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400b3b0 tx=0x7f6e74009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:19.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:19.998+0000 7f6e7e000700 1 -- 172.21.15.148:0/113001166 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6e78059f10 con 0x7f6e880fcef0 2024-02-28T16:30:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:19 smithi157 ceph-mon[38346]: pgmap v77: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:20.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.230+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e68000bf0 con 0x7f6e6c06d0f0 2024-02-28T16:30:20.278 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.241+0000 7f6e7e000700 1 -- 172.21.15.148:0/113001166 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6e68000bf0 con 0x7f6e6c06d0f0 2024-02-28T16:30:20.278 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:30:20.278 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (13s) 5s ago 15m 13.5M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:30:20.278 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (16m) 5s ago 16m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (14m) 65s ago 14m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (4m) 5s ago 15m 75.6M - 9.4.7 954c08fa6188 f71525960747 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (7m) 5s ago 7m 13.3M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (7m) 5s ago 7m 146M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (7m) 65s ago 7m 13.1M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (7m) 65s ago 7m 13.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (3m) 5s ago 17m 497M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (105s) 65s ago 13m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (17m) 5s ago 17m 54.0M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (13m) 65s ago 13m 42.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (77s) 5s ago 16m 7235k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (70s) 65s ago 13m 2600k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (12m) 5s ago 12m 206M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:30:20.279 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (12m) 5s ago 12m 210M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:30:20.280 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (11m) 5s ago 11m 180M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:30:20.280 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (10m) 65s ago 10m 232M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:30:20.280 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (10m) 65s ago 10m 204M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:30:20.280 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (9m) 65s ago 9m 185M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:30:20.280 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (39s) 5s ago 15m 43.4M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6e6c06d0f0 msgr2=0x7f6e6c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6e6c06d0f0 0x7f6e6c06f5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400b3b0 tx=0x7f6e74009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fcef0 msgr2=0x7f6e8810fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fcef0 0x7f6e8810fb70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800b790 tx=0x7f6e78009220 comp rx=0 tx=0).stop 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 shutdown_connections 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6e6c06d0f0 0x7f6e6c06f5a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6e880fcef0 0x7f6e8810fb70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 --2- 172.21.15.148:0/113001166 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6e880fe0e0 0x7f6e881100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 >> 172.21.15.148:0/113001166 conn(0x7f6e880f8620 msgr2=0x7f6e880ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 shutdown_connections 2024-02-28T16:30:20.281 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.245+0000 7f6e8cc00700 1 -- 172.21.15.148:0/113001166 wait complete. 2024-02-28T16:30:20.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.389+0000 7f7adc800700 1 -- 172.21.15.148:0/4197552603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fb870 msgr2=0x7f7ad40fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.389+0000 7f7adc800700 1 --2- 172.21.15.148:0/4197552603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fb870 0x7f7ad40fbc80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8004940 tx=0x7f7ac8009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.389+0000 7f7adc800700 1 -- 172.21.15.148:0/4197552603 shutdown_connections 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.389+0000 7f7adc800700 1 --2- 172.21.15.148:0/4197552603 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ad40fc1c0 0x7f7ad40fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.389+0000 7f7adc800700 1 --2- 172.21.15.148:0/4197552603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fb870 0x7f7ad40fbc80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.389+0000 7f7adc800700 1 -- 172.21.15.148:0/4197552603 >> 172.21.15.148:0/4197552603 conn(0x7f7ad40f74e0 msgr2=0x7f7ad40f9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.390+0000 7f7adc800700 1 -- 172.21.15.148:0/4197552603 shutdown_connections 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.390+0000 7f7adc800700 1 -- 172.21.15.148:0/4197552603 wait complete. 2024-02-28T16:30:20.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.390+0000 7f7adc800700 1 Processor -- start 2024-02-28T16:30:20.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7adc800700 1 -- start start 2024-02-28T16:30:20.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7adc800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ad40fb870 0x7f7ad410fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:20.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7adc800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fc1c0 0x7f7ad4110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:20.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7adc800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4110680 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7adc800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4110f20 con 0x7f7ad40fb870 2024-02-28T16:30:20.381 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7ad9400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fc1c0 0x7f7ad4110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7ad9400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fc1c0 0x7f7ad4110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57468/0 (socket says 172.21.15.148:57468) 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.391+0000 7f7ad9400700 1 -- 172.21.15.148:0/1522043756 learned_addr learned my addr 172.21.15.148:0/1522043756 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ad9e00700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ad40fb870 0x7f7ad410fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ad9400700 1 -- 172.21.15.148:0/1522043756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ad40fb870 msgr2=0x7f7ad410fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ad9400700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ad40fb870 0x7f7ad410fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ad9400700 1 -- 172.21.15.148:0/1522043756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8005040 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ad9400700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fc1c0 0x7f7ad4110080 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400c830 tx=0x7f7ac4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ace000700 1 -- 172.21.15.148:0/1522043756 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac400a760 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ace000700 1 -- 172.21.15.148:0/1522043756 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ac400ad90 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7ace000700 1 -- 172.21.15.148:0/1522043756 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ac40113a0 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad4111200 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.382 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.392+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad41116f0 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.383 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.393+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad404bed0 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.395+0000 7f7ace000700 1 -- 172.21.15.148:0/1522043756 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f7ac4012400 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.396+0000 7f7ace000700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f7abc06d0e0 0x7f7abc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:20.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.396+0000 7f7ace000700 1 -- 172.21.15.148:0/1522043756 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f7ac408c690 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.396+0000 7f7ad9e00700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f7abc06d0e0 0x7f7abc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:20.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.397+0000 7f7ad9e00700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f7abc06d0e0 0x7f7abc06f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8004f90 tx=0x7f7ac8009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:20.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.400+0000 7f7ace000700 1 -- 172.21.15.148:0/1522043756 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f7ac405a240 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.715+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7ad4107c00 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.716+0000 7f7ace000700 1 -- 172.21.15.148:0/1522043756 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f7ac4059dd0 con 0x7f7ad40fc1c0 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:30:20.705 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:30:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:30:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:30:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:30:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:30:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:30:20.706 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:30:20.706 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:30:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f7abc06d0e0 msgr2=0x7f7abc06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f7abc06d0e0 0x7f7abc06f590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8004f90 tx=0x7f7ac8009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:20.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fc1c0 msgr2=0x7f7ad4110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fc1c0 0x7f7ad4110080 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400c830 tx=0x7f7ac4004470 comp rx=0 tx=0).stop 2024-02-28T16:30:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 shutdown_connections 2024-02-28T16:30:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f7abc06d0e0 0x7f7abc06f590 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ad40fb870 0x7f7ad410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 --2- 172.21.15.148:0/1522043756 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ad40fc1c0 0x7f7ad4110080 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 >> 172.21.15.148:0/1522043756 conn(0x7f7ad40f74e0 msgr2=0x7f7ad4103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:20.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 shutdown_connections 2024-02-28T16:30:20.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.719+0000 7f7adc800700 1 -- 172.21.15.148:0/1522043756 wait complete. 2024-02-28T16:30:20.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.867+0000 7f3c4b400700 1 -- 172.21.15.148:0/204373633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c44071f10 msgr2=0x7f3c44070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.867+0000 7f3c4b400700 1 --2- 172.21.15.148:0/204373633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c44071f10 0x7f3c44070380 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3c38004940 tx=0x7f3c38009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:20.857 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:20 smithi148 ceph-mon[28767]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:20.857 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:20 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.868+0000 7f3c4b400700 1 -- 172.21.15.148:0/204373633 shutdown_connections 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.868+0000 7f3c4b400700 1 --2- 172.21.15.148:0/204373633 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c440708c0 0x7f3c44070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.868+0000 7f3c4b400700 1 --2- 172.21.15.148:0/204373633 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c44071f10 0x7f3c44070380 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.868+0000 7f3c4b400700 1 -- 172.21.15.148:0/204373633 >> 172.21.15.148:0/204373633 conn(0x7f3c440f8620 msgr2=0x7f3c440faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.868+0000 7f3c4b400700 1 -- 172.21.15.148:0/204373633 shutdown_connections 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.868+0000 7f3c4b400700 1 -- 172.21.15.148:0/204373633 wait complete. 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.869+0000 7f3c4b400700 1 Processor -- start 2024-02-28T16:30:20.858 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.869+0000 7f3c4b400700 1 -- start start 2024-02-28T16:30:20.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.869+0000 7f3c4b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c440708c0 0x7f3c4410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:20.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.869+0000 7f3c4b400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c44071f10 0x7f3c441100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:20.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.869+0000 7f3c4b400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441106e0 con 0x7f3c440708c0 2024-02-28T16:30:20.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.869+0000 7f3c4b400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44110f80 con 0x7f3c44071f10 2024-02-28T16:30:20.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.870+0000 7f3c48a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c440708c0 0x7f3c4410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:20.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.870+0000 7f3c48a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c440708c0 0x7f3c4410fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57494/0 (socket says 172.21.15.148:57494) 2024-02-28T16:30:20.859 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.870+0000 7f3c48a00700 1 -- 172.21.15.148:0/1128773614 learned_addr learned my addr 172.21.15.148:0/1128773614 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:20.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.870+0000 7f3c43e00700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c44071f10 0x7f3c441100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:20.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.870+0000 7f3c48a00700 1 -- 172.21.15.148:0/1128773614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c44071f10 msgr2=0x7f3c441100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:20.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.870+0000 7f3c48a00700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c44071f10 0x7f3c441100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:20.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.870+0000 7f3c48a00700 1 -- 172.21.15.148:0/1128773614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38005040 con 0x7f3c440708c0 2024-02-28T16:30:20.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.871+0000 7f3c48a00700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c440708c0 0x7f3c4410fba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009fd0 tx=0x7f3c38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:20.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.871+0000 7f3c40c00700 1 -- 172.21.15.148:0/1128773614 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3800e040 con 0x7f3c440708c0 2024-02-28T16:30:20.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.871+0000 7f3c40c00700 1 -- 172.21.15.148:0/1128773614 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c38004290 con 0x7f3c440708c0 2024-02-28T16:30:20.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.871+0000 7f3c40c00700 1 -- 172.21.15.148:0/1128773614 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3801c630 con 0x7f3c440708c0 2024-02-28T16:30:20.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.871+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c44111200 con 0x7f3c440708c0 2024-02-28T16:30:20.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.871+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c44111740 con 0x7f3c440708c0 2024-02-28T16:30:20.861 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.872+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4404bed0 con 0x7f3c440708c0 2024-02-28T16:30:20.863 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.874+0000 7f3c40c00700 1 -- 172.21.15.148:0/1128773614 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f3c3800bc60 con 0x7f3c440708c0 2024-02-28T16:30:20.864 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.875+0000 7f3c40c00700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f3c2c06d0f0 0x7f3c2c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:20.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.876+0000 7f3c40c00700 1 -- 172.21.15.148:0/1128773614 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f3c3808da80 con 0x7f3c440708c0 2024-02-28T16:30:20.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.876+0000 7f3c43e00700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f3c2c06d0f0 0x7f3c2c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:20.865 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.877+0000 7f3c43e00700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f3c2c06d0f0 0x7f3c2c06f5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c30007fd0 tx=0x7f3c30009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:20.868 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:20.880+0000 7f3c40c00700 1 -- 172.21.15.148:0/1128773614 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f3c3805b770 con 0x7f3c440708c0 2024-02-28T16:30:20.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:20 smithi157 ceph-mon[38346]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:20.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:20 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:21.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.148+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c441044f0 con 0x7f3c2c06d0f0 2024-02-28T16:30:21.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.149+0000 7f3c40c00700 1 -- 172.21.15.148:0/1128773614 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3c441044f0 con 0x7f3c2c06d0f0 2024-02-28T16:30:21.138 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:30:21.139 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f3c2c06d0f0 msgr2=0x7f3c2c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f3c2c06d0f0 0x7f3c2c06f5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3c30007fd0 tx=0x7f3c30009040 comp rx=0 tx=0).stop 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c440708c0 msgr2=0x7f3c4410fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c440708c0 0x7f3c4410fba0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3c38009fd0 tx=0x7f3c38009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 shutdown_connections 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f3c2c06d0f0 0x7f3c2c06f5a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c440708c0 0x7f3c4410fba0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 --2- 172.21.15.148:0/1128773614 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c44071f10 0x7f3c441100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 >> 172.21.15.148:0/1128773614 conn(0x7f3c440f8620 msgr2=0x7f3c44102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:21.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 shutdown_connections 2024-02-28T16:30:21.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:21.152+0000 7f3c4b400700 1 -- 172.21.15.148:0/1128773614 wait complete. 2024-02-28T16:30:21.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:21 smithi148 ceph-mon[28767]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:21.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:21 smithi148 ceph-mon[28767]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:21.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:21 smithi148 ceph-mon[28767]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:21.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:21 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1522043756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:21.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:21 smithi157 ceph-mon[38346]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:21.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:21 smithi157 ceph-mon[38346]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:21.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:21 smithi157 ceph-mon[38346]: pgmap v78: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:21.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:21 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1522043756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:22.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:22.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:22.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:22.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:22.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:22 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:22.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:22 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:23.782 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:23 smithi148 ceph-mon[28767]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:23.783 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:23 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:30:23.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:23 smithi157 ceph-mon[38346]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:23.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:23 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T16:30:25.863 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:25 smithi148 ceph-mon[28767]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:25.863 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:25 smithi148 ceph-mon[28767]: Upgrade: Updating grafana.smithi148 2024-02-28T16:30:25.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:25 smithi157 ceph-mon[38346]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:25.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:25 smithi157 ceph-mon[38346]: Upgrade: Updating grafana.smithi148 2024-02-28T16:30:26.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:26 smithi148 ceph-mon[28767]: Deploying daemon grafana.smithi148 on smithi148 2024-02-28T16:30:26.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:26 smithi157 ceph-mon[38346]: Deploying daemon grafana.smithi148 on smithi148 2024-02-28T16:30:27.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:27 smithi148 ceph-mon[28767]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:27.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:27 smithi157 ceph-mon[38346]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:29.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:29 smithi148 ceph-mon[28767]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:29 smithi157 ceph-mon[38346]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:31.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:30 smithi157 ceph-mon[38346]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:31.320 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:30 smithi148 ceph-mon[28767]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:33.051 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:32 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:33.051 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:32 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:33.051 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:32 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:33.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:32 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:33.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:32 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:33.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:32 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:34.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:33 smithi148 ceph-mon[28767]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:34.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:33 smithi157 ceph-mon[38346]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:36.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:35 smithi157 ceph-mon[38346]: pgmap v85: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:36.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:36.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:35 smithi148 ceph-mon[28767]: pgmap v85: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:36.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:38.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:37 smithi148 ceph-mon[28767]: pgmap v86: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:38.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:37 smithi157 ceph-mon[38346]: pgmap v86: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:38 smithi148 ceph-mon[28767]: pgmap v87: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:39.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:38 smithi157 ceph-mon[38346]: pgmap v87: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:40.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:40 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:40.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:40 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:40.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:40 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:40.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:40 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:41.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:41 smithi148 ceph-mon[28767]: pgmap v88: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:41 smithi157 ceph-mon[38346]: pgmap v88: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:42.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:42 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:42.977 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:42 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:42.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:42 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:42.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:42 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:43.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:43 smithi157 ceph-mon[38346]: pgmap v89: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:44.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:43 smithi148 ceph-mon[28767]: pgmap v89: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:45.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:45 smithi157 ceph-mon[38346]: pgmap v90: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:45 smithi148 ceph-mon[28767]: pgmap v90: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:47.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:47 smithi148 ceph-mon[28767]: pgmap v91: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:47.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:47 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:47.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:47 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:47.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:47 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:47.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:47 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:47.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:47 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:47.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:47 smithi157 ceph-mon[38346]: pgmap v91: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:47.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:47 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:47.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:47 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:47.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:47 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:47.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:47 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:47.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:47 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:30:48.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:30:48.877 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:48.878 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:48.879 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:48.879 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:48.879 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:48.879 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:48.879 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:48.879 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:48 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:30:48.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:30:48.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:30:48.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:30:48.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:30:48.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:49 smithi157 ceph-mon[38346]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:30:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:49 smithi157 ceph-mon[38346]: Upgrade: Finalizing container_image settings 2024-02-28T16:30:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:49 smithi157 ceph-mon[38346]: Upgrade: Complete! 2024-02-28T16:30:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:49 smithi157 ceph-mon[38346]: pgmap v92: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:50.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:49 smithi148 ceph-mon[28767]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T16:30:50.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:49 smithi148 ceph-mon[28767]: Upgrade: Finalizing container_image settings 2024-02-28T16:30:50.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:49 smithi148 ceph-mon[28767]: Upgrade: Complete! 2024-02-28T16:30:50.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:49 smithi148 ceph-mon[28767]: pgmap v92: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:51.308 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:50 smithi148 ceph-mon[28767]: pgmap v93: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:51.308 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:50 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:51.308 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:50 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 -- 172.21.15.148:0/2019753083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fcef0 msgr2=0x7faa7c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 --2- 172.21.15.148:0/2019753083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fcef0 0x7faa7c0fd320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7faa70004940 tx=0x7faa70009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 -- 172.21.15.148:0/2019753083 shutdown_connections 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 --2- 172.21.15.148:0/2019753083 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa7c0fe0e0 0x7faa7c0fe550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 --2- 172.21.15.148:0/2019753083 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fcef0 0x7faa7c0fd320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 -- 172.21.15.148:0/2019753083 >> 172.21.15.148:0/2019753083 conn(0x7faa7c0f8620 msgr2=0x7faa7c0faa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 -- 172.21.15.148:0/2019753083 shutdown_connections 2024-02-28T16:30:51.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.318+0000 7faa84600700 1 -- 172.21.15.148:0/2019753083 wait complete. 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.319+0000 7faa84600700 1 Processor -- start 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.319+0000 7faa84600700 1 -- start start 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa84600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa7c0fcef0 0x7faa7c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa84600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fe0e0 0x7faa7c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa84600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c1106c0 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa84600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7c110f60 con 0x7faa7c0fcef0 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa81200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fe0e0 0x7faa7c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa81200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fe0e0 0x7faa7c1100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:57880/0 (socket says 172.21.15.148:57880) 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa81200700 1 -- 172.21.15.148:0/1552562279 learned_addr learned my addr 172.21.15.148:0/1552562279 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa81c00700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa7c0fcef0 0x7faa7c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa81200700 1 -- 172.21.15.148:0/1552562279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa7c0fcef0 msgr2=0x7faa7c10fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa81200700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa7c0fcef0 0x7faa7c10fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.320+0000 7faa81200700 1 -- 172.21.15.148:0/1552562279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70005040 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.321+0000 7faa81200700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fe0e0 0x7faa7c1100c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c830 tx=0x7faa68004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:51.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.321+0000 7faa79600700 1 -- 172.21.15.148:0/1552562279 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa6800a760 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.321+0000 7faa79600700 1 -- 172.21.15.148:0/1552562279 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa6800ad90 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.321+0000 7faa79600700 1 -- 172.21.15.148:0/1552562279 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa680113a0 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.321+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7c111240 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.321+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7c111780 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.322+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7c102210 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.323+0000 7faa79600700 1 -- 172.21.15.148:0/1552562279 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7faa68012400 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.325+0000 7faa79600700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faa6406d0f0 0x7faa6406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:51.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.325+0000 7faa79600700 1 -- 172.21.15.148:0/1552562279 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7faa6808c640 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.325+0000 7faa81c00700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faa6406d0f0 0x7faa6406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:51.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.326+0000 7faa81c00700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faa6406d0f0 0x7faa6406f5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa7000b3b0 tx=0x7faa70009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:51.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.329+0000 7faa79600700 1 -- 172.21.15.148:0/1552562279 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7faa6805a1f0 con 0x7faa7c0fe0e0 2024-02-28T16:30:51.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:51 smithi157 ceph-mon[38346]: pgmap v93: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:51.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:30:51.488 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:51 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:30:51.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.569+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa7c111af0 con 0x7faa6406d0f0 2024-02-28T16:30:51.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.573+0000 7faa79600700 1 -- 172.21.15.148:0/1552562279 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7faa7c111af0 con 0x7faa6406d0f0 2024-02-28T16:30:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faa6406d0f0 msgr2=0x7faa6406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faa6406d0f0 0x7faa6406f5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa7000b3b0 tx=0x7faa70009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fe0e0 msgr2=0x7faa7c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fe0e0 0x7faa7c1100c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faa6800c830 tx=0x7faa68004470 comp rx=0 tx=0).stop 2024-02-28T16:30:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 shutdown_connections 2024-02-28T16:30:51.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7faa6406d0f0 0x7faa6406f5a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faa7c0fcef0 0x7faa7c10fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 --2- 172.21.15.148:0/1552562279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa7c0fe0e0 0x7faa7c1100c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 >> 172.21.15.148:0/1552562279 conn(0x7faa7c0f8620 msgr2=0x7faa7c0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 shutdown_connections 2024-02-28T16:30:51.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:51.576+0000 7faa84600700 1 -- 172.21.15.148:0/1552562279 wait complete. 2024-02-28T16:30:52.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:52 smithi148 ceph-mon[28767]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:52.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:52 smithi157 ceph-mon[38346]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:30:52.562 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-28T16:30:53.040 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:30:53.340 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:53 smithi148 ceph-mon[28767]: pgmap v94: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:53.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:53 smithi157 ceph-mon[38346]: pgmap v94: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:55.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.361+0000 7f20ec000700 1 -- 172.21.15.148:0/108783270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 msgr2=0x7f20e40fc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:55.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.361+0000 7f20ec000700 1 --2- 172.21.15.148:0/108783270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e40fc070 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f20d8004940 tx=0x7f20d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:55.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.361+0000 7f20ec000700 1 -- 172.21.15.148:0/108783270 shutdown_connections 2024-02-28T16:30:55.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.361+0000 7f20ec000700 1 --2- 172.21.15.148:0/108783270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e40fc5b0 0x7f20e4109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:55.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.361+0000 7f20ec000700 1 --2- 172.21.15.148:0/108783270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e40fc070 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:55.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.361+0000 7f20ec000700 1 -- 172.21.15.148:0/108783270 >> 172.21.15.148:0/108783270 conn(0x7f20e40f79d0 msgr2=0x7f20e40f9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:55.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.362+0000 7f20ec000700 1 -- 172.21.15.148:0/108783270 shutdown_connections 2024-02-28T16:30:55.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.362+0000 7f20ec000700 1 -- 172.21.15.148:0/108783270 wait complete. 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.363+0000 7f20ec000700 1 Processor -- start 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.363+0000 7f20ec000700 1 -- start start 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.363+0000 7f20ec000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e4115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20ec000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e40fc5b0 0x7f20e4116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20ec000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e4116780 con 0x7f20e40fbca0 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20ec000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e410fad0 con 0x7f20e40fc5b0 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20e9600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e4115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20e9600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e4115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36898/0 (socket says 172.21.15.148:36898) 2024-02-28T16:30:55.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20e9600700 1 -- 172.21.15.148:0/524302470 learned_addr learned my addr 172.21.15.148:0/524302470 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20e8c00700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e40fc5b0 0x7f20e4116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20e9600700 1 -- 172.21.15.148:0/524302470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e40fc5b0 msgr2=0x7f20e4116130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20e9600700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e40fc5b0 0x7f20e4116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.364+0000 7f20e9600700 1 -- 172.21.15.148:0/524302470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8005040 con 0x7f20e40fbca0 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.365+0000 7f20e9600700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e4115bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f20d8004890 tx=0x7f20d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.365+0000 7f20e1600700 1 -- 172.21.15.148:0/524302470 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20d800e040 con 0x7f20e40fbca0 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.365+0000 7f20e1600700 1 -- 172.21.15.148:0/524302470 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20d800bbf0 con 0x7f20e40fbca0 2024-02-28T16:30:55.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.365+0000 7f20e1600700 1 -- 172.21.15.148:0/524302470 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20d801c630 con 0x7f20e40fbca0 2024-02-28T16:30:55.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.365+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e410fd50 con 0x7f20e40fbca0 2024-02-28T16:30:55.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.365+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e4110290 con 0x7f20e40fbca0 2024-02-28T16:30:55.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.366+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e4106a40 con 0x7f20e40fbca0 2024-02-28T16:30:55.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.367+0000 7f20e1600700 1 -- 172.21.15.148:0/524302470 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f20d800bd60 con 0x7f20e40fbca0 2024-02-28T16:30:55.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.368+0000 7f20e1600700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f20cc06d0e0 0x7f20cc06f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:55.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.368+0000 7f20e1600700 1 -- 172.21.15.148:0/524302470 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f20d808da20 con 0x7f20e40fbca0 2024-02-28T16:30:55.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.369+0000 7f20e8c00700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f20cc06d0e0 0x7f20cc06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:55.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.369+0000 7f20e8c00700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f20cc06d0e0 0x7f20cc06f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20e4111490 tx=0x7f20d000b040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:55.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.373+0000 7f20e1600700 1 -- 172.21.15.148:0/524302470 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f20d8057b20 con 0x7f20e40fbca0 2024-02-28T16:30:55.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:55 smithi148 ceph-mon[28767]: pgmap v95: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:55.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.679+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20e41111d0 con 0x7f20e40fbca0 2024-02-28T16:30:55.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.680+0000 7f20e1600700 1 -- 172.21.15.148:0/524302470 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f20d805b1e0 con 0x7f20e40fbca0 2024-02-28T16:30:55.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f20cc06d0e0 msgr2=0x7f20cc06f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:55.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f20cc06d0e0 0x7f20cc06f590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f20e4111490 tx=0x7f20d000b040 comp rx=0 tx=0).stop 2024-02-28T16:30:55.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 msgr2=0x7f20e4115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:55.672 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e4115bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f20d8004890 tx=0x7f20d8009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 shutdown_connections 2024-02-28T16:30:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f20cc06d0e0 0x7f20cc06f590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f20e40fbca0 0x7f20e4115bf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 --2- 172.21.15.148:0/524302470 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f20e40fc5b0 0x7f20e4116130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.683+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 >> 172.21.15.148:0/524302470 conn(0x7f20e40f79d0 msgr2=0x7f20e40f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.684+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 shutdown_connections 2024-02-28T16:30:55.673 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:55.684+0000 7f20ec000700 1 -- 172.21.15.148:0/524302470 wait complete. 2024-02-28T16:30:55.688 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:30:55.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:55 smithi157 ceph-mon[38346]: pgmap v95: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:56.445 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-28T16:30:56.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:56 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/524302470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:56.929 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:30:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:56 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/524302470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:30:57.673 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:57 smithi148 ceph-mon[28767]: pgmap v96: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:57 smithi157 ceph-mon[38346]: pgmap v96: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 -- 172.21.15.148:0/2790747450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 msgr2=0x7f5614070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 --2- 172.21.15.148:0/2790747450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f5614070ce0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f55fc004970 tx=0x7f55fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 -- 172.21.15.148:0/2790747450 shutdown_connections 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 --2- 172.21.15.148:0/2790747450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f5614070ce0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 --2- 172.21.15.148:0/2790747450 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5614071f60 0x7f5614070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 -- 172.21.15.148:0/2790747450 >> 172.21.15.148:0/2790747450 conn(0x7f56140f8ae0 msgr2=0x7f56140faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 -- 172.21.15.148:0/2790747450 shutdown_connections 2024-02-28T16:30:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.322+0000 7f561a800700 1 -- 172.21.15.148:0/2790747450 wait complete. 2024-02-28T16:30:59.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.323+0000 7f561a800700 1 Processor -- start 2024-02-28T16:30:59.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.323+0000 7f561a800700 1 -- start start 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.324+0000 7f561a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f561411a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.324+0000 7f561a800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5614071f60 0x7f561411a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.324+0000 7f561a800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561411ad50 con 0x7f5614070870 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.324+0000 7f561a800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614113fd0 con 0x7f5614071f60 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.324+0000 7f5613400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f561411a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.324+0000 7f5613400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f561411a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:36912/0 (socket says 172.21.15.148:36912) 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.324+0000 7f5613400700 1 -- 172.21.15.148:0/3459610634 learned_addr learned my addr 172.21.15.148:0/3459610634 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f560be00700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5614071f60 0x7f561411a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f5613400700 1 -- 172.21.15.148:0/3459610634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5614071f60 msgr2=0x7f561411a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f5613400700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5614071f60 0x7f561411a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:59.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f5613400700 1 -- 172.21.15.148:0/3459610634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc005040 con 0x7f5614070870 2024-02-28T16:30:59.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f5613400700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f561411a130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f560400b790 tx=0x7f5604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:59.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f560b400700 1 -- 172.21.15.148:0/3459610634 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560400f770 con 0x7f5614070870 2024-02-28T16:30:59.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5614114250 con 0x7f5614070870 2024-02-28T16:30:59.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f560b400700 1 -- 172.21.15.148:0/3459610634 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f560400fda0 con 0x7f5614070870 2024-02-28T16:30:59.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.325+0000 7f560b400700 1 -- 172.21.15.148:0/3459610634 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560400d310 con 0x7f5614070870 2024-02-28T16:30:59.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.326+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5614114760 con 0x7f5614070870 2024-02-28T16:30:59.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.327+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56140fe400 con 0x7f5614070870 2024-02-28T16:30:59.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.328+0000 7f560b400700 1 -- 172.21.15.148:0/3459610634 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f5604010420 con 0x7f5614070870 2024-02-28T16:30:59.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.329+0000 7f560b400700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f55f806d0f0 0x7f55f806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:30:59.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.329+0000 7f560b400700 1 -- 172.21.15.148:0/3459610634 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f560408c5b0 con 0x7f5614070870 2024-02-28T16:30:59.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.329+0000 7f560be00700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f55f806d0f0 0x7f55f806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:30:59.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.330+0000 7f560be00700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f55f806d0f0 0x7f55f806f5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009fd0 tx=0x7f55fc009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:30:59.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.333+0000 7f560b400700 1 -- 172.21.15.148:0/3459610634 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f560405a200 con 0x7f5614070870 2024-02-28T16:30:59.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:30:59 smithi148 ceph-mon[28767]: pgmap v97: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:30:59.626 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.637+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f561404bed0 con 0x7f5614070870 2024-02-28T16:30:59.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.638+0000 7f560b400700 1 -- 172.21.15.148:0/3459610634 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f5604059d90 con 0x7f5614070870 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f55f806d0f0 msgr2=0x7f55f806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f55f806d0f0 0x7f55f806f5a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009fd0 tx=0x7f55fc009e30 comp rx=0 tx=0).stop 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 msgr2=0x7f561411a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f561411a130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f560400b790 tx=0x7f5604009250 comp rx=0 tx=0).stop 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 shutdown_connections 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f55f806d0f0 0x7f55f806f5a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5614070870 0x7f561411a130 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 --2- 172.21.15.148:0/3459610634 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5614071f60 0x7f561411a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 >> 172.21.15.148:0/3459610634 conn(0x7f56140f8ae0 msgr2=0x7f56140fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 shutdown_connections 2024-02-28T16:30:59.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:30:59.641+0000 7f561a800700 1 -- 172.21.15.148:0/3459610634 wait complete. 2024-02-28T16:30:59.645 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)" 2024-02-28T16:30:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:30:59 smithi157 ceph-mon[38346]: pgmap v97: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:00.484 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-28T16:31:00.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:00 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/3459610634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:00.958 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:00 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3459610634' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:01.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:01 smithi148 ceph-mon[28767]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:01.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:01 smithi157 ceph-mon[38346]: pgmap v98: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:03.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 -- 172.21.15.148:0/2978969897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105170 msgr2=0x7f16b0105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 --2- 172.21.15.148:0/2978969897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105170 0x7f16b0105540 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f16a0004940 tx=0x7f16a0009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:03.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 -- 172.21.15.148:0/2978969897 shutdown_connections 2024-02-28T16:31:03.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 --2- 172.21.15.148:0/2978969897 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16b0105b10 0x7f16b00ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 --2- 172.21.15.148:0/2978969897 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105170 0x7f16b0105540 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 -- 172.21.15.148:0/2978969897 >> 172.21.15.148:0/2978969897 conn(0x7f16b00face0 msgr2=0x7f16b00fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:03.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 -- 172.21.15.148:0/2978969897 shutdown_connections 2024-02-28T16:31:03.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.340+0000 7f16b4e00700 1 -- 172.21.15.148:0/2978969897 wait complete. 2024-02-28T16:31:03.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.341+0000 7f16b4e00700 1 Processor -- start 2024-02-28T16:31:03.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.341+0000 7f16b4e00700 1 -- start start 2024-02-28T16:31:03.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16b4e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16b0105170 0x7f16b0115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16b4e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105b10 0x7f16b01161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16b4e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b01167f0 con 0x7f16b0105b10 2024-02-28T16:31:03.331 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16b4e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b010fb40 con 0x7f16b0105170 2024-02-28T16:31:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16ad400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105b10 0x7f16b01161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16ad400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105b10 0x7f16b01161a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41154/0 (socket says 172.21.15.148:41154) 2024-02-28T16:31:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16ad400700 1 -- 172.21.15.148:0/1069253841 learned_addr learned my addr 172.21.15.148:0/1069253841 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16ade00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16b0105170 0x7f16b0115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16ad400700 1 -- 172.21.15.148:0/1069253841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16b0105170 msgr2=0x7f16b0115c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16ad400700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16b0105170 0x7f16b0115c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.342+0000 7f16ad400700 1 -- 172.21.15.148:0/1069253841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a0005040 con 0x7f16b0105b10 2024-02-28T16:31:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.343+0000 7f16ad400700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105b10 0x7f16b01161a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f169c002a50 tx=0x7f169c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.343+0000 7f16a6000700 1 -- 172.21.15.148:0/1069253841 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169c007cc0 con 0x7f16b0105b10 2024-02-28T16:31:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.343+0000 7f16a6000700 1 -- 172.21.15.148:0/1069253841 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f169c00f040 con 0x7f16b0105b10 2024-02-28T16:31:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.343+0000 7f16a6000700 1 -- 172.21.15.148:0/1069253841 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f169c00daf0 con 0x7f16b0105b10 2024-02-28T16:31:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.343+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b010fe20 con 0x7f16b0105b10 2024-02-28T16:31:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.343+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b0110360 con 0x7f16b0105b10 2024-02-28T16:31:03.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.344+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b0102480 con 0x7f16b0105b10 2024-02-28T16:31:03.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.345+0000 7f16a6000700 1 -- 172.21.15.148:0/1069253841 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f169c009810 con 0x7f16b0105b10 2024-02-28T16:31:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.346+0000 7f16a6000700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f169406d0f0 0x7f169406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.346+0000 7f16a6000700 1 -- 172.21.15.148:0/1069253841 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f169c08c390 con 0x7f16b0105b10 2024-02-28T16:31:03.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.347+0000 7f16ade00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f169406d0f0 0x7f169406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:03.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.347+0000 7f16ade00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f169406d0f0 0x7f169406f5a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16a000b3b0 tx=0x7f16a0009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:03.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.352+0000 7f16a6000700 1 -- 172.21.15.148:0/1069253841 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f169c056390 con 0x7f16b0105b10 2024-02-28T16:31:03.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:03 smithi148 ceph-mon[28767]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:03.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.660+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f16b0111280 con 0x7f16b0105b10 2024-02-28T16:31:03.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.661+0000 7f16a6000700 1 -- 172.21.15.148:0/1069253841 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f169c059a50 con 0x7f16b0105b10 2024-02-28T16:31:03.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f169406d0f0 msgr2=0x7f169406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f169406d0f0 0x7f169406f5a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f16a000b3b0 tx=0x7f16a0009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:03.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105b10 msgr2=0x7f16b01161a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:03.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105b10 0x7f16b01161a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f169c002a50 tx=0x7f169c004600 comp rx=0 tx=0).stop 2024-02-28T16:31:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 shutdown_connections 2024-02-28T16:31:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f169406d0f0 0x7f169406f5a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f16b0105170 0x7f16b0115c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 --2- 172.21.15.148:0/1069253841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f16b0105b10 0x7f16b01161a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 >> 172.21.15.148:0/1069253841 conn(0x7f16b00face0 msgr2=0x7f16b00fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 shutdown_connections 2024-02-28T16:31:03.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:03.664+0000 7f16b4e00700 1 -- 172.21.15.148:0/1069253841 wait complete. 2024-02-28T16:31:03.668 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:31:03.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:03 smithi157 ceph-mon[38346]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:04.432 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-28T16:31:04.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:04 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/1069253841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:04.922 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:04 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/1069253841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:05.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:05 smithi148 ceph-mon[28767]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:05.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:05 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:05.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:05 smithi157 ceph-mon[38346]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:05.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:05 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:07.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.221+0000 7f6bc8400700 1 -- 172.21.15.148:0/479415496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0071f60 msgr2=0x7f6bc0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:07.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.221+0000 7f6bc8400700 1 --2- 172.21.15.148:0/479415496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0071f60 0x7f6bc0070330 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004970 tx=0x7f6bb4009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:07.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.221+0000 7f6bc8400700 1 -- 172.21.15.148:0/479415496 shutdown_connections 2024-02-28T16:31:07.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.221+0000 7f6bc8400700 1 --2- 172.21.15.148:0/479415496 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc0070870 0x7f6bc0070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:07.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.221+0000 7f6bc8400700 1 --2- 172.21.15.148:0/479415496 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0071f60 0x7f6bc0070330 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:07.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.222+0000 7f6bc8400700 1 -- 172.21.15.148:0/479415496 >> 172.21.15.148:0/479415496 conn(0x7f6bc00f8ae0 msgr2=0x7f6bc00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:07.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.222+0000 7f6bc8400700 1 -- 172.21.15.148:0/479415496 shutdown_connections 2024-02-28T16:31:07.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.222+0000 7f6bc8400700 1 -- 172.21.15.148:0/479415496 wait complete. 2024-02-28T16:31:07.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.222+0000 7f6bc8400700 1 Processor -- start 2024-02-28T16:31:07.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc8400700 1 -- start start 2024-02-28T16:31:07.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc8400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0070870 0x7f6bc011a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:07.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc8400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc0071f60 0x7f6bc011a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:07.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc8400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc011ac00 con 0x7f6bc0070870 2024-02-28T16:31:07.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc8400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0113f10 con 0x7f6bc0071f60 2024-02-28T16:31:07.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc5a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0070870 0x7f6bc011a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:07.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc5a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0070870 0x7f6bc011a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41180/0 (socket says 172.21.15.148:41180) 2024-02-28T16:31:07.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.223+0000 7f6bc5a00700 1 -- 172.21.15.148:0/1212826483 learned_addr learned my addr 172.21.15.148:0/1212826483 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:07.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bc5000700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc0071f60 0x7f6bc011a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:07.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bc5a00700 1 -- 172.21.15.148:0/1212826483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc0071f60 msgr2=0x7f6bc011a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:07.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bc5a00700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc0071f60 0x7f6bc011a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:07.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bc5a00700 1 -- 172.21.15.148:0/1212826483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4005040 con 0x7f6bc0070870 2024-02-28T16:31:07.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bc5000700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc0071f60 0x7f6bc011a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:31:07.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bc5a00700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0070870 0x7f6bc011a070 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004f50 tx=0x7f6bb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:07.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bbd600700 1 -- 172.21.15.148:0/1212826483 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb400e040 con 0x7f6bc0070870 2024-02-28T16:31:07.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bbd600700 1 -- 172.21.15.148:0/1212826483 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bb400bc10 con 0x7f6bc0070870 2024-02-28T16:31:07.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc0114190 con 0x7f6bc0070870 2024-02-28T16:31:07.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.224+0000 7f6bbd600700 1 -- 172.21.15.148:0/1212826483 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb401c630 con 0x7f6bc0070870 2024-02-28T16:31:07.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.225+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc01146d0 con 0x7f6bc0070870 2024-02-28T16:31:07.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.226+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc00fe400 con 0x7f6bc0070870 2024-02-28T16:31:07.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.227+0000 7f6bbd600700 1 -- 172.21.15.148:0/1212826483 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f6bb400bd80 con 0x7f6bc0070870 2024-02-28T16:31:07.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.227+0000 7f6bbd600700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6ba806d0f0 0x7f6ba806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:07.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.228+0000 7f6bbd600700 1 -- 172.21.15.148:0/1212826483 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f6bb408da50 con 0x7f6bc0070870 2024-02-28T16:31:07.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.228+0000 7f6bc5000700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6ba806d0f0 0x7f6ba806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:07.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.229+0000 7f6bc5000700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6ba806d0f0 0x7f6ba806f5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:07.222 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.233+0000 7f6bbd600700 1 -- 172.21.15.148:0/1212826483 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f6bb405b600 con 0x7f6bc0070870 2024-02-28T16:31:07.457 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:07.468+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bc004bf40 con 0x7f6ba806d0f0 2024-02-28T16:31:07.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:07 smithi148 ceph-mon[28767]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:07.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:07 smithi157 ceph-mon[38346]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:08.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:08 smithi148 ceph-mon[28767]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:08.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:08 smithi157 ceph-mon[38346]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:09.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:09 smithi148 ceph-mon[28767]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:09.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:09 smithi157 ceph-mon[38346]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:10.484 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.495+0000 7f6bbd600700 1 -- 172.21.15.148:0/1212826483 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5092 (secure 0 0 0) 0x7f6bc004bf40 con 0x7f6ba806d0f0 2024-02-28T16:31:10.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6ba806d0f0 msgr2=0x7f6ba806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:10.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6ba806d0f0 0x7f6ba806f5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac009040 comp rx=0 tx=0).stop 2024-02-28T16:31:10.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0070870 msgr2=0x7f6bc011a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:10.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0070870 0x7f6bc011a070 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004f50 tx=0x7f6bb4009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:10.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 shutdown_connections 2024-02-28T16:31:10.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f6ba806d0f0 0x7f6ba806f5a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:10.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bc0070870 0x7f6bc011a070 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:10.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 --2- 172.21.15.148:0/1212826483 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6bc0071f60 0x7f6bc011a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:10.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 >> 172.21.15.148:0/1212826483 conn(0x7f6bc00f8ae0 msgr2=0x7f6bc00fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:10.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 shutdown_connections 2024-02-28T16:31:10.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:10.499+0000 7f6bc8400700 1 -- 172.21.15.148:0/1212826483 wait complete. 2024-02-28T16:31:10.508 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:31:11.245 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:11 smithi148 ceph-mon[28767]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:11.304 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T16:31:11.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:11 smithi157 ceph-mon[38346]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:11.791 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:13.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:13 smithi148 ceph-mon[28767]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:13 smithi157 ceph-mon[38346]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:14.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 -- 172.21.15.148:0/749206531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780702d0 msgr2=0x7f07780706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:14.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 --2- 172.21.15.148:0/749206531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780702d0 0x7f07780706a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0768004970 tx=0x7f0768009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:14.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 -- 172.21.15.148:0/749206531 shutdown_connections 2024-02-28T16:31:14.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 --2- 172.21.15.148:0/749206531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0778070be0 0x7f07781092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:14.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 --2- 172.21.15.148:0/749206531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f07780702d0 0x7f07780706a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:14.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 -- 172.21.15.148:0/749206531 >> 172.21.15.148:0/749206531 conn(0x7f07780f8ae0 msgr2=0x7f07780faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:14.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 -- 172.21.15.148:0/749206531 shutdown_connections 2024-02-28T16:31:14.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.333+0000 7f077ee00700 1 -- 172.21.15.148:0/749206531 wait complete. 2024-02-28T16:31:14.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.334+0000 7f077ee00700 1 Processor -- start 2024-02-28T16:31:14.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.334+0000 7f077ee00700 1 -- start start 2024-02-28T16:31:14.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.334+0000 7f077ee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07780702d0 0x7f0778115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:14.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.334+0000 7f077ee00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0778070be0 0x7f0778116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:14.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.334+0000 7f077ee00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07781167b0 con 0x7f0778070be0 2024-02-28T16:31:14.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.334+0000 7f077ee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077810fae0 con 0x7f07780702d0 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0778070be0 0x7f0778116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0778070be0 0x7f0778116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34728/0 (socket says 172.21.15.148:34728) 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777400700 1 -- 172.21.15.148:0/4252151173 learned_addr learned my addr 172.21.15.148:0/4252151173 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777e00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07780702d0 0x7f0778115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777400700 1 -- 172.21.15.148:0/4252151173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07780702d0 msgr2=0x7f0778115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777400700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07780702d0 0x7f0778115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777400700 1 -- 172.21.15.148:0/4252151173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0768005040 con 0x7f0778070be0 2024-02-28T16:31:14.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.335+0000 7f0777400700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0778070be0 0x7f0778116160 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f076400c8c0 tx=0x7f07640044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.336+0000 7f076fe00700 1 -- 172.21.15.148:0/4252151173 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f076400a980 con 0x7f0778070be0 2024-02-28T16:31:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.336+0000 7f076fe00700 1 -- 172.21.15.148:0/4252151173 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f076400ce60 con 0x7f0778070be0 2024-02-28T16:31:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.336+0000 7f076fe00700 1 -- 172.21.15.148:0/4252151173 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07640115e0 con 0x7f0778070be0 2024-02-28T16:31:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.336+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f077810fdc0 con 0x7f0778070be0 2024-02-28T16:31:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.336+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0778110300 con 0x7f0778070be0 2024-02-28T16:31:14.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.337+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778106980 con 0x7f0778070be0 2024-02-28T16:31:14.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.339+0000 7f076fe00700 1 -- 172.21.15.148:0/4252151173 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f0764012400 con 0x7f0778070be0 2024-02-28T16:31:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.340+0000 7f076fe00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f075c06d0f0 0x7f075c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.340+0000 7f076fe00700 1 -- 172.21.15.148:0/4252151173 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f076408c610 con 0x7f0778070be0 2024-02-28T16:31:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.340+0000 7f0777e00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f075c06d0f0 0x7f075c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:14.329 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.341+0000 7f0777e00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f075c06d0f0 0x7f075c06f5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0768000c00 tx=0x7f0768009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:14.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.345+0000 7f076fe00700 1 -- 172.21.15.148:0/4252151173 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f076405a240 con 0x7f0778070be0 2024-02-28T16:31:14.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.577+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f07781158f0 con 0x7f075c06d0f0 2024-02-28T16:31:14.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.592+0000 7f076fe00700 1 -- 172.21.15.148:0/4252151173 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f07781158f0 con 0x7f075c06d0f0 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (68s) 34s ago 16m 13.6M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (17m) 34s ago 17m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (15m) 119s ago 15m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (43s) 34s ago 16m 47.4M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (8m) 34s ago 8m 13.4M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (8m) 34s ago 8m 146M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (8m) 119s ago 8m 13.1M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (8m) 119s ago 8m 13.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (3m) 34s ago 18m 498M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:31:14.581 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (2m) 119s ago 14m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (18m) 34s ago 18m 54.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (14m) 119s ago 14m 42.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (2m) 34s ago 16m 7558k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (2m) 119s ago 14m 2600k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (13m) 34s ago 13m 206M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (13m) 34s ago 13m 210M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (12m) 34s ago 12m 180M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (11m) 119s ago 11m 232M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (11m) 119s ago 11m 204M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (10m) 119s ago 10m 185M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:31:14.582 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (94s) 34s ago 15m 44.2M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.594+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f075c06d0f0 msgr2=0x7f075c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.594+0000 7f077ee00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f075c06d0f0 0x7f075c06f5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0768000c00 tx=0x7f0768009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.594+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0778070be0 msgr2=0x7f0778116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.594+0000 7f077ee00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0778070be0 0x7f0778116160 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f076400c8c0 tx=0x7f07640044c0 comp rx=0 tx=0).stop 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.595+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 shutdown_connections 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.595+0000 7f077ee00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f075c06d0f0 0x7f075c06f5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.595+0000 7f077ee00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f07780702d0 0x7f0778115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.595+0000 7f077ee00700 1 --2- 172.21.15.148:0/4252151173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0778070be0 0x7f0778116160 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.595+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 >> 172.21.15.148:0/4252151173 conn(0x7f07780f8ae0 msgr2=0x7f0778103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.595+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 shutdown_connections 2024-02-28T16:31:14.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:14.595+0000 7f077ee00700 1 -- 172.21.15.148:0/4252151173 wait complete. 2024-02-28T16:31:15.607 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T16:31:15.608 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:31:15.608 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-28T16:31:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:15 smithi148 ceph-mon[28767]: pgmap v105: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:15.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:15 smithi148 ceph-mon[28767]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:15 smithi157 ceph-mon[38346]: pgmap v105: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:15 smithi157 ceph-mon[38346]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:16.096 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:17.809 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:17 smithi148 ceph-mon[28767]: pgmap v106: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:17 smithi157 ceph-mon[38346]: pgmap v106: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:18.310 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 -- 172.21.15.148:0/2485543351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 msgr2=0x7fc08c0fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:18.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 --2- 172.21.15.148:0/2485543351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c0fbf50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc07c004940 tx=0x7fc07c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:18.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 -- 172.21.15.148:0/2485543351 shutdown_connections 2024-02-28T16:31:18.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 --2- 172.21.15.148:0/2485543351 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08c0fc490 0x7fc08c1091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:18.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 --2- 172.21.15.148:0/2485543351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c0fbf50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:18.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 -- 172.21.15.148:0/2485543351 >> 172.21.15.148:0/2485543351 conn(0x7fc08c073ab0 msgr2=0x7fc08c073eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:18.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 -- 172.21.15.148:0/2485543351 shutdown_connections 2024-02-28T16:31:18.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.321+0000 7fc090e00700 1 -- 172.21.15.148:0/2485543351 wait complete. 2024-02-28T16:31:18.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.322+0000 7fc090e00700 1 Processor -- start 2024-02-28T16:31:18.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.322+0000 7fc090e00700 1 -- start start 2024-02-28T16:31:18.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.323+0000 7fc090e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:18.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.323+0000 7fc090e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08c0fc490 0x7fc08c115f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:18.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.323+0000 7fc090e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c116640 con 0x7fc08c0fbb80 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.323+0000 7fc090e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c10f8e0 con 0x7fc08c0fc490 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.323+0000 7fc08b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.323+0000 7fc08b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c115a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34742/0 (socket says 172.21.15.148:34742) 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.323+0000 7fc08b400700 1 -- 172.21.15.148:0/61086530 learned_addr learned my addr 172.21.15.148:0/61086530 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc08aa00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08c0fc490 0x7fc08c115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc08b400700 1 -- 172.21.15.148:0/61086530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08c0fc490 msgr2=0x7fc08c115f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc08b400700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08c0fc490 0x7fc08c115f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:18.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc08b400700 1 -- 172.21.15.148:0/61086530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c005040 con 0x7fc08c0fbb80 2024-02-28T16:31:18.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc08b400700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c115a20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009150 tx=0x7fc07c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:18.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc083400700 1 -- 172.21.15.148:0/61086530 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc07c00e040 con 0x7fc08c0fbb80 2024-02-28T16:31:18.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc083400700 1 -- 172.21.15.148:0/61086530 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc07c00bbf0 con 0x7fc08c0fbb80 2024-02-28T16:31:18.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc083400700 1 -- 172.21.15.148:0/61086530 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc07c01c630 con 0x7fc08c0fbb80 2024-02-28T16:31:18.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.324+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c10fb60 con 0x7fc08c0fbb80 2024-02-28T16:31:18.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.325+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c1100d0 con 0x7fc08c0fbb80 2024-02-28T16:31:18.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.326+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c106920 con 0x7fc08c0fbb80 2024-02-28T16:31:18.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.327+0000 7fc083400700 1 -- 172.21.15.148:0/61086530 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7fc07c00bd60 con 0x7fc08c0fbb80 2024-02-28T16:31:18.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.328+0000 7fc083400700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc07006d0f0 0x7fc07006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:18.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.328+0000 7fc083400700 1 -- 172.21.15.148:0/61086530 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc07c08d980 con 0x7fc08c0fbb80 2024-02-28T16:31:18.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.329+0000 7fc08aa00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc07006d0f0 0x7fc07006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:18.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.330+0000 7fc08aa00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc07006d0f0 0x7fc07006f5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc078006fd0 tx=0x7fc078008040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:18.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.334+0000 7fc083400700 1 -- 172.21.15.148:0/61086530 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc07c05b5d0 con 0x7fc08c0fbb80 2024-02-28T16:31:18.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.557+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7fc08c05f5c0 con 0x7fc08c0fbb80 2024-02-28T16:31:18.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.567+0000 7fc083400700 1 -- 172.21.15.148:0/61086530 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc07c05b160 con 0x7fc08c0fbb80 2024-02-28T16:31:18.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc07006d0f0 msgr2=0x7fc07006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc07006d0f0 0x7fc07006f5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc078006fd0 tx=0x7fc078008040 comp rx=0 tx=0).stop 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 msgr2=0x7fc08c115a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c115a20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc07c009150 tx=0x7fc07c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 shutdown_connections 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc07006d0f0 0x7fc07006f5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc08c0fbb80 0x7fc08c115a20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.570+0000 7fc090e00700 1 --2- 172.21.15.148:0/61086530 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc08c0fc490 0x7fc08c115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.571+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 >> 172.21.15.148:0/61086530 conn(0x7fc08c073ab0 msgr2=0x7fc08c0fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.571+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 shutdown_connections 2024-02-28T16:31:18.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:18.571+0000 7fc090e00700 1 -- 172.21.15.148:0/61086530 wait complete. 2024-02-28T16:31:19.411 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T16:31:19.412 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:31:19.412 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-28T16:31:19.614 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:19 smithi148 ceph-mon[28767]: pgmap v107: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:19.614 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:19 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/61086530' entity='client.admin' 2024-02-28T16:31:19.614 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:19 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:19.614 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:19 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:19.614 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:19 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:19.614 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:19 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:19.884 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:19 smithi157 ceph-mon[38346]: pgmap v107: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:19 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/61086530' entity='client.admin' 2024-02-28T16:31:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:19 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:19 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:19.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:19 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:19.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:19 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:21.367 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:21 smithi148 ceph-mon[28767]: pgmap v108: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:21.367 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:21 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:21.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:21 smithi157 ceph-mon[38346]: pgmap v108: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:21.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:21 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 -- 172.21.15.148:0/2254447666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 msgr2=0x7fc7f4103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 --2- 172.21.15.148:0/2254447666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4103320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8004940 tx=0x7fc7e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 -- 172.21.15.148:0/2254447666 shutdown_connections 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 --2- 172.21.15.148:0/2254447666 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f41038f0 0x7fc7f40fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 --2- 172.21.15.148:0/2254447666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4103320 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 -- 172.21.15.148:0/2254447666 >> 172.21.15.148:0/2254447666 conn(0x7fc7f40f8ae0 msgr2=0x7fc7f40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 -- 172.21.15.148:0/2254447666 shutdown_connections 2024-02-28T16:31:22.197 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.207+0000 7fc7fc800700 1 -- 172.21.15.148:0/2254447666 wait complete. 2024-02-28T16:31:22.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.208+0000 7fc7fc800700 1 Processor -- start 2024-02-28T16:31:22.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7fc800700 1 -- start start 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7fc800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7fc800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f41038f0 0x7fc7f41161b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7fc800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4116800 con 0x7fc7f4102f50 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7fc800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f410fb30 con 0x7fc7f41038f0 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7f9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7f9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4115c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55872/0 (socket says 172.21.15.148:55872) 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.209+0000 7fc7f9e00700 1 -- 172.21.15.148:0/1038775281 learned_addr learned my addr 172.21.15.148:0/1038775281 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7f9400700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f41038f0 0x7fc7f41161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7f9e00700 1 -- 172.21.15.148:0/1038775281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f41038f0 msgr2=0x7fc7f41161b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7f9e00700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f41038f0 0x7fc7f41161b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:22.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7f9e00700 1 -- 172.21.15.148:0/1038775281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8005040 con 0x7fc7f4102f50 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7f9400700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f41038f0 0x7fc7f41161b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7f9e00700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4115c70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009150 tx=0x7fc7e8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7ee000700 1 -- 172.21.15.148:0/1038775281 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e800e040 con 0x7fc7f4102f50 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7ee000700 1 -- 172.21.15.148:0/1038775281 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc7e800bbf0 con 0x7fc7f4102f50 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.210+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f410fdb0 con 0x7fc7f4102f50 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.211+0000 7fc7ee000700 1 -- 172.21.15.148:0/1038775281 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7e801c630 con 0x7fc7f4102f50 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.211+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f41102f0 con 0x7fc7f4102f50 2024-02-28T16:31:22.201 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.212+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f40fc6e0 con 0x7fc7f4102f50 2024-02-28T16:31:22.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.213+0000 7fc7ee000700 1 -- 172.21.15.148:0/1038775281 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7fc7e800bd60 con 0x7fc7f4102f50 2024-02-28T16:31:22.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.214+0000 7fc7ee000700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc7dc06d0f0 0x7fc7dc06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:22.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.214+0000 7fc7ee000700 1 -- 172.21.15.148:0/1038775281 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc7e808d8a0 con 0x7fc7f4102f50 2024-02-28T16:31:22.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.214+0000 7fc7f9400700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc7dc06d0f0 0x7fc7dc06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:22.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.215+0000 7fc7f9400700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc7dc06d0f0 0x7fc7dc06f5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009fd0 tx=0x7fc7e400b040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:22.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.218+0000 7fc7ee000700 1 -- 172.21.15.148:0/1038775281 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fc7e805b590 con 0x7fc7f4102f50 2024-02-28T16:31:22.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.438+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fc7f410a0d0 con 0x7fc7f4102f50 2024-02-28T16:31:22.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.439+0000 7fc7ee000700 1 -- 172.21.15.148:0/1038775281 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7fc7f410a0d0 con 0x7fc7f4102f50 2024-02-28T16:31:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc7dc06d0f0 msgr2=0x7fc7dc06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc7dc06d0f0 0x7fc7dc06f5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009fd0 tx=0x7fc7e400b040 comp rx=0 tx=0).stop 2024-02-28T16:31:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 msgr2=0x7fc7f4115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4115c70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009150 tx=0x7fc7e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:22.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 shutdown_connections 2024-02-28T16:31:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fc7dc06d0f0 0x7fc7dc06f5a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc7f4102f50 0x7fc7f4115c70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 --2- 172.21.15.148:0/1038775281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc7f41038f0 0x7fc7f41161b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 >> 172.21.15.148:0/1038775281 conn(0x7fc7f40f8ae0 msgr2=0x7fc7f4070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 shutdown_connections 2024-02-28T16:31:22.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:22.442+0000 7fc7fc800700 1 -- 172.21.15.148:0/1038775281 wait complete. 2024-02-28T16:31:23.312 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-28T16:31:23.805 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:23.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:23 smithi148 ceph-mon[28767]: pgmap v109: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:23.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:23 smithi157 ceph-mon[38346]: pgmap v109: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:25.746 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:25 smithi148 ceph-mon[28767]: pgmap v110: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:25.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:25 smithi157 ceph-mon[38346]: pgmap v110: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 -- 172.21.15.148:0/1444099899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fbdd0 msgr2=0x7f702c0fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 --2- 172.21.15.148:0/1444099899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fbdd0 0x7f702c0fc1a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f701c004940 tx=0x7f701c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 -- 172.21.15.148:0/1444099899 shutdown_connections 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 --2- 172.21.15.148:0/1444099899 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f702c0fc6e0 0x7f702c100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 --2- 172.21.15.148:0/1444099899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fbdd0 0x7f702c0fc1a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 -- 172.21.15.148:0/1444099899 >> 172.21.15.148:0/1444099899 conn(0x7f702c071d90 msgr2=0x7f702c072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 -- 172.21.15.148:0/1444099899 shutdown_connections 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.357+0000 7f7031200700 1 -- 172.21.15.148:0/1444099899 wait complete. 2024-02-28T16:31:26.347 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.358+0000 7f7031200700 1 Processor -- start 2024-02-28T16:31:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.358+0000 7f7031200700 1 -- start start 2024-02-28T16:31:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7031200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f702c0fbdd0 0x7f702c11a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7031200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fc6e0 0x7f702c11a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7031200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c11ac30 con 0x7f702c0fc6e0 2024-02-28T16:31:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7031200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c113f40 con 0x7f702c0fbdd0 2024-02-28T16:31:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7029400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fc6e0 0x7f702c11a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:26.349 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7029400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fc6e0 0x7f702c11a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55884/0 (socket says 172.21.15.148:55884) 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7029400700 1 -- 172.21.15.148:0/4149105932 learned_addr learned my addr 172.21.15.148:0/4149105932 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.359+0000 7f7029e00700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f702c0fbdd0 0x7f702c11a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7029400700 1 -- 172.21.15.148:0/4149105932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f702c0fbdd0 msgr2=0x7f702c11a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7029400700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f702c0fbdd0 0x7f702c11a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7029400700 1 -- 172.21.15.148:0/4149105932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c005040 con 0x7f702c0fc6e0 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7029400700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fc6e0 0x7f702c11a5e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f701800c830 tx=0x7f7018004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7022000700 1 -- 172.21.15.148:0/4149105932 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70180106f0 con 0x7f702c0fc6e0 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7022000700 1 -- 172.21.15.148:0/4149105932 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7018010d20 con 0x7f702c0fc6e0 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c114220 con 0x7f702c0fc6e0 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7022000700 1 -- 172.21.15.148:0/4149105932 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70180113a0 con 0x7f702c0fc6e0 2024-02-28T16:31:26.350 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.360+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c114760 con 0x7f702c0fc6e0 2024-02-28T16:31:26.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.362+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c0fe540 con 0x7f702c0fc6e0 2024-02-28T16:31:26.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.363+0000 7f7022000700 1 -- 172.21.15.148:0/4149105932 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f7018012400 con 0x7f702c0fc6e0 2024-02-28T16:31:26.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.363+0000 7f7022000700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f701006d0f0 0x7f701006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:26.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.364+0000 7f7022000700 1 -- 172.21.15.148:0/4149105932 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f701808c4f0 con 0x7f702c0fc6e0 2024-02-28T16:31:26.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.364+0000 7f7029e00700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f701006d0f0 0x7f701006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:26.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.365+0000 7f7029e00700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f701006d0f0 0x7f701006f5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f701c0043d0 tx=0x7f701c009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:26.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.369+0000 7f7022000700 1 -- 172.21.15.148:0/4149105932 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f701805a120 con 0x7f702c0fc6e0 2024-02-28T16:31:26.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.588+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f702c0738b0 con 0x7f702c0fc6e0 2024-02-28T16:31:26.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.588+0000 7f7022000700 1 -- 172.21.15.148:0/4149105932 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f7018059cb0 con 0x7f702c0fc6e0 2024-02-28T16:31:26.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f701006d0f0 msgr2=0x7f701006f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:26.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f701006d0f0 0x7f701006f5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f701c0043d0 tx=0x7f701c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:26.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fc6e0 msgr2=0x7f702c11a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fc6e0 0x7f702c11a5e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f701800c830 tx=0x7f7018004470 comp rx=0 tx=0).stop 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 shutdown_connections 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f701006d0f0 0x7f701006f5a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f702c0fbdd0 0x7f702c11a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 --2- 172.21.15.148:0/4149105932 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f702c0fc6e0 0x7f702c11a5e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.591+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 >> 172.21.15.148:0/4149105932 conn(0x7f702c071d90 msgr2=0x7f702c10d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.592+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 shutdown_connections 2024-02-28T16:31:26.581 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:26.592+0000 7f7031200700 1 -- 172.21.15.148:0/4149105932 wait complete. 2024-02-28T16:31:27.500 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-28T16:31:27.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:27 smithi148 ceph-mon[28767]: pgmap v111: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:27.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:27 smithi157 ceph-mon[38346]: pgmap v111: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:27.992 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:29.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:29 smithi148 ceph-mon[28767]: pgmap v112: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:29 smithi157 ceph-mon[38346]: pgmap v112: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:30.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 -- 172.21.15.148:0/218604257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70071f60 msgr2=0x7f5e70070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 --2- 172.21.15.148:0/218604257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70071f60 0x7f5e70070330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5e60004970 tx=0x7f5e60009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 -- 172.21.15.148:0/218604257 shutdown_connections 2024-02-28T16:31:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 --2- 172.21.15.148:0/218604257 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e70070870 0x7f5e70070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 --2- 172.21.15.148:0/218604257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70071f60 0x7f5e70070330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 -- 172.21.15.148:0/218604257 >> 172.21.15.148:0/218604257 conn(0x7f5e700f8ae0 msgr2=0x7f5e700faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 -- 172.21.15.148:0/218604257 shutdown_connections 2024-02-28T16:31:30.294 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.304+0000 7f5e75800700 1 -- 172.21.15.148:0/218604257 wait complete. 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.305+0000 7f5e75800700 1 Processor -- start 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.305+0000 7f5e75800700 1 -- start start 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e75800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70070870 0x7f5e7011a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e75800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e70071f60 0x7f5e7011a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e75800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7011ad10 con 0x7f5e70070870 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e75800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70113f90 con 0x7f5e70071f60 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e6ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70070870 0x7f5e7011a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e6ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70070870 0x7f5e7011a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55894/0 (socket says 172.21.15.148:55894) 2024-02-28T16:31:30.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e6ea00700 1 -- 172.21.15.148:0/2669843910 learned_addr learned my addr 172.21.15.148:0/2669843910 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.306+0000 7f5e66000700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e70071f60 0x7f5e7011a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e6ea00700 1 -- 172.21.15.148:0/2669843910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e70071f60 msgr2=0x7f5e7011a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e6ea00700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e70071f60 0x7f5e7011a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e6ea00700 1 -- 172.21.15.148:0/2669843910 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60005040 con 0x7f5e70070870 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e6ea00700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70070870 0x7f5e7011a0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009150 tx=0x7f5e60009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e67400700 1 -- 172.21.15.148:0/2669843910 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6000e040 con 0x7f5e70070870 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e67400700 1 -- 172.21.15.148:0/2669843910 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e6000bc10 con 0x7f5e70070870 2024-02-28T16:31:30.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e701141b0 con 0x7f5e70070870 2024-02-28T16:31:30.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e67400700 1 -- 172.21.15.148:0/2669843910 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6001c630 con 0x7f5e70070870 2024-02-28T16:31:30.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.307+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e701146f0 con 0x7f5e70070870 2024-02-28T16:31:30.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.309+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e700fe400 con 0x7f5e70070870 2024-02-28T16:31:30.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.310+0000 7f5e67400700 1 -- 172.21.15.148:0/2669843910 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f5e6000bd80 con 0x7f5e70070870 2024-02-28T16:31:30.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.310+0000 7f5e67400700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f5e5406d0f0 0x7f5e5406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:30.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.311+0000 7f5e67400700 1 -- 172.21.15.148:0/2669843910 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5e6008d8b0 con 0x7f5e70070870 2024-02-28T16:31:30.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.311+0000 7f5e66000700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f5e5406d0f0 0x7f5e5406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:30.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.311+0000 7f5e66000700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f5e5406d0f0 0x7f5e5406f5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e58006fd0 tx=0x7f5e58008040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:30.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.316+0000 7f5e67400700 1 -- 172.21.15.148:0/2669843910 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f5e6005b5a0 con 0x7f5e70070870 2024-02-28T16:31:30.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.533+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f5e700fc6e0 con 0x7f5e70070870 2024-02-28T16:31:30.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.534+0000 7f5e67400700 1 -- 172.21.15.148:0/2669843910 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5e6005b130 con 0x7f5e70070870 2024-02-28T16:31:30.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f5e5406d0f0 msgr2=0x7f5e5406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f5e5406d0f0 0x7f5e5406f5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e58006fd0 tx=0x7f5e58008040 comp rx=0 tx=0).stop 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70070870 msgr2=0x7f5e7011a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70070870 0x7f5e7011a0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009150 tx=0x7f5e60009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 shutdown_connections 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f5e5406d0f0 0x7f5e5406f5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5e70070870 0x7f5e7011a0f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 --2- 172.21.15.148:0/2669843910 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5e70071f60 0x7f5e7011a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.537+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 >> 172.21.15.148:0/2669843910 conn(0x7f5e700f8ae0 msgr2=0x7f5e700fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.538+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 shutdown_connections 2024-02-28T16:31:30.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:30.538+0000 7f5e75800700 1 -- 172.21.15.148:0/2669843910 wait complete. 2024-02-28T16:31:31.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:31 smithi148 ceph-mon[28767]: pgmap v113: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:31.463 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-28T16:31:31.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:31 smithi157 ceph-mon[38346]: pgmap v113: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:31.944 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:33.803 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:33 smithi148 ceph-mon[28767]: pgmap v114: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:33.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:33 smithi157 ceph-mon[38346]: pgmap v114: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:34.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 -- 172.21.15.148:0/3938573121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105170 msgr2=0x7f8744105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 --2- 172.21.15.148:0/3938573121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105170 0x7f8744105540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8734004940 tx=0x7f8734009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:34.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 -- 172.21.15.148:0/3938573121 shutdown_connections 2024-02-28T16:31:34.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 --2- 172.21.15.148:0/3938573121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8744105b10 0x7f87440ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 --2- 172.21.15.148:0/3938573121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105170 0x7f8744105540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 -- 172.21.15.148:0/3938573121 >> 172.21.15.148:0/3938573121 conn(0x7f87440face0 msgr2=0x7f87440fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:34.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 -- 172.21.15.148:0/3938573121 shutdown_connections 2024-02-28T16:31:34.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.309+0000 7f874b200700 1 -- 172.21.15.148:0/3938573121 wait complete. 2024-02-28T16:31:34.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.310+0000 7f874b200700 1 Processor -- start 2024-02-28T16:31:34.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.310+0000 7f874b200700 1 -- start start 2024-02-28T16:31:34.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f874b200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8744105170 0x7f8744115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f874b200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105b10 0x7f87441161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f874b200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87441167f0 con 0x7f8744105b10 2024-02-28T16:31:34.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f874b200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874410fb40 con 0x7f8744105170 2024-02-28T16:31:34.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f8743400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105b10 0x7f87441161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f8743400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105b10 0x7f87441161a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33244/0 (socket says 172.21.15.148:33244) 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f8743400700 1 -- 172.21.15.148:0/4278254374 learned_addr learned my addr 172.21.15.148:0/4278254374 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.311+0000 7f8743e00700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8744105170 0x7f8744115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f8743400700 1 -- 172.21.15.148:0/4278254374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8744105170 msgr2=0x7f8744115c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f8743400700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8744105170 0x7f8744115c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f8743400700 1 -- 172.21.15.148:0/4278254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734005040 con 0x7f8744105b10 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f8743400700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105b10 0x7f87441161a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f873000c800 tx=0x7f8730004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f873be00700 1 -- 172.21.15.148:0/4278254374 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f873000a760 con 0x7f8744105b10 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f873be00700 1 -- 172.21.15.148:0/4278254374 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f873000ad90 con 0x7f8744105b10 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f873be00700 1 -- 172.21.15.148:0/4278254374 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87300113a0 con 0x7f8744105b10 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.312+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874410fe20 con 0x7f8744105b10 2024-02-28T16:31:34.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.313+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8744110360 con 0x7f8744105b10 2024-02-28T16:31:34.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.314+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8744102480 con 0x7f8744105b10 2024-02-28T16:31:34.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.315+0000 7f873be00700 1 -- 172.21.15.148:0/4278254374 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f8730012400 con 0x7f8744105b10 2024-02-28T16:31:34.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.316+0000 7f873be00700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f872806d0f0 0x7f872806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:34.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.316+0000 7f873be00700 1 -- 172.21.15.148:0/4278254374 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f873008c520 con 0x7f8744105b10 2024-02-28T16:31:34.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.316+0000 7f8743e00700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f872806d0f0 0x7f872806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:34.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.317+0000 7f8743e00700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f872806d0f0 0x7f872806f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f873400b020 tx=0x7f8734009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:34.309 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.320+0000 7f873be00700 1 -- 172.21.15.148:0/4278254374 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8730056620 con 0x7f8744105b10 2024-02-28T16:31:34.550 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.561+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}) v1 -- 0x7f8744111280 con 0x7f872806d0f0 2024-02-28T16:31:34.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.575+0000 7f873be00700 1 -- 172.21.15.148:0/4278254374 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f8744111280 con 0x7f872806d0f0 2024-02-28T16:31:34.565 INFO:teuthology.orchestra.run.smithi148.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:31:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.578+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f872806d0f0 msgr2=0x7f872806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.567 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.578+0000 7f874b200700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f872806d0f0 0x7f872806f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f873400b020 tx=0x7f8734009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.578+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105b10 msgr2=0x7f87441161a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.578+0000 7f874b200700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105b10 0x7f87441161a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f873000c800 tx=0x7f8730004470 comp rx=0 tx=0).stop 2024-02-28T16:31:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.579+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 shutdown_connections 2024-02-28T16:31:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.579+0000 7f874b200700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f872806d0f0 0x7f872806f5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.579+0000 7f874b200700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8744105170 0x7f8744115c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.579+0000 7f874b200700 1 --2- 172.21.15.148:0/4278254374 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8744105b10 0x7f87441161a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:34.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.579+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 >> 172.21.15.148:0/4278254374 conn(0x7f87440face0 msgr2=0x7f87440fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.579+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 shutdown_connections 2024-02-28T16:31:34.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:34.579+0000 7f874b200700 1 -- 172.21.15.148:0/4278254374 wait complete. 2024-02-28T16:31:35.482 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T16:31:35.483 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:31:35.483 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-28T16:31:35.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:35 smithi148 ceph-mon[28767]: pgmap v115: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:35 smithi148 ceph-mon[28767]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:35 smithi148 ceph-mon[28767]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:31:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:35.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:35 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:35.961 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:31:35.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:35 smithi157 ceph-mon[38346]: pgmap v115: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:35.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:35 smithi157 ceph-mon[38346]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:35.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:35 smithi157 ceph-mon[38346]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:31:35.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:35.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:35.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:35 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:36 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:36 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:36 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:36.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:36 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:36.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:36 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:31:36.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:36 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:37.850 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:37 smithi148 ceph-mon[28767]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:31:37.850 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:37 smithi148 ceph-mon[28767]: pgmap v116: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:37.889 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:37 smithi157 ceph-mon[38346]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T16:31:37.889 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:37 smithi157 ceph-mon[38346]: pgmap v116: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 -- 172.21.15.148:0/2555767729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 msgr2=0x7fb650109440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 --2- 172.21.15.148:0/2555767729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb650109440 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb63c004940 tx=0x7fb63c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 -- 172.21.15.148:0/2555767729 shutdown_connections 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 --2- 172.21.15.148:0/2555767729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb650109440 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 --2- 172.21.15.148:0/2555767729 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6500fbdd0 0x7fb6500fc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 -- 172.21.15.148:0/2555767729 >> 172.21.15.148:0/2555767729 conn(0x7fb650071d90 msgr2=0x7fb650072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 -- 172.21.15.148:0/2555767729 shutdown_connections 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.670+0000 7fb654c00700 1 -- 172.21.15.148:0/2555767729 wait complete. 2024-02-28T16:31:39.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.671+0000 7fb654c00700 1 Processor -- start 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.671+0000 7fb654c00700 1 -- start start 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.672+0000 7fb654c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6500fbdd0 0x7fb650115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.672+0000 7fb654c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb6501161b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.672+0000 7fb654c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb650116890 con 0x7fb6500fc6e0 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.672+0000 7fb654c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65010fb30 con 0x7fb6500fbdd0 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.672+0000 7fb64d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb6501161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.672+0000 7fb64d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb6501161b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33262/0 (socket says 172.21.15.148:33262) 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.672+0000 7fb64d400700 1 -- 172.21.15.148:0/1751278770 learned_addr learned my addr 172.21.15.148:0/1751278770 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.673+0000 7fb64de00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6500fbdd0 0x7fb650115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.673+0000 7fb64d400700 1 -- 172.21.15.148:0/1751278770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6500fbdd0 msgr2=0x7fb650115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.673+0000 7fb64d400700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6500fbdd0 0x7fb650115c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.673+0000 7fb64d400700 1 -- 172.21.15.148:0/1751278770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c005040 con 0x7fb6500fc6e0 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.673+0000 7fb64d400700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb6501161b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009360 tx=0x7fb63c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.673+0000 7fb646000700 1 -- 172.21.15.148:0/1751278770 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb63c00e040 con 0x7fb6500fc6e0 2024-02-28T16:31:39.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.674+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65010fdb0 con 0x7fb6500fc6e0 2024-02-28T16:31:39.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.674+0000 7fb646000700 1 -- 172.21.15.148:0/1751278770 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb63c00bb90 con 0x7fb6500fc6e0 2024-02-28T16:31:39.130 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:31:39.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.674+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6501102f0 con 0x7fb6500fc6e0 2024-02-28T16:31:39.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.674+0000 7fb646000700 1 -- 172.21.15.148:0/1751278770 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb63c0255e0 con 0x7fb6500fc6e0 2024-02-28T16:31:39.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.675+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb650106b70 con 0x7fb6500fc6e0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.676+0000 7fb646000700 1 -- 172.21.15.148:0/1751278770 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7fb63c00bd00 con 0x7fb6500fc6e0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.677+0000 7fb646000700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fb63406d0e0 0x7fb63406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.677+0000 7fb646000700 1 -- 172.21.15.148:0/1751278770 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb63c08d990 con 0x7fb6500fc6e0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.678+0000 7fb64de00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fb63406d0e0 0x7fb63406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.678+0000 7fb64de00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fb63406d0e0 0x7fb63406f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb640006fd0 tx=0x7fb640008040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.683+0000 7fb646000700 1 -- 172.21.15.148:0/1751278770 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7fb63c05b540 con 0x7fb6500fc6e0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.947+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb65004bf40 con 0x7fb63406d0e0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.949+0000 7fb646000700 1 -- 172.21.15.148:0/1751278770 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb65004bf40 con 0x7fb63406d0e0 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.951+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fb63406d0e0 msgr2=0x7fb63406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.951+0000 7fb654c00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fb63406d0e0 0x7fb63406f590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb640006fd0 tx=0x7fb640008040 comp rx=0 tx=0).stop 2024-02-28T16:31:39.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.951+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 msgr2=0x7fb6501161b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.951+0000 7fb654c00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb6501161b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009360 tx=0x7fb63c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.951+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 shutdown_connections 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.952+0000 7fb654c00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7fb63406d0e0 0x7fb63406f590 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.952+0000 7fb654c00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6500fbdd0 0x7fb650115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.952+0000 7fb654c00700 1 --2- 172.21.15.148:0/1751278770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6500fc6e0 0x7fb6501161b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.952+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 >> 172.21.15.148:0/1751278770 conn(0x7fb650071d90 msgr2=0x7fb6500fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.952+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 shutdown_connections 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:38.952+0000 7fb654c00700 1 -- 172.21.15.148:0/1751278770 wait complete. 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 -- 172.21.15.148:0/1455348379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 msgr2=0x7f49e4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 --2- 172.21.15.148:0/1455348379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e4104210 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f49d0004940 tx=0x7f49d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 -- 172.21.15.148:0/1455348379 shutdown_connections 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 --2- 172.21.15.148:0/1455348379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e4104210 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 --2- 172.21.15.148:0/1455348379 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49e41095f0 0x7f49e41099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 -- 172.21.15.148:0/1455348379 >> 172.21.15.148:0/1455348379 conn(0x7f49e4072d50 msgr2=0x7f49e4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 -- 172.21.15.148:0/1455348379 shutdown_connections 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.106+0000 7f49ea000700 1 -- 172.21.15.148:0/1455348379 wait complete. 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.107+0000 7f49ea000700 1 Processor -- start 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.107+0000 7f49ea000700 1 -- start start 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49ea000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e411a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49ea000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49e41095f0 0x7f49e411a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49ea000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e411abd0 con 0x7f49e4103dc0 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49ea000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e4113ee0 con 0x7f49e41095f0 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49e3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e411a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49e3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e411a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33286/0 (socket says 172.21.15.148:33286) 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49e3400700 1 -- 172.21.15.148:0/2141997142 learned_addr learned my addr 172.21.15.148:0/2141997142 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49e2a00700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49e41095f0 0x7f49e411a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49e3400700 1 -- 172.21.15.148:0/2141997142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49e41095f0 msgr2=0x7f49e411a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49e3400700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49e41095f0 0x7f49e411a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.108+0000 7f49e3400700 1 -- 172.21.15.148:0/2141997142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0005040 con 0x7f49e4103dc0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.109+0000 7f49e3400700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e411a040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f49d4002a50 tx=0x7f49d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.109+0000 7f49db400700 1 -- 172.21.15.148:0/2141997142 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d4007cc0 con 0x7f49e4103dc0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.109+0000 7f49db400700 1 -- 172.21.15.148:0/2141997142 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49d400f040 con 0x7f49e4103dc0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.109+0000 7f49db400700 1 -- 172.21.15.148:0/2141997142 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d4009640 con 0x7f49e4103dc0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.109+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e41141c0 con 0x7f49e4103dc0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.109+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e4114700 con 0x7f49e4103dc0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.110+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e410b9c0 con 0x7f49e4103dc0 2024-02-28T16:31:39.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.111+0000 7f49db400700 1 -- 172.21.15.148:0/2141997142 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f49d40097a0 con 0x7f49e4103dc0 2024-02-28T16:31:39.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.112+0000 7f49db400700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f49c806d0f0 0x7f49c806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.112+0000 7f49db400700 1 -- 172.21.15.148:0/2141997142 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f49d408c3c0 con 0x7f49e4103dc0 2024-02-28T16:31:39.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.112+0000 7f49e2a00700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f49c806d0f0 0x7f49c806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.113+0000 7f49e2a00700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f49c806d0f0 0x7f49c806f5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49e41158e0 tx=0x7f49d0009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.135 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.117+0000 7f49db400700 1 -- 172.21.15.148:0/2141997142 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f49d4059ef0 con 0x7f49e4103dc0 2024-02-28T16:31:39.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.362+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49e4115620 con 0x7f49c806d0f0 2024-02-28T16:31:39.353 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.365+0000 7f49db400700 1 -- 172.21.15.148:0/2141997142 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f49e4115620 con 0x7f49c806d0f0 2024-02-28T16:31:39.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f49c806d0f0 msgr2=0x7f49c806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f49c806d0f0 0x7f49c806f5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f49e41158e0 tx=0x7f49d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 msgr2=0x7f49e411a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e411a040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f49d4002a50 tx=0x7f49d40046b0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 shutdown_connections 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f49c806d0f0 0x7f49c806f5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49e4103dc0 0x7f49e411a040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 --2- 172.21.15.148:0/2141997142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f49e41095f0 0x7f49e411a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.367+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 >> 172.21.15.148:0/2141997142 conn(0x7f49e4072d50 msgr2=0x7f49e4074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:39.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.368+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 shutdown_connections 2024-02-28T16:31:39.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.368+0000 7f49ea000700 1 -- 172.21.15.148:0/2141997142 wait complete. 2024-02-28T16:31:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 -- 172.21.15.148:0/1685426341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f48103dc0 msgr2=0x7f8f48104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1685426341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f48103dc0 0x7f8f48104210 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8f34004940 tx=0x7f8f34009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 -- 172.21.15.148:0/1685426341 shutdown_connections 2024-02-28T16:31:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1685426341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f48103dc0 0x7f8f48104210 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.499 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1685426341 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f481095f0 0x7f8f481099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 -- 172.21.15.148:0/1685426341 >> 172.21.15.148:0/1685426341 conn(0x7f8f48072d50 msgr2=0x7f8f48075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:39.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 -- 172.21.15.148:0/1685426341 shutdown_connections 2024-02-28T16:31:39.500 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.510+0000 7f8f4d000700 1 -- 172.21.15.148:0/1685426341 wait complete. 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.511+0000 7f8f4d000700 1 Processor -- start 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.511+0000 7f8f4d000700 1 -- start start 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.511+0000 7f8f4d000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f48103dc0 0x7f8f4811a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.511+0000 7f8f4d000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f481095f0 0x7f8f4811a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.511+0000 7f8f4d000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4811abd0 con 0x7f8f481095f0 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.511+0000 7f8f4d000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48113ee0 con 0x7f8f48103dc0 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f481095f0 0x7f8f4811a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f48103dc0 0x7f8f4811a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f481095f0 0x7f8f4811a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33308/0 (socket says 172.21.15.148:33308) 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45400700 1 -- 172.21.15.148:0/1919139593 learned_addr learned my addr 172.21.15.148:0/1919139593 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45400700 1 -- 172.21.15.148:0/1919139593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f48103dc0 msgr2=0x7f8f4811a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45400700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f48103dc0 0x7f8f4811a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45400700 1 -- 172.21.15.148:0/1919139593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f34005040 con 0x7f8f481095f0 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.512+0000 7f8f45400700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f481095f0 0x7f8f4811a580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009150 tx=0x7f8f34009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.513+0000 7f8f3e000700 1 -- 172.21.15.148:0/1919139593 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f3400e040 con 0x7f8f481095f0 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.513+0000 7f8f3e000700 1 -- 172.21.15.148:0/1919139593 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f3400bbf0 con 0x7f8f481095f0 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.513+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f48114160 con 0x7f8f481095f0 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.513+0000 7f8f3e000700 1 -- 172.21.15.148:0/1919139593 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f3401c3f0 con 0x7f8f481095f0 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.513+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f481146a0 con 0x7f8f481095f0 2024-02-28T16:31:39.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.514+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4810b9c0 con 0x7f8f481095f0 2024-02-28T16:31:39.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.515+0000 7f8f3e000700 1 -- 172.21.15.148:0/1919139593 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f8f3400bd60 con 0x7f8f481095f0 2024-02-28T16:31:39.504 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.516+0000 7f8f3e000700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f8f2c06d0f0 0x7f8f2c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.516+0000 7f8f3e000700 1 -- 172.21.15.148:0/1919139593 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8f3408d7d0 con 0x7f8f481095f0 2024-02-28T16:31:39.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.516+0000 7f8f45e00700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f8f2c06d0f0 0x7f8f2c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.517+0000 7f8f45e00700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f8f2c06d0f0 0x7f8f2c06f5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f38007fd0 tx=0x7f8f38009040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.521+0000 7f8f3e000700 1 -- 172.21.15.148:0/1919139593 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f8f3405b400 con 0x7f8f481095f0 2024-02-28T16:31:39.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.741+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f4804bf40 con 0x7f8f2c06d0f0 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.756+0000 7f8f3e000700 1 -- 172.21.15.148:0/1919139593 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8f4804bf40 con 0x7f8f2c06d0f0 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (93s) 60s ago 17m 13.6M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (17m) 60s ago 17m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (15m) 2m ago 15m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (68s) 60s ago 16m 47.4M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (9m) 60s ago 9m 13.4M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:31:39.745 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (9m) 60s ago 9m 146M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (8m) 2m ago 8m 13.1M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (9m) 2m ago 9m 13.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (4m) 60s ago 18m 498M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (3m) 2m ago 15m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (19m) 60s ago 19m 54.5M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 76d7b5412223 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (15m) 2m ago 15m 42.9M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (2m) 60s ago 17m 7558k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (2m) 2m ago 15m 2600k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (14m) 60s ago 14m 206M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (13m) 60s ago 13m 210M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (12m) 60s ago 12m 180M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (12m) 2m ago 12m 232M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:31:39.746 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (11m) 2m ago 11m 204M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:31:39.747 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (11m) 2m ago 11m 185M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:31:39.747 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (119s) 60s ago 16m 44.2M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f8f2c06d0f0 msgr2=0x7f8f2c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f8f2c06d0f0 0x7f8f2c06f5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8f38007fd0 tx=0x7f8f38009040 comp rx=0 tx=0).stop 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f481095f0 msgr2=0x7f8f4811a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f481095f0 0x7f8f4811a580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009150 tx=0x7f8f34009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 shutdown_connections 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f8f2c06d0f0 0x7f8f2c06f5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8f48103dc0 0x7f8f4811a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 --2- 172.21.15.148:0/1919139593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8f481095f0 0x7f8f4811a580 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 >> 172.21.15.148:0/1919139593 conn(0x7f8f48072d50 msgr2=0x7f8f48074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 shutdown_connections 2024-02-28T16:31:39.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.759+0000 7f8f4d000700 1 -- 172.21.15.148:0/1919139593 wait complete. 2024-02-28T16:31:39.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:39 smithi148 ceph-mon[28767]: pgmap v117: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 -- 172.21.15.148:0/3862948364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601038f0 msgr2=0x7ffb600fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 --2- 172.21.15.148:0/3862948364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601038f0 0x7ffb600fcf60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c004940 tx=0x7ffb4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 -- 172.21.15.148:0/3862948364 shutdown_connections 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 --2- 172.21.15.148:0/3862948364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb601038f0 0x7ffb600fcf60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 --2- 172.21.15.148:0/3862948364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb60102f50 0x7ffb60103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 -- 172.21.15.148:0/3862948364 >> 172.21.15.148:0/3862948364 conn(0x7ffb600f8ae0 msgr2=0x7ffb600faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 -- 172.21.15.148:0/3862948364 shutdown_connections 2024-02-28T16:31:39.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.906+0000 7ffb65800700 1 -- 172.21.15.148:0/3862948364 wait complete. 2024-02-28T16:31:39.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.907+0000 7ffb65800700 1 Processor -- start 2024-02-28T16:31:39.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.907+0000 7ffb65800700 1 -- start start 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.907+0000 7ffb65800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb60102f50 0x7ffb60113ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.907+0000 7ffb65800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb601038f0 0x7ffb60114000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.907+0000 7ffb65800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601146e0 con 0x7ffb60102f50 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.907+0000 7ffb65800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6010d980 con 0x7ffb601038f0 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.908+0000 7ffb5ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb60102f50 0x7ffb60113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.908+0000 7ffb5ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb60102f50 0x7ffb60113ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33326/0 (socket says 172.21.15.148:33326) 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.908+0000 7ffb5ea00700 1 -- 172.21.15.148:0/291483604 learned_addr learned my addr 172.21.15.148:0/291483604 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:39.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.908+0000 7ffb5e000700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb601038f0 0x7ffb60114000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.908+0000 7ffb5ea00700 1 -- 172.21.15.148:0/291483604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb601038f0 msgr2=0x7ffb60114000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.908+0000 7ffb5ea00700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb601038f0 0x7ffb60114000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.908+0000 7ffb5ea00700 1 -- 172.21.15.148:0/291483604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c005040 con 0x7ffb60102f50 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.909+0000 7ffb5ea00700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb60102f50 0x7ffb60113ac0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000b790 tx=0x7ffb50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.909+0000 7ffb56a00700 1 -- 172.21.15.148:0/291483604 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb5000f770 con 0x7ffb60102f50 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.909+0000 7ffb56a00700 1 -- 172.21.15.148:0/291483604 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb5000fda0 con 0x7ffb60102f50 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.909+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6010dc60 con 0x7ffb60102f50 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.909+0000 7ffb56a00700 1 -- 172.21.15.148:0/291483604 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb5000d310 con 0x7ffb60102f50 2024-02-28T16:31:39.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.909+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6010e1a0 con 0x7ffb60102f50 2024-02-28T16:31:39.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.910+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb600fc6e0 con 0x7ffb60102f50 2024-02-28T16:31:39.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.911+0000 7ffb56a00700 1 -- 172.21.15.148:0/291483604 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7ffb50010420 con 0x7ffb60102f50 2024-02-28T16:31:39.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.913+0000 7ffb56a00700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ffb4406d0f0 0x7ffb4406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:39.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.913+0000 7ffb56a00700 1 -- 172.21.15.148:0/291483604 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ffb5008c650 con 0x7ffb60102f50 2024-02-28T16:31:39.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.913+0000 7ffb5e000700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ffb4406d0f0 0x7ffb4406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:39.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.914+0000 7ffb5e000700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ffb4406d0f0 0x7ffb4406f5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb6010f2f0 tx=0x7ffb4c009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:39.906 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:39.918+0000 7ffb56a00700 1 -- 172.21.15.148:0/291483604 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7ffb5005a200 con 0x7ffb60102f50 2024-02-28T16:31:39.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:39 smithi157 ceph-mon[38346]: pgmap v117: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:40.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.222+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb6010a120 con 0x7ffb60102f50 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.223+0000 7ffb56a00700 1 -- 172.21.15.148:0/291483604 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7ffb6010a120 con 0x7ffb60102f50 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:31:40.212 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 12, 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:31:40.213 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:31:40.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ffb4406d0f0 msgr2=0x7ffb4406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ffb4406d0f0 0x7ffb4406f5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb6010f2f0 tx=0x7ffb4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:40.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb60102f50 msgr2=0x7ffb60113ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb60102f50 0x7ffb60113ac0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000b790 tx=0x7ffb50009250 comp rx=0 tx=0).stop 2024-02-28T16:31:40.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 shutdown_connections 2024-02-28T16:31:40.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7ffb4406d0f0 0x7ffb4406f5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb60102f50 0x7ffb60113ac0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 --2- 172.21.15.148:0/291483604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb601038f0 0x7ffb60114000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.226+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 >> 172.21.15.148:0/291483604 conn(0x7ffb600f8ae0 msgr2=0x7ffb600fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:40.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.227+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 shutdown_connections 2024-02-28T16:31:40.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.227+0000 7ffb65800700 1 -- 172.21.15.148:0/291483604 wait complete. 2024-02-28T16:31:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.368+0000 7f4027e00700 1 -- 172.21.15.148:0/1172970043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 msgr2=0x7f40201093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.368+0000 7f4027e00700 1 --2- 172.21.15.148:0/1172970043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f40201093d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f400c004940 tx=0x7f400c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.368+0000 7f4027e00700 1 -- 172.21.15.148:0/1172970043 shutdown_connections 2024-02-28T16:31:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.368+0000 7f4027e00700 1 --2- 172.21.15.148:0/1172970043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f40201093d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.368+0000 7f4027e00700 1 --2- 172.21.15.148:0/1172970043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4020065760 0x7f4020065b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.368+0000 7f4027e00700 1 -- 172.21.15.148:0/1172970043 >> 172.21.15.148:0/1172970043 conn(0x7f4020071d50 msgr2=0x7f4020072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.369+0000 7f4027e00700 1 -- 172.21.15.148:0/1172970043 shutdown_connections 2024-02-28T16:31:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.369+0000 7f4027e00700 1 -- 172.21.15.148:0/1172970043 wait complete. 2024-02-28T16:31:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.369+0000 7f4027e00700 1 Processor -- start 2024-02-28T16:31:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.369+0000 7f4027e00700 1 -- start start 2024-02-28T16:31:40.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4027e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4020065760 0x7f4020115b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4027e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f4020116080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4027e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4020116760 con 0x7f4020066070 2024-02-28T16:31:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4027e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402010fa00 con 0x7f4020065760 2024-02-28T16:31:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4024a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f4020116080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4024a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f4020116080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33344/0 (socket says 172.21.15.148:33344) 2024-02-28T16:31:40.363 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4024a00700 1 -- 172.21.15.148:0/4245359843 learned_addr learned my addr 172.21.15.148:0/4245359843 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.370+0000 7f4025400700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4020065760 0x7f4020115b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.371+0000 7f4024a00700 1 -- 172.21.15.148:0/4245359843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4020065760 msgr2=0x7f4020115b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.371+0000 7f4024a00700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4020065760 0x7f4020115b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.371+0000 7f4024a00700 1 -- 172.21.15.148:0/4245359843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c005040 con 0x7f4020066070 2024-02-28T16:31:40.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.371+0000 7f4024a00700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f4020116080 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f400c009180 tx=0x7f400c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.371+0000 7f401d600700 1 -- 172.21.15.148:0/4245359843 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f400c00e040 con 0x7f4020066070 2024-02-28T16:31:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.371+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402010fc80 con 0x7f4020066070 2024-02-28T16:31:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.371+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40201101c0 con 0x7f4020066070 2024-02-28T16:31:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.372+0000 7f401d600700 1 -- 172.21.15.148:0/4245359843 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f400c004290 con 0x7f4020066070 2024-02-28T16:31:40.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.372+0000 7f401d600700 1 -- 172.21.15.148:0/4245359843 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f400c01c630 con 0x7f4020066070 2024-02-28T16:31:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.373+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40000052e0 con 0x7f4020066070 2024-02-28T16:31:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.374+0000 7f401d600700 1 -- 172.21.15.148:0/4245359843 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f400c00bcc0 con 0x7f4020066070 2024-02-28T16:31:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.375+0000 7f401d600700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f400806d0f0 0x7f400806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:40.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.375+0000 7f401d600700 1 -- 172.21.15.148:0/4245359843 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f400c08d900 con 0x7f4020066070 2024-02-28T16:31:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.375+0000 7f4025400700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f400806d0f0 0x7f400806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.376+0000 7f4025400700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f400806d0f0 0x7f400806f5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4014006fd0 tx=0x7f4014008040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:40.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.379+0000 7f401d600700 1 -- 172.21.15.148:0/4245359843 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f400c05b530 con 0x7f4020066070 2024-02-28T16:31:40.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.666+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4000005da0 con 0x7f4020066070 2024-02-28T16:31:40.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.667+0000 7f401d600700 1 -- 172.21.15.148:0/4245359843 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1811 (secure 0 0 0) 0x7f400c05b0c0 con 0x7f4020066070 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:31:40.657 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:31:40.658 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:31:40.659 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:31:40.660 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:40.660 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:40.660 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:40.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f400806d0f0 msgr2=0x7f400806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f400806d0f0 0x7f400806f5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4014006fd0 tx=0x7f4014008040 comp rx=0 tx=0).stop 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 msgr2=0x7f4020116080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f4020116080 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f400c009180 tx=0x7f400c009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 shutdown_connections 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f400806d0f0 0x7f400806f5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4020065760 0x7f4020115b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 --2- 172.21.15.148:0/4245359843 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4020066070 0x7f4020116080 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 >> 172.21.15.148:0/4245359843 conn(0x7f4020071d50 msgr2=0x7f40200fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 shutdown_connections 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.670+0000 7f4027e00700 1 -- 172.21.15.148:0/4245359843 wait complete. 2024-02-28T16:31:40.661 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:31:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 -- 172.21.15.148:0/2558207142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 msgr2=0x7f837c109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 --2- 172.21.15.148:0/2558207142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c109740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8370004940 tx=0x7f8370009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 -- 172.21.15.148:0/2558207142 shutdown_connections 2024-02-28T16:31:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 --2- 172.21.15.148:0/2558207142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837c109d10 0x7f837c103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 --2- 172.21.15.148:0/2558207142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c109740 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 -- 172.21.15.148:0/2558207142 >> 172.21.15.148:0/2558207142 conn(0x7f837c072b80 msgr2=0x7f837c074f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:40.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 -- 172.21.15.148:0/2558207142 shutdown_connections 2024-02-28T16:31:40.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.820+0000 7f8382600700 1 -- 172.21.15.148:0/2558207142 wait complete. 2024-02-28T16:31:40.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.821+0000 7f8382600700 1 Processor -- start 2024-02-28T16:31:40.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.821+0000 7f8382600700 1 -- start start 2024-02-28T16:31:40.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.821+0000 7f8382600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c119eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.821+0000 7f8382600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837c109d10 0x7f837c11a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.821+0000 7f8382600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c11aad0 con 0x7f837c109370 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.821+0000 7f8382600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c113d50 con 0x7f837c109d10 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f8381200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c119eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f8381200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c119eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33372/0 (socket says 172.21.15.148:33372) 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f8381200700 1 -- 172.21.15.148:0/416763458 learned_addr learned my addr 172.21.15.148:0/416763458 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f8381200700 1 -- 172.21.15.148:0/416763458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837c109d10 msgr2=0x7f837c11a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f837be00700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837c109d10 0x7f837c11a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f8381200700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837c109d10 0x7f837c11a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f8381200700 1 -- 172.21.15.148:0/416763458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370005040 con 0x7f837c109370 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.822+0000 7f8381200700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c119eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8370009100 tx=0x7f8370009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.823+0000 7f8378c00700 1 -- 172.21.15.148:0/416763458 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837000e040 con 0x7f837c109370 2024-02-28T16:31:40.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.823+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c113f70 con 0x7f837c109370 2024-02-28T16:31:40.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.823+0000 7f8378c00700 1 -- 172.21.15.148:0/416763458 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8370004290 con 0x7f837c109370 2024-02-28T16:31:40.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.823+0000 7f8378c00700 1 -- 172.21.15.148:0/416763458 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837001c630 con 0x7f837c109370 2024-02-28T16:31:40.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.823+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c1144b0 con 0x7f837c109370 2024-02-28T16:31:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.824+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c05f5c0 con 0x7f837c109370 2024-02-28T16:31:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.825+0000 7f8378c00700 1 -- 172.21.15.148:0/416763458 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f837000bbf0 con 0x7f837c109370 2024-02-28T16:31:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.826+0000 7f8378c00700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f836406d0e0 0x7f836406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.826+0000 7f8378c00700 1 -- 172.21.15.148:0/416763458 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f837008d8c0 con 0x7f837c109370 2024-02-28T16:31:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.826+0000 7f837be00700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f836406d0e0 0x7f836406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:40.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.827+0000 7f837be00700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f836406d0e0 0x7f836406f590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f837c115750 tx=0x7f8368008040 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:40.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:40.830+0000 7f8378c00700 1 -- 172.21.15.148:0/416763458 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f837005b510 con 0x7f837c109370 2024-02-28T16:31:40.935 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:40.935 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:40.935 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:40.935 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (squid) 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: Upgrade: Setting container_image for all mgr 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/291483604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:40.936 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:40 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/4245359843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:31:41.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.066+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 --> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f837c1155a0 con 0x7f836406d0e0 2024-02-28T16:31:41.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.068+0000 7f8378c00700 1 -- 172.21.15.148:0/416763458 <== mgr.24437 v2:172.21.15.148:6800/2883262037 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f837c1155a0 con 0x7f836406d0e0 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:31:41.057 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "2/21 daemons upgraded", 2024-02-28T16:31:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T16:31:41.058 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:31:41.058 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:31:41.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f836406d0e0 msgr2=0x7f836406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:41.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f836406d0e0 0x7f836406f590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f837c115750 tx=0x7f8368008040 comp rx=0 tx=0).stop 2024-02-28T16:31:41.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 msgr2=0x7f837c119eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c119eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8370009100 tx=0x7f8370009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 shutdown_connections 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f836406d0e0 0x7f836406f590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f837c109370 0x7f837c119eb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 --2- 172.21.15.148:0/416763458 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f837c109d10 0x7f837c11a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.070+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 >> 172.21.15.148:0/416763458 conn(0x7f837c072b80 msgr2=0x7f837c075650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.071+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 shutdown_connections 2024-02-28T16:31:41.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.071+0000 7f8382600700 1 -- 172.21.15.148:0/416763458 wait complete. 2024-02-28T16:31:41.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.213+0000 7f1749400700 1 -- 172.21.15.148:0/3550737604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744102d90 msgr2=0x7f1744103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:41.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.213+0000 7f1749400700 1 --2- 172.21.15.148:0/3550737604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744102d90 0x7f1744103160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1734004940 tx=0x7f1734009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:41.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.213+0000 7f1749400700 1 -- 172.21.15.148:0/3550737604 shutdown_connections 2024-02-28T16:31:41.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.213+0000 7f1749400700 1 --2- 172.21.15.148:0/3550737604 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1744103730 0x7f17440fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.213+0000 7f1749400700 1 --2- 172.21.15.148:0/3550737604 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744102d90 0x7f1744103160 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.213+0000 7f1749400700 1 -- 172.21.15.148:0/3550737604 >> 172.21.15.148:0/3550737604 conn(0x7f17440f8940 msgr2=0x7f17440fad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:41.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.214+0000 7f1749400700 1 -- 172.21.15.148:0/3550737604 shutdown_connections 2024-02-28T16:31:41.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.214+0000 7f1749400700 1 -- 172.21.15.148:0/3550737604 wait complete. 2024-02-28T16:31:41.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.214+0000 7f1749400700 1 Processor -- start 2024-02-28T16:31:41.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1749400700 1 -- start start 2024-02-28T16:31:41.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1749400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1744102d90 0x7f1744115a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:41.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1749400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744103730 0x7f1744115f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:41.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1749400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17441165e0 con 0x7f1744103730 2024-02-28T16:31:41.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1749400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174410f910 con 0x7f1744102d90 2024-02-28T16:31:41.204 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1743400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744103730 0x7f1744115f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:41.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1743400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744103730 0x7f1744115f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33396/0 (socket says 172.21.15.148:33396) 2024-02-28T16:31:41.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.215+0000 7f1743400700 1 -- 172.21.15.148:0/2219691364 learned_addr learned my addr 172.21.15.148:0/2219691364 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:31:41.205 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.216+0000 7f1743e00700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1744102d90 0x7f1744115a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.216+0000 7f1743400700 1 -- 172.21.15.148:0/2219691364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1744102d90 msgr2=0x7f1744115a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.216+0000 7f1743400700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1744102d90 0x7f1744115a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.216+0000 7f1743400700 1 -- 172.21.15.148:0/2219691364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734005040 con 0x7f1744103730 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.216+0000 7f1743400700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744103730 0x7f1744115f90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f173000c800 tx=0x7f1730004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.216+0000 7f173be00700 1 -- 172.21.15.148:0/2219691364 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f173000a760 con 0x7f1744103730 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.216+0000 7f173be00700 1 -- 172.21.15.148:0/2219691364 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f173000ad90 con 0x7f1744103730 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.217+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174410fbf0 con 0x7f1744103730 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.217+0000 7f173be00700 1 -- 172.21.15.148:0/2219691364 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17300113a0 con 0x7f1744103730 2024-02-28T16:31:41.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.217+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17441101b0 con 0x7f1744103730 2024-02-28T16:31:41.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.218+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174405f5c0 con 0x7f1744103730 2024-02-28T16:31:41.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.219+0000 7f173be00700 1 -- 172.21.15.148:0/2219691364 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 34) v1 ==== 91201+0+0 (secure 0 0 0) 0x7f1730012400 con 0x7f1744103730 2024-02-28T16:31:41.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.220+0000 7f173be00700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f172806d0f0 0x7f172806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:31:41.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.220+0000 7f173be00700 1 -- 172.21.15.148:0/2219691364 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f173008c640 con 0x7f1744103730 2024-02-28T16:31:41.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.220+0000 7f1743e00700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f172806d0f0 0x7f172806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:31:41.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.221+0000 7f1743e00700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f172806d0f0 0x7f172806f5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f173400b020 tx=0x7f1734009e30 comp rx=0 tx=0).ready entity=mgr.24437 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:31:41.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.225+0000 7f173be00700 1 -- 172.21.15.148:0/2219691364 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181772 (secure 0 0 0) 0x7f173005a1f0 con 0x7f1744103730 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (squid) 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:41.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: Upgrade: Setting container_image for all mgr 2024-02-28T16:31:41.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:41.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:31:41.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/291483604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:31:41.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:40 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/4245359843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:31:41.520 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.531+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1744110430 con 0x7f1744103730 2024-02-28T16:31:41.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.532+0000 7f173be00700 1 -- 172.21.15.148:0/2219691364 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1730059d80 con 0x7f1744103730 2024-02-28T16:31:41.521 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:31:41.521 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:31:41.521 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.534+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f172806d0f0 msgr2=0x7f172806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.534+0000 7f1749400700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f172806d0f0 0x7f172806f5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f173400b020 tx=0x7f1734009e30 comp rx=0 tx=0).stop 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.534+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744103730 msgr2=0x7f1744115f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.534+0000 7f1749400700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744103730 0x7f1744115f90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f173000c800 tx=0x7f1730004470 comp rx=0 tx=0).stop 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.535+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 shutdown_connections 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.535+0000 7f1749400700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:6800/2883262037,v1:172.21.15.148:6801/2883262037] conn(0x7f172806d0f0 0x7f172806f5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.535+0000 7f1749400700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1744102d90 0x7f1744115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.535+0000 7f1749400700 1 --2- 172.21.15.148:0/2219691364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1744103730 0x7f1744115f90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:31:41.524 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.535+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 >> 172.21.15.148:0/2219691364 conn(0x7f17440f8940 msgr2=0x7f17440fa190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:31:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.535+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 shutdown_connections 2024-02-28T16:31:41.525 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:31:41.535+0000 7f1749400700 1 -- 172.21.15.148:0/2219691364 wait complete. 2024-02-28T16:31:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:41 smithi148 ceph-mon[28767]: pgmap v118: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:42.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:41 smithi148 ceph-mon[28767]: from='client.? 172.21.15.148:0/2219691364' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:31:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:41 smithi157 ceph-mon[38346]: pgmap v118: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:41 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2219691364' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:31:43.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:42 smithi148 ceph-mon[28767]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:43.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:42 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:43.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:42 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:31:43.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:42 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:31:43.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:42 smithi148 ceph-mon[28767]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:43.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:42 smithi157 ceph-mon[38346]: from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:31:43.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:42 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' 2024-02-28T16:31:43.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:42 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:31:43.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:42 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:31:43.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:42 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:31:43.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:43 smithi148 ceph-mon[28767]: Upgrade: Updating mon.smithi148 2024-02-28T16:31:43.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:43 smithi148 ceph-mon[28767]: Deploying daemon mon.smithi148 on smithi148 2024-02-28T16:31:43.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:43 smithi148 ceph-mon[28767]: pgmap v119: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:43 smithi157 ceph-mon[38346]: Upgrade: Updating mon.smithi148 2024-02-28T16:31:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:43 smithi157 ceph-mon[38346]: Deploying daemon mon.smithi148 on smithi148 2024-02-28T16:31:44.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:43 smithi157 ceph-mon[38346]: pgmap v119: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:45.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:44 smithi148 ceph-mon[28767]: pgmap v120: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:45.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:45 smithi148 systemd[1]: Stopping Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:31:45.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:44 smithi157 ceph-mon[38346]: pgmap v120: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:45.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:45 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[28763]: 2024-02-28T16:31:45.541+0000 7fc6f7000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi148 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:31:45.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:45 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[28763]: 2024-02-28T16:31:45.541+0000 7fc6f7000700 -1 mon.smithi148@0(leader) e2 *** Got Signal Terminated *** 2024-02-28T16:31:45.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:45 smithi148 podman[112292]: 2024-02-28 16:31:45.686167577 +0000 UTC m=+0.269785365 container died 76d7b5412223a193798e902466f7f3cb8aa04c2172df832f9adfbdcb7ce81a0f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, ceph=True, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-28T16:31:46.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:46 smithi148 podman[112292]: 2024-02-28 16:31:46.143563182 +0000 UTC m=+0.727180980 container cleanup 76d7b5412223a193798e902466f7f3cb8aa04c2172df832f9adfbdcb7ce81a0f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-c0f02e6, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-28T16:31:46.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:46 smithi148 bash[112292]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148 2024-02-28T16:31:46.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:46 smithi148 podman[112317]: 2024-02-28 16:31:46.419791528 +0000 UTC m=+0.718547723 container remove 76d7b5412223a193798e902466f7f3cb8aa04c2172df832f9adfbdcb7ce81a0f (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T16:31:47.261 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:46 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service: Deactivated successfully. 2024-02-28T16:31:47.262 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:46 smithi148 systemd[1]: Stopped Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:31:47.262 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:46 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service: Consumed 31.699s CPU time. 2024-02-28T16:31:47.609 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:47 smithi148 systemd[1]: Starting Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:31:47.860 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:47 smithi148 podman[112444]: 2024-02-28 16:31:47.530760571 +0000 UTC m=+0.040576592 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:31:47.860 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:47 smithi148 podman[112444]: 2024-02-28 16:31:47.65446122 +0000 UTC m=+0.164277254 container create c5c988485518fd6ff10bd3b251585fbdc65e921de4dd4a1c444170a9506d209d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-28T16:31:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 podman[112444]: 2024-02-28 16:31:48.008963443 +0000 UTC m=+0.518779520 container init c5c988485518fd6ff10bd3b251585fbdc65e921de4dd4a1c444170a9506d209d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-28T16:31:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 podman[112444]: 2024-02-28 16:31:48.021667218 +0000 UTC m=+0.531483227 container start c5c988485518fd6ff10bd3b251585fbdc65e921de4dd4a1c444170a9506d209d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-28T16:31:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:31:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T16:31:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: pidfile_write: ignore empty --pid-file 2024-02-28T16:31:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: load: jerasure load: lrc 2024-02-28T16:31:48.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Git sha 0 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: DB SUMMARY 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: DB Session ID: 6BAQDUOW6ID6SGJ8FQLN 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1944 Bytes 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi148/store.db dir, Total Num: 1, files: 000045.sst 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi148/store.db: 000043.log size: 56660 ; 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:31:48.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.env: 0x56216dcdeb20 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.info_log: 0x56216eb0f7c0 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.statistics: (nil) 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.use_fsync: 0 2024-02-28T16:31:48.377 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.db_log_dir: 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.wal_dir: 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:31:48.378 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.write_buffer_manager: 0x56216eae3400 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.unordered_write: 0 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:31:48.379 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:31:48.380 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:31:48.380 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:31:48.380 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.row_cache: None 2024-02-28T16:31:48.380 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.wal_filter: None 2024-02-28T16:31:48.380 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:31:48.380 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:31:48.380 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.wal_compression: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:31:48.381 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_open_files: -1 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:31:48.382 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Compression algorithms supported: 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kZSTD supported: 0 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi148/store.db/MANIFEST-000015 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:31:48.383 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.merge_operator: 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_filter: None 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56216eb0f8e0) 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_type: 0 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_block_index_type: 0 2024-02-28T16:31:48.384 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_shortening: 1 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: checksum: 4 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: no_block_cache: 0 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache: 0x56216eb13090 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_options: 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: capacity : 536870912 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: num_shard_bits : 4 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: strict_capacity_limit : 0 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_cache_compressed: (nil) 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: persistent_cache: (nil) 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_size: 4096 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_size_deviation: 10 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_restart_interval: 16 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: index_block_restart_interval: 1 2024-02-28T16:31:48.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: metadata_block_size: 4096 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: partition_filters: 0 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: use_delta_encoding: 1 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: filter_policy: bloomfilter 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: whole_key_filtering: 1 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: verify_compression: 0 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: format_version: 5 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: enable_index_compression: 1 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: block_align: 0 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_auto_readahead_size: 262144 2024-02-28T16:31:48.386 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: prepopulate_block_cache: 0 2024-02-28T16:31:48.387 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression: NoCompression 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.num_levels: 7 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:31:48.388 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:31:48.389 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:31:48.390 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:31:48.391 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.ttl: 2592000 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:31:48.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 45.sst 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:31:48.393 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi148/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 47, last_sequence is 19208, log_number is 43,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 43 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c13fb17a-8d90-4d38-b66b-ee3ec888474a 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137908077734, "job": 1, "event": "recovery_started", "wal_files": [43]} 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #43 mode 2 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137908078935, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 48, "file_size": 56790, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 19209, "largest_seqno": 19303, "table_properties": {"data_size": 55329, "index_size": 257, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 197, "raw_key_size": 1521, "raw_average_key_size": 25, "raw_value_size": 53993, "raw_average_value_size": 899, "num_data_blocks": 12, "num_entries": 60, "num_filter_entries": 60, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709137908, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c13fb17a-8d90-4d38-b66b-ee3ec888474a", "db_session_id": "6BAQDUOW6ID6SGJ8FQLN", "orig_file_number": 48, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137908079109, "job": 1, "event": "recovery_finished"} 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/version_set.cc:5047] Creating manifest 50 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi148/store.db/000043.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56216ec02000 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: DB pointer 0x56216ebee000 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** DB Stats ** 2024-02-28T16:31:48.394 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: L0 1/0 55.46 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: L6 1/0 6.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Sum 2/0 6.47 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:31:48.395 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:31:48.396 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.396 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** Compaction Stats [default] ** 2024-02-28T16:31:48.396 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:31:48.396 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:31:48.396 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T16:31:48.396 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:31:48.399 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Cumulative compaction: 0.00 GB write, 9.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Interval compaction: 0.00 GB write, 9.17 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Block cache BinnedLRUCache@0x56216eb13090#2 capacity: 512.00 MB usage: 0.59 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 3.1e-05 secs_since: 0 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.23 KB,4.47035e-05%) IndexBlock(1,0.36 KB,6.85453e-05%) Misc(1,0.00 KB,0%) 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: starting mon.smithi148 rank 0 at public addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] at bind addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi148 fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???) e2 preinit fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???).mds e14 new map 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???).mds e14 print_map 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: e14 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:31:48.400 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: legacy client fscid: 1 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Filesystem 'cephfs' (1) 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: fs_name cephfs 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: epoch 14 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: tableserver 0 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: root 0 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: session_timeout 60 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: session_autoclose 300 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_file_size 1099511627776 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_xattr_size 65536 2024-02-28T16:31:48.401 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: required_client_features {} 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: last_failure 0 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: last_failure_osd_epoch 46 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: max_mds 1 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: in 0 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: up {0=14484} 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: failed 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: damaged 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: stopped 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: data_pools [3] 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: metadata_pool 2 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: inline_data enabled 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: balancer 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: bal_rank_mask -1 2024-02-28T16:31:48.402 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: standby_count_wanted 1 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: Standby daemons: 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout: [mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 bash[112444]: c5c988485518fd6ff10bd3b251585fbdc65e921de4dd4a1c444170a9506d209d 2024-02-28T16:31:48.403 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 systemd[1]: Started Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:31:49.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:31:49.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:31:49.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:49.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148 calling monitor election 2024-02-28T16:31:49.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mon.smithi148 is new leader, mons smithi148,smithi157 in quorum (ranks 0,1) 2024-02-28T16:31:49.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: monmap e2: 2 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:31:49.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:31:49.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:31:49.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mgrmap e34: smithi148.gelspy(active, since 3m), standbys: smithi157.cmcxzj 2024-02-28T16:31:49.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:31:49.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:31:49.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:31:49.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: mgrmap e35: smithi148.gelspy(active, since 3m), standbys: smithi157.cmcxzj 2024-02-28T16:31:49.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:48 smithi148 ceph-mon[112463]: from='mgr.24437 ' entity='' 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: from='mgr.24437 172.21.15.148:0/2480290850' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: pgmap v121: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: mon.smithi148 calling monitor election 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: mon.smithi148 is new leader, mons smithi148,smithi157 in quorum (ranks 0,1) 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: monmap e2: 2 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: mgrmap e34: smithi148.gelspy(active, since 3m), standbys: smithi157.cmcxzj 2024-02-28T16:31:49.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:31:49.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:31:49.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:31:49.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: mgrmap e35: smithi148.gelspy(active, since 3m), standbys: smithi157.cmcxzj 2024-02-28T16:31:49.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:48 smithi157 ceph-mon[38346]: from='mgr.24437 ' entity='' 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: Active manager daemon smithi148.gelspy restarted 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: Activating manager daemon smithi148.gelspy 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: mgrmap e36: smithi148.gelspy(active, starting, since 0.0177733s), standbys: smithi157.cmcxzj 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:31:57.822 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: Standby manager daemon smithi157.cmcxzj restarted 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:31:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:31:57.824 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:31:57.824 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:31:57.824 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:57 smithi148 ceph-mon[112463]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:31:57.849 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: Active manager daemon smithi148.gelspy restarted 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: Activating manager daemon smithi148.gelspy 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: mgrmap e36: smithi148.gelspy(active, starting, since 0.0177733s), standbys: smithi157.cmcxzj 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi148.gelspy", "id": "smithi148.gelspy"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr metadata", "who": "smithi157.cmcxzj", "id": "smithi157.cmcxzj"}]: dispatch 2024-02-28T16:31:57.850 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj restarted 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: Standby manager daemon smithi157.cmcxzj started 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/crt"}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: Manager daemon smithi148.gelspy is now available 2024-02-28T16:31:57.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi157.cmcxzj/key"}]: dispatch 2024-02-28T16:31:57.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:57 smithi157 ceph-mon[38346]: from='mgr.? 172.21.15.157:0/3494991161' entity='mgr.smithi157.cmcxzj' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T16:31:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:58.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:58.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:31:58.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:31:58.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:58 smithi148 ceph-mon[112463]: mgrmap e37: smithi148.gelspy(active, since 1.0296s), standbys: smithi157.cmcxzj 2024-02-28T16:31:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:58 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:58 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:31:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:58 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:31:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:58 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/mirror_snapshot_schedule"}]: dispatch 2024-02-28T16:31:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:58 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi148.gelspy/trash_purge_schedule"}]: dispatch 2024-02-28T16:31:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:58 smithi157 ceph-mon[38346]: mgrmap e37: smithi148.gelspy(active, since 1.0296s), standbys: smithi157.cmcxzj 2024-02-28T16:31:59.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:59 smithi148 ceph-mon[112463]: [28/Feb/2024:16:31:58] ENGINE Bus STARTING 2024-02-28T16:31:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:59 smithi148 ceph-mon[112463]: [28/Feb/2024:16:31:58] ENGINE Serving on http://172.21.15.148:8765 2024-02-28T16:31:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:59 smithi148 ceph-mon[112463]: pgmap v3: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:59 smithi148 ceph-mon[112463]: [28/Feb/2024:16:31:58] ENGINE Serving on https://172.21.15.148:7150 2024-02-28T16:31:59.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:31:59 smithi148 ceph-mon[112463]: [28/Feb/2024:16:31:58] ENGINE Bus STARTED 2024-02-28T16:31:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:59 smithi157 ceph-mon[38346]: [28/Feb/2024:16:31:58] ENGINE Bus STARTING 2024-02-28T16:31:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:59 smithi157 ceph-mon[38346]: [28/Feb/2024:16:31:58] ENGINE Serving on http://172.21.15.148:8765 2024-02-28T16:31:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:59 smithi157 ceph-mon[38346]: pgmap v3: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:31:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:59 smithi157 ceph-mon[38346]: [28/Feb/2024:16:31:58] ENGINE Serving on https://172.21.15.148:7150 2024-02-28T16:31:59.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:31:59 smithi157 ceph-mon[38346]: [28/Feb/2024:16:31:58] ENGINE Bus STARTED 2024-02-28T16:32:00.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:00 smithi157 ceph-mon[38346]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:00.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:00 smithi157 ceph-mon[38346]: mgrmap e38: smithi148.gelspy(active, since 2s), standbys: smithi157.cmcxzj 2024-02-28T16:32:00.853 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:00 smithi148 ceph-mon[112463]: pgmap v4: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:00.853 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:00 smithi148 ceph-mon[112463]: mgrmap e38: smithi148.gelspy(active, since 2s), standbys: smithi157.cmcxzj 2024-02-28T16:32:02.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:02 smithi148 ceph-mon[112463]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:02.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:02 smithi148 ceph-mon[112463]: mgrmap e39: smithi148.gelspy(active, since 4s), standbys: smithi157.cmcxzj 2024-02-28T16:32:02.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:02 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:02.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:02 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:02 smithi157 ceph-mon[38346]: pgmap v5: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:02 smithi157 ceph-mon[38346]: mgrmap e39: smithi148.gelspy(active, since 4s), standbys: smithi157.cmcxzj 2024-02-28T16:32:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:02 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:02 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:04 smithi157 ceph-mon[38346]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:04 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:04 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:05.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:04 smithi148 ceph-mon[112463]: pgmap v6: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:05.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:04 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:05.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:04 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:06.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:06 smithi148 ceph-mon[112463]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-28T16:32:06.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:06.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:06.953 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:06 smithi157 ceph-mon[38346]: pgmap v7: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-02-28T16:32:06.953 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:06 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:06.953 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:06 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:08.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:08 smithi148 ceph-mon[112463]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T16:32:08.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:08 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:08.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:08 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:08.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:08 smithi157 ceph-mon[38346]: pgmap v8: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T16:32:08.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:08 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:08.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:08 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:10 smithi148 ceph-mon[112463]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-28T16:32:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:10 smithi148 ceph-mon[112463]: Detected new or changed devices on smithi157 2024-02-28T16:32:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:10 smithi157 ceph-mon[38346]: pgmap v9: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-28T16:32:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:10 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi157 2024-02-28T16:32:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:10 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:10.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:10 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 -- 172.21.15.148:0/2246897542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fdfe0 msgr2=0x7fc6340fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 --2- 172.21.15.148:0/2246897542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fdfe0 0x7fc6340fe3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc624004970 tx=0x7fc624009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 -- 172.21.15.148:0/2246897542 shutdown_connections 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 --2- 172.21.15.148:0/2246897542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6340fe8f0 0x7fc634107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 --2- 172.21.15.148:0/2246897542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fdfe0 0x7fc6340fe3b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 -- 172.21.15.148:0/2246897542 >> 172.21.15.148:0/2246897542 conn(0x7fc634071d90 msgr2=0x7fc634072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 -- 172.21.15.148:0/2246897542 shutdown_connections 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.696+0000 7fc63ac00700 1 -- 172.21.15.148:0/2246897542 wait complete. 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.697+0000 7fc63ac00700 1 Processor -- start 2024-02-28T16:32:11.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.697+0000 7fc63ac00700 1 -- start start 2024-02-28T16:32:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.697+0000 7fc63ac00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6340fdfe0 0x7fc634115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.697+0000 7fc63ac00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fe8f0 0x7fc634116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:11.687 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc63ac00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6341167a0 con 0x7fc6340fe8f0 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc63ac00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63410faf0 con 0x7fc6340fdfe0 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc633400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fe8f0 0x7fc634116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc633400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fe8f0 0x7fc634116150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55962/0 (socket says 172.21.15.148:55962) 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc633400700 1 -- 172.21.15.148:0/1253408235 learned_addr learned my addr 172.21.15.148:0/1253408235 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc633e00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6340fdfe0 0x7fc634115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc633400700 1 -- 172.21.15.148:0/1253408235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6340fdfe0 msgr2=0x7fc634115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc633400700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6340fdfe0 0x7fc634115c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.698+0000 7fc633400700 1 -- 172.21.15.148:0/1253408235 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624005040 con 0x7fc6340fe8f0 2024-02-28T16:32:11.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.699+0000 7fc633400700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fe8f0 0x7fc634116150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c830 tx=0x7fc620004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.699+0000 7fc62be00700 1 -- 172.21.15.148:0/1253408235 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62000a760 con 0x7fc6340fe8f0 2024-02-28T16:32:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.699+0000 7fc62be00700 1 -- 172.21.15.148:0/1253408235 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc62000ad90 con 0x7fc6340fe8f0 2024-02-28T16:32:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.699+0000 7fc62be00700 1 -- 172.21.15.148:0/1253408235 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6200113a0 con 0x7fc6340fe8f0 2024-02-28T16:32:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.699+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63410fdd0 con 0x7fc6340fe8f0 2024-02-28T16:32:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.699+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc634110310 con 0x7fc6340fe8f0 2024-02-28T16:32:11.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.701+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc634106ac0 con 0x7fc6340fe8f0 2024-02-28T16:32:11.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.702+0000 7fc62be00700 1 -- 172.21.15.148:0/1253408235 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fc620012400 con 0x7fc6340fe8f0 2024-02-28T16:32:11.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.703+0000 7fc62be00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc61806d900 0x7fc61806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.703+0000 7fc62be00700 1 -- 172.21.15.148:0/1253408235 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc62008cf70 con 0x7fc6340fe8f0 2024-02-28T16:32:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.703+0000 7fc633e00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc61806d900 0x7fc61806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:11.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.704+0000 7fc633e00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc61806d900 0x7fc61806fdb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc624004ee0 tx=0x7fc624009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:11.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.711+0000 7fc62be00700 1 -- 172.21.15.148:0/1253408235 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc6200c0d20 con 0x7fc6340fe8f0 2024-02-28T16:32:11.952 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.963+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc63404bed0 con 0x7fc61806d900 2024-02-28T16:32:11.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.966+0000 7fc62be00700 1 -- 172.21.15.148:0/1253408235 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fc63404bed0 con 0x7fc61806d900 2024-02-28T16:32:11.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc61806d900 msgr2=0x7fc61806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:11.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc61806d900 0x7fc61806fdb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc624004ee0 tx=0x7fc624009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:11.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fe8f0 msgr2=0x7fc634116150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:11.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fe8f0 0x7fc634116150 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c830 tx=0x7fc620004470 comp rx=0 tx=0).stop 2024-02-28T16:32:11.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 shutdown_connections 2024-02-28T16:32:11.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc61806d900 0x7fc61806fdb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:11.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6340fdfe0 0x7fc634115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:11.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 --2- 172.21.15.148:0/1253408235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc6340fe8f0 0x7fc634116150 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:11.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 >> 172.21.15.148:0/1253408235 conn(0x7fc634071d90 msgr2=0x7fc634103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:11.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.970+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 shutdown_connections 2024-02-28T16:32:11.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:11.971+0000 7fc63ac00700 1 -- 172.21.15.148:0/1253408235 wait complete. 2024-02-28T16:32:11.983 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.152+0000 7f817da00700 1 -- 172.21.15.148:0/4060508811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 msgr2=0x7f81780fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.152+0000 7f817da00700 1 --2- 172.21.15.148:0/4060508811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f81780fcf60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8164004940 tx=0x7f8164009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.153+0000 7f817da00700 1 -- 172.21.15.148:0/4060508811 shutdown_connections 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.153+0000 7f817da00700 1 --2- 172.21.15.148:0/4060508811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f81780fcf60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.153+0000 7f817da00700 1 --2- 172.21.15.148:0/4060508811 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8178102f50 0x7f8178103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.153+0000 7f817da00700 1 -- 172.21.15.148:0/4060508811 >> 172.21.15.148:0/4060508811 conn(0x7f81780f8ae0 msgr2=0x7f81780faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.153+0000 7f817da00700 1 -- 172.21.15.148:0/4060508811 shutdown_connections 2024-02-28T16:32:12.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.153+0000 7f817da00700 1 -- 172.21.15.148:0/4060508811 wait complete. 2024-02-28T16:32:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.154+0000 7f817da00700 1 Processor -- start 2024-02-28T16:32:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.154+0000 7f817da00700 1 -- start start 2024-02-28T16:32:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.154+0000 7f817da00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8178102f50 0x7f8178115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:12.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.154+0000 7f817da00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f8178116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.154+0000 7f817da00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81781168f0 con 0x7f81781038f0 2024-02-28T16:32:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.154+0000 7f817da00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817810fb70 con 0x7f8178102f50 2024-02-28T16:32:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f8178116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f8178116210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33758/0 (socket says 172.21.15.148:33758) 2024-02-28T16:32:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176000700 1 -- 172.21.15.148:0/166100239 learned_addr learned my addr 172.21.15.148:0/166100239 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:12.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176a00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8178102f50 0x7f8178115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176000700 1 -- 172.21.15.148:0/166100239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8178102f50 msgr2=0x7f8178115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176000700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8178102f50 0x7f8178115cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176000700 1 -- 172.21.15.148:0/166100239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8164005040 con 0x7f81781038f0 2024-02-28T16:32:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.155+0000 7f8176a00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8178102f50 0x7f8178115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:32:12.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.156+0000 7f8176000700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f8178116210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8164009150 tx=0x7f8164009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:12.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.156+0000 7f816ea00700 1 -- 172.21.15.148:0/166100239 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816400e040 con 0x7f81781038f0 2024-02-28T16:32:12.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.156+0000 7f816ea00700 1 -- 172.21.15.148:0/166100239 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f816400bbf0 con 0x7f81781038f0 2024-02-28T16:32:12.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.156+0000 7f816ea00700 1 -- 172.21.15.148:0/166100239 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816401c630 con 0x7f81781038f0 2024-02-28T16:32:12.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.156+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817810fd90 con 0x7f81781038f0 2024-02-28T16:32:12.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.157+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81781102d0 con 0x7f81781038f0 2024-02-28T16:32:12.147 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.158+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81780fc6e0 con 0x7f81781038f0 2024-02-28T16:32:12.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.159+0000 7f816ea00700 1 -- 172.21.15.148:0/166100239 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f816400bd60 con 0x7f81781038f0 2024-02-28T16:32:12.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.161+0000 7f816ea00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f815c06d900 0x7f815c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:12.149 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.161+0000 7f816ea00700 1 -- 172.21.15.148:0/166100239 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f816408e4c0 con 0x7f81781038f0 2024-02-28T16:32:12.150 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.162+0000 7f8176a00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f815c06d900 0x7f815c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:12.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.163+0000 7f8176a00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f815c06d900 0x7f815c06fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8168009b10 tx=0x7f8168008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:12.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.166+0000 7f816ea00700 1 -- 172.21.15.148:0/166100239 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f816405b6d0 con 0x7f81781038f0 2024-02-28T16:32:12.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.425+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f81781113c0 con 0x7f815c06d900 2024-02-28T16:32:12.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.427+0000 7f816ea00700 1 -- 172.21.15.148:0/166100239 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f81781113c0 con 0x7f815c06d900 2024-02-28T16:32:12.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f815c06d900 msgr2=0x7f815c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f815c06d900 0x7f815c06fdb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8168009b10 tx=0x7f8168008040 comp rx=0 tx=0).stop 2024-02-28T16:32:12.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 msgr2=0x7f8178116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f8178116210 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8164009150 tx=0x7f8164009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:12.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 shutdown_connections 2024-02-28T16:32:12.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f815c06d900 0x7f815c06fdb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8178102f50 0x7f8178115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 --2- 172.21.15.148:0/166100239 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81781038f0 0x7f8178116210 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 >> 172.21.15.148:0/166100239 conn(0x7f81780f8ae0 msgr2=0x7f81780fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:12.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 shutdown_connections 2024-02-28T16:32:12.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.430+0000 7f817da00700 1 -- 172.21.15.148:0/166100239 wait complete. 2024-02-28T16:32:12.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.618+0000 7f3f81c00700 1 -- 172.21.15.148:0/3004232345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 msgr2=0x7f3f7c0fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.618+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3004232345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c0fcd50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3f68004940 tx=0x7f3f68009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.618+0000 7f3f81c00700 1 -- 172.21.15.148:0/3004232345 shutdown_connections 2024-02-28T16:32:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.618+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3004232345 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c0fcd50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.618+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3004232345 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f7c102d40 0x7f3f7c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.618+0000 7f3f81c00700 1 -- 172.21.15.148:0/3004232345 >> 172.21.15.148:0/3004232345 conn(0x7f3f7c0f88b0 msgr2=0x7f3f7c0facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.619+0000 7f3f81c00700 1 -- 172.21.15.148:0/3004232345 shutdown_connections 2024-02-28T16:32:12.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.619+0000 7f3f81c00700 1 -- 172.21.15.148:0/3004232345 wait complete. 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.619+0000 7f3f81c00700 1 Processor -- start 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f81c00700 1 -- start start 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f81c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f7c102d40 0x7f3f7c1138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f81c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c113e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f81c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c114450 con 0x7f3f7c1036e0 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f81c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c10d780 con 0x7f3f7c102d40 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f7b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c113e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:12.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f7b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c113e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33786/0 (socket says 172.21.15.148:33786) 2024-02-28T16:32:12.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.620+0000 7f3f7b400700 1 -- 172.21.15.148:0/3851145663 learned_addr learned my addr 172.21.15.148:0/3851145663 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.621+0000 7f3f7be00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f7c102d40 0x7f3f7c1138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.621+0000 7f3f7b400700 1 -- 172.21.15.148:0/3851145663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f7c102d40 msgr2=0x7f3f7c1138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.621+0000 7f3f7b400700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f7c102d40 0x7f3f7c1138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.621+0000 7f3f7b400700 1 -- 172.21.15.148:0/3851145663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68005040 con 0x7f3f7c1036e0 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.621+0000 7f3f7b400700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c113e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009150 tx=0x7f3f68009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.622+0000 7f3f73e00700 1 -- 172.21.15.148:0/3851145663 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f6800e040 con 0x7f3f7c1036e0 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.622+0000 7f3f73e00700 1 -- 172.21.15.148:0/3851145663 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f6800bbf0 con 0x7f3f7c1036e0 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.622+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c10da00 con 0x7f3f7c1036e0 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.622+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c10df40 con 0x7f3f7c1036e0 2024-02-28T16:32:12.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.622+0000 7f3f73e00700 1 -- 172.21.15.148:0/3851145663 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f68013ea0 con 0x7f3f7c1036e0 2024-02-28T16:32:12.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.623+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c105210 con 0x7f3f7c1036e0 2024-02-28T16:32:12.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.624+0000 7f3f73e00700 1 -- 172.21.15.148:0/3851145663 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f3f6800bd60 con 0x7f3f7c1036e0 2024-02-28T16:32:12.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.625+0000 7f3f73e00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3f6006d900 0x7f3f6006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:12.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.625+0000 7f3f73e00700 1 -- 172.21.15.148:0/3851145663 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3f6808e4f0 con 0x7f3f7c1036e0 2024-02-28T16:32:12.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.626+0000 7f3f7be00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3f6006d900 0x7f3f6006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:12.615 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.626+0000 7f3f7be00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3f6006d900 0x7f3f6006fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c004d60 tx=0x7f3f6c00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:12.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.631+0000 7f3f73e00700 1 -- 172.21.15.148:0/3851145663 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3f6805b680 con 0x7f3f7c1036e0 2024-02-28T16:32:12.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.904+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f7c109e20 con 0x7f3f6006d900 2024-02-28T16:32:12.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.934+0000 7f3f73e00700 1 -- 172.21.15.148:0/3851145663 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3f7c109e20 con 0x7f3f6006d900 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (2m) 7s ago 17m 14.4M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (18m) 7s ago 18m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (16m) 10s ago 16m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (101s) 7s ago 17m 74.3M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (9m) 7s ago 9m 14.2M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (9m) 7s ago 9m 146M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (9m) 10s ago 9m 13.9M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:32:12.923 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (9m) 10s ago 9m 14.0M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (4m) 7s ago 19m 476M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (3m) 10s ago 15m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (25s) 7s ago 19m 28.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (15m) 10s ago 15m 46.4M 2048M 17.2.7-535-gc0f02e60 1c37ed371348 b959330f9a43 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (3m) 7s ago 17m 7700k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (3m) 10s ago 15m 7415k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (14m) 7s ago 14m 207M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (14m) 7s ago 14m 211M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (13m) 7s ago 13m 181M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (12m) 10s ago 12m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (12m) 10s ago 12m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (11m) 10s ago 11m 192M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:32:12.924 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (2m) 7s ago 16m 49.6M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:32:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3f6006d900 msgr2=0x7f3f6006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3f6006d900 0x7f3f6006fdb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c004d60 tx=0x7f3f6c00b040 comp rx=0 tx=0).stop 2024-02-28T16:32:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 msgr2=0x7f3f7c113e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c113e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3f68009150 tx=0x7f3f68009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 shutdown_connections 2024-02-28T16:32:12.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3f6006d900 0x7f3f6006fdb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f7c102d40 0x7f3f7c1138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 --2- 172.21.15.148:0/3851145663 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3f7c1036e0 0x7f3f7c113e00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:12.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.937+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 >> 172.21.15.148:0/3851145663 conn(0x7f3f7c0f88b0 msgr2=0x7f3f7c0fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:12.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.938+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 shutdown_connections 2024-02-28T16:32:12.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:12.938+0000 7f3f81c00700 1 -- 172.21.15.148:0/3851145663 wait complete. 2024-02-28T16:32:12.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:12 smithi148 ceph-mon[112463]: pgmap v10: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-28T16:32:12.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.083+0000 7f58d5000700 1 -- 172.21.15.148:0/1019645330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d0102f50 msgr2=0x7f58d0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.083+0000 7f58d5000700 1 --2- 172.21.15.148:0/1019645330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d0102f50 0x7f58d0103320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f58c0004940 tx=0x7f58c0009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.084+0000 7f58d5000700 1 -- 172.21.15.148:0/1019645330 shutdown_connections 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.084+0000 7f58d5000700 1 --2- 172.21.15.148:0/1019645330 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d01038f0 0x7f58d00fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.084+0000 7f58d5000700 1 --2- 172.21.15.148:0/1019645330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d0102f50 0x7f58d0103320 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.084+0000 7f58d5000700 1 -- 172.21.15.148:0/1019645330 >> 172.21.15.148:0/1019645330 conn(0x7f58d00f8ae0 msgr2=0x7f58d00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.084+0000 7f58d5000700 1 -- 172.21.15.148:0/1019645330 shutdown_connections 2024-02-28T16:32:13.073 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.084+0000 7f58d5000700 1 -- 172.21.15.148:0/1019645330 wait complete. 2024-02-28T16:32:13.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.084+0000 7f58d5000700 1 Processor -- start 2024-02-28T16:32:13.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58d5000700 1 -- start start 2024-02-28T16:32:13.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58d5000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d0102f50 0x7f58d0115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58d5000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d01038f0 0x7f58d01161b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58d5000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0116890 con 0x7f58d01038f0 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58d5000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d010fb30 con 0x7f58d0102f50 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58cd400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d01038f0 0x7f58d01161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58cd400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d01038f0 0x7f58d01161b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33796/0 (socket says 172.21.15.148:33796) 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.085+0000 7f58cd400700 1 -- 172.21.15.148:0/3362270155 learned_addr learned my addr 172.21.15.148:0/3362270155 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58cde00700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d0102f50 0x7f58d0115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58cd400700 1 -- 172.21.15.148:0/3362270155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d0102f50 msgr2=0x7f58d0115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58cd400700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d0102f50 0x7f58d0115c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58cd400700 1 -- 172.21.15.148:0/3362270155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c0005040 con 0x7f58d01038f0 2024-02-28T16:32:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58cd400700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d01038f0 0x7f58d01161b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00b790 tx=0x7f58bc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58c6000700 1 -- 172.21.15.148:0/3362270155 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58bc00f6f0 con 0x7f58d01038f0 2024-02-28T16:32:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58c6000700 1 -- 172.21.15.148:0/3362270155 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58bc00fd20 con 0x7f58d01038f0 2024-02-28T16:32:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58c6000700 1 -- 172.21.15.148:0/3362270155 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58bc0103a0 con 0x7f58d01038f0 2024-02-28T16:32:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.086+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d010fe10 con 0x7f58d01038f0 2024-02-28T16:32:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.087+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d0110350 con 0x7f58d01038f0 2024-02-28T16:32:13.076 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.088+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d00fc6e0 con 0x7f58d01038f0 2024-02-28T16:32:13.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.089+0000 7f58c6000700 1 -- 172.21.15.148:0/3362270155 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f58bc011400 con 0x7f58d01038f0 2024-02-28T16:32:13.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.090+0000 7f58c6000700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f58b406d900 0x7f58b406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.090+0000 7f58c6000700 1 -- 172.21.15.148:0/3362270155 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f58bc08cef0 con 0x7f58d01038f0 2024-02-28T16:32:13.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.090+0000 7f58cde00700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f58b406d900 0x7f58b406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.091+0000 7f58cde00700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f58b406d900 0x7f58b406fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58c000b3b0 tx=0x7f58c0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:13.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.095+0000 7f58c6000700 1 -- 172.21.15.148:0/3362270155 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f58bc05a110 con 0x7f58d01038f0 2024-02-28T16:32:13.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:12 smithi157 ceph-mon[38346]: pgmap v10: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-28T16:32:13.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:12 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:13.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.385+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f58d0111280 con 0x7f58d01038f0 2024-02-28T16:32:13.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.386+0000 7f58c6000700 1 -- 172.21.15.148:0/3362270155 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f58bc059ca0 con 0x7f58d01038f0 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:32:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 11, 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:32:13.377 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:32:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f58b406d900 msgr2=0x7f58b406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f58b406d900 0x7f58b406fdb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58c000b3b0 tx=0x7f58c0009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d01038f0 msgr2=0x7f58d01161b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d01038f0 0x7f58d01161b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00b790 tx=0x7f58bc009220 comp rx=0 tx=0).stop 2024-02-28T16:32:13.378 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 shutdown_connections 2024-02-28T16:32:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f58b406d900 0x7f58b406fdb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f58d0102f50 0x7f58d0115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 --2- 172.21.15.148:0/3362270155 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58d01038f0 0x7f58d01161b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 >> 172.21.15.148:0/3362270155 conn(0x7f58d00f8ae0 msgr2=0x7f58d00fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 shutdown_connections 2024-02-28T16:32:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.389+0000 7f58d5000700 1 -- 172.21.15.148:0/3362270155 wait complete. 2024-02-28T16:32:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 -- 172.21.15.148:0/3890587240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f4102d40 msgr2=0x7fd5f4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/3890587240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f4102d40 0x7fd5f4103110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4004940 tx=0x7fd5e4009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 -- 172.21.15.148:0/3890587240 shutdown_connections 2024-02-28T16:32:13.526 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/3890587240 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f41036e0 0x7fd5f40fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/3890587240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f4102d40 0x7fd5f4103110 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 -- 172.21.15.148:0/3890587240 >> 172.21.15.148:0/3890587240 conn(0x7fd5f40f88b0 msgr2=0x7fd5f40facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 -- 172.21.15.148:0/3890587240 shutdown_connections 2024-02-28T16:32:13.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.537+0000 7fd5f3e00700 1 -- 172.21.15.148:0/3890587240 wait complete. 2024-02-28T16:32:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.538+0000 7fd5f3e00700 1 Processor -- start 2024-02-28T16:32:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.538+0000 7fd5f3e00700 1 -- start start 2024-02-28T16:32:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.538+0000 7fd5f3e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f4102d40 0x7fd5f4115a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.538+0000 7fd5f3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f41036e0 0x7fd5f4115fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.538+0000 7fd5f3e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f4116680 con 0x7fd5f41036e0 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.538+0000 7fd5f3e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f410f920 con 0x7fd5f4102d40 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f41036e0 0x7fd5f4115fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f41036e0 0x7fd5f4115fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33822/0 (socket says 172.21.15.148:33822) 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2000700 1 -- 172.21.15.148:0/4119732443 learned_addr learned my addr 172.21.15.148:0/4119732443 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2a00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f4102d40 0x7fd5f4115a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2000700 1 -- 172.21.15.148:0/4119732443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f4102d40 msgr2=0x7fd5f4115a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2000700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f4102d40 0x7fd5f4115a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2000700 1 -- 172.21.15.148:0/4119732443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e4005040 con 0x7fd5f41036e0 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.539+0000 7fd5f2a00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f4102d40 0x7fd5f4115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.540+0000 7fd5f2000700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f41036e0 0x7fd5f4115fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00b790 tx=0x7fd5dc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:13.530 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.540+0000 7fd5eaa00700 1 -- 172.21.15.148:0/4119732443 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc00f6f0 con 0x7fd5f41036e0 2024-02-28T16:32:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.540+0000 7fd5eaa00700 1 -- 172.21.15.148:0/4119732443 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5dc00fd20 con 0x7fd5f41036e0 2024-02-28T16:32:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.540+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f410fc00 con 0x7fd5f41036e0 2024-02-28T16:32:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.540+0000 7fd5eaa00700 1 -- 172.21.15.148:0/4119732443 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc0103a0 con 0x7fd5f41036e0 2024-02-28T16:32:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.540+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f4110140 con 0x7fd5f41036e0 2024-02-28T16:32:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.541+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f405f5c0 con 0x7fd5f41036e0 2024-02-28T16:32:13.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.542+0000 7fd5eaa00700 1 -- 172.21.15.148:0/4119732443 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fd5dc011400 con 0x7fd5f41036e0 2024-02-28T16:32:13.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.544+0000 7fd5eaa00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd5d806d900 0x7fd5d806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.544+0000 7fd5eaa00700 1 -- 172.21.15.148:0/4119732443 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd5dc08ce50 con 0x7fd5f41036e0 2024-02-28T16:32:13.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.544+0000 7fd5f2a00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd5d806d900 0x7fd5d806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.545+0000 7fd5f2a00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd5d806d900 0x7fd5d806fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400b3b0 tx=0x7fd5e4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:13.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.549+0000 7fd5eaa00700 1 -- 172.21.15.148:0/4119732443 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd5dc05a110 con 0x7fd5f41036e0 2024-02-28T16:32:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.826+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd5f4111040 con 0x7fd5f41036e0 2024-02-28T16:32:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.826+0000 7fd5eaa00700 1 -- 172.21.15.148:0/4119732443 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7fd5dc059ca0 con 0x7fd5f41036e0 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:32:13.816 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:32:13.817 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:13.818 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:13.819 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:13.819 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:13.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd5d806d900 msgr2=0x7fd5d806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd5d806d900 0x7fd5d806fdb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400b3b0 tx=0x7fd5e4009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f41036e0 msgr2=0x7fd5f4115fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f41036e0 0x7fd5f4115fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00b790 tx=0x7fd5dc009220 comp rx=0 tx=0).stop 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 shutdown_connections 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd5d806d900 0x7fd5d806fdb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd5f4102d40 0x7fd5f4115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 --2- 172.21.15.148:0/4119732443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5f41036e0 0x7fd5f4115fa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 >> 172.21.15.148:0/4119732443 conn(0x7fd5f40f88b0 msgr2=0x7fd5f4070530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 shutdown_connections 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.829+0000 7fd5f3e00700 1 -- 172.21.15.148:0/4119732443 wait complete. 2024-02-28T16:32:13.820 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 -- 172.21.15.148:0/3430707887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f4070be0 msgr2=0x7fe8f41092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 --2- 172.21.15.148:0/3430707887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f4070be0 0x7fe8f41092c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0004970 tx=0x7fe8e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 -- 172.21.15.148:0/3430707887 shutdown_connections 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 --2- 172.21.15.148:0/3430707887 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f4070be0 0x7fe8f41092c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 --2- 172.21.15.148:0/3430707887 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8f40702d0 0x7fe8f40706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 -- 172.21.15.148:0/3430707887 >> 172.21.15.148:0/3430707887 conn(0x7fe8f40f8ae0 msgr2=0x7fe8f40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 -- 172.21.15.148:0/3430707887 shutdown_connections 2024-02-28T16:32:13.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.974+0000 7fe8fa200700 1 -- 172.21.15.148:0/3430707887 wait complete. 2024-02-28T16:32:13.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.975+0000 7fe8fa200700 1 Processor -- start 2024-02-28T16:32:13.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.975+0000 7fe8fa200700 1 -- start start 2024-02-28T16:32:13.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8fa200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f40702d0 0x7fe8f4115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8fa200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8f4070be0 0x7fe8f4116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8fa200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f41167a0 con 0x7fe8f40702d0 2024-02-28T16:32:13.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8fa200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f410faf0 con 0x7fe8f4070be0 2024-02-28T16:32:13.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8f3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f40702d0 0x7fe8f4115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8f3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f40702d0 0x7fe8f4115c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33828/0 (socket says 172.21.15.148:33828) 2024-02-28T16:32:13.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8f3400700 1 -- 172.21.15.148:0/625466120 learned_addr learned my addr 172.21.15.148:0/625466120 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:13.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.976+0000 7fe8f2a00700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8f4070be0 0x7fe8f4116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8f3400700 1 -- 172.21.15.148:0/625466120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8f4070be0 msgr2=0x7fe8f4116150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:13.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8f3400700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8f4070be0 0x7fe8f4116150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:13.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8f3400700 1 -- 172.21.15.148:0/625466120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e0005040 con 0x7fe8f40702d0 2024-02-28T16:32:13.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8f3400700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f40702d0 0x7fe8f4115c10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400c8c0 tx=0x7fe8e40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:13.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8eb400700 1 -- 172.21.15.148:0/625466120 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e400a760 con 0x7fe8f40702d0 2024-02-28T16:32:13.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8eb400700 1 -- 172.21.15.148:0/625466120 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8e400ad90 con 0x7fe8f40702d0 2024-02-28T16:32:13.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8eb400700 1 -- 172.21.15.148:0/625466120 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8e40113a0 con 0x7fe8f40702d0 2024-02-28T16:32:13.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.977+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f410fdd0 con 0x7fe8f40702d0 2024-02-28T16:32:13.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.978+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f41102e0 con 0x7fe8f40702d0 2024-02-28T16:32:13.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.979+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f4106980 con 0x7fe8f40702d0 2024-02-28T16:32:13.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.980+0000 7fe8eb400700 1 -- 172.21.15.148:0/625466120 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fe8e4012400 con 0x7fe8f40702d0 2024-02-28T16:32:13.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.981+0000 7fe8eb400700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe8d806d900 0x7fe8d806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:13.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.981+0000 7fe8eb400700 1 -- 172.21.15.148:0/625466120 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe8e408cf50 con 0x7fe8f40702d0 2024-02-28T16:32:13.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.981+0000 7fe8f2a00700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe8d806d900 0x7fe8d806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:13.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.982+0000 7fe8f2a00700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe8d806d900 0x7fe8d806fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0004940 tx=0x7fe8e0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:13.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:13.986+0000 7fe8eb400700 1 -- 172.21.15.148:0/625466120 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe8e40c0d20 con 0x7fe8f40702d0 2024-02-28T16:32:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:13 smithi148 ceph-mon[112463]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:13 smithi148 ceph-mon[112463]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:13 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3362270155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:14.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.221+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8f404bed0 con 0x7fe8d806d900 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.222+0000 7fe8eb400700 1 -- 172.21.15.148:0/625466120 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fe8f404bed0 con 0x7fe8d806d900 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr" 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "3/21 daemons upgraded", 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "", 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:32:14.211 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:32:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe8d806d900 msgr2=0x7fe8d806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe8d806d900 0x7fe8d806fdb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0004940 tx=0x7fe8e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f40702d0 msgr2=0x7fe8f4115c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f40702d0 0x7fe8f4115c10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400c8c0 tx=0x7fe8e40044c0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 shutdown_connections 2024-02-28T16:32:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe8d806d900 0x7fe8d806fdb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe8f40702d0 0x7fe8f4115c10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 --2- 172.21.15.148:0/625466120 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe8f4070be0 0x7fe8f4116150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 >> 172.21.15.148:0/625466120 conn(0x7fe8f40f8ae0 msgr2=0x7fe8f4103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.225+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 shutdown_connections 2024-02-28T16:32:14.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.226+0000 7fe8fa200700 1 -- 172.21.15.148:0/625466120 wait complete. 2024-02-28T16:32:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:13 smithi157 ceph-mon[38346]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:13 smithi157 ceph-mon[38346]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:13 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/3362270155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:13 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:13 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:13 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:14.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:13 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:14.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.368+0000 7fa9c2000700 1 -- 172.21.15.148:0/3918507281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc102f50 msgr2=0x7fa9bc103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:14.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.368+0000 7fa9c2000700 1 --2- 172.21.15.148:0/3918507281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc102f50 0x7fa9bc103320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac004940 tx=0x7fa9ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:14.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.368+0000 7fa9c2000700 1 -- 172.21.15.148:0/3918507281 shutdown_connections 2024-02-28T16:32:14.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.368+0000 7fa9c2000700 1 --2- 172.21.15.148:0/3918507281 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9bc1038f0 0x7fa9bc0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.368+0000 7fa9c2000700 1 --2- 172.21.15.148:0/3918507281 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc102f50 0x7fa9bc103320 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.368+0000 7fa9c2000700 1 -- 172.21.15.148:0/3918507281 >> 172.21.15.148:0/3918507281 conn(0x7fa9bc0f8ae0 msgr2=0x7fa9bc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:14.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.369+0000 7fa9c2000700 1 -- 172.21.15.148:0/3918507281 shutdown_connections 2024-02-28T16:32:14.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.369+0000 7fa9c2000700 1 -- 172.21.15.148:0/3918507281 wait complete. 2024-02-28T16:32:14.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.370+0000 7fa9c2000700 1 Processor -- start 2024-02-28T16:32:14.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.370+0000 7fa9c2000700 1 -- start start 2024-02-28T16:32:14.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.370+0000 7fa9c2000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9bc102f50 0x7fa9bc115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:14.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.370+0000 7fa9c2000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc1038f0 0x7fa9bc1161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:14.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.370+0000 7fa9c2000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc116810 con 0x7fa9bc1038f0 2024-02-28T16:32:14.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.370+0000 7fa9c2000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc10fb40 con 0x7fa9bc102f50 2024-02-28T16:32:14.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.370+0000 7fa9baa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc1038f0 0x7fa9bc1161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:14.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.371+0000 7fa9baa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc1038f0 0x7fa9bc1161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33846/0 (socket says 172.21.15.148:33846) 2024-02-28T16:32:14.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.371+0000 7fa9baa00700 1 -- 172.21.15.148:0/2683299661 learned_addr learned my addr 172.21.15.148:0/2683299661 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:14.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.371+0000 7fa9bb400700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9bc102f50 0x7fa9bc115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.371+0000 7fa9baa00700 1 -- 172.21.15.148:0/2683299661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9bc102f50 msgr2=0x7fa9bc115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.371+0000 7fa9baa00700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9bc102f50 0x7fa9bc115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.371+0000 7fa9baa00700 1 -- 172.21.15.148:0/2683299661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ac005040 con 0x7fa9bc1038f0 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.371+0000 7fa9baa00700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc1038f0 0x7fa9bc1161c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8002a50 tx=0x7fa9a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.372+0000 7fa9b3400700 1 -- 172.21.15.148:0/2683299661 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9a8007cc0 con 0x7fa9bc1038f0 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.372+0000 7fa9b3400700 1 -- 172.21.15.148:0/2683299661 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9a800f040 con 0x7fa9bc1038f0 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.372+0000 7fa9b3400700 1 -- 172.21.15.148:0/2683299661 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9a800d9c0 con 0x7fa9bc1038f0 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.372+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc10fe20 con 0x7fa9bc1038f0 2024-02-28T16:32:14.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.372+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc110360 con 0x7fa9bc1038f0 2024-02-28T16:32:14.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.373+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9bc0fc6e0 con 0x7fa9bc1038f0 2024-02-28T16:32:14.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.374+0000 7fa9b3400700 1 -- 172.21.15.148:0/2683299661 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fa9a8009730 con 0x7fa9bc1038f0 2024-02-28T16:32:14.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.375+0000 7fa9b3400700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9a006d900 0x7fa9a006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:14.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.375+0000 7fa9b3400700 1 -- 172.21.15.148:0/2683299661 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa9a808ce20 con 0x7fa9bc1038f0 2024-02-28T16:32:14.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.375+0000 7fa9bb400700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9a006d900 0x7fa9a006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:14.364 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.376+0000 7fa9bb400700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9a006d900 0x7fa9a006fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0043d0 tx=0x7fa9ac009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:14.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.380+0000 7fa9b3400700 1 -- 172.21.15.148:0/2683299661 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa9a8059f30 con 0x7fa9bc1038f0 2024-02-28T16:32:14.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.718+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa9bc10a050 con 0x7fa9bc1038f0 2024-02-28T16:32:14.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.718+0000 7fa9b3400700 1 -- 172.21.15.148:0/2683299661 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fa9a8059ac0 con 0x7fa9bc1038f0 2024-02-28T16:32:14.707 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:14.707 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:14.707 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:32:14.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.720+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9a006d900 msgr2=0x7fa9a006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:14.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9a006d900 0x7fa9a006fdb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0043d0 tx=0x7fa9ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:14.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc1038f0 msgr2=0x7fa9bc1161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc1038f0 0x7fa9bc1161c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8002a50 tx=0x7fa9a8004600 comp rx=0 tx=0).stop 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 shutdown_connections 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9a006d900 0x7fa9a006fdb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9bc102f50 0x7fa9bc115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 --2- 172.21.15.148:0/2683299661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9bc1038f0 0x7fa9bc1161c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 >> 172.21.15.148:0/2683299661 conn(0x7fa9bc0f8ae0 msgr2=0x7fa9bc0fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 shutdown_connections 2024-02-28T16:32:14.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:14.721+0000 7fa9c2000700 1 -- 172.21.15.148:0/2683299661 wait complete. 2024-02-28T16:32:15.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:14 smithi148 ceph-mon[112463]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:15.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:14 smithi148 ceph-mon[112463]: Detected new or changed devices on smithi148 2024-02-28T16:32:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:14 smithi148 ceph-mon[112463]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:32:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:14 smithi148 ceph-mon[112463]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:32:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:14 smithi148 ceph-mon[112463]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-28T16:32:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:14 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4119732443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:14 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2683299661' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:15.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:14 smithi157 ceph-mon[38346]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:15.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:14 smithi157 ceph-mon[38346]: Detected new or changed devices on smithi148 2024-02-28T16:32:15.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:14 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.conf 2024-02-28T16:32:15.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:14 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.conf 2024-02-28T16:32:15.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:14 smithi157 ceph-mon[38346]: pgmap v11: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-28T16:32:15.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:14 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/4119732443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:15.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:14 smithi157 ceph-mon[38346]: from='client.? 172.21.15.148:0/2683299661' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:16.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:15 smithi148 ceph-mon[112463]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:32:16.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:15 smithi148 ceph-mon[112463]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:16.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:15 smithi148 ceph-mon[112463]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:32:16.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:15 smithi148 ceph-mon[112463]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:32:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:15 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:32:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:15 smithi157 ceph-mon[38346]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:15 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T16:32:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:15 smithi157 ceph-mon[38346]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:32:17.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:32:17.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:32:17.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-28T16:32:17.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:32:17.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.027 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.027 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.027 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: Updating smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: pgmap v12: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: Updating smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:16 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:18.033 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:17 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:18.034 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:17 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:18.034 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:17 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:32:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T16:32:19.092 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:18 smithi157 ceph-mon[38346]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:19.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:18 smithi148 ceph-mon[112463]: pgmap v13: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:20.358 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:20 smithi157 ceph-mon[38346]: Upgrade: Updating mon.smithi157 2024-02-28T16:32:20.358 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:20 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:20.358 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:20 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:32:20.358 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:20 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:32:20.358 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:20 smithi157 ceph-mon[38346]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:20.358 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:20 smithi157 ceph-mon[38346]: Deploying daemon mon.smithi157 on smithi157 2024-02-28T16:32:20.359 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:20 smithi157 ceph-mon[38346]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:20 smithi148 ceph-mon[112463]: Upgrade: Updating mon.smithi157 2024-02-28T16:32:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:32:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:32:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:20 smithi148 ceph-mon[112463]: Deploying daemon mon.smithi157 on smithi157 2024-02-28T16:32:20.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:20 smithi148 ceph-mon[112463]: pgmap v14: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:22.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:21 smithi157 systemd[1]: Stopping Ceph mon.smithi157 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:32:22.643 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:22 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157[38334]: 2024-02-28T16:32:22.246+0000 7f3cfe800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi157 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:32:22.643 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:22 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157[38334]: 2024-02-28T16:32:22.246+0000 7f3cfe800700 -1 mon.smithi157@1(peon) e2 *** Got Signal Terminated *** 2024-02-28T16:32:22.643 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:22 smithi157 podman[89163]: 2024-02-28 16:32:22.340366271 +0000 UTC m=+0.234298636 container died b959330f9a4318a46bc6b0501d5a6b921752cb9a75b9196e3768c7634b9550f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-c0f02e6, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-28T16:32:22.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:22 smithi157 podman[89163]: 2024-02-28 16:32:22.765200831 +0000 UTC m=+0.659133213 container cleanup b959330f9a4318a46bc6b0501d5a6b921752cb9a75b9196e3768c7634b9550f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c0f02e6, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:32:22.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:22 smithi157 bash[89163]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157 2024-02-28T16:32:23.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:22 smithi157 podman[89177]: 2024-02-28 16:32:22.997837051 +0000 UTC m=+0.640293874 container remove b959330f9a4318a46bc6b0501d5a6b921752cb9a75b9196e3768c7634b9550f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-28T16:32:23.910 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:23 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi157.service: Deactivated successfully. 2024-02-28T16:32:23.910 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:23 smithi157 systemd[1]: Stopped Ceph mon.smithi157 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:32:23.910 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:23 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi157.service: Consumed 20.465s CPU time. 2024-02-28T16:32:24.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:23 smithi157 systemd[1]: Starting Ceph mon.smithi157 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:32:24.631 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 podman[89310]: 2024-02-28 16:32:24.167593003 +0000 UTC m=+0.032297657 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:32:24.631 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 podman[89310]: 2024-02-28 16:32:24.325744775 +0000 UTC m=+0.190449464 container create d8fb0fa2111ff76bc738457aea7679e7483767ea3287e7d3dba0f2039fdb0060 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10) 2024-02-28T16:32:24.631 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 podman[89310]: 2024-02-28 16:32:24.642729521 +0000 UTC m=+0.507434257 container init d8fb0fa2111ff76bc738457aea7679e7483767ea3287e7d3dba0f2039fdb0060 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_CLEAN=True) 2024-02-28T16:32:24.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 podman[89310]: 2024-02-28 16:32:24.653054064 +0000 UTC m=+0.517758760 container start d8fb0fa2111ff76bc738457aea7679e7483767ea3287e7d3dba0f2039fdb0060 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10) 2024-02-28T16:32:24.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: pidfile_write: ignore empty --pid-file 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: load: jerasure load: lrc 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: RocksDB version: 7.9.2 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Git sha 0 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: DB SUMMARY 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: DB Session ID: ZFFHLUT6CCVF5JLDZFNB 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: CURRENT file: CURRENT 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1869 Bytes 2024-02-28T16:32:24.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi157/store.db dir, Total Num: 1, files: 000039.sst 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi157/store.db: 000037.log size: 2804999 ; 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.error_if_exists: 0 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.create_if_missing: 0 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.paranoid_checks: 1 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.env: 0x560a00d53b20 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.info_log: 0x560a019217c0 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.statistics: (nil) 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.use_fsync: 0 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_log_file_size: 0 2024-02-28T16:32:24.990 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T16:32:24.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T16:32:24.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T16:32:24.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T16:32:24.991 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.allow_fallocate: 1 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.use_direct_reads: 0 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.db_log_dir: 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.wal_dir: 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T16:32:24.992 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T16:32:24.993 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T16:32:24.993 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T16:32:24.993 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T16:32:24.993 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.write_buffer_manager: 0x560a018f5400 2024-02-28T16:32:24.993 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.unordered_write: 0 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T16:32:24.994 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.row_cache: None 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.wal_filter: None 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.two_write_queues: 0 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.wal_compression: 0 2024-02-28T16:32:24.995 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.atomic_flush: 0 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.log_readahead_size: 0 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T16:32:24.996 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_background_jobs: 2 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_background_compactions: -1 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_subcompactions: 1 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_open_files: -1 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T16:32:24.997 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_background_flushes: -1 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Compression algorithms supported: 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kZSTD supported: 0 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kXpressCompression supported: 0 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kZlibCompression supported: 1 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kSnappyCompression supported: 1 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kLZ4Compression supported: 1 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: kBZip2Compression supported: 0 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T16:32:24.998 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000009 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.merge_operator: 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_filter: None 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T16:32:24.999 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560a019218e0) 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks: 1 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: pin_top_level_index_and_filter: 1 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_type: 0 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_index_type: 0 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_shortening: 1 2024-02-28T16:32:25.000 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: checksum: 4 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: no_block_cache: 0 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache: 0x560a01925090 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_name: BinnedLRUCache 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_options: 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: capacity : 536870912 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: num_shard_bits : 4 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: strict_capacity_limit : 0 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: high_pri_pool_ratio: 0.000 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_cache_compressed: (nil) 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: persistent_cache: (nil) 2024-02-28T16:32:25.001 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size: 4096 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_size_deviation: 10 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_restart_interval: 16 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: index_block_restart_interval: 1 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: metadata_block_size: 4096 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: partition_filters: 0 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: use_delta_encoding: 1 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: filter_policy: bloomfilter 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: whole_key_filtering: 1 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: verify_compression: 0 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: read_amp_bytes_per_bit: 0 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: format_version: 5 2024-02-28T16:32:25.002 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_index_compression: 1 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: block_align: 0 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_auto_readahead_size: 262144 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: prepopulate_block_cache: 0 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: initial_auto_readahead_size: 8192 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression: NoCompression 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.num_levels: 7 2024-02-28T16:32:25.003 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T16:32:25.005 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T16:32:25.006 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T16:32:25.007 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T16:32:25.008 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T16:32:25.009 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.table_properties_collectors: 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.inplace_update_support: 0 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T16:32:25.010 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.bloom_locality: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.max_successive_merges: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.ttl: 2592000 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.enable_blob_files: false 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.min_blob_size: 0 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T16:32:25.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 39.sst 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi157/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 41, last_sequence is 19676, log_number is 37,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 37 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ed3120bf-6a1e-4b4d-9346-ec2133ebae98 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137944712182, "job": 1, "event": "recovery_started", "wal_files": [37]} 2024-02-28T16:32:25.012 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #37 mode 2 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137944728491, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 42, "file_size": 1783235, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 19681, "largest_seqno": 20360, "table_properties": {"data_size": 1779355, "index_size": 2034, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 837, "raw_key_size": 7542, "raw_average_key_size": 24, "raw_value_size": 1772461, "raw_average_value_size": 5644, "num_data_blocks": 94, "num_entries": 314, "num_filter_entries": 314, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709137944, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ed3120bf-6a1e-4b4d-9346-ec2133ebae98", "db_session_id": "ZFFHLUT6CCVF5JLDZFNB", "orig_file_number": 42, "seqno_to_time_mapping": "N/A"}} 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709137944728683, "job": 1, "event": "recovery_finished"} 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/version_set.cc:5047] Creating manifest 44 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi157/store.db/000037.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560a01a14000 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: DB pointer 0x560a01a00000 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** DB Stats ** 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:32:25.013 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T16:32:25.014 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L0 1/0 1.70 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: L6 1/0 6.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Sum 2/0 8.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** Compaction Stats [default] ** 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 361.5 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T16:32:25.015 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Cumulative compaction: 0.00 GB write, 75.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Interval compaction: 0.00 GB write, 75.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Block cache BinnedLRUCache@0x560a01925090#2 capacity: 512.00 MB usage: 2.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2024-02-28T16:32:25.016 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.91 KB,0.000172853%) IndexBlock(1,2.08 KB,0.000396371%) Misc(1,0.00 KB,0%) 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: starting mon.smithi157 rank 1 at public addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] at bind addrs [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi157 fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???) e2 preinit fsid 004ac12e-d654-11ee-95c3-87774f69a715 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???).mds e14 new map 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???).mds e14 print_map 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: e14 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: legacy client fscid: 1 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.017 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Filesystem 'cephfs' (1) 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: fs_name cephfs 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: epoch 14 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: tableserver 0 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: root 0 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: session_timeout 60 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: session_autoclose 300 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_file_size 1099511627776 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_xattr_size 65536 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: required_client_features {} 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: last_failure 0 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: last_failure_osd_epoch 46 2024-02-28T16:32:25.018 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: max_mds 1 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: in 0 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: up {0=14484} 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: failed 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: damaged 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: stopped 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: data_pools [3] 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: metadata_pool 2 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: inline_data enabled 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: balancer 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: bal_rank_mask -1 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: standby_count_wanted 1 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:25.019 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: Standby daemons: 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout: [mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 ceph-mon[89328]: mon.smithi157@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 bash[89310]: d8fb0fa2111ff76bc738457aea7679e7483767ea3287e7d3dba0f2039fdb0060 2024-02-28T16:32:25.020 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:24 smithi157 systemd[1]: Started Ceph mon.smithi157 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:32:25.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:25 smithi157 ceph-mon[89328]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:26.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:25 smithi148 ceph-mon[112463]: pgmap v15: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:26.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: mon.smithi148 calling monitor election 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: mon.smithi157 calling monitor election 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: mon.smithi148 is new leader, mons smithi148,smithi157 in quorum (ranks 0,1) 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: monmap e3: 2 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: mgrmap e39: smithi148.gelspy(active, since 28s), standbys: smithi157.cmcxzj 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:32:26.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:26.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:26.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:26 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:27.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: pgmap v17: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:27.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi148"}]: dispatch 2024-02-28T16:32:27.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: mon.smithi148 calling monitor election 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: mon.smithi157 calling monitor election 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mon metadata", "id": "smithi157"}]: dispatch 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: mon.smithi148 is new leader, mons smithi148,smithi157 in quorum (ranks 0,1) 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: monmap e3: 2 mons at {smithi148=[v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0],smithi157=[v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: mgrmap e39: smithi148.gelspy(active, since 28s), standbys: smithi157.cmcxzj 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:27.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:26 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:32:27.955 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:28.100 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:28.955 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:28 smithi157 ceph-mon[89328]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:28 smithi148 ceph-mon[112463]: pgmap v18: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:30 smithi157 ceph-mon[89328]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:30 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:30 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:31.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:30 smithi148 ceph-mon[112463]: pgmap v19: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:31.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:30 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:31.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:30 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:32 smithi148 ceph-mon[112463]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:33.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:32 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:33.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:32 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:33.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:32 smithi157 ceph-mon[89328]: pgmap v20: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:33.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:32 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:33.144 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:32 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:34.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:34 smithi148 ceph-mon[112463]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:34.433 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:34 smithi157 ceph-mon[89328]: pgmap v21: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:36.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:36 smithi157 ceph-mon[89328]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:37.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:36 smithi148 ceph-mon[112463]: pgmap v22: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:32:38.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: pgmap v23: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:32:39.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:39.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:39 smithi148 ceph-mon[112463]: Reconfiguring mon.smithi148 (monmap changed)... 2024-02-28T16:32:39.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:39 smithi148 ceph-mon[112463]: Reconfiguring daemon mon.smithi148 on smithi148 2024-02-28T16:32:39.905 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:39 smithi157 ceph-mon[89328]: Reconfiguring mon.smithi148 (monmap changed)... 2024-02-28T16:32:39.906 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:39 smithi157 ceph-mon[89328]: Reconfiguring daemon mon.smithi148 on smithi148 2024-02-28T16:32:40.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:40 smithi157 ceph-mon[89328]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:40 smithi148 ceph-mon[112463]: pgmap v24: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:41.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:41.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:41.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:41 smithi148 ceph-mon[112463]: Reconfiguring mgr.smithi148.gelspy (monmap changed)... 2024-02-28T16:32:41.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:32:41.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:32:41.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:41.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:41 smithi148 ceph-mon[112463]: Reconfiguring daemon mgr.smithi148.gelspy on smithi148 2024-02-28T16:32:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:41 smithi157 ceph-mon[89328]: Reconfiguring mgr.smithi148.gelspy (monmap changed)... 2024-02-28T16:32:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi148.gelspy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:32:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:32:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:41.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:41 smithi157 ceph-mon[89328]: Reconfiguring daemon mgr.smithi148.gelspy on smithi148 2024-02-28T16:32:42.737 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:42 smithi148 ceph-mon[112463]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:42.737 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:42.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:42 smithi157 ceph-mon[89328]: pgmap v25: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:42.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:44.028 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:44.028 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:44.028 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:43 smithi148 ceph-mon[112463]: Reconfiguring crash.smithi148 (monmap changed)... 2024-02-28T16:32:44.029 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:32:44.029 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:44.029 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:43 smithi148 ceph-mon[112463]: Reconfiguring daemon crash.smithi148 on smithi148 2024-02-28T16:32:44.029 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:43 smithi148 ceph-mon[112463]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:43 smithi157 ceph-mon[89328]: Reconfiguring crash.smithi148 (monmap changed)... 2024-02-28T16:32:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:32:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:44.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:43 smithi157 ceph-mon[89328]: Reconfiguring daemon crash.smithi148 on smithi148 2024-02-28T16:32:44.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:43 smithi157 ceph-mon[89328]: pgmap v26: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:44.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 -- 172.21.15.148:0/1167952542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 msgr2=0x7fc8900fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:44.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 --2- 172.21.15.148:0/1167952542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc8900fb9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc87c004940 tx=0x7fc87c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:44.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 -- 172.21.15.148:0/1167952542 shutdown_connections 2024-02-28T16:32:44.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 --2- 172.21.15.148:0/1167952542 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc8900fb9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:44.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 --2- 172.21.15.148:0/1167952542 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc890103140 0x7fc890103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:44.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 -- 172.21.15.148:0/1167952542 >> 172.21.15.148:0/1167952542 conn(0x7fc890071560 msgr2=0x7fc890071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:44.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 -- 172.21.15.148:0/1167952542 shutdown_connections 2024-02-28T16:32:44.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.884+0000 7fc895400700 1 -- 172.21.15.148:0/1167952542 wait complete. 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.885+0000 7fc895400700 1 Processor -- start 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.885+0000 7fc895400700 1 -- start start 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.885+0000 7fc895400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc890115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc895400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc890103140 0x7fc890116270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc895400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901168c0 con 0x7fc8900fb570 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc895400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89010fc10 con 0x7fc890103140 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc88e800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc890115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc88e800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc890115d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56556/0 (socket says 172.21.15.148:56556) 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc88e800700 1 -- 172.21.15.148:0/1014338670 learned_addr learned my addr 172.21.15.148:0/1014338670 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc88de00700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc890103140 0x7fc890116270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc88e800700 1 -- 172.21.15.148:0/1014338670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc890103140 msgr2=0x7fc890116270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:44.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc88e800700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc890103140 0x7fc890116270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.886+0000 7fc88e800700 1 -- 172.21.15.148:0/1014338670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c005040 con 0x7fc8900fb570 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.887+0000 7fc88e800700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc890115d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc88000eb40 tx=0x7fc88000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.887+0000 7fc886a00700 1 -- 172.21.15.148:0/1014338670 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc880007cc0 con 0x7fc8900fb570 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.887+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89010fe90 con 0x7fc8900fb570 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.887+0000 7fc886a00700 1 -- 172.21.15.148:0/1014338670 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc88000f040 con 0x7fc8900fb570 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.887+0000 7fc886a00700 1 -- 172.21.15.148:0/1014338670 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc880009620 con 0x7fc8900fb570 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.887+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8901103d0 con 0x7fc8900fb570 2024-02-28T16:32:44.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.888+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc890073080 con 0x7fc8900fb570 2024-02-28T16:32:44.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.889+0000 7fc886a00700 1 -- 172.21.15.148:0/1014338670 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fc880009780 con 0x7fc8900fb570 2024-02-28T16:32:44.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.890+0000 7fc886a00700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc87406d900 0x7fc87406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:44.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.890+0000 7fc886a00700 1 -- 172.21.15.148:0/1014338670 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc88008cda0 con 0x7fc8900fb570 2024-02-28T16:32:44.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.891+0000 7fc88de00700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc87406d900 0x7fc87406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:44.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.891+0000 7fc88de00700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc87406d900 0x7fc87406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc87c000c00 tx=0x7fc87c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:44.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:44.896+0000 7fc886a00700 1 -- 172.21.15.148:0/1014338670 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc8800564d0 con 0x7fc8900fb570 2024-02-28T16:32:45.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.135+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc890111350 con 0x7fc87406d900 2024-02-28T16:32:45.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.138+0000 7fc886a00700 1 -- 172.21.15.148:0/1014338670 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc890111350 con 0x7fc87406d900 2024-02-28T16:32:45.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc87406d900 msgr2=0x7fc87406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc87406d900 0x7fc87406fdb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc87c000c00 tx=0x7fc87c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 msgr2=0x7fc890115d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc890115d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc88000eb40 tx=0x7fc88000b040 comp rx=0 tx=0).stop 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 shutdown_connections 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc87406d900 0x7fc87406fdb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8900fb570 0x7fc890115d30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 --2- 172.21.15.148:0/1014338670 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc890103140 0x7fc890116270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 >> 172.21.15.148:0/1014338670 conn(0x7fc890071560 msgr2=0x7fc8900f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 shutdown_connections 2024-02-28T16:32:45.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.142+0000 7fc895400700 1 -- 172.21.15.148:0/1014338670 wait complete. 2024-02-28T16:32:45.147 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 -- 172.21.15.148:0/2132785987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2801038f0 msgr2=0x7fa2800fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 --2- 172.21.15.148:0/2132785987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2801038f0 0x7fa2800fcf60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa26c004940 tx=0x7fa26c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 -- 172.21.15.148:0/2132785987 shutdown_connections 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 --2- 172.21.15.148:0/2132785987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2801038f0 0x7fa2800fcf60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 --2- 172.21.15.148:0/2132785987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa280102f50 0x7fa280103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 -- 172.21.15.148:0/2132785987 >> 172.21.15.148:0/2132785987 conn(0x7fa2800f8ae0 msgr2=0x7fa2800faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 -- 172.21.15.148:0/2132785987 shutdown_connections 2024-02-28T16:32:45.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.306+0000 7fa288400700 1 -- 172.21.15.148:0/2132785987 wait complete. 2024-02-28T16:32:45.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.307+0000 7fa288400700 1 Processor -- start 2024-02-28T16:32:45.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.307+0000 7fa288400700 1 -- start start 2024-02-28T16:32:45.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.308+0000 7fa288400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa280102f50 0x7fa280115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:45.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.308+0000 7fa288400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2801038f0 0x7fa2801161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:45.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.308+0000 7fa288400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa280116840 con 0x7fa280102f50 2024-02-28T16:32:45.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.308+0000 7fa288400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28010fb50 con 0x7fa2801038f0 2024-02-28T16:32:45.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.308+0000 7fa285a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa280102f50 0x7fa280115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:45.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.308+0000 7fa285a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa280102f50 0x7fa280115cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56572/0 (socket says 172.21.15.148:56572) 2024-02-28T16:32:45.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.308+0000 7fa285a00700 1 -- 172.21.15.148:0/3368389112 learned_addr learned my addr 172.21.15.148:0/3368389112 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:45.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa285000700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2801038f0 0x7fa2801161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:45.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa285a00700 1 -- 172.21.15.148:0/3368389112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2801038f0 msgr2=0x7fa2801161f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa285a00700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2801038f0 0x7fa2801161f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa285a00700 1 -- 172.21.15.148:0/3368389112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c005040 con 0x7fa280102f50 2024-02-28T16:32:45.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa285a00700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa280102f50 0x7fa280115cb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa270001d80 tx=0x7fa270009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:45.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa27d600700 1 -- 172.21.15.148:0/3368389112 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa270007d10 con 0x7fa280102f50 2024-02-28T16:32:45.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa27d600700 1 -- 172.21.15.148:0/3368389112 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa270007e70 con 0x7fa280102f50 2024-02-28T16:32:45.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa27d600700 1 -- 172.21.15.148:0/3368389112 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa270014640 con 0x7fa280102f50 2024-02-28T16:32:45.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.309+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28010fe30 con 0x7fa280102f50 2024-02-28T16:32:45.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.310+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa280110370 con 0x7fa280102f50 2024-02-28T16:32:45.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.311+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2800fc6e0 con 0x7fa280102f50 2024-02-28T16:32:45.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.312+0000 7fa27d600700 1 -- 172.21.15.148:0/3368389112 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fa27000e960 con 0x7fa280102f50 2024-02-28T16:32:45.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.313+0000 7fa27d600700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa26406d900 0x7fa26406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:45.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.313+0000 7fa27d600700 1 -- 172.21.15.148:0/3368389112 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa27008cd50 con 0x7fa280102f50 2024-02-28T16:32:45.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.313+0000 7fa285000700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa26406d900 0x7fa26406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:45.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.314+0000 7fa285000700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa26406d900 0x7fa26406fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa280111550 tx=0x7fa26c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:45.306 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.318+0000 7fa27d600700 1 -- 172.21.15.148:0/3368389112 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa27005a140 con 0x7fa280102f50 2024-02-28T16:32:45.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.561+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2801113a0 con 0x7fa26406d900 2024-02-28T16:32:45.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.563+0000 7fa27d600700 1 -- 172.21.15.148:0/3368389112 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fa2801113a0 con 0x7fa26406d900 2024-02-28T16:32:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa26406d900 msgr2=0x7fa26406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa26406d900 0x7fa26406fdb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa280111550 tx=0x7fa26c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa280102f50 msgr2=0x7fa280115cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa280102f50 0x7fa280115cb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa270001d80 tx=0x7fa270009ec0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 shutdown_connections 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa26406d900 0x7fa26406fdb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa280102f50 0x7fa280115cb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 --2- 172.21.15.148:0/3368389112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2801038f0 0x7fa2801161f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 >> 172.21.15.148:0/3368389112 conn(0x7fa2800f8ae0 msgr2=0x7fa2800fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 shutdown_connections 2024-02-28T16:32:45.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.566+0000 7fa288400700 1 -- 172.21.15.148:0/3368389112 wait complete. 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.714+0000 7f0c3f800700 1 -- 172.21.15.148:0/4023990057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 msgr2=0x7f0c38070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.714+0000 7f0c3f800700 1 --2- 172.21.15.148:0/4023990057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c38070330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c004970 tx=0x7f0c2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.714+0000 7f0c3f800700 1 -- 172.21.15.148:0/4023990057 shutdown_connections 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.714+0000 7f0c3f800700 1 --2- 172.21.15.148:0/4023990057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c38070870 0x7f0c38070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.714+0000 7f0c3f800700 1 --2- 172.21.15.148:0/4023990057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c38070330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.714+0000 7f0c3f800700 1 -- 172.21.15.148:0/4023990057 >> 172.21.15.148:0/4023990057 conn(0x7f0c380f8ae0 msgr2=0x7f0c380faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.715+0000 7f0c3f800700 1 -- 172.21.15.148:0/4023990057 shutdown_connections 2024-02-28T16:32:45.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.715+0000 7f0c3f800700 1 -- 172.21.15.148:0/4023990057 wait complete. 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.716+0000 7f0c3f800700 1 Processor -- start 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.716+0000 7f0c3f800700 1 -- start start 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.716+0000 7f0c3f800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c38070870 0x7f0c3811a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.716+0000 7f0c3f800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c3811a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.716+0000 7f0c3f800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3811ac00 con 0x7f0c38071f60 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.716+0000 7f0c3f800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38113f10 con 0x7f0c38070870 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c37e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c3811a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c37e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c3811a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56582/0 (socket says 172.21.15.148:56582) 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c37e00700 1 -- 172.21.15.148:0/943625721 learned_addr learned my addr 172.21.15.148:0/943625721 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:45.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c3ce00700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c38070870 0x7f0c3811a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c37e00700 1 -- 172.21.15.148:0/943625721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c38070870 msgr2=0x7f0c3811a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c37e00700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c38070870 0x7f0c3811a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c37e00700 1 -- 172.21.15.148:0/943625721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2c005040 con 0x7f0c38071f60 2024-02-28T16:32:45.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.717+0000 7f0c3ce00700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c38070870 0x7f0c3811a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:32:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.718+0000 7f0c37e00700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c3811a5b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c24002a50 tx=0x7f0c240046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.718+0000 7f0c34c00700 1 -- 172.21.15.148:0/943625721 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c24007cc0 con 0x7f0c38071f60 2024-02-28T16:32:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.718+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c381141f0 con 0x7f0c38071f60 2024-02-28T16:32:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.718+0000 7f0c34c00700 1 -- 172.21.15.148:0/943625721 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c2400f040 con 0x7f0c38071f60 2024-02-28T16:32:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.718+0000 7f0c34c00700 1 -- 172.21.15.148:0/943625721 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c24009640 con 0x7f0c38071f60 2024-02-28T16:32:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.718+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c38114730 con 0x7f0c38071f60 2024-02-28T16:32:45.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.719+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c380fe400 con 0x7f0c38071f60 2024-02-28T16:32:45.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.720+0000 7f0c34c00700 1 -- 172.21.15.148:0/943625721 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f0c240097a0 con 0x7f0c38071f60 2024-02-28T16:32:45.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.722+0000 7f0c34c00700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0c2006d900 0x7f0c2006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:45.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.723+0000 7f0c34c00700 1 -- 172.21.15.148:0/943625721 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0c2408cf60 con 0x7f0c38071f60 2024-02-28T16:32:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.723+0000 7f0c3ce00700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0c2006d900 0x7f0c2006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:45.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.724+0000 7f0c3ce00700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0c2006d900 0x7f0c2006fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c004560 tx=0x7f0c2c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:45.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.726+0000 7f0c34c00700 1 -- 172.21.15.148:0/943625721 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0c2405a070 con 0x7f0c38071f60 2024-02-28T16:32:45.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.965+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c3804bf40 con 0x7f0c2006d900 2024-02-28T16:32:45.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.975+0000 7f0c34c00700 1 -- 172.21.15.148:0/943625721 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f0c3804bf40 con 0x7f0c2006d900 2024-02-28T16:32:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:32:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (2m) 40s ago 18m 14.4M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:32:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (18m) 40s ago 18m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:32:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (17m) 15s ago 17m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (2m) 40s ago 17m 74.3M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (10m) 40s ago 10m 14.2M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (10m) 40s ago 10m 146M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (10m) 15s ago 10m 14.4M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (10m) 15s ago 10m 14.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (5m) 40s ago 20m 476M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (4m) 15s ago 16m 448M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (58s) 40s ago 20m 28.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (21s) 15s ago 16m 18.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (3m) 40s ago 18m 7700k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (3m) 15s ago 16m 7335k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (15m) 40s ago 15m 207M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:32:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (14m) 40s ago 14m 211M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:32:45.966 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (13m) 40s ago 13m 181M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:32:45.966 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (13m) 15s ago 13m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:32:45.966 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (12m) 15s ago 12m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:32:45.966 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (12m) 15s ago 12m 193M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:32:45.966 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (3m) 40s ago 17m 49.6M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:32:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.978+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0c2006d900 msgr2=0x7f0c2006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.978+0000 7f0c3f800700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0c2006d900 0x7f0c2006fdb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c004560 tx=0x7f0c2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:45.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 msgr2=0x7f0c3811a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:45.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c3811a5b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c24002a50 tx=0x7f0c240046b0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 shutdown_connections 2024-02-28T16:32:45.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0c2006d900 0x7f0c2006fdb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0c38070870 0x7f0c3811a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 --2- 172.21.15.148:0/943625721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c38071f60 0x7f0c3811a5b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:45.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 >> 172.21.15.148:0/943625721 conn(0x7f0c380f8ae0 msgr2=0x7f0c380fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:45.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 shutdown_connections 2024-02-28T16:32:45.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:45.979+0000 7f0c3f800700 1 -- 172.21.15.148:0/943625721 wait complete. 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 -- 172.21.15.148:0/192921254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105170 msgr2=0x7fcf34105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 --2- 172.21.15.148:0/192921254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105170 0x7fcf34105540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf28004940 tx=0x7fcf28009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 -- 172.21.15.148:0/192921254 shutdown_connections 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 --2- 172.21.15.148:0/192921254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf34105b10 0x7fcf340ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 --2- 172.21.15.148:0/192921254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105170 0x7fcf34105540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 -- 172.21.15.148:0/192921254 >> 172.21.15.148:0/192921254 conn(0x7fcf340face0 msgr2=0x7fcf340fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 -- 172.21.15.148:0/192921254 shutdown_connections 2024-02-28T16:32:46.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.118+0000 7fcf3c000700 1 -- 172.21.15.148:0/192921254 wait complete. 2024-02-28T16:32:46.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.119+0000 7fcf3c000700 1 Processor -- start 2024-02-28T16:32:46.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.119+0000 7fcf3c000700 1 -- start start 2024-02-28T16:32:46.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.119+0000 7fcf3c000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf34105170 0x7fcf34115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.119+0000 7fcf3c000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105b10 0x7fcf341161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.109 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.119+0000 7fcf3c000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf341168a0 con 0x7fcf34105b10 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.119+0000 7fcf3c000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3410fb40 con 0x7fcf34105170 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.119+0000 7fcf38c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105b10 0x7fcf341161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf38c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105b10 0x7fcf341161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56604/0 (socket says 172.21.15.148:56604) 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf38c00700 1 -- 172.21.15.148:0/1569567069 learned_addr learned my addr 172.21.15.148:0/1569567069 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf39600700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf34105170 0x7fcf34115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf38c00700 1 -- 172.21.15.148:0/1569567069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf34105170 msgr2=0x7fcf34115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf38c00700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf34105170 0x7fcf34115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf38c00700 1 -- 172.21.15.148:0/1569567069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28005040 con 0x7fcf34105b10 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf38c00700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105b10 0x7fcf341161c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000b790 tx=0x7fcf20009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.120+0000 7fcf31600700 1 -- 172.21.15.148:0/1569567069 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2000f6f0 con 0x7fcf34105b10 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.121+0000 7fcf31600700 1 -- 172.21.15.148:0/1569567069 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf2000fd20 con 0x7fcf34105b10 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.121+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3410fe20 con 0x7fcf34105b10 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.121+0000 7fcf31600700 1 -- 172.21.15.148:0/1569567069 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf200103a0 con 0x7fcf34105b10 2024-02-28T16:32:46.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.121+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf34110360 con 0x7fcf34105b10 2024-02-28T16:32:46.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.122+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf340fe900 con 0x7fcf34105b10 2024-02-28T16:32:46.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.123+0000 7fcf31600700 1 -- 172.21.15.148:0/1569567069 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fcf20011400 con 0x7fcf34105b10 2024-02-28T16:32:46.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.124+0000 7fcf31600700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcf1c06d900 0x7fcf1c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.124+0000 7fcf31600700 1 -- 172.21.15.148:0/1569567069 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcf2008ce60 con 0x7fcf34105b10 2024-02-28T16:32:46.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.124+0000 7fcf39600700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcf1c06d900 0x7fcf1c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.125+0000 7fcf39600700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcf1c06d900 0x7fcf1c06fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800b020 tx=0x7fcf28009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:46.117 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.128+0000 7fcf31600700 1 -- 172.21.15.148:0/1569567069 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcf2005a100 con 0x7fcf34105b10 2024-02-28T16:32:46.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.425+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf3410c2e0 con 0x7fcf34105b10 2024-02-28T16:32:46.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.427+0000 7fcf31600700 1 -- 172.21.15.148:0/1569567069 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fcf20059c90 con 0x7fcf34105b10 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:46.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:32:46.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:32:46.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:32:46.417 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:32:46.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 10, 2024-02-28T16:32:46.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:32:46.417 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:32:46.417 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:32:46.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcf1c06d900 msgr2=0x7fcf1c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcf1c06d900 0x7fcf1c06fdb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800b020 tx=0x7fcf28009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:46.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105b10 msgr2=0x7fcf341161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105b10 0x7fcf341161c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000b790 tx=0x7fcf20009220 comp rx=0 tx=0).stop 2024-02-28T16:32:46.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 shutdown_connections 2024-02-28T16:32:46.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcf1c06d900 0x7fcf1c06fdb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf34105170 0x7fcf34115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 --2- 172.21.15.148:0/1569567069 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf34105b10 0x7fcf341161c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 >> 172.21.15.148:0/1569567069 conn(0x7fcf340face0 msgr2=0x7fcf340fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:46.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 shutdown_connections 2024-02-28T16:32:46.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.429+0000 7fcf3c000700 1 -- 172.21.15.148:0/1569567069 wait complete. 2024-02-28T16:32:46.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.569+0000 7efd86c00700 1 -- 172.21.15.148:0/3904435536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 msgr2=0x7efd800fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.569+0000 7efd86c00700 1 --2- 172.21.15.148:0/3904435536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd800fb9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd6c004940 tx=0x7efd6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.570+0000 7efd86c00700 1 -- 172.21.15.148:0/3904435536 shutdown_connections 2024-02-28T16:32:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.570+0000 7efd86c00700 1 --2- 172.21.15.148:0/3904435536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd800fb9e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.570+0000 7efd86c00700 1 --2- 172.21.15.148:0/3904435536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd800fde50 0x7efd800fe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.570+0000 7efd86c00700 1 -- 172.21.15.148:0/3904435536 >> 172.21.15.148:0/3904435536 conn(0x7efd80071560 msgr2=0x7efd80071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:46.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.570+0000 7efd86c00700 1 -- 172.21.15.148:0/3904435536 shutdown_connections 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: Reconfiguring daemon osd.0 on smithi148 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:46.560 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:46 smithi148 ceph-mon[112463]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:46.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.570+0000 7efd86c00700 1 -- 172.21.15.148:0/3904435536 wait complete. 2024-02-28T16:32:46.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd86c00700 1 Processor -- start 2024-02-28T16:32:46.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd86c00700 1 -- start start 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd86c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd80115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd86c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd800fde50 0x7efd80116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd86c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80116830 con 0x7efd800fb570 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd86c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8010faf0 con 0x7efd800fde50 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd7fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd80115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd7fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd80115c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56622/0 (socket says 172.21.15.148:56622) 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.571+0000 7efd7fe00700 1 -- 172.21.15.148:0/661817049 learned_addr learned my addr 172.21.15.148:0/661817049 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd7f400700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd800fde50 0x7efd80116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd7fe00700 1 -- 172.21.15.148:0/661817049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd800fde50 msgr2=0x7efd80116150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd7fe00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd800fde50 0x7efd80116150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd7fe00700 1 -- 172.21.15.148:0/661817049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c005040 con 0x7efd800fb570 2024-02-28T16:32:46.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd7fe00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd80115c10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b790 tx=0x7efd70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:46.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd77e00700 1 -- 172.21.15.148:0/661817049 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7000f770 con 0x7efd800fb570 2024-02-28T16:32:46.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd77e00700 1 -- 172.21.15.148:0/661817049 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd7000fda0 con 0x7efd800fb570 2024-02-28T16:32:46.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd77e00700 1 -- 172.21.15.148:0/661817049 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7000d310 con 0x7efd800fb570 2024-02-28T16:32:46.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.572+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8010fdd0 con 0x7efd800fb570 2024-02-28T16:32:46.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.573+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd80110310 con 0x7efd800fb570 2024-02-28T16:32:46.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.574+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd80073080 con 0x7efd800fb570 2024-02-28T16:32:46.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.575+0000 7efd77e00700 1 -- 172.21.15.148:0/661817049 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7efd70010420 con 0x7efd800fb570 2024-02-28T16:32:46.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.575+0000 7efd77e00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efd6406d900 0x7efd6406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.575+0000 7efd77e00700 1 -- 172.21.15.148:0/661817049 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efd7008cfe0 con 0x7efd800fb570 2024-02-28T16:32:46.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.576+0000 7efd7f400700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efd6406d900 0x7efd6406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.576+0000 7efd7f400700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efd6406d900 0x7efd6406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd801114b0 tx=0x7efd6c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:46.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.580+0000 7efd77e00700 1 -- 172.21.15.148:0/661817049 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efd70056810 con 0x7efd800fb570 2024-02-28T16:32:46.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:46.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:46.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:46.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T16:32:46.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:32:46.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: Reconfiguring daemon osd.0 on smithi148 2024-02-28T16:32:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:46.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:46 smithi157 ceph-mon[89328]: pgmap v27: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:46.822 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.833+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd801111f0 con 0x7efd800fb570 2024-02-28T16:32:46.823 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.834+0000 7efd77e00700 1 -- 172.21.15.148:0/661817049 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7efd70059ed0 con 0x7efd800fb570 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:32:46.825 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:32:46.826 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:46.827 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:46.828 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:32:46.828 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:32:46.828 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:46.828 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:46.828 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:32:46.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efd6406d900 msgr2=0x7efd6406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efd6406d900 0x7efd6406fdb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd801114b0 tx=0x7efd6c009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:46.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 msgr2=0x7efd80115c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd80115c10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd7000b790 tx=0x7efd70009250 comp rx=0 tx=0).stop 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 shutdown_connections 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efd6406d900 0x7efd6406fdb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efd800fb570 0x7efd80115c10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 --2- 172.21.15.148:0/661817049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efd800fde50 0x7efd80116150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 >> 172.21.15.148:0/661817049 conn(0x7efd80071560 msgr2=0x7efd800f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.838+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 shutdown_connections 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.839+0000 7efd86c00700 1 -- 172.21.15.148:0/661817049 wait complete. 2024-02-28T16:32:46.830 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 -- 172.21.15.148:0/632456997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 msgr2=0x7f0efc103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 --2- 172.21.15.148:0/632456997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc103320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0eec004940 tx=0x7f0eec009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 -- 172.21.15.148:0/632456997 shutdown_connections 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 --2- 172.21.15.148:0/632456997 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0efc1038f0 0x7f0efc0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 --2- 172.21.15.148:0/632456997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc103320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 -- 172.21.15.148:0/632456997 >> 172.21.15.148:0/632456997 conn(0x7f0efc0f8ae0 msgr2=0x7f0efc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 -- 172.21.15.148:0/632456997 shutdown_connections 2024-02-28T16:32:46.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.988+0000 7f0f01800700 1 -- 172.21.15.148:0/632456997 wait complete. 2024-02-28T16:32:46.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.989+0000 7f0f01800700 1 Processor -- start 2024-02-28T16:32:46.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.989+0000 7f0f01800700 1 -- start start 2024-02-28T16:32:46.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0f01800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.978 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0f01800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0efc1038f0 0x7f0efc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0f01800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc070dd0 con 0x7f0efc102f50 2024-02-28T16:32:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0f01800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc070f40 con 0x7f0efc1038f0 2024-02-28T16:32:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0efaa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0efaa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56640/0 (socket says 172.21.15.148:56640) 2024-02-28T16:32:46.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0efaa00700 1 -- 172.21.15.148:0/3609983620 learned_addr learned my addr 172.21.15.148:0/3609983620 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0efaa00700 1 -- 172.21.15.148:0/3609983620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0efc1038f0 msgr2=0x7f0efc0707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0efaa00700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0efc1038f0 0x7f0efc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.990+0000 7f0efaa00700 1 -- 172.21.15.148:0/3609983620 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec005040 con 0x7f0efc102f50 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.991+0000 7f0efaa00700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc070290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009150 tx=0x7f0eec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.991+0000 7f0ef2a00700 1 -- 172.21.15.148:0/3609983620 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eec00e040 con 0x7f0efc102f50 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.991+0000 7f0ef2a00700 1 -- 172.21.15.148:0/3609983620 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0eec00bbf0 con 0x7f0efc102f50 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.991+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc119ca0 con 0x7f0efc102f50 2024-02-28T16:32:46.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.991+0000 7f0ef2a00700 1 -- 172.21.15.148:0/3609983620 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eec01c630 con 0x7f0efc102f50 2024-02-28T16:32:46.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.991+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc11a100 con 0x7f0efc102f50 2024-02-28T16:32:46.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.992+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0efc100260 con 0x7f0efc102f50 2024-02-28T16:32:46.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.993+0000 7f0ef2a00700 1 -- 172.21.15.148:0/3609983620 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f0eec00bd60 con 0x7f0efc102f50 2024-02-28T16:32:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.994+0000 7f0ef2a00700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0ee006d900 0x7f0ee006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.994+0000 7f0ef2a00700 1 -- 172.21.15.148:0/3609983620 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0eec08e500 con 0x7f0efc102f50 2024-02-28T16:32:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.994+0000 7f0efa000700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0ee006d900 0x7f0ee006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:46.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.995+0000 7f0efa000700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0ee006d900 0x7f0ee006fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0efc071c90 tx=0x7f0ee8009ce0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:46.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:46.999+0000 7f0ef2a00700 1 -- 172.21.15.148:0/3609983620 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0eec057be0 con 0x7f0efc102f50 2024-02-28T16:32:47.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.241+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0efc0719d0 con 0x7f0ee006d900 2024-02-28T16:32:47.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.243+0000 7f0ef2a00700 1 -- 172.21.15.148:0/3609983620 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f0efc0719d0 con 0x7f0ee006d900 2024-02-28T16:32:47.232 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:32:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:32:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:32:47.232 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "mon" 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "4/21 daemons upgraded", 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:32:47.233 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0ee006d900 msgr2=0x7f0ee006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0ee006d900 0x7f0ee006fdb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0efc071c90 tx=0x7f0ee8009ce0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 msgr2=0x7f0efc070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc070290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009150 tx=0x7f0eec009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 shutdown_connections 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0ee006d900 0x7f0ee006fdb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0efc102f50 0x7f0efc070290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 --2- 172.21.15.148:0/3609983620 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0efc1038f0 0x7f0efc0707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 >> 172.21.15.148:0/3609983620 conn(0x7f0efc0f8ae0 msgr2=0x7f0efc0fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:47.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.246+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 shutdown_connections 2024-02-28T16:32:47.236 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.247+0000 7f0f01800700 1 -- 172.21.15.148:0/3609983620 wait complete. 2024-02-28T16:32:47.384 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 -- 172.21.15.148:0/754893043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 msgr2=0x7f6d98105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:47.385 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/754893043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98105540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6d88004940 tx=0x7f6d88009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:47.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:47 smithi148 ceph-mon[112463]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:47.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:47 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1569567069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:47.385 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:47 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/661817049' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 -- 172.21.15.148:0/754893043 shutdown_connections 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/754893043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d98105b10 0x7f6d980ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/754893043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98105540 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 -- 172.21.15.148:0/754893043 >> 172.21.15.148:0/754893043 conn(0x7f6d980face0 msgr2=0x7f6d980fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 -- 172.21.15.148:0/754893043 shutdown_connections 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.396+0000 7f6d9dc00700 1 -- 172.21.15.148:0/754893043 wait complete. 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.397+0000 7f6d9dc00700 1 Processor -- start 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.397+0000 7f6d9dc00700 1 -- start start 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.397+0000 7f6d9dc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:47.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.397+0000 7f6d9dc00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d98105b10 0x7f6d981161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.397+0000 7f6d9dc00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d981167f0 con 0x7f6d98105170 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.397+0000 7f6d9dc00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9810fb40 con 0x7f6d98105b10 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98115c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:56648/0 (socket says 172.21.15.148:56648) 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96a00700 1 -- 172.21.15.148:0/955999903 learned_addr learned my addr 172.21.15.148:0/955999903 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96000700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d98105b10 0x7f6d981161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96a00700 1 -- 172.21.15.148:0/955999903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d98105b10 msgr2=0x7f6d981161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96a00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d98105b10 0x7f6d981161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96a00700 1 -- 172.21.15.148:0/955999903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88005040 con 0x7f6d98105170 2024-02-28T16:32:47.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.398+0000 7f6d96a00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98115c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009150 tx=0x7f6d88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:47.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.399+0000 7f6d8ea00700 1 -- 172.21.15.148:0/955999903 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d8800e040 con 0x7f6d98105170 2024-02-28T16:32:47.389 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.399+0000 7f6d8ea00700 1 -- 172.21.15.148:0/955999903 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d8800bbf0 con 0x7f6d98105170 2024-02-28T16:32:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.399+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9810fdc0 con 0x7f6d98105170 2024-02-28T16:32:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.399+0000 7f6d8ea00700 1 -- 172.21.15.148:0/955999903 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d8801c630 con 0x7f6d98105170 2024-02-28T16:32:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.399+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d98110300 con 0x7f6d98105170 2024-02-28T16:32:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.400+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d98102480 con 0x7f6d98105170 2024-02-28T16:32:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.401+0000 7f6d8ea00700 1 -- 172.21.15.148:0/955999903 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f6d8800bd60 con 0x7f6d98105170 2024-02-28T16:32:47.390 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.402+0000 7f6d8ea00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f6d7c06d900 0x7f6d7c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:32:47.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.402+0000 7f6d8ea00700 1 -- 172.21.15.148:0/955999903 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6d8808e4e0 con 0x7f6d98105170 2024-02-28T16:32:47.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.402+0000 7f6d96000700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f6d7c06d900 0x7f6d7c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:32:47.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.403+0000 7f6d96000700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f6d7c06d900 0x7f6d7c06fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d84007fd0 tx=0x7f6d84009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:32:47.395 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.406+0000 7f6d8ea00700 1 -- 172.21.15.148:0/955999903 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6d88057bc0 con 0x7f6d98105170 2024-02-28T16:32:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.699+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6d98111280 con 0x7f6d98105170 2024-02-28T16:32:47.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.700+0000 7f6d8ea00700 1 -- 172.21.15.148:0/955999903 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f6d8805b280 con 0x7f6d98105170 2024-02-28T16:32:47.689 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:47.689 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:32:47.689 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:32:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.702+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f6d7c06d900 msgr2=0x7f6d7c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.702+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f6d7c06d900 0x7f6d7c06fdb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d84007fd0 tx=0x7f6d84009040 comp rx=0 tx=0).stop 2024-02-28T16:32:47.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.702+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 msgr2=0x7f6d98115c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.702+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98115c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009150 tx=0x7f6d88009e30 comp rx=0 tx=0).stop 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.703+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 shutdown_connections 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.703+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f6d7c06d900 0x7f6d7c06fdb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.703+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6d98105170 0x7f6d98115c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.703+0000 7f6d9dc00700 1 --2- 172.21.15.148:0/955999903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6d98105b10 0x7f6d981161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.703+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 >> 172.21.15.148:0/955999903 conn(0x7f6d980face0 msgr2=0x7f6d980fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.703+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 shutdown_connections 2024-02-28T16:32:47.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:32:47.703+0000 7f6d9dc00700 1 -- 172.21.15.148:0/955999903 wait complete. 2024-02-28T16:32:47.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:47 smithi157 ceph-mon[89328]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:47.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:47 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1569567069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:32:47.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:47 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/661817049' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:32:48.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:48.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:48.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/955999903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:48.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:48.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:48.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T16:32:48.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:32:48.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:48.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:32:48.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: pgmap v28: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:48.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/955999903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:32:48.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:48.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:48.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T16:32:48.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:32:48.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:49.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:49 smithi148 ceph-mon[112463]: Reconfiguring daemon osd.1 on smithi148 2024-02-28T16:32:49.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:49 smithi157 ceph-mon[89328]: Reconfiguring daemon osd.1 on smithi148 2024-02-28T16:32:50.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:50 smithi148 ceph-mon[112463]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:50.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:50.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:50.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:32:50.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:50.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:50 smithi157 ceph-mon[89328]: pgmap v29: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:50.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:50.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:50.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:32:50.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:51.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:51 smithi148 ceph-mon[112463]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T16:32:51.473 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:51 smithi148 ceph-mon[112463]: Reconfiguring daemon osd.2 on smithi148 2024-02-28T16:32:51.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:51 smithi157 ceph-mon[89328]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T16:32:51.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:51 smithi157 ceph-mon[89328]: Reconfiguring daemon osd.2 on smithi148 2024-02-28T16:32:52.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:52 smithi148 ceph-mon[112463]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:52.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:52 smithi157 ceph-mon[89328]: pgmap v30: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:53 smithi148 ceph-mon[112463]: Reconfiguring mds.cephfs.smithi148.mgdxsi (monmap changed)... 2024-02-28T16:32:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:53.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:53 smithi148 ceph-mon[112463]: Reconfiguring daemon mds.cephfs.smithi148.mgdxsi on smithi148 2024-02-28T16:32:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:53 smithi157 ceph-mon[89328]: Reconfiguring mds.cephfs.smithi148.mgdxsi (monmap changed)... 2024-02-28T16:32:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:53 smithi157 ceph-mon[89328]: Reconfiguring daemon mds.cephfs.smithi148.mgdxsi on smithi148 2024-02-28T16:32:54.840 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:54 smithi148 ceph-mon[112463]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:54 smithi157 ceph-mon[89328]: pgmap v31: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:56.136 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:55 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:56.136 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:55 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:56.136 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:55 smithi148 ceph-mon[112463]: Reconfiguring mds.cephfs.smithi148.nqnotw (monmap changed)... 2024-02-28T16:32:56.136 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:55 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:56.136 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:55 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:56.136 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:55 smithi148 ceph-mon[112463]: Reconfiguring daemon mds.cephfs.smithi148.nqnotw on smithi148 2024-02-28T16:32:56.136 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:55 smithi148 ceph-mon[112463]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:55 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:55 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:55 smithi157 ceph-mon[89328]: Reconfiguring mds.cephfs.smithi148.nqnotw (monmap changed)... 2024-02-28T16:32:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:55 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:32:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:55 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:55 smithi157 ceph-mon[89328]: Reconfiguring daemon mds.cephfs.smithi148.nqnotw on smithi148 2024-02-28T16:32:56.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:55 smithi157 ceph-mon[89328]: pgmap v32: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: Reconfiguring crash.smithi157 (monmap changed)... 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: Reconfiguring daemon crash.smithi157 on smithi157 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:58.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:32:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:32:58.637 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:58.637 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:32:58.637 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: Reconfiguring crash.smithi157 (monmap changed)... 2024-02-28T16:32:58.637 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:32:58.637 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:32:58.637 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: Reconfiguring daemon crash.smithi157 on smithi157 2024-02-28T16:32:58.638 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: pgmap v33: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:32:58.638 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:32:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:00.904 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:00.904 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:00.905 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:00.905 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: Reconfiguring mgr.smithi157.cmcxzj (monmap changed)... 2024-02-28T16:33:00.905 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:33:00.905 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:33:00.905 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:00.905 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:00 smithi157 ceph-mon[89328]: Reconfiguring daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:33:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: pgmap v34: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: Reconfiguring mgr.smithi157.cmcxzj (monmap changed)... 2024-02-28T16:33:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi157.cmcxzj", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T16:33:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T16:33:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:01.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:00 smithi148 ceph-mon[112463]: Reconfiguring daemon mgr.smithi157.cmcxzj on smithi157 2024-02-28T16:33:02.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:02 smithi157 ceph-mon[89328]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:02 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:02 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:02 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:33:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:02 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:33:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:02 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:03.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:02 smithi148 ceph-mon[112463]: pgmap v35: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:03.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:02 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:03.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:02 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:03.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:02 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T16:33:03.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:02 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T16:33:03.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:02 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:03.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:03 smithi157 ceph-mon[89328]: Reconfiguring mon.smithi157 (monmap changed)... 2024-02-28T16:33:03.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:03 smithi157 ceph-mon[89328]: Reconfiguring daemon mon.smithi157 on smithi157 2024-02-28T16:33:04.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:03 smithi148 ceph-mon[112463]: Reconfiguring mon.smithi157 (monmap changed)... 2024-02-28T16:33:04.139 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:03 smithi148 ceph-mon[112463]: Reconfiguring daemon mon.smithi157 on smithi157 2024-02-28T16:33:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:04 smithi157 ceph-mon[89328]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:04 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:04 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:04 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:33:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:04 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:05.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:04 smithi148 ceph-mon[112463]: pgmap v36: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:05.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:04 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:05.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:04 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:05.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:04 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:33:05.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:04 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:05.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:05 smithi157 ceph-mon[89328]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T16:33:05.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:05 smithi157 ceph-mon[89328]: Reconfiguring daemon osd.3 on smithi157 2024-02-28T16:33:06.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:05 smithi148 ceph-mon[112463]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T16:33:06.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:05 smithi148 ceph-mon[112463]: Reconfiguring daemon osd.3 on smithi157 2024-02-28T16:33:06.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:06 smithi157 ceph-mon[89328]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:07.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:06 smithi148 ceph-mon[112463]: pgmap v37: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:08.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:08 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:08.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:08 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:08.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:08 smithi157 ceph-mon[89328]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T16:33:08.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:08 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:33:08.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:08 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:08.203 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:08 smithi157 ceph-mon[89328]: Reconfiguring daemon osd.4 on smithi157 2024-02-28T16:33:08.204 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:08 smithi157 ceph-mon[89328]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:08.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:08 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:08.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:08 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:08.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:08 smithi148 ceph-mon[112463]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T16:33:08.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:08 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:33:08.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:08 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:08.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:08 smithi148 ceph-mon[112463]: Reconfiguring daemon osd.4 on smithi157 2024-02-28T16:33:08.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:08 smithi148 ceph-mon[112463]: pgmap v38: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:10.743 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:10.743 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:10.743 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:10 smithi157 ceph-mon[89328]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T16:33:10.743 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:33:10.743 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:10.743 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:10 smithi157 ceph-mon[89328]: Reconfiguring daemon osd.5 on smithi157 2024-02-28T16:33:10.743 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:10 smithi157 ceph-mon[89328]: pgmap v39: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:10 smithi148 ceph-mon[112463]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T16:33:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:33:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:10 smithi148 ceph-mon[112463]: Reconfiguring daemon osd.5 on smithi157 2024-02-28T16:33:10.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:10 smithi148 ceph-mon[112463]: pgmap v39: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:12 smithi157 ceph-mon[89328]: pgmap v40: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:33:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:12 smithi148 ceph-mon[112463]: pgmap v40: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:33:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:13 smithi157 ceph-mon[89328]: Reconfiguring mds.cephfs.smithi157.hinycn (monmap changed)... 2024-02-28T16:33:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:13 smithi157 ceph-mon[89328]: Reconfiguring daemon mds.cephfs.smithi157.hinycn on smithi157 2024-02-28T16:33:13.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:13 smithi148 ceph-mon[112463]: Reconfiguring mds.cephfs.smithi157.hinycn (monmap changed)... 2024-02-28T16:33:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:13 smithi148 ceph-mon[112463]: Reconfiguring daemon mds.cephfs.smithi157.hinycn on smithi157 2024-02-28T16:33:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:14.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:14 smithi157 ceph-mon[89328]: pgmap v41: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:14.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:14.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:14.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:33:14.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:15.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:14 smithi148 ceph-mon[112463]: pgmap v41: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:33:15.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:15 smithi157 ceph-mon[89328]: Reconfiguring mds.cephfs.smithi157.dreayg (monmap changed)... 2024-02-28T16:33:15.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:15 smithi157 ceph-mon[89328]: Reconfiguring daemon mds.cephfs.smithi157.dreayg on smithi157 2024-02-28T16:33:16.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:15 smithi148 ceph-mon[112463]: Reconfiguring mds.cephfs.smithi157.dreayg (monmap changed)... 2024-02-28T16:33:16.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:15 smithi148 ceph-mon[112463]: Reconfiguring daemon mds.cephfs.smithi157.dreayg on smithi157 2024-02-28T16:33:16.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:16 smithi157 ceph-mon[89328]: pgmap v42: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:17.025 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:16 smithi148 ceph-mon[112463]: pgmap v42: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:17.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 -- 172.21.15.148:0/3750252726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 msgr2=0x7f21dc103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:17.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 --2- 172.21.15.148:0/3750252726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc103320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21d0004940 tx=0x7f21d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:17.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 -- 172.21.15.148:0/3750252726 shutdown_connections 2024-02-28T16:33:17.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 --2- 172.21.15.148:0/3750252726 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21dc1038f0 0x7f21dc0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:17.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 --2- 172.21.15.148:0/3750252726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc103320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:17.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 -- 172.21.15.148:0/3750252726 >> 172.21.15.148:0/3750252726 conn(0x7f21dc0f8ae0 msgr2=0x7f21dc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:17.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 -- 172.21.15.148:0/3750252726 shutdown_connections 2024-02-28T16:33:17.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.853+0000 7f21e3c00700 1 -- 172.21.15.148:0/3750252726 wait complete. 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.854+0000 7f21e3c00700 1 Processor -- start 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.855+0000 7f21e3c00700 1 -- start start 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.855+0000 7f21e3c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.855+0000 7f21e3c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21dc1038f0 0x7f21dc113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.855+0000 7f21e3c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc114670 con 0x7f21dc102f50 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.855+0000 7f21e3c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21dc10d910 con 0x7f21dc1038f0 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21e1200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:17.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21e1200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc113a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43138/0 (socket says 172.21.15.148:43138) 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21e1200700 1 -- 172.21.15.148:0/2737543006 learned_addr learned my addr 172.21.15.148:0/2737543006 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21dbe00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21dc1038f0 0x7f21dc113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21e1200700 1 -- 172.21.15.148:0/2737543006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21dc1038f0 msgr2=0x7f21dc113f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21e1200700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21dc1038f0 0x7f21dc113f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21e1200700 1 -- 172.21.15.148:0/2737543006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0005040 con 0x7f21dc102f50 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21dbe00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21dc1038f0 0x7f21dc113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.856+0000 7f21e1200700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc113a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009fd0 tx=0x7f21d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.857+0000 7f21d8c00700 1 -- 172.21.15.148:0/2737543006 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d000e040 con 0x7f21dc102f50 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.857+0000 7f21d8c00700 1 -- 172.21.15.148:0/2737543006 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21d000bbf0 con 0x7f21dc102f50 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.857+0000 7f21d8c00700 1 -- 172.21.15.148:0/2737543006 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d001c3f0 con 0x7f21dc102f50 2024-02-28T16:33:17.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.857+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc10db90 con 0x7f21dc102f50 2024-02-28T16:33:17.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.857+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21dc10e0d0 con 0x7f21dc102f50 2024-02-28T16:33:17.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.858+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21dc0fc6e0 con 0x7f21dc102f50 2024-02-28T16:33:17.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.859+0000 7f21d8c00700 1 -- 172.21.15.148:0/2737543006 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f21d000bd60 con 0x7f21dc102f50 2024-02-28T16:33:17.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.860+0000 7f21d8c00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f21c406d900 0x7f21c406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:17.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.860+0000 7f21d8c00700 1 -- 172.21.15.148:0/2737543006 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f21d008e340 con 0x7f21dc102f50 2024-02-28T16:33:17.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.860+0000 7f21dbe00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f21c406d900 0x7f21c406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:17.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.861+0000 7f21dbe00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f21c406d900 0x7f21c406fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006fd0 tx=0x7f21c8008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:17.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:17.865+0000 7f21d8c00700 1 -- 172.21.15.148:0/2737543006 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f21d005b610 con 0x7f21dc102f50 2024-02-28T16:33:18.043 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"}]: dispatch 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"}]': finished 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]: dispatch 2024-02-28T16:33:18.044 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]': finished 2024-02-28T16:33:18.106 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.117+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f21dc10f0d0 con 0x7f21c406d900 2024-02-28T16:33:18.107 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.118+0000 7f21d8c00700 1 -- 172.21.15.148:0/2737543006 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f21dc10f0d0 con 0x7f21c406d900 2024-02-28T16:33:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f21c406d900 msgr2=0x7f21c406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f21c406d900 0x7f21c406fdb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006fd0 tx=0x7f21c8008040 comp rx=0 tx=0).stop 2024-02-28T16:33:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 msgr2=0x7f21dc113a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc113a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21d0009fd0 tx=0x7f21d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 shutdown_connections 2024-02-28T16:33:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f21c406d900 0x7f21c406fdb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f21dc102f50 0x7f21dc113a50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 --2- 172.21.15.148:0/2737543006 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f21dc1038f0 0x7f21dc113f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 >> 172.21.15.148:0/2737543006 conn(0x7f21dc0f8ae0 msgr2=0x7f21dc0fa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:18.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 shutdown_connections 2024-02-28T16:33:18.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.121+0000 7f21e3c00700 1 -- 172.21.15.148:0/2737543006 wait complete. 2024-02-28T16:33:18.125 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:33:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:18.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"}]: dispatch 2024-02-28T16:33:18.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi148"}]': finished 2024-02-28T16:33:18.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]: dispatch 2024-02-28T16:33:18.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi157"}]': finished 2024-02-28T16:33:18.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.268+0000 7f8d4a400700 1 -- 172.21.15.148:0/2660608451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 msgr2=0x7f8d440ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.268+0000 7f8d4a400700 1 --2- 172.21.15.148:0/2660608451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d440ff160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8d30004940 tx=0x7f8d30009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.269+0000 7f8d4a400700 1 -- 172.21.15.148:0/2660608451 shutdown_connections 2024-02-28T16:33:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.269+0000 7f8d4a400700 1 --2- 172.21.15.148:0/2660608451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d440ff160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.269+0000 7f8d4a400700 1 --2- 172.21.15.148:0/2660608451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d44105150 0x7f8d44105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.269+0000 7f8d4a400700 1 -- 172.21.15.148:0/2660608451 >> 172.21.15.148:0/2660608451 conn(0x7f8d440face0 msgr2=0x7f8d440fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.269+0000 7f8d4a400700 1 -- 172.21.15.148:0/2660608451 shutdown_connections 2024-02-28T16:33:18.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.269+0000 7f8d4a400700 1 -- 172.21.15.148:0/2660608451 wait complete. 2024-02-28T16:33:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.270+0000 7f8d4a400700 1 Processor -- start 2024-02-28T16:33:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.270+0000 7f8d4a400700 1 -- start start 2024-02-28T16:33:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.270+0000 7f8d4a400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d44105150 0x7f8d44115d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.270+0000 7f8d4a400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d44116260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.270+0000 7f8d4a400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d441168b0 con 0x7f8d44105af0 2024-02-28T16:33:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.270+0000 7f8d4a400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4410fbc0 con 0x7f8d44105150 2024-02-28T16:33:18.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.271+0000 7f8d42a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d44116260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.271+0000 7f8d42a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d44116260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43160/0 (socket says 172.21.15.148:43160) 2024-02-28T16:33:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.271+0000 7f8d42a00700 1 -- 172.21.15.148:0/1638525990 learned_addr learned my addr 172.21.15.148:0/1638525990 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.271+0000 7f8d43400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d44105150 0x7f8d44115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.271+0000 7f8d42a00700 1 -- 172.21.15.148:0/1638525990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d44105150 msgr2=0x7f8d44115d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.271+0000 7f8d42a00700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d44105150 0x7f8d44115d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.271+0000 7f8d42a00700 1 -- 172.21.15.148:0/1638525990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30005040 con 0x7f8d44105af0 2024-02-28T16:33:18.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.272+0000 7f8d42a00700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d44116260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d30000c00 tx=0x7f8d30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:18.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.272+0000 7f8d3b400700 1 -- 172.21.15.148:0/1638525990 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d30021070 con 0x7f8d44105af0 2024-02-28T16:33:18.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.272+0000 7f8d3b400700 1 -- 172.21.15.148:0/1638525990 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d30013d00 con 0x7f8d44105af0 2024-02-28T16:33:18.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.272+0000 7f8d3b400700 1 -- 172.21.15.148:0/1638525990 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d3000e070 con 0x7f8d44105af0 2024-02-28T16:33:18.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.272+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4410fe40 con 0x7f8d44105af0 2024-02-28T16:33:18.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.272+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d44110320 con 0x7f8d44105af0 2024-02-28T16:33:18.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.273+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d44107620 con 0x7f8d44105af0 2024-02-28T16:33:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.275+0000 7f8d3b400700 1 -- 172.21.15.148:0/1638525990 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f8d3001c400 con 0x7f8d44105af0 2024-02-28T16:33:18.264 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.276+0000 7f8d3b400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8d2806d900 0x7f8d2806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:18.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.276+0000 7f8d3b400700 1 -- 172.21.15.148:0/1638525990 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8d3008e600 con 0x7f8d44105af0 2024-02-28T16:33:18.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.277+0000 7f8d43400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8d2806d900 0x7f8d2806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:18.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.277+0000 7f8d43400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8d2806d900 0x7f8d2806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009b80 tx=0x7f8d3400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:18.270 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.282+0000 7f8d3b400700 1 -- 172.21.15.148:0/1638525990 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8d3005b7d0 con 0x7f8d44105af0 2024-02-28T16:33:18.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.516+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d4404bf40 con 0x7f8d2806d900 2024-02-28T16:33:18.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.518+0000 7f8d3b400700 1 -- 172.21.15.148:0/1638525990 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f8d4404bf40 con 0x7f8d2806d900 2024-02-28T16:33:18.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8d2806d900 msgr2=0x7f8d2806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8d2806d900 0x7f8d2806fdb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8d34009b80 tx=0x7f8d3400b040 comp rx=0 tx=0).stop 2024-02-28T16:33:18.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 msgr2=0x7f8d44116260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d44116260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d30000c00 tx=0x7f8d30009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:18.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 shutdown_connections 2024-02-28T16:33:18.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8d2806d900 0x7f8d2806fdb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8d44105150 0x7f8d44115d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 --2- 172.21.15.148:0/1638525990 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d44105af0 0x7f8d44116260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.520+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 >> 172.21.15.148:0/1638525990 conn(0x7f8d440face0 msgr2=0x7f8d440fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:18.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.521+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 shutdown_connections 2024-02-28T16:33:18.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.521+0000 7f8d4a400700 1 -- 172.21.15.148:0/1638525990 wait complete. 2024-02-28T16:33:18.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 -- 172.21.15.148:0/3731052856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 msgr2=0x7f64800fb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 --2- 172.21.15.148:0/3731052856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f64800fb430 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f646c004940 tx=0x7f646c009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:18.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 -- 172.21.15.148:0/3731052856 shutdown_connections 2024-02-28T16:33:18.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 --2- 172.21.15.148:0/3731052856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f64800fb430 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 --2- 172.21.15.148:0/3731052856 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64801013c0 0x7f6480101790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 -- 172.21.15.148:0/3731052856 >> 172.21.15.148:0/3731052856 conn(0x7f6480072270 msgr2=0x7f6480072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:18.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 -- 172.21.15.148:0/3731052856 shutdown_connections 2024-02-28T16:33:18.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.666+0000 7f6486e00700 1 -- 172.21.15.148:0/3731052856 wait complete. 2024-02-28T16:33:18.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.667+0000 7f6486e00700 1 Processor -- start 2024-02-28T16:33:18.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.667+0000 7f6486e00700 1 -- start start 2024-02-28T16:33:18.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6486e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64801013c0 0x7f6480115a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:18.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6486e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f6480115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:18.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6486e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64801165c0 con 0x7f6480101d60 2024-02-28T16:33:18.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6486e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648010f8f0 con 0x7f64801013c0 2024-02-28T16:33:18.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6485000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f6480115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:18.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6485000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f6480115f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43186/0 (socket says 172.21.15.148:43186) 2024-02-28T16:33:18.657 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6485000700 1 -- 172.21.15.148:0/2106280150 learned_addr learned my addr 172.21.15.148:0/2106280150 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:18.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6485a00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64801013c0 0x7f6480115a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:18.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6485000700 1 -- 172.21.15.148:0/2106280150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64801013c0 msgr2=0x7f6480115a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6485000700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64801013c0 0x7f6480115a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.668+0000 7f6485000700 1 -- 172.21.15.148:0/2106280150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c005040 con 0x7f6480101d60 2024-02-28T16:33:18.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.669+0000 7f6485a00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64801013c0 0x7f6480115a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:18.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.669+0000 7f6485000700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f6480115f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f646c009030 tx=0x7f646c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:18.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.669+0000 7f647d600700 1 -- 172.21.15.148:0/2106280150 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646c00e040 con 0x7f6480101d60 2024-02-28T16:33:18.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.669+0000 7f647d600700 1 -- 172.21.15.148:0/2106280150 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f646c00bbf0 con 0x7f6480101d60 2024-02-28T16:33:18.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.669+0000 7f647d600700 1 -- 172.21.15.148:0/2106280150 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646c01c630 con 0x7f6480101d60 2024-02-28T16:33:18.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.669+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648010fb70 con 0x7f6480101d60 2024-02-28T16:33:18.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.669+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6480110130 con 0x7f6480101d60 2024-02-28T16:33:18.659 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.671+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648005f5c0 con 0x7f6480101d60 2024-02-28T16:33:18.660 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.672+0000 7f647d600700 1 -- 172.21.15.148:0/2106280150 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f646c00bd60 con 0x7f6480101d60 2024-02-28T16:33:18.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.673+0000 7f647d600700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f646806d900 0x7f646806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:18.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.673+0000 7f647d600700 1 -- 172.21.15.148:0/2106280150 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f646c08e130 con 0x7f6480101d60 2024-02-28T16:33:18.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.673+0000 7f6485a00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f646806d900 0x7f646806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:18.662 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.674+0000 7f6485a00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f646806d900 0x7f646806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6474004a10 tx=0x7f6474009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:18.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.677+0000 7f647d600700 1 -- 172.21.15.148:0/2106280150 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f646c05b400 con 0x7f6480101d60 2024-02-28T16:33:18.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.899+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6480107c90 con 0x7f646806d900 2024-02-28T16:33:18.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.910+0000 7f647d600700 1 -- 172.21.15.148:0/2106280150 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6480107c90 con 0x7f646806d900 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (3m) 73s ago 18m 14.4M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (19m) 73s ago 19m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 4c463db9984f 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (17m) 48s ago 17m 6665k - 17.2.7-535-gc0f02e60 1c37ed371348 a8681b27ffd0 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (2m) 73s ago 18m 74.3M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (10m) 73s ago 10m 14.2M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (10m) 73s ago 10m 146M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (10m) 48s ago 10m 14.4M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (10m) 48s ago 10m 14.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:33:18.899 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (6m) 73s ago 20m 476M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (4m) 48s ago 16m 448M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (91s) 73s ago 20m 28.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (54s) 48s ago 16m 18.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (4m) 73s ago 19m 7700k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (4m) 48s ago 16m 7335k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (15m) 73s ago 15m 207M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (15m) 73s ago 15m 211M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (14m) 73s ago 14m 181M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (13m) 48s ago 13m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (13m) 48s ago 13m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (12m) 48s ago 12m 193M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:33:18.900 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (3m) 73s ago 18m 49.6M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f646806d900 msgr2=0x7f646806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f646806d900 0x7f646806fdb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6474004a10 tx=0x7f6474009040 comp rx=0 tx=0).stop 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 msgr2=0x7f6480115f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f6480115f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f646c009030 tx=0x7f646c009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 shutdown_connections 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f646806d900 0x7f646806fdb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f64801013c0 0x7f6480115a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 --2- 172.21.15.148:0/2106280150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6480101d60 0x7f6480115f70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 >> 172.21.15.148:0/2106280150 conn(0x7f6480072270 msgr2=0x7f64800fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 shutdown_connections 2024-02-28T16:33:18.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:18.913+0000 7f6486e00700 1 -- 172.21.15.148:0/2106280150 wait complete. 2024-02-28T16:33:18.925 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:18 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all mon 2024-02-28T16:33:18.925 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:18 smithi148 ceph-mon[112463]: pgmap v43: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 -- 172.21.15.148:0/857702275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 msgr2=0x7f46a4109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 --2- 172.21.15.148:0/857702275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a4109980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4694004940 tx=0x7f4694009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 -- 172.21.15.148:0/857702275 shutdown_connections 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 --2- 172.21.15.148:0/857702275 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46a4103dc0 0x7f46a4104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 --2- 172.21.15.148:0/857702275 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a4109980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 -- 172.21.15.148:0/857702275 >> 172.21.15.148:0/857702275 conn(0x7f46a4072d70 msgr2=0x7f46a4075180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 -- 172.21.15.148:0/857702275 shutdown_connections 2024-02-28T16:33:19.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.052+0000 7f46aaa00700 1 -- 172.21.15.148:0/857702275 wait complete. 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.053+0000 7f46aaa00700 1 Processor -- start 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.053+0000 7f46aaa00700 1 -- start start 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.053+0000 7f46aaa00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46a4103dc0 0x7f46a411a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.053+0000 7f46aaa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a411a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.053+0000 7f46aaa00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a411ac30 con 0x7f46a41095b0 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.053+0000 7f46aaa00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a4113f40 con 0x7f46a4103dc0 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a411a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a411a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43200/0 (socket says 172.21.15.148:43200) 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3400700 1 -- 172.21.15.148:0/2957684635 learned_addr learned my addr 172.21.15.148:0/2957684635 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3e00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46a4103dc0 0x7f46a411a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3400700 1 -- 172.21.15.148:0/2957684635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46a4103dc0 msgr2=0x7f46a411a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3400700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46a4103dc0 0x7f46a411a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3400700 1 -- 172.21.15.148:0/2957684635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694005040 con 0x7f46a41095b0 2024-02-28T16:33:19.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.054+0000 7f46a3400700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a411a5e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f469000c830 tx=0x7f4690004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:19.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.055+0000 7f469be00700 1 -- 172.21.15.148:0/2957684635 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f469000a760 con 0x7f46a41095b0 2024-02-28T16:33:19.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.055+0000 7f469be00700 1 -- 172.21.15.148:0/2957684635 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f469000ad90 con 0x7f46a41095b0 2024-02-28T16:33:19.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.055+0000 7f469be00700 1 -- 172.21.15.148:0/2957684635 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46900113a0 con 0x7f46a41095b0 2024-02-28T16:33:19.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.055+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a4114220 con 0x7f46a41095b0 2024-02-28T16:33:19.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.055+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a4114760 con 0x7f46a41095b0 2024-02-28T16:33:19.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.056+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a4106850 con 0x7f46a41095b0 2024-02-28T16:33:19.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.057+0000 7f469be00700 1 -- 172.21.15.148:0/2957684635 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f4690012400 con 0x7f46a41095b0 2024-02-28T16:33:19.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.058+0000 7f469be00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468806d900 0x7f468806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.058+0000 7f469be00700 1 -- 172.21.15.148:0/2957684635 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f469008d030 con 0x7f46a41095b0 2024-02-28T16:33:19.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.058+0000 7f46a3e00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468806d900 0x7f468806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.059+0000 7f46a3e00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468806d900 0x7f468806fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4694004f90 tx=0x7f4694009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:19.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.063+0000 7f469be00700 1 -- 172.21.15.148:0/2957684635 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f469005a370 con 0x7f46a41095b0 2024-02-28T16:33:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:18 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all mon 2024-02-28T16:33:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:18 smithi157 ceph-mon[89328]: pgmap v43: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:19.351 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.362+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f46a4075890 con 0x7f46a41095b0 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.363+0000 7f469be00700 1 -- 172.21.15.148:0/2957684635 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7f4690059f00 con 0x7f46a41095b0 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:19.352 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 10, 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:33:19.353 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:33:19.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468806d900 msgr2=0x7f468806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468806d900 0x7f468806fdb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4694004f90 tx=0x7f4694009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:19.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 msgr2=0x7f46a411a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a411a5e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f469000c830 tx=0x7f4690004470 comp rx=0 tx=0).stop 2024-02-28T16:33:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 shutdown_connections 2024-02-28T16:33:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468806d900 0x7f468806fdb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46a4103dc0 0x7f46a411a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 --2- 172.21.15.148:0/2957684635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f46a41095b0 0x7f46a411a5e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 >> 172.21.15.148:0/2957684635 conn(0x7f46a4072d70 msgr2=0x7f46a4074890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 shutdown_connections 2024-02-28T16:33:19.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.367+0000 7f46aaa00700 1 -- 172.21.15.148:0/2957684635 wait complete. 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 -- 172.21.15.148:0/412633782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 msgr2=0x7f27140fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 --2- 172.21.15.148:0/412633782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27140fcf60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2700004940 tx=0x7f2700009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 -- 172.21.15.148:0/412633782 shutdown_connections 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 --2- 172.21.15.148:0/412633782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27140fcf60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 --2- 172.21.15.148:0/412633782 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2714102f50 0x7f2714103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 -- 172.21.15.148:0/412633782 >> 172.21.15.148:0/412633782 conn(0x7f27140f8ae0 msgr2=0x7f27140faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 -- 172.21.15.148:0/412633782 shutdown_connections 2024-02-28T16:33:19.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.518+0000 7f271ba00700 1 -- 172.21.15.148:0/412633782 wait complete. 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.519+0000 7f271ba00700 1 Processor -- start 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.519+0000 7f271ba00700 1 -- start start 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.519+0000 7f271ba00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2714102f50 0x7f2714115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.519+0000 7f271ba00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27141161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.519+0000 7f271ba00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714116810 con 0x7f27141038f0 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.519+0000 7f271ba00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271410fb40 con 0x7f2714102f50 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.520+0000 7f2713e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27141161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.520+0000 7f2713e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27141161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43218/0 (socket says 172.21.15.148:43218) 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.520+0000 7f2713e00700 1 -- 172.21.15.148:0/3140877963 learned_addr learned my addr 172.21.15.148:0/3140877963 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.520+0000 7f2719000700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2714102f50 0x7f2714115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.520+0000 7f2713e00700 1 -- 172.21.15.148:0/3140877963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2714102f50 msgr2=0x7f2714115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.520+0000 7f2713e00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2714102f50 0x7f2714115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.520+0000 7f2713e00700 1 -- 172.21.15.148:0/3140877963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700005040 con 0x7f27141038f0 2024-02-28T16:33:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.521+0000 7f2713e00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27141161c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2700009030 tx=0x7f2700009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.521+0000 7f2710c00700 1 -- 172.21.15.148:0/3140877963 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f270000e040 con 0x7f27141038f0 2024-02-28T16:33:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.521+0000 7f2710c00700 1 -- 172.21.15.148:0/3140877963 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f270000bbf0 con 0x7f27141038f0 2024-02-28T16:33:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.521+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271410fdc0 con 0x7f27141038f0 2024-02-28T16:33:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.521+0000 7f2710c00700 1 -- 172.21.15.148:0/3140877963 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f270001c630 con 0x7f27141038f0 2024-02-28T16:33:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.521+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2714110300 con 0x7f27141038f0 2024-02-28T16:33:19.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.522+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27140fc6e0 con 0x7f27141038f0 2024-02-28T16:33:19.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.523+0000 7f2710c00700 1 -- 172.21.15.148:0/3140877963 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f270000bd60 con 0x7f27141038f0 2024-02-28T16:33:19.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.525+0000 7f2710c00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f26fc06d900 0x7f26fc06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.525+0000 7f2710c00700 1 -- 172.21.15.148:0/3140877963 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f270008e460 con 0x7f27141038f0 2024-02-28T16:33:19.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.525+0000 7f2719000700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f26fc06d900 0x7f26fc06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.526+0000 7f2719000700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f26fc06d900 0x7f26fc06fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2708004990 tx=0x7f2708009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:19.517 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.529+0000 7f2710c00700 1 -- 172.21.15.148:0/3140877963 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f270005b690 con 0x7f27141038f0 2024-02-28T16:33:19.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.807+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f271410a030 con 0x7f27141038f0 2024-02-28T16:33:19.796 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.808+0000 7f2710c00700 1 -- 172.21.15.148:0/3140877963 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f270005b220 con 0x7f27141038f0 2024-02-28T16:33:19.797 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:33:19.797 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:33:19.797 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:33:19.797 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:33:19.798 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:33:19.799 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:19.800 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:33:19.801 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:19.801 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:19.801 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:19.801 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:19.801 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f26fc06d900 msgr2=0x7f26fc06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f26fc06d900 0x7f26fc06fdb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2708004990 tx=0x7f2708009ee0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 msgr2=0x7f27141161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27141161c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2700009030 tx=0x7f2700009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 shutdown_connections 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f26fc06d900 0x7f26fc06fdb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2714102f50 0x7f2714115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 --2- 172.21.15.148:0/3140877963 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27141038f0 0x7f27141161c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 >> 172.21.15.148:0/3140877963 conn(0x7f27140f8ae0 msgr2=0x7f27140fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.812+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 shutdown_connections 2024-02-28T16:33:19.802 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.813+0000 7f271ba00700 1 -- 172.21.15.148:0/3140877963 wait complete. 2024-02-28T16:33:19.803 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:33:19.953 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.964+0000 7f35df400700 1 -- 172.21.15.148:0/2047507641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8103890 msgr2=0x7f35d80fcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.964+0000 7f35df400700 1 --2- 172.21.15.148:0/2047507641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8103890 0x7f35d80fcf00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35c4004940 tx=0x7f35c4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:19.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.965+0000 7f35df400700 1 -- 172.21.15.148:0/2047507641 shutdown_connections 2024-02-28T16:33:19.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.965+0000 7f35df400700 1 --2- 172.21.15.148:0/2047507641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8103890 0x7f35d80fcf00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.965+0000 7f35df400700 1 --2- 172.21.15.148:0/2047507641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35d8102ef0 0x7f35d81032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.965+0000 7f35df400700 1 -- 172.21.15.148:0/2047507641 >> 172.21.15.148:0/2047507641 conn(0x7f35d80f8a80 msgr2=0x7f35d80fae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:19.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.965+0000 7f35df400700 1 -- 172.21.15.148:0/2047507641 shutdown_connections 2024-02-28T16:33:19.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.965+0000 7f35df400700 1 -- 172.21.15.148:0/2047507641 wait complete. 2024-02-28T16:33:19.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.965+0000 7f35df400700 1 Processor -- start 2024-02-28T16:33:19.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35df400700 1 -- start start 2024-02-28T16:33:19.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35df400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8102ef0 0x7f35d8115bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35df400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35d8103890 0x7f35d8116100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35df400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8116750 con 0x7f35d8102ef0 2024-02-28T16:33:19.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35df400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d810fa80 con 0x7f35d8103890 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35dca00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8102ef0 0x7f35d8115bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35dca00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8102ef0 0x7f35d8115bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43238/0 (socket says 172.21.15.148:43238) 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.966+0000 7f35dca00700 1 -- 172.21.15.148:0/421170765 learned_addr learned my addr 172.21.15.148:0/421170765 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35dca00700 1 -- 172.21.15.148:0/421170765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35d8103890 msgr2=0x7f35d8116100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35d7e00700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35d8103890 0x7f35d8116100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35dca00700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35d8103890 0x7f35d8116100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35dca00700 1 -- 172.21.15.148:0/421170765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4005040 con 0x7f35d8102ef0 2024-02-28T16:33:19.956 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35d7e00700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35d8103890 0x7f35d8116100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:19.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35dca00700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8102ef0 0x7f35d8115bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f35cc002a50 tx=0x7f35cc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:19.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35d4c00700 1 -- 172.21.15.148:0/421170765 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35cc007cc0 con 0x7f35d8102ef0 2024-02-28T16:33:19.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35d4c00700 1 -- 172.21.15.148:0/421170765 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35cc00f040 con 0x7f35d8102ef0 2024-02-28T16:33:19.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d810fd60 con 0x7f35d8102ef0 2024-02-28T16:33:19.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.967+0000 7f35d4c00700 1 -- 172.21.15.148:0/421170765 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35cc009640 con 0x7f35d8102ef0 2024-02-28T16:33:19.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.968+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d8110320 con 0x7f35d8102ef0 2024-02-28T16:33:19.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.969+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d80fc680 con 0x7f35d8102ef0 2024-02-28T16:33:19.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.970+0000 7f35d4c00700 1 -- 172.21.15.148:0/421170765 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f35cc0097a0 con 0x7f35d8102ef0 2024-02-28T16:33:19.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.971+0000 7f35d4c00700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f35c006d900 0x7f35c006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:19.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.971+0000 7f35d4c00700 1 -- 172.21.15.148:0/421170765 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f35cc08ce00 con 0x7f35d8102ef0 2024-02-28T16:33:19.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.972+0000 7f35d7e00700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f35c006d900 0x7f35c006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:19.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.972+0000 7f35d7e00700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f35c006d900 0x7f35c006fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35c400b3b0 tx=0x7f35c4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:19.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:19.976+0000 7f35d4c00700 1 -- 172.21.15.148:0/421170765 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f35cc05a030 con 0x7f35d8102ef0 2024-02-28T16:33:20.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2957684635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:33:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:19 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3140877963' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:20.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.224+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35d8111210 con 0x7f35c006d900 2024-02-28T16:33:20.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.225+0000 7f35d4c00700 1 -- 172.21.15.148:0/421170765 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f35d8111210 con 0x7f35c006d900 2024-02-28T16:33:20.214 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:33:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:33:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:33:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:33:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:33:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:33:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: "mon" 2024-02-28T16:33:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:33:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "4/21 daemons upgraded", 2024-02-28T16:33:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading crash daemons", 2024-02-28T16:33:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:33:20.215 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:33:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f35c006d900 msgr2=0x7f35c006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f35c006d900 0x7f35c006fdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35c400b3b0 tx=0x7f35c4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:20.216 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8102ef0 msgr2=0x7f35d8115bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8102ef0 0x7f35d8115bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f35cc002a50 tx=0x7f35cc0046b0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 shutdown_connections 2024-02-28T16:33:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f35c006d900 0x7f35c006fdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35d8102ef0 0x7f35d8115bc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 --2- 172.21.15.148:0/421170765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f35d8103890 0x7f35d8116100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 >> 172.21.15.148:0/421170765 conn(0x7f35d80f8a80 msgr2=0x7f35d8070570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:20.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 shutdown_connections 2024-02-28T16:33:20.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.228+0000 7f35df400700 1 -- 172.21.15.148:0/421170765 wait complete. 2024-02-28T16:33:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2957684635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi148", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:33:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:20.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:19 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3140877963' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.365+0000 7f470ae00700 1 -- 172.21.15.148:0/912000540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47041095f0 msgr2=0x7f47041099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.365+0000 7f470ae00700 1 --2- 172.21.15.148:0/912000540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47041095f0 0x7f47041099c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46f4004940 tx=0x7f46f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.365+0000 7f470ae00700 1 -- 172.21.15.148:0/912000540 shutdown_connections 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.365+0000 7f470ae00700 1 --2- 172.21.15.148:0/912000540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4704103dc0 0x7f4704104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.365+0000 7f470ae00700 1 --2- 172.21.15.148:0/912000540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f47041095f0 0x7f47041099c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.365+0000 7f470ae00700 1 -- 172.21.15.148:0/912000540 >> 172.21.15.148:0/912000540 conn(0x7f4704072d50 msgr2=0x7f4704075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.366+0000 7f470ae00700 1 -- 172.21.15.148:0/912000540 shutdown_connections 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.366+0000 7f470ae00700 1 -- 172.21.15.148:0/912000540 wait complete. 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.366+0000 7f470ae00700 1 Processor -- start 2024-02-28T16:33:20.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.366+0000 7f470ae00700 1 -- start start 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.367+0000 7f470ae00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4704103dc0 0x7f470411a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.367+0000 7f470ae00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47041095f0 0x7f470411a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.367+0000 7f470ae00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470411ac70 con 0x7f4704103dc0 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.367+0000 7f470ae00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4704113f80 con 0x7f47041095f0 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.367+0000 7f4703e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4704103dc0 0x7f470411a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.367+0000 7f4703e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4704103dc0 0x7f470411a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:43254/0 (socket says 172.21.15.148:43254) 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.367+0000 7f4703e00700 1 -- 172.21.15.148:0/3391965526 learned_addr learned my addr 172.21.15.148:0/3391965526 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.368+0000 7f4703400700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47041095f0 0x7f470411a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.368+0000 7f4703e00700 1 -- 172.21.15.148:0/3391965526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47041095f0 msgr2=0x7f470411a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.368+0000 7f4703e00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47041095f0 0x7f470411a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.368+0000 7f4703e00700 1 -- 172.21.15.148:0/3391965526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f4005040 con 0x7f4704103dc0 2024-02-28T16:33:20.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.368+0000 7f4703e00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4704103dc0 0x7f470411a0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009150 tx=0x7f46f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.369+0000 7f46fbe00700 1 -- 172.21.15.148:0/3391965526 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f400e040 con 0x7f4704103dc0 2024-02-28T16:33:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.369+0000 7f46fbe00700 1 -- 172.21.15.148:0/3391965526 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46f400bbf0 con 0x7f4704103dc0 2024-02-28T16:33:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.369+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4704114200 con 0x7f4704103dc0 2024-02-28T16:33:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.369+0000 7f46fbe00700 1 -- 172.21.15.148:0/3391965526 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f401c3f0 con 0x7f4704103dc0 2024-02-28T16:33:20.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.369+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4704114740 con 0x7f4704103dc0 2024-02-28T16:33:20.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.370+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4704106850 con 0x7f4704103dc0 2024-02-28T16:33:20.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.371+0000 7f46fbe00700 1 -- 172.21.15.148:0/3391965526 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 39) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f46f400bd60 con 0x7f4704103dc0 2024-02-28T16:33:20.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.372+0000 7f46fbe00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f46e806d900 0x7f46e806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:20.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.372+0000 7f46fbe00700 1 -- 172.21.15.148:0/3391965526 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f46f408e460 con 0x7f4704103dc0 2024-02-28T16:33:20.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.373+0000 7f4703400700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f46e806d900 0x7f46e806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:20.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.373+0000 7f4703400700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f46e806d900 0x7f46e806fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4704115980 tx=0x7f46f00043c0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:20.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.378+0000 7f46fbe00700 1 -- 172.21.15.148:0/3391965526 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f46f405b5f0 con 0x7f4704103dc0 2024-02-28T16:33:20.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.677+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f470404bed0 con 0x7f4704103dc0 2024-02-28T16:33:20.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.677+0000 7f46fbe00700 1 -- 172.21.15.148:0/3391965526 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f46f405b180 con 0x7f4704103dc0 2024-02-28T16:33:20.666 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:33:20.666 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:33:20.666 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:33:20.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.680+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f46e806d900 msgr2=0x7f46e806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.680+0000 7f470ae00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f46e806d900 0x7f46e806fdb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4704115980 tx=0x7f46f00043c0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.680+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4704103dc0 msgr2=0x7f470411a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.680+0000 7f470ae00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4704103dc0 0x7f470411a0e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009150 tx=0x7f46f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.681+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 shutdown_connections 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.681+0000 7f470ae00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f46e806d900 0x7f46e806fdb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.681+0000 7f470ae00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4704103dc0 0x7f470411a0e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.681+0000 7f470ae00700 1 --2- 172.21.15.148:0/3391965526 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f47041095f0 0x7f470411a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.681+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 >> 172.21.15.148:0/3391965526 conn(0x7f4704072d50 msgr2=0x7f4704074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.681+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 shutdown_connections 2024-02-28T16:33:20.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:20.681+0000 7f470ae00700 1 -- 172.21.15.148:0/3391965526 wait complete. 2024-02-28T16:33:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:20 smithi148 ceph-mon[112463]: Upgrade: Updating crash.smithi148 (1/2) 2024-02-28T16:33:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:20 smithi148 ceph-mon[112463]: Deploying daemon crash.smithi148 on smithi148 2024-02-28T16:33:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:20 smithi148 ceph-mon[112463]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:20 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3391965526' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:20 smithi157 ceph-mon[89328]: Upgrade: Updating crash.smithi148 (1/2) 2024-02-28T16:33:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:20 smithi157 ceph-mon[89328]: Deploying daemon crash.smithi148 on smithi148 2024-02-28T16:33:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:20 smithi157 ceph-mon[89328]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:20 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3391965526' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:22.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:21 smithi148 ceph-mon[112463]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:22.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:21 smithi157 ceph-mon[89328]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:23.142 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:22 smithi148 ceph-mon[112463]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:23.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:22 smithi157 ceph-mon[89328]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:24.982 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:24 smithi148 ceph-mon[112463]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:25.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:24 smithi157 ceph-mon[89328]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:26.406 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:26 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:26.406 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:26 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:26.406 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:26 smithi157 ceph-mon[89328]: pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:26.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:26 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:26.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:26 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:26.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:26 smithi148 ceph-mon[112463]: pgmap v47: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:28.697 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:28 smithi157 ceph-mon[89328]: Upgrade: Updating crash.smithi157 (2/2) 2024-02-28T16:33:28.697 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:28.697 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:33:28.697 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:28.697 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:28 smithi157 ceph-mon[89328]: Deploying daemon crash.smithi157 on smithi157 2024-02-28T16:33:28.697 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:28 smithi157 ceph-mon[89328]: pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:28.697 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:28.804 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:28 smithi148 ceph-mon[112463]: Upgrade: Updating crash.smithi157 (2/2) 2024-02-28T16:33:28.804 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:28.804 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi157", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T16:33:28.805 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:28.805 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:28 smithi148 ceph-mon[112463]: Deploying daemon crash.smithi157 on smithi157 2024-02-28T16:33:28.805 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:28 smithi148 ceph-mon[112463]: pgmap v48: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:28.805 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:30 smithi157 ceph-mon[89328]: pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:30 smithi157 ceph-mon[89328]: mgrmap e40: smithi148.gelspy(active, since 92s), standbys: smithi157.cmcxzj 2024-02-28T16:33:31.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:30 smithi148 ceph-mon[112463]: pgmap v49: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:31.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:30 smithi148 ceph-mon[112463]: mgrmap e40: smithi148.gelspy(active, since 92s), standbys: smithi157.cmcxzj 2024-02-28T16:33:32.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:32 smithi157 ceph-mon[89328]: pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:32 smithi148 ceph-mon[112463]: pgmap v50: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:34.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:34 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:34.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:34 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:34.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:34 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:34.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:34 smithi148 ceph-mon[112463]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:34.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:34 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:34.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:34 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:34.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:34 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:34.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:34 smithi157 ceph-mon[89328]: pgmap v51: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:36.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:36 smithi157 ceph-mon[89328]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:37.087 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:36 smithi148 ceph-mon[112463]: pgmap v52: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:38.945 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:38 smithi148 ceph-mon[112463]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:38.945 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:38.945 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:38 smithi157 ceph-mon[89328]: pgmap v53: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:41.116 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:40 smithi157 ceph-mon[89328]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:41.116 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:40 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:41.116 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:40 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:41.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:40 smithi148 ceph-mon[112463]: pgmap v54: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-02-28T16:33:41.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:40 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:41.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:40 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:42.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:42.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:41 smithi157 ceph-mon[89328]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:42.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:42.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:42.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:41 smithi148 ceph-mon[112463]: pgmap v55: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:43.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:43.376 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:44.306 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:44.306 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:44.306 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:44 smithi148 ceph-mon[112463]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:44.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:44 smithi157 ceph-mon[89328]: pgmap v56: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:47.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:46 smithi148 ceph-mon[112463]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:47.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:47.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:46 smithi157 ceph-mon[89328]: pgmap v57: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:48 smithi148 ceph-mon[112463]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:49.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:49.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:33:49.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:48 smithi157 ceph-mon[89328]: pgmap v58: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:49.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:49.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:33:49.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:49.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:49.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:49.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"}]: dispatch 2024-02-28T16:33:49.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"}]': finished 2024-02-28T16:33:49.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]: dispatch 2024-02-28T16:33:49.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]': finished 2024-02-28T16:33:49.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:33:50.120 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:33:50.120 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:50.120 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:50.120 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:50.120 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:50.121 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"}]: dispatch 2024-02-28T16:33:50.121 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi148"}]': finished 2024-02-28T16:33:50.121 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]: dispatch 2024-02-28T16:33:50.121 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi157"}]': finished 2024-02-28T16:33:50.121 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:33:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 -- 172.21.15.148:0/2198255918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fde30 msgr2=0x7fc40c0fe200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 --2- 172.21.15.148:0/2198255918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fde30 0x7fc40c0fe200 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc400004940 tx=0x7fc400009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:50.837 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 -- 172.21.15.148:0/2198255918 shutdown_connections 2024-02-28T16:33:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 --2- 172.21.15.148:0/2198255918 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc40c0fe7d0 0x7fc40c106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 --2- 172.21.15.148:0/2198255918 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fde30 0x7fc40c0fe200 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 -- 172.21.15.148:0/2198255918 >> 172.21.15.148:0/2198255918 conn(0x7fc40c0f78a0 msgr2=0x7fc40c0f9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 -- 172.21.15.148:0/2198255918 shutdown_connections 2024-02-28T16:33:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.848+0000 7fc412a00700 1 -- 172.21.15.148:0/2198255918 wait complete. 2024-02-28T16:33:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.849+0000 7fc412a00700 1 Processor -- start 2024-02-28T16:33:50.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.849+0000 7fc412a00700 1 -- start start 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.849+0000 7fc412a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc40c0fde30 0x7fc40c0fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.849+0000 7fc412a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fe7d0 0x7fc40c0fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.849+0000 7fc412a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0fc830 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.849+0000 7fc412a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0fc9a0 con 0x7fc40c0fde30 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc410c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fe7d0 0x7fc40c0fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc410c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fe7d0 0x7fc40c0fc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32852/0 (socket says 172.21.15.148:32852) 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc410c00700 1 -- 172.21.15.148:0/3980250804 learned_addr learned my addr 172.21.15.148:0/3980250804 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc411600700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc40c0fde30 0x7fc40c0fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc410c00700 1 -- 172.21.15.148:0/3980250804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc40c0fde30 msgr2=0x7fc40c0fbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc410c00700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc40c0fde30 0x7fc40c0fbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:50.840 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc410c00700 1 -- 172.21.15.148:0/3980250804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400005040 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.850+0000 7fc410c00700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fe7d0 0x7fc40c0fc1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b790 tx=0x7fc3f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.851+0000 7fc409600700 1 -- 172.21.15.148:0/3980250804 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f800f770 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.851+0000 7fc409600700 1 -- 172.21.15.148:0/3980250804 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3f800fda0 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.851+0000 7fc409600700 1 -- 172.21.15.148:0/3980250804 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f800d310 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.851+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c119b30 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.851+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c11a020 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.852+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c104420 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.842 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.853+0000 7fc409600700 1 -- 172.21.15.148:0/3980250804 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc3f8010420 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.854+0000 7fc409600700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3f406d7e0 0x7fc3f406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:50.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.854+0000 7fc409600700 1 -- 172.21.15.148:0/3980250804 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc3f808cdd0 con 0x7fc40c0fe7d0 2024-02-28T16:33:50.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.855+0000 7fc411600700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3f406d7e0 0x7fc3f406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:50.843 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.855+0000 7fc411600700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3f406d7e0 0x7fc3f406fc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc400004f90 tx=0x7fc400009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:50.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:50.859+0000 7fc409600700 1 -- 172.21.15.148:0/3980250804 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc3f8056790 con 0x7fc40c0fe7d0 2024-02-28T16:33:51.087 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:50 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all crash 2024-02-28T16:33:51.087 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:50 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:33:51.087 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:50 smithi148 ceph-mon[112463]: Upgrade: osd.0 is safe to restart 2024-02-28T16:33:51.087 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:50 smithi148 ceph-mon[112463]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:51.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.100+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc40c0fd3a0 con 0x7fc3f406d7e0 2024-02-28T16:33:51.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.103+0000 7fc409600700 1 -- 172.21.15.148:0/3980250804 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc40c0fd3a0 con 0x7fc3f406d7e0 2024-02-28T16:33:51.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3f406d7e0 msgr2=0x7fc3f406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3f406d7e0 0x7fc3f406fc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc400004f90 tx=0x7fc400009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:51.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fe7d0 msgr2=0x7fc40c0fc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fe7d0 0x7fc40c0fc1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800b790 tx=0x7fc3f8009250 comp rx=0 tx=0).stop 2024-02-28T16:33:51.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 shutdown_connections 2024-02-28T16:33:51.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3f406d7e0 0x7fc3f406fc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc40c0fde30 0x7fc40c0fbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 --2- 172.21.15.148:0/3980250804 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc40c0fe7d0 0x7fc40c0fc1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 >> 172.21.15.148:0/3980250804 conn(0x7fc40c0f78a0 msgr2=0x7fc40c1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:51.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 shutdown_connections 2024-02-28T16:33:51.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.106+0000 7fc412a00700 1 -- 172.21.15.148:0/3980250804 wait complete. 2024-02-28T16:33:51.110 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:33:51.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:50 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all crash 2024-02-28T16:33:51.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:50 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T16:33:51.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:50 smithi157 ceph-mon[89328]: Upgrade: osd.0 is safe to restart 2024-02-28T16:33:51.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:50 smithi157 ceph-mon[89328]: pgmap v59: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 -- 172.21.15.148:0/704576701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd41095b0 msgr2=0x7f3bd4109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 --2- 172.21.15.148:0/704576701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd41095b0 0x7f3bd4109980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4004940 tx=0x7f3bc4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 -- 172.21.15.148:0/704576701 shutdown_connections 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 --2- 172.21.15.148:0/704576701 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bd4103dc0 0x7f3bd4104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 --2- 172.21.15.148:0/704576701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd41095b0 0x7f3bd4109980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 -- 172.21.15.148:0/704576701 >> 172.21.15.148:0/704576701 conn(0x7f3bd4072d70 msgr2=0x7f3bd4075180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 -- 172.21.15.148:0/704576701 shutdown_connections 2024-02-28T16:33:51.245 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.256+0000 7f3bda800700 1 -- 172.21.15.148:0/704576701 wait complete. 2024-02-28T16:33:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.257+0000 7f3bda800700 1 Processor -- start 2024-02-28T16:33:51.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.257+0000 7f3bda800700 1 -- start start 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.258+0000 7f3bda800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd4103dc0 0x7f3bd411a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.258+0000 7f3bda800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bd41095b0 0x7f3bd411a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.258+0000 7f3bda800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd411ac30 con 0x7f3bd4103dc0 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.258+0000 7f3bda800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd4113f40 con 0x7f3bd41095b0 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.258+0000 7f3bd3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd4103dc0 0x7f3bd411a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.258+0000 7f3bd3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd4103dc0 0x7f3bd411a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32876/0 (socket says 172.21.15.148:32876) 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.258+0000 7f3bd3400700 1 -- 172.21.15.148:0/3037858866 learned_addr learned my addr 172.21.15.148:0/3037858866 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bd2a00700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bd41095b0 0x7f3bd411a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bd3400700 1 -- 172.21.15.148:0/3037858866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bd41095b0 msgr2=0x7f3bd411a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bd3400700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bd41095b0 0x7f3bd411a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bd3400700 1 -- 172.21.15.148:0/3037858866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4005040 con 0x7f3bd4103dc0 2024-02-28T16:33:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bd2a00700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bd41095b0 0x7f3bd411a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bd3400700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd4103dc0 0x7f3bd411a0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40090d0 tx=0x7f3bc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:51.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bcb400700 1 -- 172.21.15.148:0/3037858866 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bc400e040 con 0x7f3bd4103dc0 2024-02-28T16:33:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd41141c0 con 0x7f3bd4103dc0 2024-02-28T16:33:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bcb400700 1 -- 172.21.15.148:0/3037858866 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3bc400bbf0 con 0x7f3bd4103dc0 2024-02-28T16:33:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bcb400700 1 -- 172.21.15.148:0/3037858866 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bc401c630 con 0x7f3bd4103dc0 2024-02-28T16:33:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.259+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd4114700 con 0x7f3bd4103dc0 2024-02-28T16:33:51.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.261+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd4106850 con 0x7f3bd4103dc0 2024-02-28T16:33:51.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.262+0000 7f3bcb400700 1 -- 172.21.15.148:0/3037858866 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f3bc400bd60 con 0x7f3bd4103dc0 2024-02-28T16:33:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.263+0000 7f3bcb400700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3bb806d7e0 0x7f3bb806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.263+0000 7f3bcb400700 1 -- 172.21.15.148:0/3037858866 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3bc408e0d0 con 0x7f3bd4103dc0 2024-02-28T16:33:51.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.263+0000 7f3bd2a00700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3bb806d7e0 0x7f3bb806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:51.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.264+0000 7f3bd2a00700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3bb806d7e0 0x7f3bb806fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4115940 tx=0x7f3bc000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:51.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.267+0000 7f3bcb400700 1 -- 172.21.15.148:0/3037858866 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3bc405b5c0 con 0x7f3bd4103dc0 2024-02-28T16:33:51.492 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.503+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bd404bf70 con 0x7f3bb806d7e0 2024-02-28T16:33:51.494 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.506+0000 7f3bcb400700 1 -- 172.21.15.148:0/3037858866 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3bc000f040 con 0x7f3bb806d7e0 2024-02-28T16:33:51.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.508+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3bb806d7e0 msgr2=0x7f3bb806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.508+0000 7f3bda800700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3bb806d7e0 0x7f3bb806fc90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4115940 tx=0x7f3bc000b040 comp rx=0 tx=0).stop 2024-02-28T16:33:51.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.508+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd4103dc0 msgr2=0x7f3bd411a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.508+0000 7f3bda800700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd4103dc0 0x7f3bd411a0a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40090d0 tx=0x7f3bc4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:51.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.509+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 shutdown_connections 2024-02-28T16:33:51.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.509+0000 7f3bda800700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3bb806d7e0 0x7f3bb806fc90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.497 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.509+0000 7f3bda800700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3bd4103dc0 0x7f3bd411a0a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.509+0000 7f3bda800700 1 --2- 172.21.15.148:0/3037858866 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3bd41095b0 0x7f3bd411a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.509+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 >> 172.21.15.148:0/3037858866 conn(0x7f3bd4072d70 msgr2=0x7f3bd4074890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:51.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.509+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 shutdown_connections 2024-02-28T16:33:51.498 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.509+0000 7f3bda800700 1 -- 172.21.15.148:0/3037858866 wait complete. 2024-02-28T16:33:51.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 -- 172.21.15.148:0/3246752058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fdfe0 msgr2=0x7fe0f00fe3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 --2- 172.21.15.148:0/3246752058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fdfe0 0x7fe0f00fe3b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4004970 tx=0x7fe0e4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:51.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 -- 172.21.15.148:0/3246752058 shutdown_connections 2024-02-28T16:33:51.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 --2- 172.21.15.148:0/3246752058 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0f00fe8f0 0x7fe0f0107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 --2- 172.21.15.148:0/3246752058 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fdfe0 0x7fe0f00fe3b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 -- 172.21.15.148:0/3246752058 >> 172.21.15.148:0/3246752058 conn(0x7fe0f0071d90 msgr2=0x7fe0f0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:51.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 -- 172.21.15.148:0/3246752058 shutdown_connections 2024-02-28T16:33:51.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.656+0000 7fe0f7800700 1 -- 172.21.15.148:0/3246752058 wait complete. 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.657+0000 7fe0f7800700 1 Processor -- start 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.657+0000 7fe0f7800700 1 -- start start 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.657+0000 7fe0f7800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0f00fdfe0 0x7fe0f0115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.657+0000 7fe0f7800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fe8f0 0x7fe0f0116220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.657+0000 7fe0f7800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f0116900 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.657+0000 7fe0f7800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f010fb80 con 0x7fe0f00fdfe0 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.657+0000 7fe0efe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fe8f0 0x7fe0f0116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.658+0000 7fe0efe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fe8f0 0x7fe0f0116220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:32894/0 (socket says 172.21.15.148:32894) 2024-02-28T16:33:51.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.658+0000 7fe0efe00700 1 -- 172.21.15.148:0/1729182497 learned_addr learned my addr 172.21.15.148:0/1729182497 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:51.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.658+0000 7fe0f4e00700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0f00fdfe0 0x7fe0f0115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:51.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.658+0000 7fe0efe00700 1 -- 172.21.15.148:0/1729182497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0f00fdfe0 msgr2=0x7fe0f0115ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.658+0000 7fe0efe00700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0f00fdfe0 0x7fe0f0115ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.658+0000 7fe0efe00700 1 -- 172.21.15.148:0/1729182497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4005040 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.658+0000 7fe0efe00700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fe8f0 0x7fe0f0116220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00b790 tx=0x7fe0dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:51.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.659+0000 7fe0ecc00700 1 -- 172.21.15.148:0/1729182497 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0dc00f6f0 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.659+0000 7fe0ecc00700 1 -- 172.21.15.148:0/1729182497 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0dc00fd20 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.659+0000 7fe0ecc00700 1 -- 172.21.15.148:0/1729182497 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0dc0103a0 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.659+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f010fe00 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.659+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f0110340 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.660+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f0106b20 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.661+0000 7fe0ecc00700 1 -- 172.21.15.148:0/1729182497 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe0dc011400 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.663+0000 7fe0ecc00700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe0d806d7e0 0x7fe0d806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:51.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.663+0000 7fe0ecc00700 1 -- 172.21.15.148:0/1729182497 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe0dc08cb90 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.663+0000 7fe0f4e00700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe0d806d7e0 0x7fe0d806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:51.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.664+0000 7fe0f4e00700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe0d806d7e0 0x7fe0d806fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000c00 tx=0x7fe0e4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:51.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.668+0000 7fe0ecc00700 1 -- 172.21.15.148:0/1729182497 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe0dc05a080 con 0x7fe0f00fe8f0 2024-02-28T16:33:51.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.901+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f004bf70 con 0x7fe0d806d7e0 2024-02-28T16:33:51.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.912+0000 7fe0ecc00700 1 -- 172.21.15.148:0/1729182497 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe0e4009710 con 0x7fe0d806d7e0 2024-02-28T16:33:51.901 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:33:51.901 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (3m) 10s ago 19m 14.6M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:33:51.901 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (27s) 10s ago 19m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (19s) 13s ago 18m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (3m) 10s ago 18m 74.9M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (11m) 10s ago 11m 14.7M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (11m) 10s ago 11m 145M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (11m) 13s ago 11m 14.7M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (11m) 13s ago 11m 14.5M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (6m) 10s ago 21m 496M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (5m) 13s ago 17m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (2m) 10s ago 21m 41.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (87s) 13s ago 17m 31.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (4m) 10s ago 19m 7750k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (4m) 13s ago 17m 7822k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (16m) 10s ago 16m 207M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1424954f8de3 2024-02-28T16:33:51.902 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (15m) 10s ago 15m 211M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:33:51.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (15m) 10s ago 15m 182M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:33:51.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (14m) 13s ago 14m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:33:51.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (13m) 13s ago 13m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:33:51.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (13m) 13s ago 13m 193M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:33:51.903 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (4m) 10s ago 18m 52.0M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe0d806d7e0 msgr2=0x7fe0d806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe0d806d7e0 0x7fe0d806fc90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000c00 tx=0x7fe0e4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fe8f0 msgr2=0x7fe0f0116220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fe8f0 0x7fe0f0116220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00b790 tx=0x7fe0dc009250 comp rx=0 tx=0).stop 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 shutdown_connections 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe0d806d7e0 0x7fe0d806fc90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0f00fdfe0 0x7fe0f0115ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 --2- 172.21.15.148:0/1729182497 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0f00fe8f0 0x7fe0f0116220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.915+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 >> 172.21.15.148:0/1729182497 conn(0x7fe0f0071d90 msgr2=0x7fe0f00fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:51.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.916+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 shutdown_connections 2024-02-28T16:33:51.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:51.916+0000 7fe0f7800700 1 -- 172.21.15.148:0/1729182497 wait complete. 2024-02-28T16:33:52.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.063+0000 7fd84ec00700 1 -- 172.21.15.148:0/3242972617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 msgr2=0x7fd8480fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.063+0000 7fd84ec00700 1 --2- 172.21.15.148:0/3242972617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8480fcf60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd834004940 tx=0x7fd834009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:52.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.064+0000 7fd84ec00700 1 -- 172.21.15.148:0/3242972617 shutdown_connections 2024-02-28T16:33:52.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.064+0000 7fd84ec00700 1 --2- 172.21.15.148:0/3242972617 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8480fcf60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.064+0000 7fd84ec00700 1 --2- 172.21.15.148:0/3242972617 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd848102f50 0x7fd848103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.064+0000 7fd84ec00700 1 -- 172.21.15.148:0/3242972617 >> 172.21.15.148:0/3242972617 conn(0x7fd8480f8ae0 msgr2=0x7fd8480faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:52.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.064+0000 7fd84ec00700 1 -- 172.21.15.148:0/3242972617 shutdown_connections 2024-02-28T16:33:52.053 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.064+0000 7fd84ec00700 1 -- 172.21.15.148:0/3242972617 wait complete. 2024-02-28T16:33:52.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd84ec00700 1 Processor -- start 2024-02-28T16:33:52.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd84ec00700 1 -- start start 2024-02-28T16:33:52.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd84ec00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd848102f50 0x7fd848115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd84ec00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8481161c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.055 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd84ec00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd848116810 con 0x7fd8481038f0 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd84ec00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84810fb40 con 0x7fd848102f50 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd847400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8481161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd847400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8481161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39200/0 (socket says 172.21.15.148:39200) 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.065+0000 7fd847400700 1 -- 172.21.15.148:0/1933303998 learned_addr learned my addr 172.21.15.148:0/1933303998 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd847e00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd848102f50 0x7fd848115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd847400700 1 -- 172.21.15.148:0/1933303998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd848102f50 msgr2=0x7fd848115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd847400700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd848102f50 0x7fd848115c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd847400700 1 -- 172.21.15.148:0/1933303998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834005040 con 0x7fd8481038f0 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd847400700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8481161c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd834009030 tx=0x7fd834009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd83fe00700 1 -- 172.21.15.148:0/1933303998 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83400e040 con 0x7fd8481038f0 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd83fe00700 1 -- 172.21.15.148:0/1933303998 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd83400bbf0 con 0x7fd8481038f0 2024-02-28T16:33:52.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84810fdc0 con 0x7fd8481038f0 2024-02-28T16:33:52.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.066+0000 7fd83fe00700 1 -- 172.21.15.148:0/1933303998 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83401c630 con 0x7fd8481038f0 2024-02-28T16:33:52.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.067+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd848110300 con 0x7fd8481038f0 2024-02-28T16:33:52.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.068+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8480fc6e0 con 0x7fd8481038f0 2024-02-28T16:33:52.057 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.069+0000 7fd83fe00700 1 -- 172.21.15.148:0/1933303998 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd83400bd60 con 0x7fd8481038f0 2024-02-28T16:33:52.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.070+0000 7fd83fe00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd82c06d7f0 0x7fd82c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.070+0000 7fd83fe00700 1 -- 172.21.15.148:0/1933303998 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd83408e0e0 con 0x7fd8481038f0 2024-02-28T16:33:52.059 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.071+0000 7fd847e00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd82c06d7f0 0x7fd82c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.071+0000 7fd847e00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd82c06d7f0 0x7fd82c06fca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd838004d60 tx=0x7fd83800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:52.063 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.075+0000 7fd83fe00700 1 -- 172.21.15.148:0/1933303998 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd83405b5d0 con 0x7fd8481038f0 2024-02-28T16:33:52.387 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.398+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd8481111f0 con 0x7fd8481038f0 2024-02-28T16:33:52.388 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.399+0000 7fd83fe00700 1 -- 172.21.15.148:0/1933303998 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fd83405b160 con 0x7fd8481038f0 2024-02-28T16:33:52.388 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:33:52.388 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:33:52.388 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:52.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 10, 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:33:52.389 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:33:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd82c06d7f0 msgr2=0x7fd82c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd82c06d7f0 0x7fd82c06fca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd838004d60 tx=0x7fd83800b040 comp rx=0 tx=0).stop 2024-02-28T16:33:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 msgr2=0x7fd8481161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.391 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8481161c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd834009030 tx=0x7fd834009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 shutdown_connections 2024-02-28T16:33:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd82c06d7f0 0x7fd82c06fca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd848102f50 0x7fd848115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 --2- 172.21.15.148:0/1933303998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd8481038f0 0x7fd8481161c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.402+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 >> 172.21.15.148:0/1933303998 conn(0x7fd8480f8ae0 msgr2=0x7fd8480fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.403+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 shutdown_connections 2024-02-28T16:33:52.392 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.403+0000 7fd84ec00700 1 -- 172.21.15.148:0/1933303998 wait complete. 2024-02-28T16:33:52.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 -- 172.21.15.148:0/3092471423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 msgr2=0x7fa4d8105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 --2- 172.21.15.148:0/3092471423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8105530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc004940 tx=0x7fa4cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:52.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 -- 172.21.15.148:0/3092471423 shutdown_connections 2024-02-28T16:33:52.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 --2- 172.21.15.148:0/3092471423 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4d8105b00 0x7fa4d80ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 --2- 172.21.15.148:0/3092471423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8105530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 -- 172.21.15.148:0/3092471423 >> 172.21.15.148:0/3092471423 conn(0x7fa4d80fad30 msgr2=0x7fa4d80fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:52.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 -- 172.21.15.148:0/3092471423 shutdown_connections 2024-02-28T16:33:52.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.544+0000 7fa4e0600700 1 -- 172.21.15.148:0/3092471423 wait complete. 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.545+0000 7fa4e0600700 1 Processor -- start 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.545+0000 7fa4e0600700 1 -- start start 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4e0600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4e0600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4d8105b00 0x7fa4d81161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4e0600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81167f0 con 0x7fa4d8105160 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4e0600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d810fb40 con 0x7fa4d8105b00 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4ddc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4ddc00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8115c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39216/0 (socket says 172.21.15.148:39216) 2024-02-28T16:33:52.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4ddc00700 1 -- 172.21.15.148:0/4053555825 learned_addr learned my addr 172.21.15.148:0/4053555825 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4ddc00700 1 -- 172.21.15.148:0/4053555825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4d8105b00 msgr2=0x7fa4d81161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.546+0000 7fa4dd200700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4d8105b00 0x7fa4d81161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4ddc00700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4d8105b00 0x7fa4d81161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4ddc00700 1 -- 172.21.15.148:0/4053555825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc005040 con 0x7fa4d8105160 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4dd200700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4d8105b00 0x7fa4d81161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4ddc00700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8115c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009150 tx=0x7fa4cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4d5600700 1 -- 172.21.15.148:0/4053555825 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4cc00e040 con 0x7fa4d8105160 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4d5600700 1 -- 172.21.15.148:0/4053555825 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4cc00bbf0 con 0x7fa4d8105160 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d810fdc0 con 0x7fa4d8105160 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4d5600700 1 -- 172.21.15.148:0/4053555825 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4cc01c630 con 0x7fa4d8105160 2024-02-28T16:33:52.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.547+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d8110300 con 0x7fa4d8105160 2024-02-28T16:33:52.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.548+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8102470 con 0x7fa4d8105160 2024-02-28T16:33:52.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.549+0000 7fa4d5600700 1 -- 172.21.15.148:0/4053555825 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa4cc00bd60 con 0x7fa4d8105160 2024-02-28T16:33:52.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.550+0000 7fa4d5600700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa4c006d7f0 0x7fa4c006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.550+0000 7fa4d5600700 1 -- 172.21.15.148:0/4053555825 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa4cc08e2a0 con 0x7fa4d8105160 2024-02-28T16:33:52.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.550+0000 7fa4dd200700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa4c006d7f0 0x7fa4c006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.551+0000 7fa4dd200700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa4c006d7f0 0x7fa4c006fca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007fd0 tx=0x7fa4c8009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:52.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.555+0000 7fa4d5600700 1 -- 172.21.15.148:0/4053555825 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa4cc057bc0 con 0x7fa4d8105160 2024-02-28T16:33:52.652 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:52.652 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: Upgrade: Updating osd.0 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: Deploying daemon osd.0 on smithi148 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:52.653 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:52 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1933303998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:52.806 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.817+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4d804bf00 con 0x7fa4d8105160 2024-02-28T16:33:52.807 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.818+0000 7fa4d5600700 1 -- 172.21.15.148:0/4053555825 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7fa4cc05b280 con 0x7fa4d8105160 2024-02-28T16:33:52.807 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:33:52.808 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:33:52.809 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:52.810 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:33:52.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.822+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa4c006d7f0 msgr2=0x7fa4c006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.822+0000 7fa4e0600700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa4c006d7f0 0x7fa4c006fca0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007fd0 tx=0x7fa4c8009040 comp rx=0 tx=0).stop 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.822+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 msgr2=0x7fa4d8115c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8115c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009150 tx=0x7fa4cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 shutdown_connections 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa4c006d7f0 0x7fa4c006fca0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4d8105160 0x7fa4d8115c60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 --2- 172.21.15.148:0/4053555825 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa4d8105b00 0x7fa4d81161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 >> 172.21.15.148:0/4053555825 conn(0x7fa4d80fad30 msgr2=0x7fa4d80fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 shutdown_connections 2024-02-28T16:33:52.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.823+0000 7fa4e0600700 1 -- 172.21.15.148:0/4053555825 wait complete. 2024-02-28T16:33:52.813 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 -- 172.21.15.148:0/3841894292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 msgr2=0x7fabc0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 --2- 172.21.15.148:0/3841894292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0103320 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fabb4004940 tx=0x7fabb4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 -- 172.21.15.148:0/3841894292 shutdown_connections 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 --2- 172.21.15.148:0/3841894292 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc01038f0 0x7fabc00fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 --2- 172.21.15.148:0/3841894292 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0103320 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 -- 172.21.15.148:0/3841894292 >> 172.21.15.148:0/3841894292 conn(0x7fabc00f8ae0 msgr2=0x7fabc00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 -- 172.21.15.148:0/3841894292 shutdown_connections 2024-02-28T16:33:52.957 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.968+0000 7fabc7a00700 1 -- 172.21.15.148:0/3841894292 wait complete. 2024-02-28T16:33:52.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.969+0000 7fabc7a00700 1 Processor -- start 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.969+0000 7fabc7a00700 1 -- start start 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.969+0000 7fabc7a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.969+0000 7fabc7a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc01038f0 0x7fabc01161b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.969+0000 7fabc7a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0116890 con 0x7fabc0102f50 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.969+0000 7fabc7a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc010fb30 con 0x7fabc01038f0 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabc5000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabc5000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0115c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39230/0 (socket says 172.21.15.148:39230) 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabc5000700 1 -- 172.21.15.148:0/531186171 learned_addr learned my addr 172.21.15.148:0/531186171 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabc5000700 1 -- 172.21.15.148:0/531186171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc01038f0 msgr2=0x7fabc01161b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabbfe00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc01038f0 0x7fabc01161b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabc5000700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc01038f0 0x7fabc01161b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabc5000700 1 -- 172.21.15.148:0/531186171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4005040 con 0x7fabc0102f50 2024-02-28T16:33:52.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabbfe00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc01038f0 0x7fabc01161b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:33:52.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.970+0000 7fabc5000700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0115c70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009150 tx=0x7fabb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:52.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.971+0000 7fabbcc00700 1 -- 172.21.15.148:0/531186171 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb400e040 con 0x7fabc0102f50 2024-02-28T16:33:52.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.971+0000 7fabbcc00700 1 -- 172.21.15.148:0/531186171 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabb400bbf0 con 0x7fabc0102f50 2024-02-28T16:33:52.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.971+0000 7fabbcc00700 1 -- 172.21.15.148:0/531186171 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb401c630 con 0x7fabc0102f50 2024-02-28T16:33:52.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.971+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc010fdb0 con 0x7fabc0102f50 2024-02-28T16:33:52.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.971+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc01102f0 con 0x7fabc0102f50 2024-02-28T16:33:52.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.972+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc00fc6e0 con 0x7fabc0102f50 2024-02-28T16:33:52.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.973+0000 7fabbcc00700 1 -- 172.21.15.148:0/531186171 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fabb400bd60 con 0x7fabc0102f50 2024-02-28T16:33:52.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.974+0000 7fabbcc00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faba806d7f0 0x7faba806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:52.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.974+0000 7fabbcc00700 1 -- 172.21.15.148:0/531186171 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fabb408e190 con 0x7fabc0102f50 2024-02-28T16:33:52.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.974+0000 7fabbfe00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faba806d7f0 0x7faba806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:52.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.975+0000 7fabbfe00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faba806d7f0 0x7faba806fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fabac006fd0 tx=0x7fabac008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:52.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:52.979+0000 7fabbcc00700 1 -- 172.21.15.148:0/531186171 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fabb405b680 con 0x7fabc0102f50 2024-02-28T16:33:52.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:52.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:52.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: Upgrade: Updating osd.0 2024-02-28T16:33:52.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:33:52.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T16:33:52.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:33:52.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: Deploying daemon osd.0 on smithi148 2024-02-28T16:33:52.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: pgmap v60: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:52.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:52.989 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:52 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1933303998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:33:53.198 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.210+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabc0110560 con 0x7faba806d7f0 2024-02-28T16:33:53.200 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.211+0000 7fabbcc00700 1 -- 172.21.15.148:0/531186171 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fabc0110560 con 0x7faba806d7f0 2024-02-28T16:33:53.200 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:33:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:33:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:33:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:33:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:33:53.200 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:33:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:33:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "crash" 2024-02-28T16:33:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:33:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "6/21 daemons upgraded", 2024-02-28T16:33:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:33:53.201 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:33:53.201 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:33:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faba806d7f0 msgr2=0x7faba806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faba806d7f0 0x7faba806fca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fabac006fd0 tx=0x7fabac008040 comp rx=0 tx=0).stop 2024-02-28T16:33:53.202 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 msgr2=0x7fabc0115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0115c70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009150 tx=0x7fabb4009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 shutdown_connections 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faba806d7f0 0x7faba806fca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fabc0102f50 0x7fabc0115c70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 --2- 172.21.15.148:0/531186171 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fabc01038f0 0x7fabc01161b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 >> 172.21.15.148:0/531186171 conn(0x7fabc00f8ae0 msgr2=0x7fabc00fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 shutdown_connections 2024-02-28T16:33:53.203 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.214+0000 7fabc7a00700 1 -- 172.21.15.148:0/531186171 wait complete. 2024-02-28T16:33:53.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.365+0000 7feb0e000700 1 -- 172.21.15.148:0/2962797297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb08103140 msgr2=0x7feb08103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:53.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.365+0000 7feb0e000700 1 --2- 172.21.15.148:0/2962797297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb08103140 0x7feb08103510 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feaf8004940 tx=0x7feaf8009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:53.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.366+0000 7feb0e000700 1 -- 172.21.15.148:0/2962797297 shutdown_connections 2024-02-28T16:33:53.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.366+0000 7feb0e000700 1 --2- 172.21.15.148:0/2962797297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb080fb570 0x7feb080fb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.366+0000 7feb0e000700 1 --2- 172.21.15.148:0/2962797297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb08103140 0x7feb08103510 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.366+0000 7feb0e000700 1 -- 172.21.15.148:0/2962797297 >> 172.21.15.148:0/2962797297 conn(0x7feb08071560 msgr2=0x7feb08071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:53.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.366+0000 7feb0e000700 1 -- 172.21.15.148:0/2962797297 shutdown_connections 2024-02-28T16:33:53.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.366+0000 7feb0e000700 1 -- 172.21.15.148:0/2962797297 wait complete. 2024-02-28T16:33:53.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.367+0000 7feb0e000700 1 Processor -- start 2024-02-28T16:33:53.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.367+0000 7feb0e000700 1 -- start start 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.367+0000 7feb0e000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb080fb570 0x7feb08115db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.367+0000 7feb0e000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb08103140 0x7feb081162f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.367+0000 7feb0e000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081169d0 con 0x7feb080fb570 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.367+0000 7feb0e000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0810fc50 con 0x7feb08103140 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feaff400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb080fb570 0x7feb08115db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feaff400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb080fb570 0x7feb08115db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39252/0 (socket says 172.21.15.148:39252) 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feaff400700 1 -- 172.21.15.148:0/2476941951 learned_addr learned my addr 172.21.15.148:0/2476941951 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feb07400700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb08103140 0x7feb081162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feaff400700 1 -- 172.21.15.148:0/2476941951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb08103140 msgr2=0x7feb081162f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feaff400700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb08103140 0x7feb081162f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feaff400700 1 -- 172.21.15.148:0/2476941951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8005040 con 0x7feb080fb570 2024-02-28T16:33:53.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.368+0000 7feaff400700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb080fb570 0x7feb08115db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009100 tx=0x7feaf8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:53.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.369+0000 7feaffe00700 1 -- 172.21.15.148:0/2476941951 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf800e040 con 0x7feb080fb570 2024-02-28T16:33:53.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.369+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0810fe70 con 0x7feb080fb570 2024-02-28T16:33:53.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.369+0000 7feaffe00700 1 -- 172.21.15.148:0/2476941951 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feaf8004290 con 0x7feb080fb570 2024-02-28T16:33:53.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.369+0000 7feaffe00700 1 -- 172.21.15.148:0/2476941951 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf801c630 con 0x7feb080fb570 2024-02-28T16:33:53.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.369+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb081103b0 con 0x7feb080fb570 2024-02-28T16:33:53.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.370+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb08073080 con 0x7feb080fb570 2024-02-28T16:33:53.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.371+0000 7feaffe00700 1 -- 172.21.15.148:0/2476941951 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7feaf800bbf0 con 0x7feb080fb570 2024-02-28T16:33:53.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.372+0000 7feaffe00700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feaec06d7e0 0x7feaec06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:33:53.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.372+0000 7feaffe00700 1 -- 172.21.15.148:0/2476941951 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7feaf808e210 con 0x7feb080fb570 2024-02-28T16:33:53.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.372+0000 7feb07400700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feaec06d7e0 0x7feaec06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:33:53.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.372+0000 7feb07400700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feaec06d7e0 0x7feaec06fc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feaf0006fd0 tx=0x7feaf0008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:33:53.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.376+0000 7feaffe00700 1 -- 172.21.15.148:0/2476941951 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feaf805b660 con 0x7feb080fb570 2024-02-28T16:33:53.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.690+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feb08111390 con 0x7feb080fb570 2024-02-28T16:33:53.679 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.691+0000 7feaffe00700 1 -- 172.21.15.148:0/2476941951 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7feaf805b1f0 con 0x7feb080fb570 2024-02-28T16:33:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:33:53.680 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:33:53.680 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feaec06d7e0 msgr2=0x7feaec06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feaec06d7e0 0x7feaec06fc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feaf0006fd0 tx=0x7feaf0008040 comp rx=0 tx=0).stop 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb080fb570 msgr2=0x7feb08115db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb080fb570 0x7feb08115db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009100 tx=0x7feaf8009e30 comp rx=0 tx=0).stop 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 shutdown_connections 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feaec06d7e0 0x7feaec06fc90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb080fb570 0x7feb08115db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 --2- 172.21.15.148:0/2476941951 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb08103140 0x7feb081162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 >> 172.21.15.148:0/2476941951 conn(0x7feb08071560 msgr2=0x7feb080f9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 shutdown_connections 2024-02-28T16:33:53.683 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:33:53.694+0000 7feb0e000700 1 -- 172.21.15.148:0/2476941951 wait complete. 2024-02-28T16:33:53.857 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:53 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4053555825' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:53.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:53 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4053555825' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:33:54.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:54 smithi148 ceph-mon[112463]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:54.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:54 smithi148 ceph-mon[112463]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:54.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:54 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2476941951' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:54 smithi157 ceph-mon[89328]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:33:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:54 smithi157 ceph-mon[89328]: pgmap v61: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:54 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2476941951' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:33:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:56 smithi157 ceph-mon[89328]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:57.101 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:56 smithi148 systemd[1]: Stopping Ceph osd.0 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:33:57.102 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:56 smithi148 ceph-mon[112463]: pgmap v62: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:57.374 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:57 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[47371]: 2024-02-28T16:33:57.111+0000 7fb647a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:33:57.374 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:57 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[47371]: 2024-02-28T16:33:57.111+0000 7fb647a00700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-28T16:33:57.374 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:57 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[47371]: 2024-02-28T16:33:57.111+0000 7fb647a00700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:33:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:57 smithi157 ceph-mon[89328]: osd.0 marked itself down and dead 2024-02-28T16:33:58.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:57 smithi148 ceph-mon[112463]: osd.0 marked itself down and dead 2024-02-28T16:33:58.623 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:58 smithi148 podman[124063]: 2024-02-28 16:33:58.376954816 +0000 UTC m=+1.399954069 container died 1424954f8de3aacbdb9090b06d7b7424589dc65f79164302deb435b5d572b5a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c0f02e6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:33:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:58 smithi157 ceph-mon[89328]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:58 smithi157 ceph-mon[89328]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:33:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:58 smithi157 ceph-mon[89328]: osdmap e50: 6 total, 5 up, 6 in 2024-02-28T16:33:59.105 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:58 smithi148 ceph-mon[112463]: pgmap v63: 65 pgs: 65 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:33:59.105 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:58 smithi148 ceph-mon[112463]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:33:59.105 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:33:59.106 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:58 smithi148 ceph-mon[112463]: osdmap e50: 6 total, 5 up, 6 in 2024-02-28T16:33:59.106 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:58 smithi148 podman[124063]: 2024-02-28 16:33:58.87343274 +0000 UTC m=+1.896432007 container cleanup 1424954f8de3aacbdb9090b06d7b7424589dc65f79164302deb435b5d572b5a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, RELEASE=quincy-c0f02e6, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-28T16:33:59.106 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:58 smithi148 bash[124063]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0 2024-02-28T16:33:59.373 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:59 smithi148 podman[124082]: 2024-02-28 16:33:59.116231611 +0000 UTC m=+0.722524229 container remove 1424954f8de3aacbdb9090b06d7b7424589dc65f79164302deb435b5d572b5a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-02-28T16:33:59.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:33:59 smithi157 ceph-mon[89328]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T16:33:59.997 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:33:59 smithi148 ceph-mon[112463]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T16:33:59.997 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:33:59 smithi148 podman[124172]: 2024-02-28 16:33:59.85532131 +0000 UTC m=+0.034267881 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:34:00.376 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:00 smithi148 podman[124172]: 2024-02-28 16:34:00.008762821 +0000 UTC m=+0.187709429 container create 66715869c8b1c9a23cd96020faeaa7841dfd5abc8d1e31c19792c8cc2e246dcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:34:00.718 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:00 smithi148 podman[124172]: 2024-02-28 16:34:00.397119725 +0000 UTC m=+0.576066339 container init 66715869c8b1c9a23cd96020faeaa7841dfd5abc8d1e31c19792c8cc2e246dcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-28T16:34:00.719 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:00 smithi148 podman[124172]: 2024-02-28 16:34:00.409497662 +0000 UTC m=+0.588444304 container start 66715869c8b1c9a23cd96020faeaa7841dfd5abc8d1e31c19792c8cc2e246dcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-28T16:34:00.719 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:00 smithi148 podman[124172]: 2024-02-28 16:34:00.49475678 +0000 UTC m=+0.673703405 container attach 66715869c8b1c9a23cd96020faeaa7841dfd5abc8d1e31c19792c8cc2e246dcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:34:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:00 smithi157 ceph-mon[89328]: pgmap v66: 65 pgs: 34 peering, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:00 smithi157 ceph-mon[89328]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-02-28T16:34:01.123 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:00 smithi148 podman[124172]: 2024-02-28 16:34:00.845271032 +0000 UTC m=+1.024217603 container died 66715869c8b1c9a23cd96020faeaa7841dfd5abc8d1e31c19792c8cc2e246dcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-28T16:34:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:00 smithi148 ceph-mon[112463]: pgmap v66: 65 pgs: 34 peering, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:00 smithi148 ceph-mon[112463]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-02-28T16:34:02.124 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:01 smithi148 podman[124198]: 2024-02-28 16:34:01.799258163 +0000 UTC m=+0.939118129 container remove 66715869c8b1c9a23cd96020faeaa7841dfd5abc8d1e31c19792c8cc2e246dcc (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:34:02.124 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:01 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-28T16:34:02.124 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:01 smithi148 systemd[1]: Stopped Ceph osd.0 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:34:02.124 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:01 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.0.service: Consumed 1min 29.143s CPU time. 2024-02-28T16:34:02.530 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:02 smithi148 systemd[1]: Starting Ceph osd.0 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:34:02.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:02 smithi148 ceph-mon[112463]: pgmap v67: 65 pgs: 34 peering, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:02.874 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:02 smithi148 podman[124299]: 2024-02-28 16:34:02.450181387 +0000 UTC m=+0.038937805 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:34:02.874 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:02 smithi148 podman[124299]: 2024-02-28 16:34:02.575153128 +0000 UTC m=+0.163909568 container create c423e288606f5f9abf57cc3218c1ae077764442a063aff69c32a3397d480da11 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2) 2024-02-28T16:34:02.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:02 smithi157 ceph-mon[89328]: pgmap v67: 65 pgs: 34 peering, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:03.374 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:02 smithi148 podman[124299]: 2024-02-28 16:34:02.987671492 +0000 UTC m=+0.576427972 container init c423e288606f5f9abf57cc3218c1ae077764442a063aff69c32a3397d480da11 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10) 2024-02-28T16:34:03.374 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 podman[124299]: 2024-02-28 16:34:03.000305249 +0000 UTC m=+0.589061680 container start c423e288606f5f9abf57cc3218c1ae077764442a063aff69c32a3397d480da11 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-02-28T16:34:03.374 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 podman[124299]: 2024-02-28 16:34:03.069556501 +0000 UTC m=+0.658312983 container attach c423e288606f5f9abf57cc3218c1ae077764442a063aff69c32a3397d480da11 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=) 2024-02-28T16:34:04.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-mon[112463]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-02-28T16:34:04.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-mon[112463]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-02-28T16:34:04.125 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate[124314]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:34:04.125 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate[124314]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:34:04.125 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 bash[124299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:34:04.125 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 bash[124299]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:34:04.125 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 bash[124299]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:34:04.125 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 bash[124299]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:34:04.125 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 bash[124299]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 bash[124299]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 bash[124299]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate[124314]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate[124314]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate[124314]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate[124314]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate[124314]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T16:34:04.126 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:03 smithi148 podman[124299]: 2024-02-28 16:34:03.889587936 +0000 UTC m=+1.478344352 container died c423e288606f5f9abf57cc3218c1ae077764442a063aff69c32a3397d480da11 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-28T16:34:04.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:03 smithi157 ceph-mon[89328]: Health check failed: Degraded data redundancy: 50/264 objects degraded (18.939%), 19 pgs degraded (PG_DEGRADED) 2024-02-28T16:34:04.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:03 smithi157 ceph-mon[89328]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-02-28T16:34:04.979 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:04 smithi148 ceph-mon[112463]: pgmap v68: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:04.980 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:04 smithi148 podman[124442]: 2024-02-28 16:34:04.64007377 +0000 UTC m=+0.726661030 container remove c423e288606f5f9abf57cc3218c1ae077764442a063aff69c32a3397d480da11 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:34:05.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:04 smithi157 ceph-mon[89328]: pgmap v68: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:05.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:04 smithi148 podman[124504]: 2024-02-28 16:34:04.897858016 +0000 UTC m=+0.032461916 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:34:05.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:05 smithi148 podman[124504]: 2024-02-28 16:34:05.040923772 +0000 UTC m=+0.175527703 container create 7f09adadd58744df1a14130d13b79543cc713d821ef241989150d91239f2ea6c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-28T16:34:05.333 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:05 smithi148 podman[124504]: 2024-02-28 16:34:05.344698743 +0000 UTC m=+0.479302681 container init 7f09adadd58744df1a14130d13b79543cc713d821ef241989150d91239f2ea6c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10) 2024-02-28T16:34:05.623 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:05 smithi148 podman[124504]: 2024-02-28 16:34:05.354689095 +0000 UTC m=+0.489293008 container start 7f09adadd58744df1a14130d13b79543cc713d821ef241989150d91239f2ea6c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS) 2024-02-28T16:34:05.624 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:05 smithi148 ceph-osd[124523]: -- 172.21.15.148:0/2589991545 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55897dbfd680 con 0x55897dbc6c00 2024-02-28T16:34:05.624 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:05 smithi148 bash[124504]: 7f09adadd58744df1a14130d13b79543cc713d821ef241989150d91239f2ea6c 2024-02-28T16:34:05.624 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:05 smithi148 systemd[1]: Started Ceph osd.0 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:34:06.373 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:05 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[124518]: 2024-02-28T16:34:05.921+0000 7f2b686a07c0 -1 Falling back to public interface 2024-02-28T16:34:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:06.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:06.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:06.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:06 smithi148 ceph-mon[112463]: pgmap v69: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:06.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:06.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:06.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:06.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:06 smithi157 ceph-mon[89328]: pgmap v69: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:08.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:08 smithi157 ceph-mon[89328]: pgmap v70: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:09.005 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:08 smithi148 ceph-mon[112463]: pgmap v70: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:10.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:10 smithi157 ceph-mon[89328]: pgmap v71: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:11.106 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:10 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[124518]: 2024-02-28T16:34:10.761+0000 7f2b686a07c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-28T16:34:11.107 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:10 smithi148 ceph-mon[112463]: pgmap v71: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:11.373 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:11 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[124518]: 2024-02-28T16:34:11.150+0000 7f2b686a07c0 -1 osd.0 49 log_to_monitors true 2024-02-28T16:34:11.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:11 smithi157 ceph-mon[89328]: from='osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:34:12.040 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:11 smithi148 ceph-mon[112463]: from='osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T16:34:12.041 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:34:11 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[124518]: 2024-02-28T16:34:11.721+0000 7f2b57a00700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:34:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:12 smithi157 ceph-mon[89328]: pgmap v72: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:12 smithi157 ceph-mon[89328]: from='osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:34:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:12 smithi157 ceph-mon[89328]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T16:34:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:12 smithi157 ceph-mon[89328]: from='osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:34:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:12.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:12 smithi148 ceph-mon[112463]: pgmap v72: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 256 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:34:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:12 smithi148 ceph-mon[112463]: from='osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T16:34:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:12 smithi148 ceph-mon[112463]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T16:34:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:12 smithi148 ceph-mon[112463]: from='osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:34:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:13 smithi157 ceph-mon[89328]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:34:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:13 smithi157 ceph-mon[89328]: osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650] boot 2024-02-28T16:34:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:13 smithi157 ceph-mon[89328]: osdmap e53: 6 total, 6 up, 6 in 2024-02-28T16:34:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:34:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:13 smithi157 ceph-mon[89328]: osdmap e54: 6 total, 6 up, 6 in 2024-02-28T16:34:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:13 smithi148 ceph-mon[112463]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:34:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:13 smithi148 ceph-mon[112463]: osd.0 [v2:172.21.15.148:6802/2918467650,v1:172.21.15.148:6803/2918467650] boot 2024-02-28T16:34:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:13 smithi148 ceph-mon[112463]: osdmap e53: 6 total, 6 up, 6 in 2024-02-28T16:34:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T16:34:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:14.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:13 smithi148 ceph-mon[112463]: osdmap e54: 6 total, 6 up, 6 in 2024-02-28T16:34:14.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:14 smithi157 ceph-mon[89328]: pgmap v75: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7/264 objects degraded (2.652%) 2024-02-28T16:34:14.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:14 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:34:15.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:14 smithi148 ceph-mon[112463]: pgmap v75: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7/264 objects degraded (2.652%) 2024-02-28T16:34:15.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:14 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T16:34:16.212 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:15 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:16.213 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:15 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:16.213 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:15 smithi148 ceph-mon[112463]: pgmap v77: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7/264 objects degraded (2.652%) 2024-02-28T16:34:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:15 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:15 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:16.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:15 smithi157 ceph-mon[89328]: pgmap v77: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7/264 objects degraded (2.652%) 2024-02-28T16:34:17.896 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:17 smithi148 ceph-mon[112463]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded) 2024-02-28T16:34:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:17 smithi157 ceph-mon[89328]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded) 2024-02-28T16:34:18.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:18 smithi157 ceph-mon[89328]: pgmap v78: 65 pgs: 25 peering, 40 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:19.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:18 smithi148 ceph-mon[112463]: pgmap v78: 65 pgs: 25 peering, 40 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:21.031 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:20 smithi148 ceph-mon[112463]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:21.031 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:21.031 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:21.031 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:21.031 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:21.031 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:20 smithi157 ceph-mon[89328]: pgmap v79: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:22.114 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:22.114 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:22.114 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:22.114 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:22.114 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:34:22.114 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:21 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:34:22.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:22.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:22.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:22.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:22.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:34:22.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:21 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T16:34:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:22 smithi148 ceph-mon[112463]: Upgrade: osd.1 is safe to restart 2024-02-28T16:34:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:22 smithi148 ceph-mon[112463]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:22 smithi157 ceph-mon[89328]: Upgrade: osd.1 is safe to restart 2024-02-28T16:34:23.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:22 smithi157 ceph-mon[89328]: pgmap v80: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:23.845 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.856+0000 7f9258600700 1 -- 172.21.15.148:0/1642067451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 msgr2=0x7f9250106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.857+0000 7f9258600700 1 --2- 172.21.15.148:0/1642067451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f9250106f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f923c004940 tx=0x7f923c009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:23.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.857+0000 7f9258600700 1 -- 172.21.15.148:0/1642067451 shutdown_connections 2024-02-28T16:34:23.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.857+0000 7f9258600700 1 --2- 172.21.15.148:0/1642067451 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f9250106f40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.857+0000 7f9258600700 1 --2- 172.21.15.148:0/1642067451 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92500fdf60 0x7f92500fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.857+0000 7f9258600700 1 -- 172.21.15.148:0/1642067451 >> 172.21.15.148:0/1642067451 conn(0x7f92500f7a10 msgr2=0x7f92500f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:23.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.857+0000 7f9258600700 1 -- 172.21.15.148:0/1642067451 shutdown_connections 2024-02-28T16:34:23.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.857+0000 7f9258600700 1 -- 172.21.15.148:0/1642067451 wait complete. 2024-02-28T16:34:23.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.858+0000 7f9258600700 1 Processor -- start 2024-02-28T16:34:23.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.858+0000 7f9258600700 1 -- start start 2024-02-28T16:34:23.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9258600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92500fdf60 0x7f92500fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:23.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9258600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f92500fc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:23.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9258600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500fc8d0 con 0x7f92500fe900 2024-02-28T16:34:23.847 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9258600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92500fca40 con 0x7f92500fdf60 2024-02-28T16:34:23.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9255200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f92500fc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:23.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9255200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f92500fc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33420/0 (socket says 172.21.15.148:33420) 2024-02-28T16:34:23.848 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9255200700 1 -- 172.21.15.148:0/3962536836 learned_addr learned my addr 172.21.15.148:0/3962536836 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9255c00700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92500fdf60 0x7f92500fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9255200700 1 -- 172.21.15.148:0/3962536836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92500fdf60 msgr2=0x7f92500fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9255200700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92500fdf60 0x7f92500fbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.859+0000 7f9255200700 1 -- 172.21.15.148:0/3962536836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c005040 con 0x7f92500fe900 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.860+0000 7f9255200700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f92500fc2d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f923c000c00 tx=0x7f923c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.860+0000 7f924d600700 1 -- 172.21.15.148:0/3962536836 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c00e040 con 0x7f92500fe900 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.860+0000 7f924d600700 1 -- 172.21.15.148:0/3962536836 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f923c009af0 con 0x7f92500fe900 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.860+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9250119d70 con 0x7f92500fe900 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.860+0000 7f924d600700 1 -- 172.21.15.148:0/3962536836 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c01c630 con 0x7f92500fe900 2024-02-28T16:34:23.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.860+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925011a1d0 con 0x7f92500fe900 2024-02-28T16:34:23.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.862+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9250104550 con 0x7f92500fe900 2024-02-28T16:34:23.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.862+0000 7f924d600700 1 -- 172.21.15.148:0/3962536836 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f923c00bbf0 con 0x7f92500fe900 2024-02-28T16:34:23.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.863+0000 7f924d600700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f923806d7e0 0x7f923806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:23.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.863+0000 7f924d600700 1 -- 172.21.15.148:0/3962536836 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f923c08e1d0 con 0x7f92500fe900 2024-02-28T16:34:23.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.864+0000 7f9255c00700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f923806d7e0 0x7f923806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:23.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.864+0000 7f9255c00700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f923806d7e0 0x7f923806fc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9244004d60 tx=0x7f924400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:23.857 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:23.869+0000 7f924d600700 1 -- 172.21.15.148:0/3962536836 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f923c057af0 con 0x7f92500fe900 2024-02-28T16:34:24.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.144+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f925004bf70 con 0x7f923806d7e0 2024-02-28T16:34:24.134 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.146+0000 7f924d600700 1 -- 172.21.15.148:0/3962536836 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f924400f040 con 0x7f923806d7e0 2024-02-28T16:34:24.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f923806d7e0 msgr2=0x7f923806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f923806d7e0 0x7f923806fc90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9244004d60 tx=0x7f924400b040 comp rx=0 tx=0).stop 2024-02-28T16:34:24.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 msgr2=0x7f92500fc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f92500fc2d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f923c000c00 tx=0x7f923c009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 shutdown_connections 2024-02-28T16:34:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f923806d7e0 0x7f923806fc90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92500fdf60 0x7f92500fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 --2- 172.21.15.148:0/3962536836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92500fe900 0x7f92500fc2d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.148+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 >> 172.21.15.148:0/3962536836 conn(0x7f92500f7a10 msgr2=0x7f92501016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.149+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 shutdown_connections 2024-02-28T16:34:24.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.149+0000 7f9258600700 1 -- 172.21.15.148:0/3962536836 wait complete. 2024-02-28T16:34:24.155 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:34:24.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 -- 172.21.15.148:0/2090308998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109d10 msgr2=0x7f9388103380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 --2- 172.21.15.148:0/2090308998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109d10 0x7f9388103380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9374004940 tx=0x7f9374009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:24.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 -- 172.21.15.148:0/2090308998 shutdown_connections 2024-02-28T16:34:24.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 --2- 172.21.15.148:0/2090308998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109d10 0x7f9388103380 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 --2- 172.21.15.148:0/2090308998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9388109370 0x7f9388109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 -- 172.21.15.148:0/2090308998 >> 172.21.15.148:0/2090308998 conn(0x7f9388072b80 msgr2=0x7f9388074f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:24.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 -- 172.21.15.148:0/2090308998 shutdown_connections 2024-02-28T16:34:24.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.296+0000 7f9387200700 1 -- 172.21.15.148:0/2090308998 wait complete. 2024-02-28T16:34:24.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.297+0000 7f9387200700 1 Processor -- start 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.297+0000 7f9387200700 1 -- start start 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9387200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109370 0x7f9388119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9387200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9388109d10 0x7f938811a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9387200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938811a970 con 0x7f9388109370 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9387200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388113cc0 con 0x7f9388109d10 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9385e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109370 0x7f9388119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9385e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109370 0x7f9388119de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33426/0 (socket says 172.21.15.148:33426) 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9385e00700 1 -- 172.21.15.148:0/2600067974 learned_addr learned my addr 172.21.15.148:0/2600067974 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9385e00700 1 -- 172.21.15.148:0/2600067974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9388109d10 msgr2=0x7f938811a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9385e00700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9388109d10 0x7f938811a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.298+0000 7f9385e00700 1 -- 172.21.15.148:0/2600067974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374005040 con 0x7f9388109370 2024-02-28T16:34:24.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.299+0000 7f9385e00700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109370 0x7f9388119de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f937800c8c0 tx=0x7f93780044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:24.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.299+0000 7f937e000700 1 -- 172.21.15.148:0/2600067974 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937800a980 con 0x7f9388109370 2024-02-28T16:34:24.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.299+0000 7f937e000700 1 -- 172.21.15.148:0/2600067974 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f937800ce60 con 0x7f9388109370 2024-02-28T16:34:24.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.299+0000 7f937e000700 1 -- 172.21.15.148:0/2600067974 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93780115e0 con 0x7f9388109370 2024-02-28T16:34:24.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.299+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9388113fa0 con 0x7f9388109370 2024-02-28T16:34:24.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.299+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9388114560 con 0x7f9388109370 2024-02-28T16:34:24.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.300+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938805f5c0 con 0x7f9388109370 2024-02-28T16:34:24.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.301+0000 7f937e000700 1 -- 172.21.15.148:0/2600067974 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9378012400 con 0x7f9388109370 2024-02-28T16:34:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.302+0000 7f937e000700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936c06d7f0 0x7f936c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.302+0000 7f937e000700 1 -- 172.21.15.148:0/2600067974 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f937808ce60 con 0x7f9388109370 2024-02-28T16:34:24.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.302+0000 7f9385400700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936c06d7f0 0x7f936c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:24.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.303+0000 7f9385400700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936c06d7f0 0x7f936c06fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9374004f90 tx=0x7f9374009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:24.295 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.307+0000 7f937e000700 1 -- 172.21.15.148:0/2600067974 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9378056820 con 0x7f9388109370 2024-02-28T16:34:24.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:24 smithi148 ceph-mon[112463]: Upgrade: Updating osd.1 2024-02-28T16:34:24.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:24.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:34:24.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:24.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:24 smithi148 ceph-mon[112463]: Deploying daemon osd.1 on smithi148 2024-02-28T16:34:24.392 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:24 smithi148 ceph-mon[112463]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:24.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.559+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9388115470 con 0x7f936c06d7f0 2024-02-28T16:34:24.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.561+0000 7f937e000700 1 -- 172.21.15.148:0/2600067974 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9388115470 con 0x7f936c06d7f0 2024-02-28T16:34:24.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.563+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936c06d7f0 msgr2=0x7f936c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.563+0000 7f9387200700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936c06d7f0 0x7f936c06fca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9374004f90 tx=0x7f9374009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:24.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.563+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109370 msgr2=0x7f9388119de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.563+0000 7f9387200700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109370 0x7f9388119de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f937800c8c0 tx=0x7f93780044c0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.564+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 shutdown_connections 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.564+0000 7f9387200700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936c06d7f0 0x7f936c06fca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.564+0000 7f9387200700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9388109370 0x7f9388119de0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.564+0000 7f9387200700 1 --2- 172.21.15.148:0/2600067974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9388109d10 0x7f938811a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.564+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 >> 172.21.15.148:0/2600067974 conn(0x7f9388072b80 msgr2=0x7f9388075620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.564+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 shutdown_connections 2024-02-28T16:34:24.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.564+0000 7f9387200700 1 -- 172.21.15.148:0/2600067974 wait complete. 2024-02-28T16:34:24.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 -- 172.21.15.148:0/3396934879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 msgr2=0x7f5a601033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 --2- 172.21.15.148:0/3396934879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a601033a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c004940 tx=0x7f5a4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:24.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 -- 172.21.15.148:0/3396934879 shutdown_connections 2024-02-28T16:34:24.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 --2- 172.21.15.148:0/3396934879 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a601033a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 --2- 172.21.15.148:0/3396934879 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a60109380 0x7f5a60109750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 -- 172.21.15.148:0/3396934879 >> 172.21.15.148:0/3396934879 conn(0x7f5a60072b50 msgr2=0x7f5a60074f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:24.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 -- 172.21.15.148:0/3396934879 shutdown_connections 2024-02-28T16:34:24.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.708+0000 7f5a65400700 1 -- 172.21.15.148:0/3396934879 wait complete. 2024-02-28T16:34:24.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.709+0000 7f5a65400700 1 Processor -- start 2024-02-28T16:34:24.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.709+0000 7f5a65400700 1 -- start start 2024-02-28T16:34:24.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a65400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a60109380 0x7f5a60119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:24.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a65400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a6011a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:24.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a65400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6011a940 con 0x7f5a60109d20 2024-02-28T16:34:24.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a65400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a60113c90 con 0x7f5a60109380 2024-02-28T16:34:24.698 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a5f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a6011a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:24.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a5f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a6011a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33438/0 (socket says 172.21.15.148:33438) 2024-02-28T16:34:24.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a5f400700 1 -- 172.21.15.148:0/3602400892 learned_addr learned my addr 172.21.15.148:0/3602400892 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a5fe00700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a60109380 0x7f5a60119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a5f400700 1 -- 172.21.15.148:0/3602400892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a60109380 msgr2=0x7f5a60119db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a5f400700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a60109380 0x7f5a60119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.710+0000 7f5a5f400700 1 -- 172.21.15.148:0/3602400892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c005040 con 0x7f5a60109d20 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.711+0000 7f5a5f400700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a6011a2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0090d0 tx=0x7f5a4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.711+0000 7f5a57e00700 1 -- 172.21.15.148:0/3602400892 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4c00e040 con 0x7f5a60109d20 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.711+0000 7f5a57e00700 1 -- 172.21.15.148:0/3602400892 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a4c00bbf0 con 0x7f5a60109d20 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.711+0000 7f5a57e00700 1 -- 172.21.15.148:0/3602400892 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a4c01c630 con 0x7f5a60109d20 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.711+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a60113f10 con 0x7f5a60109d20 2024-02-28T16:34:24.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.711+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a60114480 con 0x7f5a60109d20 2024-02-28T16:34:24.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.712+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6005f5c0 con 0x7f5a60109d20 2024-02-28T16:34:24.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.713+0000 7f5a57e00700 1 -- 172.21.15.148:0/3602400892 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5a4c00bd60 con 0x7f5a60109d20 2024-02-28T16:34:24.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.714+0000 7f5a57e00700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a4406d7e0 0x7f5a4406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:24.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.714+0000 7f5a57e00700 1 -- 172.21.15.148:0/3602400892 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5a4c08e1f0 con 0x7f5a60109d20 2024-02-28T16:34:24.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.715+0000 7f5a5fe00700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a4406d7e0 0x7f5a4406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:24.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.715+0000 7f5a5fe00700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a4406d7e0 0x7f5a4406fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a50004bc0 tx=0x7f5a50009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:24.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.719+0000 7f5a57e00700 1 -- 172.21.15.148:0/3602400892 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5a4c057b10 con 0x7f5a60109d20 2024-02-28T16:34:24.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:24 smithi157 ceph-mon[89328]: Upgrade: Updating osd.1 2024-02-28T16:34:24.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:24.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T16:34:24.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:24.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:24 smithi157 ceph-mon[89328]: Deploying daemon osd.1 on smithi148 2024-02-28T16:34:24.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:24 smithi157 ceph-mon[89328]: pgmap v81: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:24.928 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.939+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a601153d0 con 0x7f5a4406d7e0 2024-02-28T16:34:24.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.951+0000 7f5a57e00700 1 -- 172.21.15.148:0/3602400892 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f5a601153d0 con 0x7f5a4406d7e0 2024-02-28T16:34:24.940 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (4m) 12s ago 19m 14.7M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (60s) 12s ago 20m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (52s) 46s ago 18m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (3m) 12s ago 19m 74.9M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (11m) 12s ago 11m 14.8M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (11m) 12s ago 11m 145M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (11m) 46s ago 11m 14.7M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (11m) 46s ago 11m 14.5M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (7m) 12s ago 21m 498M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (5m) 46s ago 17m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (2m) 12s ago 21m 42.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (2m) 46s ago 17m 31.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (5m) 12s ago 20m 7998k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (5m) 46s ago 18m 7822k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:34:24.941 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (20s) 12s ago 16m 11.1M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:34:24.942 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (16m) 12s ago 16m 211M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 1849d1e53ff3 2024-02-28T16:34:24.942 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (15m) 12s ago 15m 181M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:34:24.942 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (15m) 46s ago 15m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:34:24.942 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (14m) 46s ago 14m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:34:24.942 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (13m) 46s ago 13m 193M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:34:24.942 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (4m) 12s ago 19m 52.4M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a4406d7e0 msgr2=0x7f5a4406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a4406d7e0 0x7f5a4406fc90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a50004bc0 tx=0x7f5a50009040 comp rx=0 tx=0).stop 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 msgr2=0x7f5a6011a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a6011a2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0090d0 tx=0x7f5a4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 shutdown_connections 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a4406d7e0 0x7f5a4406fc90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a60109380 0x7f5a60119db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 --2- 172.21.15.148:0/3602400892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a60109d20 0x7f5a6011a2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 >> 172.21.15.148:0/3602400892 conn(0x7f5a60072b50 msgr2=0x7f5a60075600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 shutdown_connections 2024-02-28T16:34:24.943 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:24.954+0000 7f5a65400700 1 -- 172.21.15.148:0/3602400892 wait complete. 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 -- 172.21.15.148:0/4095703107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb81038f0 msgr2=0x7facb80fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 --2- 172.21.15.148:0/4095703107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb81038f0 0x7facb80fcf60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faca4004940 tx=0x7faca4009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 -- 172.21.15.148:0/4095703107 shutdown_connections 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 --2- 172.21.15.148:0/4095703107 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb81038f0 0x7facb80fcf60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 --2- 172.21.15.148:0/4095703107 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb8102f50 0x7facb8103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 -- 172.21.15.148:0/4095703107 >> 172.21.15.148:0/4095703107 conn(0x7facb80f8ae0 msgr2=0x7facb80faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 -- 172.21.15.148:0/4095703107 shutdown_connections 2024-02-28T16:34:25.085 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.096+0000 7facbf000700 1 -- 172.21.15.148:0/4095703107 wait complete. 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.097+0000 7facbf000700 1 Processor -- start 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.097+0000 7facbf000700 1 -- start start 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facbf000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb8102f50 0x7facb8115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facbf000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb81038f0 0x7facb8116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facbf000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81168f0 con 0x7facb8102f50 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facbf000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb810fb70 con 0x7facb81038f0 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb8102f50 0x7facb8115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb8102f50 0x7facb8115cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33458/0 (socket says 172.21.15.148:33458) 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7e00700 1 -- 172.21.15.148:0/3774229067 learned_addr learned my addr 172.21.15.148:0/3774229067 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:25.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7400700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb81038f0 0x7facb8116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7e00700 1 -- 172.21.15.148:0/3774229067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb81038f0 msgr2=0x7facb8116210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7e00700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb81038f0 0x7facb8116210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7e00700 1 -- 172.21.15.148:0/3774229067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4005040 con 0x7facb8102f50 2024-02-28T16:34:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.098+0000 7facb7400700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb81038f0 0x7facb8116210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:34:25.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.099+0000 7facb7e00700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb8102f50 0x7facb8115cd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faca800b790 tx=0x7faca8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.099+0000 7facafe00700 1 -- 172.21.15.148:0/3774229067 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca800f770 con 0x7facb8102f50 2024-02-28T16:34:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.099+0000 7facafe00700 1 -- 172.21.15.148:0/3774229067 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faca800fda0 con 0x7facb8102f50 2024-02-28T16:34:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.099+0000 7facafe00700 1 -- 172.21.15.148:0/3774229067 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca800d310 con 0x7facb8102f50 2024-02-28T16:34:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.099+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb810fdf0 con 0x7facb8102f50 2024-02-28T16:34:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.099+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb81102e0 con 0x7facb8102f50 2024-02-28T16:34:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.100+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb80fc6e0 con 0x7facb8102f50 2024-02-28T16:34:25.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.101+0000 7facafe00700 1 -- 172.21.15.148:0/3774229067 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7faca8010420 con 0x7facb8102f50 2024-02-28T16:34:25.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.102+0000 7facafe00700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fac9c06d7e0 0x7fac9c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:25.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.102+0000 7facafe00700 1 -- 172.21.15.148:0/3774229067 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7faca808ce70 con 0x7facb8102f50 2024-02-28T16:34:25.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.102+0000 7facb7400700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fac9c06d7e0 0x7fac9c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:25.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.103+0000 7facb7400700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fac9c06d7e0 0x7fac9c06fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faca4000c00 tx=0x7faca4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:25.095 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.107+0000 7facafe00700 1 -- 172.21.15.148:0/3774229067 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faca805a2c0 con 0x7facb8102f50 2024-02-28T16:34:25.396 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.408+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7facb81112b0 con 0x7facb8102f50 2024-02-28T16:34:25.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.408+0000 7facafe00700 1 -- 172.21.15.148:0/3774229067 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7faca8059e50 con 0x7facb8102f50 2024-02-28T16:34:25.397 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:34:25.397 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:34:25.397 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:25.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:25.397 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 5, 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 9, 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:34:25.398 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:34:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.411+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fac9c06d7e0 msgr2=0x7fac9c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.411+0000 7facbf000700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fac9c06d7e0 0x7fac9c06fc90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faca4000c00 tx=0x7faca4009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.411+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb8102f50 msgr2=0x7facb8115cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.411+0000 7facbf000700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb8102f50 0x7facb8115cd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faca800b790 tx=0x7faca8009250 comp rx=0 tx=0).stop 2024-02-28T16:34:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.412+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 shutdown_connections 2024-02-28T16:34:25.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.412+0000 7facbf000700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fac9c06d7e0 0x7fac9c06fc90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.412+0000 7facbf000700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facb8102f50 0x7facb8115cd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.412+0000 7facbf000700 1 --2- 172.21.15.148:0/3774229067 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7facb81038f0 0x7facb8116210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.412+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 >> 172.21.15.148:0/3774229067 conn(0x7facb80f8ae0 msgr2=0x7facb80fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.412+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 shutdown_connections 2024-02-28T16:34:25.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.412+0000 7facbf000700 1 -- 172.21.15.148:0/3774229067 wait complete. 2024-02-28T16:34:25.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.551+0000 7f9387e00700 1 -- 172.21.15.148:0/2294616583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93801095f0 msgr2=0x7f93801099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.551+0000 7f9387e00700 1 --2- 172.21.15.148:0/2294616583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93801095f0 0x7f93801099c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9374004940 tx=0x7f9374009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:25.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.552+0000 7f9387e00700 1 -- 172.21.15.148:0/2294616583 shutdown_connections 2024-02-28T16:34:25.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.552+0000 7f9387e00700 1 --2- 172.21.15.148:0/2294616583 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9380103dc0 0x7f9380104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.552+0000 7f9387e00700 1 --2- 172.21.15.148:0/2294616583 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f93801095f0 0x7f93801099c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.552+0000 7f9387e00700 1 -- 172.21.15.148:0/2294616583 >> 172.21.15.148:0/2294616583 conn(0x7f9380072d50 msgr2=0x7f9380075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:25.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.552+0000 7f9387e00700 1 -- 172.21.15.148:0/2294616583 shutdown_connections 2024-02-28T16:34:25.541 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.552+0000 7f9387e00700 1 -- 172.21.15.148:0/2294616583 wait complete. 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.553+0000 7f9387e00700 1 Processor -- start 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.553+0000 7f9387e00700 1 -- start start 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.553+0000 7f9387e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9380103dc0 0x7f938011a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.553+0000 7f9387e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93801095f0 0x7f938011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.553+0000 7f9387e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938011ac70 con 0x7f9380103dc0 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.553+0000 7f9387e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9380113f80 con 0x7f93801095f0 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.554+0000 7f9385400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9380103dc0 0x7f938011a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:25.542 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.554+0000 7f9385400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9380103dc0 0x7f938011a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33478/0 (socket says 172.21.15.148:33478) 2024-02-28T16:34:25.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.554+0000 7f9385400700 1 -- 172.21.15.148:0/4151744523 learned_addr learned my addr 172.21.15.148:0/4151744523 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:25.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.554+0000 7f9384a00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93801095f0 0x7f938011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.554+0000 7f9385400700 1 -- 172.21.15.148:0/4151744523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93801095f0 msgr2=0x7f938011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.554+0000 7f9385400700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93801095f0 0x7f938011a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.554+0000 7f9385400700 1 -- 172.21.15.148:0/4151744523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9374005040 con 0x7f9380103dc0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.555+0000 7f9385400700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9380103dc0 0x7f938011a0e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9374009150 tx=0x7f9374009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.555+0000 7f937d600700 1 -- 172.21.15.148:0/4151744523 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937400e040 con 0x7f9380103dc0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.555+0000 7f937d600700 1 -- 172.21.15.148:0/4151744523 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f937400bbf0 con 0x7f9380103dc0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.555+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9380114200 con 0x7f9380103dc0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.555+0000 7f937d600700 1 -- 172.21.15.148:0/4151744523 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f937401c630 con 0x7f9380103dc0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.555+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9380114740 con 0x7f9380103dc0 2024-02-28T16:34:25.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.556+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93640052e0 con 0x7f9380103dc0 2024-02-28T16:34:25.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.557+0000 7f937d600700 1 -- 172.21.15.148:0/4151744523 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9374013420 con 0x7f9380103dc0 2024-02-28T16:34:25.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.559+0000 7f937d600700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936806d7f0 0x7f936806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:25.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.559+0000 7f937d600700 1 -- 172.21.15.148:0/4151744523 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f937408e1b0 con 0x7f9380103dc0 2024-02-28T16:34:25.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.559+0000 7f9384a00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936806d7f0 0x7f936806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:25.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.560+0000 7f9384a00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936806d7f0 0x7f936806fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9380115980 tx=0x7f9370009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:25.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.563+0000 7f937d600700 1 -- 172.21.15.148:0/4151744523 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f937405b600 con 0x7f9380103dc0 2024-02-28T16:34:25.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:25 smithi148 ceph-mon[112463]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:25.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:25 smithi148 ceph-mon[112463]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:25.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:25 smithi157 ceph-mon[89328]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:25.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:25 smithi157 ceph-mon[89328]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:25.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.822+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9364005da0 con 0x7f9380103dc0 2024-02-28T16:34:25.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.822+0000 7f937d600700 1 -- 172.21.15.148:0/4151744523 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f937405b190 con 0x7f9380103dc0 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:34:25.812 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:34:25.813 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:25.814 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:25.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936806d7f0 msgr2=0x7f936806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936806d7f0 0x7f936806fca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9380115980 tx=0x7f9370009ee0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9380103dc0 msgr2=0x7f938011a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9380103dc0 0x7f938011a0e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9374009150 tx=0x7f9374009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 shutdown_connections 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f936806d7f0 0x7f936806fca0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9380103dc0 0x7f938011a0e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 --2- 172.21.15.148:0/4151744523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93801095f0 0x7f938011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 >> 172.21.15.148:0/4151744523 conn(0x7f9380072d50 msgr2=0x7f9380074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.825+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 shutdown_connections 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:25.826+0000 7f9387e00700 1 -- 172.21.15.148:0/4151744523 wait complete. 2024-02-28T16:34:25.816 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 -- 172.21.15.148:0/2901305801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 msgr2=0x7f77d4103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 --2- 172.21.15.148:0/2901305801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4103320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77c8004940 tx=0x7f77c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 -- 172.21.15.148:0/2901305801 shutdown_connections 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 --2- 172.21.15.148:0/2901305801 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77d41038f0 0x7f77d40fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 --2- 172.21.15.148:0/2901305801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4103320 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 -- 172.21.15.148:0/2901305801 >> 172.21.15.148:0/2901305801 conn(0x7f77d40f8ae0 msgr2=0x7f77d40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 -- 172.21.15.148:0/2901305801 shutdown_connections 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.019+0000 7f77dc800700 1 -- 172.21.15.148:0/2901305801 wait complete. 2024-02-28T16:34:26.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77dc800700 1 Processor -- start 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77dc800700 1 -- start start 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77dc800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77dc800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77d41038f0 0x7f77d40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77dc800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4070e60 con 0x7f77d4102f50 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77dc800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d4070fd0 con 0x7f77d41038f0 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77d9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77d9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33494/0 (socket says 172.21.15.148:33494) 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.020+0000 7f77d9e00700 1 -- 172.21.15.148:0/2088319290 learned_addr learned my addr 172.21.15.148:0/2088319290 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77d9e00700 1 -- 172.21.15.148:0/2088319290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77d41038f0 msgr2=0x7f77d40707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77d9400700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77d41038f0 0x7f77d40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:26.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77d9e00700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77d41038f0 0x7f77d40707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77d9e00700 1 -- 172.21.15.148:0/2088319290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c8005040 con 0x7f77d4102f50 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77d9400700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77d41038f0 0x7f77d40707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77d9e00700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4070290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009fd0 tx=0x7f77c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77ce000700 1 -- 172.21.15.148:0/2088319290 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c800e040 con 0x7f77d4102f50 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77ce000700 1 -- 172.21.15.148:0/2088319290 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77c800bbf0 con 0x7f77d4102f50 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77ce000700 1 -- 172.21.15.148:0/2088319290 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77c801c3f0 con 0x7f77d4102f50 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.021+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d4119c90 con 0x7f77d4102f50 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.022+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d411a180 con 0x7f77d4102f50 2024-02-28T16:34:26.011 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.023+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d40fc6e0 con 0x7f77d4102f50 2024-02-28T16:34:26.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.024+0000 7f77ce000700 1 -- 172.21.15.148:0/2088319290 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f77c800bd60 con 0x7f77d4102f50 2024-02-28T16:34:26.012 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.024+0000 7f77ce000700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f77bc06d7f0 0x7f77bc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:26.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.024+0000 7f77ce000700 1 -- 172.21.15.148:0/2088319290 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f77c808e080 con 0x7f77d4102f50 2024-02-28T16:34:26.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.025+0000 7f77d9400700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f77bc06d7f0 0x7f77bc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:26.013 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.025+0000 7f77d9400700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f77bc06d7f0 0x7f77bc06fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77c4006fd0 tx=0x7f77c4008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:26.018 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.029+0000 7f77ce000700 1 -- 172.21.15.148:0/2088319290 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f77c8057a40 con 0x7f77d4102f50 2024-02-28T16:34:26.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.272+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f77d40fabc0 con 0x7f77bc06d7f0 2024-02-28T16:34:26.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.274+0000 7f77ce000700 1 -- 172.21.15.148:0/2088319290 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f77d40fabc0 con 0x7f77bc06d7f0 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "crash" 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "7/21 daemons upgraded", 2024-02-28T16:34:26.263 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:34:26.264 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:34:26.264 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:34:26.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.276+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f77bc06d7f0 msgr2=0x7f77bc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.276+0000 7f77dc800700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f77bc06d7f0 0x7f77bc06fca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f77c4006fd0 tx=0x7f77c4008040 comp rx=0 tx=0).stop 2024-02-28T16:34:26.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.276+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 msgr2=0x7f77d4070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.276+0000 7f77dc800700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4070290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009fd0 tx=0x7f77c8009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:26.265 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.277+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 shutdown_connections 2024-02-28T16:34:26.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.277+0000 7f77dc800700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f77bc06d7f0 0x7f77bc06fca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.277+0000 7f77dc800700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f77d4102f50 0x7f77d4070290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.277+0000 7f77dc800700 1 --2- 172.21.15.148:0/2088319290 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77d41038f0 0x7f77d40707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.277+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 >> 172.21.15.148:0/2088319290 conn(0x7f77d40f8ae0 msgr2=0x7f77d40fa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:26.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.277+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 shutdown_connections 2024-02-28T16:34:26.266 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.277+0000 7f77dc800700 1 -- 172.21.15.148:0/2088319290 wait complete. 2024-02-28T16:34:26.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.419+0000 7ff39d400700 1 -- 172.21.15.148:0/1629451608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff398102f50 msgr2=0x7ff398103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.419+0000 7ff39d400700 1 --2- 172.21.15.148:0/1629451608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff398102f50 0x7ff398103320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff388004940 tx=0x7ff388009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:26.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.419+0000 7ff39d400700 1 -- 172.21.15.148:0/1629451608 shutdown_connections 2024-02-28T16:34:26.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.419+0000 7ff39d400700 1 --2- 172.21.15.148:0/1629451608 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3981038f0 0x7ff3980fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.419+0000 7ff39d400700 1 --2- 172.21.15.148:0/1629451608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff398102f50 0x7ff398103320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.419+0000 7ff39d400700 1 -- 172.21.15.148:0/1629451608 >> 172.21.15.148:0/1629451608 conn(0x7ff3980f8ae0 msgr2=0x7ff3980faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:26.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.419+0000 7ff39d400700 1 -- 172.21.15.148:0/1629451608 shutdown_connections 2024-02-28T16:34:26.409 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:26 smithi148 ceph-mon[112463]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:26.409 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:26 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3774229067' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:26.409 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:26 smithi148 ceph-mon[112463]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:26.409 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:26 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4151744523' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:34:26.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.420+0000 7ff39d400700 1 -- 172.21.15.148:0/1629451608 wait complete. 2024-02-28T16:34:26.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.420+0000 7ff39d400700 1 Processor -- start 2024-02-28T16:34:26.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff39d400700 1 -- start start 2024-02-28T16:34:26.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff39d400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff398102f50 0x7ff398070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:26.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff39d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3981038f0 0x7ff3980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:26.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff39d400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398070dd0 con 0x7ff3981038f0 2024-02-28T16:34:26.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff39d400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff398070f40 con 0x7ff398102f50 2024-02-28T16:34:26.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff395e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3981038f0 0x7ff3980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:26.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff395e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3981038f0 0x7ff3980707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:33500/0 (socket says 172.21.15.148:33500) 2024-02-28T16:34:26.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff395e00700 1 -- 172.21.15.148:0/2045255777 learned_addr learned my addr 172.21.15.148:0/2045255777 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:26.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.421+0000 7ff396800700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff398102f50 0x7ff398070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:26.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.422+0000 7ff395e00700 1 -- 172.21.15.148:0/2045255777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff398102f50 msgr2=0x7ff398070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.422+0000 7ff395e00700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff398102f50 0x7ff398070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.422+0000 7ff395e00700 1 -- 172.21.15.148:0/2045255777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388005040 con 0x7ff3981038f0 2024-02-28T16:34:26.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.422+0000 7ff395e00700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3981038f0 0x7ff3980707d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c800 tx=0x7ff384004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:26.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.422+0000 7ff38ea00700 1 -- 172.21.15.148:0/2045255777 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff38400a760 con 0x7ff3981038f0 2024-02-28T16:34:26.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.423+0000 7ff38ea00700 1 -- 172.21.15.148:0/2045255777 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff38400ad90 con 0x7ff3981038f0 2024-02-28T16:34:26.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.422+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff398119c90 con 0x7ff3981038f0 2024-02-28T16:34:26.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.423+0000 7ff38ea00700 1 -- 172.21.15.148:0/2045255777 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3840113a0 con 0x7ff3981038f0 2024-02-28T16:34:26.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.423+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39811a170 con 0x7ff3981038f0 2024-02-28T16:34:26.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.424+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3980fc6e0 con 0x7ff3981038f0 2024-02-28T16:34:26.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.425+0000 7ff38ea00700 1 -- 172.21.15.148:0/2045255777 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff384012400 con 0x7ff3981038f0 2024-02-28T16:34:26.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.427+0000 7ff38ea00700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff37c06d7f0 0x7ff37c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:26.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.427+0000 7ff38ea00700 1 -- 172.21.15.148:0/2045255777 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff38408d940 con 0x7ff3981038f0 2024-02-28T16:34:26.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.427+0000 7ff396800700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff37c06d7f0 0x7ff37c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:26.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.428+0000 7ff396800700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff37c06d7f0 0x7ff37c06fca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff38800b3b0 tx=0x7ff388009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:26.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.430+0000 7ff38ea00700 1 -- 172.21.15.148:0/2045255777 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff384057300 con 0x7ff3981038f0 2024-02-28T16:34:26.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.741+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff39810a050 con 0x7ff3981038f0 2024-02-28T16:34:26.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.742+0000 7ff38ea00700 1 -- 172.21.15.148:0/2045255777 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7ff38405a9c0 con 0x7ff3981038f0 2024-02-28T16:34:26.730 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:34:26.730 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:34:26.730 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:34:26.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff37c06d7f0 msgr2=0x7ff37c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff37c06d7f0 0x7ff37c06fca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff38800b3b0 tx=0x7ff388009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3981038f0 msgr2=0x7ff3980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3981038f0 0x7ff3980707d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c800 tx=0x7ff384004470 comp rx=0 tx=0).stop 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 shutdown_connections 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff37c06d7f0 0x7ff37c06fca0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff398102f50 0x7ff398070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 --2- 172.21.15.148:0/2045255777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3981038f0 0x7ff3980707d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 >> 172.21.15.148:0/2045255777 conn(0x7ff3980f8ae0 msgr2=0x7ff3980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 shutdown_connections 2024-02-28T16:34:26.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:26.744+0000 7ff39d400700 1 -- 172.21.15.148:0/2045255777 wait complete. 2024-02-28T16:34:26.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:26 smithi157 ceph-mon[89328]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:26.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:26 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3774229067' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:26.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:26 smithi157 ceph-mon[89328]: pgmap v82: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:26.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:26 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4151744523' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:34:27.516 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:27 smithi148 ceph-mon[112463]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:27.516 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:27 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2045255777' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:34:27.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:27 smithi157 ceph-mon[89328]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:27.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:27 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2045255777' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:34:28.623 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:28 smithi148 systemd[1]: Stopping Ceph osd.1 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:34:28.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:28 smithi157 ceph-mon[89328]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:28.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:28.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:28.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:28 smithi148 ceph-mon[112463]: pgmap v83: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:29.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:29.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:29.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:29.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:28 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[54871]: 2024-02-28T16:34:28.747+0000 7f2b50600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:34:29.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:28 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[54871]: 2024-02-28T16:34:28.747+0000 7f2b50600700 -1 osd.1 54 *** Got signal Terminated *** 2024-02-28T16:34:29.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:28 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[54871]: 2024-02-28T16:34:28.747+0000 7f2b50600700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:34:29.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:29 smithi157 ceph-mon[89328]: osd.1 marked itself down and dead 2024-02-28T16:34:30.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:29 smithi148 ceph-mon[112463]: osd.1 marked itself down and dead 2024-02-28T16:34:30.373 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:30 smithi148 podman[129885]: 2024-02-28 16:34:30.29217711 +0000 UTC m=+1.680319719 container died 1849d1e53ff3d134b1c73f135c1d34bafd383483c7602c182a32fe1e8b2fe09d (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=quincy-c0f02e6, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-28T16:34:30.870 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:30 smithi148 ceph-mon[112463]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:30.870 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:30 smithi148 ceph-mon[112463]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:34:30.870 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:30 smithi148 ceph-mon[112463]: osdmap e55: 6 total, 5 up, 6 in 2024-02-28T16:34:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:30 smithi157 ceph-mon[89328]: pgmap v84: 65 pgs: 65 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:30 smithi157 ceph-mon[89328]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:34:30.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:30 smithi157 ceph-mon[89328]: osdmap e55: 6 total, 5 up, 6 in 2024-02-28T16:34:31.123 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:30 smithi148 podman[129885]: 2024-02-28 16:34:30.882302058 +0000 UTC m=+2.270444693 container cleanup 1849d1e53ff3d134b1c73f135c1d34bafd383483c7602c182a32fe1e8b2fe09d (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T16:34:31.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:30 smithi148 bash[129885]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1 2024-02-28T16:34:31.623 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:31 smithi148 podman[129905]: 2024-02-28 16:34:31.150433415 +0000 UTC m=+0.841624036 container remove 1849d1e53ff3d134b1c73f135c1d34bafd383483c7602c182a32fe1e8b2fe09d (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-28T16:34:31.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:31 smithi157 ceph-mon[89328]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T16:34:32.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:31 smithi148 ceph-mon[112463]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T16:34:32.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:31 smithi148 podman[129990]: 2024-02-28 16:34:31.793413039 +0000 UTC m=+0.034433325 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:34:32.125 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:31 smithi148 podman[129990]: 2024-02-28 16:34:31.960129548 +0000 UTC m=+0.201149856 container create 4f665e06cea904c5df41ba93f6ebbe7ac6595880f0e5934930419b2c0efcb0e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T16:34:32.374 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:32 smithi148 podman[129990]: 2024-02-28 16:34:32.2825268 +0000 UTC m=+0.523547171 container init 4f665e06cea904c5df41ba93f6ebbe7ac6595880f0e5934930419b2c0efcb0e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T16:34:32.374 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:32 smithi148 podman[129990]: 2024-02-28 16:34:32.296272261 +0000 UTC m=+0.537292602 container start 4f665e06cea904c5df41ba93f6ebbe7ac6595880f0e5934930419b2c0efcb0e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD) 2024-02-28T16:34:32.374 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:32 smithi148 podman[129990]: 2024-02-28 16:34:32.381295247 +0000 UTC m=+0.622315602 container attach 4f665e06cea904c5df41ba93f6ebbe7ac6595880f0e5934930419b2c0efcb0e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:34:32.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:32 smithi157 ceph-mon[89328]: pgmap v87: 65 pgs: 12 stale+active+clean, 53 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:32 smithi148 ceph-mon[112463]: pgmap v87: 65 pgs: 12 stale+active+clean, 53 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:33.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:32 smithi148 podman[129990]: 2024-02-28 16:34:32.728167967 +0000 UTC m=+0.969188265 container died 4f665e06cea904c5df41ba93f6ebbe7ac6595880f0e5934930419b2c0efcb0e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, ceph=True) 2024-02-28T16:34:33.779 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:33 smithi148 podman[130015]: 2024-02-28 16:34:33.534789106 +0000 UTC m=+0.785269253 container remove 4f665e06cea904c5df41ba93f6ebbe7ac6595880f0e5934930419b2c0efcb0e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:34:33.779 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:33 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-28T16:34:33.780 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:33 smithi148 systemd[1]: Stopped Ceph osd.1 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:34:33.780 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:33 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.1.service: Consumed 1min 34.830s CPU time. 2024-02-28T16:34:34.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:33 smithi148 ceph-mon[112463]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:34:34.123 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:33 smithi148 systemd[1]: Starting Ceph osd.1 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:34:34.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:33 smithi157 ceph-mon[89328]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:34:34.623 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:34 smithi148 podman[130113]: 2024-02-28 16:34:34.217903051 +0000 UTC m=+0.035108955 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:34:34.624 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:34 smithi148 podman[130113]: 2024-02-28 16:34:34.402459705 +0000 UTC m=+0.219665632 container create fefe9967a099e3ddee8262c0afc00cd6ac68646bc1ebaf4a100737fbc8f13600 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-1fb5d10, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-28T16:34:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:34 smithi148 ceph-mon[112463]: pgmap v88: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:35.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:34 smithi148 podman[130113]: 2024-02-28 16:34:34.714538705 +0000 UTC m=+0.531744639 container init fefe9967a099e3ddee8262c0afc00cd6ac68646bc1ebaf4a100737fbc8f13600 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-28T16:34:35.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:34 smithi148 podman[130113]: 2024-02-28 16:34:34.725295428 +0000 UTC m=+0.542501335 container start fefe9967a099e3ddee8262c0afc00cd6ac68646bc1ebaf4a100737fbc8f13600 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-02-28T16:34:35.124 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:34 smithi148 podman[130113]: 2024-02-28 16:34:34.830135772 +0000 UTC m=+0.647341783 container attach fefe9967a099e3ddee8262c0afc00cd6ac68646bc1ebaf4a100737fbc8f13600 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:34:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:34 smithi157 ceph-mon[89328]: pgmap v88: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:35.874 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate[130128]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:34:35.875 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate[130128]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:34:35.875 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 bash[130113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:34:35.875 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 bash[130113]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:34:35.875 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 bash[130113]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:34:35.875 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 bash[130113]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:34:35.875 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 bash[130113]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T16:34:35.876 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 bash[130113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:34:35.876 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 bash[130113]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T16:34:35.876 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate[130128]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:34:35.876 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate[130128]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:34:35.876 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate[130128]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T16:34:35.877 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate[130128]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T16:34:35.877 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate[130128]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T16:34:35.877 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:35 smithi148 podman[130113]: 2024-02-28 16:34:35.639526572 +0000 UTC m=+1.456732519 container died fefe9967a099e3ddee8262c0afc00cd6ac68646bc1ebaf4a100737fbc8f13600 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-02-28T16:34:36.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:36 smithi148 ceph-mon[112463]: pgmap v89: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:36.874 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:36 smithi148 podman[130256]: 2024-02-28 16:34:36.551110899 +0000 UTC m=+0.892591326 container remove fefe9967a099e3ddee8262c0afc00cd6ac68646bc1ebaf4a100737fbc8f13600 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-activate, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-28T16:34:37.039 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:36 smithi157 ceph-mon[89328]: pgmap v89: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:37.151 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:36 smithi148 podman[130315]: 2024-02-28 16:34:36.812270083 +0000 UTC m=+0.039552767 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:34:37.151 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:36 smithi148 podman[130315]: 2024-02-28 16:34:36.927055727 +0000 UTC m=+0.154338442 container create b31a8f1e54838295c624b598cdb36eef67f07932b72d965fa09b9aa20a93ac2f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:34:37.623 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:37 smithi148 podman[130315]: 2024-02-28 16:34:37.31352808 +0000 UTC m=+0.540810802 container init b31a8f1e54838295c624b598cdb36eef67f07932b72d965fa09b9aa20a93ac2f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:34:37.623 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:37 smithi148 podman[130315]: 2024-02-28 16:34:37.323702065 +0000 UTC m=+0.550984787 container start b31a8f1e54838295c624b598cdb36eef67f07932b72d965fa09b9aa20a93ac2f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-28T16:34:37.623 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:37 smithi148 ceph-osd[130334]: -- 172.21.15.148:0/1581380216 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5607bca17680 con 0x5607bc9e0c00 2024-02-28T16:34:37.624 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:37 smithi148 bash[130315]: b31a8f1e54838295c624b598cdb36eef67f07932b72d965fa09b9aa20a93ac2f 2024-02-28T16:34:37.624 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:37 smithi148 systemd[1]: Started Ceph osd.1 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:34:38.373 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:37 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[130330]: 2024-02-28T16:34:37.901+0000 7fb8a8c247c0 -1 Falling back to public interface 2024-02-28T16:34:38.707 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:38.707 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:38.707 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:38.707 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:38 smithi157 ceph-mon[89328]: pgmap v90: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:38.707 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:38.708 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:38 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:38.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:38.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:38.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:38.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:38 smithi148 ceph-mon[112463]: pgmap v90: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:38.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:38.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:38 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:40.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:40 smithi157 ceph-mon[89328]: pgmap v91: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:40.987 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:40 smithi148 ceph-mon[112463]: pgmap v91: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:42.798 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:42 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[130330]: 2024-02-28T16:34:42.504+0000 7fb8a8c247c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-28T16:34:42.798 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:42 smithi148 ceph-mon[112463]: pgmap v92: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:42.798 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:42.799 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:42.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:42 smithi157 ceph-mon[89328]: pgmap v92: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:42.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:42.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:43.123 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:42 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[130330]: 2024-02-28T16:34:42.914+0000 7fb8a8c247c0 -1 osd.1 54 log_to_monitors true 2024-02-28T16:34:43.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:43 smithi157 ceph-mon[89328]: from='osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:34:44.036 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:43 smithi148 ceph-mon[112463]: from='osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T16:34:44.036 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:34:43 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[130330]: 2024-02-28T16:34:43.748+0000 7fb898000700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:34:44.970 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:44 smithi148 ceph-mon[112463]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:44.970 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:44 smithi148 ceph-mon[112463]: from='osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:34:44.970 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:44 smithi148 ceph-mon[112463]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T16:34:44.970 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:44 smithi148 ceph-mon[112463]: from='osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:34:44.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:44 smithi157 ceph-mon[89328]: pgmap v93: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:44.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:44 smithi157 ceph-mon[89328]: from='osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T16:34:44.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:44 smithi157 ceph-mon[89328]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T16:34:44.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:44 smithi157 ceph-mon[89328]: from='osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:34:46.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:45 smithi148 ceph-mon[112463]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:34:46.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:45 smithi148 ceph-mon[112463]: osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407] boot 2024-02-28T16:34:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:45 smithi148 ceph-mon[112463]: osdmap e58: 6 total, 6 up, 6 in 2024-02-28T16:34:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:45 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:34:46.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:45 smithi148 ceph-mon[112463]: osdmap e59: 6 total, 6 up, 6 in 2024-02-28T16:34:46.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:45 smithi157 ceph-mon[89328]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:34:46.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:45 smithi157 ceph-mon[89328]: osd.1 [v2:172.21.15.148:6810/3822469407,v1:172.21.15.148:6811/3822469407] boot 2024-02-28T16:34:46.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:45 smithi157 ceph-mon[89328]: osdmap e58: 6 total, 6 up, 6 in 2024-02-28T16:34:46.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:45 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T16:34:46.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:45 smithi157 ceph-mon[89328]: osdmap e59: 6 total, 6 up, 6 in 2024-02-28T16:34:47.025 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:46 smithi148 ceph-mon[112463]: pgmap v96: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:47.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:47.026 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:46 smithi157 ceph-mon[89328]: pgmap v96: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:47.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:48.836 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:48 smithi148 ceph-mon[112463]: pgmap v98: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:48.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:48.837 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:48 smithi157 ceph-mon[89328]: pgmap v98: 65 pgs: 13 active+undersized+degraded, 19 active+undersized, 33 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:34:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:49.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:49 smithi148 ceph-mon[112463]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded) 2024-02-28T16:34:49.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:49 smithi157 ceph-mon[89328]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 34/264 objects degraded (12.879%), 13 pgs degraded) 2024-02-28T16:34:50.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:50 smithi157 ceph-mon[89328]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:51.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:50 smithi148 ceph-mon[112463]: pgmap v99: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:52.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:52 smithi148 ceph-mon[112463]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:52.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:52 smithi157 ceph-mon[89328]: pgmap v100: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:54.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:54.980 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:54.981 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: pgmap v101: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:54.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:34:55.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:55 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:34:55.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:55 smithi157 ceph-mon[89328]: Upgrade: osd.2 is safe to restart 2024-02-28T16:34:55.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:55 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T16:34:55.993 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:55 smithi148 ceph-mon[112463]: Upgrade: osd.2 is safe to restart 2024-02-28T16:34:56.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 -- 172.21.15.148:0/4017845160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 msgr2=0x7f4bf8102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 --2- 172.21.15.148:0/4017845160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8102210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4be8004940 tx=0x7f4be8009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 -- 172.21.15.148:0/4017845160 shutdown_connections 2024-02-28T16:34:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 --2- 172.21.15.148:0/4017845160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bf81027e0 0x7f4bf80fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 --2- 172.21.15.148:0/4017845160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8102210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 -- 172.21.15.148:0/4017845160 >> 172.21.15.148:0/4017845160 conn(0x7f4bf8071d90 msgr2=0x7f4bf8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 -- 172.21.15.148:0/4017845160 shutdown_connections 2024-02-28T16:34:56.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.907+0000 7f4bfde00700 1 -- 172.21.15.148:0/4017845160 wait complete. 2024-02-28T16:34:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.908+0000 7f4bfde00700 1 Processor -- start 2024-02-28T16:34:56.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.908+0000 7f4bfde00700 1 -- start start 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.908+0000 7f4bfde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.908+0000 7f4bfde00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bf81027e0 0x7f4bf8116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.908+0000 7f4bfde00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf81167b0 con 0x7f4bf8101e40 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.908+0000 7f4bfde00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf810fb00 con 0x7f4bf81027e0 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47088/0 (socket says 172.21.15.148:47088) 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6a00700 1 -- 172.21.15.148:0/1206605937 learned_addr learned my addr 172.21.15.148:0/1206605937 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6000700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bf81027e0 0x7f4bf8116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6a00700 1 -- 172.21.15.148:0/1206605937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bf81027e0 msgr2=0x7f4bf8116160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6a00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bf81027e0 0x7f4bf8116160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6a00700 1 -- 172.21.15.148:0/1206605937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8005040 con 0x7f4bf8101e40 2024-02-28T16:34:56.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.909+0000 7f4bf6a00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8115c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009150 tx=0x7f4be8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:56.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.910+0000 7f4beea00700 1 -- 172.21.15.148:0/1206605937 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be800e040 con 0x7f4bf8101e40 2024-02-28T16:34:56.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.910+0000 7f4beea00700 1 -- 172.21.15.148:0/1206605937 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4be800bbf0 con 0x7f4bf8101e40 2024-02-28T16:34:56.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.910+0000 7f4beea00700 1 -- 172.21.15.148:0/1206605937 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4be801c630 con 0x7f4bf8101e40 2024-02-28T16:34:56.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.910+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf810fd80 con 0x7f4bf8101e40 2024-02-28T16:34:56.899 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.910+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf81102c0 con 0x7f4bf8101e40 2024-02-28T16:34:56.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.911+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf80738b0 con 0x7f4bf8101e40 2024-02-28T16:34:56.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.912+0000 7f4beea00700 1 -- 172.21.15.148:0/1206605937 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4be800bd60 con 0x7f4bf8101e40 2024-02-28T16:34:56.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.913+0000 7f4beea00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4bdc06d7f0 0x7f4bdc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:56.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.913+0000 7f4beea00700 1 -- 172.21.15.148:0/1206605937 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4be808e180 con 0x7f4bf8101e40 2024-02-28T16:34:56.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.913+0000 7f4bf6000700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4bdc06d7f0 0x7f4bdc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:56.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.914+0000 7f4bf6000700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4bdc06d7f0 0x7f4bdc06fca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009fd0 tx=0x7f4be4009f20 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:56.907 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:56.918+0000 7f4beea00700 1 -- 172.21.15.148:0/1206605937 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4be8057b40 con 0x7f4bf8101e40 2024-02-28T16:34:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:56 smithi157 ceph-mon[89328]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:34:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:56 smithi148 ceph-mon[112463]: pgmap v102: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T16:34:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:34:57.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.168+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bf8111200 con 0x7f4bdc06d7f0 2024-02-28T16:34:57.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.170+0000 7f4beea00700 1 -- 172.21.15.148:0/1206605937 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4bf8111200 con 0x7f4bdc06d7f0 2024-02-28T16:34:57.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.173+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4bdc06d7f0 msgr2=0x7f4bdc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.173+0000 7f4bfde00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4bdc06d7f0 0x7f4bdc06fca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009fd0 tx=0x7f4be4009f20 comp rx=0 tx=0).stop 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.173+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 msgr2=0x7f4bf8115c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.173+0000 7f4bfde00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8115c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009150 tx=0x7f4be8009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.174+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 shutdown_connections 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.174+0000 7f4bfde00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4bdc06d7f0 0x7f4bdc06fca0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.174+0000 7f4bfde00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bf8101e40 0x7f4bf8115c20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.174+0000 7f4bfde00700 1 --2- 172.21.15.148:0/1206605937 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4bf81027e0 0x7f4bf8116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.174+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 >> 172.21.15.148:0/1206605937 conn(0x7f4bf8071d90 msgr2=0x7f4bf8065700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.174+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 shutdown_connections 2024-02-28T16:34:57.163 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.174+0000 7f4bfde00700 1 -- 172.21.15.148:0/1206605937 wait complete. 2024-02-28T16:34:57.179 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 -- 172.21.15.148:0/2627763740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 msgr2=0x7f44f81099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 --2- 172.21.15.148:0/2627763740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f81099c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f44e8004940 tx=0x7f44e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 -- 172.21.15.148:0/2627763740 shutdown_connections 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 --2- 172.21.15.148:0/2627763740 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44f8103dc0 0x7f44f8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 --2- 172.21.15.148:0/2627763740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f81099c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 -- 172.21.15.148:0/2627763740 >> 172.21.15.148:0/2627763740 conn(0x7f44f8072d50 msgr2=0x7f44f8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 -- 172.21.15.148:0/2627763740 shutdown_connections 2024-02-28T16:34:57.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.323+0000 7f44fd600700 1 -- 172.21.15.148:0/2627763740 wait complete. 2024-02-28T16:34:57.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.324+0000 7f44fd600700 1 Processor -- start 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.324+0000 7f44fd600700 1 -- start start 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44fd600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44f8103dc0 0x7f44f811a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44fd600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f811a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44fd600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f811ac70 con 0x7f44f81095f0 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44fd600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8113f80 con 0x7f44f8103dc0 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f811a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f811a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47096/0 (socket says 172.21.15.148:47096) 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6000700 1 -- 172.21.15.148:0/2417826657 learned_addr learned my addr 172.21.15.148:0/2417826657 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6a00700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44f8103dc0 0x7f44f811a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6000700 1 -- 172.21.15.148:0/2417826657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44f8103dc0 msgr2=0x7f44f811a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6000700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44f8103dc0 0x7f44f811a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6000700 1 -- 172.21.15.148:0/2417826657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e8005040 con 0x7f44f81095f0 2024-02-28T16:34:57.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.325+0000 7f44f6a00700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44f8103dc0 0x7f44f811a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:34:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.326+0000 7f44f6000700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f811a620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44e4002a50 tx=0x7f44e40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.326+0000 7f44eea00700 1 -- 172.21.15.148:0/2417826657 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e4007cc0 con 0x7f44f81095f0 2024-02-28T16:34:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.326+0000 7f44eea00700 1 -- 172.21.15.148:0/2417826657 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f44e400f040 con 0x7f44f81095f0 2024-02-28T16:34:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.326+0000 7f44eea00700 1 -- 172.21.15.148:0/2417826657 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44e4009640 con 0x7f44f81095f0 2024-02-28T16:34:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.326+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f8114260 con 0x7f44f81095f0 2024-02-28T16:34:57.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.326+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f81147a0 con 0x7f44f81095f0 2024-02-28T16:34:57.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.327+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f8106850 con 0x7f44f81095f0 2024-02-28T16:34:57.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.328+0000 7f44eea00700 1 -- 172.21.15.148:0/2417826657 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f44e40097a0 con 0x7f44f81095f0 2024-02-28T16:34:57.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.329+0000 7f44eea00700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f44dc06d7e0 0x7f44dc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.329+0000 7f44eea00700 1 -- 172.21.15.148:0/2417826657 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f44e408cb70 con 0x7f44f81095f0 2024-02-28T16:34:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.330+0000 7f44f6a00700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f44dc06d7e0 0x7f44dc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:57.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.330+0000 7f44f6a00700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f44dc06d7e0 0x7f44dc06fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f44e8004560 tx=0x7f44e8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:57.322 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.334+0000 7f44eea00700 1 -- 172.21.15.148:0/2417826657 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f44e4059fc0 con 0x7f44f81095f0 2024-02-28T16:34:57.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.577+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f44f81156c0 con 0x7f44dc06d7e0 2024-02-28T16:34:57.568 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.580+0000 7f44eea00700 1 -- 172.21.15.148:0/2417826657 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f44f81156c0 con 0x7f44dc06d7e0 2024-02-28T16:34:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f44dc06d7e0 msgr2=0x7f44dc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f44dc06d7e0 0x7f44dc06fc90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f44e8004560 tx=0x7f44e8009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 msgr2=0x7f44f811a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f811a620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44e4002a50 tx=0x7f44e40046b0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 shutdown_connections 2024-02-28T16:34:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f44dc06d7e0 0x7f44dc06fc90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f44f8103dc0 0x7f44f811a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 --2- 172.21.15.148:0/2417826657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f81095f0 0x7f44f811a620 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.582+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 >> 172.21.15.148:0/2417826657 conn(0x7f44f8072d50 msgr2=0x7f44f8074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.583+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 shutdown_connections 2024-02-28T16:34:57.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.583+0000 7f44fd600700 1 -- 172.21.15.148:0/2417826657 wait complete. 2024-02-28T16:34:57.727 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.738+0000 7fea46600700 1 -- 172.21.15.148:0/3657125256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea40102f50 msgr2=0x7fea40103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.738+0000 7fea46600700 1 --2- 172.21.15.148:0/3657125256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea40102f50 0x7fea40103320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fea30004940 tx=0x7fea30009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:57.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.739+0000 7fea46600700 1 -- 172.21.15.148:0/3657125256 shutdown_connections 2024-02-28T16:34:57.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.739+0000 7fea46600700 1 --2- 172.21.15.148:0/3657125256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea401038f0 0x7fea400fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.739+0000 7fea46600700 1 --2- 172.21.15.148:0/3657125256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea40102f50 0x7fea40103320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.739+0000 7fea46600700 1 -- 172.21.15.148:0/3657125256 >> 172.21.15.148:0/3657125256 conn(0x7fea400f8ae0 msgr2=0x7fea400faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:57.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.739+0000 7fea46600700 1 -- 172.21.15.148:0/3657125256 shutdown_connections 2024-02-28T16:34:57.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.739+0000 7fea46600700 1 -- 172.21.15.148:0/3657125256 wait complete. 2024-02-28T16:34:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.740+0000 7fea46600700 1 Processor -- start 2024-02-28T16:34:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.740+0000 7fea46600700 1 -- start start 2024-02-28T16:34:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.741+0000 7fea46600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea401038f0 0x7fea40115e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:57.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.741+0000 7fea46600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea401163a0 0x7fea4010fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.741+0000 7fea46600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea401169b0 con 0x7fea401038f0 2024-02-28T16:34:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.741+0000 7fea46600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea40110240 con 0x7fea401163a0 2024-02-28T16:34:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.741+0000 7fea3f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea401038f0 0x7fea40115e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.741+0000 7fea3f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea401038f0 0x7fea40115e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47118/0 (socket says 172.21.15.148:47118) 2024-02-28T16:34:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.741+0000 7fea3f400700 1 -- 172.21.15.148:0/2267345093 learned_addr learned my addr 172.21.15.148:0/2267345093 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:57.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.742+0000 7fea3ea00700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea401163a0 0x7fea4010fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:57.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.742+0000 7fea3f400700 1 -- 172.21.15.148:0/2267345093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea401163a0 msgr2=0x7fea4010fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:57.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.742+0000 7fea3f400700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea401163a0 0x7fea4010fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:57.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.742+0000 7fea3f400700 1 -- 172.21.15.148:0/2267345093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30005040 con 0x7fea401038f0 2024-02-28T16:34:57.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.743+0000 7fea3f400700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea401038f0 0x7fea40115e60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea30013000 tx=0x7fea30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:57.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.743+0000 7fea37400700 1 -- 172.21.15.148:0/2267345093 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea3000e040 con 0x7fea401038f0 2024-02-28T16:34:57.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.744+0000 7fea37400700 1 -- 172.21.15.148:0/2267345093 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea30013420 con 0x7fea401038f0 2024-02-28T16:34:57.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.744+0000 7fea37400700 1 -- 172.21.15.148:0/2267345093 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea3000bee0 con 0x7fea401038f0 2024-02-28T16:34:57.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.744+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea401104c0 con 0x7fea401038f0 2024-02-28T16:34:57.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.744+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea40110a00 con 0x7fea401038f0 2024-02-28T16:34:57.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.745+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea400fc6e0 con 0x7fea401038f0 2024-02-28T16:34:57.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.746+0000 7fea37400700 1 -- 172.21.15.148:0/2267345093 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fea30013590 con 0x7fea401038f0 2024-02-28T16:34:57.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.748+0000 7fea37400700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fea2406d980 0x7fea2406fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:57.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.748+0000 7fea37400700 1 -- 172.21.15.148:0/2267345093 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fea3008e030 con 0x7fea401038f0 2024-02-28T16:34:57.736 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.748+0000 7fea3ea00700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fea2406d980 0x7fea2406fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:57.737 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.749+0000 7fea3ea00700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fea2406d980 0x7fea2406fe30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea400672c0 tx=0x7fea2c0091a0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:57.740 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.752+0000 7fea37400700 1 -- 172.21.15.148:0/2267345093 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fea300c1d20 con 0x7fea401038f0 2024-02-28T16:34:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:57 smithi148 ceph-mon[112463]: Upgrade: Updating osd.2 2024-02-28T16:34:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:57 smithi148 ceph-mon[112463]: Deploying daemon osd.2 on smithi148 2024-02-28T16:34:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:57.823 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:57.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:57.987+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea4004bf70 con 0x7fea2406d980 2024-02-28T16:34:57.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:57 smithi157 ceph-mon[89328]: Upgrade: Updating osd.2 2024-02-28T16:34:57.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:57 smithi157 ceph-mon[89328]: Deploying daemon osd.2 on smithi148 2024-02-28T16:34:57.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:57 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:57 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:34:57.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.010+0000 7fea37400700 1 -- 172.21.15.148:0/2267345093 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fea2c00e6d0 con 0x7fea2406d980 2024-02-28T16:34:57.998 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (4m) 12s ago 20m 14.0M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (93s) 12s ago 20m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (85s) 80s ago 19m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (4m) 12s ago 20m 74.9M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (12m) 12s ago 12m 14.9M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (12m) 12s ago 12m 145M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (12m) 80s ago 12m 14.7M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (12m) 80s ago 12m 14.5M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (7m) 12s ago 22m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (6m) 80s ago 18m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (3m) 12s ago 22m 44.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (2m) 80s ago 18m 31.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:34:57.999 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (5m) 12s ago 20m 7864k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (5m) 80s ago 18m 7822k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (53s) 12s ago 17m 81.9M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (21s) 12s ago 16m 11.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (16m) 12s ago 16m 179M 1558M 17.2.7-535-gc0f02e60 1c37ed371348 0c6337b54f4a 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (15m) 80s ago 15m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (14m) 80s ago 14m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (14m) 80s ago 14m 193M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:34:58.000 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (5m) 12s ago 19m 52.5M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:34:58.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fea2406d980 msgr2=0x7fea2406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fea2406d980 0x7fea2406fe30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea400672c0 tx=0x7fea2c0091a0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea401038f0 msgr2=0x7fea40115e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea401038f0 0x7fea40115e60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea30013000 tx=0x7fea30009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 shutdown_connections 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fea2406d980 0x7fea2406fe30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fea401038f0 0x7fea40115e60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 --2- 172.21.15.148:0/2267345093 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fea401163a0 0x7fea4010fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 >> 172.21.15.148:0/2267345093 conn(0x7fea400f8ae0 msgr2=0x7fea400fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 shutdown_connections 2024-02-28T16:34:58.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.013+0000 7fea46600700 1 -- 172.21.15.148:0/2267345093 wait complete. 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 -- 172.21.15.148:0/4233682598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c00702d0 msgr2=0x7f89c00706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 --2- 172.21.15.148:0/4233682598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c00702d0 0x7f89c00706a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f89b0004970 tx=0x7f89b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 -- 172.21.15.148:0/4233682598 shutdown_connections 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 --2- 172.21.15.148:0/4233682598 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89c0070be0 0x7f89c01092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 --2- 172.21.15.148:0/4233682598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c00702d0 0x7f89c00706a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 -- 172.21.15.148:0/4233682598 >> 172.21.15.148:0/4233682598 conn(0x7f89c00f8ae0 msgr2=0x7f89c00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 -- 172.21.15.148:0/4233682598 shutdown_connections 2024-02-28T16:34:58.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.163+0000 7f89c5400700 1 -- 172.21.15.148:0/4233682598 wait complete. 2024-02-28T16:34:58.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.164+0000 7f89c5400700 1 Processor -- start 2024-02-28T16:34:58.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.164+0000 7f89c5400700 1 -- start start 2024-02-28T16:34:58.154 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89c5400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89c00702d0 0x7f89c0115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89c5400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c0070be0 0x7f89c0116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89c5400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c01167b0 con 0x7f89c0070be0 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89c5400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c010fae0 con 0x7f89c00702d0 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89bde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c0070be0 0x7f89c0116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89bde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c0070be0 0x7f89c0116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47140/0 (socket says 172.21.15.148:47140) 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89bde00700 1 -- 172.21.15.148:0/4197945762 learned_addr learned my addr 172.21.15.148:0/4197945762 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89be800700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89c00702d0 0x7f89c0115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89bde00700 1 -- 172.21.15.148:0/4197945762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89c00702d0 msgr2=0x7f89c0115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89bde00700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89c00702d0 0x7f89c0115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.165+0000 7f89bde00700 1 -- 172.21.15.148:0/4197945762 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0005040 con 0x7f89c0070be0 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.166+0000 7f89bde00700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c0070be0 0x7f89c0116160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00c8c0 tx=0x7f89ac0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.166+0000 7f89b6a00700 1 -- 172.21.15.148:0/4197945762 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ac00a980 con 0x7f89c0070be0 2024-02-28T16:34:58.155 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.166+0000 7f89b6a00700 1 -- 172.21.15.148:0/4197945762 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89ac00ce60 con 0x7f89c0070be0 2024-02-28T16:34:58.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.166+0000 7f89b6a00700 1 -- 172.21.15.148:0/4197945762 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ac0115e0 con 0x7f89c0070be0 2024-02-28T16:34:58.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.166+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c010fdc0 con 0x7f89c0070be0 2024-02-28T16:34:58.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.166+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c0110300 con 0x7f89c0070be0 2024-02-28T16:34:58.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.167+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c0106980 con 0x7f89c0070be0 2024-02-28T16:34:58.156 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.168+0000 7f89b6a00700 1 -- 172.21.15.148:0/4197945762 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f89ac012400 con 0x7f89c0070be0 2024-02-28T16:34:58.157 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.169+0000 7f89b6a00700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89a406d7f0 0x7f89a406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:58.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.169+0000 7f89b6a00700 1 -- 172.21.15.148:0/4197945762 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f89ac08cf20 con 0x7f89c0070be0 2024-02-28T16:34:58.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.169+0000 7f89be800700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89a406d7f0 0x7f89a406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:58.158 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.170+0000 7f89be800700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89a406d7f0 0x7f89a406fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000c00 tx=0x7f89b0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:58.162 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.174+0000 7f89b6a00700 1 -- 172.21.15.148:0/4197945762 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f89ac05a350 con 0x7f89c0070be0 2024-02-28T16:34:58.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.487+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89c010c240 con 0x7f89c0070be0 2024-02-28T16:34:58.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.488+0000 7f89b6a00700 1 -- 172.21.15.148:0/4197945762 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f89ac0126b0 con 0x7f89c0070be0 2024-02-28T16:34:58.477 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:34:58.477 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:34:58.477 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:58.477 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4, 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:34:58.478 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 8, 2024-02-28T16:34:58.479 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:34:58.479 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:34:58.479 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89a406d7f0 msgr2=0x7f89a406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89a406d7f0 0x7f89a406fca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f89b0000c00 tx=0x7f89b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c0070be0 msgr2=0x7f89c0116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c0070be0 0x7f89c0116160 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00c8c0 tx=0x7f89ac0044c0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 shutdown_connections 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89a406d7f0 0x7f89a406fca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f89c00702d0 0x7f89c0115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 --2- 172.21.15.148:0/4197945762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f89c0070be0 0x7f89c0116160 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 >> 172.21.15.148:0/4197945762 conn(0x7f89c00f8ae0 msgr2=0x7f89c0103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:58.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 shutdown_connections 2024-02-28T16:34:58.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.492+0000 7f89c5400700 1 -- 172.21.15.148:0/4197945762 wait complete. 2024-02-28T16:34:58.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 -- 172.21.15.148:0/1501294777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 msgr2=0x7f626c1092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 --2- 172.21.15.148:0/1501294777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c1092c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6258004970 tx=0x7f6258009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:58.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 -- 172.21.15.148:0/1501294777 shutdown_connections 2024-02-28T16:34:58.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 --2- 172.21.15.148:0/1501294777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c1092c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 --2- 172.21.15.148:0/1501294777 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c0702d0 0x7f626c0706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 -- 172.21.15.148:0/1501294777 >> 172.21.15.148:0/1501294777 conn(0x7f626c0f8ae0 msgr2=0x7f626c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:58.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 -- 172.21.15.148:0/1501294777 shutdown_connections 2024-02-28T16:34:58.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.646+0000 7f6271000700 1 -- 172.21.15.148:0/1501294777 wait complete. 2024-02-28T16:34:58.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.647+0000 7f6271000700 1 Processor -- start 2024-02-28T16:34:58.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.647+0000 7f6271000700 1 -- start start 2024-02-28T16:34:58.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.647+0000 7f6271000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c0702d0 0x7f626c115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:58.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.647+0000 7f6271000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:58.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.647+0000 7f6271000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1167a0 con 0x7f626c070be0 2024-02-28T16:34:58.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.647+0000 7f6271000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c10faf0 con 0x7f626c0702d0 2024-02-28T16:34:58.637 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c116150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47166/0 (socket says 172.21.15.148:47166) 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269400700 1 -- 172.21.15.148:0/2520275898 learned_addr learned my addr 172.21.15.148:0/2520275898 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269e00700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c0702d0 0x7f626c115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269400700 1 -- 172.21.15.148:0/2520275898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c0702d0 msgr2=0x7f626c115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269400700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c0702d0 0x7f626c115c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269400700 1 -- 172.21.15.148:0/2520275898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258005040 con 0x7f626c070be0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.648+0000 7f6269400700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c116150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6258004f50 tx=0x7f6258009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.649+0000 7f6262000700 1 -- 172.21.15.148:0/2520275898 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625800e040 con 0x7f626c070be0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.649+0000 7f6262000700 1 -- 172.21.15.148:0/2520275898 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6258004290 con 0x7f626c070be0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.649+0000 7f6262000700 1 -- 172.21.15.148:0/2520275898 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625801c630 con 0x7f626c070be0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.649+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c10fd70 con 0x7f626c070be0 2024-02-28T16:34:58.638 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.649+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c1102b0 con 0x7f626c070be0 2024-02-28T16:34:58.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.650+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c106980 con 0x7f626c070be0 2024-02-28T16:34:58.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.651+0000 7f6262000700 1 -- 172.21.15.148:0/2520275898 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f625800bc10 con 0x7f626c070be0 2024-02-28T16:34:58.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.652+0000 7f6262000700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f625006d7f0 0x7f625006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:58.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.652+0000 7f6262000700 1 -- 172.21.15.148:0/2520275898 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f625808e230 con 0x7f626c070be0 2024-02-28T16:34:58.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.652+0000 7f6269e00700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f625006d7f0 0x7f625006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:58.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.653+0000 7f6269e00700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f625006d7f0 0x7f625006fca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f625c004d60 tx=0x7f625c00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:58.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.657+0000 7f6262000700 1 -- 172.21.15.148:0/2520275898 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6258057b30 con 0x7f626c070be0 2024-02-28T16:34:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.912+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f626c04bed0 con 0x7f626c070be0 2024-02-28T16:34:58.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.912+0000 7f6262000700 1 -- 172.21.15.148:0/2520275898 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f6258013e60 con 0x7f626c070be0 2024-02-28T16:34:58.901 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:34:58.901 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:34:58.901 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:34:58.901 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:34:58.901 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:58.901 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:34:58.901 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:34:58.902 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:58.903 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:58.904 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:34:58.904 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:34:58.904 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:58.904 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:58.904 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f625006d7f0 msgr2=0x7f625006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f625006d7f0 0x7f625006fca0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f625c004d60 tx=0x7f625c00b040 comp rx=0 tx=0).stop 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 msgr2=0x7f626c116150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c116150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6258004f50 tx=0x7f6258009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 shutdown_connections 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f625006d7f0 0x7f625006fca0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f626c0702d0 0x7f626c115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 --2- 172.21.15.148:0/2520275898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f626c070be0 0x7f626c116150 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 >> 172.21.15.148:0/2520275898 conn(0x7f626c0f8ae0 msgr2=0x7f626c103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 shutdown_connections 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:58.915+0000 7f6271000700 1 -- 172.21.15.148:0/2520275898 wait complete. 2024-02-28T16:34:58.905 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:34:59.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.056+0000 7f963a000700 1 -- 172.21.15.148:0/1996598959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 msgr2=0x7f9634070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.056+0000 7f963a000700 1 --2- 172.21.15.148:0/1996598959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f9634070700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9624004970 tx=0x7f9624009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:59.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.057+0000 7f963a000700 1 -- 172.21.15.148:0/1996598959 shutdown_connections 2024-02-28T16:34:59.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.057+0000 7f963a000700 1 --2- 172.21.15.148:0/1996598959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9634070c40 0x7f9634109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.057+0000 7f963a000700 1 --2- 172.21.15.148:0/1996598959 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f9634070700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.057+0000 7f963a000700 1 -- 172.21.15.148:0/1996598959 >> 172.21.15.148:0/1996598959 conn(0x7f96340f8ae0 msgr2=0x7f96340faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:59.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.057+0000 7f963a000700 1 -- 172.21.15.148:0/1996598959 shutdown_connections 2024-02-28T16:34:59.046 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.057+0000 7f963a000700 1 -- 172.21.15.148:0/1996598959 wait complete. 2024-02-28T16:34:59.046 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:58 smithi148 ceph-mon[112463]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:59.046 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:58 smithi148 ceph-mon[112463]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:59.046 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:58 smithi148 ceph-mon[112463]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:59.046 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:59.046 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:58 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4197945762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:59.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.057+0000 7f963a000700 1 Processor -- start 2024-02-28T16:34:59.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f963a000700 1 -- start start 2024-02-28T16:34:59.047 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f963a000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f963411a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f963a000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9634070c40 0x7f963411a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f963a000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963411aba0 con 0x7f9634070330 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f963a000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9634108480 con 0x7f9634070c40 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f9633400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f963411a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f9633400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f963411a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47180/0 (socket says 172.21.15.148:47180) 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.058+0000 7f9633400700 1 -- 172.21.15.148:0/1952094929 learned_addr learned my addr 172.21.15.148:0/1952094929 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f9633400700 1 -- 172.21.15.148:0/1952094929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9634070c40 msgr2=0x7f963411a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f9633400700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9634070c40 0x7f963411a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f9633400700 1 -- 172.21.15.148:0/1952094929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624005040 con 0x7f9634070330 2024-02-28T16:34:59.048 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f9633400700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f963411a010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9624000c00 tx=0x7f9624009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:59.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f962b400700 1 -- 172.21.15.148:0/1952094929 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962400e040 con 0x7f9634070330 2024-02-28T16:34:59.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f962b400700 1 -- 172.21.15.148:0/1952094929 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9624004290 con 0x7f9634070330 2024-02-28T16:34:59.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9634108700 con 0x7f9634070330 2024-02-28T16:34:59.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.059+0000 7f962b400700 1 -- 172.21.15.148:0/1952094929 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962401c630 con 0x7f9634070330 2024-02-28T16:34:59.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.060+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9634108c40 con 0x7f9634070330 2024-02-28T16:34:59.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.061+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9634102510 con 0x7f9634070330 2024-02-28T16:34:59.050 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.062+0000 7f962b400700 1 -- 172.21.15.148:0/1952094929 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9624013980 con 0x7f9634070330 2024-02-28T16:34:59.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.063+0000 7f962b400700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f961806d7e0 0x7f961806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:59.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.063+0000 7f962b400700 1 -- 172.21.15.148:0/1952094929 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f962408e1d0 con 0x7f9634070330 2024-02-28T16:34:59.051 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.063+0000 7f9632a00700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f961806d7e0 0x7f961806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:59.052 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.064+0000 7f9632a00700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f961806d7e0 0x7f961806fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9634115880 tx=0x7f9620007d40 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:59.056 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.067+0000 7f962b400700 1 -- 172.21.15.148:0/1952094929 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f962405b620 con 0x7f9634070330 2024-02-28T16:34:59.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:58 smithi157 ceph-mon[89328]: from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:59.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:58 smithi157 ceph-mon[89328]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:34:59.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:58 smithi157 ceph-mon[89328]: pgmap v103: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:34:59.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:34:59.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:58 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4197945762' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:34:59.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.317+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f96341155c0 con 0x7f961806d7e0 2024-02-28T16:34:59.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.319+0000 7f962b400700 1 -- 172.21.15.148:0/1952094929 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f96341155c0 con 0x7f961806d7e0 2024-02-28T16:34:59.307 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:34:59.307 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:34:59.307 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:34:59.307 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: "crash" 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "8/21 daemons upgraded", 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:34:59.308 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:34:59.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.322+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f961806d7e0 msgr2=0x7f961806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.322+0000 7f963a000700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f961806d7e0 0x7f961806fc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9634115880 tx=0x7f9620007d40 comp rx=0 tx=0).stop 2024-02-28T16:34:59.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.322+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 msgr2=0x7f963411a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.322+0000 7f963a000700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f963411a010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9624000c00 tx=0x7f9624009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.323+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 shutdown_connections 2024-02-28T16:34:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.323+0000 7f963a000700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f961806d7e0 0x7f961806fc90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.323+0000 7f963a000700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9634070330 0x7f963411a010 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.323+0000 7f963a000700 1 --2- 172.21.15.148:0/1952094929 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9634070c40 0x7f963411a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.323+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 >> 172.21.15.148:0/1952094929 conn(0x7f96340f8ae0 msgr2=0x7f96340ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.323+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 shutdown_connections 2024-02-28T16:34:59.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.324+0000 7f963a000700 1 -- 172.21.15.148:0/1952094929 wait complete. 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 -- 172.21.15.148:0/2501543130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 msgr2=0x7f94e0105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 --2- 172.21.15.148:0/2501543130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0105540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94d0004940 tx=0x7f94d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 -- 172.21.15.148:0/2501543130 shutdown_connections 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 --2- 172.21.15.148:0/2501543130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94e0105b10 0x7f94e00ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 --2- 172.21.15.148:0/2501543130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0105540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 -- 172.21.15.148:0/2501543130 >> 172.21.15.148:0/2501543130 conn(0x7f94e00face0 msgr2=0x7f94e00fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 -- 172.21.15.148:0/2501543130 shutdown_connections 2024-02-28T16:34:59.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.475+0000 7f94e5c00700 1 -- 172.21.15.148:0/2501543130 wait complete. 2024-02-28T16:34:59.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.476+0000 7f94e5c00700 1 Processor -- start 2024-02-28T16:34:59.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.476+0000 7f94e5c00700 1 -- start start 2024-02-28T16:34:59.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94e5c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:59.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94e5c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94e0105b10 0x7f94e01161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:59.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94e5c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01167f0 con 0x7f94e0105170 2024-02-28T16:34:59.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94e5c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e010fb40 con 0x7f94e0105b10 2024-02-28T16:34:59.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94dea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:59.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94dea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0115c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47200/0 (socket says 172.21.15.148:47200) 2024-02-28T16:34:59.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94dea00700 1 -- 172.21.15.148:0/418308256 learned_addr learned my addr 172.21.15.148:0/418308256 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94dea00700 1 -- 172.21.15.148:0/418308256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94e0105b10 msgr2=0x7f94e01161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94de000700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94e0105b10 0x7f94e01161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.477+0000 7f94dea00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94e0105b10 0x7f94e01161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94dea00700 1 -- 172.21.15.148:0/418308256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0005040 con 0x7f94e0105170 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94de000700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94e0105b10 0x7f94e01161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94dea00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0115c60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009150 tx=0x7f94d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94d6a00700 1 -- 172.21.15.148:0/418308256 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d000e040 con 0x7f94e0105170 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94d6a00700 1 -- 172.21.15.148:0/418308256 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94d000bbf0 con 0x7f94e0105170 2024-02-28T16:34:59.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e010fdc0 con 0x7f94e0105170 2024-02-28T16:34:59.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94d6a00700 1 -- 172.21.15.148:0/418308256 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94d001c630 con 0x7f94e0105170 2024-02-28T16:34:59.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.478+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e0110300 con 0x7f94e0105170 2024-02-28T16:34:59.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.479+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0102480 con 0x7f94e0105170 2024-02-28T16:34:59.469 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.481+0000 7f94d6a00700 1 -- 172.21.15.148:0/418308256 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f94d000bd60 con 0x7f94e0105170 2024-02-28T16:34:59.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.482+0000 7f94d6a00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f94c406d7f0 0x7f94c406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:34:59.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.482+0000 7f94d6a00700 1 -- 172.21.15.148:0/418308256 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f94d008e190 con 0x7f94e0105170 2024-02-28T16:34:59.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.482+0000 7f94de000700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f94c406d7f0 0x7f94c406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:34:59.471 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.483+0000 7f94de000700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f94c406d7f0 0x7f94c406fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009fd0 tx=0x7f94cc00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:34:59.476 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.487+0000 7f94d6a00700 1 -- 172.21.15.148:0/418308256 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f94d0057b50 con 0x7f94e0105170 2024-02-28T16:34:59.787 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.799+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f94e004bf00 con 0x7f94e0105170 2024-02-28T16:34:59.788 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.800+0000 7f94d6a00700 1 -- 172.21.15.148:0/418308256 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f94d005b210 con 0x7f94e0105170 2024-02-28T16:34:59.788 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:34:59.788 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:34:59.788 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:34:59.791 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f94c406d7f0 msgr2=0x7f94c406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f94c406d7f0 0x7f94c406fca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009fd0 tx=0x7f94cc00b040 comp rx=0 tx=0).stop 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 msgr2=0x7f94e0115c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0115c60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009150 tx=0x7f94d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 shutdown_connections 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f94c406d7f0 0x7f94c406fca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94e0105170 0x7f94e0115c60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 --2- 172.21.15.148:0/418308256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f94e0105b10 0x7f94e01161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 >> 172.21.15.148:0/418308256 conn(0x7f94e00face0 msgr2=0x7f94e00fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 shutdown_connections 2024-02-28T16:34:59.792 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:34:59.803+0000 7f94e5c00700 1 -- 172.21.15.148:0/418308256 wait complete. 2024-02-28T16:35:00.046 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:59 smithi148 ceph-mon[112463]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:00.047 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:34:59 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2520275898' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:35:00.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:59 smithi157 ceph-mon[89328]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:00.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:34:59 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2520275898' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:35:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:00 smithi148 ceph-mon[112463]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:00 smithi148 ceph-mon[112463]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:01.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:00 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/418308256' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:35:01.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:00 smithi157 ceph-mon[89328]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:01.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:00 smithi157 ceph-mon[89328]: pgmap v104: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:01.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:00 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/418308256' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:35:02.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:01 smithi148 systemd[1]: Stopping Ceph osd.2 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:35:02.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:02 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[62645]: 2024-02-28T16:35:02.218+0000 7f0f14000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:35:02.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:02 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[62645]: 2024-02-28T16:35:02.218+0000 7f0f14000700 -1 osd.2 59 *** Got signal Terminated *** 2024-02-28T16:35:02.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:02 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[62645]: 2024-02-28T16:35:02.218+0000 7f0f14000700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:35:03.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:02 smithi148 ceph-mon[112463]: pgmap v105: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:03.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:02 smithi148 ceph-mon[112463]: osd.2 marked itself down and dead 2024-02-28T16:35:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:02 smithi157 ceph-mon[89328]: pgmap v105: 65 pgs: 65 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:03.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:02 smithi157 ceph-mon[89328]: osd.2 marked itself down and dead 2024-02-28T16:35:03.755 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:03 smithi148 podman[135770]: 2024-02-28 16:35:03.453862628 +0000 UTC m=+1.421062788 container died 0c6337b54f4a809e6a68735585112255f0a2b7b7001547e8fef89a37ff9326f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-c0f02e6) 2024-02-28T16:35:04.021 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:04 smithi148 podman[135770]: 2024-02-28 16:35:04.011760239 +0000 UTC m=+1.978960439 container cleanup 0c6337b54f4a809e6a68735585112255f0a2b7b7001547e8fef89a37ff9326f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=quincy-c0f02e6, org.label-schema.vendor=CentOS) 2024-02-28T16:35:04.021 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:04 smithi148 bash[135770]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2 2024-02-28T16:35:04.022 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:03 smithi148 ceph-mon[112463]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:35:04.022 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:03 smithi148 ceph-mon[112463]: osdmap e60: 6 total, 5 up, 6 in 2024-02-28T16:35:04.022 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:03 smithi148 ceph-mon[112463]: osdmap e61: 6 total, 5 up, 6 in 2024-02-28T16:35:04.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:03 smithi157 ceph-mon[89328]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:35:04.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:03 smithi157 ceph-mon[89328]: osdmap e60: 6 total, 5 up, 6 in 2024-02-28T16:35:04.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:03 smithi157 ceph-mon[89328]: osdmap e61: 6 total, 5 up, 6 in 2024-02-28T16:35:04.623 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:04 smithi148 podman[135791]: 2024-02-28 16:35:04.355446142 +0000 UTC m=+0.888154143 container remove 0c6337b54f4a809e6a68735585112255f0a2b7b7001547e8fef89a37ff9326f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=quincy-c0f02e6, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-02-28T16:35:05.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:04 smithi148 ceph-mon[112463]: pgmap v107: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:05.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:04 smithi148 ceph-mon[112463]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-28T16:35:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:04 smithi157 ceph-mon[89328]: pgmap v107: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:05.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:04 smithi157 ceph-mon[89328]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-28T16:35:05.490 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:05 smithi148 podman[135879]: 2024-02-28 16:35:05.122460426 +0000 UTC m=+0.031040841 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:35:05.491 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:05 smithi148 podman[135879]: 2024-02-28 16:35:05.223086804 +0000 UTC m=+0.131667256 container create f67252a9bbe7ace238a4915f13838ef0e69db93580fb5bf3a73d94c14bf8a065 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222) 2024-02-28T16:35:05.491 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:05 smithi148 podman[135879]: 2024-02-28 16:35:05.502184932 +0000 UTC m=+0.410765427 container init f67252a9bbe7ace238a4915f13838ef0e69db93580fb5bf3a73d94c14bf8a065 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-28T16:35:05.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:05 smithi148 podman[135879]: 2024-02-28 16:35:05.512573747 +0000 UTC m=+0.421154181 container start f67252a9bbe7ace238a4915f13838ef0e69db93580fb5bf3a73d94c14bf8a065 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:35:05.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:05 smithi148 podman[135879]: 2024-02-28 16:35:05.583659121 +0000 UTC m=+0.492239603 container attach f67252a9bbe7ace238a4915f13838ef0e69db93580fb5bf3a73d94c14bf8a065 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-28T16:35:06.374 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:05 smithi148 podman[135879]: 2024-02-28 16:35:05.954880987 +0000 UTC m=+0.863461449 container died f67252a9bbe7ace238a4915f13838ef0e69db93580fb5bf3a73d94c14bf8a065 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:35:07.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:06 smithi148 ceph-mon[112463]: pgmap v109: 65 pgs: 19 peering, 3 stale+active+clean, 43 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:07.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:06 smithi148 podman[135904]: 2024-02-28 16:35:06.778967826 +0000 UTC m=+0.810057453 container remove f67252a9bbe7ace238a4915f13838ef0e69db93580fb5bf3a73d94c14bf8a065 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-28T16:35:07.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:06 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-28T16:35:07.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:06 smithi148 systemd[1]: Stopped Ceph osd.2 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:35:07.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:06 smithi148 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.2.service: Consumed 1min 21.085s CPU time. 2024-02-28T16:35:07.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:06 smithi157 ceph-mon[89328]: pgmap v109: 65 pgs: 19 peering, 3 stale+active+clean, 43 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-02-28T16:35:07.517 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:07 smithi148 systemd[1]: Starting Ceph osd.2 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:35:07.859 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:07 smithi148 podman[136005]: 2024-02-28 16:35:07.432818081 +0000 UTC m=+0.030769822 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:35:07.859 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:07 smithi148 podman[136005]: 2024-02-28 16:35:07.613638018 +0000 UTC m=+0.211589823 container create 37ac7dc19135a30eaadb72ca12170a92b89b7b88894447ec091c696dcb582a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-28T16:35:08.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:07 smithi148 ceph-mon[112463]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 4 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:08.123 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:07 smithi148 podman[136005]: 2024-02-28 16:35:07.925844347 +0000 UTC m=+0.523796131 container init 37ac7dc19135a30eaadb72ca12170a92b89b7b88894447ec091c696dcb582a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-28T16:35:08.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:07 smithi148 podman[136005]: 2024-02-28 16:35:07.937683932 +0000 UTC m=+0.535635753 container start 37ac7dc19135a30eaadb72ca12170a92b89b7b88894447ec091c696dcb582a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-28T16:35:08.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 podman[136005]: 2024-02-28 16:35:08.024609811 +0000 UTC m=+0.622561557 container attach 37ac7dc19135a30eaadb72ca12170a92b89b7b88894447ec091c696dcb582a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-28T16:35:08.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:07 smithi157 ceph-mon[89328]: Health check failed: Degraded data redundancy: 10/264 objects degraded (3.788%), 4 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-mon[112463]: pgmap v110: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10/264 objects degraded (3.788%) 2024-02-28T16:35:09.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate[136019]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:35:09.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate[136019]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:35:09.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 bash[136005]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:35:09.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 bash[136005]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:35:09.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 bash[136005]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:35:09.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 bash[136005]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:35:09.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 bash[136005]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 bash[136005]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 bash[136005]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate[136019]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate[136019]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate[136019]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate[136019]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate[136019]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T16:35:09.125 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:08 smithi148 podman[136005]: 2024-02-28 16:35:08.855271432 +0000 UTC m=+1.453223217 container died 37ac7dc19135a30eaadb72ca12170a92b89b7b88894447ec091c696dcb582a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-02-28T16:35:09.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:08 smithi157 ceph-mon[89328]: pgmap v110: 65 pgs: 4 active+undersized+degraded, 19 peering, 4 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 10/264 objects degraded (3.788%) 2024-02-28T16:35:10.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:09 smithi148 ceph-mon[112463]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-02-28T16:35:10.117 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:09 smithi148 podman[136142]: 2024-02-28 16:35:09.812173069 +0000 UTC m=+0.933507296 container remove 37ac7dc19135a30eaadb72ca12170a92b89b7b88894447ec091c696dcb582a44 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-28T16:35:10.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:09 smithi157 ceph-mon[89328]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-02-28T16:35:10.373 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:10 smithi148 podman[136203]: 2024-02-28 16:35:10.070612616 +0000 UTC m=+0.033407553 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:35:10.373 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:10 smithi148 podman[136203]: 2024-02-28 16:35:10.171285767 +0000 UTC m=+0.134080733 container create 79bbadb9075d63ce3e790caf0f25d320001a95c21210b1a35733f342f51f9be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:35:10.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:10 smithi148 podman[136203]: 2024-02-28 16:35:10.491283619 +0000 UTC m=+0.454078591 container init 79bbadb9075d63ce3e790caf0f25d320001a95c21210b1a35733f342f51f9be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-02-28T16:35:10.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:10 smithi148 podman[136203]: 2024-02-28 16:35:10.501597545 +0000 UTC m=+0.464392534 container start 79bbadb9075d63ce3e790caf0f25d320001a95c21210b1a35733f342f51f9be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-02-28T16:35:10.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:10 smithi148 ceph-osd[136222]: -- 172.21.15.148:0/938106997 <== mon.0 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606fa5e9680 con 0x5606fa5b2c00 2024-02-28T16:35:10.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:10 smithi148 bash[136203]: 79bbadb9075d63ce3e790caf0f25d320001a95c21210b1a35733f342f51f9be3 2024-02-28T16:35:10.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:10 smithi148 systemd[1]: Started Ceph osd.2 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:35:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:10 smithi157 ceph-mon[89328]: pgmap v111: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:11.373 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:11 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[136218]: 2024-02-28T16:35:11.071+0000 7fb581c897c0 -1 Falling back to public interface 2024-02-28T16:35:11.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:10 smithi148 ceph-mon[112463]: pgmap v111: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:11.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:11.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:11.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:12.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:11 smithi157 ceph-mon[89328]: pgmap v112: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:12.270 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:11 smithi148 ceph-mon[112463]: pgmap v112: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:13.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:13 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:13 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 34/264 objects degraded (12.879%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:14.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:14 smithi157 ceph-mon[89328]: pgmap v113: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:15.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:14 smithi148 ceph-mon[112463]: pgmap v113: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:15.873 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:15 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[136218]: 2024-02-28T16:35:15.597+0000 7fb581c897c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-28T16:35:16.320 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:15 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[136218]: 2024-02-28T16:35:15.938+0000 7fb581c897c0 -1 osd.2 59 log_to_monitors true 2024-02-28T16:35:16.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:16 smithi157 ceph-mon[89328]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:16.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:16 smithi157 ceph-mon[89328]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:35:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:16 smithi148 ceph-mon[112463]: pgmap v114: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:16 smithi148 ceph-mon[112463]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T16:35:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:17 smithi157 ceph-mon[89328]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:35:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:17 smithi157 ceph-mon[89328]: osdmap e62: 6 total, 5 up, 6 in 2024-02-28T16:35:17.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:17 smithi157 ceph-mon[89328]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:35:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:17 smithi148 ceph-mon[112463]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T16:35:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:17 smithi148 ceph-mon[112463]: osdmap e62: 6 total, 5 up, 6 in 2024-02-28T16:35:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:17 smithi148 ceph-mon[112463]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]: dispatch 2024-02-28T16:35:18.124 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:35:17 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[136218]: 2024-02-28T16:35:17.811+0000 7fb56c000700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:35:19.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:18 smithi148 ceph-mon[112463]: pgmap v116: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:19.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:18 smithi148 ceph-mon[112463]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' 2024-02-28T16:35:19.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:19.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:19.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:18 smithi157 ceph-mon[89328]: pgmap v116: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:18 smithi157 ceph-mon[89328]: from='osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371]' entity='osd.2' 2024-02-28T16:35:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:20.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:19 smithi148 ceph-mon[112463]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:35:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:19 smithi148 ceph-mon[112463]: osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371] boot 2024-02-28T16:35:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:19 smithi148 ceph-mon[112463]: osdmap e63: 6 total, 6 up, 6 in 2024-02-28T16:35:20.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:19 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:35:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:19 smithi157 ceph-mon[89328]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:35:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:19 smithi157 ceph-mon[89328]: osd.2 [v2:172.21.15.148:6818/1849077371,v1:172.21.15.148:6819/1849077371] boot 2024-02-28T16:35:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:19 smithi157 ceph-mon[89328]: osdmap e63: 6 total, 6 up, 6 in 2024-02-28T16:35:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:19 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T16:35:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:20 smithi148 ceph-mon[112463]: pgmap v118: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:20 smithi148 ceph-mon[112463]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T16:35:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:20 smithi157 ceph-mon[89328]: pgmap v118: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:20 smithi157 ceph-mon[89328]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T16:35:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:22 smithi148 ceph-mon[112463]: pgmap v120: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:22 smithi157 ceph-mon[89328]: pgmap v120: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:35:24.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:23 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 4/264 objects degraded (1.515%), 1 pg degraded (PG_DEGRADED) 2024-02-28T16:35:24.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:23 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 4/264 objects degraded (1.515%), 1 pg degraded (PG_DEGRADED) 2024-02-28T16:35:25.181 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:24 smithi148 ceph-mon[112463]: pgmap v121: 65 pgs: 1 active+undersized+degraded, 2 active+undersized, 62 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4/264 objects degraded (1.515%) 2024-02-28T16:35:25.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:24 smithi157 ceph-mon[89328]: pgmap v121: 65 pgs: 1 active+undersized+degraded, 2 active+undersized, 62 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4/264 objects degraded (1.515%) 2024-02-28T16:35:26.175 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:25 smithi148 ceph-mon[112463]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:26.175 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:25 smithi148 ceph-mon[112463]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/264 objects degraded (1.515%), 1 pg degraded) 2024-02-28T16:35:26.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:25 smithi157 ceph-mon[89328]: pgmap v122: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:26.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:25 smithi157 ceph-mon[89328]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/264 objects degraded (1.515%), 1 pg degraded) 2024-02-28T16:35:27.604 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:27.605 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:35:27.606 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:35:27.606 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:27 smithi157 ceph-mon[89328]: Upgrade: osd.3 is safe to restart 2024-02-28T16:35:27.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T16:35:27.624 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:27 smithi148 ceph-mon[112463]: Upgrade: osd.3 is safe to restart 2024-02-28T16:35:28.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:28 smithi157 ceph-mon[89328]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:28.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:28.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:28 smithi148 ceph-mon[112463]: pgmap v123: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.970+0000 7f92d3200700 1 -- 172.21.15.148:0/4034160075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d41058f0 msgr2=0x7f92d40fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.970+0000 7f92d3200700 1 --2- 172.21.15.148:0/4034160075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d41058f0 0x7f92d40fef60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f92c0004940 tx=0x7f92c0009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:29.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.970+0000 7f92d3200700 1 -- 172.21.15.148:0/4034160075 shutdown_connections 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.970+0000 7f92d3200700 1 --2- 172.21.15.148:0/4034160075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d41058f0 0x7f92d40fef60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.970+0000 7f92d3200700 1 --2- 172.21.15.148:0/4034160075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92d4104f50 0x7f92d4105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.970+0000 7f92d3200700 1 -- 172.21.15.148:0/4034160075 >> 172.21.15.148:0/4034160075 conn(0x7f92d40faae0 msgr2=0x7f92d40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.971+0000 7f92d3200700 1 -- 172.21.15.148:0/4034160075 shutdown_connections 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.971+0000 7f92d3200700 1 -- 172.21.15.148:0/4034160075 wait complete. 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.971+0000 7f92d3200700 1 Processor -- start 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.971+0000 7f92d3200700 1 -- start start 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d3200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d4104f50 0x7f92d4115a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d3200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92d41058f0 0x7f92d4115f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d3200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d41165c0 con 0x7f92d4104f50 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d3200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d410f8f0 con 0x7f92d41058f0 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d1e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d4104f50 0x7f92d4115a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d1e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d4104f50 0x7f92d4115a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34238/0 (socket says 172.21.15.148:34238) 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d1e00700 1 -- 172.21.15.148:0/1236477662 learned_addr learned my addr 172.21.15.148:0/1236477662 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.972+0000 7f92d1400700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92d41058f0 0x7f92d4115f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92d1e00700 1 -- 172.21.15.148:0/1236477662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92d41058f0 msgr2=0x7f92d4115f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92d1e00700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92d41058f0 0x7f92d4115f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:29.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92d1e00700 1 -- 172.21.15.148:0/1236477662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0005040 con 0x7f92d4104f50 2024-02-28T16:35:29.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92d1e00700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d4104f50 0x7f92d4115a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92c4002a50 tx=0x7f92c40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92ca000700 1 -- 172.21.15.148:0/1236477662 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c4007cc0 con 0x7f92d4104f50 2024-02-28T16:35:29.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92ca000700 1 -- 172.21.15.148:0/1236477662 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92c400f040 con 0x7f92d4104f50 2024-02-28T16:35:29.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d410fbd0 con 0x7f92d4104f50 2024-02-28T16:35:29.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.973+0000 7f92ca000700 1 -- 172.21.15.148:0/1236477662 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92c400db70 con 0x7f92d4104f50 2024-02-28T16:35:29.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.974+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d4110190 con 0x7f92d4104f50 2024-02-28T16:35:29.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.975+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d4107420 con 0x7f92d4104f50 2024-02-28T16:35:29.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.976+0000 7f92ca000700 1 -- 172.21.15.148:0/1236477662 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f92c400dcd0 con 0x7f92d4104f50 2024-02-28T16:35:29.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.976+0000 7f92ca000700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f92b806d7e0 0x7f92b806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:29.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.977+0000 7f92ca000700 1 -- 172.21.15.148:0/1236477662 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f92c408c580 con 0x7f92d4104f50 2024-02-28T16:35:29.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.977+0000 7f92d1400700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f92b806d7e0 0x7f92b806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:29.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.977+0000 7f92d1400700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f92b806d7e0 0x7f92b806fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92d4111260 tx=0x7f92c0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:29.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:29.982+0000 7f92ca000700 1 -- 172.21.15.148:0/1236477662 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f92c4059950 con 0x7f92d4104f50 2024-02-28T16:35:30.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.221+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92d404bf40 con 0x7f92b806d7e0 2024-02-28T16:35:30.211 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.223+0000 7f92ca000700 1 -- 172.21.15.148:0/1236477662 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f92d404bf40 con 0x7f92b806d7e0 2024-02-28T16:35:30.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f92b806d7e0 msgr2=0x7f92b806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f92b806d7e0 0x7f92b806fc90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f92d4111260 tx=0x7f92c0009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d4104f50 msgr2=0x7f92d4115a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d4104f50 0x7f92d4115a30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f92c4002a50 tx=0x7f92c40046b0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 shutdown_connections 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f92b806d7e0 0x7f92b806fc90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92d4104f50 0x7f92d4115a30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 --2- 172.21.15.148:0/1236477662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f92d41058f0 0x7f92d4115f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.226+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 >> 172.21.15.148:0/1236477662 conn(0x7f92d40faae0 msgr2=0x7f92d40fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.227+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 shutdown_connections 2024-02-28T16:35:30.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.227+0000 7f92d3200700 1 -- 172.21.15.148:0/1236477662 wait complete. 2024-02-28T16:35:30.230 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.367+0000 7f2991c00700 1 -- 172.21.15.148:0/3118698593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070330 msgr2=0x7f298c070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.367+0000 7f2991c00700 1 --2- 172.21.15.148:0/3118698593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070330 0x7f298c070700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f297c009d10 tx=0x7f297c004d10 comp rx=0 tx=0).stop 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.367+0000 7f2991c00700 1 -- 172.21.15.148:0/3118698593 shutdown_connections 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.367+0000 7f2991c00700 1 --2- 172.21.15.148:0/3118698593 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f298c070c40 0x7f298c109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.367+0000 7f2991c00700 1 --2- 172.21.15.148:0/3118698593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070330 0x7f298c070700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.367+0000 7f2991c00700 1 -- 172.21.15.148:0/3118698593 >> 172.21.15.148:0/3118698593 conn(0x7f298c0f8ae0 msgr2=0x7f298c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.367+0000 7f2991c00700 1 -- 172.21.15.148:0/3118698593 shutdown_connections 2024-02-28T16:35:30.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.368+0000 7f2991c00700 1 -- 172.21.15.148:0/3118698593 wait complete. 2024-02-28T16:35:30.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.368+0000 7f2991c00700 1 Processor -- start 2024-02-28T16:35:30.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.368+0000 7f2991c00700 1 -- start start 2024-02-28T16:35:30.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f2991c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f298c070330 0x7f298c115eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:30.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f2991c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070c40 0x7f298c1163f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:30.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f2991c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c116a40 con 0x7f298c070c40 2024-02-28T16:35:30.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f2991c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c10fd50 con 0x7f298c070330 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f298a000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070c40 0x7f298c1163f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f298a000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070c40 0x7f298c1163f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34262/0 (socket says 172.21.15.148:34262) 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f298a000700 1 -- 172.21.15.148:0/1844434984 learned_addr learned my addr 172.21.15.148:0/1844434984 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f298aa00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f298c070330 0x7f298c115eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f298a000700 1 -- 172.21.15.148:0/1844434984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f298c070330 msgr2=0x7f298c115eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f298a000700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f298c070330 0x7f298c115eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.369+0000 7f298a000700 1 -- 172.21.15.148:0/1844434984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c009940 con 0x7f298c070c40 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.370+0000 7f298a000700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070c40 0x7f298c1163f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2978002a50 tx=0x7f29780046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.370+0000 7f2982a00700 1 -- 172.21.15.148:0/1844434984 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2978007cc0 con 0x7f298c070c40 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.370+0000 7f2982a00700 1 -- 172.21.15.148:0/1844434984 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f297800f040 con 0x7f298c070c40 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.370+0000 7f2982a00700 1 -- 172.21.15.148:0/1844434984 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2978009640 con 0x7f298c070c40 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.370+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c110030 con 0x7f298c070c40 2024-02-28T16:35:30.359 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.370+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c110570 con 0x7f298c070c40 2024-02-28T16:35:30.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.371+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c106920 con 0x7f298c070c40 2024-02-28T16:35:30.360 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.372+0000 7f2982a00700 1 -- 172.21.15.148:0/1844434984 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f29780097a0 con 0x7f298c070c40 2024-02-28T16:35:30.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.373+0000 7f2982a00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f297006d7f0 0x7f297006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:30.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.373+0000 7f2982a00700 1 -- 172.21.15.148:0/1844434984 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f297808cb70 con 0x7f298c070c40 2024-02-28T16:35:30.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.374+0000 7f298aa00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f297006d7f0 0x7f297006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:30.362 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.374+0000 7f298aa00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f297006d7f0 0x7f297006fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f297c015040 tx=0x7f297c004d10 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:30.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.378+0000 7f2982a00700 1 -- 172.21.15.148:0/1844434984 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2978059fc0 con 0x7f298c070c40 2024-02-28T16:35:30.594 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:30 smithi157 ceph-mon[89328]: Upgrade: Updating osd.3 2024-02-28T16:35:30.594 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:30 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:30.594 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:30 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:35:30.594 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:30 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:30.594 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:30 smithi157 ceph-mon[89328]: Deploying daemon osd.3 on smithi157 2024-02-28T16:35:30.594 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:30 smithi157 ceph-mon[89328]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:30.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.618+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f298c04bf40 con 0x7f297006d7f0 2024-02-28T16:35:30.607 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:30 smithi148 ceph-mon[112463]: Upgrade: Updating osd.3 2024-02-28T16:35:30.607 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:30 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:30.607 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:30 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T16:35:30.607 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:30 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:30.607 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:30 smithi148 ceph-mon[112463]: Deploying daemon osd.3 on smithi157 2024-02-28T16:35:30.607 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:30 smithi148 ceph-mon[112463]: pgmap v124: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:30.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.620+0000 7f2982a00700 1 -- 172.21.15.148:0/1844434984 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f298c04bf40 con 0x7f297006d7f0 2024-02-28T16:35:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f297006d7f0 msgr2=0x7f297006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f297006d7f0 0x7f297006fca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f297c015040 tx=0x7f297c004d10 comp rx=0 tx=0).stop 2024-02-28T16:35:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070c40 msgr2=0x7f298c1163f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070c40 0x7f298c1163f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2978002a50 tx=0x7f29780046b0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 shutdown_connections 2024-02-28T16:35:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f297006d7f0 0x7f297006fca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f298c070330 0x7f298c115eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 --2- 172.21.15.148:0/1844434984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f298c070c40 0x7f298c1163f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.623+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 >> 172.21.15.148:0/1844434984 conn(0x7f298c0f8ae0 msgr2=0x7f298c103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.624+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 shutdown_connections 2024-02-28T16:35:30.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.624+0000 7f2991c00700 1 -- 172.21.15.148:0/1844434984 wait complete. 2024-02-28T16:35:30.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.777+0000 7fe3f9800700 1 -- 172.21.15.148:0/3054494291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4071f60 msgr2=0x7fe3f4070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.777+0000 7fe3f9800700 1 --2- 172.21.15.148:0/3054494291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4071f60 0x7fe3f4070330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009d10 tx=0x7fe3e4004d10 comp rx=0 tx=0).stop 2024-02-28T16:35:30.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.777+0000 7fe3f9800700 1 -- 172.21.15.148:0/3054494291 shutdown_connections 2024-02-28T16:35:30.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.777+0000 7fe3f9800700 1 --2- 172.21.15.148:0/3054494291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f4070870 0x7fe3f4070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.777+0000 7fe3f9800700 1 --2- 172.21.15.148:0/3054494291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4071f60 0x7fe3f4070330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.777+0000 7fe3f9800700 1 -- 172.21.15.148:0/3054494291 >> 172.21.15.148:0/3054494291 conn(0x7fe3f40f8ae0 msgr2=0x7fe3f40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:30.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.777+0000 7fe3f9800700 1 -- 172.21.15.148:0/3054494291 shutdown_connections 2024-02-28T16:35:30.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.778+0000 7fe3f9800700 1 -- 172.21.15.148:0/3054494291 wait complete. 2024-02-28T16:35:30.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.779+0000 7fe3f9800700 1 Processor -- start 2024-02-28T16:35:30.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.779+0000 7fe3f9800700 1 -- start start 2024-02-28T16:35:30.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.779+0000 7fe3f9800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4070870 0x7fe3f411a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.779+0000 7fe3f9800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f4071f60 0x7fe3f411a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.779+0000 7fe3f9800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f411aeb0 con 0x7fe3f4070870 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.779+0000 7fe3f9800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f4114130 con 0x7fe3f4071f60 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4070870 0x7fe3f411a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4070870 0x7fe3f411a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34290/0 (socket says 172.21.15.148:34290) 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2a00700 1 -- 172.21.15.148:0/725616173 learned_addr learned my addr 172.21.15.148:0/725616173 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2000700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f4071f60 0x7fe3f411a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2a00700 1 -- 172.21.15.148:0/725616173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f4071f60 msgr2=0x7fe3f411a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2a00700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f4071f60 0x7fe3f411a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2a00700 1 -- 172.21.15.148:0/725616173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4009940 con 0x7fe3f4070870 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2000700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f4071f60 0x7fe3f411a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:35:30.769 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.780+0000 7fe3f2a00700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4070870 0x7fe3f411a290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4008dd0 tx=0x7fe3e4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:30.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.781+0000 7fe3eaa00700 1 -- 172.21.15.148:0/725616173 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3e400e040 con 0x7fe3f4070870 2024-02-28T16:35:30.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.781+0000 7fe3eaa00700 1 -- 172.21.15.148:0/725616173 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3e40128e0 con 0x7fe3f4070870 2024-02-28T16:35:30.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.781+0000 7fe3eaa00700 1 -- 172.21.15.148:0/725616173 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3e401c980 con 0x7fe3f4070870 2024-02-28T16:35:30.770 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.781+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f4114350 con 0x7fe3f4070870 2024-02-28T16:35:30.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.781+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f4114890 con 0x7fe3f4070870 2024-02-28T16:35:30.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.782+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f40fe400 con 0x7fe3f4070870 2024-02-28T16:35:30.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.783+0000 7fe3eaa00700 1 -- 172.21.15.148:0/725616173 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe3e4012a50 con 0x7fe3f4070870 2024-02-28T16:35:30.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.784+0000 7fe3eaa00700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe3d806d7f0 0x7fe3d806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:30.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.784+0000 7fe3eaa00700 1 -- 172.21.15.148:0/725616173 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe3e408eb60 con 0x7fe3f4070870 2024-02-28T16:35:30.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.785+0000 7fe3f2000700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe3d806d7f0 0x7fe3d806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:30.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.785+0000 7fe3f2000700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe3d806d7f0 0x7fe3d806fca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fd0 tx=0x7fe3e0008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:30.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:30.789+0000 7fe3eaa00700 1 -- 172.21.15.148:0/725616173 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe3e405bf10 con 0x7fe3f4070870 2024-02-28T16:35:31.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.017+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3f4115870 con 0x7fe3d806d7f0 2024-02-28T16:35:31.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.045+0000 7fe3eaa00700 1 -- 172.21.15.148:0/725616173 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe3f4115870 con 0x7fe3d806d7f0 2024-02-28T16:35:31.034 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (5m) 12s ago 20m 14.1M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (2m) 12s ago 21m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (118s) 113s ago 19m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (4m) 12s ago 20m 73.8M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (13m) 12s ago 13m 15.0M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (12m) 12s ago 12m 145M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (12m) 113s ago 12m 14.7M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (12m) 113s ago 12m 14.5M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (8m) 12s ago 22m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (6m) 113s ago 19m 449M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (3m) 12s ago 23m 44.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (3m) 113s ago 18m 31.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (6m) 12s ago 21m 7780k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (6m) 113s ago 19m 7822k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:35:31.035 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (86s) 12s ago 17m 82.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:35:31.036 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (54s) 12s ago 17m 81.4M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:35:31.036 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (20s) 12s ago 16m 11.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:35:31.036 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (16m) 113s ago 16m 238M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 52bc9a17f471 2024-02-28T16:35:31.036 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (15m) 113s ago 15m 208M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:35:31.036 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (14m) 113s ago 14m 193M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:35:31.036 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (5m) 12s ago 20m 54.1M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe3d806d7f0 msgr2=0x7fe3d806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe3d806d7f0 0x7fe3d806fca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fd0 tx=0x7fe3e0008040 comp rx=0 tx=0).stop 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4070870 msgr2=0x7fe3f411a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4070870 0x7fe3f411a290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4008dd0 tx=0x7fe3e4004d10 comp rx=0 tx=0).stop 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 shutdown_connections 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe3d806d7f0 0x7fe3d806fca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe3f4070870 0x7fe3f411a290 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 --2- 172.21.15.148:0/725616173 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe3f4071f60 0x7fe3f411a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.037 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 >> 172.21.15.148:0/725616173 conn(0x7fe3f40f8ae0 msgr2=0x7fe3f40fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 shutdown_connections 2024-02-28T16:35:31.038 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.048+0000 7fe3f9800700 1 -- 172.21.15.148:0/725616173 wait complete. 2024-02-28T16:35:31.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 -- 172.21.15.148:0/1331709350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fe8f0 msgr2=0x7fddcc106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 --2- 172.21.15.148:0/1331709350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fe8f0 0x7fddcc106f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fddb8004940 tx=0x7fddb8009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:31.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 -- 172.21.15.148:0/1331709350 shutdown_connections 2024-02-28T16:35:31.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 --2- 172.21.15.148:0/1331709350 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fe8f0 0x7fddcc106f30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 --2- 172.21.15.148:0/1331709350 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddcc0fdf50 0x7fddcc0fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.189 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 -- 172.21.15.148:0/1331709350 >> 172.21.15.148:0/1331709350 conn(0x7fddcc0f79e0 msgr2=0x7fddcc0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:31.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 -- 172.21.15.148:0/1331709350 shutdown_connections 2024-02-28T16:35:31.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.200+0000 7fddd0c00700 1 -- 172.21.15.148:0/1331709350 wait complete. 2024-02-28T16:35:31.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.201+0000 7fddd0c00700 1 Processor -- start 2024-02-28T16:35:31.190 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.201+0000 7fddd0c00700 1 -- start start 2024-02-28T16:35:31.191 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.201+0000 7fddd0c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fdf50 0x7fddcc113ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.201+0000 7fddd0c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddcc0fe8f0 0x7fddcc114020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.201+0000 7fddd0c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc114700 con 0x7fddcc0fdf50 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.201+0000 7fddd0c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc10d9a0 con 0x7fddcc0fe8f0 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fdf50 0x7fddcc113ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fdf50 0x7fddcc113ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34306/0 (socket says 172.21.15.148:34306) 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9e00700 1 -- 172.21.15.148:0/4124961862 learned_addr learned my addr 172.21.15.148:0/4124961862 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9400700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddcc0fe8f0 0x7fddcc114020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9e00700 1 -- 172.21.15.148:0/4124961862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddcc0fe8f0 msgr2=0x7fddcc114020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9e00700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddcc0fe8f0 0x7fddcc114020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9e00700 1 -- 172.21.15.148:0/4124961862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8005040 con 0x7fddcc0fdf50 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9400700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddcc0fe8f0 0x7fddcc114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:35:31.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.202+0000 7fddc9e00700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fdf50 0x7fddcc113ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00b790 tx=0x7fddbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:31.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.203+0000 7fddc2000700 1 -- 172.21.15.148:0/4124961862 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddbc00f770 con 0x7fddcc0fdf50 2024-02-28T16:35:31.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.203+0000 7fddc2000700 1 -- 172.21.15.148:0/4124961862 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddbc00fda0 con 0x7fddcc0fdf50 2024-02-28T16:35:31.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.203+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc10dc80 con 0x7fddcc0fdf50 2024-02-28T16:35:31.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.203+0000 7fddc2000700 1 -- 172.21.15.148:0/4124961862 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddbc00d310 con 0x7fddcc0fdf50 2024-02-28T16:35:31.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.203+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc10e1c0 con 0x7fddcc0fdf50 2024-02-28T16:35:31.193 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.204+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc104540 con 0x7fddcc0fdf50 2024-02-28T16:35:31.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.205+0000 7fddc2000700 1 -- 172.21.15.148:0/4124961862 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fddbc010420 con 0x7fddcc0fdf50 2024-02-28T16:35:31.194 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.206+0000 7fddc2000700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddb006d7f0 0x7fddb006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:31.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.206+0000 7fddc2000700 1 -- 172.21.15.148:0/4124961862 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fddbc08cea0 con 0x7fddcc0fdf50 2024-02-28T16:35:31.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.206+0000 7fddc9400700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddb006d7f0 0x7fddb006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:31.195 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.207+0000 7fddc9400700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddb006d7f0 0x7fddb006fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddb8004f90 tx=0x7fddb8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:31.199 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.211+0000 7fddc2000700 1 -- 172.21.15.148:0/4124961862 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fddbc05a2d0 con 0x7fddcc0fdf50 2024-02-28T16:35:31.502 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.514+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fddcc064b00 con 0x7fddcc0fdf50 2024-02-28T16:35:31.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.515+0000 7fddc2000700 1 -- 172.21.15.148:0/4124961862 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fddbc059e60 con 0x7fddcc0fdf50 2024-02-28T16:35:31.503 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:35:31.503 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 3, 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:35:31.504 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:35:31.505 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 7, 2024-02-28T16:35:31.505 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 7 2024-02-28T16:35:31.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:35:31.505 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:35:31.505 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddb006d7f0 msgr2=0x7fddb006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddb006d7f0 0x7fddb006fca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fddb8004f90 tx=0x7fddb8009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fdf50 msgr2=0x7fddcc113ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fdf50 0x7fddcc113ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00b790 tx=0x7fddbc009250 comp rx=0 tx=0).stop 2024-02-28T16:35:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 shutdown_connections 2024-02-28T16:35:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddb006d7f0 0x7fddb006fca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fddcc0fdf50 0x7fddcc113ae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.506 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 --2- 172.21.15.148:0/4124961862 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddcc0fe8f0 0x7fddcc114020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.517+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 >> 172.21.15.148:0/4124961862 conn(0x7fddcc0f79e0 msgr2=0x7fddcc1016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.518+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 shutdown_connections 2024-02-28T16:35:31.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.518+0000 7fddd0c00700 1 -- 172.21.15.148:0/4124961862 wait complete. 2024-02-28T16:35:31.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 -- 172.21.15.148:0/2072068861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fe8f0 msgr2=0x7f8c60107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.644 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 --2- 172.21.15.148:0/2072068861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fe8f0 0x7f8c60107050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c004970 tx=0x7f8c4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 -- 172.21.15.148:0/2072068861 shutdown_connections 2024-02-28T16:35:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 --2- 172.21.15.148:0/2072068861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fe8f0 0x7f8c60107050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 --2- 172.21.15.148:0/2072068861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c600fdfe0 0x7f8c600fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 -- 172.21.15.148:0/2072068861 >> 172.21.15.148:0/2072068861 conn(0x7f8c60071d90 msgr2=0x7f8c60072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 -- 172.21.15.148:0/2072068861 shutdown_connections 2024-02-28T16:35:31.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.656+0000 7f8c68600700 1 -- 172.21.15.148:0/2072068861 wait complete. 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.657+0000 7f8c68600700 1 Processor -- start 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.657+0000 7f8c68600700 1 -- start start 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.657+0000 7f8c68600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fdfe0 0x7f8c601139f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.657+0000 7f8c68600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c600fe8f0 0x7f8c60113f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.657+0000 7f8c68600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60114580 con 0x7f8c600fdfe0 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.657+0000 7f8c68600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6010d8b0 con 0x7f8c600fe8f0 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.657+0000 7f8c65c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fdfe0 0x7f8c601139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:31.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.658+0000 7f8c65c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fdfe0 0x7f8c601139f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34316/0 (socket says 172.21.15.148:34316) 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.658+0000 7f8c65c00700 1 -- 172.21.15.148:0/2178712306 learned_addr learned my addr 172.21.15.148:0/2178712306 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.658+0000 7f8c65200700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c600fe8f0 0x7f8c60113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.658+0000 7f8c65c00700 1 -- 172.21.15.148:0/2178712306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c600fe8f0 msgr2=0x7f8c60113f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.658+0000 7f8c65c00700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c600fe8f0 0x7f8c60113f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.658+0000 7f8c65c00700 1 -- 172.21.15.148:0/2178712306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c005040 con 0x7f8c600fdfe0 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.658+0000 7f8c65c00700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fdfe0 0x7f8c601139f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400c830 tx=0x7f8c54004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.659+0000 7f8c5d600700 1 -- 172.21.15.148:0/2178712306 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c540106f0 con 0x7f8c600fdfe0 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.659+0000 7f8c5d600700 1 -- 172.21.15.148:0/2178712306 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c54010d20 con 0x7f8c600fdfe0 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.659+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6010db90 con 0x7f8c600fdfe0 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.659+0000 7f8c5d600700 1 -- 172.21.15.148:0/2178712306 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c540113a0 con 0x7f8c600fdfe0 2024-02-28T16:35:31.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.659+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6010e0a0 con 0x7f8c600fdfe0 2024-02-28T16:35:31.649 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:31 smithi148 ceph-mon[112463]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:31.649 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:31 smithi148 ceph-mon[112463]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:31.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.660+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c601046c0 con 0x7f8c600fdfe0 2024-02-28T16:35:31.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.662+0000 7f8c5d600700 1 -- 172.21.15.148:0/2178712306 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f8c54012400 con 0x7f8c600fdfe0 2024-02-28T16:35:31.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.663+0000 7f8c5d600700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8c4806d7f0 0x7f8c4806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:31.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.663+0000 7f8c5d600700 1 -- 172.21.15.148:0/2178712306 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8c5408d9b0 con 0x7f8c600fdfe0 2024-02-28T16:35:31.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.663+0000 7f8c65200700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8c4806d7f0 0x7f8c4806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:31.652 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.664+0000 7f8c65200700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8c4806d7f0 0x7f8c4806fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c004940 tx=0x7f8c4c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:31.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.667+0000 7f8c5d600700 1 -- 172.21.15.148:0/2178712306 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8c5405ade0 con 0x7f8c600fdfe0 2024-02-28T16:35:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:31 smithi157 ceph-mon[89328]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:31.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:31 smithi157 ceph-mon[89328]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:31.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.926+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8c600738b0 con 0x7f8c600fdfe0 2024-02-28T16:35:31.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.927+0000 7f8c5d600700 1 -- 172.21.15.148:0/2178712306 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f8c5405a970 con 0x7f8c600fdfe0 2024-02-28T16:35:31.915 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:35:31.915 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:35:31.915 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:35:31.915 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:35:31.915 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:35:31.915 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:35:31.916 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:35:31.917 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:35:31.918 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:35:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8c4806d7f0 msgr2=0x7f8c4806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8c4806d7f0 0x7f8c4806fca0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c004940 tx=0x7f8c4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fdfe0 msgr2=0x7f8c601139f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fdfe0 0x7f8c601139f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400c830 tx=0x7f8c54004470 comp rx=0 tx=0).stop 2024-02-28T16:35:31.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 shutdown_connections 2024-02-28T16:35:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8c4806d7f0 0x7f8c4806fca0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8c600fdfe0 0x7f8c601139f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 --2- 172.21.15.148:0/2178712306 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8c600fe8f0 0x7f8c60113f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 >> 172.21.15.148:0/2178712306 conn(0x7f8c60071d90 msgr2=0x7f8c60101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 shutdown_connections 2024-02-28T16:35:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:31.931+0000 7f8c68600700 1 -- 172.21.15.148:0/2178712306 wait complete. 2024-02-28T16:35:31.920 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:35:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 -- 172.21.15.148:0/960147309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d50102f50 msgr2=0x7f4d50103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 --2- 172.21.15.148:0/960147309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d50102f50 0x7f4d50103320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d44004940 tx=0x7f4d44009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:32.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 -- 172.21.15.148:0/960147309 shutdown_connections 2024-02-28T16:35:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 --2- 172.21.15.148:0/960147309 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d501038f0 0x7f4d500fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 --2- 172.21.15.148:0/960147309 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d50102f50 0x7f4d50103320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 -- 172.21.15.148:0/960147309 >> 172.21.15.148:0/960147309 conn(0x7f4d500f8ae0 msgr2=0x7f4d500faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 -- 172.21.15.148:0/960147309 shutdown_connections 2024-02-28T16:35:32.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.079+0000 7f4d57e00700 1 -- 172.21.15.148:0/960147309 wait complete. 2024-02-28T16:35:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.080+0000 7f4d57e00700 1 Processor -- start 2024-02-28T16:35:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.080+0000 7f4d57e00700 1 -- start start 2024-02-28T16:35:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.080+0000 7f4d57e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d50102f50 0x7f4d50115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.080+0000 7f4d57e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d501038f0 0x7f4d50116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.080+0000 7f4d57e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50116830 con 0x7f4d501038f0 2024-02-28T16:35:32.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.080+0000 7f4d57e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5010faf0 con 0x7f4d50102f50 2024-02-28T16:35:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d54a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d501038f0 0x7f4d50116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d54a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d501038f0 0x7f4d50116150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49066/0 (socket says 172.21.15.148:49066) 2024-02-28T16:35:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d54a00700 1 -- 172.21.15.148:0/2610450861 learned_addr learned my addr 172.21.15.148:0/2610450861 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:35:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d55400700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d50102f50 0x7f4d50115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d54a00700 1 -- 172.21.15.148:0/2610450861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d50102f50 msgr2=0x7f4d50115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d54a00700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d50102f50 0x7f4d50115c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d54a00700 1 -- 172.21.15.148:0/2610450861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44005040 con 0x7f4d501038f0 2024-02-28T16:35:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.081+0000 7f4d54a00700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d501038f0 0x7f4d50116150 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00b790 tx=0x7f4d3c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.082+0000 7f4d4d600700 1 -- 172.21.15.148:0/2610450861 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d3c00f6f0 con 0x7f4d501038f0 2024-02-28T16:35:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.082+0000 7f4d4d600700 1 -- 172.21.15.148:0/2610450861 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d3c00fd20 con 0x7f4d501038f0 2024-02-28T16:35:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.082+0000 7f4d4d600700 1 -- 172.21.15.148:0/2610450861 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d3c0103a0 con 0x7f4d501038f0 2024-02-28T16:35:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.082+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5010fdd0 con 0x7f4d501038f0 2024-02-28T16:35:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.082+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d50110310 con 0x7f4d501038f0 2024-02-28T16:35:32.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.083+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d500fc6e0 con 0x7f4d501038f0 2024-02-28T16:35:32.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.084+0000 7f4d4d600700 1 -- 172.21.15.148:0/2610450861 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4d3c011400 con 0x7f4d501038f0 2024-02-28T16:35:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.086+0000 7f4d4d600700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4d3806d7f0 0x7f4d3806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.086+0000 7f4d4d600700 1 -- 172.21.15.148:0/2610450861 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4d3c08cce0 con 0x7f4d501038f0 2024-02-28T16:35:32.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.086+0000 7f4d55400700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4d3806d7f0 0x7f4d3806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:32.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.087+0000 7f4d55400700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4d3806d7f0 0x7f4d3806fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b3b0 tx=0x7f4d44009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:32.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.090+0000 7f4d4d600700 1 -- 172.21.15.148:0/2610450861 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4d3c056560 con 0x7f4d501038f0 2024-02-28T16:35:32.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.310+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d50111260 con 0x7f4d3806d7f0 2024-02-28T16:35:32.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.313+0000 7f4d4d600700 1 -- 172.21.15.148:0/2610450861 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4d50111260 con 0x7f4d3806d7f0 2024-02-28T16:35:32.301 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:35:32.301 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "crash" 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "9/21 daemons upgraded", 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:35:32.302 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:35:32.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.315+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4d3806d7f0 msgr2=0x7f4d3806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4d3806d7f0 0x7f4d3806fca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b3b0 tx=0x7f4d44009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:32.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d501038f0 msgr2=0x7f4d50116150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d501038f0 0x7f4d50116150 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00b790 tx=0x7f4d3c009220 comp rx=0 tx=0).stop 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 shutdown_connections 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4d3806d7f0 0x7f4d3806fca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4d50102f50 0x7f4d50115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 --2- 172.21.15.148:0/2610450861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d501038f0 0x7f4d50116150 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 >> 172.21.15.148:0/2610450861 conn(0x7f4d500f8ae0 msgr2=0x7f4d500fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 shutdown_connections 2024-02-28T16:35:32.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.316+0000 7f4d57e00700 1 -- 172.21.15.148:0/2610450861 wait complete. 2024-02-28T16:35:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.459+0000 7f00ce200700 1 -- 172.21.15.148:0/219208531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c8103dc0 msgr2=0x7f00c8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.459+0000 7f00ce200700 1 --2- 172.21.15.148:0/219208531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c8103dc0 0x7f00c8104210 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00b0004940 tx=0x7f00b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.460+0000 7f00ce200700 1 -- 172.21.15.148:0/219208531 shutdown_connections 2024-02-28T16:35:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.460+0000 7f00ce200700 1 --2- 172.21.15.148:0/219208531 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c8103dc0 0x7f00c8104210 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.460+0000 7f00ce200700 1 --2- 172.21.15.148:0/219208531 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00c81095f0 0x7f00c81099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.460+0000 7f00ce200700 1 -- 172.21.15.148:0/219208531 >> 172.21.15.148:0/219208531 conn(0x7f00c8072d50 msgr2=0x7f00c8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:32.448 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.460+0000 7f00ce200700 1 -- 172.21.15.148:0/219208531 shutdown_connections 2024-02-28T16:35:32.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.460+0000 7f00ce200700 1 -- 172.21.15.148:0/219208531 wait complete. 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.460+0000 7f00ce200700 1 Processor -- start 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00ce200700 1 -- start start 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00ce200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00c8103dc0 0x7f00c811a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00ce200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c81095f0 0x7f00c811a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00ce200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c811abe0 con 0x7f00c81095f0 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00ce200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c8113ef0 con 0x7f00c8103dc0 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00bfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c81095f0 0x7f00c811a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:32.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00bfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c81095f0 0x7f00c811a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:49092/0 (socket says 172.21.15.148:49092) 2024-02-28T16:35:32.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00bfe00700 1 -- 172.21.15.148:0/2751885267 learned_addr learned my addr 172.21.15.148:0/2751885267 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:35:32.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.461+0000 7f00c7400700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00c8103dc0 0x7f00c811a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:32.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00bfe00700 1 -- 172.21.15.148:0/2751885267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00c8103dc0 msgr2=0x7f00c811a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00bfe00700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00c8103dc0 0x7f00c811a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00bfe00700 1 -- 172.21.15.148:0/2751885267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0005040 con 0x7f00c81095f0 2024-02-28T16:35:32.451 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00c7400700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00c8103dc0 0x7f00c811a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:35:32.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00bfe00700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c81095f0 0x7f00c811a590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009100 tx=0x7f00b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:32.452 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00bf400700 1 -- 172.21.15.148:0/2751885267 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b000e040 con 0x7f00c81095f0 2024-02-28T16:35:32.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00bf400700 1 -- 172.21.15.148:0/2751885267 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00b0004290 con 0x7f00c81095f0 2024-02-28T16:35:32.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c8114170 con 0x7f00c81095f0 2024-02-28T16:35:32.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.462+0000 7f00bf400700 1 -- 172.21.15.148:0/2751885267 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b001c630 con 0x7f00c81095f0 2024-02-28T16:35:32.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.463+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c81146b0 con 0x7f00c81095f0 2024-02-28T16:35:32.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.464+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c810b9c0 con 0x7f00c81095f0 2024-02-28T16:35:32.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.465+0000 7f00bf400700 1 -- 172.21.15.148:0/2751885267 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f00b000bbf0 con 0x7f00c81095f0 2024-02-28T16:35:32.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.465+0000 7f00bf400700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f00ac06d7e0 0x7f00ac06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:35:32.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.466+0000 7f00bf400700 1 -- 172.21.15.148:0/2751885267 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f00b008e210 con 0x7f00c81095f0 2024-02-28T16:35:32.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.466+0000 7f00c7400700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f00ac06d7e0 0x7f00ac06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:35:32.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.466+0000 7f00c7400700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f00ac06d7e0 0x7f00ac06fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009fd0 tx=0x7f00b8009e90 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:35:32.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.470+0000 7f00bf400700 1 -- 172.21.15.148:0/2751885267 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f00b005b660 con 0x7f00c81095f0 2024-02-28T16:35:32.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:32 smithi148 ceph-mon[112463]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:32.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:32 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4124961862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:32.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:32 smithi148 ceph-mon[112463]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:32.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:32 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2178712306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:35:32.659 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:32 smithi157 ceph-mon[89328]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:32.659 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:32 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4124961862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:32.659 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:32 smithi157 ceph-mon[89328]: pgmap v125: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:32.659 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:32 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2178712306' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:35:32.750 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.762+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f00c8075870 con 0x7f00c81095f0 2024-02-28T16:35:32.751 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.763+0000 7f00bf400700 1 -- 172.21.15.148:0/2751885267 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f00b005b1f0 con 0x7f00c81095f0 2024-02-28T16:35:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:35:32.751 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:35:32.751 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:35:32.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f00ac06d7e0 msgr2=0x7f00ac06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f00ac06d7e0 0x7f00ac06fc90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009fd0 tx=0x7f00b8009e90 comp rx=0 tx=0).stop 2024-02-28T16:35:32.753 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c81095f0 msgr2=0x7f00c811a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c81095f0 0x7f00c811a590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009100 tx=0x7f00b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 shutdown_connections 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f00ac06d7e0 0x7f00ac06fc90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f00c8103dc0 0x7f00c811a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 --2- 172.21.15.148:0/2751885267 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00c81095f0 0x7f00c811a590 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.765+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 >> 172.21.15.148:0/2751885267 conn(0x7f00c8072d50 msgr2=0x7f00c8074810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.766+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 shutdown_connections 2024-02-28T16:35:32.754 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:35:32.766+0000 7f00ce200700 1 -- 172.21.15.148:0/2751885267 wait complete. 2024-02-28T16:35:33.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:33 smithi157 ceph-mon[89328]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:33.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:33 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2751885267' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:35:33.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:33 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:33.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:33 smithi148 ceph-mon[112463]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:35:33.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:33 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2751885267' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:35:33.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:33 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:34.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:34 smithi157 ceph-mon[89328]: pgmap v126: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:34.737 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:34 smithi157 systemd[1]: Stopping Ceph osd.3 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:35:34.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:34 smithi148 ceph-mon[112463]: pgmap v126: 65 pgs: 65 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:35.237 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:34 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[43867]: 2024-02-28T16:35:34.916+0000 7fd359000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:35:35.237 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:34 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[43867]: 2024-02-28T16:35:34.916+0000 7fd359000700 -1 osd.3 64 *** Got signal Terminated *** 2024-02-28T16:35:35.237 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:34 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[43867]: 2024-02-28T16:35:34.916+0000 7fd359000700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:35:35.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:35 smithi157 ceph-mon[89328]: osd.3 marked itself down and dead 2024-02-28T16:35:35.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:35 smithi148 ceph-mon[112463]: osd.3 marked itself down and dead 2024-02-28T16:35:36.431 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:36 smithi157 podman[98380]: 2024-02-28 16:35:36.141542846 +0000 UTC m=+1.359843650 container died 52bc9a17f471e04c4e5c2cb81b5caf88430658146500bd4ba2f110d2b6b1a14f (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-c0f02e6, ceph=True, org.label-schema.license=GPLv2) 2024-02-28T16:35:36.736 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:36 smithi157 podman[98380]: 2024-02-28 16:35:36.5782556 +0000 UTC m=+1.796556412 container cleanup 52bc9a17f471e04c4e5c2cb81b5caf88430658146500bd4ba2f110d2b6b1a14f (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c0f02e6, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:35:36.737 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:36 smithi157 bash[98380]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3 2024-02-28T16:35:36.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:36 smithi157 ceph-mon[89328]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:35:36.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:36 smithi157 ceph-mon[89328]: osdmap e65: 6 total, 5 up, 6 in 2024-02-28T16:35:36.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:36 smithi157 ceph-mon[89328]: pgmap v128: 65 pgs: 16 stale+active+clean, 49 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:36 smithi148 ceph-mon[112463]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:35:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:36 smithi148 ceph-mon[112463]: osdmap e65: 6 total, 5 up, 6 in 2024-02-28T16:35:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:36 smithi148 ceph-mon[112463]: pgmap v128: 65 pgs: 16 stale+active+clean, 49 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:37.237 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:36 smithi157 podman[98398]: 2024-02-28 16:35:36.804449473 +0000 UTC m=+0.651512273 container remove 52bc9a17f471e04c4e5c2cb81b5caf88430658146500bd4ba2f110d2b6b1a14f (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-c0f02e6, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-02-28T16:35:37.617 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:37 smithi157 ceph-mon[89328]: osdmap e66: 6 total, 5 up, 6 in 2024-02-28T16:35:37.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:37 smithi148 ceph-mon[112463]: osdmap e66: 6 total, 5 up, 6 in 2024-02-28T16:35:37.987 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:37 smithi157 podman[98486]: 2024-02-28 16:35:37.534948945 +0000 UTC m=+0.034405230 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:35:37.987 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:37 smithi157 podman[98486]: 2024-02-28 16:35:37.688943745 +0000 UTC m=+0.188400053 container create 24ceaad6db445397952ec372e4e44dd88ad16784ed1649b8062c0257aca6f8af (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:35:38.448 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:38 smithi157 podman[98486]: 2024-02-28 16:35:38.013013499 +0000 UTC m=+0.512469844 container init 24ceaad6db445397952ec372e4e44dd88ad16784ed1649b8062c0257aca6f8af (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:35:38.448 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:38 smithi157 podman[98486]: 2024-02-28 16:35:38.025734827 +0000 UTC m=+0.525191165 container start 24ceaad6db445397952ec372e4e44dd88ad16784ed1649b8062c0257aca6f8af (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-28T16:35:38.448 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:38 smithi157 podman[98486]: 2024-02-28 16:35:38.116357264 +0000 UTC m=+0.615813615 container attach 24ceaad6db445397952ec372e4e44dd88ad16784ed1649b8062c0257aca6f8af (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-02-28T16:35:38.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:38 smithi157 ceph-mon[89328]: pgmap v130: 65 pgs: 5 active+undersized+degraded, 12 stale+active+clean, 6 active+undersized, 42 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 13/264 objects degraded (4.924%) 2024-02-28T16:35:38.737 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:38 smithi157 podman[98486]: 2024-02-28 16:35:38.460848172 +0000 UTC m=+0.960304506 container died 24ceaad6db445397952ec372e4e44dd88ad16784ed1649b8062c0257aca6f8af (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:35:38.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:38 smithi148 ceph-mon[112463]: pgmap v130: 65 pgs: 5 active+undersized+degraded, 12 stale+active+clean, 6 active+undersized, 42 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 13/264 objects degraded (4.924%) 2024-02-28T16:35:39.367 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:39 smithi157 podman[98512]: 2024-02-28 16:35:39.30083444 +0000 UTC m=+0.819334342 container remove 24ceaad6db445397952ec372e4e44dd88ad16784ed1649b8062c0257aca6f8af (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-28T16:35:39.368 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:39 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-28T16:35:39.368 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:39 smithi157 systemd[1]: Stopped Ceph osd.3 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:35:39.368 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:39 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.3.service: Consumed 2min 10.452s CPU time. 2024-02-28T16:35:39.728 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:39 smithi157 ceph-mon[89328]: Health check failed: Degraded data redundancy: 13/264 objects degraded (4.924%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:39.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:39 smithi148 ceph-mon[112463]: Health check failed: Degraded data redundancy: 13/264 objects degraded (4.924%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:39.986 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:39 smithi157 systemd[1]: Starting Ceph osd.3 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:35:40.335 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:40 smithi157 podman[98621]: 2024-02-28 16:35:40.002483738 +0000 UTC m=+0.034044519 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:35:40.335 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:40 smithi157 podman[98621]: 2024-02-28 16:35:40.146481813 +0000 UTC m=+0.178042623 container create aa6f361bdde2b52b1faa348f42629fac687d903f12436d024875d6666b17721d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-28T16:35:40.671 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:40 smithi157 ceph-mon[89328]: pgmap v131: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:40.671 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:40 smithi157 podman[98621]: 2024-02-28 16:35:40.484162954 +0000 UTC m=+0.515723798 container init aa6f361bdde2b52b1faa348f42629fac687d903f12436d024875d6666b17721d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=) 2024-02-28T16:35:40.671 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:40 smithi157 podman[98621]: 2024-02-28 16:35:40.495493871 +0000 UTC m=+0.527054688 container start aa6f361bdde2b52b1faa348f42629fac687d903f12436d024875d6666b17721d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-02-28T16:35:40.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:40 smithi148 ceph-mon[112463]: pgmap v131: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:40.986 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:40 smithi157 podman[98621]: 2024-02-28 16:35:40.682782178 +0000 UTC m=+0.714343034 container attach aa6f361bdde2b52b1faa348f42629fac687d903f12436d024875d6666b17721d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=) 2024-02-28T16:35:41.737 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate[98636]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate[98636]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 bash[98621]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 bash[98621]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 bash[98621]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 bash[98621]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 bash[98621]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 bash[98621]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 bash[98621]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate[98636]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate[98636]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate[98636]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T16:35:41.738 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate[98636]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T16:35:41.739 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate[98636]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T16:35:41.739 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:41 smithi157 podman[98621]: 2024-02-28 16:35:41.376489917 +0000 UTC m=+1.408050734 container died aa6f361bdde2b52b1faa348f42629fac687d903f12436d024875d6666b17721d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-28T16:35:42.620 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:42 smithi157 podman[98761]: 2024-02-28 16:35:42.27041466 +0000 UTC m=+0.871361563 container remove aa6f361bdde2b52b1faa348f42629fac687d903f12436d024875d6666b17721d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:35:42.873 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:42 smithi157 ceph-mon[89328]: pgmap v132: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:42.873 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:42.873 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:42.873 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:42 smithi157 podman[98823]: 2024-02-28 16:35:42.537222544 +0000 UTC m=+0.035279865 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:35:42.873 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:42 smithi157 podman[98823]: 2024-02-28 16:35:42.712192338 +0000 UTC m=+0.210249683 container create 95f4d72b6933f6f5bafc428382f27e1ce25b4ca41c260af7e7b3760447c9cd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:35:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:42 smithi148 ceph-mon[112463]: pgmap v132: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:43.486 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:43 smithi157 podman[98823]: 2024-02-28 16:35:43.015649968 +0000 UTC m=+0.513707360 container init 95f4d72b6933f6f5bafc428382f27e1ce25b4ca41c260af7e7b3760447c9cd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-28T16:35:43.486 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:43 smithi157 podman[98823]: 2024-02-28 16:35:43.026150388 +0000 UTC m=+0.524207763 container start 95f4d72b6933f6f5bafc428382f27e1ce25b4ca41c260af7e7b3760447c9cd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=main-1fb5d10, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-28T16:35:43.486 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:43 smithi157 ceph-osd[98842]: -- 172.21.15.157:0/255421733 <== mon.1 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56250b673680 con 0x56250b63cc00 2024-02-28T16:35:43.487 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:43 smithi157 bash[98823]: 95f4d72b6933f6f5bafc428382f27e1ce25b4ca41c260af7e7b3760447c9cd0d 2024-02-28T16:35:43.487 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:43 smithi157 systemd[1]: Started Ceph osd.3 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:35:43.986 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:43 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:35:43.592+0000 7fbc181327c0 -1 Falling back to public interface 2024-02-28T16:35:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:44.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:44 smithi157 ceph-mon[89328]: pgmap v133: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:44.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:44.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:44.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:44.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:44 smithi148 ceph-mon[112463]: pgmap v133: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:46.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:46 smithi157 ceph-mon[89328]: pgmap v134: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:47.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:46 smithi148 ceph-mon[112463]: pgmap v134: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:48.986 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:48 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:35:48.710+0000 7fbc181327c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-28T16:35:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:48 smithi157 ceph-mon[89328]: pgmap v135: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:48.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:48 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:49.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:48 smithi148 ceph-mon[112463]: pgmap v135: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:49.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:49.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:49.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:48 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 59/264 objects degraded (22.348%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:49.464 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:49 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:35:49.132+0000 7fbc181327c0 -1 osd.3 64 log_to_monitors true 2024-02-28T16:35:50.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:49 smithi157 ceph-mon[89328]: from='osd.3 [v2:172.21.15.157:6800/2446981625,v1:172.21.15.157:6801/2446981625]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:35:50.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:49 smithi157 ceph-mon[89328]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:35:50.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:50.161 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:49 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:50.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:49 smithi148 ceph-mon[112463]: from='osd.3 [v2:172.21.15.157:6800/2446981625,v1:172.21.15.157:6801/2446981625]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:35:50.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:49 smithi148 ceph-mon[112463]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T16:35:50.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:50.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:49 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:51.182 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:35:50 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:35:50.930+0000 7fbc02400700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:35:51.183 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:50 smithi157 ceph-mon[89328]: pgmap v136: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:51.183 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:50 smithi157 ceph-mon[89328]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:35:51.183 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:50 smithi157 ceph-mon[89328]: from='osd.3 [v2:172.21.15.157:6800/2446981625,v1:172.21.15.157:6801/2446981625]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:35:51.183 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:50 smithi157 ceph-mon[89328]: osdmap e67: 6 total, 5 up, 6 in 2024-02-28T16:35:51.183 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:50 smithi157 ceph-mon[89328]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:35:51.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:50 smithi148 ceph-mon[112463]: pgmap v136: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:51.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:50 smithi148 ceph-mon[112463]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T16:35:51.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:50 smithi148 ceph-mon[112463]: from='osd.3 [v2:172.21.15.157:6800/2446981625,v1:172.21.15.157:6801/2446981625]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:35:51.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:50 smithi148 ceph-mon[112463]: osdmap e67: 6 total, 5 up, 6 in 2024-02-28T16:35:51.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:50 smithi148 ceph-mon[112463]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:35:51.937 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:51 smithi157 ceph-mon[89328]: from='osd.3 ' entity='osd.3' 2024-02-28T16:35:52.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:51 smithi148 ceph-mon[112463]: from='osd.3 ' entity='osd.3' 2024-02-28T16:35:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:52 smithi157 ceph-mon[89328]: pgmap v138: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:53.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:52 smithi157 ceph-mon[89328]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:35:53.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:52 smithi157 ceph-mon[89328]: osd.3 [v2:172.21.15.157:6800/2446981625,v1:172.21.15.157:6801/2446981625] boot 2024-02-28T16:35:53.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:52 smithi157 ceph-mon[89328]: osdmap e68: 6 total, 6 up, 6 in 2024-02-28T16:35:53.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:35:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:52 smithi148 ceph-mon[112463]: pgmap v138: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 59/264 objects degraded (22.348%) 2024-02-28T16:35:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:52 smithi148 ceph-mon[112463]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:35:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:52 smithi148 ceph-mon[112463]: osd.3 [v2:172.21.15.157:6800/2446981625,v1:172.21.15.157:6801/2446981625] boot 2024-02-28T16:35:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:52 smithi148 ceph-mon[112463]: osdmap e68: 6 total, 6 up, 6 in 2024-02-28T16:35:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T16:35:54.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:53 smithi157 ceph-mon[89328]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T16:35:54.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:53 smithi157 ceph-mon[89328]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 14 active+undersized, 35 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:35:54.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:53 smithi148 ceph-mon[112463]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T16:35:54.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:53 smithi148 ceph-mon[112463]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 14 active+undersized, 35 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 50/264 objects degraded (18.939%) 2024-02-28T16:35:54.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:54 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 50/264 objects degraded (18.939%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:55.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:54 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 50/264 objects degraded (18.939%), 16 pgs degraded (PG_DEGRADED) 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: pgmap v142: 65 pgs: 3 active+undersized+degraded, 4 active+undersized, 58 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7/264 objects degraded (2.652%) 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:56.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: pgmap v142: 65 pgs: 3 active+undersized+degraded, 4 active+undersized, 58 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7/264 objects degraded (2.652%) 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:35:56.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:56.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:56.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:35:56.988 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:35:57.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:57 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:35:57.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:57 smithi157 ceph-mon[89328]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-28T16:35:58.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:57 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:35:58.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:57 smithi148 ceph-mon[112463]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-28T16:35:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:58 smithi157 ceph-mon[89328]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:58.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:35:58 smithi157 ceph-mon[89328]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded) 2024-02-28T16:35:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:58 smithi148 ceph-mon[112463]: pgmap v143: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:35:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:35:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:35:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:35:58 smithi148 ceph-mon[112463]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/264 objects degraded (2.652%), 3 pgs degraded) 2024-02-28T16:36:00.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:00 smithi157 ceph-mon[89328]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:00 smithi148 ceph-mon[112463]: pgmap v144: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 -- 172.21.15.148:0/529432481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 msgr2=0x7f4e98103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 --2- 172.21.15.148:0/529432481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98103160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e88004940 tx=0x7f4e88009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 -- 172.21.15.148:0/529432481 shutdown_connections 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 --2- 172.21.15.148:0/529432481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e98103730 0x7f4e980fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 --2- 172.21.15.148:0/529432481 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98103160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 -- 172.21.15.148:0/529432481 >> 172.21.15.148:0/529432481 conn(0x7f4e980f8940 msgr2=0x7f4e980fad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 -- 172.21.15.148:0/529432481 shutdown_connections 2024-02-28T16:36:02.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.931+0000 7f4e97200700 1 -- 172.21.15.148:0/529432481 wait complete. 2024-02-28T16:36:02.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.932+0000 7f4e97200700 1 Processor -- start 2024-02-28T16:36:02.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e97200700 1 -- start start 2024-02-28T16:36:02.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e97200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:02.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e97200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e98103730 0x7f4e98113d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:02.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e97200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981143b0 con 0x7f4e98102d90 2024-02-28T16:36:02.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e97200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9810d6e0 con 0x7f4e98103730 2024-02-28T16:36:02.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e95e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:02.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e95e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98113820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34804/0 (socket says 172.21.15.148:34804) 2024-02-28T16:36:02.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.933+0000 7f4e95e00700 1 -- 172.21.15.148:0/1879714263 learned_addr learned my addr 172.21.15.148:0/1879714263 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e95e00700 1 -- 172.21.15.148:0/1879714263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e98103730 msgr2=0x7f4e98113d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e8fe00700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e98103730 0x7f4e98113d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e95e00700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e98103730 0x7f4e98113d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e95e00700 1 -- 172.21.15.148:0/1879714263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88005040 con 0x7f4e98102d90 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e8fe00700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e98103730 0x7f4e98113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e95e00700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98113820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009150 tx=0x7f4e88009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e8e000700 1 -- 172.21.15.148:0/1879714263 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8800e040 con 0x7f4e98102d90 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e8e000700 1 -- 172.21.15.148:0/1879714263 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e8800bbf0 con 0x7f4e98102d90 2024-02-28T16:36:02.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e8e000700 1 -- 172.21.15.148:0/1879714263 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e8801c630 con 0x7f4e98102d90 2024-02-28T16:36:02.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.934+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9810d960 con 0x7f4e98102d90 2024-02-28T16:36:02.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.935+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9810df20 con 0x7f4e98102d90 2024-02-28T16:36:02.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.936+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9805f5c0 con 0x7f4e98102d90 2024-02-28T16:36:02.925 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.937+0000 7f4e8e000700 1 -- 172.21.15.148:0/1879714263 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4e8800bd60 con 0x7f4e98102d90 2024-02-28T16:36:02.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.938+0000 7f4e8e000700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e7c06d7f0 0x7f4e7c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:02.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.938+0000 7f4e8e000700 1 -- 172.21.15.148:0/1879714263 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4e8808e1b0 con 0x7f4e98102d90 2024-02-28T16:36:02.926 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.938+0000 7f4e8fe00700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e7c06d7f0 0x7f4e7c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:02.927 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.939+0000 7f4e8fe00700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e7c06d7f0 0x7f4e7c06fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007fd0 tx=0x7f4e80009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:02.932 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:02.944+0000 7f4e8e000700 1 -- 172.21.15.148:0/1879714263 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4e8805b6a0 con 0x7f4e98102d90 2024-02-28T16:36:02.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:02 smithi157 ceph-mon[89328]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:03.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:02 smithi148 ceph-mon[112463]: pgmap v145: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:03.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.178+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e9810ee70 con 0x7f4e7c06d7f0 2024-02-28T16:36:03.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.181+0000 7f4e8e000700 1 -- 172.21.15.148:0/1879714263 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4e9810ee70 con 0x7f4e7c06d7f0 2024-02-28T16:36:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.183+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e7c06d7f0 msgr2=0x7f4e7c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.183+0000 7f4e97200700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e7c06d7f0 0x7f4e7c06fca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007fd0 tx=0x7f4e80009040 comp rx=0 tx=0).stop 2024-02-28T16:36:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.183+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 msgr2=0x7f4e98113820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98113820 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009150 tx=0x7f4e88009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 shutdown_connections 2024-02-28T16:36:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e7c06d7f0 0x7f4e7c06fca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.172 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4e98102d90 0x7f4e98113820 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 --2- 172.21.15.148:0/1879714263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4e98103730 0x7f4e98113d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 >> 172.21.15.148:0/1879714263 conn(0x7f4e980f8940 msgr2=0x7f4e980fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:03.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 shutdown_connections 2024-02-28T16:36:03.173 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.184+0000 7f4e97200700 1 -- 172.21.15.148:0/1879714263 wait complete. 2024-02-28T16:36:03.187 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.324+0000 7fc4c6c00700 1 -- 172.21.15.148:0/97061028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 msgr2=0x7fc4c0100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.324+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/97061028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c0100d10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8004940 tx=0x7fc4a8009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.324+0000 7fc4c6c00700 1 -- 172.21.15.148:0/97061028 shutdown_connections 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.324+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/97061028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c0100d10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.324+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/97061028 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4c00fbd50 0x7fc4c00fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.324+0000 7fc4c6c00700 1 -- 172.21.15.148:0/97061028 >> 172.21.15.148:0/97061028 conn(0x7fc4c00f7a10 msgr2=0x7fc4c00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.325+0000 7fc4c6c00700 1 -- 172.21.15.148:0/97061028 shutdown_connections 2024-02-28T16:36:03.313 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.325+0000 7fc4c6c00700 1 -- 172.21.15.148:0/97061028 wait complete. 2024-02-28T16:36:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.325+0000 7fc4c6c00700 1 Processor -- start 2024-02-28T16:36:03.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.326+0000 7fc4c6c00700 1 -- start start 2024-02-28T16:36:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.326+0000 7fc4c6c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4c00fbd50 0x7fc4c011a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.326+0000 7fc4c6c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c011a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.326+0000 7fc4c6c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c011ad50 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.326+0000 7fc4c6c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c0114060 con 0x7fc4c00fbd50 2024-02-28T16:36:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.326+0000 7fc4b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c011a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c011a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34824/0 (socket says 172.21.15.148:34824) 2024-02-28T16:36:03.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4b7400700 1 -- 172.21.15.148:0/3050012688 learned_addr learned my addr 172.21.15.148:0/3050012688 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:03.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4bfe00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4c00fbd50 0x7fc4c011a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:03.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4b7400700 1 -- 172.21.15.148:0/3050012688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4c00fbd50 msgr2=0x7fc4c011a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4b7400700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4c00fbd50 0x7fc4c011a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4b7400700 1 -- 172.21.15.148:0/3050012688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a8005040 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4bfe00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4c00fbd50 0x7fc4c011a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:36:03.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4b7400700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c011a700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009fd0 tx=0x7fc4a8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:03.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.327+0000 7fc4bcc00700 1 -- 172.21.15.148:0/3050012688 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4a800e040 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.328+0000 7fc4bcc00700 1 -- 172.21.15.148:0/3050012688 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4a800bbf0 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.328+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c01142e0 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.328+0000 7fc4bcc00700 1 -- 172.21.15.148:0/3050012688 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4a801c3f0 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.328+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c0114820 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.329+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c00fe430 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.330+0000 7fc4bcc00700 1 -- 172.21.15.148:0/3050012688 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc4a800bd60 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.331+0000 7fc4bcc00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc4a406d7f0 0x7fc4a406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.331+0000 7fc4bcc00700 1 -- 172.21.15.148:0/3050012688 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc4a808e0b0 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.319 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.331+0000 7fc4bfe00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc4a406d7f0 0x7fc4a406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:03.320 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.332+0000 7fc4bfe00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc4a406d7f0 0x7fc4a406fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0007fd0 tx=0x7fc4b0009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:03.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.336+0000 7fc4bcc00700 1 -- 172.21.15.148:0/3050012688 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc4a805b5a0 con 0x7fc4c00fc6f0 2024-02-28T16:36:03.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.558+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4c004bed0 con 0x7fc4a406d7f0 2024-02-28T16:36:03.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.560+0000 7fc4bcc00700 1 -- 172.21.15.148:0/3050012688 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc4c004bed0 con 0x7fc4a406d7f0 2024-02-28T16:36:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc4a406d7f0 msgr2=0x7fc4a406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc4a406d7f0 0x7fc4a406fca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0007fd0 tx=0x7fc4b0009040 comp rx=0 tx=0).stop 2024-02-28T16:36:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 msgr2=0x7fc4c011a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c011a700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009fd0 tx=0x7fc4a8009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 shutdown_connections 2024-02-28T16:36:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc4a406d7f0 0x7fc4a406fca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc4c00fbd50 0x7fc4c011a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 --2- 172.21.15.148:0/3050012688 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc4c00fc6f0 0x7fc4c011a700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 >> 172.21.15.148:0/3050012688 conn(0x7fc4c00f7a10 msgr2=0x7fc4c010d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.563+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 shutdown_connections 2024-02-28T16:36:03.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.564+0000 7fc4c6c00700 1 -- 172.21.15.148:0/3050012688 wait complete. 2024-02-28T16:36:03.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 -- 172.21.15.148:0/3527112003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fdd90 msgr2=0x7f01a80fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 --2- 172.21.15.148:0/3527112003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fdd90 0x7f01a80fe160 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f019c004940 tx=0x7f019c009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 -- 172.21.15.148:0/3527112003 shutdown_connections 2024-02-28T16:36:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 --2- 172.21.15.148:0/3527112003 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01a80fe730 0x7f01a8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 --2- 172.21.15.148:0/3527112003 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fdd90 0x7f01a80fe160 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 -- 172.21.15.148:0/3527112003 >> 172.21.15.148:0/3527112003 conn(0x7f01a8073ab0 msgr2=0x7f01a8073eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 -- 172.21.15.148:0/3527112003 shutdown_connections 2024-02-28T16:36:03.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.716+0000 7f01aec00700 1 -- 172.21.15.148:0/3527112003 wait complete. 2024-02-28T16:36:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.717+0000 7f01aec00700 1 Processor -- start 2024-02-28T16:36:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.717+0000 7f01aec00700 1 -- start start 2024-02-28T16:36:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01aec00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01a80fdd90 0x7f01a8115ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01aec00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fe730 0x7f01a8116020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01aec00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8116700 con 0x7f01a80fe730 2024-02-28T16:36:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01aec00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a810f9a0 con 0x7f01a80fdd90 2024-02-28T16:36:03.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01ace00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fe730 0x7f01a8116020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01ace00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fe730 0x7f01a8116020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34842/0 (socket says 172.21.15.148:34842) 2024-02-28T16:36:03.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01ace00700 1 -- 172.21.15.148:0/2474420984 learned_addr learned my addr 172.21.15.148:0/2474420984 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01ad800700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01a80fdd90 0x7f01a8115ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01ace00700 1 -- 172.21.15.148:0/2474420984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01a80fdd90 msgr2=0x7f01a8115ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.718+0000 7f01ace00700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01a80fdd90 0x7f01a8115ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.719+0000 7f01ace00700 1 -- 172.21.15.148:0/2474420984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c005040 con 0x7f01a80fe730 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.719+0000 7f01ace00700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fe730 0x7f01a8116020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f019400b790 tx=0x7f0194009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.719+0000 7f01a5600700 1 -- 172.21.15.148:0/2474420984 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f019400f770 con 0x7f01a80fe730 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.719+0000 7f01a5600700 1 -- 172.21.15.148:0/2474420984 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f019400fda0 con 0x7f01a80fe730 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.719+0000 7f01a5600700 1 -- 172.21.15.148:0/2474420984 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f019400d310 con 0x7f01a80fe730 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.719+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a810fc80 con 0x7f01a80fe730 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.719+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a81101c0 con 0x7f01a80fe730 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.720+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a8106920 con 0x7f01a80fe730 2024-02-28T16:36:03.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.722+0000 7f01a5600700 1 -- 172.21.15.148:0/2474420984 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0194010420 con 0x7f01a80fe730 2024-02-28T16:36:03.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.723+0000 7f01a5600700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f019006d7f0 0x7f019006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:03.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.723+0000 7f01a5600700 1 -- 172.21.15.148:0/2474420984 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f019408cea0 con 0x7f01a80fe730 2024-02-28T16:36:03.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.723+0000 7f01ad800700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f019006d7f0 0x7f019006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:03.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.724+0000 7f01ad800700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f019006d7f0 0x7f019006fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b3b0 tx=0x7f019c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:03.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.728+0000 7f01a5600700 1 -- 172.21.15.148:0/2474420984 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f019405a2d0 con 0x7f01a80fe730 2024-02-28T16:36:03.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:03 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:03.948 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.960+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f01a8109ef0 con 0x7f019006d7f0 2024-02-28T16:36:03.977 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.989+0000 7f01a5600700 1 -- 172.21.15.148:0/2474420984 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f01a8109ef0 con 0x7f019006d7f0 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (5m) 45s ago 21m 14.1M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (2m) 45s ago 21m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (2m) 16s ago 20m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (5m) 45s ago 21m 73.8M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (13m) 45s ago 13m 15.0M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (13m) 45s ago 13m 145M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:36:03.978 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (13m) 16s ago 13m 15.2M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (13m) 16s ago 13m 15.0M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (8m) 45s ago 23m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (7m) 16s ago 19m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (4m) 45s ago 23m 44.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (3m) 16s ago 19m 35.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (7m) 45s ago 21m 7780k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (6m) 16s ago 19m 7620k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (119s) 45s ago 18m 82.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (87s) 45s ago 17m 81.4M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (53s) 45s ago 17m 11.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (21s) 16s ago 16m 11.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (16m) 16s ago 16m 210M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 35b470c04b92 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (15m) 16s ago 15m 193M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:36:03.979 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (6m) 45s ago 20m 54.1M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:36:03.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f019006d7f0 msgr2=0x7f019006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f019006d7f0 0x7f019006fca0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f019c00b3b0 tx=0x7f019c009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:03.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fe730 msgr2=0x7f01a8116020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:03.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fe730 0x7f01a8116020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f019400b790 tx=0x7f0194009250 comp rx=0 tx=0).stop 2024-02-28T16:36:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 shutdown_connections 2024-02-28T16:36:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f019006d7f0 0x7f019006fca0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01a80fdd90 0x7f01a8115ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 --2- 172.21.15.148:0/2474420984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01a80fe730 0x7f01a8116020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.992+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 >> 172.21.15.148:0/2474420984 conn(0x7f01a8073ab0 msgr2=0x7f01a80fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.993+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 shutdown_connections 2024-02-28T16:36:03.981 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:03.993+0000 7f01aec00700 1 -- 172.21.15.148:0/2474420984 wait complete. 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.137+0000 7effd6600700 1 -- 172.21.15.148:0/2608499430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 msgr2=0x7effd01092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.137+0000 7effd6600700 1 --2- 172.21.15.148:0/2608499430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd01092c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7effbc004970 tx=0x7effbc009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.138+0000 7effd6600700 1 -- 172.21.15.148:0/2608499430 shutdown_connections 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.138+0000 7effd6600700 1 --2- 172.21.15.148:0/2608499430 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd01092c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.138+0000 7effd6600700 1 --2- 172.21.15.148:0/2608499430 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd00702d0 0x7effd00706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.138+0000 7effd6600700 1 -- 172.21.15.148:0/2608499430 >> 172.21.15.148:0/2608499430 conn(0x7effd00f8ae0 msgr2=0x7effd00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.138+0000 7effd6600700 1 -- 172.21.15.148:0/2608499430 shutdown_connections 2024-02-28T16:36:04.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.138+0000 7effd6600700 1 -- 172.21.15.148:0/2608499430 wait complete. 2024-02-28T16:36:04.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effd6600700 1 Processor -- start 2024-02-28T16:36:04.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effd6600700 1 -- start start 2024-02-28T16:36:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effd6600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd00702d0 0x7effd0115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effd6600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd0116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effd6600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd01167a0 con 0x7effd0070be0 2024-02-28T16:36:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effd6600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd010faf0 con 0x7effd00702d0 2024-02-28T16:36:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effcea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd0116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effcea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd0116150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34858/0 (socket says 172.21.15.148:34858) 2024-02-28T16:36:04.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.139+0000 7effcea00700 1 -- 172.21.15.148:0/1588063908 learned_addr learned my addr 172.21.15.148:0/1588063908 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effcf400700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd00702d0 0x7effd0115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effcea00700 1 -- 172.21.15.148:0/1588063908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd00702d0 msgr2=0x7effd0115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effcea00700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd00702d0 0x7effd0115c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effcea00700 1 -- 172.21.15.148:0/1588063908 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc005040 con 0x7effd0070be0 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effcea00700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd0116150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7effbc009150 tx=0x7effbc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effc7400700 1 -- 172.21.15.148:0/1588063908 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effbc00e040 con 0x7effd0070be0 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effc7400700 1 -- 172.21.15.148:0/1588063908 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7effbc004290 con 0x7effd0070be0 2024-02-28T16:36:04.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd010fd70 con 0x7effd0070be0 2024-02-28T16:36:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.140+0000 7effc7400700 1 -- 172.21.15.148:0/1588063908 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effbc01c630 con 0x7effd0070be0 2024-02-28T16:36:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.141+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd01102b0 con 0x7effd0070be0 2024-02-28T16:36:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.142+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd0106980 con 0x7effd0070be0 2024-02-28T16:36:04.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.143+0000 7effc7400700 1 -- 172.21.15.148:0/1588063908 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7effbc013980 con 0x7effd0070be0 2024-02-28T16:36:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.143+0000 7effc7400700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7effb406d7f0 0x7effb406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.144+0000 7effc7400700 1 -- 172.21.15.148:0/1588063908 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7effbc08e270 con 0x7effd0070be0 2024-02-28T16:36:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.144+0000 7effcf400700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7effb406d7f0 0x7effb406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.144+0000 7effcf400700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7effb406d7f0 0x7effb406fca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effc0004d60 tx=0x7effc000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:04.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.148+0000 7effc7400700 1 -- 172.21.15.148:0/1588063908 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7effbc057af0 con 0x7effd0070be0 2024-02-28T16:36:04.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:03 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:04.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.446+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7effd004bed0 con 0x7effd0070be0 2024-02-28T16:36:04.435 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.447+0000 7effc7400700 1 -- 172.21.15.148:0/1588063908 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7effbc05b1b0 con 0x7effd0070be0 2024-02-28T16:36:04.436 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:36:04.436 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:36:04.436 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:36:04.436 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:04.436 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:36:04.437 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:36:04.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:04.437 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:36:04.437 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2, 2024-02-28T16:36:04.437 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:36:04.437 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:04.438 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:36:04.438 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:36:04.438 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:04.438 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:36:04.438 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 6, 2024-02-28T16:36:04.438 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 8 2024-02-28T16:36:04.439 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:36:04.439 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:36:04.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7effb406d7f0 msgr2=0x7effb406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7effb406d7f0 0x7effb406fca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7effc0004d60 tx=0x7effc000b040 comp rx=0 tx=0).stop 2024-02-28T16:36:04.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 msgr2=0x7effd0116150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd0116150 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7effbc009150 tx=0x7effbc009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:04.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 shutdown_connections 2024-02-28T16:36:04.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7effb406d7f0 0x7effb406fca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7effd00702d0 0x7effd0115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 --2- 172.21.15.148:0/1588063908 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effd0070be0 0x7effd0116150 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 >> 172.21.15.148:0/1588063908 conn(0x7effd00f8ae0 msgr2=0x7effd0103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:04.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 shutdown_connections 2024-02-28T16:36:04.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.451+0000 7effd6600700 1 -- 172.21.15.148:0/1588063908 wait complete. 2024-02-28T16:36:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 -- 172.21.15.148:0/888371487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 msgr2=0x7fcafc0fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 --2- 172.21.15.148:0/888371487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0fcf60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcae8004940 tx=0x7fcae8009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 -- 172.21.15.148:0/888371487 shutdown_connections 2024-02-28T16:36:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 --2- 172.21.15.148:0/888371487 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0fcf60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 --2- 172.21.15.148:0/888371487 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc102f50 0x7fcafc103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 -- 172.21.15.148:0/888371487 >> 172.21.15.148:0/888371487 conn(0x7fcafc0f8ae0 msgr2=0x7fcafc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:04.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 -- 172.21.15.148:0/888371487 shutdown_connections 2024-02-28T16:36:04.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.600+0000 7fcb03a00700 1 -- 172.21.15.148:0/888371487 wait complete. 2024-02-28T16:36:04.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.601+0000 7fcb03a00700 1 Processor -- start 2024-02-28T16:36:04.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.601+0000 7fcb03a00700 1 -- start start 2024-02-28T16:36:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.601+0000 7fcb03a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc102f50 0x7fcafc070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.601+0000 7fcb03a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.601+0000 7fcb03a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc070dd0 con 0x7fcafc1038f0 2024-02-28T16:36:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.601+0000 7fcb03a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc070f40 con 0x7fcafc102f50 2024-02-28T16:36:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.601+0000 7fcafbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcafbe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34890/0 (socket says 172.21.15.148:34890) 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcafbe00700 1 -- 172.21.15.148:0/278923421 learned_addr learned my addr 172.21.15.148:0/278923421 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcb01000700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc102f50 0x7fcafc070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcafbe00700 1 -- 172.21.15.148:0/278923421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc102f50 msgr2=0x7fcafc070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcafbe00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc102f50 0x7fcafc070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcafbe00700 1 -- 172.21.15.148:0/278923421 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8005040 con 0x7fcafc1038f0 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcb01000700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc102f50 0x7fcafc070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcafbe00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0707d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009030 tx=0x7fcae8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcaf8c00700 1 -- 172.21.15.148:0/278923421 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae800e040 con 0x7fcafc1038f0 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcaf8c00700 1 -- 172.21.15.148:0/278923421 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcae800bbf0 con 0x7fcafc1038f0 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcaf8c00700 1 -- 172.21.15.148:0/278923421 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcae801c630 con 0x7fcafc1038f0 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.602+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc119cd0 con 0x7fcafc1038f0 2024-02-28T16:36:04.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.603+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc11a130 con 0x7fcafc1038f0 2024-02-28T16:36:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.604+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcafc105420 con 0x7fcafc1038f0 2024-02-28T16:36:04.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.605+0000 7fcaf8c00700 1 -- 172.21.15.148:0/278923421 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcae800bd60 con 0x7fcafc1038f0 2024-02-28T16:36:04.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.606+0000 7fcaf8c00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcae406d7f0 0x7fcae406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:04.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.606+0000 7fcaf8c00700 1 -- 172.21.15.148:0/278923421 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcae808e080 con 0x7fcafc1038f0 2024-02-28T16:36:04.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.606+0000 7fcb01000700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcae406d7f0 0x7fcae406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:04.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.607+0000 7fcb01000700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcae406d7f0 0x7fcae406fca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009fd0 tx=0x7fcaf000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:04.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.610+0000 7fcaf8c00700 1 -- 172.21.15.148:0/278923421 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcae8057a40 con 0x7fcafc1038f0 2024-02-28T16:36:04.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.861+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcafc04bed0 con 0x7fcafc1038f0 2024-02-28T16:36:04.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.862+0000 7fcaf8c00700 1 -- 172.21.15.148:0/278923421 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7fcae805b100 con 0x7fcafc1038f0 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:36:04.851 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:36:04.852 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:36:04.853 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:04.854 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.864+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcae406d7f0 msgr2=0x7fcae406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.864+0000 7fcb03a00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcae406d7f0 0x7fcae406fca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009fd0 tx=0x7fcaf000b040 comp rx=0 tx=0).stop 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.864+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 msgr2=0x7fcafc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.864+0000 7fcb03a00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0707d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009030 tx=0x7fcae8009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.864+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 shutdown_connections 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.864+0000 7fcb03a00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcae406d7f0 0x7fcae406fca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.864+0000 7fcb03a00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcafc102f50 0x7fcafc070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.865+0000 7fcb03a00700 1 --2- 172.21.15.148:0/278923421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcafc1038f0 0x7fcafc0707d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.865+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 >> 172.21.15.148:0/278923421 conn(0x7fcafc0f8ae0 msgr2=0x7fcafc0fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.865+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 shutdown_connections 2024-02-28T16:36:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:04.865+0000 7fcb03a00700 1 -- 172.21.15.148:0/278923421 wait complete. 2024-02-28T16:36:04.856 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1568378679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b00702b0 msgr2=0x7fc5b0070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1568378679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b00702b0 0x7fc5b0070680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0004940 tx=0x7fc5a0009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1568378679 shutdown_connections 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1568378679 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5b0070bc0 0x7fc5b01092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1568378679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b00702b0 0x7fc5b0070680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1568378679 >> 172.21.15.148:0/1568378679 conn(0x7fc5b00f8ae0 msgr2=0x7fc5b00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1568378679 shutdown_connections 2024-02-28T16:36:05.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.015+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1568378679 wait complete. 2024-02-28T16:36:05.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.016+0000 7fc5b6c00700 1 Processor -- start 2024-02-28T16:36:05.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.016+0000 7fc5b6c00700 1 -- start start 2024-02-28T16:36:05.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5b6c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5b00702b0 0x7fc5b0115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:05.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5b6c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b0070bc0 0x7fc5b01161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5b6c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b0116840 con 0x7fc5b0070bc0 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5b6c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b010fb50 con 0x7fc5b00702b0 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5a7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b0070bc0 0x7fc5b01161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5a7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b0070bc0 0x7fc5b01161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34906/0 (socket says 172.21.15.148:34906) 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5a7400700 1 -- 172.21.15.148:0/1199165503 learned_addr learned my addr 172.21.15.148:0/1199165503 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5afe00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5b00702b0 0x7fc5b0115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5a7400700 1 -- 172.21.15.148:0/1199165503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5b00702b0 msgr2=0x7fc5b0115cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5a7400700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5b00702b0 0x7fc5b0115cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.017+0000 7fc5a7400700 1 -- 172.21.15.148:0/1199165503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a0005040 con 0x7fc5b0070bc0 2024-02-28T16:36:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.018+0000 7fc5a7400700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b0070bc0 0x7fc5b01161f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c830 tx=0x7fc598004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.018+0000 7fc5acc00700 1 -- 172.21.15.148:0/1199165503 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc59800a760 con 0x7fc5b0070bc0 2024-02-28T16:36:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.018+0000 7fc5acc00700 1 -- 172.21.15.148:0/1199165503 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc59800ad90 con 0x7fc5b0070bc0 2024-02-28T16:36:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.018+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b010fe30 con 0x7fc5b0070bc0 2024-02-28T16:36:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.018+0000 7fc5acc00700 1 -- 172.21.15.148:0/1199165503 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5980113a0 con 0x7fc5b0070bc0 2024-02-28T16:36:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.018+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b0110370 con 0x7fc5b0070bc0 2024-02-28T16:36:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.019+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b01069a0 con 0x7fc5b0070bc0 2024-02-28T16:36:05.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.020+0000 7fc5acc00700 1 -- 172.21.15.148:0/1199165503 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc598012400 con 0x7fc5b0070bc0 2024-02-28T16:36:05.009 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.021+0000 7fc5acc00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc59406d7f0 0x7fc59406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.021+0000 7fc5acc00700 1 -- 172.21.15.148:0/1199165503 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc59808cfa0 con 0x7fc5b0070bc0 2024-02-28T16:36:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.022+0000 7fc5afe00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc59406d7f0 0x7fc59406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:05.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.022+0000 7fc5afe00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc59406d7f0 0x7fc59406fca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000b020 tx=0x7fc5a0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:05.014 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.026+0000 7fc5acc00700 1 -- 172.21.15.148:0/1199165503 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc59805a350 con 0x7fc5b0070bc0 2024-02-28T16:36:05.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:04 smithi148 ceph-mon[112463]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:05.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:04 smithi148 ceph-mon[112463]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:05.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:04 smithi148 ceph-mon[112463]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:05.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:04 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1588063908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:04 smithi157 ceph-mon[89328]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:04 smithi157 ceph-mon[89328]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:05.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:04 smithi157 ceph-mon[89328]: pgmap v146: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:05.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:04 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1588063908' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:05.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.264+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b004bf40 con 0x7fc59406d7f0 2024-02-28T16:36:05.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.267+0000 7fc5acc00700 1 -- 172.21.15.148:0/1199165503 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fc5b004bf40 con 0x7fc59406d7f0 2024-02-28T16:36:05.255 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:36:05.255 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:36:05.255 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:36:05.255 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:36:05.255 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:36:05.255 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:36:05.256 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:36:05.256 INFO:teuthology.orchestra.run.smithi148.stdout: "crash" 2024-02-28T16:36:05.256 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:36:05.256 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "10/21 daemons upgraded", 2024-02-28T16:36:05.256 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:36:05.256 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:36:05.256 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc59406d7f0 msgr2=0x7fc59406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc59406d7f0 0x7fc59406fca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000b020 tx=0x7fc5a0009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b0070bc0 msgr2=0x7fc5b01161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b0070bc0 0x7fc5b01161f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c830 tx=0x7fc598004470 comp rx=0 tx=0).stop 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 shutdown_connections 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc59406d7f0 0x7fc59406fca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc5b00702b0 0x7fc5b0115cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 --2- 172.21.15.148:0/1199165503 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc5b0070bc0 0x7fc5b01161f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.269+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 >> 172.21.15.148:0/1199165503 conn(0x7fc5b00f8ae0 msgr2=0x7fc5b0103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:05.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.270+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 shutdown_connections 2024-02-28T16:36:05.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.270+0000 7fc5b6c00700 1 -- 172.21.15.148:0/1199165503 wait complete. 2024-02-28T16:36:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 -- 172.21.15.148:0/3163473783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4850103dc0 msgr2=0x7f4850104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 --2- 172.21.15.148:0/3163473783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4850103dc0 0x7f4850104210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f483c004940 tx=0x7f483c009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 -- 172.21.15.148:0/3163473783 shutdown_connections 2024-02-28T16:36:05.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 --2- 172.21.15.148:0/3163473783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4850103dc0 0x7f4850104210 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 --2- 172.21.15.148:0/3163473783 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48501095f0 0x7f48501099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 -- 172.21.15.148:0/3163473783 >> 172.21.15.148:0/3163473783 conn(0x7f4850072d50 msgr2=0x7f4850075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 -- 172.21.15.148:0/3163473783 shutdown_connections 2024-02-28T16:36:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.421+0000 7f4856600700 1 -- 172.21.15.148:0/3163473783 wait complete. 2024-02-28T16:36:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.422+0000 7f4856600700 1 Processor -- start 2024-02-28T16:36:05.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.422+0000 7f4856600700 1 -- start start 2024-02-28T16:36:05.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f4856600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4850103dc0 0x7f485011a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:05.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f4856600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501095f0 0x7f485011a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:05.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f4856600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485011ac50 con 0x7f48501095f0 2024-02-28T16:36:05.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f4856600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850113ed0 con 0x7f4850103dc0 2024-02-28T16:36:05.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f484ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501095f0 0x7f485011a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:05.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f484ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501095f0 0x7f485011a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:34934/0 (socket says 172.21.15.148:34934) 2024-02-28T16:36:05.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f484ea00700 1 -- 172.21.15.148:0/1605452521 learned_addr learned my addr 172.21.15.148:0/1605452521 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:05.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.423+0000 7f484f400700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4850103dc0 0x7f485011a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f484ea00700 1 -- 172.21.15.148:0/1605452521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4850103dc0 msgr2=0x7f485011a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f484ea00700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4850103dc0 0x7f485011a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f484ea00700 1 -- 172.21.15.148:0/1605452521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c005040 con 0x7f48501095f0 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f484ea00700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501095f0 0x7f485011a570 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f483c009150 tx=0x7f483c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f4847400700 1 -- 172.21.15.148:0/1605452521 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483c00e040 con 0x7f48501095f0 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f4847400700 1 -- 172.21.15.148:0/1605452521 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f483c00bbf0 con 0x7f48501095f0 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48501140f0 con 0x7f48501095f0 2024-02-28T16:36:05.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.424+0000 7f4847400700 1 -- 172.21.15.148:0/1605452521 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483c01c630 con 0x7f48501095f0 2024-02-28T16:36:05.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.425+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4850114630 con 0x7f48501095f0 2024-02-28T16:36:05.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.426+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4850075870 con 0x7f48501095f0 2024-02-28T16:36:05.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.427+0000 7f4847400700 1 -- 172.21.15.148:0/1605452521 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f483c00bd60 con 0x7f48501095f0 2024-02-28T16:36:05.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.428+0000 7f4847400700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f483406d7f0 0x7f483406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:05.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.428+0000 7f4847400700 1 -- 172.21.15.148:0/1605452521 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f483c08e270 con 0x7f48501095f0 2024-02-28T16:36:05.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.428+0000 7f484f400700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f483406d7f0 0x7f483406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:05.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.429+0000 7f484f400700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f483406d7f0 0x7f483406fca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4840006fd0 tx=0x7f4840008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:05.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.432+0000 7f4847400700 1 -- 172.21.15.148:0/1605452521 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f483c05b6a0 con 0x7f48501095f0 2024-02-28T16:36:05.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.715+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f48501106a0 con 0x7f48501095f0 2024-02-28T16:36:05.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.716+0000 7f4847400700 1 -- 172.21.15.148:0/1605452521 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f483c05b230 con 0x7f48501095f0 2024-02-28T16:36:05.704 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:36:05.704 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:36:05.704 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.718+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f483406d7f0 msgr2=0x7f483406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f483406d7f0 0x7f483406fca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4840006fd0 tx=0x7f4840008040 comp rx=0 tx=0).stop 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501095f0 msgr2=0x7f485011a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501095f0 0x7f485011a570 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f483c009150 tx=0x7f483c009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 shutdown_connections 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f483406d7f0 0x7f483406fca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4850103dc0 0x7f485011a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 --2- 172.21.15.148:0/1605452521 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48501095f0 0x7f485011a570 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:05.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 >> 172.21.15.148:0/1605452521 conn(0x7f4850072d50 msgr2=0x7f48500746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:05.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 shutdown_connections 2024-02-28T16:36:05.708 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:05.719+0000 7f4856600700 1 -- 172.21.15.148:0/1605452521 wait complete. 2024-02-28T16:36:06.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:05 smithi148 ceph-mon[112463]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:06.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:05 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/278923421' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:36:06.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:05 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1605452521' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:36:06.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:05 smithi157 ceph-mon[89328]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:06.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:05 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/278923421' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:36:06.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:05 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1605452521' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:36:07.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:06 smithi148 ceph-mon[112463]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:07.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:06 smithi148 ceph-mon[112463]: pgmap v147: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:07.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:06 smithi157 ceph-mon[89328]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:07.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:06 smithi157 ceph-mon[89328]: pgmap v147: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:08.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:08 smithi157 ceph-mon[89328]: pgmap v148: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:08 smithi148 ceph-mon[112463]: pgmap v148: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:10 smithi148 ceph-mon[112463]: pgmap v149: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:11.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:10 smithi157 ceph-mon[89328]: pgmap v149: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:12.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:11 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:36:12.126 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:11 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:36:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:12 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:36:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:12 smithi148 ceph-mon[112463]: Upgrade: osd.4 is safe to restart 2024-02-28T16:36:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:12 smithi148 ceph-mon[112463]: pgmap v150: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:13.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:13.174 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:12 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T16:36:13.174 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:12 smithi157 ceph-mon[89328]: Upgrade: osd.4 is safe to restart 2024-02-28T16:36:13.174 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:12 smithi157 ceph-mon[89328]: pgmap v150: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:13.174 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:13.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:14.474 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:14 smithi157 ceph-mon[89328]: Upgrade: Updating osd.4 2024-02-28T16:36:14.474 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:14.474 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:36:14.474 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:14.474 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:14 smithi157 ceph-mon[89328]: Deploying daemon osd.4 on smithi157 2024-02-28T16:36:14.474 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:14 smithi157 ceph-mon[89328]: pgmap v151: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:14.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:14 smithi148 ceph-mon[112463]: Upgrade: Updating osd.4 2024-02-28T16:36:14.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:14.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T16:36:14.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:14.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:14 smithi148 ceph-mon[112463]: Deploying daemon osd.4 on smithi157 2024-02-28T16:36:14.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:14 smithi148 ceph-mon[112463]: pgmap v151: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:16.848 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:16 smithi157 ceph-mon[89328]: pgmap v152: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:16 smithi148 ceph-mon[112463]: pgmap v152: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:18.733 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:18 smithi157 systemd[1]: Stopping Ceph osd.4 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:36:18.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:18 smithi157 ceph-mon[89328]: pgmap v153: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:18.987 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:18 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[50277]: 2024-02-28T16:36:18.844+0000 7f81caa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:36:18.987 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:18 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[50277]: 2024-02-28T16:36:18.844+0000 7f81caa00700 -1 osd.4 69 *** Got signal Terminated *** 2024-02-28T16:36:18.987 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:18 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[50277]: 2024-02-28T16:36:18.844+0000 7f81caa00700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:36:19.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:18 smithi148 ceph-mon[112463]: pgmap v153: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:19 smithi148 ceph-mon[112463]: osd.4 marked itself down and dead 2024-02-28T16:36:20.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:19 smithi157 ceph-mon[89328]: osd.4 marked itself down and dead 2024-02-28T16:36:20.737 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:20 smithi157 podman[103568]: 2024-02-28 16:36:20.429018147 +0000 UTC m=+1.732103146 container died 35b470c04b928879faca323cf048511e014351c8d90c121202e7284e77be5725 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, org.label-schema.license=GPLv2, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-28T16:36:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:20 smithi148 ceph-mon[112463]: pgmap v154: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:20 smithi148 ceph-mon[112463]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:36:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:20 smithi148 ceph-mon[112463]: osdmap e70: 6 total, 5 up, 6 in 2024-02-28T16:36:21.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:20 smithi157 ceph-mon[89328]: pgmap v154: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:21.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:20 smithi157 ceph-mon[89328]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:36:21.143 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:20 smithi157 ceph-mon[89328]: osdmap e70: 6 total, 5 up, 6 in 2024-02-28T16:36:21.144 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:20 smithi157 podman[103568]: 2024-02-28 16:36:20.963101252 +0000 UTC m=+2.266186290 container cleanup 35b470c04b928879faca323cf048511e014351c8d90c121202e7284e77be5725 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, RELEASE=quincy-c0f02e6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222) 2024-02-28T16:36:21.144 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:20 smithi157 bash[103568]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4 2024-02-28T16:36:21.486 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:21 smithi157 podman[103587]: 2024-02-28 16:36:21.155615978 +0000 UTC m=+0.710363024 container remove 35b470c04b928879faca323cf048511e014351c8d90c121202e7284e77be5725 (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=quincy-c0f02e6, maintainer=Guillaume Abrioux , ceph=True) 2024-02-28T16:36:22.104 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:21 smithi157 ceph-mon[89328]: osdmap e71: 6 total, 5 up, 6 in 2024-02-28T16:36:22.105 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:21 smithi157 podman[103672]: 2024-02-28 16:36:21.842780166 +0000 UTC m=+0.031611753 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:36:22.105 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:21 smithi157 podman[103672]: 2024-02-28 16:36:21.95652569 +0000 UTC m=+0.145357313 container create 24b9c097ee3c5abb2b9d51327488cc0f671a19cf0522e5d9f28e5c09b441ee04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-1fb5d10, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T16:36:22.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:21 smithi148 ceph-mon[112463]: osdmap e71: 6 total, 5 up, 6 in 2024-02-28T16:36:22.363 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:22 smithi157 podman[103672]: 2024-02-28 16:36:22.286129576 +0000 UTC m=+0.474961236 container init 24b9c097ee3c5abb2b9d51327488cc0f671a19cf0522e5d9f28e5c09b441ee04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2) 2024-02-28T16:36:22.363 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:22 smithi157 podman[103672]: 2024-02-28 16:36:22.298864232 +0000 UTC m=+0.487695825 container start 24b9c097ee3c5abb2b9d51327488cc0f671a19cf0522e5d9f28e5c09b441ee04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222) 2024-02-28T16:36:22.363 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:22 smithi157 podman[103672]: 2024-02-28 16:36:22.37565253 +0000 UTC m=+0.564484156 container attach 24b9c097ee3c5abb2b9d51327488cc0f671a19cf0522e5d9f28e5c09b441ee04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=) 2024-02-28T16:36:22.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:22 smithi157 ceph-mon[89328]: pgmap v157: 65 pgs: 11 peering, 5 stale+active+clean, 49 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:22.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:22 smithi157 ceph-mon[89328]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-28T16:36:22.987 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:22 smithi157 podman[103672]: 2024-02-28 16:36:22.72562274 +0000 UTC m=+0.914454367 container died 24b9c097ee3c5abb2b9d51327488cc0f671a19cf0522e5d9f28e5c09b441ee04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-28T16:36:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:22 smithi148 ceph-mon[112463]: pgmap v157: 65 pgs: 11 peering, 5 stale+active+clean, 49 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:22 smithi148 ceph-mon[112463]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-28T16:36:23.737 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:23 smithi157 podman[103698]: 2024-02-28 16:36:23.492071501 +0000 UTC m=+0.744961220 container remove 24b9c097ee3c5abb2b9d51327488cc0f671a19cf0522e5d9f28e5c09b441ee04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:36:23.737 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:23 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-28T16:36:23.737 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:23 smithi157 systemd[1]: Stopped Ceph osd.4 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:36:23.737 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:23 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.4.service: Consumed 1min 47.633s CPU time. 2024-02-28T16:36:24.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:23 smithi148 ceph-mon[112463]: Health check failed: Degraded data redundancy: 17/264 objects degraded (6.439%), 6 pgs degraded (PG_DEGRADED) 2024-02-28T16:36:24.229 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:23 smithi157 ceph-mon[89328]: Health check failed: Degraded data redundancy: 17/264 objects degraded (6.439%), 6 pgs degraded (PG_DEGRADED) 2024-02-28T16:36:24.229 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:23 smithi157 systemd[1]: Starting Ceph osd.4 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:36:24.487 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:24 smithi157 podman[103802]: 2024-02-28 16:36:24.147383626 +0000 UTC m=+0.037172130 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:36:24.487 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:24 smithi157 podman[103802]: 2024-02-28 16:36:24.269870248 +0000 UTC m=+0.159658819 container create 6ab471b3996b2afe472b587c1af037c947b03742a1c9b1bc6bbfc39530831fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2) 2024-02-28T16:36:24.828 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:24 smithi157 podman[103802]: 2024-02-28 16:36:24.609331844 +0000 UTC m=+0.499120425 container init 6ab471b3996b2afe472b587c1af037c947b03742a1c9b1bc6bbfc39530831fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-28T16:36:24.829 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:24 smithi157 podman[103802]: 2024-02-28 16:36:24.623042293 +0000 UTC m=+0.512830810 container start 6ab471b3996b2afe472b587c1af037c947b03742a1c9b1bc6bbfc39530831fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-28T16:36:24.829 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:24 smithi157 podman[103802]: 2024-02-28 16:36:24.699523274 +0000 UTC m=+0.589311865 container attach 6ab471b3996b2afe472b587c1af037c947b03742a1c9b1bc6bbfc39530831fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-02-28T16:36:25.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:24 smithi148 ceph-mon[112463]: pgmap v158: 65 pgs: 6 active+undersized+degraded, 11 peering, 1 stale+active+clean, 9 active+undersized, 38 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17/264 objects degraded (6.439%) 2024-02-28T16:36:25.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:24 smithi157 ceph-mon[89328]: pgmap v158: 65 pgs: 6 active+undersized+degraded, 11 peering, 1 stale+active+clean, 9 active+undersized, 38 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 17/264 objects degraded (6.439%) 2024-02-28T16:36:25.737 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate[103817]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:36:25.737 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate[103817]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 bash[103802]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 bash[103802]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 bash[103802]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 bash[103802]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 bash[103802]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 bash[103802]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 bash[103802]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate[103817]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate[103817]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate[103817]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate[103817]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate[103817]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T16:36:25.738 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:25 smithi157 podman[103802]: 2024-02-28 16:36:25.531553348 +0000 UTC m=+1.421341896 container died 6ab471b3996b2afe472b587c1af037c947b03742a1c9b1bc6bbfc39530831fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:36:26.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:25 smithi157 ceph-mon[89328]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-28T16:36:26.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:25 smithi148 ceph-mon[112463]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-28T16:36:26.736 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:26 smithi157 podman[103953]: 2024-02-28 16:36:26.402945357 +0000 UTC m=+0.851847112 container remove 6ab471b3996b2afe472b587c1af037c947b03742a1c9b1bc6bbfc39530831fc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-28T16:36:27.154 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:26 smithi157 ceph-mon[89328]: pgmap v159: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:27.154 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:26 smithi157 podman[104014]: 2024-02-28 16:36:26.662368695 +0000 UTC m=+0.033774019 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:36:27.154 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:26 smithi157 podman[104014]: 2024-02-28 16:36:26.837864888 +0000 UTC m=+0.209270240 container create 93c28b8b835a6e0a2236fa4cb8a26cdced2fc495a3502125d9570eb26ae2fafa (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True) 2024-02-28T16:36:27.155 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:27 smithi157 podman[104014]: 2024-02-28 16:36:27.166618262 +0000 UTC m=+0.538023634 container init 93c28b8b835a6e0a2236fa4cb8a26cdced2fc495a3502125d9570eb26ae2fafa (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:36:27.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:26 smithi148 ceph-mon[112463]: pgmap v159: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:27.486 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:27 smithi157 podman[104014]: 2024-02-28 16:36:27.177085981 +0000 UTC m=+0.548491306 container start 93c28b8b835a6e0a2236fa4cb8a26cdced2fc495a3502125d9570eb26ae2fafa (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:36:27.486 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:27 smithi157 ceph-osd[104033]: -- 172.21.15.157:0/1312993399 <== mon.1 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56337e7d7680 con 0x56337e7a1000 2024-02-28T16:36:27.486 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:27 smithi157 bash[104014]: 93c28b8b835a6e0a2236fa4cb8a26cdced2fc495a3502125d9570eb26ae2fafa 2024-02-28T16:36:27.487 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:27 smithi157 systemd[1]: Started Ceph osd.4 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:36:28.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:27 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:36:27.751+0000 7fa0f6fbf7c0 -1 Falling back to public interface 2024-02-28T16:36:28.700 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:28.700 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:28.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:36:28.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:28 smithi157 ceph-mon[89328]: pgmap v160: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:28.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:28.701 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:28.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:28.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:28.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:36:28.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:28 smithi148 ceph-mon[112463]: pgmap v160: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:28.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:28.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:30.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:30 smithi157 ceph-mon[89328]: pgmap v161: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:31.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:30 smithi148 ceph-mon[112463]: pgmap v161: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:32 smithi148 ceph-mon[112463]: pgmap v162: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:32 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:32 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:32 smithi157 ceph-mon[89328]: pgmap v162: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:32 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:33.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:32 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:33.237 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:32 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:36:32.893+0000 7fa0f6fbf7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-28T16:36:33.736 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:33 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:36:33.300+0000 7fa0f6fbf7c0 -1 osd.4 69 log_to_monitors true 2024-02-28T16:36:34.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:33 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T16:36:34.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:33 smithi148 ceph-mon[112463]: from='osd.4 [v2:172.21.15.157:6808/1675329690,v1:172.21.15.157:6809/1675329690]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:36:34.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:33 smithi148 ceph-mon[112463]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:36:34.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:33 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:34.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:33 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:34.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:33 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 46/264 objects degraded (17.424%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T16:36:34.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:33 smithi157 ceph-mon[89328]: from='osd.4 [v2:172.21.15.157:6808/1675329690,v1:172.21.15.157:6809/1675329690]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:36:34.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:33 smithi157 ceph-mon[89328]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T16:36:34.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:33 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:34.214 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:33 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:34.486 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:36:34 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:36:34.225+0000 7fa0e6400700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:36:34.863 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:34 smithi157 ceph-mon[89328]: pgmap v163: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:34.863 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:34 smithi157 ceph-mon[89328]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:36:34.864 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:34 smithi157 ceph-mon[89328]: osdmap e72: 6 total, 5 up, 6 in 2024-02-28T16:36:34.864 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:34 smithi157 ceph-mon[89328]: from='osd.4 [v2:172.21.15.157:6808/1675329690,v1:172.21.15.157:6809/1675329690]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:36:34.864 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:34 smithi157 ceph-mon[89328]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:36:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:34 smithi148 ceph-mon[112463]: pgmap v163: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:34 smithi148 ceph-mon[112463]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T16:36:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:34 smithi148 ceph-mon[112463]: osdmap e72: 6 total, 5 up, 6 in 2024-02-28T16:36:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:34 smithi148 ceph-mon[112463]: from='osd.4 [v2:172.21.15.157:6808/1675329690,v1:172.21.15.157:6809/1675329690]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:36:35.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:34 smithi148 ceph-mon[112463]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:36:35.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 -- 172.21.15.148:0/2401500254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a18105170 msgr2=0x7f7a18105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 --2- 172.21.15.148:0/2401500254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a18105170 0x7f7a18105540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7a08004940 tx=0x7f7a08009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 -- 172.21.15.148:0/2401500254 shutdown_connections 2024-02-28T16:36:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 --2- 172.21.15.148:0/2401500254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a18105b10 0x7f7a180ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 --2- 172.21.15.148:0/2401500254 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a18105170 0x7f7a18105540 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 -- 172.21.15.148:0/2401500254 >> 172.21.15.148:0/2401500254 conn(0x7f7a180face0 msgr2=0x7f7a180fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 -- 172.21.15.148:0/2401500254 shutdown_connections 2024-02-28T16:36:35.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.886+0000 7f7a1d200700 1 -- 172.21.15.148:0/2401500254 wait complete. 2024-02-28T16:36:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.887+0000 7f7a1d200700 1 Processor -- start 2024-02-28T16:36:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.887+0000 7f7a1d200700 1 -- start start 2024-02-28T16:36:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.887+0000 7f7a1d200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a18105b10 0x7f7a18115ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.887+0000 7f7a1d200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a181163e0 0x7f7a1810fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:35.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.887+0000 7f7a1d200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18116960 con 0x7f7a181163e0 2024-02-28T16:36:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.887+0000 7f7a1d200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18116ad0 con 0x7f7a18105b10 2024-02-28T16:36:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.888+0000 7f7a15400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a181163e0 0x7f7a1810fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.888+0000 7f7a15400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a181163e0 0x7f7a1810fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46722/0 (socket says 172.21.15.148:46722) 2024-02-28T16:36:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.888+0000 7f7a15400700 1 -- 172.21.15.148:0/4001761881 learned_addr learned my addr 172.21.15.148:0/4001761881 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.888+0000 7f7a15e00700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a18105b10 0x7f7a18115ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.888+0000 7f7a15400700 1 -- 172.21.15.148:0/4001761881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a18105b10 msgr2=0x7f7a18115ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:35.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.888+0000 7f7a15400700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a18105b10 0x7f7a18115ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.888+0000 7f7a15400700 1 -- 172.21.15.148:0/4001761881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08005040 con 0x7f7a181163e0 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.889+0000 7f7a15400700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a181163e0 0x7f7a1810fd40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a04002a50 tx=0x7f7a04004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.889+0000 7f7a0e000700 1 -- 172.21.15.148:0/4001761881 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a04007cc0 con 0x7f7a181163e0 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.889+0000 7f7a0e000700 1 -- 172.21.15.148:0/4001761881 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a0400f040 con 0x7f7a181163e0 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.889+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a18110340 con 0x7f7a181163e0 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.889+0000 7f7a0e000700 1 -- 172.21.15.148:0/4001761881 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0400daf0 con 0x7f7a181163e0 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.889+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a18110880 con 0x7f7a181163e0 2024-02-28T16:36:35.879 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.890+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a18102480 con 0x7f7a181163e0 2024-02-28T16:36:35.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.891+0000 7f7a0e000700 1 -- 172.21.15.148:0/4001761881 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7a04009810 con 0x7f7a181163e0 2024-02-28T16:36:35.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.892+0000 7f7a0e000700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f79fc06d7e0 0x7f79fc06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:35.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.892+0000 7f7a0e000700 1 -- 172.21.15.148:0/4001761881 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7a0408cca0 con 0x7f7a181163e0 2024-02-28T16:36:35.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.892+0000 7f7a15e00700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f79fc06d7e0 0x7f79fc06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:35.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.893+0000 7f7a15e00700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f79fc06d7e0 0x7f79fc06fc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009040 tx=0x7f7a08009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:35.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:35.897+0000 7f7a0e000700 1 -- 172.21.15.148:0/4001761881 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7a04059fd0 con 0x7f7a181163e0 2024-02-28T16:36:36.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:35 smithi148 ceph-mon[112463]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:36:36.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:35 smithi148 ceph-mon[112463]: osd.4 [v2:172.21.15.157:6808/1675329690,v1:172.21.15.157:6809/1675329690] boot 2024-02-28T16:36:36.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:35 smithi148 ceph-mon[112463]: osdmap e73: 6 total, 6 up, 6 in 2024-02-28T16:36:36.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:35 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:36:36.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.136+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a18110b00 con 0x7f79fc06d7e0 2024-02-28T16:36:36.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.138+0000 7f7a0e000700 1 -- 172.21.15.148:0/4001761881 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7a18110b00 con 0x7f79fc06d7e0 2024-02-28T16:36:36.128 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f79fc06d7e0 msgr2=0x7f79fc06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f79fc06d7e0 0x7f79fc06fc90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009040 tx=0x7f7a08009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:36.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a181163e0 msgr2=0x7f7a1810fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a181163e0 0x7f7a1810fd40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a04002a50 tx=0x7f7a04004600 comp rx=0 tx=0).stop 2024-02-28T16:36:36.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 shutdown_connections 2024-02-28T16:36:36.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f79fc06d7e0 0x7f79fc06fc90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7a18105b10 0x7f7a18115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 --2- 172.21.15.148:0/4001761881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7a181163e0 0x7f7a1810fd40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.140+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 >> 172.21.15.148:0/4001761881 conn(0x7f7a180face0 msgr2=0x7f7a180fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:36.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.141+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 shutdown_connections 2024-02-28T16:36:36.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.141+0000 7f7a1d200700 1 -- 172.21.15.148:0/4001761881 wait complete. 2024-02-28T16:36:36.144 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:36:36.175 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:35 smithi157 ceph-mon[89328]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:36:36.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:35 smithi157 ceph-mon[89328]: osd.4 [v2:172.21.15.157:6808/1675329690,v1:172.21.15.157:6809/1675329690] boot 2024-02-28T16:36:36.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:35 smithi157 ceph-mon[89328]: osdmap e73: 6 total, 6 up, 6 in 2024-02-28T16:36:36.176 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:35 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T16:36:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.309+0000 7fab1da00700 1 -- 172.21.15.148:0/2374123092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 msgr2=0x7fab18070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.309+0000 7fab1da00700 1 --2- 172.21.15.148:0/2374123092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab18070ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab04004970 tx=0x7fab04009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.310+0000 7fab1da00700 1 -- 172.21.15.148:0/2374123092 shutdown_connections 2024-02-28T16:36:36.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.310+0000 7fab1da00700 1 --2- 172.21.15.148:0/2374123092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab18070ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.310+0000 7fab1da00700 1 --2- 172.21.15.148:0/2374123092 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab18071f60 0x7fab18070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.310+0000 7fab1da00700 1 -- 172.21.15.148:0/2374123092 >> 172.21.15.148:0/2374123092 conn(0x7fab180f8ae0 msgr2=0x7fab180faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.310+0000 7fab1da00700 1 -- 172.21.15.148:0/2374123092 shutdown_connections 2024-02-28T16:36:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.310+0000 7fab1da00700 1 -- 172.21.15.148:0/2374123092 wait complete. 2024-02-28T16:36:36.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.310+0000 7fab1da00700 1 Processor -- start 2024-02-28T16:36:36.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab1da00700 1 -- start start 2024-02-28T16:36:36.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab1da00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab1811a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab1da00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab18071f60 0x7fab1811a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab1da00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1811aba0 con 0x7fab18070870 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab1da00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab18113eb0 con 0x7fab18071f60 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab16a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab1811a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab16a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab1811a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46742/0 (socket says 172.21.15.148:46742) 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.311+0000 7fab16a00700 1 -- 172.21.15.148:0/4156975998 learned_addr learned my addr 172.21.15.148:0/4156975998 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab16000700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab18071f60 0x7fab1811a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab16a00700 1 -- 172.21.15.148:0/4156975998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab18071f60 msgr2=0x7fab1811a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab16a00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab18071f60 0x7fab1811a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab16a00700 1 -- 172.21.15.148:0/4156975998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab04005040 con 0x7fab18070870 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab16000700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab18071f60 0x7fab1811a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab16a00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab1811a010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab08002a50 tx=0x7fab080046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab0ea00700 1 -- 172.21.15.148:0/4156975998 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab08007cc0 con 0x7fab18070870 2024-02-28T16:36:36.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab0ea00700 1 -- 172.21.15.148:0/4156975998 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab0800f040 con 0x7fab18070870 2024-02-28T16:36:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab0ea00700 1 -- 172.21.15.148:0/4156975998 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab08009640 con 0x7fab18070870 2024-02-28T16:36:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab18114190 con 0x7fab18070870 2024-02-28T16:36:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.312+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab18114680 con 0x7fab18070870 2024-02-28T16:36:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.314+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab180fe400 con 0x7fab18070870 2024-02-28T16:36:36.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.315+0000 7fab0ea00700 1 -- 172.21.15.148:0/4156975998 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fab080097a0 con 0x7fab18070870 2024-02-28T16:36:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.315+0000 7fab0ea00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faafc06d7f0 0x7faafc06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:36.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.315+0000 7fab0ea00700 1 -- 172.21.15.148:0/4156975998 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fab0808ccd0 con 0x7fab18070870 2024-02-28T16:36:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.316+0000 7fab16000700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faafc06d7f0 0x7faafc06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:36.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.316+0000 7fab16000700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faafc06d7f0 0x7faafc06fca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab181158b0 tx=0x7fab04009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:36.308 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.320+0000 7fab0ea00700 1 -- 172.21.15.148:0/4156975998 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fab0805a000 con 0x7fab18070870 2024-02-28T16:36:36.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.559+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab1804bf40 con 0x7faafc06d7f0 2024-02-28T16:36:36.551 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.563+0000 7fab0ea00700 1 -- 172.21.15.148:0/4156975998 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fab1804bf40 con 0x7faafc06d7f0 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faafc06d7f0 msgr2=0x7faafc06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faafc06d7f0 0x7faafc06fca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab181158b0 tx=0x7fab04009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 msgr2=0x7fab1811a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab1811a010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab08002a50 tx=0x7fab080046b0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 shutdown_connections 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faafc06d7f0 0x7faafc06fca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fab18070870 0x7fab1811a010 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.565+0000 7fab1da00700 1 --2- 172.21.15.148:0/4156975998 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fab18071f60 0x7fab1811a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.566+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 >> 172.21.15.148:0/4156975998 conn(0x7fab180f8ae0 msgr2=0x7fab180fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.566+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 shutdown_connections 2024-02-28T16:36:36.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.566+0000 7fab1da00700 1 -- 172.21.15.148:0/4156975998 wait complete. 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 -- 172.21.15.148:0/857447810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 msgr2=0x7f42c4109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 --2- 172.21.15.148:0/857447810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4109260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f42b0004970 tx=0x7f42b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 -- 172.21.15.148:0/857447810 shutdown_connections 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 --2- 172.21.15.148:0/857447810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4109260 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 --2- 172.21.15.148:0/857447810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c4070330 0x7f42c4070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 -- 172.21.15.148:0/857447810 >> 172.21.15.148:0/857447810 conn(0x7f42c40f8ae0 msgr2=0x7f42c40faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 -- 172.21.15.148:0/857447810 shutdown_connections 2024-02-28T16:36:36.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.720+0000 7f42ca800700 1 -- 172.21.15.148:0/857447810 wait complete. 2024-02-28T16:36:36.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.721+0000 7f42ca800700 1 Processor -- start 2024-02-28T16:36:36.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.721+0000 7f42ca800700 1 -- start start 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42ca800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c4070330 0x7f42c4115c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42ca800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4116140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42ca800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4116790 con 0x7f42c4070c40 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42ca800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c410fae0 con 0x7f42c4070330 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42c2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4116140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42c2a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4116140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46762/0 (socket says 172.21.15.148:46762) 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42c2a00700 1 -- 172.21.15.148:0/4166177841 learned_addr learned my addr 172.21.15.148:0/4166177841 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.722+0000 7f42c3400700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c4070330 0x7f42c4115c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42c2a00700 1 -- 172.21.15.148:0/4166177841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c4070330 msgr2=0x7f42c4115c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42c2a00700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c4070330 0x7f42c4115c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42c2a00700 1 -- 172.21.15.148:0/4166177841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b0005040 con 0x7f42c4070c40 2024-02-28T16:36:36.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42c2a00700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4116140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42b0000c00 tx=0x7f42b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:36.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42bb400700 1 -- 172.21.15.148:0/4166177841 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b000e040 con 0x7f42c4070c40 2024-02-28T16:36:36.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42bb400700 1 -- 172.21.15.148:0/4166177841 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42b0004290 con 0x7f42c4070c40 2024-02-28T16:36:36.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c410fd60 con 0x7f42c4070c40 2024-02-28T16:36:36.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42bb400700 1 -- 172.21.15.148:0/4166177841 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b0013ea0 con 0x7f42c4070c40 2024-02-28T16:36:36.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.723+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c41102a0 con 0x7f42c4070c40 2024-02-28T16:36:36.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.725+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4106920 con 0x7f42c4070c40 2024-02-28T16:36:36.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.726+0000 7f42bb400700 1 -- 172.21.15.148:0/4166177841 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f42b0009480 con 0x7f42c4070c40 2024-02-28T16:36:36.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.727+0000 7f42bb400700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42a806d7f0 0x7f42a806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:36.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.727+0000 7f42bb400700 1 -- 172.21.15.148:0/4166177841 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f42b008e100 con 0x7f42c4070c40 2024-02-28T16:36:36.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.727+0000 7f42c3400700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42a806d7f0 0x7f42a806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:36.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.728+0000 7f42c3400700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42a806d7f0 0x7f42a806fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009b80 tx=0x7f42b400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:36.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.732+0000 7f42bb400700 1 -- 172.21.15.148:0/4166177841 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f42b00579a0 con 0x7f42c4070c40 2024-02-28T16:36:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:36 smithi148 ceph-mon[112463]: pgmap v166: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:36.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:36 smithi148 ceph-mon[112463]: osdmap e74: 6 total, 6 up, 6 in 2024-02-28T16:36:36.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.966+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f42c404bed0 con 0x7f42a806d7f0 2024-02-28T16:36:36.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.982+0000 7f42bb400700 1 -- 172.21.15.148:0/4166177841 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f42c404bed0 con 0x7f42a806d7f0 2024-02-28T16:36:36.970 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (6m) 78s ago 22m 14.1M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (3m) 78s ago 22m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (3m) 5s ago 20m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (6m) 78s ago 21m 73.8M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (14m) 78s ago 14m 15.0M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (13m) 78s ago 13m 145M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (13m) 5s ago 13m 15.4M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (14m) 5s ago 14m 15.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (9m) 78s ago 23m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (8m) 5s ago 20m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (4m) 78s ago 24m 44.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (4m) 5s ago 20m 36.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (7m) 78s ago 22m 7780k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:36:36.971 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (7m) 5s ago 20m 7608k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:36:36.972 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (2m) 78s ago 19m 82.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:36:36.972 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (2m) 78s ago 18m 81.4M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:36:36.972 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (86s) 78s ago 17m 11.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:36:36.972 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (54s) 5s ago 17m 92.0M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:36:36.972 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (10s) 5s ago 16m 11.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 93c28b8b835a 2024-02-28T16:36:36.972 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (16m) 5s ago 16m 192M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:36:36.972 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (6m) 78s ago 21m 54.1M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:36:36.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42a806d7f0 msgr2=0x7f42a806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42a806d7f0 0x7f42a806fca0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009b80 tx=0x7f42b400b040 comp rx=0 tx=0).stop 2024-02-28T16:36:36.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 msgr2=0x7f42c4116140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:36.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4116140 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42b0000c00 tx=0x7f42b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 shutdown_connections 2024-02-28T16:36:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42a806d7f0 0x7f42a806fca0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42c4070330 0x7f42c4115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 --2- 172.21.15.148:0/4166177841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42c4070c40 0x7f42c4116140 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 >> 172.21.15.148:0/4166177841 conn(0x7f42c40f8ae0 msgr2=0x7f42c4103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 shutdown_connections 2024-02-28T16:36:36.974 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:36.985+0000 7f42ca800700 1 -- 172.21.15.148:0/4166177841 wait complete. 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 -- 172.21.15.148:0/3319924183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 msgr2=0x7f27c0100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 --2- 172.21.15.148:0/3319924183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c0100d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27ac004940 tx=0x7f27ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 -- 172.21.15.148:0/3319924183 shutdown_connections 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 --2- 172.21.15.148:0/3319924183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c0100d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 --2- 172.21.15.148:0/3319924183 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27c00fbd50 0x7f27c00fc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 -- 172.21.15.148:0/3319924183 >> 172.21.15.148:0/3319924183 conn(0x7f27c00f7a10 msgr2=0x7f27c00f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 -- 172.21.15.148:0/3319924183 shutdown_connections 2024-02-28T16:36:37.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.130+0000 7f27c6800700 1 -- 172.21.15.148:0/3319924183 wait complete. 2024-02-28T16:36:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.131+0000 7f27c6800700 1 Processor -- start 2024-02-28T16:36:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.131+0000 7f27c6800700 1 -- start start 2024-02-28T16:36:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27c6800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27c00fbd50 0x7f27c011a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27c6800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c011a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:37.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27c6800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c011ad70 con 0x7f27c00fc6f0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27c6800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c0114080 con 0x7f27c00fbd50 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27bea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c011a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27bea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c011a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46780/0 (socket says 172.21.15.148:46780) 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27bea00700 1 -- 172.21.15.148:0/913036008 learned_addr learned my addr 172.21.15.148:0/913036008 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27bea00700 1 -- 172.21.15.148:0/913036008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27c00fbd50 msgr2=0x7f27c011a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27bea00700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27c00fbd50 0x7f27c011a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.132+0000 7f27bea00700 1 -- 172.21.15.148:0/913036008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac005040 con 0x7f27c00fc6f0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.133+0000 7f27bea00700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c011a720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00b3b0 tx=0x7f27ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.133+0000 7f27b7400700 1 -- 172.21.15.148:0/913036008 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27ac00e040 con 0x7f27c00fc6f0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.133+0000 7f27b7400700 1 -- 172.21.15.148:0/913036008 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27ac00bbf0 con 0x7f27c00fc6f0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.133+0000 7f27b7400700 1 -- 172.21.15.148:0/913036008 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27ac01c630 con 0x7f27c00fc6f0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.133+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c0114300 con 0x7f27c00fc6f0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.133+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c0114840 con 0x7f27c00fc6f0 2024-02-28T16:36:37.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.134+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c00fe430 con 0x7f27c00fc6f0 2024-02-28T16:36:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.135+0000 7f27b7400700 1 -- 172.21.15.148:0/913036008 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f27ac00bd60 con 0x7f27c00fc6f0 2024-02-28T16:36:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.136+0000 7f27b7400700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f27a406d7e0 0x7f27a406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.136+0000 7f27b7400700 1 -- 172.21.15.148:0/913036008 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f27ac08e330 con 0x7f27c00fc6f0 2024-02-28T16:36:37.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.136+0000 7f27bf400700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f27a406d7e0 0x7f27a406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:37.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.137+0000 7f27bf400700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f27a406d7e0 0x7f27a406fc90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27b0004b70 tx=0x7f27b0007cc0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:37.129 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.141+0000 7f27b7400700 1 -- 172.21.15.148:0/913036008 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f27ac05b6e0 con 0x7f27c00fc6f0 2024-02-28T16:36:37.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:36 smithi157 ceph-mon[89328]: pgmap v166: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 46/264 objects degraded (17.424%) 2024-02-28T16:36:37.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:36 smithi157 ceph-mon[89328]: osdmap e74: 6 total, 6 up, 6 in 2024-02-28T16:36:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.426+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27c004bed0 con 0x7f27c00fc6f0 2024-02-28T16:36:37.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.427+0000 7f27b7400700 1 -- 172.21.15.148:0/913036008 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f27ac05b270 con 0x7f27c00fc6f0 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:36:37.416 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 5, 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 9 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:36:37.417 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:36:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f27a406d7e0 msgr2=0x7f27a406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f27a406d7e0 0x7f27a406fc90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f27b0004b70 tx=0x7f27b0007cc0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 msgr2=0x7f27c011a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c011a720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00b3b0 tx=0x7f27ac009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 shutdown_connections 2024-02-28T16:36:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f27a406d7e0 0x7f27a406fc90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27c00fbd50 0x7f27c011a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 --2- 172.21.15.148:0/913036008 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27c00fc6f0 0x7f27c011a720 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 >> 172.21.15.148:0/913036008 conn(0x7f27c00f7a10 msgr2=0x7f27c010d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 shutdown_connections 2024-02-28T16:36:37.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.431+0000 7f27c6800700 1 -- 172.21.15.148:0/913036008 wait complete. 2024-02-28T16:36:37.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 -- 172.21.15.148:0/4181795227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f40103dc0 msgr2=0x7f0f40104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 --2- 172.21.15.148:0/4181795227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f40103dc0 0x7f0f40104210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c004940 tx=0x7f0f2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:37.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 -- 172.21.15.148:0/4181795227 shutdown_connections 2024-02-28T16:36:37.569 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 --2- 172.21.15.148:0/4181795227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f40103dc0 0x7f0f40104210 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 --2- 172.21.15.148:0/4181795227 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f401095f0 0x7f0f401099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 -- 172.21.15.148:0/4181795227 >> 172.21.15.148:0/4181795227 conn(0x7f0f40072d50 msgr2=0x7f0f40075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:37.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 -- 172.21.15.148:0/4181795227 shutdown_connections 2024-02-28T16:36:37.570 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.581+0000 7f0f46c00700 1 -- 172.21.15.148:0/4181795227 wait complete. 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.582+0000 7f0f46c00700 1 Processor -- start 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.582+0000 7f0f46c00700 1 -- start start 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.582+0000 7f0f46c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f40103dc0 0x7f0f4011a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.582+0000 7f0f46c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f401095f0 0x7f0f4011a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.582+0000 7f0f46c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4011abd0 con 0x7f0f401095f0 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.582+0000 7f0f46c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f40113ee0 con 0x7f0f40103dc0 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f401095f0 0x7f0f4011a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3fe00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f40103dc0 0x7f0f4011a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f401095f0 0x7f0f4011a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46790/0 (socket says 172.21.15.148:46790) 2024-02-28T16:36:37.571 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3f400700 1 -- 172.21.15.148:0/1254497992 learned_addr learned my addr 172.21.15.148:0/1254497992 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:37.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3f400700 1 -- 172.21.15.148:0/1254497992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f40103dc0 msgr2=0x7f0f4011a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3f400700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f40103dc0 0x7f0f4011a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3f400700 1 -- 172.21.15.148:0/1254497992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2c005040 con 0x7f0f401095f0 2024-02-28T16:36:37.572 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3fe00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f40103dc0 0x7f0f4011a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T16:36:37.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.583+0000 7f0f3f400700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f401095f0 0x7f0f4011a580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009150 tx=0x7f0f2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:37.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.584+0000 7f0f37e00700 1 -- 172.21.15.148:0/1254497992 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f2c00e040 con 0x7f0f401095f0 2024-02-28T16:36:37.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.584+0000 7f0f37e00700 1 -- 172.21.15.148:0/1254497992 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f2c00bbf0 con 0x7f0f401095f0 2024-02-28T16:36:37.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.584+0000 7f0f37e00700 1 -- 172.21.15.148:0/1254497992 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f2c01c3f0 con 0x7f0f401095f0 2024-02-28T16:36:37.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.584+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f40114160 con 0x7f0f401095f0 2024-02-28T16:36:37.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.584+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f401146a0 con 0x7f0f401095f0 2024-02-28T16:36:37.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.585+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4010b9c0 con 0x7f0f401095f0 2024-02-28T16:36:37.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.586+0000 7f0f37e00700 1 -- 172.21.15.148:0/1254497992 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0f2c00bd60 con 0x7f0f401095f0 2024-02-28T16:36:37.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.587+0000 7f0f37e00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0f2406d7f0 0x7f0f2406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:37.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.587+0000 7f0f37e00700 1 -- 172.21.15.148:0/1254497992 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0f2c08e020 con 0x7f0f401095f0 2024-02-28T16:36:37.575 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.587+0000 7f0f3fe00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0f2406d7f0 0x7f0f2406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:37.576 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.588+0000 7f0f3fe00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0f2406d7f0 0x7f0f2406fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f30010520 tx=0x7f0f3000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:37.580 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.592+0000 7f0f37e00700 1 -- 172.21.15.148:0/1254497992 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0f2c05b510 con 0x7f0f401095f0 2024-02-28T16:36:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.857+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0f4004bed0 con 0x7f0f401095f0 2024-02-28T16:36:37.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.858+0000 7f0f37e00700 1 -- 172.21.15.148:0/1254497992 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f0f2c05b0a0 con 0x7f0f401095f0 2024-02-28T16:36:37.847 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:36:37.848 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:36:37.849 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:37.850 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:36:37.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.861+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0f2406d7f0 msgr2=0x7f0f2406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.861+0000 7f0f46c00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0f2406d7f0 0x7f0f2406fca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f30010520 tx=0x7f0f3000b040 comp rx=0 tx=0).stop 2024-02-28T16:36:37.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.861+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f401095f0 msgr2=0x7f0f4011a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:37.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.861+0000 7f0f46c00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f401095f0 0x7f0f4011a580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c009150 tx=0x7f0f2c009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.861+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 shutdown_connections 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.861+0000 7f0f46c00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f0f2406d7f0 0x7f0f2406fca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.861+0000 7f0f46c00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0f40103dc0 0x7f0f4011a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.862+0000 7f0f46c00700 1 --2- 172.21.15.148:0/1254497992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f401095f0 0x7f0f4011a580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.862+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 >> 172.21.15.148:0/1254497992 conn(0x7f0f40072d50 msgr2=0x7f0f40074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.862+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 shutdown_connections 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:37.862+0000 7f0f46c00700 1 -- 172.21.15.148:0/1254497992 wait complete. 2024-02-28T16:36:37.852 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:36:37.900 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:37 smithi157 ceph-mon[89328]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:37.900 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:37 smithi157 ceph-mon[89328]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:37.900 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:37 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/913036008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:37.999 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 -- 172.21.15.148:0/4293765858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 msgr2=0x7f8a0c0fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 --2- 172.21.15.148:0/4293765858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fb9c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f89f8004940 tx=0x7f89f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:38.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 -- 172.21.15.148:0/4293765858 shutdown_connections 2024-02-28T16:36:38.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 --2- 172.21.15.148:0/4293765858 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fb9c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 --2- 172.21.15.148:0/4293765858 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a0c103140 0x7f8a0c103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 -- 172.21.15.148:0/4293765858 >> 172.21.15.148:0/4293765858 conn(0x7f8a0c071560 msgr2=0x7f8a0c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:38.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 -- 172.21.15.148:0/4293765858 shutdown_connections 2024-02-28T16:36:38.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.011+0000 7f8a11c00700 1 -- 172.21.15.148:0/4293765858 wait complete. 2024-02-28T16:36:38.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.012+0000 7f8a11c00700 1 Processor -- start 2024-02-28T16:36:38.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.012+0000 7f8a11c00700 1 -- start start 2024-02-28T16:36:38.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a11c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:38.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a11c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a0c103140 0x7f8a0c0fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a11c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0fd300 con 0x7f8a0c0fb570 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a11c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0fd470 con 0x7f8a0c103140 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a0aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a0aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46810/0 (socket says 172.21.15.148:46810) 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a0aa00700 1 -- 172.21.15.148:0/542163919 learned_addr learned my addr 172.21.15.148:0/542163919 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a0a000700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a0c103140 0x7f8a0c0fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a0aa00700 1 -- 172.21.15.148:0/542163919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a0c103140 msgr2=0x7f8a0c0fccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a0aa00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a0c103140 0x7f8a0c0fccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.013+0000 7f8a0aa00700 1 -- 172.21.15.148:0/542163919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8005040 con 0x7f8a0c0fb570 2024-02-28T16:36:38.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.014+0000 7f8a0aa00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fc750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f89fc002a50 tx=0x7f89fc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:38.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.014+0000 7f8a02a00700 1 -- 172.21.15.148:0/542163919 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89fc007cc0 con 0x7f8a0c0fb570 2024-02-28T16:36:38.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.014+0000 7f8a02a00700 1 -- 172.21.15.148:0/542163919 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f89fc00f040 con 0x7f8a0c0fb570 2024-02-28T16:36:38.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.014+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c119d60 con 0x7f8a0c0fb570 2024-02-28T16:36:38.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.014+0000 7f8a02a00700 1 -- 172.21.15.148:0/542163919 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89fc00da30 con 0x7f8a0c0fb570 2024-02-28T16:36:38.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.014+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c11a2a0 con 0x7f8a0c0fb570 2024-02-28T16:36:38.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.015+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c1054d0 con 0x7f8a0c0fb570 2024-02-28T16:36:38.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.016+0000 7f8a02a00700 1 -- 172.21.15.148:0/542163919 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f89fc00db90 con 0x7f8a0c0fb570 2024-02-28T16:36:38.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.017+0000 7f8a02a00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89f006d7f0 0x7f89f006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:38.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.017+0000 7f8a02a00700 1 -- 172.21.15.148:0/542163919 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f89fc08cba0 con 0x7f8a0c0fb570 2024-02-28T16:36:38.005 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.017+0000 7f8a0a000700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89f006d7f0 0x7f89f006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:38.006 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.018+0000 7f8a0a000700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89f006d7f0 0x7f89f006fca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89f80043d0 tx=0x7f89f8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:38.010 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.022+0000 7f8a02a00700 1 -- 172.21.15.148:0/542163919 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f89fc056420 con 0x7f8a0c0fb570 2024-02-28T16:36:38.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:37 smithi148 ceph-mon[112463]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:38.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:37 smithi148 ceph-mon[112463]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:38.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:37 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/913036008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:38.244 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.255+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a0c073050 con 0x7f89f006d7f0 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.258+0000 7f8a02a00700 1 -- 172.21.15.148:0/542163919 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8a0c073050 con 0x7f89f006d7f0 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: "crash" 2024-02-28T16:36:38.246 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:36:38.247 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "11/21 daemons upgraded", 2024-02-28T16:36:38.247 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:36:38.247 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:36:38.247 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:36:38.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89f006d7f0 msgr2=0x7f89f006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89f006d7f0 0x7f89f006fca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89f80043d0 tx=0x7f89f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:38.248 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 msgr2=0x7f8a0c0fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fc750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f89fc002a50 tx=0x7f89fc0046b0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 shutdown_connections 2024-02-28T16:36:38.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f89f006d7f0 0x7f89f006fca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c0fb570 0x7f8a0c0fc750 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.249 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 --2- 172.21.15.148:0/542163919 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8a0c103140 0x7f8a0c0fccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.260+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 >> 172.21.15.148:0/542163919 conn(0x7f8a0c071560 msgr2=0x7f8a0c0f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:38.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.261+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 shutdown_connections 2024-02-28T16:36:38.250 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.261+0000 7f8a11c00700 1 -- 172.21.15.148:0/542163919 wait complete. 2024-02-28T16:36:38.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.408+0000 7fe14e200700 1 -- 172.21.15.148:0/3858740175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 msgr2=0x7fe148104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.408+0000 7fe14e200700 1 --2- 172.21.15.148:0/3858740175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe148104210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe130004940 tx=0x7fe130009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:38.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.408+0000 7fe14e200700 1 -- 172.21.15.148:0/3858740175 shutdown_connections 2024-02-28T16:36:38.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.408+0000 7fe14e200700 1 --2- 172.21.15.148:0/3858740175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe148104210 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.408+0000 7fe14e200700 1 --2- 172.21.15.148:0/3858740175 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1481095f0 0x7fe1481099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.409+0000 7fe14e200700 1 -- 172.21.15.148:0/3858740175 >> 172.21.15.148:0/3858740175 conn(0x7fe148072d50 msgr2=0x7fe148075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:38.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.409+0000 7fe14e200700 1 -- 172.21.15.148:0/3858740175 shutdown_connections 2024-02-28T16:36:38.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.409+0000 7fe14e200700 1 -- 172.21.15.148:0/3858740175 wait complete. 2024-02-28T16:36:38.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.409+0000 7fe14e200700 1 Processor -- start 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe14e200700 1 -- start start 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe14e200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe14811a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe14e200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1481095f0 0x7fe14811a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe14e200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14811abd0 con 0x7fe148103dc0 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe14e200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148113ee0 con 0x7fe1481095f0 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe147400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe14811a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe147400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe14811a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:46836/0 (socket says 172.21.15.148:46836) 2024-02-28T16:36:38.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.410+0000 7fe147400700 1 -- 172.21.15.148:0/1999259896 learned_addr learned my addr 172.21.15.148:0/1999259896 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:36:38.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe13ea00700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1481095f0 0x7fe14811a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:38.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe147400700 1 -- 172.21.15.148:0/1999259896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1481095f0 msgr2=0x7fe14811a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe147400700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1481095f0 0x7fe14811a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe147400700 1 -- 172.21.15.148:0/1999259896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe130005040 con 0x7fe148103dc0 2024-02-28T16:36:38.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe13ea00700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1481095f0 0x7fe14811a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:36:38.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe147400700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe14811a040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c8c0 tx=0x7fe1380044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:38.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe13fe00700 1 -- 172.21.15.148:0/1999259896 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13800a980 con 0x7fe148103dc0 2024-02-28T16:36:38.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe13fe00700 1 -- 172.21.15.148:0/1999259896 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe13800ce60 con 0x7fe148103dc0 2024-02-28T16:36:38.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1481141c0 con 0x7fe148103dc0 2024-02-28T16:36:38.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.411+0000 7fe13fe00700 1 -- 172.21.15.148:0/1999259896 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1380115e0 con 0x7fe148103dc0 2024-02-28T16:36:38.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.412+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148114700 con 0x7fe148103dc0 2024-02-28T16:36:38.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.413+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14810b9c0 con 0x7fe148103dc0 2024-02-28T16:36:38.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.414+0000 7fe13fe00700 1 -- 172.21.15.148:0/1999259896 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe138012400 con 0x7fe148103dc0 2024-02-28T16:36:38.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.415+0000 7fe13fe00700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe12c06d7f0 0x7fe12c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:36:38.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.415+0000 7fe13fe00700 1 -- 172.21.15.148:0/1999259896 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe13808cf50 con 0x7fe148103dc0 2024-02-28T16:36:38.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.415+0000 7fe13ea00700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe12c06d7f0 0x7fe12c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:36:38.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.416+0000 7fe13ea00700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe12c06d7f0 0x7fe12c06fca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe13000b3b0 tx=0x7fe130009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:36:38.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.421+0000 7fe13fe00700 1 -- 172.21.15.148:0/1999259896 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe1380c0d20 con 0x7fe148103dc0 2024-02-28T16:36:38.716 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.727+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe148075870 con 0x7fe148103dc0 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.728+0000 7fe13fe00700 1 -- 172.21.15.148:0/1999259896 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1039 (secure 0 0 0) 0x7fe13805a3a0 con 0x7fe148103dc0 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 39/264 objects degraded (14.773%), 12 pgs degraded 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 39/264 objects degraded (14.773%), 12 pgs degraded 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-28T16:36:38.717 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-28T16:36:38.718 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-28T16:36:38.718 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-28T16:36:38.718 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-02-28T16:36:38.718 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-28T16:36:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe12c06d7f0 msgr2=0x7fe12c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe12c06d7f0 0x7fe12c06fca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe13000b3b0 tx=0x7fe130009e30 comp rx=0 tx=0).stop 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 msgr2=0x7fe14811a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe14811a040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c8c0 tx=0x7fe1380044c0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 shutdown_connections 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe12c06d7f0 0x7fe12c06fca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe148103dc0 0x7fe14811a040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 --2- 172.21.15.148:0/1999259896 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe1481095f0 0x7fe14811a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 >> 172.21.15.148:0/1999259896 conn(0x7fe148072d50 msgr2=0x7fe148074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 shutdown_connections 2024-02-28T16:36:38.720 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:36:38.731+0000 7fe14e200700 1 -- 172.21.15.148:0/1999259896 wait complete. 2024-02-28T16:36:39.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:38 smithi148 ceph-mon[112463]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:38 smithi148 ceph-mon[112463]: pgmap v168: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 39/264 objects degraded (14.773%) 2024-02-28T16:36:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:38 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1254497992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:36:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:38 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 39/264 objects degraded (14.773%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:36:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:38 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1999259896' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:36:39.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:38 smithi157 ceph-mon[89328]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:39.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:38 smithi157 ceph-mon[89328]: pgmap v168: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 39/264 objects degraded (14.773%) 2024-02-28T16:36:39.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:38 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1254497992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:36:39.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:38 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 39/264 objects degraded (14.773%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T16:36:39.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:38 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1999259896' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:36:40.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:40.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:39 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:36:40.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:39 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:40 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:40 smithi148 ceph-mon[112463]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-28T16:36:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:40 smithi148 ceph-mon[112463]: pgmap v169: 65 pgs: 5 active+undersized+degraded, 5 active+undersized, 55 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/264 objects degraded (8.333%) 2024-02-28T16:36:41.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:40 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:41.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:40 smithi157 ceph-mon[89328]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-28T16:36:41.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:40 smithi157 ceph-mon[89328]: pgmap v169: 65 pgs: 5 active+undersized+degraded, 5 active+undersized, 55 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/264 objects degraded (8.333%) 2024-02-28T16:36:42.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:41 smithi148 ceph-mon[112463]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/264 objects degraded (8.333%), 5 pgs degraded) 2024-02-28T16:36:42.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:41 smithi157 ceph-mon[89328]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/264 objects degraded (8.333%), 5 pgs degraded) 2024-02-28T16:36:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:42 smithi148 ceph-mon[112463]: pgmap v170: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:42 smithi157 ceph-mon[89328]: pgmap v170: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:45.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:44 smithi148 ceph-mon[112463]: pgmap v171: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:44 smithi157 ceph-mon[89328]: pgmap v171: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:47.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:46 smithi148 ceph-mon[112463]: pgmap v172: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:46 smithi157 ceph-mon[89328]: pgmap v172: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:49.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:48 smithi148 ceph-mon[112463]: pgmap v173: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:49.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:48 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:49.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:48 smithi157 ceph-mon[89328]: pgmap v173: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:49.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:48 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:50 smithi148 ceph-mon[112463]: pgmap v174: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:51.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:50 smithi157 ceph-mon[89328]: pgmap v174: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:53.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:52 smithi148 ceph-mon[112463]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:52 smithi157 ceph-mon[89328]: pgmap v175: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:55.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:54 smithi148 ceph-mon[112463]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:55.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:55.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:54 smithi157 ceph-mon[89328]: pgmap v176: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:55.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:56.116 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:55 smithi157 ceph-mon[89328]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:56.116 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:55 smithi157 ceph-mon[89328]: Upgrade: osd.5 is safe to restart 2024-02-28T16:36:56.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:55 smithi148 ceph-mon[112463]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T16:36:56.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:55 smithi148 ceph-mon[112463]: Upgrade: osd.5 is safe to restart 2024-02-28T16:36:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:56 smithi148 ceph-mon[112463]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:36:57.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:56 smithi157 ceph-mon[89328]: pgmap v177: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:36:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T16:36:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:36:58.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:57 smithi157 ceph-mon[89328]: Upgrade: Updating osd.5 2024-02-28T16:36:58.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:57 smithi157 ceph-mon[89328]: Deploying daemon osd.5 on smithi157 2024-02-28T16:36:58.040 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:57 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:58.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:57 smithi148 ceph-mon[112463]: Upgrade: Updating osd.5 2024-02-28T16:36:58.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:57 smithi148 ceph-mon[112463]: Deploying daemon osd.5 on smithi157 2024-02-28T16:36:58.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:36:58.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:36:58 smithi157 ceph-mon[89328]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:36:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:36:58 smithi148 ceph-mon[112463]: pgmap v178: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:00.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:00 smithi157 ceph-mon[89328]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:00 smithi148 ceph-mon[112463]: pgmap v179: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:01.737 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:01 smithi157 systemd[1]: Stopping Ceph osd.5 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:37:02.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:01 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[57318]: 2024-02-28T16:37:01.926+0000 7f18be800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:37:02.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:01 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[57318]: 2024-02-28T16:37:01.926+0000 7f18be800700 -1 osd.5 74 *** Got signal Terminated *** 2024-02-28T16:37:02.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:01 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[57318]: 2024-02-28T16:37:01.926+0000 7f18be800700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:37:03.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:02 smithi148 ceph-mon[112463]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:03.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:02 smithi148 ceph-mon[112463]: osd.5 marked itself down and dead 2024-02-28T16:37:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:02 smithi157 ceph-mon[89328]: pgmap v180: 65 pgs: 65 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:03.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:02 smithi157 ceph-mon[89328]: osd.5 marked itself down and dead 2024-02-28T16:37:03.831 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:03 smithi157 podman[108727]: 2024-02-28 16:37:03.520960393 +0000 UTC m=+1.776278010 container died 1a50c5f2126e2999f978acd90ae687ff8af51382ba148b3e0d4a6ac97d17a23a (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-c0f02e6, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-28T16:37:04.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:03 smithi148 ceph-mon[112463]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:37:04.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:03 smithi148 ceph-mon[112463]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T16:37:04.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:03 smithi148 ceph-mon[112463]: osdmap e75: 6 total, 5 up, 6 in 2024-02-28T16:37:04.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:03 smithi157 ceph-mon[89328]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T16:37:04.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:03 smithi157 ceph-mon[89328]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T16:37:04.210 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:03 smithi157 ceph-mon[89328]: osdmap e75: 6 total, 5 up, 6 in 2024-02-28T16:37:04.211 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:03 smithi157 podman[108727]: 2024-02-28 16:37:03.98797911 +0000 UTC m=+2.243296768 container cleanup 1a50c5f2126e2999f978acd90ae687ff8af51382ba148b3e0d4a6ac97d17a23a (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c0f02e6) 2024-02-28T16:37:04.211 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:03 smithi157 bash[108727]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5 2024-02-28T16:37:04.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:04 smithi157 podman[108747]: 2024-02-28 16:37:04.222348816 +0000 UTC m=+0.688525762 container remove 1a50c5f2126e2999f978acd90ae687ff8af51382ba148b3e0d4a6ac97d17a23a (image=quay.ceph.io/ceph-ci/ceph@sha256:021981da540536081f6780ee5f46f271a73eedf115b483788e5c5e3dab60ff13, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=quincy-c0f02e6, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:37:05.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:05 smithi157 podman[108839]: 2024-02-28 16:37:04.951485809 +0000 UTC m=+0.034421944 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:37:05.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:05 smithi157 podman[108839]: 2024-02-28 16:37:05.131843066 +0000 UTC m=+0.214779231 container create 4c04235af39759207449aa8e2eddc73351699190d688e1b771f871d9894a9216 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T16:37:05.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:04 smithi157 ceph-mon[89328]: pgmap v182: 65 pgs: 13 stale+active+clean, 52 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:05.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:04 smithi157 ceph-mon[89328]: osdmap e76: 6 total, 5 up, 6 in 2024-02-28T16:37:05.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:04 smithi148 ceph-mon[112463]: pgmap v182: 65 pgs: 13 stale+active+clean, 52 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:05.375 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:04 smithi148 ceph-mon[112463]: osdmap e76: 6 total, 5 up, 6 in 2024-02-28T16:37:05.555 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:05 smithi157 podman[108839]: 2024-02-28 16:37:05.431558046 +0000 UTC m=+0.514494234 container init 4c04235af39759207449aa8e2eddc73351699190d688e1b771f871d9894a9216 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-28T16:37:05.555 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:05 smithi157 podman[108839]: 2024-02-28 16:37:05.44297978 +0000 UTC m=+0.525915955 container start 4c04235af39759207449aa8e2eddc73351699190d688e1b771f871d9894a9216 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-28T16:37:05.555 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:05 smithi157 podman[108839]: 2024-02-28 16:37:05.56765248 +0000 UTC m=+0.650588715 container attach 4c04235af39759207449aa8e2eddc73351699190d688e1b771f871d9894a9216 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, RELEASE=main-1fb5d10, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:37:06.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:05 smithi157 ceph-mon[89328]: pgmap v184: 65 pgs: 9 active+undersized+degraded, 3 peering, 5 stale+active+clean, 8 active+undersized, 40 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:37:06.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:05 smithi157 ceph-mon[89328]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-28T16:37:06.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:05 smithi157 ceph-mon[89328]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 9 pgs degraded (PG_DEGRADED) 2024-02-28T16:37:06.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:05 smithi157 podman[108865]: 2024-02-28 16:37:05.930799221 +0000 UTC m=+0.036501288 container died 4c04235af39759207449aa8e2eddc73351699190d688e1b771f871d9894a9216 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-28T16:37:06.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:05 smithi148 ceph-mon[112463]: pgmap v184: 65 pgs: 9 active+undersized+degraded, 3 peering, 5 stale+active+clean, 8 active+undersized, 40 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 34/264 objects degraded (12.879%) 2024-02-28T16:37:06.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:05 smithi148 ceph-mon[112463]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-28T16:37:06.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:05 smithi148 ceph-mon[112463]: Health check failed: Degraded data redundancy: 34/264 objects degraded (12.879%), 9 pgs degraded (PG_DEGRADED) 2024-02-28T16:37:06.986 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:06 smithi157 podman[108865]: 2024-02-28 16:37:06.738081021 +0000 UTC m=+0.843783123 container remove 4c04235af39759207449aa8e2eddc73351699190d688e1b771f871d9894a9216 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-28T16:37:06.986 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:06 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-28T16:37:06.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:06 smithi157 systemd[1]: Stopped Ceph osd.5 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:37:06.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:06 smithi157 systemd[1]: ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.5.service: Consumed 1min 50.123s CPU time. 2024-02-28T16:37:07.470 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:07 smithi157 systemd[1]: Starting Ceph osd.5 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:37:07.737 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:07 smithi157 podman[108965]: 2024-02-28 16:37:07.386934996 +0000 UTC m=+0.036663525 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:37:07.737 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:07 smithi157 podman[108965]: 2024-02-28 16:37:07.531416849 +0000 UTC m=+0.181145407 container create f43c639ac480628cb0767318254b8f3bbf91afa37b1da48ba18e6350da472700 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-28T16:37:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:07 smithi157 podman[108965]: 2024-02-28 16:37:07.77659553 +0000 UTC m=+0.426324131 container init f43c639ac480628cb0767318254b8f3bbf91afa37b1da48ba18e6350da472700 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:37:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:07 smithi157 podman[108965]: 2024-02-28 16:37:07.788808281 +0000 UTC m=+0.438536846 container start f43c639ac480628cb0767318254b8f3bbf91afa37b1da48ba18e6350da472700 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True) 2024-02-28T16:37:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:07 smithi157 podman[108965]: 2024-02-28 16:37:07.883689492 +0000 UTC m=+0.533418110 container attach f43c639ac480628cb0767318254b8f3bbf91afa37b1da48ba18e6350da472700 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 -- 172.21.15.148:0/179352639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 msgr2=0x7ffb900fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 --2- 172.21.15.148:0/179352639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb900fcf60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c004940 tx=0x7ffb7c009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 -- 172.21.15.148:0/179352639 shutdown_connections 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 --2- 172.21.15.148:0/179352639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb900fcf60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 --2- 172.21.15.148:0/179352639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb90102f50 0x7ffb90103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 -- 172.21.15.148:0/179352639 >> 172.21.15.148:0/179352639 conn(0x7ffb900f8ae0 msgr2=0x7ffb900faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 -- 172.21.15.148:0/179352639 shutdown_connections 2024-02-28T16:37:08.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.897+0000 7ffb95000700 1 -- 172.21.15.148:0/179352639 wait complete. 2024-02-28T16:37:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.898+0000 7ffb95000700 1 Processor -- start 2024-02-28T16:37:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb95000700 1 -- start start 2024-02-28T16:37:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb95000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb90102f50 0x7ffb90113a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb95000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb90113f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:08.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb95000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90114590 con 0x7ffb901038f0 2024-02-28T16:37:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb95000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9010d930 con 0x7ffb90102f50 2024-02-28T16:37:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb8d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb90113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb8d400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb90113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52746/0 (socket says 172.21.15.148:52746) 2024-02-28T16:37:08.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.899+0000 7ffb8d400700 1 -- 172.21.15.148:0/46741410 learned_addr learned my addr 172.21.15.148:0/46741410 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb8de00700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb90102f50 0x7ffb90113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb8d400700 1 -- 172.21.15.148:0/46741410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb90102f50 msgr2=0x7ffb90113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb8d400700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb90102f50 0x7ffb90113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb8d400700 1 -- 172.21.15.148:0/46741410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c005040 con 0x7ffb901038f0 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb8d400700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb90113f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009030 tx=0x7ffb7c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb86000700 1 -- 172.21.15.148:0/46741410 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c00e040 con 0x7ffb901038f0 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb86000700 1 -- 172.21.15.148:0/46741410 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb7c00bbf0 con 0x7ffb901038f0 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb86000700 1 -- 172.21.15.148:0/46741410 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c01c630 con 0x7ffb901038f0 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.900+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9010dbb0 con 0x7ffb901038f0 2024-02-28T16:37:08.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.901+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9010e0f0 con 0x7ffb901038f0 2024-02-28T16:37:08.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.902+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90105420 con 0x7ffb901038f0 2024-02-28T16:37:08.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.903+0000 7ffb86000700 1 -- 172.21.15.148:0/46741410 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ffb7c00bd60 con 0x7ffb901038f0 2024-02-28T16:37:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.904+0000 7ffb86000700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ffb7406d7f0 0x7ffb7406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.904+0000 7ffb86000700 1 -- 172.21.15.148:0/46741410 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffb7c08e1a0 con 0x7ffb901038f0 2024-02-28T16:37:08.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.904+0000 7ffb8de00700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ffb7406d7f0 0x7ffb7406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:08.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.905+0000 7ffb8de00700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ffb7406d7f0 0x7ffb7406fca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb80004990 tx=0x7ffb80009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:08.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:08.909+0000 7ffb86000700 1 -- 172.21.15.148:0/46741410 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb7c05b5d0 con 0x7ffb901038f0 2024-02-28T16:37:08.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-mon[89328]: pgmap v185: 65 pgs: 11 active+undersized+degraded, 3 peering, 14 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 38/264 objects degraded (14.394%) 2024-02-28T16:37:08.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate[108980]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:37:08.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate[108980]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:37:08.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 bash[108965]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:37:08.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 bash[108965]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T16:37:08.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 bash[108965]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:37:08.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 bash[108965]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:37:08.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 bash[108965]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 bash[108965]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 bash[108965]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate[108980]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate[108980]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate[108980]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate[108980]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate[108980]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T16:37:08.988 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:08 smithi157 podman[108965]: 2024-02-28 16:37:08.718082806 +0000 UTC m=+1.367811371 container died f43c639ac480628cb0767318254b8f3bbf91afa37b1da48ba18e6350da472700 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-02-28T16:37:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:08 smithi148 ceph-mon[112463]: pgmap v185: 65 pgs: 11 active+undersized+degraded, 3 peering, 14 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 38/264 objects degraded (14.394%) 2024-02-28T16:37:09.136 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.147+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb9010a030 con 0x7ffb7406d7f0 2024-02-28T16:37:09.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.149+0000 7ffb86000700 1 -- 172.21.15.148:0/46741410 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ffb9010a030 con 0x7ffb7406d7f0 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ffb7406d7f0 msgr2=0x7ffb7406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ffb7406d7f0 0x7ffb7406fca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffb80004990 tx=0x7ffb80009ee0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 msgr2=0x7ffb90113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb90113f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009030 tx=0x7ffb7c009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 shutdown_connections 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ffb7406d7f0 0x7ffb7406fca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb90102f50 0x7ffb90113a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 --2- 172.21.15.148:0/46741410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb901038f0 0x7ffb90113f40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 >> 172.21.15.148:0/46741410 conn(0x7ffb900f8ae0 msgr2=0x7ffb900fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:09.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.152+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 shutdown_connections 2024-02-28T16:37:09.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.153+0000 7ffb95000700 1 -- 172.21.15.148:0/46741410 wait complete. 2024-02-28T16:37:09.156 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:37:09.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 -- 172.21.15.148:0/3639080051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c072dd0 msgr2=0x7fde0c10d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.296 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 --2- 172.21.15.148:0/3639080051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c072dd0 0x7fde0c10d8e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fddf8004940 tx=0x7fddf8009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 -- 172.21.15.148:0/3639080051 shutdown_connections 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 --2- 172.21.15.148:0/3639080051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c072dd0 0x7fde0c10d8e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 --2- 172.21.15.148:0/3639080051 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde0c0724c0 0x7fde0c072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 -- 172.21.15.148:0/3639080051 >> 172.21.15.148:0/3639080051 conn(0x7fde0c0face0 msgr2=0x7fde0c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 -- 172.21.15.148:0/3639080051 shutdown_connections 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.308+0000 7fde11400700 1 -- 172.21.15.148:0/3639080051 wait complete. 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.309+0000 7fde11400700 1 Processor -- start 2024-02-28T16:37:09.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.309+0000 7fde11400700 1 -- start start 2024-02-28T16:37:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.310+0000 7fde11400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c0724c0 0x7fde0c11a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.310+0000 7fde11400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde0c072dd0 0x7fde0c11a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.310+0000 7fde11400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c11abc0 con 0x7fde0c0724c0 2024-02-28T16:37:09.298 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.310+0000 7fde11400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c113ed0 con 0x7fde0c072dd0 2024-02-28T16:37:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.310+0000 7fde0a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c0724c0 0x7fde0c11a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.310+0000 7fde0a800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c0724c0 0x7fde0c11a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52770/0 (socket says 172.21.15.148:52770) 2024-02-28T16:37:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.310+0000 7fde0a800700 1 -- 172.21.15.148:0/1923589189 learned_addr learned my addr 172.21.15.148:0/1923589189 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:09.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde09e00700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde0c072dd0 0x7fde0c11a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde0a800700 1 -- 172.21.15.148:0/1923589189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde0c072dd0 msgr2=0x7fde0c11a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde0a800700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde0c072dd0 0x7fde0c11a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde0a800700 1 -- 172.21.15.148:0/1923589189 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8005040 con 0x7fde0c0724c0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde0a800700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c0724c0 0x7fde0c11a030 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fddfc002a50 tx=0x7fddfc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde02a00700 1 -- 172.21.15.148:0/1923589189 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddfc007cc0 con 0x7fde0c0724c0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde02a00700 1 -- 172.21.15.148:0/1923589189 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fddfc00f040 con 0x7fde0c0724c0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c1141b0 con 0x7fde0c0724c0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.311+0000 7fde02a00700 1 -- 172.21.15.148:0/1923589189 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddfc00db70 con 0x7fde0c0724c0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.312+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c1146f0 con 0x7fde0c0724c0 2024-02-28T16:37:09.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.313+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c10b010 con 0x7fde0c0724c0 2024-02-28T16:37:09.301 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.314+0000 7fde02a00700 1 -- 172.21.15.148:0/1923589189 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fddfc00dd10 con 0x7fde0c0724c0 2024-02-28T16:37:09.302 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.314+0000 7fde02a00700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddf006d7f0 0x7fddf006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.315+0000 7fde02a00700 1 -- 172.21.15.148:0/1923589189 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fddfc08c620 con 0x7fde0c0724c0 2024-02-28T16:37:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.315+0000 7fde09e00700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddf006d7f0 0x7fddf006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:09.303 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.315+0000 7fde09e00700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddf006d7f0 0x7fddf006fca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fde0c1158d0 tx=0x7fddf8009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:09.307 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.319+0000 7fde02a00700 1 -- 172.21.15.148:0/1923589189 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fddfc059950 con 0x7fde0c0724c0 2024-02-28T16:37:09.531 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.542+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde0c04bf40 con 0x7fddf006d7f0 2024-02-28T16:37:09.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.546+0000 7fde02a00700 1 -- 172.21.15.148:0/1923589189 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fde0c04bf40 con 0x7fddf006d7f0 2024-02-28T16:37:09.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddf006d7f0 msgr2=0x7fddf006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddf006d7f0 0x7fddf006fca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fde0c1158d0 tx=0x7fddf8009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c0724c0 msgr2=0x7fde0c11a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c0724c0 0x7fde0c11a030 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fddfc002a50 tx=0x7fddfc0046b0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 shutdown_connections 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fddf006d7f0 0x7fddf006fca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fde0c0724c0 0x7fde0c11a030 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 --2- 172.21.15.148:0/1923589189 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fde0c072dd0 0x7fde0c11a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 >> 172.21.15.148:0/1923589189 conn(0x7fde0c0face0 msgr2=0x7fde0c0fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 shutdown_connections 2024-02-28T16:37:09.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.549+0000 7fde11400700 1 -- 172.21.15.148:0/1923589189 wait complete. 2024-02-28T16:37:09.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 -- 172.21.15.148:0/435785068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f0102f50 msgr2=0x7f48f0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 --2- 172.21.15.148:0/435785068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f0102f50 0x7f48f0103320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48e0004940 tx=0x7f48e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:09.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 -- 172.21.15.148:0/435785068 shutdown_connections 2024-02-28T16:37:09.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 --2- 172.21.15.148:0/435785068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48f01038f0 0x7f48f00fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 --2- 172.21.15.148:0/435785068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f0102f50 0x7f48f0103320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 -- 172.21.15.148:0/435785068 >> 172.21.15.148:0/435785068 conn(0x7f48f00f8ae0 msgr2=0x7f48f00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:09.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 -- 172.21.15.148:0/435785068 shutdown_connections 2024-02-28T16:37:09.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.700+0000 7f48f6200700 1 -- 172.21.15.148:0/435785068 wait complete. 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.701+0000 7f48f6200700 1 Processor -- start 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.701+0000 7f48f6200700 1 -- start start 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.701+0000 7f48f6200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48f0102f50 0x7f48f0113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.701+0000 7f48f6200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f01038f0 0x7f48f0113f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.701+0000 7f48f6200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0114670 con 0x7f48f01038f0 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.701+0000 7f48f6200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f010d910 con 0x7f48f0102f50 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48eea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f01038f0 0x7f48f0113f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48eea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f01038f0 0x7f48f0113f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52788/0 (socket says 172.21.15.148:52788) 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48eea00700 1 -- 172.21.15.148:0/1913526640 learned_addr learned my addr 172.21.15.148:0/1913526640 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:09.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48ef400700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48f0102f50 0x7f48f0113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:09.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48eea00700 1 -- 172.21.15.148:0/1913526640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48f0102f50 msgr2=0x7f48f0113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.691 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48eea00700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48f0102f50 0x7f48f0113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48eea00700 1 -- 172.21.15.148:0/1913526640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0005040 con 0x7f48f01038f0 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.702+0000 7f48ef400700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48f0102f50 0x7f48f0113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.703+0000 7f48eea00700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f01038f0 0x7f48f0113f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00b790 tx=0x7f48dc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.703+0000 7f48e7400700 1 -- 172.21.15.148:0/1913526640 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48dc00f6f0 con 0x7f48f01038f0 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.703+0000 7f48e7400700 1 -- 172.21.15.148:0/1913526640 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48dc00fd20 con 0x7f48f01038f0 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.703+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f010dbf0 con 0x7f48f01038f0 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.703+0000 7f48e7400700 1 -- 172.21.15.148:0/1913526640 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48dc0103a0 con 0x7f48f01038f0 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.703+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f010e130 con 0x7f48f01038f0 2024-02-28T16:37:09.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.704+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f00fc6e0 con 0x7f48f01038f0 2024-02-28T16:37:09.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.705+0000 7f48e7400700 1 -- 172.21.15.148:0/1913526640 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f48dc011400 con 0x7f48f01038f0 2024-02-28T16:37:09.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.706+0000 7f48e7400700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f48d406d7f0 0x7f48d406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:09.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.706+0000 7f48e7400700 1 -- 172.21.15.148:0/1913526640 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f48dc08cce0 con 0x7f48f01038f0 2024-02-28T16:37:09.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.706+0000 7f48ef400700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f48d406d7f0 0x7f48d406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:09.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.707+0000 7f48ef400700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f48d406d7f0 0x7f48d406fca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b3b0 tx=0x7f48e0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:09.699 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.711+0000 7f48e7400700 1 -- 172.21.15.148:0/1913526640 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f48dc05a090 con 0x7f48f01038f0 2024-02-28T16:37:09.930 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.942+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f48f004bed0 con 0x7f48d406d7f0 2024-02-28T16:37:09.946 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.958+0000 7f48e7400700 1 -- 172.21.15.148:0/1913526640 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f48f004bed0 con 0x7f48d406d7f0 2024-02-28T16:37:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:37:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (7m) 111s ago 22m 14.1M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:37:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (3m) 111s ago 22m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:37:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (3m) 38s ago 21m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:37:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (6m) 111s ago 22m 73.8M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:37:09.946 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (14m) 111s ago 14m 15.0M - 17.2.7-535-gc0f02e60 1c37ed371348 bb1e6bf7ae81 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (14m) 111s ago 14m 145M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (14m) 38s ago 14m 15.4M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (14m) 38s ago 14m 15.2M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (9m) 111s ago 24m 504M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (8m) 38s ago 20m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (5m) 111s ago 24m 44.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (4m) 38s ago 20m 36.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (8m) 111s ago 22m 7780k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (8m) 38s ago 20m 7608k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (3m) 111s ago 19m 82.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (2m) 111s ago 18m 81.4M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (119s) 111s ago 18m 11.2M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (87s) 38s ago 17m 92.0M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:37:09.947 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (43s) 38s ago 17m 11.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 93c28b8b835a 2024-02-28T16:37:09.948 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (16m) 38s ago 16m 192M 2582M 17.2.7-535-gc0f02e60 1c37ed371348 1a50c5f2126e 2024-02-28T16:37:09.948 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (7m) 111s ago 21m 54.1M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:37:09.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f48d406d7f0 msgr2=0x7f48d406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f48d406d7f0 0x7f48d406fca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b3b0 tx=0x7f48e0009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:09.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f01038f0 msgr2=0x7f48f0113f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:09.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f01038f0 0x7f48f0113f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00b790 tx=0x7f48dc009220 comp rx=0 tx=0).stop 2024-02-28T16:37:09.949 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 shutdown_connections 2024-02-28T16:37:09.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f48d406d7f0 0x7f48d406fca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f48f0102f50 0x7f48f0113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 --2- 172.21.15.148:0/1913526640 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f48f01038f0 0x7f48f0113f90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:09.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 >> 172.21.15.148:0/1913526640 conn(0x7f48f00f8ae0 msgr2=0x7f48f00fa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:09.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 shutdown_connections 2024-02-28T16:37:09.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:09.961+0000 7f48f6200700 1 -- 172.21.15.148:0/1913526640 wait complete. 2024-02-28T16:37:09.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:09 smithi157 ceph-mon[89328]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-28T16:37:09.987 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:09 smithi157 podman[109099]: 2024-02-28 16:37:09.721047513 +0000 UTC m=+0.985463901 container remove f43c639ac480628cb0767318254b8f3bbf91afa37b1da48ba18e6350da472700 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True) 2024-02-28T16:37:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.100+0000 7f56aee00700 1 -- 172.21.15.148:0/3519860194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a8103dc0 msgr2=0x7f56a8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.100+0000 7f56aee00700 1 --2- 172.21.15.148:0/3519860194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a8103dc0 0x7f56a8104210 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5694004940 tx=0x7f5694009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:10.089 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:09 smithi148 ceph-mon[112463]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-28T16:37:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.100+0000 7f56aee00700 1 -- 172.21.15.148:0/3519860194 shutdown_connections 2024-02-28T16:37:10.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.100+0000 7f56aee00700 1 --2- 172.21.15.148:0/3519860194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a8103dc0 0x7f56a8104210 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.100+0000 7f56aee00700 1 --2- 172.21.15.148:0/3519860194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56a81095f0 0x7f56a81099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.100+0000 7f56aee00700 1 -- 172.21.15.148:0/3519860194 >> 172.21.15.148:0/3519860194 conn(0x7f56a8072d50 msgr2=0x7f56a8075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:10.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.101+0000 7f56aee00700 1 -- 172.21.15.148:0/3519860194 shutdown_connections 2024-02-28T16:37:10.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.101+0000 7f56aee00700 1 -- 172.21.15.148:0/3519860194 wait complete. 2024-02-28T16:37:10.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.101+0000 7f56aee00700 1 Processor -- start 2024-02-28T16:37:10.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56aee00700 1 -- start start 2024-02-28T16:37:10.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56aee00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56a8103dc0 0x7f56a811a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56aee00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a81095f0 0x7f56a811a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56aee00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a811abd0 con 0x7f56a81095f0 2024-02-28T16:37:10.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56aee00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8113ee0 con 0x7f56a8103dc0 2024-02-28T16:37:10.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56a7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a81095f0 0x7f56a811a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56a7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a81095f0 0x7f56a811a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52800/0 (socket says 172.21.15.148:52800) 2024-02-28T16:37:10.091 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.102+0000 7f56a7400700 1 -- 172.21.15.148:0/3033941150 learned_addr learned my addr 172.21.15.148:0/3033941150 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f56a7e00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56a8103dc0 0x7f56a811a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f56a7400700 1 -- 172.21.15.148:0/3033941150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56a8103dc0 msgr2=0x7f56a811a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f56a7400700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56a8103dc0 0x7f56a811a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f56a7400700 1 -- 172.21.15.148:0/3033941150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694005040 con 0x7f56a81095f0 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f56a7e00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56a8103dc0 0x7f56a811a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f56a7400700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a81095f0 0x7f56a811a580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5694009fd0 tx=0x7f5694009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f569fe00700 1 -- 172.21.15.148:0/3033941150 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f569400e040 con 0x7f56a81095f0 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f569fe00700 1 -- 172.21.15.148:0/3033941150 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f569400bbf0 con 0x7f56a81095f0 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f569fe00700 1 -- 172.21.15.148:0/3033941150 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f569401c3f0 con 0x7f56a81095f0 2024-02-28T16:37:10.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.103+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a8114160 con 0x7f56a81095f0 2024-02-28T16:37:10.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.104+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a81146a0 con 0x7f56a81095f0 2024-02-28T16:37:10.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.105+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a810b9c0 con 0x7f56a81095f0 2024-02-28T16:37:10.094 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.107+0000 7f569fe00700 1 -- 172.21.15.148:0/3033941150 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f569400bd60 con 0x7f56a81095f0 2024-02-28T16:37:10.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.108+0000 7f569fe00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f568c06d7f0 0x7f568c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.108+0000 7f569fe00700 1 -- 172.21.15.148:0/3033941150 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f569408e0b0 con 0x7f56a81095f0 2024-02-28T16:37:10.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.108+0000 7f56a7e00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f568c06d7f0 0x7f568c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.109+0000 7f56a7e00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f568c06d7f0 0x7f568c06fca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5698009fd0 tx=0x7f569800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:10.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.113+0000 7f569fe00700 1 -- 172.21.15.148:0/3033941150 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f569405b5a0 con 0x7f56a81095f0 2024-02-28T16:37:10.355 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 podman[109160]: 2024-02-28 16:37:09.978944063 +0000 UTC m=+0.036721148 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:37:10.355 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 podman[109160]: 2024-02-28 16:37:10.122227701 +0000 UTC m=+0.180004818 container create 860ae8452ebf625983fbe4efe3a15fbc1b163e0b60fcacc83938031eb1f00128 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222) 2024-02-28T16:37:10.355 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 podman[109160]: 2024-02-28 16:37:10.367066247 +0000 UTC m=+0.424843371 container init 860ae8452ebf625983fbe4efe3a15fbc1b163e0b60fcacc83938031eb1f00128 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-28T16:37:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.405+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56a804bed0 con 0x7f56a81095f0 2024-02-28T16:37:10.393 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.406+0000 7f569fe00700 1 -- 172.21.15.148:0/3033941150 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f569405b130 con 0x7f56a81095f0 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:10.394 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:37:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4 2024-02-28T16:37:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:37:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 4, 2024-02-28T16:37:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 9 2024-02-28T16:37:10.395 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:37:10.395 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:37:10.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f568c06d7f0 msgr2=0x7f568c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f568c06d7f0 0x7f568c06fca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5698009fd0 tx=0x7f569800b040 comp rx=0 tx=0).stop 2024-02-28T16:37:10.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a81095f0 msgr2=0x7f56a811a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a81095f0 0x7f56a811a580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5694009fd0 tx=0x7f5694009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:10.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 shutdown_connections 2024-02-28T16:37:10.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f568c06d7f0 0x7f568c06fca0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.397 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f56a8103dc0 0x7f56a811a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 --2- 172.21.15.148:0/3033941150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f56a81095f0 0x7f56a811a580 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 >> 172.21.15.148:0/3033941150 conn(0x7f56a8072d50 msgr2=0x7f56a8074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:10.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 shutdown_connections 2024-02-28T16:37:10.398 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.409+0000 7f56aee00700 1 -- 172.21.15.148:0/3033941150 wait complete. 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.554+0000 7f547b800700 1 -- 172.21.15.148:0/2054289623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474071f60 msgr2=0x7f5474070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.554+0000 7f547b800700 1 --2- 172.21.15.148:0/2054289623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474071f60 0x7f5474070330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5468004970 tx=0x7f5468009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.554+0000 7f547b800700 1 -- 172.21.15.148:0/2054289623 shutdown_connections 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.554+0000 7f547b800700 1 --2- 172.21.15.148:0/2054289623 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5474070870 0x7f5474070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.554+0000 7f547b800700 1 --2- 172.21.15.148:0/2054289623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474071f60 0x7f5474070330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.554+0000 7f547b800700 1 -- 172.21.15.148:0/2054289623 >> 172.21.15.148:0/2054289623 conn(0x7f54740f8ae0 msgr2=0x7f54740faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.555+0000 7f547b800700 1 -- 172.21.15.148:0/2054289623 shutdown_connections 2024-02-28T16:37:10.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.555+0000 7f547b800700 1 -- 172.21.15.148:0/2054289623 wait complete. 2024-02-28T16:37:10.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.556+0000 7f547b800700 1 Processor -- start 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.556+0000 7f547b800700 1 -- start start 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.556+0000 7f547b800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474070870 0x7f547411a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.556+0000 7f547b800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5474071f60 0x7f547411a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.556+0000 7f547b800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547411ac00 con 0x7f5474070870 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.556+0000 7f547b800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5474113f10 con 0x7f5474071f60 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5478e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474070870 0x7f547411a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5478e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474070870 0x7f547411a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52810/0 (socket says 172.21.15.148:52810) 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5478e00700 1 -- 172.21.15.148:0/4155802655 learned_addr learned my addr 172.21.15.148:0/4155802655 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:10.545 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5473e00700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5474071f60 0x7f547411a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5478e00700 1 -- 172.21.15.148:0/4155802655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5474071f60 msgr2=0x7f547411a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5478e00700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5474071f60 0x7f547411a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5478e00700 1 -- 172.21.15.148:0/4155802655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468005040 con 0x7f5474070870 2024-02-28T16:37:10.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.557+0000 7f5478e00700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474070870 0x7f547411a070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5468000c00 tx=0x7f5468009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:10.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.558+0000 7f5470c00700 1 -- 172.21.15.148:0/4155802655 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f546800e040 con 0x7f5474070870 2024-02-28T16:37:10.546 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.558+0000 7f5470c00700 1 -- 172.21.15.148:0/4155802655 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5468009af0 con 0x7f5474070870 2024-02-28T16:37:10.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.558+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5474114190 con 0x7f5474070870 2024-02-28T16:37:10.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.558+0000 7f5470c00700 1 -- 172.21.15.148:0/4155802655 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f546801c630 con 0x7f5474070870 2024-02-28T16:37:10.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.558+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54741146d0 con 0x7f5474070870 2024-02-28T16:37:10.547 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.559+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54740fe400 con 0x7f5474070870 2024-02-28T16:37:10.548 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.560+0000 7f5470c00700 1 -- 172.21.15.148:0/4155802655 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f546800bc10 con 0x7f5474070870 2024-02-28T16:37:10.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.561+0000 7f5470c00700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f545c06d7e0 0x7f545c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.561+0000 7f5470c00700 1 -- 172.21.15.148:0/4155802655 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f546808e1b0 con 0x7f5474070870 2024-02-28T16:37:10.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.561+0000 7f5473e00700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f545c06d7e0 0x7f545c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.549 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.562+0000 7f5473e00700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f545c06d7e0 0x7f545c06fc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5474115910 tx=0x7f546000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:10.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.566+0000 7f5470c00700 1 -- 172.21.15.148:0/4155802655 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f546805b560 con 0x7f5474070870 2024-02-28T16:37:10.736 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 podman[109160]: 2024-02-28 16:37:10.378036531 +0000 UTC m=+0.435813619 container start 860ae8452ebf625983fbe4efe3a15fbc1b163e0b60fcacc83938031eb1f00128 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-02-28T16:37:10.737 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-osd[109179]: -- 172.21.15.157:0/3317918376 <== mon.1 v2:172.21.15.157:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5638ea201680 con 0x5638ea1cac00 2024-02-28T16:37:10.737 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 bash[109160]: 860ae8452ebf625983fbe4efe3a15fbc1b163e0b60fcacc83938031eb1f00128 2024-02-28T16:37:10.737 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 systemd[1]: Started Ceph osd.5 for 004ac12e-d654-11ee-95c3-87774f69a715. 2024-02-28T16:37:10.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.828+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f547404bed0 con 0x7f5474070870 2024-02-28T16:37:10.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.829+0000 7f5470c00700 1 -- 172.21.15.148:0/4155802655 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f546805b0f0 con 0x7f5474070870 2024-02-28T16:37:10.817 INFO:teuthology.orchestra.run.smithi148.stdout:e14 2024-02-28T16:37:10.817 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:37:10.817 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:37:10.817 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:37:10.817 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:37:10.818 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:37:10.819 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:10.820 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:37:10.820 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:10.820 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:14496} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/143165648,v1:172.21.15.148:6827/143165648] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:37:10.820 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:37:10.820 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f545c06d7e0 msgr2=0x7f545c06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f545c06d7e0 0x7f545c06fc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5474115910 tx=0x7f546000b040 comp rx=0 tx=0).stop 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474070870 msgr2=0x7f547411a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474070870 0x7f547411a070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5468000c00 tx=0x7f5468009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 shutdown_connections 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f545c06d7e0 0x7f545c06fc90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5474070870 0x7f547411a070 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.831+0000 7f547b800700 1 --2- 172.21.15.148:0/4155802655 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5474071f60 0x7f547411a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.832+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 >> 172.21.15.148:0/4155802655 conn(0x7f54740f8ae0 msgr2=0x7f54740fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.832+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 shutdown_connections 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.832+0000 7f547b800700 1 -- 172.21.15.148:0/4155802655 wait complete. 2024-02-28T16:37:10.821 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 14 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.977+0000 7f133be00700 1 -- 172.21.15.148:0/1177309626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334102f50 msgr2=0x7f1334103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.977+0000 7f133be00700 1 --2- 172.21.15.148:0/1177309626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334102f50 0x7f1334103320 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1328004940 tx=0x7f1328009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.977+0000 7f133be00700 1 -- 172.21.15.148:0/1177309626 shutdown_connections 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.977+0000 7f133be00700 1 --2- 172.21.15.148:0/1177309626 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f13341038f0 0x7f13340fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.977+0000 7f133be00700 1 --2- 172.21.15.148:0/1177309626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1334102f50 0x7f1334103320 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.977+0000 7f133be00700 1 -- 172.21.15.148:0/1177309626 >> 172.21.15.148:0/1177309626 conn(0x7f13340f8ae0 msgr2=0x7f13340faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.978+0000 7f133be00700 1 -- 172.21.15.148:0/1177309626 shutdown_connections 2024-02-28T16:37:10.966 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.978+0000 7f133be00700 1 -- 172.21.15.148:0/1177309626 wait complete. 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.979+0000 7f133be00700 1 Processor -- start 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.979+0000 7f133be00700 1 -- start start 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.979+0000 7f133be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334102f50 0x7f1334070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.979+0000 7f133be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13341038f0 0x7f13340707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.979+0000 7f133be00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1334070dd0 con 0x7f13341038f0 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.979+0000 7f133be00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1334070f40 con 0x7f1334102f50 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.979+0000 7f1338a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13341038f0 0x7f13340707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1338a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13341038f0 0x7f13340707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52830/0 (socket says 172.21.15.148:52830) 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1338a00700 1 -- 172.21.15.148:0/1119781190 learned_addr learned my addr 172.21.15.148:0/1119781190 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1339400700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334102f50 0x7f1334070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1338a00700 1 -- 172.21.15.148:0/1119781190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334102f50 msgr2=0x7f1334070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1338a00700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334102f50 0x7f1334070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1338a00700 1 -- 172.21.15.148:0/1119781190 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328005040 con 0x7f13341038f0 2024-02-28T16:37:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1338a00700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13341038f0 0x7f13340707d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f132000eb40 tx=0x7f132000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1331600700 1 -- 172.21.15.148:0/1119781190 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1320007cc0 con 0x7f13341038f0 2024-02-28T16:37:10.969 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1334119c10 con 0x7f13341038f0 2024-02-28T16:37:10.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1331600700 1 -- 172.21.15.148:0/1119781190 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f132000f040 con 0x7f13341038f0 2024-02-28T16:37:10.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.980+0000 7f1331600700 1 -- 172.21.15.148:0/1119781190 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132000c9d0 con 0x7f13341038f0 2024-02-28T16:37:10.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.981+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133411a070 con 0x7f13341038f0 2024-02-28T16:37:10.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.982+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13340fc6e0 con 0x7f13341038f0 2024-02-28T16:37:10.970 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.982+0000 7f1331600700 1 -- 172.21.15.148:0/1119781190 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f132000cc40 con 0x7f13341038f0 2024-02-28T16:37:10.972 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.984+0000 7f1331600700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f131c06d7f0 0x7f131c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.984+0000 7f1331600700 1 -- 172.21.15.148:0/1119781190 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f132008c950 con 0x7f13341038f0 2024-02-28T16:37:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.984+0000 7f1339400700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f131c06d7f0 0x7f131c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:10.973 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.985+0000 7f1339400700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f131c06d7f0 0x7f131c06fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f132800b0d0 tx=0x7f1328009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:10.975 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:10.988+0000 7f1331600700 1 -- 172.21.15.148:0/1119781190 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1320056200 con 0x7f13341038f0 2024-02-28T16:37:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: pgmap v186: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:11.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3033941150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:11.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:11.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:11.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:10 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:11.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.224+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13340faac0 con 0x7f131c06d7f0 2024-02-28T16:37:11.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.226+0000 7f1331600700 1 -- 172.21.15.148:0/1119781190 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f13340faac0 con 0x7f131c06d7f0 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "crash" 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "11/21 daemons upgraded", 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T16:37:11.215 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:37:11.216 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:37:11.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f131c06d7f0 msgr2=0x7f131c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:11.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f131c06d7f0 0x7f131c06fca0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f132800b0d0 tx=0x7f1328009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:11.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13341038f0 msgr2=0x7f13340707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:11.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13341038f0 0x7f13340707d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f132000eb40 tx=0x7f132000b040 comp rx=0 tx=0).stop 2024-02-28T16:37:11.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 shutdown_connections 2024-02-28T16:37:11.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f131c06d7f0 0x7f131c06fca0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1334102f50 0x7f1334070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 --2- 172.21.15.148:0/1119781190 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f13341038f0 0x7f13340707d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 >> 172.21.15.148:0/1119781190 conn(0x7f13340f8ae0 msgr2=0x7f13340fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:11.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 shutdown_connections 2024-02-28T16:37:11.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.230+0000 7f133be00700 1 -- 172.21.15.148:0/1119781190 wait complete. 2024-02-28T16:37:11.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:37:10.945+0000 7fa183a9c7c0 -1 Falling back to public interface 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: pgmap v186: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3033941150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:11.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:10 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.376+0000 7fbe62800700 1 -- 172.21.15.148:0/900454755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 msgr2=0x7fbe5c105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.376+0000 7fbe62800700 1 --2- 172.21.15.148:0/900454755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c105540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c004940 tx=0x7fbe4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.377+0000 7fbe62800700 1 -- 172.21.15.148:0/900454755 shutdown_connections 2024-02-28T16:37:11.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.377+0000 7fbe62800700 1 --2- 172.21.15.148:0/900454755 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c105b10 0x7fbe5c0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.377+0000 7fbe62800700 1 --2- 172.21.15.148:0/900454755 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c105540 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.377+0000 7fbe62800700 1 -- 172.21.15.148:0/900454755 >> 172.21.15.148:0/900454755 conn(0x7fbe5c0face0 msgr2=0x7fbe5c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.377+0000 7fbe62800700 1 -- 172.21.15.148:0/900454755 shutdown_connections 2024-02-28T16:37:11.366 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.377+0000 7fbe62800700 1 -- 172.21.15.148:0/900454755 wait complete. 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe62800700 1 Processor -- start 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe62800700 1 -- start start 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe62800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe62800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c105b10 0x7fbe5c116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe62800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c116780 con 0x7fbe5c105170 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe62800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c10fad0 con 0x7fbe5c105b10 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe5b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe5b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:52846/0 (socket says 172.21.15.148:52846) 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe5b400700 1 -- 172.21.15.148:0/1016568958 learned_addr learned my addr 172.21.15.148:0/1016568958 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:11.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.378+0000 7fbe5aa00700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c105b10 0x7fbe5c116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe5b400700 1 -- 172.21.15.148:0/1016568958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c105b10 msgr2=0x7fbe5c116130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe5b400700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c105b10 0x7fbe5c116130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe5b400700 1 -- 172.21.15.148:0/1016568958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c005040 con 0x7fbe5c105170 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe5b400700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c115bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c000c00 tx=0x7fbe4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe53400700 1 -- 172.21.15.148:0/1016568958 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe4c021070 con 0x7fbe5c105170 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe53400700 1 -- 172.21.15.148:0/1016568958 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe4c013d00 con 0x7fbe5c105170 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe53400700 1 -- 172.21.15.148:0/1016568958 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe4c00e070 con 0x7fbe5c105170 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.379+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c10fd50 con 0x7fbe5c105170 2024-02-28T16:37:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.380+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c110230 con 0x7fbe5c105170 2024-02-28T16:37:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.381+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c0fe900 con 0x7fbe5c105170 2024-02-28T16:37:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.382+0000 7fbe53400700 1 -- 172.21.15.148:0/1016568958 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fbe4c01caf0 con 0x7fbe5c105170 2024-02-28T16:37:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.383+0000 7fbe53400700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fbe4006d7f0 0x7fbe4006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.383+0000 7fbe53400700 1 -- 172.21.15.148:0/1016568958 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fbe4c08e3a0 con 0x7fbe5c105170 2024-02-28T16:37:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.383+0000 7fbe5aa00700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fbe4006d7f0 0x7fbe4006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.383+0000 7fbe5aa00700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fbe4006d7f0 0x7fbe4006fca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c111490 tx=0x7fbe4800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:11.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.387+0000 7fbe53400700 1 -- 172.21.15.148:0/1016568958 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbe4c057c20 con 0x7fbe5c105170 2024-02-28T16:37:11.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.693+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbe5c111270 con 0x7fbe5c105170 2024-02-28T16:37:11.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.693+0000 7fbe53400700 1 -- 172.21.15.148:0/1016568958 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1424 (secure 0 0 0) 0x7fbe4c05b2e0 con 0x7fbe5c105170 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout: osd.5 (root=default,host=smithi157) is down 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-02-28T16:37:11.682 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-28T16:37:11.683 INFO:teuthology.orchestra.run.smithi148.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-02-28T16:37:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fbe4006d7f0 msgr2=0x7fbe4006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fbe4006d7f0 0x7fbe4006fca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c111490 tx=0x7fbe4800b040 comp rx=0 tx=0).stop 2024-02-28T16:37:11.684 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 msgr2=0x7fbe5c115bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c115bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c000c00 tx=0x7fbe4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 shutdown_connections 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fbe4006d7f0 0x7fbe4006fca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe5c105170 0x7fbe5c115bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 --2- 172.21.15.148:0/1016568958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbe5c105b10 0x7fbe5c116130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.696+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 >> 172.21.15.148:0/1016568958 conn(0x7fbe5c0face0 msgr2=0x7fbe5c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.697+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 shutdown_connections 2024-02-28T16:37:11.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:11.697+0000 7fbe62800700 1 -- 172.21.15.148:0/1016568958 wait complete. 2024-02-28T16:37:12.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:11 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4155802655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:37:12.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:11 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1016568958' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:37:12.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:11 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4155802655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:37:12.152 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:11 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1016568958' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:37:13.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:12 smithi157 ceph-mon[89328]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:13.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:12 smithi157 ceph-mon[89328]: pgmap v187: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:13.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:13.071 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:12 smithi148 ceph-mon[112463]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:12 smithi148 ceph-mon[112463]: pgmap v187: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:13 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:37:14.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:13 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 41/264 objects degraded (15.530%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T16:37:15.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:14 smithi148 ceph-mon[112463]: pgmap v188: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:15.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:14 smithi157 ceph-mon[89328]: pgmap v188: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:15.736 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:15 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:37:15.494+0000 7fa183a9c7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-28T16:37:16.205 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:15 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:37:15.804+0000 7fa183a9c7c0 -1 osd.5 74 log_to_monitors true 2024-02-28T16:37:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:16 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:16 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:16 smithi157 ceph-mon[89328]: pgmap v189: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:16 smithi157 ceph-mon[89328]: from='osd.5 [v2:172.21.15.157:6816/2009672957,v1:172.21.15.157:6817/2009672957]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:37:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:16 smithi157 ceph-mon[89328]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:37:16.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:16.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:16.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:16 smithi148 ceph-mon[112463]: pgmap v189: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:16.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:16 smithi148 ceph-mon[112463]: from='osd.5 [v2:172.21.15.157:6816/2009672957,v1:172.21.15.157:6817/2009672957]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:37:16.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:16 smithi148 ceph-mon[112463]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T16:37:17.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:37:17 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:37:17.176+0000 7fa16de00700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T16:37:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:17 smithi157 ceph-mon[89328]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:37:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:17 smithi157 ceph-mon[89328]: osdmap e77: 6 total, 5 up, 6 in 2024-02-28T16:37:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:17 smithi157 ceph-mon[89328]: from='osd.5 [v2:172.21.15.157:6816/2009672957,v1:172.21.15.157:6817/2009672957]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:37:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:17 smithi157 ceph-mon[89328]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:37:17.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:17 smithi157 ceph-mon[89328]: from='osd.5 ' entity='osd.5' 2024-02-28T16:37:17.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:17 smithi148 ceph-mon[112463]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T16:37:17.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:17 smithi148 ceph-mon[112463]: osdmap e77: 6 total, 5 up, 6 in 2024-02-28T16:37:17.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:17 smithi148 ceph-mon[112463]: from='osd.5 [v2:172.21.15.157:6816/2009672957,v1:172.21.15.157:6817/2009672957]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:37:17.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:17 smithi148 ceph-mon[112463]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi157", "root=default"]}]: dispatch 2024-02-28T16:37:17.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:17 smithi148 ceph-mon[112463]: from='osd.5 ' entity='osd.5' 2024-02-28T16:37:18.577 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:18.577 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:18.577 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:18 smithi157 ceph-mon[89328]: pgmap v191: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:18.577 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:18 smithi157 ceph-mon[89328]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:37:18.577 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:18 smithi157 ceph-mon[89328]: osd.5 [v2:172.21.15.157:6816/2009672957,v1:172.21.15.157:6817/2009672957] boot 2024-02-28T16:37:18.577 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:18 smithi157 ceph-mon[89328]: osdmap e78: 6 total, 6 up, 6 in 2024-02-28T16:37:18.577 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:37:18.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:18.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:18.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:18 smithi148 ceph-mon[112463]: pgmap v191: 65 pgs: 13 active+undersized+degraded, 15 active+undersized, 37 active+clean; 256 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 41/264 objects degraded (15.530%) 2024-02-28T16:37:18.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:18 smithi148 ceph-mon[112463]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T16:37:18.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:18 smithi148 ceph-mon[112463]: osd.5 [v2:172.21.15.157:6816/2009672957,v1:172.21.15.157:6817/2009672957] boot 2024-02-28T16:37:18.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:18 smithi148 ceph-mon[112463]: osdmap e78: 6 total, 6 up, 6 in 2024-02-28T16:37:18.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T16:37:20.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:20 smithi148 ceph-mon[112463]: osdmap e79: 6 total, 6 up, 6 in 2024-02-28T16:37:20.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:20 smithi148 ceph-mon[112463]: pgmap v194: 65 pgs: 2 peering, 10 active+undersized+degraded, 13 active+undersized, 40 active+clean; 256 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%) 2024-02-28T16:37:20.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:20 smithi157 ceph-mon[89328]: osdmap e79: 6 total, 6 up, 6 in 2024-02-28T16:37:20.393 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:20 smithi157 ceph-mon[89328]: pgmap v194: 65 pgs: 2 peering, 10 active+undersized+degraded, 13 active+undersized, 40 active+clean; 256 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 35/264 objects degraded (13.258%) 2024-02-28T16:37:21.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:21 smithi157 ceph-mon[89328]: Health check update: Degraded data redundancy: 35/264 objects degraded (13.258%), 10 pgs degraded (PG_DEGRADED) 2024-02-28T16:37:21.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:21 smithi148 ceph-mon[112463]: Health check update: Degraded data redundancy: 35/264 objects degraded (13.258%), 10 pgs degraded (PG_DEGRADED) 2024-02-28T16:37:22.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:22 smithi157 ceph-mon[89328]: pgmap v195: 65 pgs: 2 peering, 1 active+undersized+degraded, 2 active+undersized, 60 active+clean; 256 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 3/264 objects degraded (1.136%) 2024-02-28T16:37:22.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:22 smithi148 ceph-mon[112463]: pgmap v195: 65 pgs: 2 peering, 1 active+undersized+degraded, 2 active+undersized, 60 active+clean; 256 MiB data, 974 MiB used, 535 GiB / 536 GiB avail; 3/264 objects degraded (1.136%) 2024-02-28T16:37:24.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:24.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:37:24.740 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: pgmap v196: 65 pgs: 2 peering, 63 active+clean; 256 MiB data, 974 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all osd 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T16:37:24.741 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T16:37:24.742 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T16:37:24.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:24.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:37:24.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: pgmap v196: 65 pgs: 2 peering, 63 active+clean; 256 MiB data, 974 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all osd 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T16:37:24.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T16:37:24.876 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T16:37:25.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:25 smithi157 ceph-mon[89328]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/264 objects degraded (1.136%), 1 pg degraded) 2024-02-28T16:37:25.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:25 smithi157 ceph-mon[89328]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T16:37:25.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:25 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T16:37:25.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:25 smithi157 ceph-mon[89328]: osdmap e80: 6 total, 6 up, 6 in 2024-02-28T16:37:25.784 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:25 smithi148 ceph-mon[112463]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/264 objects degraded (1.136%), 1 pg degraded) 2024-02-28T16:37:25.785 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:25 smithi148 ceph-mon[112463]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T16:37:25.785 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:25 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T16:37:25.785 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:25 smithi148 ceph-mon[112463]: osdmap e80: 6 total, 6 up, 6 in 2024-02-28T16:37:26.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:26 smithi157 ceph-mon[89328]: pgmap v198: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:26.795 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:26 smithi148 ceph-mon[112463]: pgmap v198: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:28.611 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: Upgrade: Updating mds.cephfs.smithi148.mgdxsi 2024-02-28T16:37:28.612 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:28.612 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:37:28.612 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:28.612 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: Deploying daemon mds.cephfs.smithi148.mgdxsi on smithi148 2024-02-28T16:37:28.612 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:28.612 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:28.612 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:28 smithi148 ceph-mon[112463]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:28.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: Upgrade: Updating mds.cephfs.smithi148.mgdxsi 2024-02-28T16:37:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.mgdxsi", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:37:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: Deploying daemon mds.cephfs.smithi148.mgdxsi on smithi148 2024-02-28T16:37:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:28.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:28 smithi157 ceph-mon[89328]: pgmap v199: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:31.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:30 smithi148 ceph-mon[112463]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:31.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:30 smithi157 ceph-mon[89328]: pgmap v200: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:32.072 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:31 smithi148 ceph-mon[112463]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T16:37:32.072 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:31 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 2 up:standby 2024-02-28T16:37:32.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:31 smithi157 ceph-mon[89328]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T16:37:32.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:31 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 2 up:standby 2024-02-28T16:37:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:32 smithi148 ceph-mon[112463]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:32 smithi157 ceph-mon[89328]: pgmap v202: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:34.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:33 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:34.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:33 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:34 smithi148 ceph-mon[112463]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:34 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:34 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:34 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:34 smithi157 ceph-mon[89328]: pgmap v203: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:34 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:34 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:34 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:36.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:36 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:boot 2024-02-28T16:37:36.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:36 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:37:36.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:36 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:37:36.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:36 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:36.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:36 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:36.374 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:36 smithi148 ceph-mon[112463]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:36.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:36 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:boot 2024-02-28T16:37:36.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:36 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi148.nqnotw=up:active} 3 up:standby 2024-02-28T16:37:36.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:36 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:37:36.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:36 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:36.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:36 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:36.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:36 smithi157 ceph-mon[89328]: pgmap v204: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:38 smithi148 ceph-mon[112463]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:39.192 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:38 smithi157 ceph-mon[89328]: pgmap v205: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:40.874 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:40 smithi157 ceph-mon[89328]: pgmap v206: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:40 smithi148 ceph-mon[112463]: pgmap v206: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 -- 172.21.15.148:0/2635402277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070330 msgr2=0x7f76cc070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 --2- 172.21.15.148:0/2635402277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070330 0x7f76cc070700 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76bc004970 tx=0x7f76bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 -- 172.21.15.148:0/2635402277 shutdown_connections 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 --2- 172.21.15.148:0/2635402277 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc070c40 0x7f76cc109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 --2- 172.21.15.148:0/2635402277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070330 0x7f76cc070700 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 -- 172.21.15.148:0/2635402277 >> 172.21.15.148:0/2635402277 conn(0x7f76cc0f8ae0 msgr2=0x7f76cc0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 -- 172.21.15.148:0/2635402277 shutdown_connections 2024-02-28T16:37:41.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.860+0000 7f76d0c00700 1 -- 172.21.15.148:0/2635402277 wait complete. 2024-02-28T16:37:41.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.861+0000 7f76d0c00700 1 Processor -- start 2024-02-28T16:37:41.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.861+0000 7f76d0c00700 1 -- start start 2024-02-28T16:37:41.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.861+0000 7f76d0c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc070330 0x7f76cc115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:41.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.861+0000 7f76d0c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070c40 0x7f76cc116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:41.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.861+0000 7f76d0c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1167b0 con 0x7f76cc070c40 2024-02-28T16:37:41.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.861+0000 7f76d0c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc10fae0 con 0x7f76cc070330 2024-02-28T16:37:41.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.862+0000 7f76c9400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070c40 0x7f76cc116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:41.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.862+0000 7f76c9400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070c40 0x7f76cc116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:55810/0 (socket says 172.21.15.148:55810) 2024-02-28T16:37:41.851 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.862+0000 7f76c9400700 1 -- 172.21.15.148:0/723427013 learned_addr learned my addr 172.21.15.148:0/723427013 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.862+0000 7f76c9e00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc070330 0x7f76cc115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.862+0000 7f76c9400700 1 -- 172.21.15.148:0/723427013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc070330 msgr2=0x7f76cc115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.862+0000 7f76c9400700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc070330 0x7f76cc115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.862+0000 7f76c9400700 1 -- 172.21.15.148:0/723427013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc005040 con 0x7f76cc070c40 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.863+0000 7f76c9400700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070c40 0x7f76cc116160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c830 tx=0x7f76b8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.863+0000 7f76c2000700 1 -- 172.21.15.148:0/723427013 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b800a760 con 0x7f76cc070c40 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.863+0000 7f76c2000700 1 -- 172.21.15.148:0/723427013 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76b800ad90 con 0x7f76cc070c40 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.863+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc10fdc0 con 0x7f76cc070c40 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.863+0000 7f76c2000700 1 -- 172.21.15.148:0/723427013 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b80113a0 con 0x7f76cc070c40 2024-02-28T16:37:41.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.863+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc110300 con 0x7f76cc070c40 2024-02-28T16:37:41.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.864+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc106920 con 0x7f76cc070c40 2024-02-28T16:37:41.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.865+0000 7f76c2000700 1 -- 172.21.15.148:0/723427013 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f76b8012400 con 0x7f76cc070c40 2024-02-28T16:37:41.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.867+0000 7f76c2000700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f76b006d7f0 0x7f76b006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:41.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.867+0000 7f76c2000700 1 -- 172.21.15.148:0/723427013 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f76b808cf50 con 0x7f76cc070c40 2024-02-28T16:37:41.855 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.867+0000 7f76c9e00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f76b006d7f0 0x7f76b006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:41.856 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.868+0000 7f76c9e00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f76b006d7f0 0x7f76b006fca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009fd0 tx=0x7f76bc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:41.860 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:41.873+0000 7f76c2000700 1 -- 172.21.15.148:0/723427013 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f76b805a300 con 0x7f76cc070c40 2024-02-28T16:37:42.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.109+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76cc10c240 con 0x7f76b006d7f0 2024-02-28T16:37:42.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.111+0000 7f76c2000700 1 -- 172.21.15.148:0/723427013 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f76cc10c240 con 0x7f76b006d7f0 2024-02-28T16:37:42.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f76b006d7f0 msgr2=0x7f76b006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.101 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f76b006d7f0 0x7f76b006fca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009fd0 tx=0x7f76bc009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070c40 msgr2=0x7f76cc116160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070c40 0x7f76cc116160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c830 tx=0x7f76b8004470 comp rx=0 tx=0).stop 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 shutdown_connections 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f76b006d7f0 0x7f76b006fca0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f76cc070330 0x7f76cc115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 --2- 172.21.15.148:0/723427013 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76cc070c40 0x7f76cc116160 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.113+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 >> 172.21.15.148:0/723427013 conn(0x7f76cc0f8ae0 msgr2=0x7f76cc103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.114+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 shutdown_connections 2024-02-28T16:37:42.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.114+0000 7f76d0c00700 1 -- 172.21.15.148:0/723427013 wait complete. 2024-02-28T16:37:42.116 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.263+0000 7fc824800700 1 -- 172.21.15.148:0/2944881966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c102f50 msgr2=0x7fc81c103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.263+0000 7fc824800700 1 --2- 172.21.15.148:0/2944881966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c102f50 0x7fc81c103320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc810004940 tx=0x7fc810009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.263+0000 7fc824800700 1 -- 172.21.15.148:0/2944881966 shutdown_connections 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.263+0000 7fc824800700 1 --2- 172.21.15.148:0/2944881966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc81c1038f0 0x7fc81c0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.263+0000 7fc824800700 1 --2- 172.21.15.148:0/2944881966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c102f50 0x7fc81c103320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.263+0000 7fc824800700 1 -- 172.21.15.148:0/2944881966 >> 172.21.15.148:0/2944881966 conn(0x7fc81c0f8ae0 msgr2=0x7fc81c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.263+0000 7fc824800700 1 -- 172.21.15.148:0/2944881966 shutdown_connections 2024-02-28T16:37:42.252 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.264+0000 7fc824800700 1 -- 172.21.15.148:0/2944881966 wait complete. 2024-02-28T16:37:42.253 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.264+0000 7fc824800700 1 Processor -- start 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.264+0000 7fc824800700 1 -- start start 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc824800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc81c102f50 0x7fc81c115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc824800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c1038f0 0x7fc81c116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc824800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c116810 con 0x7fc81c1038f0 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc824800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c10fad0 con 0x7fc81c102f50 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc821400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c1038f0 0x7fc81c116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc821400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c1038f0 0x7fc81c116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58766/0 (socket says 172.21.15.148:58766) 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc821400700 1 -- 172.21.15.148:0/2554903536 learned_addr learned my addr 172.21.15.148:0/2554903536 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.265+0000 7fc821e00700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc81c102f50 0x7fc81c115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc821400700 1 -- 172.21.15.148:0/2554903536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc81c102f50 msgr2=0x7fc81c115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc821400700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc81c102f50 0x7fc81c115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc821400700 1 -- 172.21.15.148:0/2554903536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810005040 con 0x7fc81c1038f0 2024-02-28T16:37:42.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc821400700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c1038f0 0x7fc81c116130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00b790 tx=0x7fc80c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:42.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc816000700 1 -- 172.21.15.148:0/2554903536 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc80c00f6f0 con 0x7fc81c1038f0 2024-02-28T16:37:42.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc816000700 1 -- 172.21.15.148:0/2554903536 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc80c00fd20 con 0x7fc81c1038f0 2024-02-28T16:37:42.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c10fdb0 con 0x7fc81c1038f0 2024-02-28T16:37:42.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.266+0000 7fc816000700 1 -- 172.21.15.148:0/2554903536 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc80c0103a0 con 0x7fc81c1038f0 2024-02-28T16:37:42.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.267+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c1102f0 con 0x7fc81c1038f0 2024-02-28T16:37:42.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.268+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c0fc6e0 con 0x7fc81c1038f0 2024-02-28T16:37:42.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.269+0000 7fc816000700 1 -- 172.21.15.148:0/2554903536 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc80c011400 con 0x7fc81c1038f0 2024-02-28T16:37:42.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.270+0000 7fc816000700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc80406d7e0 0x7fc80406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.270+0000 7fc816000700 1 -- 172.21.15.148:0/2554903536 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc80c08ccd0 con 0x7fc81c1038f0 2024-02-28T16:37:42.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.270+0000 7fc821e00700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc80406d7e0 0x7fc80406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.271+0000 7fc821e00700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc80406d7e0 0x7fc80406fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc810004f90 tx=0x7fc810009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:42.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.275+0000 7fc816000700 1 -- 172.21.15.148:0/2554903536 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc80c056550 con 0x7fc81c1038f0 2024-02-28T16:37:42.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.530+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc81c1111d0 con 0x7fc80406d7e0 2024-02-28T16:37:42.519 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.532+0000 7fc816000700 1 -- 172.21.15.148:0/2554903536 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc81c1111d0 con 0x7fc80406d7e0 2024-02-28T16:37:42.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc80406d7e0 msgr2=0x7fc80406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc80406d7e0 0x7fc80406fc90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc810004f90 tx=0x7fc810009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:42.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c1038f0 msgr2=0x7fc81c116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c1038f0 0x7fc81c116130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00b790 tx=0x7fc80c009220 comp rx=0 tx=0).stop 2024-02-28T16:37:42.522 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 shutdown_connections 2024-02-28T16:37:42.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc80406d7e0 0x7fc80406fc90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc81c102f50 0x7fc81c115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 --2- 172.21.15.148:0/2554903536 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc81c1038f0 0x7fc81c116130 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 >> 172.21.15.148:0/2554903536 conn(0x7fc81c0f8ae0 msgr2=0x7fc81c0fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:42.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 shutdown_connections 2024-02-28T16:37:42.523 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.534+0000 7fc824800700 1 -- 172.21.15.148:0/2554903536 wait complete. 2024-02-28T16:37:42.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 -- 172.21.15.148:0/2650261440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5641038f0 msgr2=0x7fe5640fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 --2- 172.21.15.148:0/2650261440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5641038f0 0x7fe5640fcf60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe550004940 tx=0x7fe550009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:42.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 -- 172.21.15.148:0/2650261440 shutdown_connections 2024-02-28T16:37:42.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 --2- 172.21.15.148:0/2650261440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe5641038f0 0x7fe5640fcf60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 --2- 172.21.15.148:0/2650261440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe564102f50 0x7fe564103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 -- 172.21.15.148:0/2650261440 >> 172.21.15.148:0/2650261440 conn(0x7fe5640f8ae0 msgr2=0x7fe5640faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:42.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 -- 172.21.15.148:0/2650261440 shutdown_connections 2024-02-28T16:37:42.666 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.677+0000 7fe56a600700 1 -- 172.21.15.148:0/2650261440 wait complete. 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.678+0000 7fe56a600700 1 Processor -- start 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.678+0000 7fe56a600700 1 -- start start 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.678+0000 7fe56a600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe564102f50 0x7fe564115cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.678+0000 7fe56a600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5641038f0 0x7fe5641161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.678+0000 7fe56a600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641168d0 con 0x7fe564102f50 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.678+0000 7fe56a600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56410fb50 con 0x7fe5641038f0 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe563400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe564102f50 0x7fe564115cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe563400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe564102f50 0x7fe564115cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58784/0 (socket says 172.21.15.148:58784) 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe563400700 1 -- 172.21.15.148:0/3781852015 learned_addr learned my addr 172.21.15.148:0/3781852015 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe562a00700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5641038f0 0x7fe5641161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe563400700 1 -- 172.21.15.148:0/3781852015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5641038f0 msgr2=0x7fe5641161f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.667 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe563400700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5641038f0 0x7fe5641161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe563400700 1 -- 172.21.15.148:0/3781852015 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550005040 con 0x7fe564102f50 2024-02-28T16:37:42.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.679+0000 7fe563400700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe564102f50 0x7fe564115cb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b790 tx=0x7fe554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:42.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.680+0000 7fe55b400700 1 -- 172.21.15.148:0/3781852015 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55400f770 con 0x7fe564102f50 2024-02-28T16:37:42.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.680+0000 7fe55b400700 1 -- 172.21.15.148:0/3781852015 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe55400fda0 con 0x7fe564102f50 2024-02-28T16:37:42.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.680+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56410fdd0 con 0x7fe564102f50 2024-02-28T16:37:42.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.680+0000 7fe55b400700 1 -- 172.21.15.148:0/3781852015 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55400d310 con 0x7fe564102f50 2024-02-28T16:37:42.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.680+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe564110310 con 0x7fe564102f50 2024-02-28T16:37:42.669 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.681+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5640fc6e0 con 0x7fe564102f50 2024-02-28T16:37:42.670 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.682+0000 7fe55b400700 1 -- 172.21.15.148:0/3781852015 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe554010420 con 0x7fe564102f50 2024-02-28T16:37:42.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.683+0000 7fe55b400700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe54806d7e0 0x7fe54806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:42.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.683+0000 7fe55b400700 1 -- 172.21.15.148:0/3781852015 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe55408cf60 con 0x7fe564102f50 2024-02-28T16:37:42.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.683+0000 7fe562a00700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe54806d7e0 0x7fe54806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:42.671 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.684+0000 7fe562a00700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe54806d7e0 0x7fe54806fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe550004f90 tx=0x7fe550009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:42.676 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.688+0000 7fe55b400700 1 -- 172.21.15.148:0/3781852015 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe55405a310 con 0x7fe564102f50 2024-02-28T16:37:42.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.912+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe564110590 con 0x7fe54806d7e0 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.932+0000 7fe55b400700 1 -- 172.21.15.148:0/3781852015 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fe564110590 con 0x7fe54806d7e0 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (7m) 0s ago 23m 15.0M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (4m) 0s ago 23m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (4m) 27s ago 21m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (7m) 0s ago 22m 75.0M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (8s) 0s ago 15m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 4d24e66401b9 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (15m) 0s ago 15m 144M - 17.2.7-535-gc0f02e60 1c37ed371348 bf5c7325f0ed 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (15m) 27s ago 15m 15.6M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:37:42.921 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (15m) 27s ago 15m 15.4M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (10m) 0s ago 24m 508M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (9m) 27s ago 21m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (5m) 0s ago 25m 52.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (5m) 27s ago 21m 36.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (8m) 0s ago 23m 7940k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (8m) 27s ago 21m 7972k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (3m) 0s ago 20m 86.5M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (3m) 0s ago 19m 84.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (2m) 0s ago 18m 83.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (2m) 27s ago 18m 92.7M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (76s) 27s ago 17m 84.7M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 93c28b8b835a 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (32s) 27s ago 17m 11.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 860ae8452ebf 2024-02-28T16:37:42.922 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (8m) 0s ago 22m 55.1M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:37:42.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe54806d7e0 msgr2=0x7fe54806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe54806d7e0 0x7fe54806fc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe550004f90 tx=0x7fe550009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:42.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe564102f50 msgr2=0x7fe564115cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:42.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe564102f50 0x7fe564115cb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b790 tx=0x7fe554009250 comp rx=0 tx=0).stop 2024-02-28T16:37:42.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 shutdown_connections 2024-02-28T16:37:42.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fe54806d7e0 0x7fe54806fc90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe564102f50 0x7fe564115cb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 --2- 172.21.15.148:0/3781852015 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe5641038f0 0x7fe5641161f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:42.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.935+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 >> 172.21.15.148:0/3781852015 conn(0x7fe5640f8ae0 msgr2=0x7fe5640fa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:42.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.936+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 shutdown_connections 2024-02-28T16:37:42.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:42.936+0000 7fe56a600700 1 -- 172.21.15.148:0/3781852015 wait complete. 2024-02-28T16:37:43.063 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:42 smithi148 ceph-mon[112463]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:43.064 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:43.064 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:43.064 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 -- 172.21.15.148:0/932012772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 msgr2=0x7fa8080fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 --2- 172.21.15.148:0/932012772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa8080fcf60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4004940 tx=0x7fa7f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 -- 172.21.15.148:0/932012772 shutdown_connections 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 --2- 172.21.15.148:0/932012772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa8080fcf60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 --2- 172.21.15.148:0/932012772 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808102f50 0x7fa808103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 -- 172.21.15.148:0/932012772 >> 172.21.15.148:0/932012772 conn(0x7fa8080f8ae0 msgr2=0x7fa8080faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 -- 172.21.15.148:0/932012772 shutdown_connections 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.075+0000 7fa80e200700 1 -- 172.21.15.148:0/932012772 wait complete. 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.076+0000 7fa80e200700 1 Processor -- start 2024-02-28T16:37:43.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.076+0000 7fa80e200700 1 -- start start 2024-02-28T16:37:43.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa80e200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808102f50 0x7fa808115cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa80e200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa808116210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa80e200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8081168f0 con 0x7fa8081038f0 2024-02-28T16:37:43.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa80e200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80810fb70 con 0x7fa808102f50 2024-02-28T16:37:43.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa806a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa808116210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa806a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa808116210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58804/0 (socket says 172.21.15.148:58804) 2024-02-28T16:37:43.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa806a00700 1 -- 172.21.15.148:0/3457728018 learned_addr learned my addr 172.21.15.148:0/3457728018 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa807400700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808102f50 0x7fa808115cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.077+0000 7fa806a00700 1 -- 172.21.15.148:0/3457728018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808102f50 msgr2=0x7fa808115cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa806a00700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808102f50 0x7fa808115cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa806a00700 1 -- 172.21.15.148:0/3457728018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f4005040 con 0x7fa8081038f0 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa807400700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808102f50 0x7fa808115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa806a00700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa808116210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009030 tx=0x7fa7f4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa7ff400700 1 -- 172.21.15.148:0/3457728018 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f400e040 con 0x7fa8081038f0 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa7ff400700 1 -- 172.21.15.148:0/3457728018 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7f400bbf0 con 0x7fa8081038f0 2024-02-28T16:37:43.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa7ff400700 1 -- 172.21.15.148:0/3457728018 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7f401c630 con 0x7fa8081038f0 2024-02-28T16:37:43.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80810fd90 con 0x7fa8081038f0 2024-02-28T16:37:43.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.078+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8081102d0 con 0x7fa8081038f0 2024-02-28T16:37:43.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.080+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8080fc6e0 con 0x7fa8081038f0 2024-02-28T16:37:43.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.082+0000 7fa7ff400700 1 -- 172.21.15.148:0/3457728018 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa7f400bd60 con 0x7fa8081038f0 2024-02-28T16:37:43.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.083+0000 7fa7ff400700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa7ec06d7f0 0x7fa7ec06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.083+0000 7fa7ff400700 1 -- 172.21.15.148:0/3457728018 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa7f408de90 con 0x7fa8081038f0 2024-02-28T16:37:43.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.083+0000 7fa807400700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa7ec06d7f0 0x7fa7ec06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.084+0000 7fa807400700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa7ec06d7f0 0x7fa7ec06fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8006fd0 tx=0x7fa7f8008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.075 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.088+0000 7fa7ff400700 1 -- 172.21.15.148:0/3457728018 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa7f405b380 con 0x7fa8081038f0 2024-02-28T16:37:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:42 smithi157 ceph-mon[89328]: pgmap v207: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:43.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.412+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa808111350 con 0x7fa8081038f0 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.413+0000 7fa7ff400700 1 -- 172.21.15.148:0/3457728018 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7fa7f405af10 con 0x7fa8081038f0 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:43.401 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 3, 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 3, 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 11 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:37:43.402 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa7ec06d7f0 msgr2=0x7fa7ec06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa7ec06d7f0 0x7fa7ec06fca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8006fd0 tx=0x7fa7f8008040 comp rx=0 tx=0).stop 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 msgr2=0x7fa808116210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa808116210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009030 tx=0x7fa7f4009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 shutdown_connections 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa7ec06d7f0 0x7fa7ec06fca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa808102f50 0x7fa808115cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 --2- 172.21.15.148:0/3457728018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8081038f0 0x7fa808116210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 >> 172.21.15.148:0/3457728018 conn(0x7fa8080f8ae0 msgr2=0x7fa8080fa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 shutdown_connections 2024-02-28T16:37:43.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.416+0000 7fa80e200700 1 -- 172.21.15.148:0/3457728018 wait complete. 2024-02-28T16:37:43.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 -- 172.21.15.148:0/4254925315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 msgr2=0x7f1580105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 --2- 172.21.15.148:0/4254925315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580105530 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1570004940 tx=0x7f1570009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:43.552 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 -- 172.21.15.148:0/4254925315 shutdown_connections 2024-02-28T16:37:43.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 --2- 172.21.15.148:0/4254925315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1580105b00 0x7f15800ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 --2- 172.21.15.148:0/4254925315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580105530 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 -- 172.21.15.148:0/4254925315 >> 172.21.15.148:0/4254925315 conn(0x7f15800fad30 msgr2=0x7f15800fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 -- 172.21.15.148:0/4254925315 shutdown_connections 2024-02-28T16:37:43.553 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.564+0000 7f1587200700 1 -- 172.21.15.148:0/4254925315 wait complete. 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.565+0000 7f1587200700 1 Processor -- start 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.565+0000 7f1587200700 1 -- start start 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f1587200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f1587200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1580105b00 0x7f15801161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f1587200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15801167f0 con 0x7f1580105160 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f1587200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158010fb40 con 0x7f1580105b00 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f157fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f157fe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580115c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58822/0 (socket says 172.21.15.148:58822) 2024-02-28T16:37:43.554 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f157fe00700 1 -- 172.21.15.148:0/3197848780 learned_addr learned my addr 172.21.15.148:0/3197848780 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f157fe00700 1 -- 172.21.15.148:0/3197848780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1580105b00 msgr2=0x7f15801161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f157fe00700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1580105b00 0x7f15801161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.566+0000 7f157fe00700 1 -- 172.21.15.148:0/3197848780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1570005040 con 0x7f1580105160 2024-02-28T16:37:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.567+0000 7f157fe00700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580115c60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1570009150 tx=0x7f1570009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.567+0000 7f1577e00700 1 -- 172.21.15.148:0/3197848780 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157000e040 con 0x7f1580105160 2024-02-28T16:37:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.567+0000 7f1577e00700 1 -- 172.21.15.148:0/3197848780 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f157000bbf0 con 0x7f1580105160 2024-02-28T16:37:43.555 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.567+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158010fdc0 con 0x7f1580105160 2024-02-28T16:37:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.567+0000 7f1577e00700 1 -- 172.21.15.148:0/3197848780 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f157001c630 con 0x7f1580105160 2024-02-28T16:37:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.567+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1580110300 con 0x7f1580105160 2024-02-28T16:37:43.556 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.568+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1580102470 con 0x7f1580105160 2024-02-28T16:37:43.557 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.569+0000 7f1577e00700 1 -- 172.21.15.148:0/3197848780 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f157000bd60 con 0x7f1580105160 2024-02-28T16:37:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.570+0000 7f1577e00700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f156406d7f0 0x7f156406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.570+0000 7f1577e00700 1 -- 172.21.15.148:0/3197848780 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f157008e240 con 0x7f1580105160 2024-02-28T16:37:43.558 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.570+0000 7f157f400700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f156406d7f0 0x7f156406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.559 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.571+0000 7f157f400700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f156406d7f0 0x7f156406fca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1580111540 tx=0x7f156c007d40 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.563 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.575+0000 7f1577e00700 1 -- 172.21.15.148:0/3197848780 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1570057b40 con 0x7f1580105160 2024-02-28T16:37:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.845+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f158004bf00 con 0x7f1580105160 2024-02-28T16:37:43.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.846+0000 7f1577e00700 1 -- 172.21.15.148:0/3197848780 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f157005b200 con 0x7f1580105160 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:e16 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 14 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:37:43.834 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:22:46.964332+0000 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 46 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=14484} 2024-02-28T16:37:43.835 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{0:14484} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.148:6828/2703268165,v1:172.21.15.148:6829/2703268165] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:37:43.836 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:37:43.837 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:24253} state up:standby seq 4 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:37:43.837 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:37:43.837 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:37:43.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f156406d7f0 msgr2=0x7f156406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f156406d7f0 0x7f156406fca0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1580111540 tx=0x7f156c007d40 comp rx=0 tx=0).stop 2024-02-28T16:37:43.838 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 msgr2=0x7f1580115c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580115c60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1570009150 tx=0x7f1570009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 shutdown_connections 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f156406d7f0 0x7f156406fca0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1580105160 0x7f1580115c60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 --2- 172.21.15.148:0/3197848780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1580105b00 0x7f15801161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.850+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 >> 172.21.15.148:0/3197848780 conn(0x7f15800fad30 msgr2=0x7f15800fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.851+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 shutdown_connections 2024-02-28T16:37:43.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.851+0000 7f1587200700 1 -- 172.21.15.148:0/3197848780 wait complete. 2024-02-28T16:37:43.840 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 16 2024-02-28T16:37:43.985 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.997+0000 7f55aca00700 1 -- 172.21.15.148:0/1492329578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 msgr2=0x7f55a8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.997+0000 7f55aca00700 1 --2- 172.21.15.148:0/1492329578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8103110 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5598004940 tx=0x7f5598009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.997+0000 7f55aca00700 1 -- 172.21.15.148:0/1492329578 shutdown_connections 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.997+0000 7f55aca00700 1 --2- 172.21.15.148:0/1492329578 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a81036e0 0x7f55a80fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.997+0000 7f55aca00700 1 --2- 172.21.15.148:0/1492329578 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8103110 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.997+0000 7f55aca00700 1 -- 172.21.15.148:0/1492329578 >> 172.21.15.148:0/1492329578 conn(0x7f55a80f88b0 msgr2=0x7f55a80facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.997+0000 7f55aca00700 1 -- 172.21.15.148:0/1492329578 shutdown_connections 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.998+0000 7f55aca00700 1 -- 172.21.15.148:0/1492329578 wait complete. 2024-02-28T16:37:43.986 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.998+0000 7f55aca00700 1 Processor -- start 2024-02-28T16:37:43.987 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.999+0000 7f55aca00700 1 -- start start 2024-02-28T16:37:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.999+0000 7f55aca00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.999+0000 7f55aca00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a81036e0 0x7f55a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.999+0000 7f55aca00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8070dd0 con 0x7f55a8102d40 2024-02-28T16:37:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:43.999+0000 7f55aca00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a8070f40 con 0x7f55a81036e0 2024-02-28T16:37:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a6800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.988 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a6800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58842/0 (socket says 172.21.15.148:58842) 2024-02-28T16:37:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a6800700 1 -- 172.21.15.148:0/1825925132 learned_addr learned my addr 172.21.15.148:0/1825925132 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a6800700 1 -- 172.21.15.148:0/1825925132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a81036e0 msgr2=0x7f55a80707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a5e00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a81036e0 0x7f55a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a6800700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a81036e0 0x7f55a80707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:43.989 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a6800700 1 -- 172.21.15.148:0/1825925132 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598005040 con 0x7f55a8102d40 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.000+0000 7f55a6800700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8070290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5598009fd0 tx=0x7f5598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.001+0000 7f559ea00700 1 -- 172.21.15.148:0/1825925132 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f559800e040 con 0x7f55a8102d40 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.001+0000 7f559ea00700 1 -- 172.21.15.148:0/1825925132 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f559800bbf0 con 0x7f55a8102d40 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.001+0000 7f559ea00700 1 -- 172.21.15.148:0/1825925132 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f559801c3f0 con 0x7f55a8102d40 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.001+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a8119a50 con 0x7f55a8102d40 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.001+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a8119f30 con 0x7f55a8102d40 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.002+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a805f5c0 con 0x7f55a8102d40 2024-02-28T16:37:43.990 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.003+0000 7f559ea00700 1 -- 172.21.15.148:0/1825925132 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f559800bd60 con 0x7f55a8102d40 2024-02-28T16:37:43.991 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.004+0000 7f559ea00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f558c06d7f0 0x7f558c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:43.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.004+0000 7f559ea00700 1 -- 172.21.15.148:0/1825925132 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f559808e170 con 0x7f55a8102d40 2024-02-28T16:37:43.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.004+0000 7f55a5e00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f558c06d7f0 0x7f558c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:43.992 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.005+0000 7f55a5e00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f558c06d7f0 0x7f558c06fca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55a8071c90 tx=0x7f559400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:43.996 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.008+0000 7f559ea00700 1 -- 172.21.15.148:0/1825925132 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5598057a70 con 0x7f55a8102d40 2024-02-28T16:37:44.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:43 smithi148 ceph-mon[112463]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:44.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:43 smithi148 ceph-mon[112463]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:44.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:43 smithi148 ceph-mon[112463]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:44.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:43 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3457728018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:44.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:43 smithi157 ceph-mon[89328]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:44.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:43 smithi157 ceph-mon[89328]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:44.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:43 smithi157 ceph-mon[89328]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:44.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:43 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3457728018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:44.254 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.266+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55a8071ae0 con 0x7f558c06d7f0 2024-02-28T16:37:44.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.268+0000 7f559ea00700 1 -- 172.21.15.148:0/1825925132 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f55a8071ae0 con 0x7f558c06d7f0 2024-02-28T16:37:44.256 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "osd" 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "13/21 daemons upgraded", 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:37:44.257 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f558c06d7f0 msgr2=0x7f558c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f558c06d7f0 0x7f558c06fca0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f55a8071c90 tx=0x7f559400b040 comp rx=0 tx=0).stop 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 msgr2=0x7f55a8070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8070290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5598009fd0 tx=0x7f5598009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 shutdown_connections 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f558c06d7f0 0x7f558c06fca0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55a8102d40 0x7f55a8070290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 --2- 172.21.15.148:0/1825925132 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a81036e0 0x7f55a80707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.271+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 >> 172.21.15.148:0/1825925132 conn(0x7f55a80f88b0 msgr2=0x7f55a80fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.272+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 shutdown_connections 2024-02-28T16:37:44.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.272+0000 7f55aca00700 1 -- 172.21.15.148:0/1825925132 wait complete. 2024-02-28T16:37:44.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 -- 172.21.15.148:0/1777279280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960070870 msgr2=0x7f9960070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 --2- 172.21.15.148:0/1777279280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960070870 0x7f9960070ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f994c004970 tx=0x7f994c009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:44.399 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 -- 172.21.15.148:0/1777279280 shutdown_connections 2024-02-28T16:37:44.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 --2- 172.21.15.148:0/1777279280 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960070870 0x7f9960070ce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 --2- 172.21.15.148:0/1777279280 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9960071f60 0x7f9960070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 -- 172.21.15.148:0/1777279280 >> 172.21.15.148:0/1777279280 conn(0x7f99600f8ae0 msgr2=0x7f99600faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:44.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 -- 172.21.15.148:0/1777279280 shutdown_connections 2024-02-28T16:37:44.400 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.411+0000 7f9965600700 1 -- 172.21.15.148:0/1777279280 wait complete. 2024-02-28T16:37:44.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.412+0000 7f9965600700 1 Processor -- start 2024-02-28T16:37:44.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.412+0000 7f9965600700 1 -- start start 2024-02-28T16:37:44.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.412+0000 7f9965600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9960070870 0x7f996011a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.412+0000 7f9965600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960071f60 0x7f996011a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.401 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f9965600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996011ad50 con 0x7f9960071f60 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f9965600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9960113fd0 con 0x7f9960070870 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f995e000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960071f60 0x7f996011a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f995e000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960071f60 0x7f996011a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:58862/0 (socket says 172.21.15.148:58862) 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f995e000700 1 -- 172.21.15.148:0/3614855213 learned_addr learned my addr 172.21.15.148:0/3614855213 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f995ea00700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9960070870 0x7f996011a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f995e000700 1 -- 172.21.15.148:0/3614855213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9960070870 msgr2=0x7f996011a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f995e000700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9960070870 0x7f996011a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.413+0000 7f995e000700 1 -- 172.21.15.148:0/3614855213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c005040 con 0x7f9960071f60 2024-02-28T16:37:44.402 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.414+0000 7f995e000700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960071f60 0x7f996011a670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f994c009150 tx=0x7f994c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.414+0000 7f9956a00700 1 -- 172.21.15.148:0/3614855213 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f994c00e040 con 0x7f9960071f60 2024-02-28T16:37:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.414+0000 7f9956a00700 1 -- 172.21.15.148:0/3614855213 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f994c00bc10 con 0x7f9960071f60 2024-02-28T16:37:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.414+0000 7f9956a00700 1 -- 172.21.15.148:0/3614855213 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f994c01c630 con 0x7f9960071f60 2024-02-28T16:37:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.414+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99601141f0 con 0x7f9960071f60 2024-02-28T16:37:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.414+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99601146e0 con 0x7f9960071f60 2024-02-28T16:37:44.403 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.415+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99600fe400 con 0x7f9960071f60 2024-02-28T16:37:44.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.416+0000 7f9956a00700 1 -- 172.21.15.148:0/3614855213 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f994c00bd80 con 0x7f9960071f60 2024-02-28T16:37:44.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.417+0000 7f9956a00700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f994406d7f0 0x7f994406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:37:44.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.417+0000 7f9956a00700 1 -- 172.21.15.148:0/3614855213 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f994c08e240 con 0x7f9960071f60 2024-02-28T16:37:44.405 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.417+0000 7f995ea00700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f994406d7f0 0x7f994406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:37:44.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.418+0000 7f995ea00700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f994406d7f0 0x7f994406fca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9950006fd0 tx=0x7f9950008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:37:44.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.422+0000 7f9956a00700 1 -- 172.21.15.148:0/3614855213 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f994c05b690 con 0x7f9960071f60 2024-02-28T16:37:44.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.726+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f99600fc6e0 con 0x7f9960071f60 2024-02-28T16:37:44.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.727+0000 7f9956a00700 1 -- 172.21.15.148:0/3614855213 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f994c05b220 con 0x7f9960071f60 2024-02-28T16:37:44.715 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:37:44.715 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:37:44.715 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:37:44.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f994406d7f0 msgr2=0x7f994406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f994406d7f0 0x7f994406fca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9950006fd0 tx=0x7f9950008040 comp rx=0 tx=0).stop 2024-02-28T16:37:44.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960071f60 msgr2=0x7f996011a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:37:44.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960071f60 0x7f996011a670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f994c009150 tx=0x7f994c009e30 comp rx=0 tx=0).stop 2024-02-28T16:37:44.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 shutdown_connections 2024-02-28T16:37:44.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f994406d7f0 0x7f994406fca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9960070870 0x7f996011a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 --2- 172.21.15.148:0/3614855213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9960071f60 0x7f996011a670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:37:44.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.730+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 >> 172.21.15.148:0/3614855213 conn(0x7f99600f8ae0 msgr2=0x7f99600fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:37:44.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.731+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 shutdown_connections 2024-02-28T16:37:44.719 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:37:44.731+0000 7f9965600700 1 -- 172.21.15.148:0/3614855213 wait complete. 2024-02-28T16:37:45.104 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:44 smithi148 ceph-mon[112463]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:45.105 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:44 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3197848780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:37:45.105 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:45.105 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:45.105 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:44 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3614855213' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:37:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:44 smithi157 ceph-mon[89328]: pgmap v208: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:44 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3197848780' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:37:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:45.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:44 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3614855213' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:37:46.070 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:45 smithi148 ceph-mon[112463]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:46.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:45 smithi157 ceph-mon[89328]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:37:47.090 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:46 smithi148 ceph-mon[112463]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:46 smithi157 ceph-mon[89328]: pgmap v209: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:49.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:48 smithi148 ceph-mon[112463]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:49.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:48 smithi157 ceph-mon[89328]: pgmap v210: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:37:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:51.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:51.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:51.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:51.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:51.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:50 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: pgmap v211: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:51.217 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:50 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:37:53.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:52 smithi148 ceph-mon[112463]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:52 smithi157 ceph-mon[89328]: pgmap v212: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:54.316 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:54 smithi148 ceph-mon[112463]: Upgrade: Updating mds.cephfs.smithi148.nqnotw 2024-02-28T16:37:54.316 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:54.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:37:54.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:54 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:54.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:54 smithi148 ceph-mon[112463]: Deploying daemon mds.cephfs.smithi148.nqnotw on smithi148 2024-02-28T16:37:54.317 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:54 smithi148 ceph-mon[112463]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:54.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:54 smithi157 ceph-mon[89328]: Upgrade: Updating mds.cephfs.smithi148.nqnotw 2024-02-28T16:37:54.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:54.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi148.nqnotw", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:37:54.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:54 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:37:54.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:54 smithi157 ceph-mon[89328]: Deploying daemon mds.cephfs.smithi148.nqnotw on smithi148 2024-02-28T16:37:54.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:54 smithi157 ceph-mon[89328]: pgmap v213: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:56.767 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[112459]: 2024-02-28T16:37:56.402+0000 7fe006c00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:37:57.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:37:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:37:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: osdmap e82: 6 total, 6 up, 6 in 2024-02-28T16:37:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: Standby daemon mds.cephfs.smithi157.hinycn assigned to filesystem cephfs as rank 0 2024-02-28T16:37:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:37:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:37:57.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:56 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:replay} 2 up:standby 2024-02-28T16:37:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: pgmap v214: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:37:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:37:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:37:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: osdmap e82: 6 total, 6 up, 6 in 2024-02-28T16:37:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: Standby daemon mds.cephfs.smithi157.hinycn assigned to filesystem cephfs as rank 0 2024-02-28T16:37:57.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:37:57.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:37:57.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:56 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:replay} 2 up:standby 2024-02-28T16:37:58.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:58.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:58.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:37:58 smithi157 ceph-mon[89328]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-02-28T16:37:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:37:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:37:59.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:37:58 smithi148 ceph-mon[112463]: pgmap v216: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-02-28T16:38:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:00 smithi148 ceph-mon[112463]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-02-28T16:38:01.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:00 smithi157 ceph-mon[89328]: pgmap v217: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s rd, 1 op/s 2024-02-28T16:38:03.113 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:02 smithi148 ceph-mon[112463]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T16:38:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:02 smithi157 ceph-mon[89328]: pgmap v218: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T16:38:04.829 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:04 smithi148 ceph-mon[112463]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-28T16:38:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:04 smithi157 ceph-mon[89328]: pgmap v219: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-02-28T16:38:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:06 smithi157 ceph-mon[89328]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-28T16:38:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:06 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.148:6828/1814235745,v1:172.21.15.148:6829/1814235745] up:boot 2024-02-28T16:38:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:06 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:replay} 3 up:standby 2024-02-28T16:38:06.487 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:38:06.528 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:06.528 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:06.528 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:06.528 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:06 smithi148 ceph-mon[112463]: pgmap v220: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-28T16:38:06.528 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:06 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.148:6828/1814235745,v1:172.21.15.148:6829/1814235745] up:boot 2024-02-28T16:38:06.529 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:06 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:replay} 3 up:standby 2024-02-28T16:38:06.529 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:38:08.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:07 smithi148 ceph-mon[112463]: reconnect by client.24309 192.168.0.1:0/3439599588 after 0.00299995 2024-02-28T16:38:08.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:07 smithi148 ceph-mon[112463]: reconnect by client.14540 192.168.0.1:0/1904265939 after 0.00299995 2024-02-28T16:38:08.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:07 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:reconnect 2024-02-28T16:38:08.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:07 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:reconnect} 3 up:standby 2024-02-28T16:38:08.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:07 smithi157 ceph-mon[89328]: reconnect by client.24309 192.168.0.1:0/3439599588 after 0.00299995 2024-02-28T16:38:08.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:07 smithi157 ceph-mon[89328]: reconnect by client.14540 192.168.0.1:0/1904265939 after 0.00299995 2024-02-28T16:38:08.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:07 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:reconnect 2024-02-28T16:38:08.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:07 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:reconnect} 3 up:standby 2024-02-28T16:38:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:08 smithi148 ceph-mon[112463]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-28T16:38:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:08 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:rejoin 2024-02-28T16:38:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:08 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:rejoin} 3 up:standby 2024-02-28T16:38:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:08 smithi148 ceph-mon[112463]: daemon mds.cephfs.smithi157.hinycn is now active in filesystem cephfs as rank 0 2024-02-28T16:38:09.139 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:08 smithi157 ceph-mon[89328]: pgmap v221: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-28T16:38:09.139 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:08 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:rejoin 2024-02-28T16:38:09.139 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:08 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi157.hinycn=up:rejoin} 3 up:standby 2024-02-28T16:38:09.139 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:08 smithi157 ceph-mon[89328]: daemon mds.cephfs.smithi157.hinycn is now active in filesystem cephfs as rank 0 2024-02-28T16:38:10.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:09 smithi148 ceph-mon[112463]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:38:10.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:09 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:active 2024-02-28T16:38:10.118 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:09 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi157.hinycn=up:active} 3 up:standby 2024-02-28T16:38:10.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:09 smithi157 ceph-mon[89328]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:38:10.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:09 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] up:active 2024-02-28T16:38:10.167 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:09 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi157.hinycn=up:active} 3 up:standby 2024-02-28T16:38:11.016 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:10 smithi148 ceph-mon[112463]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-28T16:38:11.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:10 smithi157 ceph-mon[89328]: pgmap v222: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-28T16:38:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:12 smithi157 ceph-mon[89328]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:38:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:13.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:12 smithi148 ceph-mon[112463]: pgmap v223: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:38:13.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:13.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:13.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:13.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:14.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 -- 172.21.15.148:0/1867455235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 msgr2=0x7f9c30106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 --2- 172.21.15.148:0/1867455235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30106f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c004940 tx=0x7f9c1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 -- 172.21.15.148:0/1867455235 shutdown_connections 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 --2- 172.21.15.148:0/1867455235 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30106f40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 --2- 172.21.15.148:0/1867455235 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c300fdf60 0x7f9c300fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 -- 172.21.15.148:0/1867455235 >> 172.21.15.148:0/1867455235 conn(0x7f9c300f7a10 msgr2=0x7f9c300f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 -- 172.21.15.148:0/1867455235 shutdown_connections 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.898+0000 7f9c37000700 1 -- 172.21.15.148:0/1867455235 wait complete. 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.899+0000 7f9c37000700 1 Processor -- start 2024-02-28T16:38:14.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.899+0000 7f9c37000700 1 -- start start 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.899+0000 7f9c37000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c300fdf60 0x7f9c30115d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.899+0000 7f9c37000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30116270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.899+0000 7f9c37000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301168c0 con 0x7f9c300fe900 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.899+0000 7f9c37000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3010fbd0 con 0x7f9c300fdf60 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30116270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30116270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51838/0 (socket says 172.21.15.148:51838) 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2f400700 1 -- 172.21.15.148:0/4184376154 learned_addr learned my addr 172.21.15.148:0/4184376154 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2fe00700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c300fdf60 0x7f9c30115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:14.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2f400700 1 -- 172.21.15.148:0/4184376154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c300fdf60 msgr2=0x7f9c30115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2f400700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c300fdf60 0x7f9c30115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2f400700 1 -- 172.21.15.148:0/4184376154 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c005040 con 0x7f9c300fe900 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2fe00700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c300fdf60 0x7f9c30115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.900+0000 7f9c2f400700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30116270 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009180 tx=0x7f9c1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.901+0000 7f9c27e00700 1 -- 172.21.15.148:0/4184376154 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c1c00e040 con 0x7f9c300fe900 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.901+0000 7f9c27e00700 1 -- 172.21.15.148:0/4184376154 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c1c004290 con 0x7f9c300fe900 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.901+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3010fe50 con 0x7f9c300fe900 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.901+0000 7f9c27e00700 1 -- 172.21.15.148:0/4184376154 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c1c01c630 con 0x7f9c300fe900 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.901+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c30110390 con 0x7f9c300fe900 2024-02-28T16:38:14.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.902+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c30106950 con 0x7f9c300fe900 2024-02-28T16:38:14.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.903+0000 7f9c27e00700 1 -- 172.21.15.148:0/4184376154 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9c1c0139f0 con 0x7f9c300fe900 2024-02-28T16:38:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.904+0000 7f9c27e00700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9c1406d7f0 0x7f9c1406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.904+0000 7f9c27e00700 1 -- 172.21.15.148:0/4184376154 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9c1c08e2f0 con 0x7f9c300fe900 2024-02-28T16:38:14.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.904+0000 7f9c2fe00700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9c1406d7f0 0x7f9c1406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:14.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.905+0000 7f9c2fe00700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9c1406d7f0 0x7f9c1406fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c20007fd0 tx=0x7f9c20009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:14.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:14.910+0000 7f9c27e00700 1 -- 172.21.15.148:0/4184376154 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9c1c05b6d0 con 0x7f9c300fe900 2024-02-28T16:38:15.146 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.157+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c3004bf40 con 0x7f9c1406d7f0 2024-02-28T16:38:15.146 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:14 smithi148 ceph-mon[112463]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 255 B/s wr, 5 op/s 2024-02-28T16:38:15.146 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:15.147 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:14 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:15.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.160+0000 7f9c27e00700 1 -- 172.21.15.148:0/4184376154 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9c3004bf40 con 0x7f9c1406d7f0 2024-02-28T16:38:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.163+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9c1406d7f0 msgr2=0x7f9c1406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.151 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.163+0000 7f9c37000700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9c1406d7f0 0x7f9c1406fca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c20007fd0 tx=0x7f9c20009040 comp rx=0 tx=0).stop 2024-02-28T16:38:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.163+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 msgr2=0x7f9c30116270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.163+0000 7f9c37000700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30116270 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009180 tx=0x7f9c1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.164+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 shutdown_connections 2024-02-28T16:38:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.164+0000 7f9c37000700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9c1406d7f0 0x7f9c1406fca0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.152 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.164+0000 7f9c37000700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9c300fdf60 0x7f9c30115d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.164+0000 7f9c37000700 1 --2- 172.21.15.148:0/4184376154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9c300fe900 0x7f9c30116270 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.164+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 >> 172.21.15.148:0/4184376154 conn(0x7f9c300f7a10 msgr2=0x7f9c30103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:15.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.164+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 shutdown_connections 2024-02-28T16:38:15.153 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.164+0000 7f9c37000700 1 -- 172.21.15.148:0/4184376154 wait complete. 2024-02-28T16:38:15.171 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:38:15.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:14 smithi157 ceph-mon[89328]: pgmap v224: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 255 B/s wr, 5 op/s 2024-02-28T16:38:15.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:15.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:14 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:15.311 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 -- 172.21.15.148:0/658292363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c0702d0 msgr2=0x7f439c0706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 --2- 172.21.15.148:0/658292363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c0702d0 0x7f439c0706a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f438c004970 tx=0x7f438c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 -- 172.21.15.148:0/658292363 shutdown_connections 2024-02-28T16:38:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 --2- 172.21.15.148:0/658292363 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f439c070be0 0x7f439c1092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 --2- 172.21.15.148:0/658292363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c0702d0 0x7f439c0706a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 -- 172.21.15.148:0/658292363 >> 172.21.15.148:0/658292363 conn(0x7f439c0f8ae0 msgr2=0x7f439c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 -- 172.21.15.148:0/658292363 shutdown_connections 2024-02-28T16:38:15.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.323+0000 7f43a2000700 1 -- 172.21.15.148:0/658292363 wait complete. 2024-02-28T16:38:15.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.324+0000 7f43a2000700 1 Processor -- start 2024-02-28T16:38:15.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.324+0000 7f43a2000700 1 -- start start 2024-02-28T16:38:15.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f43a2000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f439c0702d0 0x7f439c115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:15.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f43a2000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c070be0 0x7f439c1161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:15.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f43a2000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c1168c0 con 0x7f439c070be0 2024-02-28T16:38:15.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f43a2000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c10fb40 con 0x7f439c0702d0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c070be0 0x7f439c1161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c070be0 0x7f439c1161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51848/0 (socket says 172.21.15.148:51848) 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439aa00700 1 -- 172.21.15.148:0/3670189010 learned_addr learned my addr 172.21.15.148:0/3670189010 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439b400700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f439c0702d0 0x7f439c115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439aa00700 1 -- 172.21.15.148:0/3670189010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f439c0702d0 msgr2=0x7f439c115ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439aa00700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f439c0702d0 0x7f439c115ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439aa00700 1 -- 172.21.15.148:0/3670189010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c005040 con 0x7f439c070be0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.325+0000 7f439b400700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f439c0702d0 0x7f439c115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.326+0000 7f439aa00700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c070be0 0x7f439c1161e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f438800b790 tx=0x7f4388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.326+0000 7f4393400700 1 -- 172.21.15.148:0/3670189010 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438800f770 con 0x7f439c070be0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.326+0000 7f4393400700 1 -- 172.21.15.148:0/3670189010 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f438800fda0 con 0x7f439c070be0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.326+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c10fdc0 con 0x7f439c070be0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.326+0000 7f4393400700 1 -- 172.21.15.148:0/3670189010 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f438800d310 con 0x7f439c070be0 2024-02-28T16:38:15.315 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.326+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c110300 con 0x7f439c070be0 2024-02-28T16:38:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.327+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c106980 con 0x7f439c070be0 2024-02-28T16:38:15.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.328+0000 7f4393400700 1 -- 172.21.15.148:0/3670189010 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4388010420 con 0x7f439c070be0 2024-02-28T16:38:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.329+0000 7f4393400700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f438006d7f0 0x7f438006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.329+0000 7f4393400700 1 -- 172.21.15.148:0/3670189010 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f438808cef0 con 0x7f439c070be0 2024-02-28T16:38:15.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.330+0000 7f439b400700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f438006d7f0 0x7f438006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:15.318 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.330+0000 7f439b400700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f438006d7f0 0x7f438006fca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f438c000c00 tx=0x7f438c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:15.321 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.334+0000 7f4393400700 1 -- 172.21.15.148:0/3670189010 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f438805a2d0 con 0x7f439c070be0 2024-02-28T16:38:15.560 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.572+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f439c111280 con 0x7f438006d7f0 2024-02-28T16:38:15.562 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.574+0000 7f4393400700 1 -- 172.21.15.148:0/3670189010 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f439c111280 con 0x7f438006d7f0 2024-02-28T16:38:15.564 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.576+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f438006d7f0 msgr2=0x7f438006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.576+0000 7f43a2000700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f438006d7f0 0x7f438006fca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f438c000c00 tx=0x7f438c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.576+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c070be0 msgr2=0x7f439c1161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.576+0000 7f43a2000700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c070be0 0x7f439c1161e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f438800b790 tx=0x7f4388009250 comp rx=0 tx=0).stop 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.577+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 shutdown_connections 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.577+0000 7f43a2000700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f438006d7f0 0x7f438006fca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.577+0000 7f43a2000700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f439c0702d0 0x7f439c115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.577+0000 7f43a2000700 1 --2- 172.21.15.148:0/3670189010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f439c070be0 0x7f439c1161e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.577+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 >> 172.21.15.148:0/3670189010 conn(0x7f439c0f8ae0 msgr2=0x7f439c103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:15.565 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.577+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 shutdown_connections 2024-02-28T16:38:15.566 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.577+0000 7f43a2000700 1 -- 172.21.15.148:0/3670189010 wait complete. 2024-02-28T16:38:15.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.721+0000 7f63e7600700 1 -- 172.21.15.148:0/3757694765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105b10 msgr2=0x7f63e00ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.721+0000 7f63e7600700 1 --2- 172.21.15.148:0/3757694765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105b10 0x7f63e00ff180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63cc004940 tx=0x7f63cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:15.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.722+0000 7f63e7600700 1 -- 172.21.15.148:0/3757694765 shutdown_connections 2024-02-28T16:38:15.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.722+0000 7f63e7600700 1 --2- 172.21.15.148:0/3757694765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105b10 0x7f63e00ff180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.722+0000 7f63e7600700 1 --2- 172.21.15.148:0/3757694765 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e0105170 0x7f63e0105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.722+0000 7f63e7600700 1 -- 172.21.15.148:0/3757694765 >> 172.21.15.148:0/3757694765 conn(0x7f63e00face0 msgr2=0x7f63e00fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:15.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.722+0000 7f63e7600700 1 -- 172.21.15.148:0/3757694765 shutdown_connections 2024-02-28T16:38:15.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.722+0000 7f63e7600700 1 -- 172.21.15.148:0/3757694765 wait complete. 2024-02-28T16:38:15.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.723+0000 7f63e7600700 1 Processor -- start 2024-02-28T16:38:15.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.723+0000 7f63e7600700 1 -- start start 2024-02-28T16:38:15.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.723+0000 7f63e7600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105170 0x7f63e0115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:15.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.723+0000 7f63e7600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e0105b10 0x7f63e0116220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:15.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.723+0000 7f63e7600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0116870 con 0x7f63e0105170 2024-02-28T16:38:15.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.723+0000 7f63e7600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e010fb80 con 0x7f63e0105b10 2024-02-28T16:38:15.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63e4c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105170 0x7f63e0115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:15.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63e4c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105170 0x7f63e0115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51854/0 (socket says 172.21.15.148:51854) 2024-02-28T16:38:15.712 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63e4c00700 1 -- 172.21.15.148:0/2806237419 learned_addr learned my addr 172.21.15.148:0/2806237419 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63dfe00700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e0105b10 0x7f63e0116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63e4c00700 1 -- 172.21.15.148:0/2806237419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e0105b10 msgr2=0x7f63e0116220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63e4c00700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e0105b10 0x7f63e0116220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63e4c00700 1 -- 172.21.15.148:0/2806237419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc005040 con 0x7f63e0105170 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.724+0000 7f63e4c00700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105170 0x7f63e0115ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63d4002a50 tx=0x7f63d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.725+0000 7f63dcc00700 1 -- 172.21.15.148:0/2806237419 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d4007cc0 con 0x7f63e0105170 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.725+0000 7f63dcc00700 1 -- 172.21.15.148:0/2806237419 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63d400f040 con 0x7f63e0105170 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.725+0000 7f63dcc00700 1 -- 172.21.15.148:0/2806237419 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d4009640 con 0x7f63e0105170 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.725+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e010fe60 con 0x7f63e0105170 2024-02-28T16:38:15.713 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.725+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e01103a0 con 0x7f63e0105170 2024-02-28T16:38:15.714 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.726+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e0107640 con 0x7f63e0105170 2024-02-28T16:38:15.715 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.727+0000 7f63dcc00700 1 -- 172.21.15.148:0/2806237419 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f63d40097a0 con 0x7f63e0105170 2024-02-28T16:38:15.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.729+0000 7f63dcc00700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f63c806d7f0 0x7f63c806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:15.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.729+0000 7f63dcc00700 1 -- 172.21.15.148:0/2806237419 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f63d408cc60 con 0x7f63e0105170 2024-02-28T16:38:15.717 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.729+0000 7f63dfe00700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f63c806d7f0 0x7f63c806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:15.718 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.730+0000 7f63dfe00700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f63c806d7f0 0x7f63c806fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00b020 tx=0x7f63cc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:15.721 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.733+0000 7f63dcc00700 1 -- 172.21.15.148:0/2806237419 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f63d4059fc0 con 0x7f63e0105170 2024-02-28T16:38:15.947 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.959+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f63e004bf40 con 0x7f63c806d7f0 2024-02-28T16:38:15.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.970+0000 7f63dcc00700 1 -- 172.21.15.148:0/2806237419 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f63e004bf40 con 0x7f63c806d7f0 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (8m) 4s ago 23m 15.0M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (4m) 4s ago 24m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (4m) 60s ago 22m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (7m) 4s ago 23m 74.1M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (42s) 4s ago 15m 11.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 4d24e66401b9 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (11s) 4s ago 15m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 777e874af3d3 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (15m) 60s ago 15m 15.6M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (15m) 60s ago 15m 15.4M - 17.2.7-535-gc0f02e60 1c37ed371348 634873fe1911 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (10m) 4s ago 25m 509M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (9m) 60s ago 21m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:38:15.959 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (6m) 4s ago 25m 50.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (5m) 60s ago 21m 36.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (9m) 4s ago 23m 8028k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (9m) 60s ago 21m 7972k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (4m) 4s ago 20m 90.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (3m) 4s ago 20m 93.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (3m) 4s ago 19m 90.9M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (2m) 60s ago 18m 92.7M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (109s) 60s ago 18m 84.7M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 93c28b8b835a 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (65s) 60s ago 17m 11.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 860ae8452ebf 2024-02-28T16:38:15.960 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (8m) 4s ago 22m 56.4M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f63c806d7f0 msgr2=0x7f63c806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f63c806d7f0 0x7f63c806fca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00b020 tx=0x7f63cc009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105170 msgr2=0x7f63e0115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105170 0x7f63e0115ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63d4002a50 tx=0x7f63d40046b0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 shutdown_connections 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f63c806d7f0 0x7f63c806fca0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f63e0105170 0x7f63e0115ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 --2- 172.21.15.148:0/2806237419 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f63e0105b10 0x7f63e0116220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:15.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 >> 172.21.15.148:0/2806237419 conn(0x7f63e00face0 msgr2=0x7f63e00fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:15.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.974+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 shutdown_connections 2024-02-28T16:38:15.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:15.975+0000 7f63e7600700 1 -- 172.21.15.148:0/2806237419 wait complete. 2024-02-28T16:38:16.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.121+0000 7f1d8be00700 1 -- 172.21.15.148:0/1285087662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c1036e0 msgr2=0x7f1d8c0fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.121+0000 7f1d8be00700 1 --2- 172.21.15.148:0/1285087662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c1036e0 0x7f1d8c0fcd50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d78004940 tx=0x7f1d78009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:16.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.121+0000 7f1d8be00700 1 -- 172.21.15.148:0/1285087662 shutdown_connections 2024-02-28T16:38:16.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.121+0000 7f1d8be00700 1 --2- 172.21.15.148:0/1285087662 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c1036e0 0x7f1d8c0fcd50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.121+0000 7f1d8be00700 1 --2- 172.21.15.148:0/1285087662 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d8c102d40 0x7f1d8c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.121+0000 7f1d8be00700 1 -- 172.21.15.148:0/1285087662 >> 172.21.15.148:0/1285087662 conn(0x7f1d8c0f88b0 msgr2=0x7f1d8c0facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:16.110 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.122+0000 7f1d8be00700 1 -- 172.21.15.148:0/1285087662 shutdown_connections 2024-02-28T16:38:16.111 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.122+0000 7f1d8be00700 1 -- 172.21.15.148:0/1285087662 wait complete. 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.122+0000 7f1d8be00700 1 Processor -- start 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8be00700 1 -- start start 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8be00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c102d40 0x7f1d8c115a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8be00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d8c1036e0 0x7f1d8c115f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8be00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1165d0 con 0x7f1d8c102d40 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8be00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c10f900 con 0x7f1d8c1036e0 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c102d40 0x7f1d8c115a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8aa00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c102d40 0x7f1d8c115a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51872/0 (socket says 172.21.15.148:51872) 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.123+0000 7f1d8aa00700 1 -- 172.21.15.148:0/3837194255 learned_addr learned my addr 172.21.15.148:0/3837194255 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:16.112 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.124+0000 7f1d8a000700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d8c1036e0 0x7f1d8c115f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:16.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.124+0000 7f1d8aa00700 1 -- 172.21.15.148:0/3837194255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d8c1036e0 msgr2=0x7f1d8c115f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.124+0000 7f1d8aa00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d8c1036e0 0x7f1d8c115f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.124+0000 7f1d8aa00700 1 -- 172.21.15.148:0/3837194255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78005040 con 0x7f1d8c102d40 2024-02-28T16:38:16.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.124+0000 7f1d8a000700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d8c1036e0 0x7f1d8c115f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:38:16.113 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.124+0000 7f1d8aa00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c102d40 0x7f1d8c115a40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00eb40 tx=0x7f1d7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:16.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.124+0000 7f1d82a00700 1 -- 172.21.15.148:0/3837194255 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7c007cc0 con 0x7f1d8c102d40 2024-02-28T16:38:16.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.125+0000 7f1d82a00700 1 -- 172.21.15.148:0/3837194255 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d7c00f040 con 0x7f1d8c102d40 2024-02-28T16:38:16.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.125+0000 7f1d82a00700 1 -- 172.21.15.148:0/3837194255 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7c009620 con 0x7f1d8c102d40 2024-02-28T16:38:16.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.125+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c10fb80 con 0x7f1d8c102d40 2024-02-28T16:38:16.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.125+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c1100c0 con 0x7f1d8c102d40 2024-02-28T16:38:16.114 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.126+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c05f5c0 con 0x7f1d8c102d40 2024-02-28T16:38:16.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.127+0000 7f1d82a00700 1 -- 172.21.15.148:0/3837194255 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1d7c009780 con 0x7f1d8c102d40 2024-02-28T16:38:16.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.128+0000 7f1d82a00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f1d7006d840 0x7f1d7006fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:16.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.128+0000 7f1d82a00700 1 -- 172.21.15.148:0/3837194255 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1d7c08cc00 con 0x7f1d8c102d40 2024-02-28T16:38:16.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.128+0000 7f1d8a000700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f1d7006d840 0x7f1d7006fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:16.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.129+0000 7f1d8a000700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f1d7006d840 0x7f1d7006fcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b0d0 tx=0x7f1d78009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:16.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.133+0000 7f1d82a00700 1 -- 172.21.15.148:0/3837194255 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1d7c059f90 con 0x7f1d8c102d40 2024-02-28T16:38:16.432 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.445+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d8c111020 con 0x7f1d8c102d40 2024-02-28T16:38:16.433 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.445+0000 7f1d82a00700 1 -- 172.21.15.148:0/3837194255 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f1d7c059b20 con 0x7f1d8c102d40 2024-02-28T16:38:16.433 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2, 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:38:16.434 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:16.435 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:38:16.435 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 2, 2024-02-28T16:38:16.435 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 12 2024-02-28T16:38:16.435 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:38:16.435 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:38:16.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f1d7006d840 msgr2=0x7f1d7006fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f1d7006d840 0x7f1d7006fcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800b0d0 tx=0x7f1d78009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:16.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c102d40 msgr2=0x7f1d8c115a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c102d40 0x7f1d8c115a40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00eb40 tx=0x7f1d7c00b040 comp rx=0 tx=0).stop 2024-02-28T16:38:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 shutdown_connections 2024-02-28T16:38:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f1d7006d840 0x7f1d7006fcf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1d8c102d40 0x7f1d8c115a40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 --2- 172.21.15.148:0/3837194255 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d8c1036e0 0x7f1d8c115f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 >> 172.21.15.148:0/3837194255 conn(0x7f1d8c0f88b0 msgr2=0x7f1d8c0fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 shutdown_connections 2024-02-28T16:38:16.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.448+0000 7f1d8be00700 1 -- 172.21.15.148:0/3837194255 wait complete. 2024-02-28T16:38:16.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 -- 172.21.15.148:0/3300035648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 msgr2=0x7f229c109260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3300035648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c109260 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2288004970 tx=0x7f2288009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 -- 172.21.15.148:0/3300035648 shutdown_connections 2024-02-28T16:38:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3300035648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c109260 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3300035648 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f229c070330 0x7f229c070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 -- 172.21.15.148:0/3300035648 >> 172.21.15.148:0/3300035648 conn(0x7f229c0f8ae0 msgr2=0x7f229c0faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 -- 172.21.15.148:0/3300035648 shutdown_connections 2024-02-28T16:38:16.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.599+0000 7f22a0e00700 1 -- 172.21.15.148:0/3300035648 wait complete. 2024-02-28T16:38:16.589 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.600+0000 7f22a0e00700 1 Processor -- start 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f22a0e00700 1 -- start start 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f22a0e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f229c070330 0x7f229c115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f22a0e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c1161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f22a0e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c1168c0 con 0x7f229c070c40 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f22a0e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229c10fb40 con 0x7f229c070330 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f2299400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c1161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f2299400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c1161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51888/0 (socket says 172.21.15.148:51888) 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.601+0000 7f2299400700 1 -- 172.21.15.148:0/3902551251 learned_addr learned my addr 172.21.15.148:0/3902551251 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2299e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f229c070330 0x7f229c115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2299400700 1 -- 172.21.15.148:0/3902551251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f229c070330 msgr2=0x7f229c115ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2299400700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f229c070330 0x7f229c115ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2299400700 1 -- 172.21.15.148:0/3902551251 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288005040 con 0x7f229c070c40 2024-02-28T16:38:16.590 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2299e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f229c070330 0x7f229c115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:38:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2299400700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c1161e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2288000c00 tx=0x7f2288009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2292000700 1 -- 172.21.15.148:0/3902551251 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228800e040 con 0x7f229c070c40 2024-02-28T16:38:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229c10fd60 con 0x7f229c070c40 2024-02-28T16:38:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2292000700 1 -- 172.21.15.148:0/3902551251 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2288004290 con 0x7f229c070c40 2024-02-28T16:38:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f2292000700 1 -- 172.21.15.148:0/3902551251 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f228801c630 con 0x7f229c070c40 2024-02-28T16:38:16.591 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.602+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229c1102a0 con 0x7f229c070c40 2024-02-28T16:38:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.604+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229c106920 con 0x7f229c070c40 2024-02-28T16:38:16.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.605+0000 7f2292000700 1 -- 172.21.15.148:0/3902551251 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2288013980 con 0x7f229c070c40 2024-02-28T16:38:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.606+0000 7f2292000700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f228006d7e0 0x7f228006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:16.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.606+0000 7f2292000700 1 -- 172.21.15.148:0/3902551251 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f228808e240 con 0x7f229c070c40 2024-02-28T16:38:16.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.606+0000 7f2299e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f228006d7e0 0x7f228006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:16.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.606+0000 7f2299e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f228006d7e0 0x7f228006fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f228c006fd0 tx=0x7f228c008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:16.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.610+0000 7f2292000700 1 -- 172.21.15.148:0/3902551251 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f228805b5a0 con 0x7f229c070c40 2024-02-28T16:38:16.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.887+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f229c0fc6e0 con 0x7f229c070c40 2024-02-28T16:38:16.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.888+0000 7f2292000700 1 -- 172.21.15.148:0/3902551251 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1853 (secure 0 0 0) 0x7f228805b130 con 0x7f229c070c40 2024-02-28T16:38:16.876 INFO:teuthology.orchestra.run.smithi148.stdout:e22 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 22 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:38:07.924642+0000 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:38:16.877 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 82 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=24253} 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:38:16.878 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{0:24253} state up:active seq 237 join_fscid=1 addr [v2:172.21.15.157:6824/696390101,v1:172.21.15.157:6825/696390101] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:24267} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:38:16.879 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{-1:34460} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6828/1814235745,v1:172.21.15.148:6829/1814235745] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:38:16.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.890+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f228006d7e0 msgr2=0x7f228006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.890+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f228006d7e0 0x7f228006fc90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f228c006fd0 tx=0x7f228c008040 comp rx=0 tx=0).stop 2024-02-28T16:38:16.880 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.890+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 msgr2=0x7f229c1161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.890+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c1161e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2288000c00 tx=0x7f2288009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.891+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 shutdown_connections 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.891+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f228006d7e0 0x7f228006fc90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.891+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f229c070330 0x7f229c115ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.891+0000 7f22a0e00700 1 --2- 172.21.15.148:0/3902551251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f229c070c40 0x7f229c1161e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.891+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 >> 172.21.15.148:0/3902551251 conn(0x7f229c0f8ae0 msgr2=0x7f229c103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.891+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 shutdown_connections 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:16.891+0000 7f22a0e00700 1 -- 172.21.15.148:0/3902551251 wait complete. 2024-02-28T16:38:16.881 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 22 2024-02-28T16:38:17.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.036+0000 7f41be000700 1 -- 172.21.15.148:0/602077907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fe8f0 msgr2=0x7f41b8107050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.036+0000 7f41be000700 1 --2- 172.21.15.148:0/602077907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fe8f0 0x7f41b8107050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f41a4004970 tx=0x7f41a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.036+0000 7f41be000700 1 -- 172.21.15.148:0/602077907 shutdown_connections 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.036+0000 7f41be000700 1 --2- 172.21.15.148:0/602077907 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fe8f0 0x7f41b8107050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.036+0000 7f41be000700 1 --2- 172.21.15.148:0/602077907 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b80fdfe0 0x7f41b80fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.036+0000 7f41be000700 1 -- 172.21.15.148:0/602077907 >> 172.21.15.148:0/602077907 conn(0x7f41b8071d90 msgr2=0x7f41b8072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.037+0000 7f41be000700 1 -- 172.21.15.148:0/602077907 shutdown_connections 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.037+0000 7f41be000700 1 -- 172.21.15.148:0/602077907 wait complete. 2024-02-28T16:38:17.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.038+0000 7f41be000700 1 Processor -- start 2024-02-28T16:38:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.038+0000 7f41be000700 1 -- start start 2024-02-28T16:38:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.038+0000 7f41be000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fdfe0 0x7f41b80fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.038+0000 7f41be000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b80fe8f0 0x7f41b80fc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.038+0000 7f41be000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80fc9e0 con 0x7f41b80fdfe0 2024-02-28T16:38:17.026 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.038+0000 7f41be000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80fcb50 con 0x7f41b80fe8f0 2024-02-28T16:38:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fdfe0 0x7f41b80fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b7400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fdfe0 0x7f41b80fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51902/0 (socket says 172.21.15.148:51902) 2024-02-28T16:38:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b7400700 1 -- 172.21.15.148:0/2324387057 learned_addr learned my addr 172.21.15.148:0/2324387057 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b6a00700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b80fe8f0 0x7f41b80fc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:17.027 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b7400700 1 -- 172.21.15.148:0/2324387057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b80fe8f0 msgr2=0x7f41b80fc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b7400700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b80fe8f0 0x7f41b80fc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b7400700 1 -- 172.21.15.148:0/2324387057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4005040 con 0x7f41b80fdfe0 2024-02-28T16:38:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.039+0000 7f41b6a00700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b80fe8f0 0x7f41b80fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:38:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.040+0000 7f41b7400700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fdfe0 0x7f41b80fbea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f41a8002a50 tx=0x7f41a80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:17.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.040+0000 7f41af400700 1 -- 172.21.15.148:0/2324387057 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a8007cc0 con 0x7f41b80fdfe0 2024-02-28T16:38:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.040+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b8119c30 con 0x7f41b80fdfe0 2024-02-28T16:38:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.040+0000 7f41af400700 1 -- 172.21.15.148:0/2324387057 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41a800f040 con 0x7f41b80fdfe0 2024-02-28T16:38:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.040+0000 7f41af400700 1 -- 172.21.15.148:0/2324387057 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41a8009640 con 0x7f41b80fdfe0 2024-02-28T16:38:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.040+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b811a110 con 0x7f41b80fdfe0 2024-02-28T16:38:17.029 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.041+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b81046c0 con 0x7f41b80fdfe0 2024-02-28T16:38:17.030 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.042+0000 7f41af400700 1 -- 172.21.15.148:0/2324387057 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f41a80097a0 con 0x7f41b80fdfe0 2024-02-28T16:38:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.044+0000 7f41af400700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f419c06d7f0 0x7f419c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.044+0000 7f41af400700 1 -- 172.21.15.148:0/2324387057 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f41a808cd00 con 0x7f41b80fdfe0 2024-02-28T16:38:17.032 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.044+0000 7f41b6a00700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f419c06d7f0 0x7f419c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:17.033 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.045+0000 7f41b6a00700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f419c06d7f0 0x7f419c06fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:17.036 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.048+0000 7f41af400700 1 -- 172.21.15.148:0/2324387057 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f41a80564b0 con 0x7f41b80fdfe0 2024-02-28T16:38:17.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:16 smithi157 ceph-mon[89328]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:17.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:16 smithi157 ceph-mon[89328]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:17.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:16 smithi157 ceph-mon[89328]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-02-28T16:38:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:16 smithi157 ceph-mon[89328]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:16 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3837194255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:17.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:16 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3902551251' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:38:17.280 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.292+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41b80fd5e0 con 0x7f419c06d7f0 2024-02-28T16:38:17.280 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:16 smithi148 ceph-mon[112463]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:17.281 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:16 smithi148 ceph-mon[112463]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:17.281 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:16 smithi148 ceph-mon[112463]: pgmap v225: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-02-28T16:38:17.281 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:16 smithi148 ceph-mon[112463]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:17.281 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:16 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3837194255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:17.281 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:16 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3902551251' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:38:17.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.294+0000 7f41af400700 1 -- 172.21.15.148:0/2324387057 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f41b80fd5e0 con 0x7f419c06d7f0 2024-02-28T16:38:17.282 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:38:17.282 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:38:17.282 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:38:17.282 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "osd" 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "14/21 daemons upgraded", 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:38:17.283 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:38:17.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f419c06d7f0 msgr2=0x7f419c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f419c06d7f0 0x7f419c06fca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f41a4000c00 tx=0x7f41a4009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fdfe0 msgr2=0x7f41b80fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fdfe0 0x7f41b80fbea0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f41a8002a50 tx=0x7f41a80046b0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 shutdown_connections 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f419c06d7f0 0x7f419c06fca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f41b80fdfe0 0x7f41b80fbea0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 --2- 172.21.15.148:0/2324387057 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f41b80fe8f0 0x7f41b80fc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.297+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 >> 172.21.15.148:0/2324387057 conn(0x7f41b8071d90 msgr2=0x7f41b8101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.298+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 shutdown_connections 2024-02-28T16:38:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.298+0000 7f41be000700 1 -- 172.21.15.148:0/2324387057 wait complete. 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.445+0000 7f32e6600700 1 -- 172.21.15.148:0/1211640767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 msgr2=0x7f32e0070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.445+0000 7f32e6600700 1 --2- 172.21.15.148:0/1211640767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e0070330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f32d0004970 tx=0x7f32d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.445+0000 7f32e6600700 1 -- 172.21.15.148:0/1211640767 shutdown_connections 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.445+0000 7f32e6600700 1 --2- 172.21.15.148:0/1211640767 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e0070870 0x7f32e0070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.445+0000 7f32e6600700 1 --2- 172.21.15.148:0/1211640767 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e0070330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.445+0000 7f32e6600700 1 -- 172.21.15.148:0/1211640767 >> 172.21.15.148:0/1211640767 conn(0x7f32e00f8ae0 msgr2=0x7f32e00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.446+0000 7f32e6600700 1 -- 172.21.15.148:0/1211640767 shutdown_connections 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.446+0000 7f32e6600700 1 -- 172.21.15.148:0/1211640767 wait complete. 2024-02-28T16:38:17.434 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.446+0000 7f32e6600700 1 Processor -- start 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.446+0000 7f32e6600700 1 -- start start 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.447+0000 7f32e6600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e0070870 0x7f32e011a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.447+0000 7f32e6600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e011a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.447+0000 7f32e6600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e011ac00 con 0x7f32e0071f60 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.447+0000 7f32e6600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e0113f10 con 0x7f32e0070870 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.447+0000 7f32dea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e011a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.447+0000 7f32dea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e011a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:51928/0 (socket says 172.21.15.148:51928) 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.447+0000 7f32dea00700 1 -- 172.21.15.148:0/1288576635 learned_addr learned my addr 172.21.15.148:0/1288576635 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32df400700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e0070870 0x7f32e011a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32dea00700 1 -- 172.21.15.148:0/1288576635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e0070870 msgr2=0x7f32e011a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32dea00700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e0070870 0x7f32e011a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32dea00700 1 -- 172.21.15.148:0/1288576635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d0005040 con 0x7f32e0071f60 2024-02-28T16:38:17.436 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32dea00700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e011a5b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c8c0 tx=0x7f32cc0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:17.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32d7400700 1 -- 172.21.15.148:0/1288576635 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc00a980 con 0x7f32e0071f60 2024-02-28T16:38:17.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32d7400700 1 -- 172.21.15.148:0/1288576635 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32cc00ce60 con 0x7f32e0071f60 2024-02-28T16:38:17.437 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e01141f0 con 0x7f32e0071f60 2024-02-28T16:38:17.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.448+0000 7f32d7400700 1 -- 172.21.15.148:0/1288576635 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32cc0115e0 con 0x7f32e0071f60 2024-02-28T16:38:17.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.449+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e0114730 con 0x7f32e0071f60 2024-02-28T16:38:17.438 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.450+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e00fe400 con 0x7f32e0071f60 2024-02-28T16:38:17.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.451+0000 7f32d7400700 1 -- 172.21.15.148:0/1288576635 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f32cc012400 con 0x7f32e0071f60 2024-02-28T16:38:17.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.452+0000 7f32d7400700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f32c406d7e0 0x7f32c406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:17.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.452+0000 7f32d7400700 1 -- 172.21.15.148:0/1288576635 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f32cc08cfe0 con 0x7f32e0071f60 2024-02-28T16:38:17.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.453+0000 7f32df400700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f32c406d7e0 0x7f32c406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:17.441 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.453+0000 7f32df400700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f32c406d7e0 0x7f32c406fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000c00 tx=0x7f32d0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:17.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.457+0000 7f32d7400700 1 -- 172.21.15.148:0/1288576635 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f32cc05a3a0 con 0x7f32e0071f60 2024-02-28T16:38:17.744 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.756+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f32e00fc6e0 con 0x7f32e0071f60 2024-02-28T16:38:17.745 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.757+0000 7f32d7400700 1 -- 172.21.15.148:0/1288576635 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f32cc0126b0 con 0x7f32e0071f60 2024-02-28T16:38:17.745 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:38:17.745 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:38:17.745 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:38:17.748 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.760+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f32c406d7e0 msgr2=0x7f32c406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.760+0000 7f32e6600700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f32c406d7e0 0x7f32c406fc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32d0000c00 tx=0x7f32d0009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.760+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 msgr2=0x7f32e011a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.760+0000 7f32e6600700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e011a5b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00c8c0 tx=0x7f32cc0044c0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.761+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 shutdown_connections 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.761+0000 7f32e6600700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f32c406d7e0 0x7f32c406fc90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.761+0000 7f32e6600700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f32e0070870 0x7f32e011a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.761+0000 7f32e6600700 1 --2- 172.21.15.148:0/1288576635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f32e0071f60 0x7f32e011a5b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.761+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 >> 172.21.15.148:0/1288576635 conn(0x7f32e00f8ae0 msgr2=0x7f32e00fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.761+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 shutdown_connections 2024-02-28T16:38:17.749 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:17.761+0000 7f32e6600700 1 -- 172.21.15.148:0/1288576635 wait complete. 2024-02-28T16:38:18.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:17 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1288576635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:38:18.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:17 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1288576635' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:38:19.028 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:18 smithi148 ceph-mon[112463]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:19.028 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:18 smithi148 ceph-mon[112463]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-28T16:38:19.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:18 smithi157 ceph-mon[89328]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:19.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:18 smithi157 ceph-mon[89328]: pgmap v226: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-02-28T16:38:21.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-28T16:38:21.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:21.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:21.061 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:38:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:21.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: pgmap v227: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 345 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-28T16:38:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:38:21.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:21.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:22 smithi148 ceph-mon[112463]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-28T16:38:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:22 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:22 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:38:23.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:22 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:22 smithi157 ceph-mon[89328]: pgmap v228: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-02-28T16:38:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:22 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:22 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.hinycn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:38:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:22 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:23.963 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:23 smithi157 ceph-mon[89328]: Upgrade: Updating mds.cephfs.smithi157.hinycn 2024-02-28T16:38:23.964 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:23 smithi157 ceph-mon[89328]: Deploying daemon mds.cephfs.smithi157.hinycn on smithi157 2024-02-28T16:38:24.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:23 smithi148 ceph-mon[112463]: Upgrade: Updating mds.cephfs.smithi157.hinycn 2024-02-28T16:38:24.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:23 smithi148 ceph-mon[112463]: Deploying daemon mds.cephfs.smithi157.hinycn on smithi157 2024-02-28T16:38:25.062 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:24 smithi157 ceph-mon[89328]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-02-28T16:38:25.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:24 smithi148 ceph-mon[112463]: pgmap v229: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4.5 KiB/s wr, 4 op/s 2024-02-28T16:38:26.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:25 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[112459]: 2024-02-28T16:38:25.908+0000 7fe006c00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 4.4 KiB/s wr, 2 op/s 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: osdmap e83: 6 total, 6 up, 6 in 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: Standby daemon mds.cephfs.smithi157.dreayg assigned to filesystem cephfs as rank 0 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:38:27.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:26 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi157.dreayg=up:replay} 2 up:standby 2024-02-28T16:38:27.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: pgmap v230: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 4.4 KiB/s wr, 2 op/s 2024-02-28T16:38:27.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:38:27.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:38:27.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: osdmap e83: 6 total, 6 up, 6 in 2024-02-28T16:38:27.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: Standby daemon mds.cephfs.smithi157.dreayg assigned to filesystem cephfs as rank 0 2024-02-28T16:38:27.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:38:27.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:38:27.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:26 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi157.dreayg=up:replay} 2 up:standby 2024-02-28T16:38:28.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:28.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:28.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:28 smithi157 ceph-mon[89328]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-02-28T16:38:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:29.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:28 smithi148 ceph-mon[112463]: pgmap v232: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 0 op/s 2024-02-28T16:38:31.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:30 smithi148 ceph-mon[112463]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-02-28T16:38:31.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:30 smithi157 ceph-mon[89328]: pgmap v233: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-02-28T16:38:33.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:32 smithi148 ceph-mon[112463]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:38:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:32 smithi157 ceph-mon[89328]: pgmap v234: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-02-28T16:38:35.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:34 smithi148 ceph-mon[112463]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T16:38:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:34 smithi157 ceph-mon[89328]: pgmap v235: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T16:38:37.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:36 smithi148 ceph-mon[112463]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-28T16:38:37.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:36 smithi148 ceph-mon[112463]: reconnect by client.24309 192.168.0.1:0/3439599588 after 0.00299995 2024-02-28T16:38:37.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:36 smithi148 ceph-mon[112463]: reconnect by client.14540 192.168.0.1:0/1904265939 after 0.00499991 2024-02-28T16:38:37.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:36 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:reconnect 2024-02-28T16:38:37.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:36 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi157.dreayg=up:reconnect} 2 up:standby 2024-02-28T16:38:37.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:36 smithi157 ceph-mon[89328]: pgmap v236: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-02-28T16:38:37.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:36 smithi157 ceph-mon[89328]: reconnect by client.24309 192.168.0.1:0/3439599588 after 0.00299995 2024-02-28T16:38:37.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:36 smithi157 ceph-mon[89328]: reconnect by client.14540 192.168.0.1:0/1904265939 after 0.00499991 2024-02-28T16:38:37.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:36 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:reconnect 2024-02-28T16:38:37.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:36 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi157.dreayg=up:reconnect} 2 up:standby 2024-02-28T16:38:38.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:37 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:rejoin 2024-02-28T16:38:38.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:37 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi157.dreayg=up:rejoin} 2 up:standby 2024-02-28T16:38:38.011 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:37 smithi157 ceph-mon[89328]: daemon mds.cephfs.smithi157.dreayg is now active in filesystem cephfs as rank 0 2024-02-28T16:38:38.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:37 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:rejoin 2024-02-28T16:38:38.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:37 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi157.dreayg=up:rejoin} 2 up:standby 2024-02-28T16:38:38.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:37 smithi148 ceph-mon[112463]: daemon mds.cephfs.smithi157.dreayg is now active in filesystem cephfs as rank 0 2024-02-28T16:38:38.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:38 smithi157 ceph-mon[89328]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-02-28T16:38:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:38 smithi157 ceph-mon[89328]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:38:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:38 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:active 2024-02-28T16:38:38.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:38 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi157.dreayg=up:active} 2 up:standby 2024-02-28T16:38:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:38 smithi148 ceph-mon[112463]: pgmap v237: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-02-28T16:38:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:38 smithi148 ceph-mon[112463]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:38:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:38 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] up:active 2024-02-28T16:38:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:38 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi157.dreayg=up:active} 2 up:standby 2024-02-28T16:38:40.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:40 smithi157 ceph-mon[89328]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:38:40.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:40 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:40.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:40 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:40.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:40 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:40 smithi148 ceph-mon[112463]: pgmap v238: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-02-28T16:38:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:40 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:40 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:41.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:40 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:42.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:41 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6824/1511558367,v1:172.21.15.157:6825/1511558367] up:boot 2024-02-28T16:38:42.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:41 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi157.dreayg=up:active} 3 up:standby 2024-02-28T16:38:42.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:41 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:38:42.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:41 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6824/1511558367,v1:172.21.15.157:6825/1511558367] up:boot 2024-02-28T16:38:42.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:41 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi157.dreayg=up:active} 3 up:standby 2024-02-28T16:38:42.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:41 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:38:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:42 smithi148 ceph-mon[112463]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-02-28T16:38:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:43.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:42 smithi157 ceph-mon[89328]: pgmap v239: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-02-28T16:38:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:45.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:44 smithi148 ceph-mon[112463]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 170 B/s wr, 5 op/s 2024-02-28T16:38:45.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:45.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:44 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:44 smithi157 ceph-mon[89328]: pgmap v240: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 9.4 MiB/s rd, 170 B/s wr, 5 op/s 2024-02-28T16:38:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:44 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:46 smithi157 ceph-mon[89328]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:38:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:46 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:47.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:46 smithi148 ceph-mon[112463]: pgmap v241: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 6.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T16:38:47.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:47.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:46 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 -- 172.21.15.148:0/485666678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 msgr2=0x7f57c01099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 --2- 172.21.15.148:0/485666678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c01099c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f57b0004940 tx=0x7f57b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 -- 172.21.15.148:0/485666678 shutdown_connections 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 --2- 172.21.15.148:0/485666678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57c0103dc0 0x7f57c0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 --2- 172.21.15.148:0/485666678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c01099c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 -- 172.21.15.148:0/485666678 >> 172.21.15.148:0/485666678 conn(0x7f57c0072d50 msgr2=0x7f57c0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 -- 172.21.15.148:0/485666678 shutdown_connections 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.929+0000 7f57c6800700 1 -- 172.21.15.148:0/485666678 wait complete. 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.930+0000 7f57c6800700 1 Processor -- start 2024-02-28T16:38:47.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.930+0000 7f57c6800700 1 -- start start 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.930+0000 7f57c6800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57c0103dc0 0x7f57c011a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57c6800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57c6800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c011ac70 con 0x7f57c01095f0 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57c6800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0113f80 con 0x7f57c0103dc0 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57bea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57bea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c011a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38804/0 (socket says 172.21.15.148:38804) 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57bea00700 1 -- 172.21.15.148:0/425998075 learned_addr learned my addr 172.21.15.148:0/425998075 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:47.920 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57bf400700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57c0103dc0 0x7f57c011a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:47.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57bea00700 1 -- 172.21.15.148:0/425998075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57c0103dc0 msgr2=0x7f57c011a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:47.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57bea00700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57c0103dc0 0x7f57c011a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:47.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.931+0000 7f57bea00700 1 -- 172.21.15.148:0/425998075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0005040 con 0x7f57c01095f0 2024-02-28T16:38:47.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.932+0000 7f57bea00700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c011a620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00c830 tx=0x7f57ac004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:47.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.932+0000 7f57b7400700 1 -- 172.21.15.148:0/425998075 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac0106f0 con 0x7f57c01095f0 2024-02-28T16:38:47.921 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.932+0000 7f57b7400700 1 -- 172.21.15.148:0/425998075 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57ac010d20 con 0x7f57c01095f0 2024-02-28T16:38:47.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.932+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c0114260 con 0x7f57c01095f0 2024-02-28T16:38:47.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.932+0000 7f57b7400700 1 -- 172.21.15.148:0/425998075 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57ac0113a0 con 0x7f57c01095f0 2024-02-28T16:38:47.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.932+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c01147a0 con 0x7f57c01095f0 2024-02-28T16:38:47.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.933+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0106850 con 0x7f57c01095f0 2024-02-28T16:38:47.922 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.935+0000 7f57b7400700 1 -- 172.21.15.148:0/425998075 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f57ac012400 con 0x7f57c01095f0 2024-02-28T16:38:47.923 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.936+0000 7f57b7400700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f57a406d7e0 0x7f57a406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:47.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.936+0000 7f57b7400700 1 -- 172.21.15.148:0/425998075 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f57ac08cef0 con 0x7f57c01095f0 2024-02-28T16:38:47.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.936+0000 7f57bf400700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f57a406d7e0 0x7f57a406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:47.924 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.937+0000 7f57bf400700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f57a406d7e0 0x7f57a406fc90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57b0004f90 tx=0x7f57b0009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:47.929 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:47.941+0000 7f57b7400700 1 -- 172.21.15.148:0/425998075 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f57ac05a220 con 0x7f57c01095f0 2024-02-28T16:38:48.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.181+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57c004bf70 con 0x7f57a406d7e0 2024-02-28T16:38:48.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.184+0000 7f57b7400700 1 -- 172.21.15.148:0/425998075 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f57b000b700 con 0x7f57a406d7e0 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.187+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f57a406d7e0 msgr2=0x7f57a406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.187+0000 7f57c6800700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f57a406d7e0 0x7f57a406fc90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f57b0004f90 tx=0x7f57b0009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.187+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 msgr2=0x7f57c011a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.187+0000 7f57c6800700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c011a620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00c830 tx=0x7f57ac004470 comp rx=0 tx=0).stop 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.188+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 shutdown_connections 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.188+0000 7f57c6800700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f57a406d7e0 0x7f57a406fc90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.188+0000 7f57c6800700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f57c0103dc0 0x7f57c011a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.188+0000 7f57c6800700 1 --2- 172.21.15.148:0/425998075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f57c01095f0 0x7f57c011a620 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.188+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 >> 172.21.15.148:0/425998075 conn(0x7f57c0072d50 msgr2=0x7f57c0074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.188+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 shutdown_connections 2024-02-28T16:38:48.176 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.188+0000 7f57c6800700 1 -- 172.21.15.148:0/425998075 wait complete. 2024-02-28T16:38:48.192 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.343+0000 7f831f400700 1 -- 172.21.15.148:0/656728440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 msgr2=0x7f8318070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.343+0000 7f831f400700 1 --2- 172.21.15.148:0/656728440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f8318070330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f830c004970 tx=0x7f830c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.344+0000 7f831f400700 1 -- 172.21.15.148:0/656728440 shutdown_connections 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.344+0000 7f831f400700 1 --2- 172.21.15.148:0/656728440 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8318070870 0x7f8318070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.344+0000 7f831f400700 1 --2- 172.21.15.148:0/656728440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f8318070330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.344+0000 7f831f400700 1 -- 172.21.15.148:0/656728440 >> 172.21.15.148:0/656728440 conn(0x7f83180f8ae0 msgr2=0x7f83180faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.344+0000 7f831f400700 1 -- 172.21.15.148:0/656728440 shutdown_connections 2024-02-28T16:38:48.332 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.344+0000 7f831f400700 1 -- 172.21.15.148:0/656728440 wait complete. 2024-02-28T16:38:48.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.344+0000 7f831f400700 1 Processor -- start 2024-02-28T16:38:48.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f831f400700 1 -- start start 2024-02-28T16:38:48.333 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f831f400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8318070870 0x7f831811a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f831f400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f831811a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f831f400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831811ac00 con 0x7f8318071f60 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f831f400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8318113f10 con 0x7f8318070870 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f8317e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f831811a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f8317e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f831811a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38834/0 (socket says 172.21.15.148:38834) 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.345+0000 7f8317e00700 1 -- 172.21.15.148:0/4272699835 learned_addr learned my addr 172.21.15.148:0/4272699835 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f831ca00700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8318070870 0x7f831811a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f8317e00700 1 -- 172.21.15.148:0/4272699835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8318070870 msgr2=0x7f831811a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f8317e00700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8318070870 0x7f831811a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f8317e00700 1 -- 172.21.15.148:0/4272699835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c005040 con 0x7f8318071f60 2024-02-28T16:38:48.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f8317e00700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f831811a5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8304002a50 tx=0x7f83040046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:48.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f8314c00700 1 -- 172.21.15.148:0/4272699835 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8304007cc0 con 0x7f8318071f60 2024-02-28T16:38:48.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f8314c00700 1 -- 172.21.15.148:0/4272699835 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f830400f040 con 0x7f8318071f60 2024-02-28T16:38:48.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f8314c00700 1 -- 172.21.15.148:0/4272699835 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8304009640 con 0x7f8318071f60 2024-02-28T16:38:48.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.346+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83181141f0 con 0x7f8318071f60 2024-02-28T16:38:48.335 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.347+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8318114730 con 0x7f8318071f60 2024-02-28T16:38:48.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.348+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83180fe400 con 0x7f8318071f60 2024-02-28T16:38:48.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.349+0000 7f8314c00700 1 -- 172.21.15.148:0/4272699835 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f83040097a0 con 0x7f8318071f60 2024-02-28T16:38:48.338 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.351+0000 7f8314c00700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f830006d7f0 0x7f830006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:48.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.351+0000 7f8314c00700 1 -- 172.21.15.148:0/4272699835 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f830408cc90 con 0x7f8318071f60 2024-02-28T16:38:48.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.351+0000 7f831ca00700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f830006d7f0 0x7f830006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:48.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.352+0000 7f831ca00700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f830006d7f0 0x7f830006fca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f830c004ee0 tx=0x7f830c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:48.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.356+0000 7f8314c00700 1 -- 172.21.15.148:0/4272699835 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8304059fc0 con 0x7f8318071f60 2024-02-28T16:38:48.582 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.594+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f831804bf40 con 0x7f830006d7f0 2024-02-28T16:38:48.584 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.596+0000 7f8314c00700 1 -- 172.21.15.148:0/4272699835 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f831804bf40 con 0x7f830006d7f0 2024-02-28T16:38:48.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f830006d7f0 msgr2=0x7f830006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.587 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f830006d7f0 0x7f830006fca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f830c004ee0 tx=0x7f830c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 msgr2=0x7f831811a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f831811a5b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8304002a50 tx=0x7f83040046b0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 shutdown_connections 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f830006d7f0 0x7f830006fca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8318070870 0x7f831811a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 --2- 172.21.15.148:0/4272699835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8318071f60 0x7f831811a5b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 >> 172.21.15.148:0/4272699835 conn(0x7f83180f8ae0 msgr2=0x7f83180fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 shutdown_connections 2024-02-28T16:38:48.588 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.599+0000 7f831f400700 1 -- 172.21.15.148:0/4272699835 wait complete. 2024-02-28T16:38:48.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 -- 172.21.15.148:0/2251492160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 msgr2=0x7f660c1092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 --2- 172.21.15.148:0/2251492160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c1092b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65f8004970 tx=0x7f65f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:48.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 -- 172.21.15.148:0/2251492160 shutdown_connections 2024-02-28T16:38:48.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 --2- 172.21.15.148:0/2251492160 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c1092b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.728 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 --2- 172.21.15.148:0/2251492160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0702d0 0x7f660c0706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 -- 172.21.15.148:0/2251492160 >> 172.21.15.148:0/2251492160 conn(0x7f660c0f8af0 msgr2=0x7f660c0faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:48.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 -- 172.21.15.148:0/2251492160 shutdown_connections 2024-02-28T16:38:48.729 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.740+0000 7f6613200700 1 -- 172.21.15.148:0/2251492160 wait complete. 2024-02-28T16:38:48.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.741+0000 7f6613200700 1 Processor -- start 2024-02-28T16:38:48.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.741+0000 7f6613200700 1 -- start start 2024-02-28T16:38:48.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f6613200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0702d0 0x7f660c115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:48.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f6613200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:48.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f6613200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c116780 con 0x7f660c070be0 2024-02-28T16:38:48.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f6613200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c10fad0 con 0x7f660c0702d0 2024-02-28T16:38:48.730 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f660b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:48.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f660b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38850/0 (socket says 172.21.15.148:38850) 2024-02-28T16:38:48.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f660b400700 1 -- 172.21.15.148:0/998967857 learned_addr learned my addr 172.21.15.148:0/998967857 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:48.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f660be00700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0702d0 0x7f660c115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:48.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f660b400700 1 -- 172.21.15.148:0/998967857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0702d0 msgr2=0x7f660c115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:48.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f660b400700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0702d0 0x7f660c115bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:48.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.742+0000 7f660b400700 1 -- 172.21.15.148:0/998967857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8005040 con 0x7f660c070be0 2024-02-28T16:38:48.731 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.743+0000 7f660b400700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c116130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009150 tx=0x7f65f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:48.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.743+0000 7f6603e00700 1 -- 172.21.15.148:0/998967857 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65f800e040 con 0x7f660c070be0 2024-02-28T16:38:48.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.743+0000 7f6603e00700 1 -- 172.21.15.148:0/998967857 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65f8004290 con 0x7f660c070be0 2024-02-28T16:38:48.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.743+0000 7f6603e00700 1 -- 172.21.15.148:0/998967857 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65f801c630 con 0x7f660c070be0 2024-02-28T16:38:48.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.743+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c10fd50 con 0x7f660c070be0 2024-02-28T16:38:48.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.743+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c110290 con 0x7f660c070be0 2024-02-28T16:38:48.732 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.744+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c106970 con 0x7f660c070be0 2024-02-28T16:38:48.733 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.745+0000 7f6603e00700 1 -- 172.21.15.148:0/998967857 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f65f8013980 con 0x7f660c070be0 2024-02-28T16:38:48.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.746+0000 7f6603e00700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f65f006d7f0 0x7f65f006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:48.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.746+0000 7f6603e00700 1 -- 172.21.15.148:0/998967857 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f65f808e240 con 0x7f660c070be0 2024-02-28T16:38:48.734 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.746+0000 7f660be00700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f65f006d7f0 0x7f65f006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:48.735 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.747+0000 7f660be00700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f65f006d7f0 0x7f65f006fca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0041d0 tx=0x7f65fc009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:48.738 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.751+0000 7f6603e00700 1 -- 172.21.15.148:0/998967857 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f65f8057ac0 con 0x7f660c070be0 2024-02-28T16:38:48.965 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:48.977+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f660c04bed0 con 0x7f65f006d7f0 2024-02-28T16:38:48.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.008+0000 7f6603e00700 1 -- 172.21.15.148:0/998967857 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f660c04bed0 con 0x7f65f006d7f0 2024-02-28T16:38:48.997 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:38:48.997 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (8m) 37s ago 24m 15.0M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:38:48.998 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (5m) 37s ago 24m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:38:48.998 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (5m) 4s ago 23m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:38:48.998 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (8m) 37s ago 23m 74.1M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:38:48.998 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (75s) 37s ago 16m 11.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 4d24e66401b9 2024-02-28T16:38:48.998 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (44s) 37s ago 16m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 777e874af3d3 2024-02-28T16:38:48.998 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (16m) 4s ago 16m 138M - 17.2.7-535-gc0f02e60 1c37ed371348 c882aab83da1 2024-02-28T16:38:48.999 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (9s) 4s ago 16m 9885k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f6672198e678 2024-02-28T16:38:48.999 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (11m) 37s ago 26m 509M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:38:48.999 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (10m) 4s ago 22m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:38:48.999 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (7m) 37s ago 26m 50.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:38:48.999 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (6m) 4s ago 22m 38.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:38:48.999 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (9m) 37s ago 24m 8028k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:38:49.000 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (9m) 4s ago 22m 7704k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:38:49.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (4m) 37s ago 21m 90.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:38:49.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (4m) 37s ago 20m 93.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:38:49.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (3m) 37s ago 19m 90.9M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:38:49.000 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (3m) 4s ago 19m 105M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:38:49.001 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (2m) 4s ago 18m 90.2M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 93c28b8b835a 2024-02-28T16:38:49.001 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (99s) 4s ago 18m 89.9M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 860ae8452ebf 2024-02-28T16:38:49.001 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (9m) 37s ago 23m 56.4M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:38:49.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.011+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f65f006d7f0 msgr2=0x7f65f006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.011+0000 7f6613200700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f65f006d7f0 0x7f65f006fca0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0041d0 tx=0x7f65fc009040 comp rx=0 tx=0).stop 2024-02-28T16:38:49.002 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.011+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 msgr2=0x7f660c116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.011+0000 7f6613200700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c116130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009150 tx=0x7f65f8009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.012+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 shutdown_connections 2024-02-28T16:38:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.012+0000 7f6613200700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f65f006d7f0 0x7f65f006fca0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.012+0000 7f6613200700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f660c0702d0 0x7f660c115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.012+0000 7f6613200700 1 --2- 172.21.15.148:0/998967857 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f660c070be0 0x7f660c116130 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.012+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 >> 172.21.15.148:0/998967857 conn(0x7f660c0f8af0 msgr2=0x7f660c103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:49.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.012+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 shutdown_connections 2024-02-28T16:38:49.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.012+0000 7f6613200700 1 -- 172.21.15.148:0/998967857 wait complete. 2024-02-28T16:38:49.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.149+0000 7f7acb600700 1 -- 172.21.15.148:0/3834900902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac4103dc0 msgr2=0x7f7ac4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.149+0000 7f7acb600700 1 --2- 172.21.15.148:0/3834900902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac4103dc0 0x7f7ac4104210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0004940 tx=0x7f7ab0009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:49.138 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:48 smithi148 ceph-mon[112463]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:38:49.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.149+0000 7f7acb600700 1 -- 172.21.15.148:0/3834900902 shutdown_connections 2024-02-28T16:38:49.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.149+0000 7f7acb600700 1 --2- 172.21.15.148:0/3834900902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac4103dc0 0x7f7ac4104210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.138 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.149+0000 7f7acb600700 1 --2- 172.21.15.148:0/3834900902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac41095f0 0x7f7ac41099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.149+0000 7f7acb600700 1 -- 172.21.15.148:0/3834900902 >> 172.21.15.148:0/3834900902 conn(0x7f7ac4072d50 msgr2=0x7f7ac4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:49.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.150+0000 7f7acb600700 1 -- 172.21.15.148:0/3834900902 shutdown_connections 2024-02-28T16:38:49.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.150+0000 7f7acb600700 1 -- 172.21.15.148:0/3834900902 wait complete. 2024-02-28T16:38:49.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.151+0000 7f7acb600700 1 Processor -- start 2024-02-28T16:38:49.139 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.151+0000 7f7acb600700 1 -- start start 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.151+0000 7f7acb600700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac4103dc0 0x7f7ac411a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.151+0000 7f7acb600700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac41095f0 0x7f7ac411a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.151+0000 7f7acb600700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac411abd0 con 0x7f7ac41095f0 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7acb600700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4113ee0 con 0x7f7ac4103dc0 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7ac3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac41095f0 0x7f7ac411a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7ac3e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac41095f0 0x7f7ac411a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38880/0 (socket says 172.21.15.148:38880) 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7ac3e00700 1 -- 172.21.15.148:0/2952613018 learned_addr learned my addr 172.21.15.148:0/2952613018 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:49.140 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7ac8c00700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac4103dc0 0x7f7ac411a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:49.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7ac3e00700 1 -- 172.21.15.148:0/2952613018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac4103dc0 msgr2=0x7f7ac411a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7ac3e00700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac4103dc0 0x7f7ac411a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.152+0000 7f7ac3e00700 1 -- 172.21.15.148:0/2952613018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0005040 con 0x7f7ac41095f0 2024-02-28T16:38:49.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.153+0000 7f7ac3e00700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac41095f0 0x7f7ac411a580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000b3b0 tx=0x7f7ab0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:49.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.153+0000 7f7ac0c00700 1 -- 172.21.15.148:0/2952613018 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab000e040 con 0x7f7ac41095f0 2024-02-28T16:38:49.141 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.153+0000 7f7ac0c00700 1 -- 172.21.15.148:0/2952613018 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ab000bbf0 con 0x7f7ac41095f0 2024-02-28T16:38:49.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.153+0000 7f7ac0c00700 1 -- 172.21.15.148:0/2952613018 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ab001c630 con 0x7f7ac41095f0 2024-02-28T16:38:49.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.153+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac4114160 con 0x7f7ac41095f0 2024-02-28T16:38:49.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.153+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac41146a0 con 0x7f7ac41095f0 2024-02-28T16:38:49.142 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.154+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac410b9c0 con 0x7f7ac41095f0 2024-02-28T16:38:49.143 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.156+0000 7f7ac0c00700 1 -- 172.21.15.148:0/2952613018 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7ab000bd60 con 0x7f7ac41095f0 2024-02-28T16:38:49.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.157+0000 7f7ac0c00700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7aac06d7e0 0x7f7aac06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:49.144 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.157+0000 7f7ac0c00700 1 -- 172.21.15.148:0/2952613018 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7ab008edb0 con 0x7f7ac41095f0 2024-02-28T16:38:49.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.157+0000 7f7ac8c00700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7aac06d7e0 0x7f7aac06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:49.145 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.158+0000 7f7ac8c00700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7aac06d7e0 0x7f7aac06fc90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007fd0 tx=0x7f7ab8009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:49.148 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.161+0000 7f7ac0c00700 1 -- 172.21.15.148:0/2952613018 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ab005c160 con 0x7f7ac41095f0 2024-02-28T16:38:49.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:48 smithi157 ceph-mon[89328]: pgmap v242: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:38:49.449 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.461+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7ac4075870 con 0x7f7ac41095f0 2024-02-28T16:38:49.450 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.463+0000 7f7ac0c00700 1 -- 172.21.15.148:0/2952613018 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f7ab005bcf0 con 0x7f7ac41095f0 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:49.451 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 17.2.7-535-gc0f02e60 (c0f02e608ed955f887728ffa27c686f52f9fd400) quincy (stable)": 1, 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 13 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:38:49.452 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:38:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7aac06d7e0 msgr2=0x7f7aac06fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7aac06d7e0 0x7f7aac06fc90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007fd0 tx=0x7f7ab8009040 comp rx=0 tx=0).stop 2024-02-28T16:38:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac41095f0 msgr2=0x7f7ac411a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.453 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac41095f0 0x7f7ac411a580 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000b3b0 tx=0x7f7ab0009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:49.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 shutdown_connections 2024-02-28T16:38:49.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7aac06d7e0 0x7f7aac06fc90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac4103dc0 0x7f7ac411a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 --2- 172.21.15.148:0/2952613018 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ac41095f0 0x7f7ac411a580 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.465+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 >> 172.21.15.148:0/2952613018 conn(0x7f7ac4072d50 msgr2=0x7f7ac4074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:49.454 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.466+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 shutdown_connections 2024-02-28T16:38:49.455 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.466+0000 7f7acb600700 1 -- 172.21.15.148:0/2952613018 wait complete. 2024-02-28T16:38:49.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 -- 172.21.15.148:0/2271891563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 msgr2=0x7f5a4c0fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 --2- 172.21.15.148:0/2271891563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c0fe320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c004940 tx=0x7f5a3c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 -- 172.21.15.148:0/2271891563 shutdown_connections 2024-02-28T16:38:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 --2- 172.21.15.148:0/2271891563 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a4c0fe8f0 0x7f5a4c106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 --2- 172.21.15.148:0/2271891563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c0fe320 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 -- 172.21.15.148:0/2271891563 >> 172.21.15.148:0/2271891563 conn(0x7f5a4c0f79e0 msgr2=0x7f5a4c0f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 -- 172.21.15.148:0/2271891563 shutdown_connections 2024-02-28T16:38:49.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.611+0000 7f5a52200700 1 -- 172.21.15.148:0/2271891563 wait complete. 2024-02-28T16:38:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.612+0000 7f5a52200700 1 Processor -- start 2024-02-28T16:38:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.612+0000 7f5a52200700 1 -- start start 2024-02-28T16:38:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a52200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a52200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a4c0fe8f0 0x7f5a4c116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a52200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c1167b0 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a52200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c10fb00 con 0x7f5a4c0fe8f0 2024-02-28T16:38:49.601 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a4b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a4b400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38888/0 (socket says 172.21.15.148:38888) 2024-02-28T16:38:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a4b400700 1 -- 172.21.15.148:0/2450566793 learned_addr learned my addr 172.21.15.148:0/2450566793 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a4aa00700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a4c0fe8f0 0x7f5a4c116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a4b400700 1 -- 172.21.15.148:0/2450566793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a4c0fe8f0 msgr2=0x7f5a4c116160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a4b400700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a4c0fe8f0 0x7f5a4c116160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.613+0000 7f5a4b400700 1 -- 172.21.15.148:0/2450566793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c005040 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.614+0000 7f5a4b400700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c115c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c000c00 tx=0x7f5a3c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:49.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.614+0000 7f5a43400700 1 -- 172.21.15.148:0/2450566793 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a3c00e040 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.614+0000 7f5a43400700 1 -- 172.21.15.148:0/2450566793 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a3c009af0 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.614+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c10fd80 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.614+0000 7f5a43400700 1 -- 172.21.15.148:0/2450566793 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a3c01c630 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.614+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c1102c0 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.615+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c106940 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.616+0000 7f5a43400700 1 -- 172.21.15.148:0/2450566793 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5a3c00bbf0 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.617+0000 7f5a43400700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a3006d7e0 0x7f5a3006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:49.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.617+0000 7f5a43400700 1 -- 172.21.15.148:0/2450566793 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5a3c08e1e0 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.617+0000 7f5a4aa00700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a3006d7e0 0x7f5a3006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:49.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.618+0000 7f5a4aa00700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a3006d7e0 0x7f5a3006fc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c1114c0 tx=0x7f5a38009ee0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:49.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.621+0000 7f5a43400700 1 -- 172.21.15.148:0/2450566793 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5a3c057b20 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.883+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a4c04bed0 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.884+0000 7f5a43400700 1 -- 172.21.15.148:0/2450566793 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1855 (secure 0 0 0) 0x7f5a3c05b1e0 con 0x7f5a4c0fdf50 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout:e28 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:38:49.873 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 27 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:38:36.957794+0000 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 83 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:38:49.874 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=24267} 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{0:24267} state up:active seq 242 join_fscid=1 addr [v2:172.21.15.157:6826/2090793909,v1:172.21.15.157:6827/2090793909] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:38:49.875 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:38:49.876 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{-1:34428} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:38:49.876 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{-1:34460} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6828/1814235745,v1:172.21.15.148:6829/1814235745] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:38:49.876 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:44279} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6824/1511558367,v1:172.21.15.157:6825/1511558367] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a3006d7e0 msgr2=0x7f5a3006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a3006d7e0 0x7f5a3006fc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c1114c0 tx=0x7f5a38009ee0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 msgr2=0x7f5a4c115c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c115c20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c000c00 tx=0x7f5a3c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 shutdown_connections 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f5a3006d7e0 0x7f5a3006fc90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a4c0fdf50 0x7f5a4c115c20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 --2- 172.21.15.148:0/2450566793 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5a4c0fe8f0 0x7f5a4c116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.887+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 >> 172.21.15.148:0/2450566793 conn(0x7f5a4c0f79e0 msgr2=0x7f5a4c103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.888+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 shutdown_connections 2024-02-28T16:38:49.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:49.888+0000 7f5a52200700 1 -- 172.21.15.148:0/2450566793 wait complete. 2024-02-28T16:38:49.878 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 28 2024-02-28T16:38:50.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.030+0000 7fee60e00700 1 -- 172.21.15.148:0/1322023737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105170 msgr2=0x7fee5c105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.030+0000 7fee60e00700 1 --2- 172.21.15.148:0/1322023737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105170 0x7fee5c105540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee4c004940 tx=0x7fee4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:50.019 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.031+0000 7fee60e00700 1 -- 172.21.15.148:0/1322023737 shutdown_connections 2024-02-28T16:38:50.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.031+0000 7fee60e00700 1 --2- 172.21.15.148:0/1322023737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee5c105b10 0x7fee5c0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.031+0000 7fee60e00700 1 --2- 172.21.15.148:0/1322023737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105170 0x7fee5c105540 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.031+0000 7fee60e00700 1 -- 172.21.15.148:0/1322023737 >> 172.21.15.148:0/1322023737 conn(0x7fee5c0face0 msgr2=0x7fee5c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:50.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.031+0000 7fee60e00700 1 -- 172.21.15.148:0/1322023737 shutdown_connections 2024-02-28T16:38:50.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.031+0000 7fee60e00700 1 -- 172.21.15.148:0/1322023737 wait complete. 2024-02-28T16:38:50.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee60e00700 1 Processor -- start 2024-02-28T16:38:50.020 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee60e00700 1 -- start start 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee60e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee5c105170 0x7fee5c115bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee60e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105b10 0x7fee5c116130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee60e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c116780 con 0x7fee5c105b10 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee60e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c10fad0 con 0x7fee5c105170 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee59400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105b10 0x7fee5c116130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee59400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105b10 0x7fee5c116130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38906/0 (socket says 172.21.15.148:38906) 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.032+0000 7fee59400700 1 -- 172.21.15.148:0/2602180972 learned_addr learned my addr 172.21.15.148:0/2602180972 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee59e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee5c105170 0x7fee5c115bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:50.022 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee59400700 1 -- 172.21.15.148:0/2602180972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee5c105170 msgr2=0x7fee5c115bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee59400700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee5c105170 0x7fee5c115bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee59400700 1 -- 172.21.15.148:0/2602180972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c005040 con 0x7fee5c105b10 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee59400700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105b10 0x7fee5c116130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee4800eb40 tx=0x7fee4800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee52000700 1 -- 172.21.15.148:0/2602180972 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee48007cc0 con 0x7fee5c105b10 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee52000700 1 -- 172.21.15.148:0/2602180972 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee4800f040 con 0x7fee5c105b10 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.033+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c10fd50 con 0x7fee5c105b10 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.034+0000 7fee52000700 1 -- 172.21.15.148:0/2602180972 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee4800c9d0 con 0x7fee5c105b10 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.034+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c110290 con 0x7fee5c105b10 2024-02-28T16:38:50.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.035+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c0fe900 con 0x7fee5c105b10 2024-02-28T16:38:50.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.036+0000 7fee52000700 1 -- 172.21.15.148:0/2602180972 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fee4800cb30 con 0x7fee5c105b10 2024-02-28T16:38:50.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.036+0000 7fee52000700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fee4006d7f0 0x7fee4006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:50.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.037+0000 7fee52000700 1 -- 172.21.15.148:0/2602180972 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fee4808c800 con 0x7fee5c105b10 2024-02-28T16:38:50.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.037+0000 7fee59e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fee4006d7f0 0x7fee4006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:50.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.037+0000 7fee59e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fee4006d7f0 0x7fee4006fca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00b0d0 tx=0x7fee4c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:50.028 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.041+0000 7fee52000700 1 -- 172.21.15.148:0/2602180972 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fee48056130 con 0x7fee5c105b10 2024-02-28T16:38:50.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:49 smithi148 ceph-mon[112463]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:50.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:49 smithi148 ceph-mon[112463]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:50.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:49 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2952613018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:50.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:49 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2450566793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:38:50.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:49 smithi157 ceph-mon[89328]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:50.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:49 smithi157 ceph-mon[89328]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:50.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:49 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2952613018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:50.178 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:49 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2450566793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:38:50.255 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.267+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fee5c111240 con 0x7fee4006d7f0 2024-02-28T16:38:50.257 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.270+0000 7fee52000700 1 -- 172.21.15.148:0/2602180972 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fee5c111240 con 0x7fee4006d7f0 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": true, 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [ 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr", 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "mon", 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "crash", 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "osd" 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: ], 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": "15/21 daemons upgraded", 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T16:38:50.258 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:38:50.259 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:38:50.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fee4006d7f0 msgr2=0x7fee4006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fee4006d7f0 0x7fee4006fca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00b0d0 tx=0x7fee4c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105b10 msgr2=0x7fee5c116130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105b10 0x7fee5c116130 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee4800eb40 tx=0x7fee4800b040 comp rx=0 tx=0).stop 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 shutdown_connections 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fee4006d7f0 0x7fee4006fca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fee5c105170 0x7fee5c115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 --2- 172.21.15.148:0/2602180972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee5c105b10 0x7fee5c116130 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.272+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 >> 172.21.15.148:0/2602180972 conn(0x7fee5c0face0 msgr2=0x7fee5c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.273+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 shutdown_connections 2024-02-28T16:38:50.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.273+0000 7fee60e00700 1 -- 172.21.15.148:0/2602180972 wait complete. 2024-02-28T16:38:50.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 -- 172.21.15.148:0/845460145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9301027e0 msgr2=0x7fc9300fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 --2- 172.21.15.148:0/845460145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9301027e0 0x7fc9300fbea0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc91c004940 tx=0x7fc91c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:50.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 -- 172.21.15.148:0/845460145 shutdown_connections 2024-02-28T16:38:50.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 --2- 172.21.15.148:0/845460145 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9301027e0 0x7fc9300fbea0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 --2- 172.21.15.148:0/845460145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc930101e40 0x7fc930102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 -- 172.21.15.148:0/845460145 >> 172.21.15.148:0/845460145 conn(0x7fc930071d90 msgr2=0x7fc930072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:50.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 -- 172.21.15.148:0/845460145 shutdown_connections 2024-02-28T16:38:50.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.419+0000 7fc934e00700 1 -- 172.21.15.148:0/845460145 wait complete. 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.420+0000 7fc934e00700 1 Processor -- start 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.420+0000 7fc934e00700 1 -- start start 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.420+0000 7fc934e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc930101e40 0x7fc930113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.420+0000 7fc934e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9301027e0 0x7fc930113fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.420+0000 7fc934e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9301146a0 con 0x7fc930101e40 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.420+0000 7fc934e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93010d940 con 0x7fc9301027e0 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc930101e40 0x7fc930113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc930101e40 0x7fc930113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:38924/0 (socket says 172.21.15.148:38924) 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92de00700 1 -- 172.21.15.148:0/1572285693 learned_addr learned my addr 172.21.15.148:0/1572285693 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92d400700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9301027e0 0x7fc930113fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92de00700 1 -- 172.21.15.148:0/1572285693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9301027e0 msgr2=0x7fc930113fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92de00700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9301027e0 0x7fc930113fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92de00700 1 -- 172.21.15.148:0/1572285693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c005040 con 0x7fc930101e40 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.421+0000 7fc92de00700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc930101e40 0x7fc930113a80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc92000b790 tx=0x7fc920009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.422+0000 7fc926000700 1 -- 172.21.15.148:0/1572285693 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92000f770 con 0x7fc930101e40 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.422+0000 7fc926000700 1 -- 172.21.15.148:0/1572285693 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc92000fda0 con 0x7fc930101e40 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.422+0000 7fc926000700 1 -- 172.21.15.148:0/1572285693 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92000d310 con 0x7fc930101e40 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.422+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93010dc20 con 0x7fc930101e40 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.422+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93010e160 con 0x7fc930101e40 2024-02-28T16:38:50.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.423+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9300738b0 con 0x7fc930101e40 2024-02-28T16:38:50.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.424+0000 7fc926000700 1 -- 172.21.15.148:0/1572285693 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc920010420 con 0x7fc930101e40 2024-02-28T16:38:50.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.424+0000 7fc926000700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc91406d7f0 0x7fc91406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:38:50.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.425+0000 7fc926000700 1 -- 172.21.15.148:0/1572285693 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc92008cf20 con 0x7fc930101e40 2024-02-28T16:38:50.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.425+0000 7fc92d400700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc91406d7f0 0x7fc91406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:38:50.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.425+0000 7fc92d400700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc91406d7f0 0x7fc91406fca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc93010f2b0 tx=0x7fc91c009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:38:50.416 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.429+0000 7fc926000700 1 -- 172.21.15.148:0/1572285693 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc92005a2d0 con 0x7fc930101e40 2024-02-28T16:38:50.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.714+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc93010f090 con 0x7fc930101e40 2024-02-28T16:38:50.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.715+0000 7fc926000700 1 -- 172.21.15.148:0/1572285693 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc920059e60 con 0x7fc930101e40 2024-02-28T16:38:50.703 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:38:50.703 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:38:50.703 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:38:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.717+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc91406d7f0 msgr2=0x7fc91406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.717+0000 7fc934e00700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc91406d7f0 0x7fc91406fca0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc93010f2b0 tx=0x7fc91c009e30 comp rx=0 tx=0).stop 2024-02-28T16:38:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.717+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc930101e40 msgr2=0x7fc930113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:38:50.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.717+0000 7fc934e00700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc930101e40 0x7fc930113a80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc92000b790 tx=0x7fc920009250 comp rx=0 tx=0).stop 2024-02-28T16:38:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.718+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 shutdown_connections 2024-02-28T16:38:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.718+0000 7fc934e00700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc91406d7f0 0x7fc91406fca0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.718+0000 7fc934e00700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc930101e40 0x7fc930113a80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.718+0000 7fc934e00700 1 --2- 172.21.15.148:0/1572285693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc9301027e0 0x7fc930113fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:38:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.718+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 >> 172.21.15.148:0/1572285693 conn(0x7fc930071d90 msgr2=0x7fc930065740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:38:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.718+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 shutdown_connections 2024-02-28T16:38:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:38:50.718+0000 7fc934e00700 1 -- 172.21.15.148:0/1572285693 wait complete. 2024-02-28T16:38:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:50 smithi148 ceph-mon[112463]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:50 smithi148 ceph-mon[112463]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:38:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:50 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1572285693' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:38:51.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:50 smithi157 ceph-mon[89328]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:51.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:50 smithi157 ceph-mon[89328]: pgmap v243: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T16:38:51.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:50 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1572285693' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:38:52.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:51 smithi157 ceph-mon[89328]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:52.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:51 smithi148 ceph-mon[112463]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:38:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:52 smithi157 ceph-mon[89328]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-28T16:38:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:38:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:52 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:52 smithi148 ceph-mon[112463]: pgmap v244: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-28T16:38:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:38:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:52 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:53.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:53.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:53.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:53.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:53.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:53 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:54.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:38:54.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:54.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:54.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:54.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:53 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:38:55.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:54 smithi157 ceph-mon[89328]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-02-28T16:38:55.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:54 smithi148 ceph-mon[112463]: pgmap v245: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-02-28T16:38:56.600 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:56 smithi157 ceph-mon[89328]: Upgrade: Updating mds.cephfs.smithi157.dreayg 2024-02-28T16:38:56.600 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:56.600 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:38:56.600 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:56 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:56.600 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:56 smithi157 ceph-mon[89328]: Deploying daemon mds.cephfs.smithi157.dreayg on smithi157 2024-02-28T16:38:56.600 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:56 smithi157 ceph-mon[89328]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-02-28T16:38:56.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:56 smithi148 ceph-mon[112463]: Upgrade: Updating mds.cephfs.smithi157.dreayg 2024-02-28T16:38:56.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:38:56.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi157.dreayg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T16:38:56.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:56 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:38:56.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:56 smithi148 ceph-mon[112463]: Deploying daemon mds.cephfs.smithi157.dreayg on smithi157 2024-02-28T16:38:56.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:56 smithi148 ceph-mon[112463]: pgmap v246: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-02-28T16:38:58.096 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:57 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:58.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[112459]: 2024-02-28T16:38:58.553+0000 7fe006c00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: osdmap e84: 6 total, 6 up, 6 in 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: Standby daemon mds.cephfs.smithi148.mgdxsi assigned to filesystem cephfs as rank 0 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:replay} 2 up:standby 2024-02-28T16:38:58.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:38:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:38:59.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: pgmap v247: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: osdmap e84: 6 total, 6 up, 6 in 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: Standby daemon mds.cephfs.smithi148.mgdxsi assigned to filesystem cephfs as rank 0 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:replay} 2 up:standby 2024-02-28T16:38:59.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:38:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:39:01.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:00 smithi148 ceph-mon[112463]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-02-28T16:39:01.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:00 smithi157 ceph-mon[89328]: pgmap v249: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-02-28T16:39:03.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:02 smithi148 ceph-mon[112463]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-02-28T16:39:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:02 smithi157 ceph-mon[89328]: pgmap v250: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 7.2 MiB/s rd, 2 op/s 2024-02-28T16:39:04.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:04 smithi157 ceph-mon[89328]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-02-28T16:39:05.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:04 smithi148 ceph-mon[112463]: pgmap v251: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 3 op/s 2024-02-28T16:39:06.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:06.851 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:06.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:06.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:06 smithi157 ceph-mon[89328]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:39:06.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:06 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.157:6826/3119390220,v1:172.21.15.157:6827/3119390220] up:boot 2024-02-28T16:39:06.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:06 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:replay} 3 up:standby 2024-02-28T16:39:06.852 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:06 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:39:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:06 smithi148 ceph-mon[112463]: pgmap v252: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T16:39:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:06 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.157:6826/3119390220,v1:172.21.15.157:6827/3119390220] up:boot 2024-02-28T16:39:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:06 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:replay} 3 up:standby 2024-02-28T16:39:06.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:06 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:39:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:08 smithi148 ceph-mon[112463]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-02-28T16:39:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:08 smithi148 ceph-mon[112463]: reconnect by client.14540 192.168.0.1:0/1904265939 after 0.000999977 2024-02-28T16:39:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:08 smithi148 ceph-mon[112463]: reconnect by client.24309 192.168.0.1:0/3439599588 after 0.00199995 2024-02-28T16:39:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:08 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:reconnect 2024-02-28T16:39:09.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:08 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:reconnect} 3 up:standby 2024-02-28T16:39:09.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:08 smithi157 ceph-mon[89328]: pgmap v253: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 6 op/s 2024-02-28T16:39:09.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:08 smithi157 ceph-mon[89328]: reconnect by client.14540 192.168.0.1:0/1904265939 after 0.000999977 2024-02-28T16:39:09.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:08 smithi157 ceph-mon[89328]: reconnect by client.24309 192.168.0.1:0/3439599588 after 0.00199995 2024-02-28T16:39:09.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:08 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:reconnect 2024-02-28T16:39:09.138 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:08 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:reconnect} 3 up:standby 2024-02-28T16:39:09.869 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:09 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:rejoin 2024-02-28T16:39:09.869 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:09 smithi157 ceph-mon[89328]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:rejoin} 3 up:standby 2024-02-28T16:39:09.869 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:09 smithi157 ceph-mon[89328]: daemon mds.cephfs.smithi148.mgdxsi is now active in filesystem cephfs as rank 0 2024-02-28T16:39:09.869 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:09 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:09.869 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:09 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:10.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:09 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:rejoin 2024-02-28T16:39:10.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:09 smithi148 ceph-mon[112463]: fsmap cephfs:1/1 {0=cephfs.smithi148.mgdxsi=up:rejoin} 3 up:standby 2024-02-28T16:39:10.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:09 smithi148 ceph-mon[112463]: daemon mds.cephfs.smithi148.mgdxsi is now active in filesystem cephfs as rank 0 2024-02-28T16:39:10.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:09 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:10.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:09 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:11.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:10 smithi148 ceph-mon[112463]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-28T16:39:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:10 smithi148 ceph-mon[112463]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:39:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:10 smithi148 ceph-mon[112463]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:active 2024-02-28T16:39:11.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:10 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:39:11.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:10 smithi157 ceph-mon[89328]: pgmap v254: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 6 op/s 2024-02-28T16:39:11.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:10 smithi157 ceph-mon[89328]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T16:39:11.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:10 smithi157 ceph-mon[89328]: mds.? [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] up:active 2024-02-28T16:39:11.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:10 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:39:12.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:12.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:12.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:12 smithi148 ceph-mon[112463]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:39:12.431 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:12.431 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:12.431 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:12 smithi157 ceph-mon[89328]: pgmap v255: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:39:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:13.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:14.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:14 smithi157 ceph-mon[89328]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:39:14.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:14 smithi148 ceph-mon[112463]: pgmap v256: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 6 op/s 2024-02-28T16:39:16.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:16 smithi157 ceph-mon[89328]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-02-28T16:39:16.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:16 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:16.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:16 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:16.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:16 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:16.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:16 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:16.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:16 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:16 smithi148 ceph-mon[112463]: pgmap v257: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-02-28T16:39:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:17.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:16 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.mgdxsi"}]': finished 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.nqnotw"}]': finished 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.dreayg"}]': finished 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.hinycn"}]': finished 2024-02-28T16:39:18.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:17 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-28T16:39:18.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.mgdxsi"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.mgdxsi"}]': finished 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.nqnotw"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi148.nqnotw"}]': finished 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.dreayg"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.dreayg"}]': finished 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.hinycn"}]: dispatch 2024-02-28T16:39:18.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi157.hinycn"}]': finished 2024-02-28T16:39:18.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:17 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-28T16:39:19.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all mds 2024-02-28T16:39:19.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: Upgrade: Setting filesystem cephfs Joinable 2024-02-28T16:39:19.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-02-28T16:39:19.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-28T16:39:19.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:39:19.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T16:39:19.126 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:39:19.127 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:39:19.128 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:39:19.129 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:18 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all mds 2024-02-28T16:39:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: Upgrade: Setting filesystem cephfs Joinable 2024-02-28T16:39:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: pgmap v258: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-02-28T16:39:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-28T16:39:19.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: fsmap cephfs:1 {0=cephfs.smithi148.mgdxsi=up:active} 3 up:standby 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T16:39:19.239 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T16:39:19.240 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.241 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T16:39:19.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T16:39:19.242 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T16:39:19.243 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:18 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all rgw 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all nfs 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Finalizing container_image settings 2024-02-28T16:39:20.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: Upgrade: Complete! 2024-02-28T16:39:20.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:20.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:20.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:19 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all rgw 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all iscsi 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all nfs 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Setting container_image for all nvmeof 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Finalizing container_image settings 2024-02-28T16:39:20.221 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: Upgrade: Complete! 2024-02-28T16:39:20.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:20.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:20.222 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:19 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 -- 172.21.15.148:0/899101780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 msgr2=0x7f04bc0ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 --2- 172.21.15.148:0/899101780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc0ff180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009ce0 tx=0x7f04a4004d10 comp rx=0 tx=0).stop 2024-02-28T16:39:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 -- 172.21.15.148:0/899101780 shutdown_connections 2024-02-28T16:39:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 --2- 172.21.15.148:0/899101780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc0ff180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 --2- 172.21.15.148:0/899101780 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04bc105170 0x7f04bc105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:20.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 -- 172.21.15.148:0/899101780 >> 172.21.15.148:0/899101780 conn(0x7f04bc0face0 msgr2=0x7f04bc0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 -- 172.21.15.148:0/899101780 shutdown_connections 2024-02-28T16:39:20.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.883+0000 7f04c3200700 1 -- 172.21.15.148:0/899101780 wait complete. 2024-02-28T16:39:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.884+0000 7f04c3200700 1 Processor -- start 2024-02-28T16:39:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.884+0000 7f04c3200700 1 -- start start 2024-02-28T16:39:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.884+0000 7f04c3200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04bc105170 0x7f04bc115f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.884+0000 7f04c3200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc116460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.884+0000 7f04c3200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc116b40 con 0x7f04bc105b10 2024-02-28T16:39:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04c3200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc10fdc0 con 0x7f04bc105170 2024-02-28T16:39:20.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04b3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc116460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04b3400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc116460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:39864/0 (socket says 172.21.15.148:39864) 2024-02-28T16:39:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04b3400700 1 -- 172.21.15.148:0/1876451088 learned_addr learned my addr 172.21.15.148:0/1876451088 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:39:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04bbe00700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04bc105170 0x7f04bc115f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04b3400700 1 -- 172.21.15.148:0/1876451088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04bc105170 msgr2=0x7f04bc115f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04b3400700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04bc105170 0x7f04bc115f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.885+0000 7f04b3400700 1 -- 172.21.15.148:0/1876451088 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a4009940 con 0x7f04bc105b10 2024-02-28T16:39:20.874 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.886+0000 7f04b3400700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc116460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04a400bec0 tx=0x7f04a4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.886+0000 7f04b8c00700 1 -- 172.21.15.148:0/1876451088 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a400e040 con 0x7f04bc105b10 2024-02-28T16:39:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.886+0000 7f04b8c00700 1 -- 172.21.15.148:0/1876451088 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04a40128e0 con 0x7f04bc105b10 2024-02-28T16:39:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.886+0000 7f04b8c00700 1 -- 172.21.15.148:0/1876451088 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a401c880 con 0x7f04bc105b10 2024-02-28T16:39:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.886+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc10ffe0 con 0x7f04bc105b10 2024-02-28T16:39:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.886+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc110520 con 0x7f04bc105b10 2024-02-28T16:39:20.875 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.887+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc102480 con 0x7f04bc105b10 2024-02-28T16:39:20.876 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.888+0000 7f04b8c00700 1 -- 172.21.15.148:0/1876451088 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f04a4012a50 con 0x7f04bc105b10 2024-02-28T16:39:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.889+0000 7f04b8c00700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f04a006d7f0 0x7f04a006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.889+0000 7f04b8c00700 1 -- 172.21.15.148:0/1876451088 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f04a408ebc0 con 0x7f04bc105b10 2024-02-28T16:39:20.877 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.890+0000 7f04bbe00700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f04a006d7f0 0x7f04a006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:20.878 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.890+0000 7f04bbe00700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f04a006d7f0 0x7f04a006fca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006fd0 tx=0x7f04ac008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:20.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:20.894+0000 7f04b8c00700 1 -- 172.21.15.148:0/1876451088 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f04a405be70 con 0x7f04bc105b10 2024-02-28T16:39:21.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.133+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04bc111500 con 0x7f04a006d7f0 2024-02-28T16:39:21.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:20 smithi148 ceph-mon[112463]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:39:21.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:21.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:21.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:21.125 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.135+0000 7f04b8c00700 1 -- 172.21.15.148:0/1876451088 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f04bc111500 con 0x7f04a006d7f0 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f04a006d7f0 msgr2=0x7f04a006fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f04a006d7f0 0x7f04a006fca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006fd0 tx=0x7f04ac008040 comp rx=0 tx=0).stop 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 msgr2=0x7f04bc116460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc116460 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04a400bec0 tx=0x7f04a4004d10 comp rx=0 tx=0).stop 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 shutdown_connections 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f04a006d7f0 0x7f04a006fca0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04bc105170 0x7f04bc115f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 --2- 172.21.15.148:0/1876451088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f04bc105b10 0x7f04bc116460 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 >> 172.21.15.148:0/1876451088 conn(0x7f04bc0face0 msgr2=0x7f04bc0fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 shutdown_connections 2024-02-28T16:39:21.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:21.138+0000 7f04c3200700 1 -- 172.21.15.148:0/1876451088 wait complete. 2024-02-28T16:39:21.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:20 smithi157 ceph-mon[89328]: pgmap v259: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:39:21.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:39:21.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:39:21.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:39:21.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:21.996 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T16:39:22.499 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:39:22.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:22 smithi148 ceph-mon[112463]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:39:22.974 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:22 smithi148 ceph-mon[112463]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 425 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:39:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:22 smithi157 ceph-mon[89328]: from='client.34524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:39:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:22 smithi157 ceph-mon[89328]: pgmap v260: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 425 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-02-28T16:39:24.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:23 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:24.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:23 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:39:24.627 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.639+0000 7f7255400700 1 -- 172.21.15.148:0/1461490017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 msgr2=0x7f72500fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.639+0000 7f7255400700 1 --2- 172.21.15.148:0/1461490017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f72500fcf60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f723c004940 tx=0x7f723c009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.639+0000 7f7255400700 1 -- 172.21.15.148:0/1461490017 shutdown_connections 2024-02-28T16:39:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.639+0000 7f7255400700 1 --2- 172.21.15.148:0/1461490017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f72500fcf60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.639+0000 7f7255400700 1 --2- 172.21.15.148:0/1461490017 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7250102f50 0x7f7250103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.639+0000 7f7255400700 1 -- 172.21.15.148:0/1461490017 >> 172.21.15.148:0/1461490017 conn(0x7f72500f8ae0 msgr2=0x7f72500faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.640+0000 7f7255400700 1 -- 172.21.15.148:0/1461490017 shutdown_connections 2024-02-28T16:39:24.628 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.640+0000 7f7255400700 1 -- 172.21.15.148:0/1461490017 wait complete. 2024-02-28T16:39:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.640+0000 7f7255400700 1 Processor -- start 2024-02-28T16:39:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.641+0000 7f7255400700 1 -- start start 2024-02-28T16:39:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.641+0000 7f7255400700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7250102f50 0x7f7250115c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.641+0000 7f7255400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f7250116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.641+0000 7f7255400700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72501167a0 con 0x7f72501038f0 2024-02-28T16:39:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.641+0000 7f7255400700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725010fb40 con 0x7f7250102f50 2024-02-28T16:39:24.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.641+0000 7f724de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f7250116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:24.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.642+0000 7f724de00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f7250116150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53026/0 (socket says 172.21.15.148:53026) 2024-02-28T16:39:24.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.642+0000 7f724de00700 1 -- 172.21.15.148:0/2292758976 learned_addr learned my addr 172.21.15.148:0/2292758976 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:39:24.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.642+0000 7f724e800700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7250102f50 0x7f7250115c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:24.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.642+0000 7f724de00700 1 -- 172.21.15.148:0/2292758976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7250102f50 msgr2=0x7f7250115c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:24.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.642+0000 7f724de00700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7250102f50 0x7f7250115c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:24.630 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.642+0000 7f724de00700 1 -- 172.21.15.148:0/2292758976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c005040 con 0x7f72501038f0 2024-02-28T16:39:24.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.643+0000 7f724de00700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f7250116150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f723c009030 tx=0x7f723c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:24.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.643+0000 7f7246a00700 1 -- 172.21.15.148:0/2292758976 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f723c00e040 con 0x7f72501038f0 2024-02-28T16:39:24.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.643+0000 7f7246a00700 1 -- 172.21.15.148:0/2292758976 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f723c009400 con 0x7f72501038f0 2024-02-28T16:39:24.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.643+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725010fdc0 con 0x7f72501038f0 2024-02-28T16:39:24.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.644+0000 7f7246a00700 1 -- 172.21.15.148:0/2292758976 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f723c01c3f0 con 0x7f72501038f0 2024-02-28T16:39:24.631 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.644+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250110300 con 0x7f72501038f0 2024-02-28T16:39:24.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.645+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72500fc6e0 con 0x7f72501038f0 2024-02-28T16:39:24.634 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.647+0000 7f7246a00700 1 -- 172.21.15.148:0/2292758976 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f723c00bbf0 con 0x7f72501038f0 2024-02-28T16:39:24.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.648+0000 7f7246a00700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f723406d7f0 0x7f723406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:24.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.648+0000 7f7246a00700 1 -- 172.21.15.148:0/2292758976 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f723c08e320 con 0x7f72501038f0 2024-02-28T16:39:24.635 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.648+0000 7f724e800700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f723406d7f0 0x7f723406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:24.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.649+0000 7f724e800700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f723406d7f0 0x7f723406fca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72400041d0 tx=0x7f72400043c0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:24.641 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.653+0000 7f7246a00700 1 -- 172.21.15.148:0/2292758976 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f723c05b610 con 0x7f72501038f0 2024-02-28T16:39:24.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.885+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f725004bed0 con 0x7f723406d7f0 2024-02-28T16:39:24.900 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.912+0000 7f7246a00700 1 -- 172.21.15.148:0/2292758976 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f725004bed0 con 0x7f723406d7f0 2024-02-28T16:39:24.901 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:39:24.901 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (9m) 72s ago 24m 15.0M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:39:24.901 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (6m) 72s ago 25m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:39:24.901 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (5m) 15s ago 23m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:39:24.901 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (8m) 72s ago 24m 74.1M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (110s) 72s ago 16m 11.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 4d24e66401b9 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (80s) 72s ago 16m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 777e874af3d3 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (19s) 15s ago 16m 10.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 55ce47fb63ca 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (45s) 15s ago 16m 11.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f6672198e678 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (12m) 72s ago 26m 509M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (10m) 15s ago 22m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (7m) 72s ago 26m 50.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:39:24.902 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (7m) 15s ago 22m 40.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (10m) 72s ago 25m 8028k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (10m) 15s ago 23m 8066k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (5m) 72s ago 21m 90.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (4m) 72s ago 21m 93.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (4m) 72s ago 20m 90.9M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (3m) 15s ago 20m 106M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (2m) 15s ago 19m 91.5M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 93c28b8b835a 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (2m) 15s ago 18m 91.4M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 860ae8452ebf 2024-02-28T16:39:24.903 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (9m) 72s ago 24m 56.4M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f723406d7f0 msgr2=0x7f723406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f723406d7f0 0x7f723406fca0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72400041d0 tx=0x7f72400043c0 comp rx=0 tx=0).stop 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 msgr2=0x7f7250116150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f7250116150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f723c009030 tx=0x7f723c009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 shutdown_connections 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f723406d7f0 0x7f723406fca0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7250102f50 0x7f7250115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:24.904 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 --2- 172.21.15.148:0/2292758976 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72501038f0 0x7f7250116150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 >> 172.21.15.148:0/2292758976 conn(0x7f72500f8ae0 msgr2=0x7f72500fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.915+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 shutdown_connections 2024-02-28T16:39:24.905 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:24.916+0000 7f7255400700 1 -- 172.21.15.148:0/2292758976 wait complete. 2024-02-28T16:39:25.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:24 smithi148 ceph-mon[112463]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-28T16:39:25.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:24 smithi157 ceph-mon[89328]: pgmap v261: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-02-28T16:39:25.737 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade status' 2024-02-28T16:39:26.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:25 smithi148 ceph-mon[112463]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:39:26.229 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:39:26.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:25 smithi157 ceph-mon[89328]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:39:27.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:26 smithi148 ceph-mon[112463]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-02-28T16:39:27.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:26 smithi157 ceph-mon[89328]: pgmap v262: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 4.2 KiB/s wr, 2 op/s 2024-02-28T16:39:28.141 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:28.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.419+0000 7f7ae7200700 1 -- 172.21.15.148:0/2597346088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 msgr2=0x7f7ae0104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.419+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2597346088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae0104210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7acc004940 tx=0x7f7acc009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.419+0000 7f7ae7200700 1 -- 172.21.15.148:0/2597346088 shutdown_connections 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.419+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2597346088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae0104210 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.419+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2597346088 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae01095f0 0x7f7ae01099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.419+0000 7f7ae7200700 1 -- 172.21.15.148:0/2597346088 >> 172.21.15.148:0/2597346088 conn(0x7f7ae0072d50 msgr2=0x7f7ae0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.420+0000 7f7ae7200700 1 -- 172.21.15.148:0/2597346088 shutdown_connections 2024-02-28T16:39:28.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.420+0000 7f7ae7200700 1 -- 172.21.15.148:0/2597346088 wait complete. 2024-02-28T16:39:28.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.421+0000 7f7ae7200700 1 Processor -- start 2024-02-28T16:39:28.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.421+0000 7f7ae7200700 1 -- start start 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.421+0000 7f7ae7200700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae011a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.421+0000 7f7ae7200700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae01095f0 0x7f7ae011a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.421+0000 7f7ae7200700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae011abd0 con 0x7f7ae0103dc0 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.421+0000 7f7ae7200700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0113ee0 con 0x7f7ae01095f0 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.421+0000 7f7adfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae011a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.422+0000 7f7adfe00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae011a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53050/0 (socket says 172.21.15.148:53050) 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.422+0000 7f7adfe00700 1 -- 172.21.15.148:0/2403454903 learned_addr learned my addr 172.21.15.148:0/2403454903 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.422+0000 7f7adf400700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae01095f0 0x7f7ae011a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.422+0000 7f7adfe00700 1 -- 172.21.15.148:0/2403454903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae01095f0 msgr2=0x7f7ae011a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.422+0000 7f7adfe00700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae01095f0 0x7f7ae011a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:28.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.422+0000 7f7adfe00700 1 -- 172.21.15.148:0/2403454903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc005040 con 0x7f7ae0103dc0 2024-02-28T16:39:28.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.422+0000 7f7adfe00700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae011a040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c8c0 tx=0x7f7ad00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:28.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.423+0000 7f7ad7e00700 1 -- 172.21.15.148:0/2403454903 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad000a980 con 0x7f7ae0103dc0 2024-02-28T16:39:28.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.423+0000 7f7ad7e00700 1 -- 172.21.15.148:0/2403454903 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ad000ce60 con 0x7f7ae0103dc0 2024-02-28T16:39:28.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.423+0000 7f7ad7e00700 1 -- 172.21.15.148:0/2403454903 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ad00115e0 con 0x7f7ae0103dc0 2024-02-28T16:39:28.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.423+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae01141c0 con 0x7f7ae0103dc0 2024-02-28T16:39:28.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.423+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae0114700 con 0x7f7ae0103dc0 2024-02-28T16:39:28.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.424+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae010b9c0 con 0x7f7ae0103dc0 2024-02-28T16:39:28.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.425+0000 7f7ad7e00700 1 -- 172.21.15.148:0/2403454903 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7ad0012400 con 0x7f7ae0103dc0 2024-02-28T16:39:28.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.426+0000 7f7ad7e00700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7ac406d7f0 0x7f7ac406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:28.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.426+0000 7f7ad7e00700 1 -- 172.21.15.148:0/2403454903 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7ad008cfe0 con 0x7f7ae0103dc0 2024-02-28T16:39:28.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.426+0000 7f7adf400700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7ac406d7f0 0x7f7ac406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:28.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.427+0000 7f7adf400700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7ac406d7f0 0x7f7ac406fca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ae01158e0 tx=0x7f7acc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:28.418 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.431+0000 7f7ad7e00700 1 -- 172.21.15.148:0/2403454903 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ad005a350 con 0x7f7ae0103dc0 2024-02-28T16:39:28.658 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.670+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae004bed0 con 0x7f7ac406d7f0 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.673+0000 7f7ad7e00700 1 -- 172.21.15.148:0/2403454903 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f7ae004bed0 con 0x7f7ac406d7f0 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout: "target_image": null, 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout: "in_progress": false, 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout: "which": "", 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout: "services_complete": [], 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout: "progress": null, 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout: "message": "", 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout: "is_paused": false 2024-02-28T16:39:28.661 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7ac406d7f0 msgr2=0x7f7ac406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7ac406d7f0 0x7f7ac406fca0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ae01158e0 tx=0x7f7acc009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 msgr2=0x7f7ae011a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae011a040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c8c0 tx=0x7f7ad00044c0 comp rx=0 tx=0).stop 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 shutdown_connections 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f7ac406d7f0 0x7f7ac406fca0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7ae0103dc0 0x7f7ae011a040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:28.664 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 --2- 172.21.15.148:0/2403454903 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ae01095f0 0x7f7ae011a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:28.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 >> 172.21.15.148:0/2403454903 conn(0x7f7ae0072d50 msgr2=0x7f7ae0074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:28.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.676+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 shutdown_connections 2024-02-28T16:39:28.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:28.677+0000 7f7ae7200700 1 -- 172.21.15.148:0/2403454903 wait complete. 2024-02-28T16:39:29.018 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:28 smithi148 ceph-mon[112463]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:29.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:28 smithi157 ceph-mon[89328]: pgmap v263: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:29.405 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph health detail' 2024-02-28T16:39:29.880 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:39:30.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:29 smithi157 ceph-mon[89328]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:39:30.237 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:29 smithi148 ceph-mon[112463]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:39:31.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:30 smithi148 ceph-mon[112463]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:31.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:30 smithi157 ceph-mon[89328]: pgmap v264: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:31.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 -- 172.21.15.148:0/3012354270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105b10 msgr2=0x7f2c540ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:31.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 --2- 172.21.15.148:0/3012354270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105b10 0x7f2c540ff180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2c40004940 tx=0x7f2c40009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:31.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 -- 172.21.15.148:0/3012354270 shutdown_connections 2024-02-28T16:39:31.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 --2- 172.21.15.148:0/3012354270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105b10 0x7f2c540ff180 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:31.958 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 --2- 172.21.15.148:0/3012354270 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c54105170 0x7f2c54105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:31.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 -- 172.21.15.148:0/3012354270 >> 172.21.15.148:0/3012354270 conn(0x7f2c540face0 msgr2=0x7f2c540fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:31.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 -- 172.21.15.148:0/3012354270 shutdown_connections 2024-02-28T16:39:31.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.969+0000 7f2c59e00700 1 -- 172.21.15.148:0/3012354270 wait complete. 2024-02-28T16:39:31.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.970+0000 7f2c59e00700 1 Processor -- start 2024-02-28T16:39:31.959 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c59e00700 1 -- start start 2024-02-28T16:39:31.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c59e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105170 0x7f2c54115ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:31.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c59e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c54105b10 0x7f2c54116220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:31.960 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c59e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54116870 con 0x7f2c54105170 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c59e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5410fb80 con 0x7f2c54105b10 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c52a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105170 0x7f2c54115ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c52a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105170 0x7f2c54115ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60320/0 (socket says 172.21.15.148:60320) 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.971+0000 7f2c52a00700 1 -- 172.21.15.148:0/510507279 learned_addr learned my addr 172.21.15.148:0/510507279 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c52a00700 1 -- 172.21.15.148:0/510507279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c54105b10 msgr2=0x7f2c54116220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c52a00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c54105b10 0x7f2c54116220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c52a00700 1 -- 172.21.15.148:0/510507279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40005040 con 0x7f2c54105170 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c52a00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105170 0x7f2c54115ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c830 tx=0x7f2c44004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c4aa00700 1 -- 172.21.15.148:0/510507279 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c4400a760 con 0x7f2c54105170 2024-02-28T16:39:31.961 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c4aa00700 1 -- 172.21.15.148:0/510507279 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c4400ad90 con 0x7f2c54105170 2024-02-28T16:39:31.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5410fe60 con 0x7f2c54105170 2024-02-28T16:39:31.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c4aa00700 1 -- 172.21.15.148:0/510507279 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c440113a0 con 0x7f2c54105170 2024-02-28T16:39:31.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.972+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c541103a0 con 0x7f2c54105170 2024-02-28T16:39:31.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.974+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c54107640 con 0x7f2c54105170 2024-02-28T16:39:31.962 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.975+0000 7f2c4aa00700 1 -- 172.21.15.148:0/510507279 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2c44012400 con 0x7f2c54105170 2024-02-28T16:39:31.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.975+0000 7f2c4aa00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2c3806d7e0 0x7f2c3806fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:31.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.976+0000 7f2c4aa00700 1 -- 172.21.15.148:0/510507279 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f2c4408cfb0 con 0x7f2c54105170 2024-02-28T16:39:31.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.976+0000 7f2c52000700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2c3806d7e0 0x7f2c3806fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:31.964 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.976+0000 7f2c52000700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2c3806d7e0 0x7f2c3806fc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c40004f90 tx=0x7f2c40009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:31.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:31.980+0000 7f2c4aa00700 1 -- 172.21.15.148:0/510507279 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2c4405a300 con 0x7f2c54105170 2024-02-28T16:39:32.282 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.294+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2c540fe900 con 0x7f2c54105170 2024-02-28T16:39:32.283 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.295+0000 7f2c4aa00700 1 -- 172.21.15.148:0/510507279 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f2c44059e90 con 0x7f2c54105170 2024-02-28T16:39:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:39:32.283 INFO:teuthology.orchestra.run.smithi148.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-28T16:39:32.283 INFO:teuthology.orchestra.run.smithi148.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-28T16:39:32.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2c3806d7e0 msgr2=0x7f2c3806fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:32.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2c3806d7e0 0x7f2c3806fc90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c40004f90 tx=0x7f2c40009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:32.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105170 msgr2=0x7f2c54115ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:32.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105170 0x7f2c54115ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c830 tx=0x7f2c44004470 comp rx=0 tx=0).stop 2024-02-28T16:39:32.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 shutdown_connections 2024-02-28T16:39:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2c3806d7e0 0x7f2c3806fc90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c54105170 0x7f2c54115ce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 --2- 172.21.15.148:0/510507279 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2c54105b10 0x7f2c54116220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 >> 172.21.15.148:0/510507279 conn(0x7f2c540face0 msgr2=0x7f2c540fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.298+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 shutdown_connections 2024-02-28T16:39:32.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:32.299+0000 7f2c59e00700 1 -- 172.21.15.148:0/510507279 wait complete. 2024-02-28T16:39:33.017 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T16:39:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:32 smithi157 ceph-mon[89328]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:32 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/510507279' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:39:33.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:32 smithi148 ceph-mon[112463]: pgmap v265: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:33.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:32 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/510507279' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T16:39:33.493 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:39:35.007 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:34 smithi148 ceph-mon[112463]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:34 smithi157 ceph-mon[89328]: pgmap v266: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:35.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.523+0000 7f9ab9a00700 1 -- 172.21.15.148:0/1922141835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 msgr2=0x7f9ab4106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:35.511 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.523+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/1922141835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4106f40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0004940 tx=0x7f9aa0009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:35.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.523+0000 7f9ab9a00700 1 -- 172.21.15.148:0/1922141835 shutdown_connections 2024-02-28T16:39:35.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.523+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/1922141835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4106f40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:35.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.523+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/1922141835 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab40fdf60 0x7f9ab40fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:35.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.523+0000 7f9ab9a00700 1 -- 172.21.15.148:0/1922141835 >> 172.21.15.148:0/1922141835 conn(0x7f9ab40f7a10 msgr2=0x7f9ab40f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:35.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.524+0000 7f9ab9a00700 1 -- 172.21.15.148:0/1922141835 shutdown_connections 2024-02-28T16:39:35.512 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.524+0000 7f9ab9a00700 1 -- 172.21.15.148:0/1922141835 wait complete. 2024-02-28T16:39:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.524+0000 7f9ab9a00700 1 Processor -- start 2024-02-28T16:39:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab9a00700 1 -- start start 2024-02-28T16:39:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab9a00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab40fdf60 0x7f9ab4113b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:35.513 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab9a00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4114070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab9a00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41146c0 con 0x7f9ab40fe900 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab9a00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab410d9f0 con 0x7f9ab40fdf60 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab2000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab2000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60344/0 (socket says 172.21.15.148:60344) 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.525+0000 7f9ab2000700 1 -- 172.21.15.148:0/441624791 learned_addr learned my addr 172.21.15.148:0/441624791 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9ab2a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab40fdf60 0x7f9ab4113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9ab2000700 1 -- 172.21.15.148:0/441624791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab40fdf60 msgr2=0x7f9ab4113b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9ab2000700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab40fdf60 0x7f9ab4113b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9ab2000700 1 -- 172.21.15.148:0/441624791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0005040 con 0x7f9ab40fe900 2024-02-28T16:39:35.514 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9ab2000700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4114070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009180 tx=0x7f9aa0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:35.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9aaaa00700 1 -- 172.21.15.148:0/441624791 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa000e040 con 0x7f9ab40fe900 2024-02-28T16:39:35.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9aaaa00700 1 -- 172.21.15.148:0/441624791 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9aa0004290 con 0x7f9ab40fe900 2024-02-28T16:39:35.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9aaaa00700 1 -- 172.21.15.148:0/441624791 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa001c630 con 0x7f9ab40fe900 2024-02-28T16:39:35.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab410dc70 con 0x7f9ab40fe900 2024-02-28T16:39:35.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.526+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab410e1b0 con 0x7f9ab40fe900 2024-02-28T16:39:35.515 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.527+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab4104550 con 0x7f9ab40fe900 2024-02-28T16:39:35.516 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.529+0000 7f9aaaa00700 1 -- 172.21.15.148:0/441624791 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9aa00139f0 con 0x7f9ab40fe900 2024-02-28T16:39:35.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.530+0000 7f9aaaa00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9a9806d7f0 0x7f9a9806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:39:35.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.530+0000 7f9aaaa00700 1 -- 172.21.15.148:0/441624791 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9aa008eea0 con 0x7f9ab40fe900 2024-02-28T16:39:35.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.530+0000 7f9ab2a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9a9806d7f0 0x7f9a9806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:39:35.518 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.531+0000 7f9ab2a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9a9806d7f0 0x7f9a9806fca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4004d60 tx=0x7f9aa400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:39:35.521 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.534+0000 7f9aaaa00700 1 -- 172.21.15.148:0/441624791 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9aa005c1d0 con 0x7f9ab40fe900 2024-02-28T16:39:35.829 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.841+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ab410de00 con 0x7f9ab40fe900 2024-02-28T16:39:35.830 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.842+0000 7f9aaaa00700 1 -- 172.21.15.148:0/441624791 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f9ab410de00 con 0x7f9ab40fe900 2024-02-28T16:39:35.831 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:39:35.831 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:39:35.831 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:39:35.831 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:39:35.831 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:39:35.832 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:39:35.833 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9a9806d7f0 msgr2=0x7f9a9806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9a9806d7f0 0x7f9a9806fca0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4004d60 tx=0x7f9aa400b040 comp rx=0 tx=0).stop 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 msgr2=0x7f9ab4114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4114070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009180 tx=0x7f9aa0009e30 comp rx=0 tx=0).stop 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 shutdown_connections 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f9a9806d7f0 0x7f9a9806fca0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9ab40fdf60 0x7f9ab4113b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 --2- 172.21.15.148:0/441624791 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ab40fe900 0x7f9ab4114070 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.845+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 >> 172.21.15.148:0/441624791 conn(0x7f9ab40f7a10 msgr2=0x7f9ab41016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.846+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 shutdown_connections 2024-02-28T16:39:35.834 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:39:35.846+0000 7f9ab9a00700 1 -- 172.21.15.148:0/441624791 wait complete. 2024-02-28T16:39:36.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:35 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/441624791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:36.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:35 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/441624791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:39:36.670 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-28T16:39:37.169 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:39:37.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:36 smithi157 ceph-mon[89328]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:37.309 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:36 smithi148 ceph-mon[112463]: pgmap v267: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:39.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:38 smithi148 ceph-mon[112463]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:39.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:38 smithi157 ceph-mon[89328]: pgmap v268: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:39.267 INFO:teuthology.orchestra.run.smithi148.stdout:wait for servicemap items w/ changing names to refresh 2024-02-28T16:39:40.016 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'sleep 60' 2024-02-28T16:39:40.508 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:39:40.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:40 smithi157 ceph-mon[89328]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:41.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:40 smithi148 ceph-mon[112463]: pgmap v269: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:42 smithi157 ceph-mon[89328]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:43.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:42 smithi148 ceph-mon[112463]: pgmap v270: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:43.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:44 smithi157 ceph-mon[89328]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:45.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:44 smithi148 ceph-mon[112463]: pgmap v271: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:46 smithi157 ceph-mon[89328]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:47.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:46 smithi148 ceph-mon[112463]: pgmap v272: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:49.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:48 smithi157 ceph-mon[89328]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:49.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:48 smithi148 ceph-mon[112463]: pgmap v273: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:51.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:50 smithi148 ceph-mon[112463]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:51.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:50 smithi157 ceph-mon[89328]: pgmap v274: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:52 smithi157 ceph-mon[89328]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:53.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:52 smithi148 ceph-mon[112463]: pgmap v275: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:54.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:54 smithi148 ceph-mon[112463]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:54.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:54 smithi157 ceph-mon[89328]: pgmap v276: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:57.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:56 smithi148 ceph-mon[112463]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:56 smithi157 ceph-mon[89328]: pgmap v277: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:58.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:58.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:57 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:39:59.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:39:58 smithi148 ceph-mon[112463]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:39:59.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:39:58 smithi157 ceph-mon[89328]: pgmap v278: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:01.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:00 smithi148 ceph-mon[112463]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:01.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:00 smithi148 ceph-mon[112463]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:40:01.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:00 smithi157 ceph-mon[89328]: pgmap v279: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:01.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:00 smithi157 ceph-mon[89328]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:40:03.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:02 smithi148 ceph-mon[112463]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:02 smithi157 ceph-mon[89328]: pgmap v280: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:05.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:04 smithi148 ceph-mon[112463]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:04 smithi157 ceph-mon[89328]: pgmap v281: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:07.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:06 smithi148 ceph-mon[112463]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:07.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:06 smithi157 ceph-mon[89328]: pgmap v282: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:09.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:08 smithi148 ceph-mon[112463]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:09.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:08 smithi157 ceph-mon[89328]: pgmap v283: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:11.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:10 smithi148 ceph-mon[112463]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:11.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:10 smithi157 ceph-mon[89328]: pgmap v284: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:13.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:12 smithi148 ceph-mon[112463]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:12 smithi157 ceph-mon[89328]: pgmap v285: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:13.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:15.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:14 smithi157 ceph-mon[89328]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:15.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:14 smithi148 ceph-mon[112463]: pgmap v286: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:17.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:16 smithi157 ceph-mon[89328]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:17.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:16 smithi148 ceph-mon[112463]: pgmap v287: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:19.175 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:18 smithi148 ceph-mon[112463]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:19.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:18 smithi157 ceph-mon[89328]: pgmap v288: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:20.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:20 smithi157 ceph-mon[89328]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:20.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:20 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:40:21.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:20 smithi148 ceph-mon[112463]: pgmap v289: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:21.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:20 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:40:22.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:40:22.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:40:22.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:21 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:40:22.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:40:22.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:40:22.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:21 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:40:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:22 smithi157 ceph-mon[89328]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:23.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:22 smithi148 ceph-mon[112463]: pgmap v290: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:25.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:24 smithi157 ceph-mon[89328]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:25.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:24 smithi148 ceph-mon[112463]: pgmap v291: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:27.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:26 smithi157 ceph-mon[89328]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:27.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:26 smithi148 ceph-mon[112463]: pgmap v292: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:28.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:28.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:29.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:28 smithi157 ceph-mon[89328]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:29.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:28 smithi148 ceph-mon[112463]: pgmap v293: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:31.230 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:30 smithi148 ceph-mon[112463]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:31.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:30 smithi157 ceph-mon[89328]: pgmap v294: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:32 smithi157 ceph-mon[89328]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:33.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:32 smithi148 ceph-mon[112463]: pgmap v295: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:34.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:34 smithi148 ceph-mon[112463]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:34.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:34 smithi157 ceph-mon[89328]: pgmap v296: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:37.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:36 smithi148 ceph-mon[112463]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:37.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:36 smithi157 ceph-mon[89328]: pgmap v297: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:39.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:38 smithi148 ceph-mon[112463]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:39.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:38 smithi157 ceph-mon[89328]: pgmap v298: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:41.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:40 smithi148 ceph-mon[112463]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:41.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:40 smithi157 ceph-mon[89328]: pgmap v299: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:43.116 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:42 smithi148 ceph-mon[112463]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:43.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:43.187 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T16:40:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:42 smithi157 ceph-mon[89328]: pgmap v300: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:43.676 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:40:44.870 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:44 smithi148 ceph-mon[112463]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:44 smithi157 ceph-mon[89328]: pgmap v301: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:45.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.702+0000 7f8886000700 1 -- 172.21.15.148:0/3190402081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880070870 msgr2=0x7f8880070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:45.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.702+0000 7f8886000700 1 --2- 172.21.15.148:0/3190402081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880070870 0x7f8880070ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f886c004970 tx=0x7f886c009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:45.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.702+0000 7f8886000700 1 -- 172.21.15.148:0/3190402081 shutdown_connections 2024-02-28T16:40:45.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.703+0000 7f8886000700 1 --2- 172.21.15.148:0/3190402081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880070870 0x7f8880070ce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:45.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.703+0000 7f8886000700 1 --2- 172.21.15.148:0/3190402081 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880071f60 0x7f8880070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:45.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.703+0000 7f8886000700 1 -- 172.21.15.148:0/3190402081 >> 172.21.15.148:0/3190402081 conn(0x7f88800f8ae0 msgr2=0x7f88800faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:45.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.703+0000 7f8886000700 1 -- 172.21.15.148:0/3190402081 shutdown_connections 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.703+0000 7f8886000700 1 -- 172.21.15.148:0/3190402081 wait complete. 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.703+0000 7f8886000700 1 Processor -- start 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f8886000700 1 -- start start 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f8886000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880070870 0x7f888011a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f8886000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880071f60 0x7f888011a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f8886000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888011abc0 con 0x7f8880071f60 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f8886000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8880113ed0 con 0x7f8880070870 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f887ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880071f60 0x7f888011a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f887ea00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880071f60 0x7f888011a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47640/0 (socket says 172.21.15.148:47640) 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.704+0000 7f887ea00700 1 -- 172.21.15.148:0/2316906215 learned_addr learned my addr 172.21.15.148:0/2316906215 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f887f400700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880070870 0x7f888011a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f887ea00700 1 -- 172.21.15.148:0/2316906215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880070870 msgr2=0x7f888011a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f887ea00700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880070870 0x7f888011a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:45.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f887ea00700 1 -- 172.21.15.148:0/2316906215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c005040 con 0x7f8880071f60 2024-02-28T16:40:45.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f887ea00700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880071f60 0x7f888011a570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f886c004f50 tx=0x7f886c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:45.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f8877400700 1 -- 172.21.15.148:0/2316906215 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f886c00e040 con 0x7f8880071f60 2024-02-28T16:40:45.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f8877400700 1 -- 172.21.15.148:0/2316906215 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f886c00bc10 con 0x7f8880071f60 2024-02-28T16:40:45.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f8877400700 1 -- 172.21.15.148:0/2316906215 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f886c01c630 con 0x7f8880071f60 2024-02-28T16:40:45.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.705+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8880114150 con 0x7f8880071f60 2024-02-28T16:40:45.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.706+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8880114690 con 0x7f8880071f60 2024-02-28T16:40:45.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.707+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88800fe400 con 0x7f8880071f60 2024-02-28T16:40:45.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.708+0000 7f8877400700 1 -- 172.21.15.148:0/2316906215 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f886c00bd80 con 0x7f8880071f60 2024-02-28T16:40:45.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.709+0000 7f8877400700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f886406d7f0 0x7f886406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:45.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.709+0000 7f8877400700 1 -- 172.21.15.148:0/2316906215 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f886c08e350 con 0x7f8880071f60 2024-02-28T16:40:45.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.709+0000 7f887f400700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f886406d7f0 0x7f886406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:45.697 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.710+0000 7f887f400700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f886406d7f0 0x7f886406fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8870007fd0 tx=0x7f8870009d70 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:45.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.714+0000 7f8877400700 1 -- 172.21.15.148:0/2316906215 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f886c05b680 con 0x7f8880071f60 2024-02-28T16:40:45.934 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.946+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 --> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f888004bed0 con 0x7f886406d7f0 2024-02-28T16:40:45.963 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.975+0000 7f8877400700 1 -- 172.21.15.148:0/2316906215 <== mgr.34100 v2:172.21.15.148:6800/3381255335 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f888004bed0 con 0x7f886406d7f0 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:alertmanager.smithi148 smithi148 *:9093,9094 running (10m) 2m ago 26m 15.0M - 0.25.0 c8568f914cd2 adf2b9b38c67 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi148 smithi148 running (7m) 2m ago 26m 6656k - 19.0.0-1670-g1fb5d106 2272b2c42f9b d9878fd22ddf 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:crash.smithi157 smithi157 running (7m) 96s ago 25m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b f2c7699e2442 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:grafana.smithi148 smithi148 *:3000 running (10m) 2m ago 25m 74.1M - 9.4.12 a0ea5e3c46d9 485a0ffef452 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.mgdxsi smithi148 running (3m) 2m ago 18m 11.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 4d24e66401b9 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi148.nqnotw smithi148 running (2m) 2m ago 18m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 777e874af3d3 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.dreayg smithi157 running (101s) 96s ago 18m 10.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 55ce47fb63ca 2024-02-28T16:40:45.964 INFO:teuthology.orchestra.run.smithi148.stdout:mds.cephfs.smithi157.hinycn smithi157 running (2m) 96s ago 18m 11.0M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f6672198e678 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi148.gelspy smithi148 *:8443,9283,8765 running (13m) 2m ago 28m 509M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 54b176d59f5c 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mgr.smithi157.cmcxzj smithi157 *:8443,9283,8765 running (12m) 96s ago 24m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b ce08c05c37bc 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi148 smithi148 running (8m) 2m ago 28m 50.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b c5c988485518 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:mon.smithi157 smithi157 running (8m) 96s ago 24m 40.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b d8fb0fa2111f 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi148 smithi148 *:9100 running (11m) 2m ago 26m 8028k - 1.5.0 0da6a335fe13 8b649557c1cc 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:node-exporter.smithi157 smithi157 *:9100 running (11m) 96s ago 24m 8066k - 1.5.0 0da6a335fe13 d22859afebf6 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.0 smithi148 running (6m) 2m ago 23m 90.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 7f09adadd587 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.1 smithi148 running (6m) 2m ago 22m 93.7M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b b31a8f1e5483 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.2 smithi148 running (5m) 2m ago 21m 90.9M 1558M 19.0.0-1670-g1fb5d106 2272b2c42f9b 79bbadb9075d 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.3 smithi157 running (5m) 96s ago 21m 106M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 95f4d72b6933 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.4 smithi157 running (4m) 96s ago 20m 91.5M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 93c28b8b835a 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:osd.5 smithi157 running (3m) 96s ago 20m 91.4M 2582M 19.0.0-1670-g1fb5d106 2272b2c42f9b 860ae8452ebf 2024-02-28T16:40:45.965 INFO:teuthology.orchestra.run.smithi148.stdout:prometheus.smithi148 smithi148 *:9095 running (11m) 2m ago 25m 56.4M - 2.43.0 a07b618ecd1d bec3985b76c0 2024-02-28T16:40:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f886406d7f0 msgr2=0x7f886406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f886406d7f0 0x7f886406fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8870007fd0 tx=0x7f8870009d70 comp rx=0 tx=0).stop 2024-02-28T16:40:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880071f60 msgr2=0x7f888011a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880071f60 0x7f888011a570 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f886c004f50 tx=0x7f886c009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 shutdown_connections 2024-02-28T16:40:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f886406d7f0 0x7f886406fca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:45.967 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8880070870 0x7f888011a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:45.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 --2- 172.21.15.148:0/2316906215 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8880071f60 0x7f888011a570 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:45.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.979+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 >> 172.21.15.148:0/2316906215 conn(0x7f88800f8ae0 msgr2=0x7f88800fa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:45.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.980+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 shutdown_connections 2024-02-28T16:40:45.968 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:45.980+0000 7f8886000700 1 -- 172.21.15.148:0/2316906215 wait complete. 2024-02-28T16:40:46.681 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T16:40:46.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:46 smithi148 ceph-mon[112463]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:46.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:46 smithi148 ceph-mon[112463]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:40:47.162 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:40:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:46 smithi157 ceph-mon[89328]: pgmap v302: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:46 smithi157 ceph-mon[89328]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T16:40:49.016 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:48 smithi148 ceph-mon[112463]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:49.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.193+0000 7f4219800700 1 -- 172.21.15.148:0/1699603040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102f50 msgr2=0x7f4214103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:49.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.193+0000 7f4219800700 1 --2- 172.21.15.148:0/1699603040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102f50 0x7f4214103320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4204004940 tx=0x7f4204009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:49.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.193+0000 7f4219800700 1 -- 172.21.15.148:0/1699603040 shutdown_connections 2024-02-28T16:40:49.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.193+0000 7f4219800700 1 --2- 172.21.15.148:0/1699603040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42141038f0 0x7f42140fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:49.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.193+0000 7f4219800700 1 --2- 172.21.15.148:0/1699603040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102f50 0x7f4214103320 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:49.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.193+0000 7f4219800700 1 -- 172.21.15.148:0/1699603040 >> 172.21.15.148:0/1699603040 conn(0x7f42140f8ae0 msgr2=0x7f42140faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:49.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.193+0000 7f4219800700 1 -- 172.21.15.148:0/1699603040 shutdown_connections 2024-02-28T16:40:49.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.194+0000 7f4219800700 1 -- 172.21.15.148:0/1699603040 wait complete. 2024-02-28T16:40:49.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.194+0000 7f4219800700 1 Processor -- start 2024-02-28T16:40:49.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4219800700 1 -- start start 2024-02-28T16:40:49.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4219800700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4214102f50 0x7f4214070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:49.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4219800700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42141038f0 0x7f42140707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:49.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4219800700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214070dd0 con 0x7f42141038f0 2024-02-28T16:40:49.183 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4219800700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214070f40 con 0x7f4214102f50 2024-02-28T16:40:49.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4212000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42141038f0 0x7f42140707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:49.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4212000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42141038f0 0x7f42140707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:47654/0 (socket says 172.21.15.148:47654) 2024-02-28T16:40:49.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.195+0000 7f4212000700 1 -- 172.21.15.148:0/2430194089 learned_addr learned my addr 172.21.15.148:0/2430194089 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:40:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f4212a00700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4214102f50 0x7f4214070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f4212000700 1 -- 172.21.15.148:0/2430194089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4214102f50 msgr2=0x7f4214070290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:49.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f4212000700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4214102f50 0x7f4214070290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f4212000700 1 -- 172.21.15.148:0/2430194089 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4204005040 con 0x7f42141038f0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f4212a00700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4214102f50 0x7f4214070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f4212000700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42141038f0 0x7f42140707d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f420000c890 tx=0x7f42000044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f420aa00700 1 -- 172.21.15.148:0/2430194089 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420000a7d0 con 0x7f42141038f0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f420aa00700 1 -- 172.21.15.148:0/2430194089 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f420000ae00 con 0x7f42141038f0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4214119c90 con 0x7f42141038f0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.196+0000 7f420aa00700 1 -- 172.21.15.148:0/2430194089 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42000113a0 con 0x7f42141038f0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.197+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421411a170 con 0x7f42141038f0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.198+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42140fc6e0 con 0x7f42141038f0 2024-02-28T16:40:49.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.199+0000 7f420aa00700 1 -- 172.21.15.148:0/2430194089 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4200012400 con 0x7f42141038f0 2024-02-28T16:40:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.200+0000 7f420aa00700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f41f806d7f0 0x7f41f806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.200+0000 7f420aa00700 1 -- 172.21.15.148:0/2430194089 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f420008cfe0 con 0x7f42141038f0 2024-02-28T16:40:49.187 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.200+0000 7f4212a00700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f41f806d7f0 0x7f41f806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:49.188 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.201+0000 7f4212a00700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f41f806d7f0 0x7f41f806fca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4204009fd0 tx=0x7f4204009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:49.192 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.205+0000 7f420aa00700 1 -- 172.21.15.148:0/2430194089 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f42000c0d20 con 0x7f42141038f0 2024-02-28T16:40:49.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:48 smithi157 ceph-mon[89328]: pgmap v303: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:49.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.514+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f421410a050 con 0x7f42141038f0 2024-02-28T16:40:49.503 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.516+0000 7f420aa00700 1 -- 172.21.15.148:0/2430194089 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f42000567e0 con 0x7f42141038f0 2024-02-28T16:40:49.503 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "mon": { 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "mgr": { 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "osd": { 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T16:40:49.504 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-02-28T16:40:49.505 INFO:teuthology.orchestra.run.smithi148.stdout: "overall": { 2024-02-28T16:40:49.505 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T16:40:49.505 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-02-28T16:40:49.505 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f41f806d7f0 msgr2=0x7f41f806fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f41f806d7f0 0x7f41f806fca0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4204009fd0 tx=0x7f4204009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42141038f0 msgr2=0x7f42140707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42141038f0 0x7f42140707d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f420000c890 tx=0x7f42000044c0 comp rx=0 tx=0).stop 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 shutdown_connections 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f41f806d7f0 0x7f41f806fca0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4214102f50 0x7f4214070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 --2- 172.21.15.148:0/2430194089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42141038f0 0x7f42140707d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 >> 172.21.15.148:0/2430194089 conn(0x7f42140f8ae0 msgr2=0x7f42140fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 shutdown_connections 2024-02-28T16:40:49.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:49.519+0000 7f4219800700 1 -- 172.21.15.148:0/2430194089 wait complete. 2024-02-28T16:40:50.117 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:49 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2430194089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:40:50.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:49 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2430194089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:40:50.277 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-28T16:40:50.752 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:40:50.893 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:50 smithi148 ceph-mon[112463]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:51.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:50 smithi157 ceph-mon[89328]: pgmap v304: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:52.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 -- 172.21.15.148:0/1024134364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 msgr2=0x7f8e2c105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:52.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 --2- 172.21.15.148:0/1024134364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c105540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c004940 tx=0x7f8e1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:52.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 -- 172.21.15.148:0/1024134364 shutdown_connections 2024-02-28T16:40:52.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 --2- 172.21.15.148:0/1024134364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e2c105b10 0x7f8e2c0ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:52.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 --2- 172.21.15.148:0/1024134364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c105540 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:52.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 -- 172.21.15.148:0/1024134364 >> 172.21.15.148:0/1024134364 conn(0x7f8e2c0face0 msgr2=0x7f8e2c0fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:52.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 -- 172.21.15.148:0/1024134364 shutdown_connections 2024-02-28T16:40:52.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.773+0000 7f8e30c00700 1 -- 172.21.15.148:0/1024134364 wait complete. 2024-02-28T16:40:52.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.774+0000 7f8e30c00700 1 Processor -- start 2024-02-28T16:40:52.763 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e30c00700 1 -- start start 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e30c00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c115c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e30c00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e2c105b10 0x7f8e2c1161a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e30c00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c1167f0 con 0x7f8e2c105170 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e30c00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c10fb40 con 0x7f8e2c105b10 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e29e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c115c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e29e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c115c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40474/0 (socket says 172.21.15.148:40474) 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.775+0000 7f8e29e00700 1 -- 172.21.15.148:0/3800115971 learned_addr learned my addr 172.21.15.148:0/3800115971 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e29400700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e2c105b10 0x7f8e2c1161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:52.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e29e00700 1 -- 172.21.15.148:0/3800115971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e2c105b10 msgr2=0x7f8e2c1161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e29e00700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e2c105b10 0x7f8e2c1161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e29e00700 1 -- 172.21.15.148:0/3800115971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c005040 con 0x7f8e2c105170 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e29e00700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c115c60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009100 tx=0x7f8e1c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e22000700 1 -- 172.21.15.148:0/3800115971 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e1c00e040 con 0x7f8e2c105170 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e22000700 1 -- 172.21.15.148:0/3800115971 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e1c004290 con 0x7f8e2c105170 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c10fdc0 con 0x7f8e2c105170 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.776+0000 7f8e22000700 1 -- 172.21.15.148:0/3800115971 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e1c01c630 con 0x7f8e2c105170 2024-02-28T16:40:52.766 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.777+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c110300 con 0x7f8e2c105170 2024-02-28T16:40:52.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.778+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c102480 con 0x7f8e2c105170 2024-02-28T16:40:52.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.779+0000 7f8e22000700 1 -- 172.21.15.148:0/3800115971 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f8e1c00bbf0 con 0x7f8e2c105170 2024-02-28T16:40:52.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.780+0000 7f8e22000700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8e1006d7e0 0x7f8e1006fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:52.767 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.780+0000 7f8e22000700 1 -- 172.21.15.148:0/3800115971 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8e1c08e3b0 con 0x7f8e2c105170 2024-02-28T16:40:52.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.780+0000 7f8e29400700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8e1006d7e0 0x7f8e1006fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:52.768 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.781+0000 7f8e29400700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8e1006d7e0 0x7f8e1006fc90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c111540 tx=0x7f8e18009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:52.773 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:52.785+0000 7f8e22000700 1 -- 172.21.15.148:0/3800115971 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8e1c057b30 con 0x7f8e2c105170 2024-02-28T16:40:53.078 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.090+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8e2c111280 con 0x7f8e2c105170 2024-02-28T16:40:53.079 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.091+0000 7f8e22000700 1 -- 172.21.15.148:0/3800115971 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8e1c05b1f0 con 0x7f8e2c105170 2024-02-28T16:40:53.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.094+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8e1006d7e0 msgr2=0x7f8e1006fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:53.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.094+0000 7f8e30c00700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8e1006d7e0 0x7f8e1006fc90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c111540 tx=0x7f8e18009040 comp rx=0 tx=0).stop 2024-02-28T16:40:53.082 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.094+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 msgr2=0x7f8e2c115c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.094+0000 7f8e30c00700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c115c60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009100 tx=0x7f8e1c009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.095+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 shutdown_connections 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.095+0000 7f8e30c00700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8e1006d7e0 0x7f8e1006fc90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.095+0000 7f8e30c00700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e2c105170 0x7f8e2c115c60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.095+0000 7f8e30c00700 1 --2- 172.21.15.148:0/3800115971 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e2c105b10 0x7f8e2c1161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.095+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 >> 172.21.15.148:0/3800115971 conn(0x7f8e2c0face0 msgr2=0x7f8e2c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.095+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 shutdown_connections 2024-02-28T16:40:53.083 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:53.095+0000 7f8e30c00700 1 -- 172.21.15.148:0/3800115971 wait complete. 2024-02-28T16:40:53.099 INFO:teuthology.orchestra.run.smithi148.stdout:true 2024-02-28T16:40:53.150 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:52 smithi148 ceph-mon[112463]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:52 smithi157 ceph-mon[89328]: pgmap v305: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:53.838 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-28T16:40:54.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:53 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3800115971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:40:54.238 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:53 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3800115971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:40:54.341 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:40:55.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:54 smithi148 ceph-mon[112463]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:55.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:54 smithi157 ceph-mon[89328]: pgmap v306: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.334+0000 7fdee5000700 1 -- 172.21.15.148:0/662126601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee01038f0 msgr2=0x7fdee00fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.334+0000 7fdee5000700 1 --2- 172.21.15.148:0/662126601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee01038f0 0x7fdee00fcf60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdecc004940 tx=0x7fdecc009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.335+0000 7fdee5000700 1 -- 172.21.15.148:0/662126601 shutdown_connections 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.335+0000 7fdee5000700 1 --2- 172.21.15.148:0/662126601 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee01038f0 0x7fdee00fcf60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.335+0000 7fdee5000700 1 --2- 172.21.15.148:0/662126601 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee0102f50 0x7fdee0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.335+0000 7fdee5000700 1 -- 172.21.15.148:0/662126601 >> 172.21.15.148:0/662126601 conn(0x7fdee00f8ae0 msgr2=0x7fdee00faef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.335+0000 7fdee5000700 1 -- 172.21.15.148:0/662126601 shutdown_connections 2024-02-28T16:40:56.323 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.335+0000 7fdee5000700 1 -- 172.21.15.148:0/662126601 wait complete. 2024-02-28T16:40:56.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.336+0000 7fdee5000700 1 Processor -- start 2024-02-28T16:40:56.324 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.336+0000 7fdee5000700 1 -- start start 2024-02-28T16:40:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdee5000700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee0102f50 0x7fdee0070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdee5000700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee01038f0 0x7fdee00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdee5000700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0070e60 con 0x7fdee0102f50 2024-02-28T16:40:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdee5000700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0070fd0 con 0x7fdee01038f0 2024-02-28T16:40:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdedde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee0102f50 0x7fdee0070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdedde00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee0102f50 0x7fdee0070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40488/0 (socket says 172.21.15.148:40488) 2024-02-28T16:40:56.325 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdedde00700 1 -- 172.21.15.148:0/2992024449 learned_addr learned my addr 172.21.15.148:0/2992024449 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:40:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.337+0000 7fdedd400700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee01038f0 0x7fdee00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fdedde00700 1 -- 172.21.15.148:0/2992024449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee01038f0 msgr2=0x7fdee00707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fdedde00700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee01038f0 0x7fdee00707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fdedde00700 1 -- 172.21.15.148:0/2992024449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc005040 con 0x7fdee0102f50 2024-02-28T16:40:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fdedde00700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee0102f50 0x7fdee0070290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fded000b790 tx=0x7fded0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:56.326 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fded6000700 1 -- 172.21.15.148:0/2992024449 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fded000f770 con 0x7fdee0102f50 2024-02-28T16:40:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fded6000700 1 -- 172.21.15.148:0/2992024449 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fded000fda0 con 0x7fdee0102f50 2024-02-28T16:40:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee0119d50 con 0x7fdee0102f50 2024-02-28T16:40:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fded6000700 1 -- 172.21.15.148:0/2992024449 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fded000d310 con 0x7fdee0102f50 2024-02-28T16:40:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.338+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee011a240 con 0x7fdee0102f50 2024-02-28T16:40:56.327 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.340+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee0100260 con 0x7fdee0102f50 2024-02-28T16:40:56.328 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.341+0000 7fded6000700 1 -- 172.21.15.148:0/2992024449 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fded0010420 con 0x7fdee0102f50 2024-02-28T16:40:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.342+0000 7fded6000700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdec406d7f0 0x7fdec406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:40:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.342+0000 7fded6000700 1 -- 172.21.15.148:0/2992024449 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fded008cf30 con 0x7fdee0102f50 2024-02-28T16:40:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.342+0000 7fdedd400700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdec406d7f0 0x7fdec406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:40:56.330 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.343+0000 7fdedd400700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdec406d7f0 0x7fdec406fca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00b3b0 tx=0x7fdecc009e30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:40:56.334 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.347+0000 7fded6000700 1 -- 172.21.15.148:0/2992024449 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fded0056730 con 0x7fdee0102f50 2024-02-28T16:40:56.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.648+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdee00719d0 con 0x7fdee0102f50 2024-02-28T16:40:56.636 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.649+0000 7fded6000700 1 -- 172.21.15.148:0/2992024449 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fded0059df0 con 0x7fdee0102f50 2024-02-28T16:40:56.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.651+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdec406d7f0 msgr2=0x7fdec406fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:56.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.651+0000 7fdee5000700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdec406d7f0 0x7fdec406fca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00b3b0 tx=0x7fdecc009e30 comp rx=0 tx=0).stop 2024-02-28T16:40:56.639 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.651+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee0102f50 msgr2=0x7fdee0070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.651+0000 7fdee5000700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee0102f50 0x7fdee0070290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fded000b790 tx=0x7fded0009250 comp rx=0 tx=0).stop 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.652+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 shutdown_connections 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.652+0000 7fdee5000700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdec406d7f0 0x7fdec406fca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.652+0000 7fdee5000700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdee0102f50 0x7fdee0070290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.652+0000 7fdee5000700 1 --2- 172.21.15.148:0/2992024449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdee01038f0 0x7fdee00707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.652+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 >> 172.21.15.148:0/2992024449 conn(0x7fdee00f8ae0 msgr2=0x7fdee00fa4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.652+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 shutdown_connections 2024-02-28T16:40:56.640 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:40:56.652+0000 7fdee5000700 1 -- 172.21.15.148:0/2992024449 wait complete. 2024-02-28T16:40:56.654 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)" 2024-02-28T16:40:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:56 smithi157 ceph-mon[89328]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:56 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2992024449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:40:57.313 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:56 smithi148 ceph-mon[112463]: pgmap v307: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:57.313 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:56 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2992024449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T16:40:57.390 DEBUG:teuthology.parallel:result is None 2024-02-28T16:40:57.390 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T16:40:57.402 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:40:57.402 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 004ac12e-d654-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T16:40:57.899 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/mon.smithi148/config 2024-02-28T16:40:58.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:57 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:58.247 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:40:59.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:40:58 smithi157 ceph-mon[89328]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:40:59.286 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:40:58 smithi148 ceph-mon[112463]: pgmap v308: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.097+0000 7f4aa6e00700 1 -- 172.21.15.148:0/4069626540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 msgr2=0x7f4aa01099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.097+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/4069626540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa01099c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009ce0 tx=0x7f4a90004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.098+0000 7f4aa6e00700 1 -- 172.21.15.148:0/4069626540 shutdown_connections 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.098+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/4069626540 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aa0103dc0 0x7f4aa0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.098+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/4069626540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa01099c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.098+0000 7f4aa6e00700 1 -- 172.21.15.148:0/4069626540 >> 172.21.15.148:0/4069626540 conn(0x7f4aa0072d50 msgr2=0x7f4aa0075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.098+0000 7f4aa6e00700 1 -- 172.21.15.148:0/4069626540 shutdown_connections 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.098+0000 7f4aa6e00700 1 -- 172.21.15.148:0/4069626540 wait complete. 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.099+0000 7f4aa6e00700 1 Processor -- start 2024-02-28T16:41:00.087 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.099+0000 7f4aa6e00700 1 -- start start 2024-02-28T16:41:00.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.099+0000 7f4aa6e00700 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aa0103dc0 0x7f4aa011a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:00.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.099+0000 7f4aa6e00700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa011a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:00.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.099+0000 7f4aa6e00700 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa011adf0 con 0x7f4aa01095f0 2024-02-28T16:41:00.088 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.099+0000 7f4aa6e00700 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0114100 con 0x7f4aa0103dc0 2024-02-28T16:41:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a97400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa011a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a97400700 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa011a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40512/0 (socket says 172.21.15.148:40512) 2024-02-28T16:41:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a97400700 1 -- 172.21.15.148:0/1890801642 learned_addr learned my addr 172.21.15.148:0/1890801642 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a9fe00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aa0103dc0 0x7f4aa011a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a97400700 1 -- 172.21.15.148:0/1890801642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aa0103dc0 msgr2=0x7f4aa011a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a97400700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aa0103dc0 0x7f4aa011a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:00.089 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a97400700 1 -- 172.21.15.148:0/1890801642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a90009940 con 0x7f4aa01095f0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.100+0000 7f4a97400700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa011a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800c830 tx=0x7f4a88004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.101+0000 7f4a9cc00700 1 -- 172.21.15.148:0/1890801642 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a8800a760 con 0x7f4aa01095f0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.101+0000 7f4a9cc00700 1 -- 172.21.15.148:0/1890801642 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a8800ad90 con 0x7f4aa01095f0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.101+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa01143e0 con 0x7f4aa01095f0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.101+0000 7f4a9cc00700 1 -- 172.21.15.148:0/1890801642 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a880113a0 con 0x7f4aa01095f0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.101+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0114920 con 0x7f4aa01095f0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.102+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa0106850 con 0x7f4aa01095f0 2024-02-28T16:41:00.090 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.103+0000 7f4a9cc00700 1 -- 172.21.15.148:0/1890801642 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4a88012400 con 0x7f4aa01095f0 2024-02-28T16:41:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.104+0000 7f4a9cc00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4a8406d7e0 0x7f4a8406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.105+0000 7f4a9cc00700 1 -- 172.21.15.148:0/1890801642 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4a8808cff0 con 0x7f4aa01095f0 2024-02-28T16:41:00.092 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.105+0000 7f4a9fe00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4a8406d7e0 0x7f4a8406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:00.093 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.105+0000 7f4a9fe00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4a8406d7e0 0x7f4a8406fc90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000b740 tx=0x7f4a90004d10 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:00.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.110+0000 7f4a9cc00700 1 -- 172.21.15.148:0/1890801642 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4a8805a300 con 0x7f4aa01095f0 2024-02-28T16:41:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.386+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4aa0075870 con 0x7f4aa01095f0 2024-02-28T16:41:00.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.387+0000 7f4a9cc00700 1 -- 172.21.15.148:0/1890801642 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1876 (secure 0 0 0) 0x7f4a88059e90 con 0x7f4aa01095f0 2024-02-28T16:41:00.375 INFO:teuthology.orchestra.run.smithi148.stdout:e35 2024-02-28T16:41:00.375 INFO:teuthology.orchestra.run.smithi148.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:legacy client fscid: 1 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:Filesystem 'cephfs' (1) 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:fs_name cephfs 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:epoch 35 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:created 2024-02-28T16:22:25.044836+0000 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:modified 2024-02-28T16:39:17.157662+0000 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:tableserver 0 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:root 0 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:session_timeout 60 2024-02-28T16:41:00.376 INFO:teuthology.orchestra.run.smithi148.stdout:session_autoclose 300 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:max_file_size 1099511627776 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:max_xattr_size 65536 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:required_client_features {} 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure 0 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:last_failure_osd_epoch 84 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:max_mds 1 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:in 0 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:up {0=34428} 2024-02-28T16:41:00.377 INFO:teuthology.orchestra.run.smithi148.stdout:failed 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:damaged 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:stopped 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:data_pools [3] 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:metadata_pool 2 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:inline_data enabled 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:balancer 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:bal_rank_mask -1 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:standby_count_wanted 1 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.mgdxsi{0:34428} state up:active seq 27 join_fscid=1 addr [v2:172.21.15.148:6826/1742396885,v1:172.21.15.148:6827/1742396885] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout:Standby daemons: 2024-02-28T16:41:00.378 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:00.379 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi148.nqnotw{-1:34460} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.148:6828/1814235745,v1:172.21.15.148:6829/1814235745] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:41:00.379 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.hinycn{-1:44279} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6824/1511558367,v1:172.21.15.157:6825/1511558367] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:41:00.379 INFO:teuthology.orchestra.run.smithi148.stdout:[mds.cephfs.smithi157.dreayg{-1:44299} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.157:6826/3119390220,v1:172.21.15.157:6827/3119390220] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.389+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4a8406d7e0 msgr2=0x7f4a8406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.389+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4a8406d7e0 0x7f4a8406fc90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000b740 tx=0x7f4a90004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.389+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 msgr2=0x7f4aa011a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.389+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa011a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800c830 tx=0x7f4a88004470 comp rx=0 tx=0).stop 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.390+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 shutdown_connections 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.390+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4a8406d7e0 0x7f4a8406fc90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.390+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4aa0103dc0 0x7f4aa011a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.390+0000 7f4aa6e00700 1 --2- 172.21.15.148:0/1890801642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4aa01095f0 0x7f4aa011a7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.390+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 >> 172.21.15.148:0/1890801642 conn(0x7f4aa0072d50 msgr2=0x7f4aa0074790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.390+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 shutdown_connections 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:00.390+0000 7f4aa6e00700 1 -- 172.21.15.148:0/1890801642 wait complete. 2024-02-28T16:41:00.380 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 35 2024-02-28T16:41:01.085 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:00 smithi148 ceph-mon[112463]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:01.085 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:00 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1890801642' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:41:01.142 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-28T16:41:01.153 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:41:01.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:00 smithi157 ceph-mon[89328]: pgmap v309: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:01.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:00 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1890801642' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 -- 172.21.15.148:0/3958985047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0719d0 msgr2=0x7fe00c071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 --2- 172.21.15.148:0/3958985047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0719d0 0x7fe00c071da0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdffc0048d0 tx=0x7fdffc009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 -- 172.21.15.148:0/3958985047 shutdown_connections 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 --2- 172.21.15.148:0/3958985047 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe00c0722e0 0x7fe00c10cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 --2- 172.21.15.148:0/3958985047 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0719d0 0x7fe00c071da0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 -- 172.21.15.148:0/3958985047 >> 172.21.15.148:0/3958985047 conn(0x7fe00c0fa090 msgr2=0x7fe00c0fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 -- 172.21.15.148:0/3958985047 shutdown_connections 2024-02-28T16:41:01.365 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.377+0000 7fe013000640 1 -- 172.21.15.148:0/3958985047 wait complete. 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.378+0000 7fe013000640 1 Processor -- start 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.378+0000 7fe013000640 1 -- start start 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe013000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe00c0719d0 0x7fe00c119090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe013000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0722e0 0x7fe00c1195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe013000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c119bd0 con 0x7fe00c0722e0 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe013000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00c113160 con 0x7fe00c0719d0 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe003400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0722e0 0x7fe00c1195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe003400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0722e0 0x7fe00c1195d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40526/0 (socket says 172.21.15.148:40526) 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe003400640 1 -- 172.21.15.148:0/2542919194 learned_addr learned my addr 172.21.15.148:0/2542919194 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe00be00640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe00c0719d0 0x7fe00c119090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:01.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe003400640 1 -- 172.21.15.148:0/2542919194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe00c0719d0 msgr2=0x7fe00c119090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:01.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe003400640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe00c0719d0 0x7fe00c119090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.379+0000 7fe003400640 1 -- 172.21.15.148:0/2542919194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc005040 con 0x7fe00c0722e0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.380+0000 7fe003400640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0722e0 0x7fe00c1195d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdff4002a50 tx=0x7fdff4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.380+0000 7fe008c00640 1 -- 172.21.15.148:0/2542919194 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff4007c30 con 0x7fe00c0722e0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.380+0000 7fe008c00640 1 -- 172.21.15.148:0/2542919194 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdff400f040 con 0x7fe00c0722e0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.380+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00c113440 con 0x7fe00c0722e0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.380+0000 7fe008c00640 1 -- 172.21.15.148:0/2542919194 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff400dad0 con 0x7fe00c0722e0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.380+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00c113960 con 0x7fe00c0722e0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.381+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00c064030 con 0x7fe00c0722e0 2024-02-28T16:41:01.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.382+0000 7fe008c00640 1 -- 172.21.15.148:0/2542919194 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fdff400dd40 con 0x7fe00c0722e0 2024-02-28T16:41:01.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.383+0000 7fe008c00640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdff006d760 0x7fdff006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:01.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.383+0000 7fe008c00640 1 -- 172.21.15.148:0/2542919194 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdff408c8a0 con 0x7fe00c0722e0 2024-02-28T16:41:01.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.383+0000 7fe00be00640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdff006d760 0x7fdff006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:01.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.384+0000 7fe00be00640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdff006d760 0x7fdff006fc10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdffc034040 tx=0x7fdffc009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:01.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.388+0000 7fe008c00640 1 -- 172.21.15.148:0/2542919194 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdff4055fe0 con 0x7fe00c0722e0 2024-02-28T16:41:01.573 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.584+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe00c114690 con 0x7fe00c0722e0 2024-02-28T16:41:01.574 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.587+0000 7fe008c00640 1 -- 172.21.15.148:0/2542919194 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16873 (secure 0 0 0) 0x7fdff40596a0 con 0x7fe00c0722e0 2024-02-28T16:41:01.575 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:01.575 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":84,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","created":"2024-02-28T16:12:27.413792+0000","modified":"2024-02-28T16:38:58.553270+0000","last_up_change":"2024-02-28T16:37:18.170766+0000","last_in_change":"2024-02-28T16:20:18.870154+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:18:56.502433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:22:23.698334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:22:24.552110+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14a7fb44-646e-4c79-82b1-a6911b120a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6803","nonce":2918467650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6805","nonce":2918467650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6809","nonce":2918467650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6807","nonce":2918467650}]},"public_addr":"172.21.15.148:6803/2918467650","cluster_addr":"172.21.15.148:6805/2918467650","heartbeat_back_addr":"172.21.15.148:6809/2918467650","heartbeat_front_addr":"172.21.15.148:6807/2918467650","state":["exists","up"]},{"osd":1,"uuid":"86d4be70-889a-48bb-8354-5c1191cd11d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6811","nonce":3822469407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6813","nonce":3822469407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6817","nonce":3822469407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6815","nonce":3822469407}]},"public_addr":"172.21.15.148:6811/3822469407","cluster_addr":"172.21.15.148:6813/3822469407","heartbeat_back_addr":"172.21.15.148:6817/3822469407","heartbeat_front_addr":"172.21.15.148:6815/3822469407","state":["exists","up"]},{"osd":2,"uuid":"fb9f2df8-5f7c-4a5d-897b-7816093d2f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6819","nonce":1849077371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6821","nonce":1849077371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6825","nonce":1849077371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6823","nonce":1849077371}]},"public_addr":"172.21.15.148:6819/1849077371","cluster_addr":"172.21.15.148:6821/1849077371","heartbeat_back_addr":"172.21.15.148:6825/1849077371","heartbeat_front_addr":"172.21.15.148:6823/1849077371","state":["exists","up"]},{"osd":3,"uuid":"387e95f1-fb7d-493e-a953-e3a0480bab84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6801","nonce":2446981625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6803","nonce":2446981625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6807","nonce":2446981625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6805","nonce":2446981625}]},"public_addr":"172.21.15.157:6801/2446981625","cluster_addr":"172.21.15.157:6803/2446981625","heartbeat_back_addr":"172.21.15.157:6807/2446981625","heartbeat_front_addr":"172.21.15.157:6805/2446981625","state":["exists","up"]},{"osd":4,"uuid":"687be313-3bfd-461c-97bd-1286d0df4890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6809","nonce":1675329690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6811","nonce":1675329690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6815","nonce":1675329690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6813","nonce":1675329690}]},"public_addr":"172.21.15.157:6809/1675329690","cluster_addr":"172.21.15.157:6811/1675329690","heartbeat_back_addr":"172.21.15.157:6815/1675329690","heartbeat_front_addr":"172.21.15.157:6813/1675329690","state":["exists","up"]},{"osd":5,"uuid":"30cd920d-07ad-4006-b70d-801862f0301a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6817","nonce":2009672957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6819","nonce":2009672957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6823","nonce":2009672957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6821","nonce":2009672957}]},"public_addr":"172.21.15.157:6817/2009672957","cluster_addr":"172.21.15.157:6819/2009672957","heartbeat_back_addr":"172.21.15.157:6823/2009672957","heartbeat_front_addr":"172.21.15.157:6821/2009672957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:37.865181+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:15.892468+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:54.360175+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:19:29.555324+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:05.461264+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:41.106302+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:6827/2090793909":"2024-02-29T16:38:58.553214+0000","172.21.15.157:6826/2090793909":"2024-02-29T16:38:58.553214+0000","172.21.15.157:6825/696390101":"2024-02-29T16:38:25.908437+0000","172.21.15.148:6829/2703268165":"2024-02-29T16:37:56.402458+0000","172.21.15.157:6828/3805996438":"2024-02-29T16:27:50.385710+0000","172.21.15.148:6800/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1252596380":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/3934075057":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/941593238":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3379725707":"2024-02-29T16:15:25.792039+0000","172.21.15.157:6829/3805996438":"2024-02-29T16:27:50.385710+0000","172.21.15.157:0/3983227890":"2024-02-29T16:27:50.385710+0000","172.21.15.157:0/40255861":"2024-02-29T16:27:50.385710+0000","172.21.15.148:6801/2883262037":"2024-02-29T16:31:57.561143+0000","172.21.15.157:6824/696390101":"2024-02-29T16:38:25.908437+0000","172.21.15.148:0/1885326731":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/2808488860":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/3872489504":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/3437363100":"2024-02-29T16:25:16.416587+0000","172.21.15.148:6800/2883262037":"2024-02-29T16:31:57.561143+0000","172.21.15.148:6801/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3440184585":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6801/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1142907915":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/2841519785":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6828/2703268165":"2024-02-29T16:37:56.402458+0000","172.21.15.148:6801/3437363100":"2024-02-29T16:25:16.416587+0000","172.21.15.157:0/3810037133":"2024-02-29T16:27:50.385710+0000","172.21.15.148:0/2552402434":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/2298274885":"2024-02-29T16:25:16.416587+0000","172.21.15.148:6801/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/1960926651":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/3059678121":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/4201431226":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6826/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:6827/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:0/1938685931":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/2468996293":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6800/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.157:0/792112074":"2024-02-29T16:27:50.385710+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:41:01.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdff006d760 msgr2=0x7fdff006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:01.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdff006d760 0x7fdff006fc10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdffc034040 tx=0x7fdffc009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.577 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0722e0 msgr2=0x7fe00c1195d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0722e0 0x7fe00c1195d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdff4002a50 tx=0x7fdff4004600 comp rx=0 tx=0).stop 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 shutdown_connections 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe00c0722e0 0x7fe00c1195d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fdff006d760 0x7fdff006fc10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 --2- 172.21.15.148:0/2542919194 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe00c0719d0 0x7fe00c119090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 >> 172.21.15.148:0/2542919194 conn(0x7fe00c0fa090 msgr2=0x7fe00c0facf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 shutdown_connections 2024-02-28T16:41:01.578 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.590+0000 7fe013000640 1 -- 172.21.15.148:0/2542919194 wait complete. 2024-02-28T16:41:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:18:56.502433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:22:23.698334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:22:24.552110+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:41:01.598 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:41:01.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 -- 172.21.15.148:0/705206721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 msgr2=0x7efcc0100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 --2- 172.21.15.148:0/705206721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0100560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efca80048d0 tx=0x7efca8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 -- 172.21.15.148:0/705206721 shutdown_connections 2024-02-28T16:41:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 --2- 172.21.15.148:0/705206721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0100560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 --2- 172.21.15.148:0/705206721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc00fe9c0 0x7efcc00fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 -- 172.21.15.148:0/705206721 >> 172.21.15.148:0/705206721 conn(0x7efcc00fa160 msgr2=0x7efcc00fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 -- 172.21.15.148:0/705206721 shutdown_connections 2024-02-28T16:41:01.809 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.821+0000 7efcc5600640 1 -- 172.21.15.148:0/705206721 wait complete. 2024-02-28T16:41:01.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.822+0000 7efcc5600640 1 Processor -- start 2024-02-28T16:41:01.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.822+0000 7efcc5600640 1 -- start start 2024-02-28T16:41:01.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.822+0000 7efcc5600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc00fe9c0 0x7efcc0114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:01.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.822+0000 7efcc5600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:01.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.822+0000 7efcc5600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc0115900 con 0x7efcc0100110 2024-02-28T16:41:01.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.822+0000 7efcc5600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc010ee90 con 0x7efcc00fe9c0 2024-02-28T16:41:01.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.822+0000 7efcb7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:01.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.823+0000 7efcb7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0115300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:40554/0 (socket says 172.21.15.148:40554) 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.823+0000 7efcb7e00640 1 -- 172.21.15.148:0/2317681788 learned_addr learned my addr 172.21.15.148:0/2317681788 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.823+0000 7efcbea00640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc00fe9c0 0x7efcc0114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.823+0000 7efcb7e00640 1 -- 172.21.15.148:0/2317681788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc00fe9c0 msgr2=0x7efcc0114dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.823+0000 7efcb7e00640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc00fe9c0 0x7efcc0114dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.823+0000 7efcb7e00640 1 -- 172.21.15.148:0/2317681788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8005040 con 0x7efcc0100110 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.823+0000 7efcb7e00640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0115300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efca802bda0 tx=0x7efca8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.824+0000 7efcb6a00640 1 -- 172.21.15.148:0/2317681788 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca80092b0 con 0x7efcc0100110 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.824+0000 7efcb6a00640 1 -- 172.21.15.148:0/2317681788 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efca803b400 con 0x7efcc0100110 2024-02-28T16:41:01.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.824+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc010f110 con 0x7efcc0100110 2024-02-28T16:41:01.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.824+0000 7efcb6a00640 1 -- 172.21.15.148:0/2317681788 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca80435d0 con 0x7efcc0100110 2024-02-28T16:41:01.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.824+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc010f5d0 con 0x7efcc0100110 2024-02-28T16:41:01.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.825+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc0064030 con 0x7efcc0100110 2024-02-28T16:41:01.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.826+0000 7efcb6a00640 1 -- 172.21.15.148:0/2317681788 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7efca802f070 con 0x7efcc0100110 2024-02-28T16:41:01.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.827+0000 7efcb6a00640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efca406d760 0x7efca406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:01.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.827+0000 7efcb6a00640 1 -- 172.21.15.148:0/2317681788 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efca80aed30 con 0x7efcc0100110 2024-02-28T16:41:01.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.827+0000 7efcbea00640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efca406d760 0x7efca406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:01.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.828+0000 7efcbea00640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efca406d760 0x7efca406fc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efcb0004a70 tx=0x7efcb000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:01.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:01.831+0000 7efcb6a00640 1 -- 172.21.15.148:0/2317681788 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efca8078550 con 0x7efcc0100110 2024-02-28T16:41:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.033+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcc010f840 con 0x7efcc0100110 2024-02-28T16:41:02.023 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.034+0000 7efcb6a00640 1 -- 172.21.15.148:0/2317681788 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7efca807bc10 con 0x7efcc0100110 2024-02-28T16:41:02.024 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-02-28T16:41:02.024 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efca406d760 msgr2=0x7efca406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efca406d760 0x7efca406fc10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efcb0004a70 tx=0x7efcb000b040 comp rx=0 tx=0).stop 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 msgr2=0x7efcc0115300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0115300 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efca802bda0 tx=0x7efca8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 shutdown_connections 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7efcc0100110 0x7efcc0115300 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7efca406d760 0x7efca406fc10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 --2- 172.21.15.148:0/2317681788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efcc00fe9c0 0x7efcc0114dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 >> 172.21.15.148:0/2317681788 conn(0x7efcc00fa160 msgr2=0x7efcc00fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 shutdown_connections 2024-02-28T16:41:02.025 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.037+0000 7efcc5600640 1 -- 172.21.15.148:0/2317681788 wait complete. 2024-02-28T16:41:02.044 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:41:02.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:01 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2542919194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 -- 172.21.15.148:0/3307695131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 msgr2=0x7f279006fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 --2- 172.21.15.148:0/3307695131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f279006fb90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f27840048d0 tx=0x7f2784009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 -- 172.21.15.148:0/3307695131 shutdown_connections 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 --2- 172.21.15.148:0/3307695131 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27900700d0 0x7f2790108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 --2- 172.21.15.148:0/3307695131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f279006fb90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 -- 172.21.15.148:0/3307695131 >> 172.21.15.148:0/3307695131 conn(0x7f27900f7ef0 msgr2=0x7f27900fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 -- 172.21.15.148:0/3307695131 shutdown_connections 2024-02-28T16:41:02.256 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.268+0000 7f2798000640 1 -- 172.21.15.148:0/3307695131 wait complete. 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.269+0000 7f2798000640 1 Processor -- start 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.269+0000 7f2798000640 1 -- start start 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2798000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f2790114e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2798000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27900700d0 0x7f27901153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2798000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2790115a50 con 0x7f279006f7c0 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2798000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279010ef50 con 0x7f27900700d0 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2795600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f2790114e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2795600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f2790114e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41008/0 (socket says 172.21.15.148:41008) 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2795600640 1 -- 172.21.15.148:0/4016952130 learned_addr learned my addr 172.21.15.148:0/4016952130 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2795600640 1 -- 172.21.15.148:0/4016952130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27900700d0 msgr2=0x7f27901153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2795600640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27900700d0 0x7f27901153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.258 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.270+0000 7f2795600640 1 -- 172.21.15.148:0/4016952130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784005040 con 0x7f279006f7c0 2024-02-28T16:41:02.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.271+0000 7f2795600640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f2790114e80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f278402bda0 tx=0x7f2784009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:02.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.271+0000 7f278d600640 1 -- 172.21.15.148:0/4016952130 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27840094c0 con 0x7f279006f7c0 2024-02-28T16:41:02.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.271+0000 7f278d600640 1 -- 172.21.15.148:0/4016952130 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2784009620 con 0x7f279006f7c0 2024-02-28T16:41:02.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.271+0000 7f278d600640 1 -- 172.21.15.148:0/4016952130 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27840435f0 con 0x7f279006f7c0 2024-02-28T16:41:02.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.271+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279010f1d0 con 0x7f279006f7c0 2024-02-28T16:41:02.259 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.271+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279010f690 con 0x7f279006f7c0 2024-02-28T16:41:02.260 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.272+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2790064480 con 0x7f279006f7c0 2024-02-28T16:41:02.261 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.274+0000 7f278d600640 1 -- 172.21.15.148:0/4016952130 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f278402f070 con 0x7f279006f7c0 2024-02-28T16:41:02.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.275+0000 7f278d600640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f277806d760 0x7f277806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:02.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.275+0000 7f278d600640 1 -- 172.21.15.148:0/4016952130 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f27840aedc0 con 0x7f279006f7c0 2024-02-28T16:41:02.262 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.275+0000 7f2794c00640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f277806d760 0x7f277806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:02.263 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.276+0000 7f2794c00640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f277806d760 0x7f277806fc10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2790110740 tx=0x7f277c006d20 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:02.267 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.280+0000 7f278d600640 1 -- 172.21.15.148:0/4016952130 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2784078560 con 0x7f279006f7c0 2024-02-28T16:41:02.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:01 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2542919194' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:41:02.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.475+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f279010b730 con 0x7f279006f7c0 2024-02-28T16:41:02.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.476+0000 7f278d600640 1 -- 172.21.15.148:0/4016952130 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f278407bc20 con 0x7f279006f7c0 2024-02-28T16:41:02.464 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:41:02.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.479+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f277806d760 msgr2=0x7f277806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.479+0000 7f2798000640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f277806d760 0x7f277806fc10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2790110740 tx=0x7f277c006d20 comp rx=0 tx=0).stop 2024-02-28T16:41:02.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.479+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 msgr2=0x7f2790114e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.479+0000 7f2798000640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f2790114e80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f278402bda0 tx=0x7f2784009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.479+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 shutdown_connections 2024-02-28T16:41:02.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.480+0000 7f2798000640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f277806d760 0x7f277806fc10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.480+0000 7f2798000640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f27900700d0 0x7f27901153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.480+0000 7f2798000640 1 --2- 172.21.15.148:0/4016952130 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f279006f7c0 0x7f2790114e80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.480+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 >> 172.21.15.148:0/4016952130 conn(0x7f27900f7ef0 msgr2=0x7f2790102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:02.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.480+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 shutdown_connections 2024-02-28T16:41:02.468 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.480+0000 7f2798000640 1 -- 172.21.15.148:0/4016952130 wait complete. 2024-02-28T16:41:02.485 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:41:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.701+0000 7f14cb600640 1 -- 172.21.15.148:0/1702192871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c41023e0 msgr2=0x7f14c41027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.701+0000 7f14cb600640 1 --2- 172.21.15.148:0/1702192871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c41023e0 0x7f14c41027b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0048d0 tx=0x7f14ac009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.701+0000 7f14cb600640 1 -- 172.21.15.148:0/1702192871 shutdown_connections 2024-02-28T16:41:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.701+0000 7f14cb600640 1 --2- 172.21.15.148:0/1702192871 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14c40644b0 0x7f14c40648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.701+0000 7f14cb600640 1 --2- 172.21.15.148:0/1702192871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c41023e0 0x7f14c41027b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.701+0000 7f14cb600640 1 -- 172.21.15.148:0/1702192871 >> 172.21.15.148:0/1702192871 conn(0x7f14c4071230 msgr2=0x7f14c4071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.702+0000 7f14cb600640 1 -- 172.21.15.148:0/1702192871 shutdown_connections 2024-02-28T16:41:02.690 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.702+0000 7f14cb600640 1 -- 172.21.15.148:0/1702192871 wait complete. 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.702+0000 7f14cb600640 1 Processor -- start 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.702+0000 7f14cb600640 1 -- start start 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.703+0000 7f14cb600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c40644b0 0x7f14c4114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.703+0000 7f14cb600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14c41023e0 0x7f14c4115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.703+0000 7f14cb600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c4115900 con 0x7f14c40644b0 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.703+0000 7f14cb600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c410ee90 con 0x7f14c41023e0 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.703+0000 7f14c8c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c40644b0 0x7f14c4114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.703+0000 7f14c8c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c40644b0 0x7f14c4114dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41030/0 (socket says 172.21.15.148:41030) 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.703+0000 7f14c8c00640 1 -- 172.21.15.148:0/994773845 learned_addr learned my addr 172.21.15.148:0/994773845 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c8c00640 1 -- 172.21.15.148:0/994773845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14c41023e0 msgr2=0x7f14c4115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.692 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c3e00640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14c41023e0 0x7f14c4115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c8c00640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14c41023e0 0x7f14c4115300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c8c00640 1 -- 172.21.15.148:0/994773845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac005040 con 0x7f14c40644b0 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c3e00640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14c41023e0 0x7f14c4115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c8c00640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c40644b0 0x7f14c4114dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f14ac02bda0 tx=0x7f14ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c0c00640 1 -- 172.21.15.148:0/994773845 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ac0094c0 con 0x7f14c40644b0 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c0c00640 1 -- 172.21.15.148:0/994773845 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14ac032e50 con 0x7f14c40644b0 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14c0c00640 1 -- 172.21.15.148:0/994773845 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ac0435f0 con 0x7f14c40644b0 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c410f110 con 0x7f14c40644b0 2024-02-28T16:41:02.693 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.704+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c410f5d0 con 0x7f14c40644b0 2024-02-28T16:41:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.705+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c4064030 con 0x7f14c40644b0 2024-02-28T16:41:02.694 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.706+0000 7f14c0c00640 1 -- 172.21.15.148:0/994773845 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f14ac02f070 con 0x7f14c40644b0 2024-02-28T16:41:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.708+0000 7f14c0c00640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f14a806d760 0x7f14a806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.708+0000 7f14c0c00640 1 -- 172.21.15.148:0/994773845 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f14ac0aee30 con 0x7f14c40644b0 2024-02-28T16:41:02.695 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.708+0000 7f14c3e00640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f14a806d760 0x7f14a806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:02.696 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.709+0000 7f14c3e00640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f14a806d760 0x7f14a806fc10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14c4110680 tx=0x7f14b400b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:02.700 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.713+0000 7f14c0c00640 1 -- 172.21.15.148:0/994773845 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f14ac0785d0 con 0x7f14c40644b0 2024-02-28T16:41:02.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.910+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f14c410f840 con 0x7f14c40644b0 2024-02-28T16:41:02.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.911+0000 7f14c0c00640 1 -- 172.21.15.148:0/994773845 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f14ac07bc90 con 0x7f14c40644b0 2024-02-28T16:41:02.899 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f14a806d760 msgr2=0x7f14a806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f14a806d760 0x7f14a806fc10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14c4110680 tx=0x7f14b400b040 comp rx=0 tx=0).stop 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c40644b0 msgr2=0x7f14c4114dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c40644b0 0x7f14c4114dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f14ac02bda0 tx=0x7f14ac009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 shutdown_connections 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f14a806d760 0x7f14a806fc10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14c41023e0 0x7f14c4115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 --2- 172.21.15.148:0/994773845 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14c40644b0 0x7f14c4114dc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 >> 172.21.15.148:0/994773845 conn(0x7f14c4071230 msgr2=0x7f14c40fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 shutdown_connections 2024-02-28T16:41:02.902 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:02.914+0000 7f14cb600640 1 -- 172.21.15.148:0/994773845 wait complete. 2024-02-28T16:41:02.919 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T16:41:03.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 -- 172.21.15.148:0/3348695256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 msgr2=0x7fd678071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3348695256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678071da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd6680048d0 tx=0x7fd668009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 -- 172.21.15.148:0/3348695256 shutdown_connections 2024-02-28T16:41:03.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3348695256 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780722e0 0x7fd67810cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3348695256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678071da0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 -- 172.21.15.148:0/3348695256 >> 172.21.15.148:0/3348695256 conn(0x7fd6780fa090 msgr2=0x7fd6780fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:03.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 -- 172.21.15.148:0/3348695256 shutdown_connections 2024-02-28T16:41:03.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.132+0000 7fd67ce00640 1 -- 172.21.15.148:0/3348695256 wait complete. 2024-02-28T16:41:03.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.133+0000 7fd67ce00640 1 Processor -- start 2024-02-28T16:41:03.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.133+0000 7fd67ce00640 1 -- start start 2024-02-28T16:41:03.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd67ce00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678119140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:03.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd67ce00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780722e0 0x7fd678119680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:03.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd67ce00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd678119d10 con 0x7fd6780719d0 2024-02-28T16:41:03.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd67ce00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd678113210 con 0x7fd6780722e0 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd675e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678119140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd675e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678119140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41048/0 (socket says 172.21.15.148:41048) 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd675e00640 1 -- 172.21.15.148:0/3465860754 learned_addr learned my addr 172.21.15.148:0/3465860754 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd66d400640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780722e0 0x7fd678119680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd675e00640 1 -- 172.21.15.148:0/3465860754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780722e0 msgr2=0x7fd678119680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd675e00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780722e0 0x7fd678119680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.134+0000 7fd675e00640 1 -- 172.21.15.148:0/3465860754 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd668005040 con 0x7fd6780719d0 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.135+0000 7fd675e00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678119140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd668031720 tx=0x7fd668009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.135+0000 7fd66ea00640 1 -- 172.21.15.148:0/3465860754 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6680094c0 con 0x7fd6780719d0 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.135+0000 7fd66ea00640 1 -- 172.21.15.148:0/3465860754 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd668009620 con 0x7fd6780719d0 2024-02-28T16:41:03.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.135+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd678113490 con 0x7fd6780719d0 2024-02-28T16:41:03.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.135+0000 7fd66ea00640 1 -- 172.21.15.148:0/3465860754 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66803b640 con 0x7fd6780719d0 2024-02-28T16:41:03.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.135+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6781139b0 con 0x7fd6780719d0 2024-02-28T16:41:03.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.136+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd678064030 con 0x7fd6780719d0 2024-02-28T16:41:03.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.137+0000 7fd66ea00640 1 -- 172.21.15.148:0/3465860754 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd66802f070 con 0x7fd6780719d0 2024-02-28T16:41:03.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.138+0000 7fd66ea00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd65c06d750 0x7fd65c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:03.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.138+0000 7fd66ea00640 1 -- 172.21.15.148:0/3465860754 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd6680af440 con 0x7fd6780719d0 2024-02-28T16:41:03.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.138+0000 7fd66d400640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd65c06d750 0x7fd65c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:03.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.139+0000 7fd66d400640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd65c06d750 0x7fd65c06fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd678114a00 tx=0x7fd660008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:03.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.143+0000 7fd66ea00640 1 -- 172.21.15.148:0/3465860754 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd668078c60 con 0x7fd6780719d0 2024-02-28T16:41:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:02 smithi157 ceph-mon[89328]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:02 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2317681788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:41:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:02 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4016952130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:41:03.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:02 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/994773845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:41:03.367 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.380+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd67810fa90 con 0x7fd6780719d0 2024-02-28T16:41:03.368 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.381+0000 7fd66ea00640 1 -- 172.21.15.148:0/3465860754 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5008 (secure 0 0 0) 0x7fd66807c320 con 0x7fd6780719d0 2024-02-28T16:41:03.368 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:03.368 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44299,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/3119390220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3119390220},{"type":"v1","addr":"172.21.15.157:6827","nonce":3119390220}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:39:17.157662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":0,"incarnation":30,"state":"up:active","state_seq":27,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:03.369 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 35 2024-02-28T16:41:03.371 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd65c06d750 msgr2=0x7fd65c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd65c06d750 0x7fd65c06fc00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd678114a00 tx=0x7fd660008040 comp rx=0 tx=0).stop 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 msgr2=0x7fd678119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678119140 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd668031720 tx=0x7fd668009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 shutdown_connections 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd65c06d750 0x7fd65c06fc00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd6780722e0 0x7fd678119680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 --2- 172.21.15.148:0/3465860754 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd6780719d0 0x7fd678119140 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 >> 172.21.15.148:0/3465860754 conn(0x7fd6780fa090 msgr2=0x7fd6780facf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 shutdown_connections 2024-02-28T16:41:03.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.384+0000 7fd67ce00640 1 -- 172.21.15.148:0/3465860754 wait complete. 2024-02-28T16:41:03.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:02 smithi148 ceph-mon[112463]: pgmap v310: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:03.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:02 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2317681788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:41:03.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:02 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4016952130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:41:03.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:02 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/994773845' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:41:03.391 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-02-28T16:41:03.391 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-02-28T16:41:03.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 -- 172.21.15.148:0/4202484973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 msgr2=0x7f283806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 --2- 172.21.15.148:0/4202484973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283806e6e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2820009c50 tx=0x7f2820004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:03.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 -- 172.21.15.148:0/4202484973 shutdown_connections 2024-02-28T16:41:03.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 --2- 172.21.15.148:0/4202484973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283806e6e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 --2- 172.21.15.148:0/4202484973 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2838108e80 0x7f2838109250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 -- 172.21.15.148:0/4202484973 >> 172.21.15.148:0/4202484973 conn(0x7f2838067d00 msgr2=0x7f2838068100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:03.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 -- 172.21.15.148:0/4202484973 shutdown_connections 2024-02-28T16:41:03.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.612+0000 7f283de00640 1 -- 172.21.15.148:0/4202484973 wait complete. 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f283de00640 1 Processor -- start 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f283de00640 1 -- start start 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f283de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283811d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f283de00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2838108e80 0x7f283811db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f283de00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283811e150 con 0x7f283806e290 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f283de00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28381176b0 con 0x7f2838108e80 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f2836a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283811d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f2836a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283811d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41058/0 (socket says 172.21.15.148:41058) 2024-02-28T16:41:03.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.613+0000 7f2836a00640 1 -- 172.21.15.148:0/2947674238 learned_addr learned my addr 172.21.15.148:0/2947674238 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.614+0000 7f282e000640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2838108e80 0x7f283811db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.614+0000 7f2836a00640 1 -- 172.21.15.148:0/2947674238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2838108e80 msgr2=0x7f283811db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.614+0000 7f2836a00640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2838108e80 0x7f283811db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.614+0000 7f2836a00640 1 -- 172.21.15.148:0/2947674238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200098b0 con 0x7f283806e290 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.614+0000 7f2836a00640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283811d5c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2828002a50 tx=0x7f2828004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.614+0000 7f282f400640 1 -- 172.21.15.148:0/2947674238 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2828007c30 con 0x7f283806e290 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.615+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2838117990 con 0x7f283806e290 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.615+0000 7f282f400640 1 -- 172.21.15.148:0/2947674238 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f282800f040 con 0x7f283806e290 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.615+0000 7f282f400640 1 -- 172.21.15.148:0/2947674238 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f282800db50 con 0x7f283806e290 2024-02-28T16:41:03.603 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.615+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2838117f30 con 0x7f283806e290 2024-02-28T16:41:03.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.616+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2838064030 con 0x7f283806e290 2024-02-28T16:41:03.604 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.617+0000 7f282f400640 1 -- 172.21.15.148:0/2947674238 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f282801c400 con 0x7f283806e290 2024-02-28T16:41:03.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.618+0000 7f282f400640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f281c06d760 0x7f281c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:03.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.618+0000 7f282f400640 1 -- 172.21.15.148:0/2947674238 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f282808c850 con 0x7f283806e290 2024-02-28T16:41:03.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.618+0000 7f282e000640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f281c06d760 0x7f281c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:03.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.618+0000 7f282e000640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f281c06d760 0x7f281c06fc10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28200048c0 tx=0x7f282002e040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:03.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.622+0000 7f282f400640 1 -- 172.21.15.148:0/2947674238 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2828055ff0 con 0x7f283806e290 2024-02-28T16:41:03.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.857+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f2838118150 con 0x7f283806e290 2024-02-28T16:41:03.846 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.859+0000 7f282f400640 1 -- 172.21.15.148:0/2947674238 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v35) v1 ==== 107+0+4052 (secure 0 0 0) 0x7f28280596b0 con 0x7f283806e290 2024-02-28T16:41:03.846 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:03.847 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:22:46.964332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi148.nqnotw","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.148:6829/2703268165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2703268165},{"type":"v1","addr":"172.21.15.148:6829","nonce":2703268165}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:03.847 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 15 2024-02-28T16:41:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f281c06d760 msgr2=0x7f281c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.849 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f281c06d760 0x7f281c06fc10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28200048c0 tx=0x7f282002e040 comp rx=0 tx=0).stop 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 msgr2=0x7f283811d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283811d5c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2828002a50 tx=0x7f2828004600 comp rx=0 tx=0).stop 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 shutdown_connections 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f281c06d760 0x7f281c06fc10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2838108e80 0x7f283811db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 --2- 172.21.15.148:0/2947674238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f283806e290 0x7f283811d5c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 >> 172.21.15.148:0/2947674238 conn(0x7f2838067d00 msgr2=0x7f283810e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 shutdown_connections 2024-02-28T16:41:03.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:03.862+0000 7f283de00640 1 -- 172.21.15.148:0/2947674238 wait complete. 2024-02-28T16:41:03.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-02-28T16:41:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 -- 172.21.15.148:0/3994587693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900722e0 msgr2=0x7f059010cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 --2- 172.21.15.148:0/3994587693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900722e0 0x7f059010cab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f05780048d0 tx=0x7f0578009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 -- 172.21.15.148:0/3994587693 shutdown_connections 2024-02-28T16:41:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 --2- 172.21.15.148:0/3994587693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900722e0 0x7f059010cab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 --2- 172.21.15.148:0/3994587693 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05900719d0 0x7f0590071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 -- 172.21.15.148:0/3994587693 >> 172.21.15.148:0/3994587693 conn(0x7f05900f9f90 msgr2=0x7f05900fc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:04.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 -- 172.21.15.148:0/3994587693 shutdown_connections 2024-02-28T16:41:04.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.076+0000 7f058f200640 1 -- 172.21.15.148:0/3994587693 wait complete. 2024-02-28T16:41:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.077+0000 7f058f200640 1 Processor -- start 2024-02-28T16:41:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.077+0000 7f058f200640 1 -- start start 2024-02-28T16:41:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.077+0000 7f058f200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900719d0 0x7f05901190d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058f200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05900722e0 0x7f0590119610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058f200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0590119c10 con 0x7f05900719d0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058f200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05901131a0 con 0x7f05900722e0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900719d0 0x7f05901190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900719d0 0x7f05901190d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41082/0 (socket says 172.21.15.148:41082) 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058de00640 1 -- 172.21.15.148:0/3684854999 learned_addr learned my addr 172.21.15.148:0/3684854999 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f0585400640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05900722e0 0x7f0590119610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058de00640 1 -- 172.21.15.148:0/3684854999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05900722e0 msgr2=0x7f0590119610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058de00640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05900722e0 0x7f0590119610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058de00640 1 -- 172.21.15.148:0/3684854999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578005040 con 0x7f05900719d0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.078+0000 7f058de00640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900719d0 0x7f05901190d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f058000db00 tx=0x7f0580004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.079+0000 7f0586a00640 1 -- 172.21.15.148:0/3684854999 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0580017070 con 0x7f05900719d0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.079+0000 7f0586a00640 1 -- 172.21.15.148:0/3684854999 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f058000f040 con 0x7f05900719d0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.079+0000 7f0586a00640 1 -- 172.21.15.148:0/3684854999 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0580003ae0 con 0x7f05900719d0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.079+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0590113480 con 0x7f05900719d0 2024-02-28T16:41:04.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.079+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05901139a0 con 0x7f05900719d0 2024-02-28T16:41:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.080+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059004bcc0 con 0x7f05900719d0 2024-02-28T16:41:04.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.081+0000 7f0586a00640 1 -- 172.21.15.148:0/3684854999 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0580003c40 con 0x7f05900719d0 2024-02-28T16:41:04.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.082+0000 7f0586a00640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f057406d760 0x7f057406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:04.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.083+0000 7f0586a00640 1 -- 172.21.15.148:0/3684854999 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f058008d0f0 con 0x7f05900719d0 2024-02-28T16:41:04.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.083+0000 7f0585400640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f057406d760 0x7f057406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:04.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.083+0000 7f0585400640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f057406d760 0x7f057406fc10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0578034040 tx=0x7f0578009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:04.074 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.087+0000 7f0586a00640 1 -- 172.21.15.148:0/3684854999 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0580056890 con 0x7f05900719d0 2024-02-28T16:41:04.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:03 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3465860754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:41:04.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:03 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2947674238' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-28T16:41:04.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:03 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3465860754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T16:41:04.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:03 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2947674238' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-02-28T16:41:04.312 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.325+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f059010f890 con 0x7f05900719d0 2024-02-28T16:41:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.326+0000 7f0586a00640 1 -- 172.21.15.148:0/3684854999 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) v1 ==== 107+0+4868 (secure 0 0 0) 0x7f0580059f50 con 0x7f05900719d0 2024-02-28T16:41:04.314 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:04.314 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:22:46.964332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14484":{"gid":14484,"name":"cephfs.smithi148.nqnotw","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.148:6829/2703268165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":2703268165},{"type":"v1","addr":"172.21.15.148:6829","nonce":2703268165}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:04.314 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 16 2024-02-28T16:41:04.316 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f057406d760 msgr2=0x7f057406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f057406d760 0x7f057406fc10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0578034040 tx=0x7f0578009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900719d0 msgr2=0x7f05901190d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900719d0 0x7f05901190d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f058000db00 tx=0x7f0580004e60 comp rx=0 tx=0).stop 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 shutdown_connections 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f057406d760 0x7f057406fc10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f05900722e0 0x7f0590119610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 --2- 172.21.15.148:0/3684854999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f05900719d0 0x7f05901190d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 >> 172.21.15.148:0/3684854999 conn(0x7f05900f9f90 msgr2=0x7f05900fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 shutdown_connections 2024-02-28T16:41:04.317 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.329+0000 7f058f200640 1 -- 172.21.15.148:0/3684854999 wait complete. 2024-02-28T16:41:04.334 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-02-28T16:41:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 -- 172.21.15.148:0/921030980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464108760 msgr2=0x7f0464108b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 --2- 172.21.15.148:0/921030980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464108760 0x7f0464108b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04540048d0 tx=0x7f0454009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 -- 172.21.15.148:0/921030980 shutdown_connections 2024-02-28T16:41:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 --2- 172.21.15.148:0/921030980 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0464102740 0x7f0464102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 --2- 172.21.15.148:0/921030980 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464108760 0x7f0464108b30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 -- 172.21.15.148:0/921030980 >> 172.21.15.148:0/921030980 conn(0x7f0464071fc0 msgr2=0x7f04640743d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:04.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 -- 172.21.15.148:0/921030980 shutdown_connections 2024-02-28T16:41:04.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.546+0000 7f0469600640 1 -- 172.21.15.148:0/921030980 wait complete. 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.547+0000 7f0469600640 1 Processor -- start 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.547+0000 7f0469600640 1 -- start start 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.548+0000 7f0469600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464102740 0x7f0464119180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.548+0000 7f0469600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0464108760 0x7f04641196c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.548+0000 7f0469600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0464119cc0 con 0x7f0464102740 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.548+0000 7f0469600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0464113250 con 0x7f0464108760 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.548+0000 7f0463e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464102740 0x7f0464119180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.548+0000 7f0463e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464102740 0x7f0464119180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41096/0 (socket says 172.21.15.148:41096) 2024-02-28T16:41:04.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.548+0000 7f0463e00640 1 -- 172.21.15.148:0/274214860 learned_addr learned my addr 172.21.15.148:0/274214860 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f045b400640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0464108760 0x7f04641196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0463e00640 1 -- 172.21.15.148:0/274214860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0464108760 msgr2=0x7f04641196c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0463e00640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0464108760 0x7f04641196c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0463e00640 1 -- 172.21.15.148:0/274214860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0454005040 con 0x7f0464102740 2024-02-28T16:41:04.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0463e00640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464102740 0x7f0464119180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0454031720 tx=0x7f0454009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:04.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0460c00640 1 -- 172.21.15.148:0/274214860 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04540094c0 con 0x7f0464102740 2024-02-28T16:41:04.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0460c00640 1 -- 172.21.15.148:0/274214860 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0454009620 con 0x7f0464102740 2024-02-28T16:41:04.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0460c00640 1 -- 172.21.15.148:0/274214860 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f045403b640 con 0x7f0464102740 2024-02-28T16:41:04.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04641134d0 con 0x7f0464102740 2024-02-28T16:41:04.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.549+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04641139f0 con 0x7f0464102740 2024-02-28T16:41:04.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.551+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046404bcc0 con 0x7f0464102740 2024-02-28T16:41:04.539 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.551+0000 7f0460c00640 1 -- 172.21.15.148:0/274214860 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f045402f070 con 0x7f0464102740 2024-02-28T16:41:04.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.552+0000 7f0460c00640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f044806d750 0x7f044806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:04.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.552+0000 7f0460c00640 1 -- 172.21.15.148:0/274214860 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f04540af370 con 0x7f0464102740 2024-02-28T16:41:04.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.553+0000 7f045b400640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f044806d750 0x7f044806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:04.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.553+0000 7f045b400640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f044806d750 0x7f044806fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0464114a40 tx=0x7f044c00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:04.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.557+0000 7f0460c00640 1 -- 172.21.15.148:0/274214860 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0454078b90 con 0x7f0464102740 2024-02-28T16:41:04.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.792+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f0464105a20 con 0x7f0464102740 2024-02-28T16:41:04.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.793+0000 7f0460c00640 1 -- 172.21.15.148:0/274214860 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4075 (secure 0 0 0) 0x7f0464105a20 con 0x7f0464102740 2024-02-28T16:41:04.781 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:04.781 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":4,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:37:56.402478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:04.781 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 17 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f044806d750 msgr2=0x7f044806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f044806d750 0x7f044806fc00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0464114a40 tx=0x7f044c00b040 comp rx=0 tx=0).stop 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464102740 msgr2=0x7f0464119180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464102740 0x7f0464119180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0454031720 tx=0x7f0454009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 shutdown_connections 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f044806d750 0x7f044806fc00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0464108760 0x7f04641196c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 --2- 172.21.15.148:0/274214860 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0464102740 0x7f0464119180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 >> 172.21.15.148:0/274214860 conn(0x7f0464071fc0 msgr2=0x7f0464074e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.796+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 shutdown_connections 2024-02-28T16:41:04.784 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:04.797+0000 7f0469600640 1 -- 172.21.15.148:0/274214860 wait complete. 2024-02-28T16:41:04.803 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-02-28T16:41:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 -- 172.21.15.148:0/3350264616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580644b0 msgr2=0x7f19580648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 --2- 172.21.15.148:0/3350264616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580644b0 0x7f19580648e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f19440048d0 tx=0x7f1944009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 -- 172.21.15.148:0/3350264616 shutdown_connections 2024-02-28T16:41:04.997 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 --2- 172.21.15.148:0/3350264616 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19580644b0 0x7f19580648e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 --2- 172.21.15.148:0/3350264616 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19581023e0 0x7f19581027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 -- 172.21.15.148:0/3350264616 >> 172.21.15.148:0/3350264616 conn(0x7f1958071230 msgr2=0x7f1958071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 -- 172.21.15.148:0/3350264616 shutdown_connections 2024-02-28T16:41:04.998 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.009+0000 7f195f000640 1 -- 172.21.15.148:0/3350264616 wait complete. 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.010+0000 7f195f000640 1 Processor -- start 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.010+0000 7f195f000640 1 -- start start 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f195f000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580644b0 0x7f1958114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f195f000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19581023e0 0x7f19581152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f195f000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19581158d0 con 0x7f19581023e0 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f195f000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195810ee60 con 0x7f19580644b0 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f1957400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19581023e0 0x7f19581152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f1957400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19581023e0 0x7f19581152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41126/0 (socket says 172.21.15.148:41126) 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f1957400640 1 -- 172.21.15.148:0/2217974291 learned_addr learned my addr 172.21.15.148:0/2217974291 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.011+0000 7f1957e00640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580644b0 0x7f1958114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f1957400640 1 -- 172.21.15.148:0/2217974291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580644b0 msgr2=0x7f1958114d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f1957400640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580644b0 0x7f1958114d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.000 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f1957400640 1 -- 172.21.15.148:0/2217974291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944005040 con 0x7f19581023e0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f1957400640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19581023e0 0x7f19581152d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f194402bda0 tx=0x7f1944009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f194fe00640 1 -- 172.21.15.148:0/2217974291 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19440094c0 con 0x7f19581023e0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f194fe00640 1 -- 172.21.15.148:0/2217974291 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1944032e50 con 0x7f19581023e0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f195810f0e0 con 0x7f19581023e0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f194fe00640 1 -- 172.21.15.148:0/2217974291 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19440435f0 con 0x7f19581023e0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.012+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195810f5a0 con 0x7f19581023e0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.014+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1958064030 con 0x7f19581023e0 2024-02-28T16:41:05.001 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.014+0000 7f194fe00640 1 -- 172.21.15.148:0/2217974291 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f194402f070 con 0x7f19581023e0 2024-02-28T16:41:05.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.015+0000 7f194fe00640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f193c06d760 0x7f193c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.015+0000 7f194fe00640 1 -- 172.21.15.148:0/2217974291 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f19440aeef0 con 0x7f19581023e0 2024-02-28T16:41:05.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.015+0000 7f1957e00640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f193c06d760 0x7f193c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.016+0000 7f1957e00640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f193c06d760 0x7f193c06fc10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1948007fd0 tx=0x7f1948009e90 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:05.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.020+0000 7f194fe00640 1 -- 172.21.15.148:0/2217974291 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1944078690 con 0x7f19581023e0 2024-02-28T16:41:05.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:04 smithi148 ceph-mon[112463]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:05.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:04 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3684854999' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-28T16:41:05.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:04 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/274214860' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-28T16:41:05.228 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.241+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f195810f7c0 con 0x7f19581023e0 2024-02-28T16:41:05.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.242+0000 7f194fe00640 1 -- 172.21.15.148:0/2217974291 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4086 (secure 0 0 0) 0x7f194407bd50 con 0x7f19581023e0 2024-02-28T16:41:05.230 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:05.230 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:37:56.410887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":0,"incarnation":18,"state":"up:replay","state_seq":4,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:05.230 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 18 2024-02-28T16:41:05.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f193c06d760 msgr2=0x7f193c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f193c06d760 0x7f193c06fc10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1948007fd0 tx=0x7f1948009e90 comp rx=0 tx=0).stop 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19581023e0 msgr2=0x7f19581152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19581023e0 0x7f19581152d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f194402bda0 tx=0x7f1944009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 shutdown_connections 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19581023e0 0x7f19581152d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f193c06d760 0x7f193c06fc10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 --2- 172.21.15.148:0/2217974291 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f19580644b0 0x7f1958114d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 >> 172.21.15.148:0/2217974291 conn(0x7f1958071230 msgr2=0x7f19580fb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 shutdown_connections 2024-02-28T16:41:05.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.245+0000 7f195f000640 1 -- 172.21.15.148:0/2217974291 wait complete. 2024-02-28T16:41:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:04 smithi157 ceph-mon[89328]: pgmap v311: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:04 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3684854999' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-02-28T16:41:05.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:04 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/274214860' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-02-28T16:41:05.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-28T16:41:05.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.471+0000 7feae6200640 1 -- 172.21.15.148:0/3786711037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 msgr2=0x7feae0073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.471+0000 7feae6200640 1 --2- 172.21.15.148:0/3786711037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0073940 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fead00048d0 tx=0x7fead0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.472+0000 7feae6200640 1 -- 172.21.15.148:0/3786711037 shutdown_connections 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.472+0000 7feae6200640 1 --2- 172.21.15.148:0/3786711037 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae0073e80 0x7feae010cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.472+0000 7feae6200640 1 --2- 172.21.15.148:0/3786711037 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0073940 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.472+0000 7feae6200640 1 -- 172.21.15.148:0/3786711037 >> 172.21.15.148:0/3786711037 conn(0x7feae00fa160 msgr2=0x7feae00fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.472+0000 7feae6200640 1 -- 172.21.15.148:0/3786711037 shutdown_connections 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.472+0000 7feae6200640 1 -- 172.21.15.148:0/3786711037 wait complete. 2024-02-28T16:41:05.460 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.472+0000 7feae6200640 1 Processor -- start 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feae6200640 1 -- start start 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feae6200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0119280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feae6200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae0073e80 0x7feae01197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feae6200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0119dc0 con 0x7feae0073570 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feae6200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae0113350 con 0x7feae0073e80 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feadf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0119280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feadf400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0119280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41146/0 (socket says 172.21.15.148:41146) 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.473+0000 7feadf400640 1 -- 172.21.15.148:0/3946631621 learned_addr learned my addr 172.21.15.148:0/3946631621 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7fead7e00640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae0073e80 0x7feae01197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.462 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7feadf400640 1 -- 172.21.15.148:0/3946631621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae0073e80 msgr2=0x7feae01197c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7feadf400640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae0073e80 0x7feae01197c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7feadf400640 1 -- 172.21.15.148:0/3946631621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0005040 con 0x7feae0073570 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7fead7e00640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae0073e80 0x7feae01197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7feadf400640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0119280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fead00316d0 tx=0x7fead0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7fead7400640 1 -- 172.21.15.148:0/3946631621 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead00094c0 con 0x7feae0073570 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7fead7400640 1 -- 172.21.15.148:0/3946631621 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fead0032e70 con 0x7feae0073570 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7fead7400640 1 -- 172.21.15.148:0/3946631621 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fead003b640 con 0x7feae0073570 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.474+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae01135d0 con 0x7feae0073570 2024-02-28T16:41:05.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.475+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae0113af0 con 0x7feae0073570 2024-02-28T16:41:05.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.476+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae0064030 con 0x7feae0073570 2024-02-28T16:41:05.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.476+0000 7fead7400640 1 -- 172.21.15.148:0/3946631621 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fead002f070 con 0x7feae0073570 2024-02-28T16:41:05.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.478+0000 7fead7400640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feac406d750 0x7feac406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.478+0000 7fead7400640 1 -- 172.21.15.148:0/3946631621 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fead00af520 con 0x7feae0073570 2024-02-28T16:41:05.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.478+0000 7fead7e00640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feac406d750 0x7feac406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.466 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.479+0000 7fead7e00640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feac406d750 0x7feac406fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feae0114b40 tx=0x7feac800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:05.470 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.483+0000 7fead7400640 1 -- 172.21.15.148:0/3946631621 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fead0078c20 con 0x7feae0073570 2024-02-28T16:41:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.718+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7feae010a470 con 0x7feae0073570 2024-02-28T16:41:05.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.719+0000 7fead7400640 1 -- 172.21.15.148:0/3946631621 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4902 (secure 0 0 0) 0x7fead007c2e0 con 0x7feae0073570 2024-02-28T16:41:05.708 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:05.708 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:37:56.410887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":0,"incarnation":18,"state":"up:replay","state_seq":4,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:05.708 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 19 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.721+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feac406d750 msgr2=0x7feac406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.721+0000 7feae6200640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feac406d750 0x7feac406fc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feae0114b40 tx=0x7feac800b040 comp rx=0 tx=0).stop 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.721+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 msgr2=0x7feae0119280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.721+0000 7feae6200640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0119280 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fead00316d0 tx=0x7fead0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.722+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 shutdown_connections 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.722+0000 7feae6200640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7feac406d750 0x7feac406fc00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.722+0000 7feae6200640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feae0073e80 0x7feae01197c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.709 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.722+0000 7feae6200640 1 --2- 172.21.15.148:0/3946631621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feae0073570 0x7feae0119280 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.722+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 >> 172.21.15.148:0/3946631621 conn(0x7feae00fa160 msgr2=0x7feae00fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:05.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.722+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 shutdown_connections 2024-02-28T16:41:05.710 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.722+0000 7feae6200640 1 -- 172.21.15.148:0/3946631621 wait complete. 2024-02-28T16:41:05.728 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 -- 172.21.15.148:0/488131710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d006f840 msgr2=0x7ff0d006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/488131710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d006f840 0x7ff0d006fc10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40048d0 tx=0x7ff0c4009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 -- 172.21.15.148:0/488131710 shutdown_connections 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/488131710 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0d0070150 0x7ff0d0108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/488131710 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d006f840 0x7ff0d006fc10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 -- 172.21.15.148:0/488131710 >> 172.21.15.148:0/488131710 conn(0x7ff0d00f7cf0 msgr2=0x7ff0d00fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 -- 172.21.15.148:0/488131710 shutdown_connections 2024-02-28T16:41:05.935 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.947+0000 7ff0d5e00640 1 -- 172.21.15.148:0/488131710 wait complete. 2024-02-28T16:41:05.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.948+0000 7ff0d5e00640 1 Processor -- start 2024-02-28T16:41:05.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.948+0000 7ff0d5e00640 1 -- start start 2024-02-28T16:41:05.937 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.948+0000 7ff0d5e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0d006f840 0x7ff0d0114be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.948+0000 7ff0d5e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d0070150 0x7ff0d0115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.948+0000 7ff0d5e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0115720 con 0x7ff0d0070150 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.948+0000 7ff0d5e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d010ecb0 con 0x7ff0d006f840 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0cfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d0070150 0x7ff0d0115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0cfe00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d0070150 0x7ff0d0115120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41150/0 (socket says 172.21.15.148:41150) 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0cfe00640 1 -- 172.21.15.148:0/494213117 learned_addr learned my addr 172.21.15.148:0/494213117 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0d4a00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0d006f840 0x7ff0d0114be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0cfe00640 1 -- 172.21.15.148:0/494213117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0d006f840 msgr2=0x7ff0d0114be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0cfe00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0d006f840 0x7ff0d0114be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0cfe00640 1 -- 172.21.15.148:0/494213117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c4005040 con 0x7ff0d0070150 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.949+0000 7ff0cfe00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d0070150 0x7ff0d0115120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc002a50 tx=0x7ff0bc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:05.938 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.950+0000 7ff0ccc00640 1 -- 172.21.15.148:0/494213117 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0bc007c30 con 0x7ff0d0070150 2024-02-28T16:41:05.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.950+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d010ef90 con 0x7ff0d0070150 2024-02-28T16:41:05.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.950+0000 7ff0ccc00640 1 -- 172.21.15.148:0/494213117 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0bc00f040 con 0x7ff0d0070150 2024-02-28T16:41:05.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.950+0000 7ff0ccc00640 1 -- 172.21.15.148:0/494213117 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0bc00dbe0 con 0x7ff0d0070150 2024-02-28T16:41:05.939 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.950+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d010f4b0 con 0x7ff0d0070150 2024-02-28T16:41:05.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.951+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d004bcc0 con 0x7ff0d0070150 2024-02-28T16:41:05.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.952+0000 7ff0ccc00640 1 -- 172.21.15.148:0/494213117 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff0bc00dd40 con 0x7ff0d0070150 2024-02-28T16:41:05.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.953+0000 7ff0ccc00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff0b806d750 0x7ff0b806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:05.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.953+0000 7ff0ccc00640 1 -- 172.21.15.148:0/494213117 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff0bc08cff0 con 0x7ff0d0070150 2024-02-28T16:41:05.940 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.953+0000 7ff0d4a00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff0b806d750 0x7ff0b806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:05.941 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.954+0000 7ff0d4a00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff0b806d750 0x7ff0b806fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4000c00 tx=0x7ff0c4009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:05.945 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:05.957+0000 7ff0ccc00640 1 -- 172.21.15.148:0/494213117 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff0bc056710 con 0x7ff0d0070150 2024-02-28T16:41:06.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:05 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2217974291' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-28T16:41:06.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:05 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3946631621' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T16:41:06.180 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.193+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7ff0d01101e0 con 0x7ff0d0070150 2024-02-28T16:41:06.182 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.194+0000 7ff0ccc00640 1 -- 172.21.15.148:0/494213117 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4907 (secure 0 0 0) 0x7ff0bc059dd0 con 0x7ff0d0070150 2024-02-28T16:41:06.182 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:06.182 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:05.854169+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":235,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:06.183 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 20 2024-02-28T16:41:06.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.197+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff0b806d750 msgr2=0x7ff0b806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.197+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff0b806d750 0x7ff0b806fc00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4000c00 tx=0x7ff0c4009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.197+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d0070150 msgr2=0x7ff0d0115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.197+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d0070150 0x7ff0d0115120 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc002a50 tx=0x7ff0bc004600 comp rx=0 tx=0).stop 2024-02-28T16:41:06.185 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.198+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 shutdown_connections 2024-02-28T16:41:06.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.198+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0d0070150 0x7ff0d0115120 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.198+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7ff0b806d750 0x7ff0b806fc00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.198+0000 7ff0d5e00640 1 --2- 172.21.15.148:0/494213117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff0d006f840 0x7ff0d0114be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.198+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 >> 172.21.15.148:0/494213117 conn(0x7ff0d00f7cf0 msgr2=0x7ff0d0102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:06.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.198+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 shutdown_connections 2024-02-28T16:41:06.186 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.198+0000 7ff0d5e00640 1 -- 172.21.15.148:0/494213117 wait complete. 2024-02-28T16:41:06.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-28T16:41:06.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:05 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2217974291' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-02-28T16:41:06.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:05 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3946631621' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 -- 172.21.15.148:0/2105385283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104580 msgr2=0x7fa65c104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 --2- 172.21.15.148:0/2105385283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104580 0x7fa65c104950 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa6500048d0 tx=0x7fa650009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 -- 172.21.15.148:0/2105385283 shutdown_connections 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 --2- 172.21.15.148:0/2105385283 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa65c104e90 0x7fa65c0fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 --2- 172.21.15.148:0/2105385283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104580 0x7fa65c104950 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 -- 172.21.15.148:0/2105385283 >> 172.21.15.148:0/2105385283 conn(0x7fa65c0fa160 msgr2=0x7fa65c0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 -- 172.21.15.148:0/2105385283 shutdown_connections 2024-02-28T16:41:06.404 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.416+0000 7fa663c00640 1 -- 172.21.15.148:0/2105385283 wait complete. 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.417+0000 7fa663c00640 1 Processor -- start 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.417+0000 7fa663c00640 1 -- start start 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa663c00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa65c104580 0x7fa65c114e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa663c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104e90 0x7fa65c115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa663c00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c115960 con 0x7fa65c104e90 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa663c00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c10eef0 con 0x7fa65c104580 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa65be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104e90 0x7fa65c115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:06.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa65be00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104e90 0x7fa65c115360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41160/0 (socket says 172.21.15.148:41160) 2024-02-28T16:41:06.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa65be00640 1 -- 172.21.15.148:0/3949394760 learned_addr learned my addr 172.21.15.148:0/3949394760 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:06.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa661200640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa65c104580 0x7fa65c114e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:06.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa65be00640 1 -- 172.21.15.148:0/3949394760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa65c104580 msgr2=0x7fa65c114e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa65be00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa65c104580 0x7fa65c114e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.418+0000 7fa65be00640 1 -- 172.21.15.148:0/3949394760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650005040 con 0x7fa65c104e90 2024-02-28T16:41:06.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.419+0000 7fa65be00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104e90 0x7fa65c115360 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa648002840 tx=0x7fa648004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:06.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.419+0000 7fa658c00640 1 -- 172.21.15.148:0/3949394760 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa648007c30 con 0x7fa65c104e90 2024-02-28T16:41:06.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.419+0000 7fa658c00640 1 -- 172.21.15.148:0/3949394760 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa64800f040 con 0x7fa65c104e90 2024-02-28T16:41:06.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.419+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c10f1d0 con 0x7fa65c104e90 2024-02-28T16:41:06.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.419+0000 7fa658c00640 1 -- 172.21.15.148:0/3949394760 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa648009590 con 0x7fa65c104e90 2024-02-28T16:41:06.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.419+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c10f6f0 con 0x7fa65c104e90 2024-02-28T16:41:06.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.420+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c064480 con 0x7fa65c104e90 2024-02-28T16:41:06.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.421+0000 7fa658c00640 1 -- 172.21.15.148:0/3949394760 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa64800d6b0 con 0x7fa65c104e90 2024-02-28T16:41:06.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.422+0000 7fa658c00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa64406d750 0x7fa64406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:06.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.422+0000 7fa658c00640 1 -- 172.21.15.148:0/3949394760 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa64808c860 con 0x7fa65c104e90 2024-02-28T16:41:06.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.422+0000 7fa661200640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa64406d750 0x7fa64406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:06.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.423+0000 7fa661200640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa64406d750 0x7fa64406fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa650004540 tx=0x7fa650009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:06.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.427+0000 7fa658c00640 1 -- 172.21.15.148:0/3949394760 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa648055f60 con 0x7fa65c104e90 2024-02-28T16:41:06.650 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.663+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fa65c10f910 con 0x7fa65c104e90 2024-02-28T16:41:06.651 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.664+0000 7fa658c00640 1 -- 172.21.15.148:0/3949394760 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4904 (secure 0 0 0) 0x7fa648059620 con 0x7fa65c104e90 2024-02-28T16:41:06.652 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:06.652 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:06.802342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":236,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:06.652 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 21 2024-02-28T16:41:06.654 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa64406d750 msgr2=0x7fa64406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa64406d750 0x7fa64406fc00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa650004540 tx=0x7fa650009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104e90 msgr2=0x7fa65c115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104e90 0x7fa65c115360 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa648002840 tx=0x7fa648004570 comp rx=0 tx=0).stop 2024-02-28T16:41:06.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 shutdown_connections 2024-02-28T16:41:06.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa65c104e90 0x7fa65c115360 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa64406d750 0x7fa64406fc00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.655 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 --2- 172.21.15.148:0/3949394760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa65c104580 0x7fa65c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.667+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 >> 172.21.15.148:0/3949394760 conn(0x7fa65c0fa160 msgr2=0x7fa65c0fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:06.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.668+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 shutdown_connections 2024-02-28T16:41:06.656 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.668+0000 7fa663c00640 1 -- 172.21.15.148:0/3949394760 wait complete. 2024-02-28T16:41:06.673 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-28T16:41:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 -- 172.21.15.148:0/622106030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 msgr2=0x7fc40810cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 --2- 172.21.15.148:0/622106030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc40810cd40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00048d0 tx=0x7fc3f0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 -- 172.21.15.148:0/622106030 shutdown_connections 2024-02-28T16:41:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 --2- 172.21.15.148:0/622106030 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc40810cd40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 --2- 172.21.15.148:0/622106030 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc408073570 0x7fc408073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 -- 172.21.15.148:0/622106030 >> 172.21.15.148:0/622106030 conn(0x7fc4080fa160 msgr2=0x7fc4080fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:06.881 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 -- 172.21.15.148:0/622106030 shutdown_connections 2024-02-28T16:41:06.882 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.893+0000 7fc40de00640 1 -- 172.21.15.148:0/622106030 wait complete. 2024-02-28T16:41:06.883 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.894+0000 7fc40de00640 1 Processor -- start 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.894+0000 7fc40de00640 1 -- start start 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc40de00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc408073570 0x7fc408119260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc40de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc4081197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc40de00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408119da0 con 0x7fc408073e80 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc40de00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408113330 con 0x7fc408073570 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc406000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc4081197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc406000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc4081197a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41178/0 (socket says 172.21.15.148:41178) 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc406000640 1 -- 172.21.15.148:0/1463659970 learned_addr learned my addr 172.21.15.148:0/1463659970 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc406a00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc408073570 0x7fc408119260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc406000640 1 -- 172.21.15.148:0/1463659970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc408073570 msgr2=0x7fc408119260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc406000640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc408073570 0x7fc408119260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.895+0000 7fc406000640 1 -- 172.21.15.148:0/1463659970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0005040 con 0x7fc408073e80 2024-02-28T16:41:06.884 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.896+0000 7fc406000640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc4081197a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00047f0 tx=0x7fc3f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.896+0000 7fc3fea00640 1 -- 172.21.15.148:0/1463659970 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f00094c0 con 0x7fc408073e80 2024-02-28T16:41:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.896+0000 7fc3fea00640 1 -- 172.21.15.148:0/1463659970 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc3f0009620 con 0x7fc408073e80 2024-02-28T16:41:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.896+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4081135b0 con 0x7fc408073e80 2024-02-28T16:41:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.896+0000 7fc3fea00640 1 -- 172.21.15.148:0/1463659970 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f00435f0 con 0x7fc408073e80 2024-02-28T16:41:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.896+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc408113a70 con 0x7fc408073e80 2024-02-28T16:41:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.897+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408064030 con 0x7fc408073e80 2024-02-28T16:41:06.885 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.898+0000 7fc3fea00640 1 -- 172.21.15.148:0/1463659970 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc3f002f070 con 0x7fc408073e80 2024-02-28T16:41:06.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.899+0000 7fc3fea00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3ec06d760 0x7fc3ec06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:06.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.899+0000 7fc3fea00640 1 -- 172.21.15.148:0/1463659970 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc3f00aee90 con 0x7fc408073e80 2024-02-28T16:41:06.886 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.899+0000 7fc406a00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3ec06d760 0x7fc3ec06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:06.887 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.900+0000 7fc406a00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3ec06d760 0x7fc3ec06fc10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8004ce0 tx=0x7fc3f800b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:06.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:06.903+0000 7fc3fea00640 1 -- 172.21.15.148:0/1463659970 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc3f0078610 con 0x7fc408073e80 2024-02-28T16:41:07.126 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.138+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fc408114860 con 0x7fc408073e80 2024-02-28T16:41:07.127 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.140+0000 7fc3fea00640 1 -- 172.21.15.148:0/1463659970 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+4904 (secure 0 0 0) 0x7fc3f007bcd0 con 0x7fc408073e80 2024-02-28T16:41:07.127 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:07.128 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:07.924642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24253":{"gid":24253,"name":"cephfs.smithi157.hinycn","rank":0,"incarnation":18,"state":"up:active","state_seq":237,"addr":"172.21.15.157:6825/696390101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":696390101},{"type":"v1","addr":"172.21.15.157:6825","nonce":696390101}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:07.128 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 22 2024-02-28T16:41:07.130 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3ec06d760 msgr2=0x7fc3ec06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3ec06d760 0x7fc3ec06fc10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8004ce0 tx=0x7fc3f800b040 comp rx=0 tx=0).stop 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 msgr2=0x7fc4081197a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc4081197a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00047f0 tx=0x7fc3f0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 shutdown_connections 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc408073e80 0x7fc4081197a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fc3ec06d760 0x7fc3ec06fc10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 --2- 172.21.15.148:0/1463659970 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc408073570 0x7fc408119260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 >> 172.21.15.148:0/1463659970 conn(0x7fc4080fa160 msgr2=0x7fc4080fbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 shutdown_connections 2024-02-28T16:41:07.131 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.143+0000 7fc40de00640 1 -- 172.21.15.148:0/1463659970 wait complete. 2024-02-28T16:41:07.148 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-28T16:41:07.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:06 smithi148 ceph-mon[112463]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:07.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:06 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/494213117' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T16:41:07.225 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:06 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3949394760' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T16:41:07.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:06 smithi157 ceph-mon[89328]: pgmap v312: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:07.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:06 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/494213117' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T16:41:07.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:06 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3949394760' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 -- 172.21.15.148:0/3219605813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 msgr2=0x7fd63c0fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 --2- 172.21.15.148:0/3219605813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c0fc390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd624009c50 tx=0x7fd624004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 -- 172.21.15.148:0/3219605813 shutdown_connections 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 --2- 172.21.15.148:0/3219605813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c0fc390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 --2- 172.21.15.148:0/3219605813 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c102360 0x7fd63c102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 -- 172.21.15.148:0/3219605813 >> 172.21.15.148:0/3219605813 conn(0x7fd63c0f7ef0 msgr2=0x7fd63c0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 -- 172.21.15.148:0/3219605813 shutdown_connections 2024-02-28T16:41:07.352 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.364+0000 7fd641600640 1 -- 172.21.15.148:0/3219605813 wait complete. 2024-02-28T16:41:07.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.365+0000 7fd641600640 1 Processor -- start 2024-02-28T16:41:07.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.365+0000 7fd641600640 1 -- start start 2024-02-28T16:41:07.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.365+0000 7fd641600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c102360 0x7fd63c114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:07.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.365+0000 7fd641600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:07.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.365+0000 7fd641600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c115940 con 0x7fd63c102d00 2024-02-28T16:41:07.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.365+0000 7fd641600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c115ab0 con 0x7fd63c102360 2024-02-28T16:41:07.354 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63a000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c115340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41200/0 (socket says 172.21.15.148:41200) 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63a000640 1 -- 172.21.15.148:0/680801297 learned_addr learned my addr 172.21.15.148:0/680801297 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63aa00640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c102360 0x7fd63c114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63a000640 1 -- 172.21.15.148:0/680801297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c102360 msgr2=0x7fd63c114e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63a000640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c102360 0x7fd63c114e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63a000640 1 -- 172.21.15.148:0/680801297 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240098b0 con 0x7fd63c102d00 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.366+0000 7fd63a000640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c115340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd624003400 tx=0x7fd624004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.367+0000 7fd632a00640 1 -- 172.21.15.148:0/680801297 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62403a070 con 0x7fd63c102d00 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.367+0000 7fd632a00640 1 -- 172.21.15.148:0/680801297 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd624035b20 con 0x7fd63c102d00 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.367+0000 7fd632a00640 1 -- 172.21.15.148:0/680801297 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62403eb60 con 0x7fd63c102d00 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.367+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c10f020 con 0x7fd63c102d00 2024-02-28T16:41:07.355 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.367+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c10f4f0 con 0x7fd63c102d00 2024-02-28T16:41:07.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.368+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c064480 con 0x7fd63c102d00 2024-02-28T16:41:07.356 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.369+0000 7fd632a00640 1 -- 172.21.15.148:0/680801297 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd624032070 con 0x7fd63c102d00 2024-02-28T16:41:07.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.370+0000 7fd632a00640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd61c06d750 0x7fd61c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:07.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.370+0000 7fd632a00640 1 -- 172.21.15.148:0/680801297 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd6240af380 con 0x7fd63c102d00 2024-02-28T16:41:07.357 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.370+0000 7fd63aa00640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd61c06d750 0x7fd61c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:07.358 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.371+0000 7fd63aa00640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd61c06d750 0x7fd61c06fc00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0041d0 tx=0x7fd62c009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:07.361 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.374+0000 7fd632a00640 1 -- 172.21.15.148:0/680801297 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd624078a80 con 0x7fd63c102d00 2024-02-28T16:41:07.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.608+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fd63c10f760 con 0x7fd63c102d00 2024-02-28T16:41:07.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.609+0000 7fd632a00640 1 -- 172.21.15.148:0/680801297 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+4112 (secure 0 0 0) 0x7fd62407c140 con 0x7fd63c102d00 2024-02-28T16:41:07.597 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:07.597 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:25.908466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:07.597 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 23 2024-02-28T16:41:07.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.611+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd61c06d750 msgr2=0x7fd61c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.611+0000 7fd641600640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd61c06d750 0x7fd61c06fc00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0041d0 tx=0x7fd62c009040 comp rx=0 tx=0).stop 2024-02-28T16:41:07.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.611+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 msgr2=0x7fd63c115340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.611+0000 7fd641600640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c115340 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd624003400 tx=0x7fd624004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:07.599 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.612+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 shutdown_connections 2024-02-28T16:41:07.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.612+0000 7fd641600640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd63c102d00 0x7fd63c115340 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.612+0000 7fd641600640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fd61c06d750 0x7fd61c06fc00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.612+0000 7fd641600640 1 --2- 172.21.15.148:0/680801297 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c102360 0x7fd63c114e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.612+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 >> 172.21.15.148:0/680801297 conn(0x7fd63c0f7ef0 msgr2=0x7fd63c06fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:07.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.612+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 shutdown_connections 2024-02-28T16:41:07.600 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.612+0000 7fd641600640 1 -- 172.21.15.148:0/680801297 wait complete. 2024-02-28T16:41:07.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-28T16:41:07.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 -- 172.21.15.148:0/2427986121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073570 msgr2=0x7f0948073940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 --2- 172.21.15.148:0/2427986121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073570 0x7f0948073940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f09380048d0 tx=0x7f0938009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 -- 172.21.15.148:0/2427986121 shutdown_connections 2024-02-28T16:41:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 --2- 172.21.15.148:0/2427986121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0948073e80 0x7f094810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 --2- 172.21.15.148:0/2427986121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073570 0x7f0948073940 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 -- 172.21.15.148:0/2427986121 >> 172.21.15.148:0/2427986121 conn(0x7f09480fa160 msgr2=0x7f09480fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 -- 172.21.15.148:0/2427986121 shutdown_connections 2024-02-28T16:41:07.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.826+0000 7f094d800640 1 -- 172.21.15.148:0/2427986121 wait complete. 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.827+0000 7f094d800640 1 Processor -- start 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.827+0000 7f094d800640 1 -- start start 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.827+0000 7f094d800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0948073570 0x7f0948119280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.827+0000 7f094d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073e80 0x7f09481197c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.827+0000 7f094d800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948119dc0 con 0x7f0948073e80 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.827+0000 7f094d800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948113350 con 0x7f0948073570 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.827+0000 7f0946000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073e80 0x7f09481197c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f0946000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073e80 0x7f09481197c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41224/0 (socket says 172.21.15.148:41224) 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f0946000640 1 -- 172.21.15.148:0/1523944587 learned_addr learned my addr 172.21.15.148:0/1523944587 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f0946a00640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0948073570 0x7f0948119280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:07.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f0946000640 1 -- 172.21.15.148:0/1523944587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0948073570 msgr2=0x7f0948119280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f0946000640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0948073570 0x7f0948119280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f0946000640 1 -- 172.21.15.148:0/1523944587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938005040 con 0x7f0948073e80 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f0946000640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073e80 0x7f09481197c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0934002a50 tx=0x7f0934004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f093ea00640 1 -- 172.21.15.148:0/1523944587 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0934007c30 con 0x7f0948073e80 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0948113630 con 0x7f0948073e80 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f093ea00640 1 -- 172.21.15.148:0/1523944587 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f093400f040 con 0x7f0948073e80 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.828+0000 7f093ea00640 1 -- 172.21.15.148:0/1523944587 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f093400db50 con 0x7f0948073e80 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.829+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0948113b50 con 0x7f0948073e80 2024-02-28T16:41:07.817 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.830+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0948064030 con 0x7f0948073e80 2024-02-28T16:41:07.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.831+0000 7f093ea00640 1 -- 172.21.15.148:0/1523944587 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f093401c400 con 0x7f0948073e80 2024-02-28T16:41:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.832+0000 7f093ea00640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f092c06d760 0x7f092c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.832+0000 7f093ea00640 1 -- 172.21.15.148:0/1523944587 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f093408c850 con 0x7f0948073e80 2024-02-28T16:41:07.819 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.832+0000 7f0946a00640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f092c06d760 0x7f092c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:07.820 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.833+0000 7f0946a00640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f092c06d760 0x7f092c06fc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0938004540 tx=0x7f0938009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:07.824 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:07.837+0000 7f093ea00640 1 -- 172.21.15.148:0/1523944587 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0934055ff0 con 0x7f0948073e80 2024-02-28T16:41:08.060 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.073+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f0948114880 con 0x7f0948073e80 2024-02-28T16:41:08.061 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.074+0000 7f093ea00640 1 -- 172.21.15.148:0/1523944587 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4123 (secure 0 0 0) 0x7f09340596b0 con 0x7f0948073e80 2024-02-28T16:41:08.061 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:08.062 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:25.921727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:08.062 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 24 2024-02-28T16:41:08.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.076+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f092c06d760 msgr2=0x7f092c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.076+0000 7f094d800640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f092c06d760 0x7f092c06fc10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0938004540 tx=0x7f0938009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.076+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073e80 msgr2=0x7f09481197c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.076+0000 7f094d800640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073e80 0x7f09481197c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0934002a50 tx=0x7f0934004600 comp rx=0 tx=0).stop 2024-02-28T16:41:08.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.077+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 shutdown_connections 2024-02-28T16:41:08.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.077+0000 7f094d800640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0948073e80 0x7f09481197c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.064 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.077+0000 7f094d800640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f092c06d760 0x7f092c06fc10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.077+0000 7f094d800640 1 --2- 172.21.15.148:0/1523944587 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0948073570 0x7f0948119280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.077+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 >> 172.21.15.148:0/1523944587 conn(0x7f09480fa160 msgr2=0x7f09480fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:08.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.077+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 shutdown_connections 2024-02-28T16:41:08.065 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.077+0000 7f094d800640 1 -- 172.21.15.148:0/1523944587 wait complete. 2024-02-28T16:41:08.084 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-28T16:41:08.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:07 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1463659970' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T16:41:08.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:07 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/680801297' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 -- 172.21.15.148:0/3645459099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e8100110 msgr2=0x7f25e8100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 --2- 172.21.15.148:0/3645459099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e8100110 0x7f25e8100560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f25d00048d0 tx=0x7f25d0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 -- 172.21.15.148:0/3645459099 shutdown_connections 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 --2- 172.21.15.148:0/3645459099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e8100110 0x7f25e8100560 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 --2- 172.21.15.148:0/3645459099 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e80fe9c0 0x7f25e80fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 -- 172.21.15.148:0/3645459099 >> 172.21.15.148:0/3645459099 conn(0x7f25e80fa160 msgr2=0x7f25e80fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 -- 172.21.15.148:0/3645459099 shutdown_connections 2024-02-28T16:41:08.287 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.299+0000 7f25ede00640 1 -- 172.21.15.148:0/3645459099 wait complete. 2024-02-28T16:41:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.300+0000 7f25ede00640 1 Processor -- start 2024-02-28T16:41:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.300+0000 7f25ede00640 1 -- start start 2024-02-28T16:41:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.300+0000 7f25ede00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e80fe9c0 0x7f25e8114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.300+0000 7f25ede00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e8100110 0x7f25e8115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.300+0000 7f25ede00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8115920 con 0x7f25e80fe9c0 2024-02-28T16:41:08.289 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.300+0000 7f25ede00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e810eeb0 con 0x7f25e8100110 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25e6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e80fe9c0 0x7f25e8114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25e6a00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e80fe9c0 0x7f25e8114de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41234/0 (socket says 172.21.15.148:41234) 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25e6a00640 1 -- 172.21.15.148:0/1889954522 learned_addr learned my addr 172.21.15.148:0/1889954522 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25de000640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e8100110 0x7f25e8115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25e6a00640 1 -- 172.21.15.148:0/1889954522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e8100110 msgr2=0x7f25e8115320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25e6a00640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e8100110 0x7f25e8115320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25e6a00640 1 -- 172.21.15.148:0/1889954522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d0005040 con 0x7f25e80fe9c0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.301+0000 7f25e6a00640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e80fe9c0 0x7f25e8114de0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25d8002a50 tx=0x7f25d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.302+0000 7f25df400640 1 -- 172.21.15.148:0/1889954522 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d8007c30 con 0x7f25e80fe9c0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.302+0000 7f25df400640 1 -- 172.21.15.148:0/1889954522 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25d800f040 con 0x7f25e80fe9c0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.302+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e810f190 con 0x7f25e80fe9c0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.302+0000 7f25df400640 1 -- 172.21.15.148:0/1889954522 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25d800db50 con 0x7f25e80fe9c0 2024-02-28T16:41:08.290 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.302+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e810f6b0 con 0x7f25e80fe9c0 2024-02-28T16:41:08.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.303+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e8064030 con 0x7f25e80fe9c0 2024-02-28T16:41:08.291 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.304+0000 7f25df400640 1 -- 172.21.15.148:0/1889954522 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f25d800dcf0 con 0x7f25e80fe9c0 2024-02-28T16:41:08.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.305+0000 7f25df400640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f25cc06d750 0x7f25cc06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:08.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.305+0000 7f25df400640 1 -- 172.21.15.148:0/1889954522 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f25d808c870 con 0x7f25e80fe9c0 2024-02-28T16:41:08.292 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.305+0000 7f25de000640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f25cc06d750 0x7f25cc06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:08.293 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.306+0000 7f25de000640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f25cc06d750 0x7f25cc06fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25d002bda0 tx=0x7f25d0009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:08.297 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.309+0000 7f25df400640 1 -- 172.21.15.148:0/1889954522 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f25d8055ff0 con 0x7f25e80fe9c0 2024-02-28T16:41:08.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:07 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1463659970' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T16:41:08.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:07 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/680801297' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T16:41:08.527 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.540+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f25e810f920 con 0x7f25e80fe9c0 2024-02-28T16:41:08.529 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.542+0000 7f25df400640 1 -- 172.21.15.148:0/1889954522 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+4128 (secure 0 0 0) 0x7f25d80596b0 con 0x7f25e80fe9c0 2024-02-28T16:41:08.529 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:08.529 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:35.092951+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":240,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:08.530 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 25 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f25cc06d750 msgr2=0x7f25cc06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f25cc06d750 0x7f25cc06fc00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25d002bda0 tx=0x7f25d0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e80fe9c0 msgr2=0x7f25e8114de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e80fe9c0 0x7f25e8114de0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25d8002a50 tx=0x7f25d8004600 comp rx=0 tx=0).stop 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 shutdown_connections 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f25cc06d750 0x7f25cc06fc00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25e8100110 0x7f25e8115320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 --2- 172.21.15.148:0/1889954522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f25e80fe9c0 0x7f25e8114de0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 >> 172.21.15.148:0/1889954522 conn(0x7f25e80fa160 msgr2=0x7f25e80fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 shutdown_connections 2024-02-28T16:41:08.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.544+0000 7f25ede00640 1 -- 172.21.15.148:0/1889954522 wait complete. 2024-02-28T16:41:08.550 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-28T16:41:08.755 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.767+0000 7fa0dc600640 1 -- 172.21.15.148:0/1855319308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 msgr2=0x7fa0d40fed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.767+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1855319308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d40fed90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80048d0 tx=0x7fa0c8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.768+0000 7fa0dc600640 1 -- 172.21.15.148:0/1855319308 shutdown_connections 2024-02-28T16:41:08.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.768+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1855319308 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d4100110 0x7fa0d4100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.768+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1855319308 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d40fed90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.768+0000 7fa0dc600640 1 -- 172.21.15.148:0/1855319308 >> 172.21.15.148:0/1855319308 conn(0x7fa0d40fa160 msgr2=0x7fa0d40fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:08.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.768+0000 7fa0dc600640 1 -- 172.21.15.148:0/1855319308 shutdown_connections 2024-02-28T16:41:08.756 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.768+0000 7fa0dc600640 1 -- 172.21.15.148:0/1855319308 wait complete. 2024-02-28T16:41:08.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.768+0000 7fa0dc600640 1 Processor -- start 2024-02-28T16:41:08.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0dc600640 1 -- start start 2024-02-28T16:41:08.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0dc600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d4114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:08.757 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0dc600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d4100110 0x7fa0d4115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0dc600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4115920 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0dc600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d410eeb0 con 0x7fa0d4100110 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0d9c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d4114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0d9c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d4114de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41252/0 (socket says 172.21.15.148:41252) 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.769+0000 7fa0d9c00640 1 -- 172.21.15.148:0/1493699841 learned_addr learned my addr 172.21.15.148:0/1493699841 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0d9c00640 1 -- 172.21.15.148:0/1493699841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d4100110 msgr2=0x7fa0d4115320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0d9c00640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d4100110 0x7fa0d4115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0d9c00640 1 -- 172.21.15.148:0/1493699841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8005040 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0d9c00640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d4114de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa0c802bda0 tx=0x7fa0c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:08.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0d1600640 1 -- 172.21.15.148:0/1493699841 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c80094c0 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0d1600640 1 -- 172.21.15.148:0/1493699841 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa0c8032e50 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d410f130 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.770+0000 7fa0d1600640 1 -- 172.21.15.148:0/1493699841 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0c80435f0 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.771+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d410f5f0 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.759 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.772+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d4064030 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.760 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.773+0000 7fa0d1600640 1 -- 172.21.15.148:0/1493699841 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa0c802f070 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.774+0000 7fa0d1600640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa0bc06d760 0x7fa0bc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:08.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.774+0000 7fa0d1600640 1 -- 172.21.15.148:0/1493699841 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa0c80aee30 con 0x7fa0d40fe9c0 2024-02-28T16:41:08.761 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.774+0000 7fa0d9200640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa0bc06d760 0x7fa0bc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:08.762 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.775+0000 7fa0d9200640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa0bc06d760 0x7fa0bc06fc10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0d41106a0 tx=0x7fa0c0009c50 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:08.765 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:08.778+0000 7fa0d1600640 1 -- 172.21.15.148:0/1493699841 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa0c80785d0 con 0x7fa0d40fe9c0 2024-02-28T16:41:09.003 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.015+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fa0d4102850 con 0x7fa0d40fe9c0 2024-02-28T16:41:09.004 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.017+0000 7fa0d1600640 1 -- 172.21.15.148:0/1493699841 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4125 (secure 0 0 0) 0x7fa0c807bc90 con 0x7fa0d40fe9c0 2024-02-28T16:41:09.004 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:09.004 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:35.819655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":241,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:09.005 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 26 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa0bc06d760 msgr2=0x7fa0bc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa0bc06d760 0x7fa0bc06fc10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0d41106a0 tx=0x7fa0c0009c50 comp rx=0 tx=0).stop 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 msgr2=0x7fa0d4114de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d4114de0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa0c802bda0 tx=0x7fa0c8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 shutdown_connections 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa0bc06d760 0x7fa0bc06fc10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0d4100110 0x7fa0d4115320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.007 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 --2- 172.21.15.148:0/1493699841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa0d40fe9c0 0x7fa0d4114de0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 >> 172.21.15.148:0/1493699841 conn(0x7fa0d40fa160 msgr2=0x7fa0d40fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:09.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 shutdown_connections 2024-02-28T16:41:09.008 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.019+0000 7fa0dc600640 1 -- 172.21.15.148:0/1493699841 wait complete. 2024-02-28T16:41:09.025 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-28T16:41:09.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 -- 172.21.15.148:0/3635982248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc06f840 msgr2=0x7fa9fc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.229 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 --2- 172.21.15.148:0/3635982248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc06f840 0x7fa9fc06fc10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00048d0 tx=0x7fa9f0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 -- 172.21.15.148:0/3635982248 shutdown_connections 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 --2- 172.21.15.148:0/3635982248 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9fc070150 0x7fa9fc108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 --2- 172.21.15.148:0/3635982248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc06f840 0x7fa9fc06fc10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 -- 172.21.15.148:0/3635982248 >> 172.21.15.148:0/3635982248 conn(0x7fa9fc0f7ee0 msgr2=0x7fa9fc0fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 -- 172.21.15.148:0/3635982248 shutdown_connections 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.238+0000 7faa04600640 1 -- 172.21.15.148:0/3635982248 wait complete. 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.239+0000 7faa04600640 1 Processor -- start 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.239+0000 7faa04600640 1 -- start start 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.239+0000 7faa04600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9fc06f840 0x7fa9fc114ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:09.230 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.239+0000 7faa04600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc070150 0x7fa9fc1153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.239+0000 7faa04600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc1159e0 con 0x7fa9fc070150 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.239+0000 7faa04600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc10ef70 con 0x7fa9fc06f840 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc070150 0x7fa9fc1153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc070150 0x7fa9fc1153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41282/0 (socket says 172.21.15.148:41282) 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01200640 1 -- 172.21.15.148:0/991770821 learned_addr learned my addr 172.21.15.148:0/991770821 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01c00640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9fc06f840 0x7fa9fc114ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01200640 1 -- 172.21.15.148:0/991770821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9fc06f840 msgr2=0x7fa9fc114ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01200640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9fc06f840 0x7fa9fc114ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01200640 1 -- 172.21.15.148:0/991770821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0005040 con 0x7fa9fc070150 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7faa01200640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc070150 0x7fa9fc1153e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8002a50 tx=0x7fa9e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.240+0000 7fa9f9600640 1 -- 172.21.15.148:0/991770821 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e8007c30 con 0x7fa9fc070150 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.241+0000 7fa9f9600640 1 -- 172.21.15.148:0/991770821 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9e800f040 con 0x7fa9fc070150 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.241+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc10f250 con 0x7fa9fc070150 2024-02-28T16:41:09.231 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.241+0000 7fa9f9600640 1 -- 172.21.15.148:0/991770821 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e800dad0 con 0x7fa9fc070150 2024-02-28T16:41:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.241+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc10f770 con 0x7fa9fc070150 2024-02-28T16:41:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.242+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc064480 con 0x7fa9fc070150 2024-02-28T16:41:09.232 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.243+0000 7fa9f9600640 1 -- 172.21.15.148:0/991770821 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa9e800dc70 con 0x7fa9fc070150 2024-02-28T16:41:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.244+0000 7fa9f9600640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9e406d760 0x7fa9e406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.244+0000 7fa9f9600640 1 -- 172.21.15.148:0/991770821 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa9e808c6f0 con 0x7fa9fc070150 2024-02-28T16:41:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.244+0000 7faa01c00640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9e406d760 0x7fa9e406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:09.233 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.245+0000 7faa01c00640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9e406d760 0x7fa9e406fc10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00048a0 tx=0x7fa9f0009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:09.235 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.248+0000 7fa9f9600640 1 -- 172.21.15.148:0/991770821 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa9e8055f10 con 0x7fa9fc070150 2024-02-28T16:41:09.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:08 smithi157 ceph-mon[89328]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:09.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:08 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1523944587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T16:41:09.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:08 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1889954522' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T16:41:09.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:08 smithi148 ceph-mon[112463]: pgmap v313: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:09.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:08 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1523944587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T16:41:09.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:08 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1889954522' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T16:41:09.473 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.486+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fa9fc10b6d0 con 0x7fa9fc070150 2024-02-28T16:41:09.475 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.488+0000 7fa9f9600640 1 -- 172.21.15.148:0/991770821 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+4125 (secure 0 0 0) 0x7fa9e80595d0 con 0x7fa9fc070150 2024-02-28T16:41:09.475 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:09.475 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:36.957794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":0,"incarnation":24,"state":"up:active","state_seq":242,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:09.476 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 27 2024-02-28T16:41:09.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9e406d760 msgr2=0x7fa9e406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9e406d760 0x7fa9e406fc10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00048a0 tx=0x7fa9f0009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc070150 msgr2=0x7fa9fc1153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.478 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc070150 0x7fa9fc1153e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8002a50 tx=0x7fa9e8004600 comp rx=0 tx=0).stop 2024-02-28T16:41:09.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 shutdown_connections 2024-02-28T16:41:09.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa9fc070150 0x7fa9fc1153e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa9e406d760 0x7fa9e406fc10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 --2- 172.21.15.148:0/991770821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa9fc06f840 0x7fa9fc114ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 >> 172.21.15.148:0/991770821 conn(0x7fa9fc0f7ee0 msgr2=0x7fa9fc102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:09.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 shutdown_connections 2024-02-28T16:41:09.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.491+0000 7faa04600640 1 -- 172.21.15.148:0/991770821 wait complete. 2024-02-28T16:41:09.496 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-28T16:41:09.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 -- 172.21.15.148:0/1786608966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6340700f0 msgr2=0x7fb6341086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 --2- 172.21.15.148:0/1786608966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6340700f0 0x7fb6341086f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6200048d0 tx=0x7fb620009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 -- 172.21.15.148:0/1786608966 shutdown_connections 2024-02-28T16:41:09.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 --2- 172.21.15.148:0/1786608966 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb6340700f0 0x7fb6341086f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 --2- 172.21.15.148:0/1786608966 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb63406f7e0 0x7fb63406fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 -- 172.21.15.148:0/1786608966 >> 172.21.15.148:0/1786608966 conn(0x7fb6340f7ef0 msgr2=0x7fb6340fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:09.701 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 -- 172.21.15.148:0/1786608966 shutdown_connections 2024-02-28T16:41:09.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.713+0000 7fb63c600640 1 -- 172.21.15.148:0/1786608966 wait complete. 2024-02-28T16:41:09.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.714+0000 7fb63c600640 1 Processor -- start 2024-02-28T16:41:09.702 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.714+0000 7fb63c600640 1 -- start start 2024-02-28T16:41:09.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.714+0000 7fb63c600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63406f7e0 0x7fb634114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:09.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.714+0000 7fb63c600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6340700f0 0x7fb634115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:09.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.714+0000 7fb63c600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb634115940 con 0x7fb63406f7e0 2024-02-28T16:41:09.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.714+0000 7fb63c600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63410eed0 con 0x7fb6340700f0 2024-02-28T16:41:09.703 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63406f7e0 0x7fb634114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63406f7e0 0x7fb634114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41300/0 (socket says 172.21.15.148:41300) 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639c00640 1 -- 172.21.15.148:0/3940443397 learned_addr learned my addr 172.21.15.148:0/3940443397 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639200640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6340700f0 0x7fb634115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639c00640 1 -- 172.21.15.148:0/3940443397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6340700f0 msgr2=0x7fb634115340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639c00640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6340700f0 0x7fb634115340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639c00640 1 -- 172.21.15.148:0/3940443397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb620005040 con 0x7fb63406f7e0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb639c00640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63406f7e0 0x7fb634114e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb62400cae0 tx=0x7fb624007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.715+0000 7fb631600640 1 -- 172.21.15.148:0/3940443397 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62400ab00 con 0x7fb63406f7e0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.716+0000 7fb631600640 1 -- 172.21.15.148:0/3940443397 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb62400ac60 con 0x7fb63406f7e0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.716+0000 7fb631600640 1 -- 172.21.15.148:0/3940443397 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6240116f0 con 0x7fb63406f7e0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.716+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63410f1b0 con 0x7fb63406f7e0 2024-02-28T16:41:09.704 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.716+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63410f6a0 con 0x7fb63406f7e0 2024-02-28T16:41:09.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.717+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb634064480 con 0x7fb63406f7e0 2024-02-28T16:41:09.705 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.718+0000 7fb631600640 1 -- 172.21.15.148:0/3940443397 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb624012440 con 0x7fb63406f7e0 2024-02-28T16:41:09.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.718+0000 7fb631600640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fb61806d750 0x7fb61806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:09.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.719+0000 7fb631600640 1 -- 172.21.15.148:0/3940443397 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb62408d870 con 0x7fb63406f7e0 2024-02-28T16:41:09.706 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.719+0000 7fb639200640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fb61806d750 0x7fb61806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:09.707 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.719+0000 7fb639200640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fb61806d750 0x7fb61806fc00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb634110010 tx=0x7fb620009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:09.711 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.724+0000 7fb631600640 1 -- 172.21.15.148:0/3940443397 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb624056ff0 con 0x7fb63406f7e0 2024-02-28T16:41:09.950 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.963+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fb63410b6b0 con 0x7fb63406f7e0 2024-02-28T16:41:09.951 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.964+0000 7fb631600640 1 -- 172.21.15.148:0/3940443397 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+4941 (secure 0 0 0) 0x7fb62405a6b0 con 0x7fb63406f7e0 2024-02-28T16:41:09.951 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:09.951 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:36.957794+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":83,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24267":{"gid":24267,"name":"cephfs.smithi157.dreayg","rank":0,"incarnation":24,"state":"up:active","state_seq":242,"addr":"172.21.15.157:6827/2090793909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":2090793909},{"type":"v1","addr":"172.21.15.157:6827","nonce":2090793909}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:09.952 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 28 2024-02-28T16:41:09.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.966+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fb61806d750 msgr2=0x7fb61806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.966+0000 7fb63c600640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fb61806d750 0x7fb61806fc00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb634110010 tx=0x7fb620009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.966+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63406f7e0 msgr2=0x7fb634114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:09.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.966+0000 7fb63c600640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63406f7e0 0x7fb634114e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb62400cae0 tx=0x7fb624007e50 comp rx=0 tx=0).stop 2024-02-28T16:41:09.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.967+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 shutdown_connections 2024-02-28T16:41:09.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.967+0000 7fb63c600640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fb61806d750 0x7fb61806fc00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.954 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.967+0000 7fb63c600640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb6340700f0 0x7fb634115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.967+0000 7fb63c600640 1 --2- 172.21.15.148:0/3940443397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb63406f7e0 0x7fb634114e00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:09.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.967+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 >> 172.21.15.148:0/3940443397 conn(0x7fb6340f7ef0 msgr2=0x7fb634102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:09.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.967+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 shutdown_connections 2024-02-28T16:41:09.955 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:09.967+0000 7fb63c600640 1 -- 172.21.15.148:0/3940443397 wait complete. 2024-02-28T16:41:09.972 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-28T16:41:10.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 -- 172.21.15.148:0/1837385151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 msgr2=0x7faf3c1032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.174 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 --2- 172.21.15.148:0/1837385151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1032d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7faf240048d0 tx=0x7faf24009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 -- 172.21.15.148:0/1837385151 shutdown_connections 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 --2- 172.21.15.148:0/1837385151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1032d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 --2- 172.21.15.148:0/1837385151 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf3c108990 0x7faf3c108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 -- 172.21.15.148:0/1837385151 >> 172.21.15.148:0/1837385151 conn(0x7faf3c072210 msgr2=0x7faf3c074620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 -- 172.21.15.148:0/1837385151 shutdown_connections 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.186+0000 7faf42800640 1 -- 172.21.15.148:0/1837385151 wait complete. 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.187+0000 7faf42800640 1 Processor -- start 2024-02-28T16:41:10.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.187+0000 7faf42800640 1 -- start start 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.187+0000 7faf42800640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf3c108990 0x7faf3c1192a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.187+0000 7faf42800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1197e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.187+0000 7faf42800640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c119e70 con 0x7faf3c109330 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.187+0000 7faf42800640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c113370 con 0x7faf3c108990 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41318/0 (socket says 172.21.15.148:41318) 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3aa00640 1 -- 172.21.15.148:0/3787748771 learned_addr learned my addr 172.21.15.148:0/3787748771 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:10.178 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3b400640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf3c108990 0x7faf3c1192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3aa00640 1 -- 172.21.15.148:0/3787748771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf3c108990 msgr2=0x7faf3c1192a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3aa00640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf3c108990 0x7faf3c1192a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3aa00640 1 -- 172.21.15.148:0/3787748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24005040 con 0x7faf3c109330 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.188+0000 7faf3aa00640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1197e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faf24034040 tx=0x7faf24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.189+0000 7faf33400640 1 -- 172.21.15.148:0/3787748771 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf240094c0 con 0x7faf3c109330 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.189+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c1135f0 con 0x7faf3c109330 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.189+0000 7faf33400640 1 -- 172.21.15.148:0/3787748771 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf24009620 con 0x7faf3c109330 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.189+0000 7faf33400640 1 -- 172.21.15.148:0/3787748771 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf240435f0 con 0x7faf3c109330 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.189+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c113ab0 con 0x7faf3c109330 2024-02-28T16:41:10.179 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.190+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c064480 con 0x7faf3c109330 2024-02-28T16:41:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.191+0000 7faf33400640 1 -- 172.21.15.148:0/3787748771 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7faf2402f070 con 0x7faf3c109330 2024-02-28T16:41:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.192+0000 7faf33400640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faf2006d760 0x7faf2006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.192+0000 7faf33400640 1 -- 172.21.15.148:0/3787748771 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7faf240aef70 con 0x7faf3c109330 2024-02-28T16:41:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.192+0000 7faf3b400640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faf2006d760 0x7faf2006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:10.181 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.193+0000 7faf3b400640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faf2006d760 0x7faf2006fc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf2c006fd0 tx=0x7faf2c008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:10.184 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.197+0000 7faf33400640 1 -- 172.21.15.148:0/3787748771 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faf24078670 con 0x7faf3c109330 2024-02-28T16:41:10.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:09 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1493699841' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T16:41:10.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:09 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/991770821' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T16:41:10.237 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:09 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3940443397' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T16:41:10.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:09 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1493699841' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T16:41:10.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:09 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/991770821' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T16:41:10.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:09 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3940443397' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T16:41:10.419 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.432+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7faf3c1148a0 con 0x7faf3c109330 2024-02-28T16:41:10.421 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.433+0000 7faf33400640 1 -- 172.21.15.148:0/3787748771 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+4146 (secure 0 0 0) 0x7faf2407bd30 con 0x7faf3c109330 2024-02-28T16:41:10.421 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:10.421 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":16},{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:58.553244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:10.421 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 29 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faf2006d760 msgr2=0x7faf2006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faf2006d760 0x7faf2006fc10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faf2c006fd0 tx=0x7faf2c008040 comp rx=0 tx=0).stop 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 msgr2=0x7faf3c1197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1197e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7faf24034040 tx=0x7faf24009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 shutdown_connections 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faf3c109330 0x7faf3c1197e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7faf2006d760 0x7faf2006fc10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 --2- 172.21.15.148:0/3787748771 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf3c108990 0x7faf3c1192a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 >> 172.21.15.148:0/3787748771 conn(0x7faf3c072210 msgr2=0x7faf3c073db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 shutdown_connections 2024-02-28T16:41:10.424 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.436+0000 7faf42800640 1 -- 172.21.15.148:0/3787748771 wait complete. 2024-02-28T16:41:10.441 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-28T16:41:10.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.654+0000 7f2a93e00640 1 -- 172.21.15.148:0/827685100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102d00 msgr2=0x7f2a8c0fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.654+0000 7f2a93e00640 1 --2- 172.21.15.148:0/827685100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102d00 0x7f2a8c0fc390 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2a780048d0 tx=0x7f2a78009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.655+0000 7f2a93e00640 1 -- 172.21.15.148:0/827685100 shutdown_connections 2024-02-28T16:41:10.642 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.655+0000 7f2a93e00640 1 --2- 172.21.15.148:0/827685100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102d00 0x7f2a8c0fc390 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.655+0000 7f2a93e00640 1 --2- 172.21.15.148:0/827685100 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a8c102360 0x7f2a8c102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.655+0000 7f2a93e00640 1 -- 172.21.15.148:0/827685100 >> 172.21.15.148:0/827685100 conn(0x7f2a8c0f7ef0 msgr2=0x7f2a8c0fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:10.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.655+0000 7f2a93e00640 1 -- 172.21.15.148:0/827685100 shutdown_connections 2024-02-28T16:41:10.643 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.655+0000 7f2a93e00640 1 -- 172.21.15.148:0/827685100 wait complete. 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a93e00640 1 Processor -- start 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a93e00640 1 -- start start 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a93e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102360 0x7f2a8c112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a93e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a8c102d00 0x7f2a8c113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a93e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c113730 con 0x7f2a8c102360 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a93e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c10ccc0 con 0x7f2a8c102d00 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a91400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102360 0x7f2a8c112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a91400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102360 0x7f2a8c112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41336/0 (socket says 172.21.15.148:41336) 2024-02-28T16:41:10.645 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.656+0000 7f2a91400640 1 -- 172.21.15.148:0/233389713 learned_addr learned my addr 172.21.15.148:0/233389713 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a90a00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a8c102d00 0x7f2a8c113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a91400640 1 -- 172.21.15.148:0/233389713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a8c102d00 msgr2=0x7f2a8c113130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a91400640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a8c102d00 0x7f2a8c113130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a91400640 1 -- 172.21.15.148:0/233389713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78005040 con 0x7f2a8c102360 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a91400640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102360 0x7f2a8c112bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000c790 tx=0x7f2a800043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a89600640 1 -- 172.21.15.148:0/233389713 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a8000a820 con 0x7f2a8c102360 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a89600640 1 -- 172.21.15.148:0/233389713 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a8000ae50 con 0x7f2a8c102360 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c10cfa0 con 0x7f2a8c102360 2024-02-28T16:41:10.646 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a89600640 1 -- 172.21.15.148:0/233389713 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a800115e0 con 0x7f2a8c102360 2024-02-28T16:41:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.657+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c10d4c0 con 0x7f2a8c102360 2024-02-28T16:41:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.659+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c064480 con 0x7f2a8c102360 2024-02-28T16:41:10.647 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.659+0000 7f2a89600640 1 -- 172.21.15.148:0/233389713 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2a80012400 con 0x7f2a8c102360 2024-02-28T16:41:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.661+0000 7f2a89600640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2a7406d760 0x7f2a7406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:10.648 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.661+0000 7f2a89600640 1 -- 172.21.15.148:0/233389713 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f2a8008d020 con 0x7f2a8c102360 2024-02-28T16:41:10.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.661+0000 7f2a90a00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2a7406d760 0x7f2a7406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:10.649 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.662+0000 7f2a90a00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2a7406d760 0x7f2a7406fc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a78034040 tx=0x7f2a78009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:10.653 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.666+0000 7f2a89600640 1 -- 172.21.15.148:0/233389713 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2a800568e0 con 0x7f2a8c102360 2024-02-28T16:41:10.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.905+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f2a8c10d790 con 0x7f2a8c102360 2024-02-28T16:41:10.893 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.906+0000 7f2a89600640 1 -- 172.21.15.148:0/233389713 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+4191 (secure 0 0 0) 0x7f2a80059fa0 con 0x7f2a8c102360 2024-02-28T16:41:10.894 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:10.894 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:58.565388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:10.894 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 30 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2a7406d760 msgr2=0x7f2a7406fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2a7406d760 0x7f2a7406fc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a78034040 tx=0x7f2a78009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102360 msgr2=0x7f2a8c112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102360 0x7f2a8c112bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a8000c790 tx=0x7f2a800043c0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 shutdown_connections 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f2a7406d760 0x7f2a7406fc10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2a8c102d00 0x7f2a8c113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 --2- 172.21.15.148:0/233389713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2a8c102360 0x7f2a8c112bf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:10.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.909+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 >> 172.21.15.148:0/233389713 conn(0x7f2a8c0f7ef0 msgr2=0x7f2a8c0f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:10.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.910+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 shutdown_connections 2024-02-28T16:41:10.898 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:10.910+0000 7f2a93e00640 1 -- 172.21.15.148:0/233389713 wait complete. 2024-02-28T16:41:10.916 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-28T16:41:11.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 -- 172.21.15.148:0/3397287038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102d00 msgr2=0x7f8b640fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 --2- 172.21.15.148:0/3397287038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102d00 0x7f8b640fc390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009c50 tx=0x7f8b50004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:11.115 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 -- 172.21.15.148:0/3397287038 shutdown_connections 2024-02-28T16:41:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 --2- 172.21.15.148:0/3397287038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102d00 0x7f8b640fc390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 --2- 172.21.15.148:0/3397287038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b64102360 0x7f8b64102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 -- 172.21.15.148:0/3397287038 >> 172.21.15.148:0/3397287038 conn(0x7f8b640f7ef0 msgr2=0x7f8b640fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 -- 172.21.15.148:0/3397287038 shutdown_connections 2024-02-28T16:41:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.127+0000 7f8b6c200640 1 -- 172.21.15.148:0/3397287038 wait complete. 2024-02-28T16:41:11.116 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.128+0000 7f8b6c200640 1 Processor -- start 2024-02-28T16:41:11.119 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.128+0000 7f8b6c200640 1 -- start start 2024-02-28T16:41:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.128+0000 7f8b6c200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102360 0x7f8b64114e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.128+0000 7f8b6c200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b64102d00 0x7f8b64115340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.128+0000 7f8b6c200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64115940 con 0x7f8b64102360 2024-02-28T16:41:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.128+0000 7f8b6c200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6410eed0 con 0x7f8b64102d00 2024-02-28T16:41:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.129+0000 7f8b69800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102360 0x7f8b64114e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.129+0000 7f8b69800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102360 0x7f8b64114e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41366/0 (socket says 172.21.15.148:41366) 2024-02-28T16:41:11.120 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.129+0000 7f8b69800640 1 -- 172.21.15.148:0/1294761407 learned_addr learned my addr 172.21.15.148:0/1294761407 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.129+0000 7f8b68e00640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b64102d00 0x7f8b64115340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.129+0000 7f8b69800640 1 -- 172.21.15.148:0/1294761407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b64102d00 msgr2=0x7f8b64115340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.129+0000 7f8b69800640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b64102d00 0x7f8b64115340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.129+0000 7f8b69800640 1 -- 172.21.15.148:0/1294761407 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500098b0 con 0x7f8b64102360 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.130+0000 7f8b69800640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102360 0x7f8b64114e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8b54002a50 tx=0x7f8b54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.130+0000 7f8b61600640 1 -- 172.21.15.148:0/1294761407 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b54007c30 con 0x7f8b64102360 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.130+0000 7f8b61600640 1 -- 172.21.15.148:0/1294761407 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b5400f040 con 0x7f8b64102360 2024-02-28T16:41:11.121 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.130+0000 7f8b61600640 1 -- 172.21.15.148:0/1294761407 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5400db50 con 0x7f8b64102360 2024-02-28T16:41:11.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.130+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6410f1b0 con 0x7f8b64102360 2024-02-28T16:41:11.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.130+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6410f750 con 0x7f8b64102360 2024-02-28T16:41:11.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.131+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b64064480 con 0x7f8b64102360 2024-02-28T16:41:11.122 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.132+0000 7f8b61600640 1 -- 172.21.15.148:0/1294761407 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f8b5401c400 con 0x7f8b64102360 2024-02-28T16:41:11.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.133+0000 7f8b61600640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8b4806d750 0x7f8b4806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:11.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.133+0000 7f8b61600640 1 -- 172.21.15.148:0/1294761407 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8b5408c850 con 0x7f8b64102360 2024-02-28T16:41:11.123 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.133+0000 7f8b68e00640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8b4806d750 0x7f8b4806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:11.124 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.134+0000 7f8b68e00640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8b4806d750 0x7f8b4806fc00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b641106c0 tx=0x7f8b5002e040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:11.125 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.137+0000 7f8b61600640 1 -- 172.21.15.148:0/1294761407 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b54055ff0 con 0x7f8b64102360 2024-02-28T16:41:11.369 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.382+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f8b6410f970 con 0x7f8b64102360 2024-02-28T16:41:11.370 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.383+0000 7f8b61600640 1 -- 172.21.15.148:0/1294761407 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+5007 (secure 0 0 0) 0x7f8b540596b0 con 0x7f8b64102360 2024-02-28T16:41:11.371 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:11.371 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44299,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/3119390220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3119390220},{"type":"v1","addr":"172.21.15.157:6827","nonce":3119390220}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:38:58.565388+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":0,"incarnation":30,"state":"up:replay","state_seq":1,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:11.371 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 31 2024-02-28T16:41:11.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:10 smithi148 ceph-mon[112463]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:11.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:10 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3787748771' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T16:41:11.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:10 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/233389713' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8b4806d750 msgr2=0x7f8b4806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8b4806d750 0x7f8b4806fc00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b641106c0 tx=0x7f8b5002e040 comp rx=0 tx=0).stop 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102360 msgr2=0x7f8b64114e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102360 0x7f8b64114e00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8b54002a50 tx=0x7f8b54004600 comp rx=0 tx=0).stop 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 shutdown_connections 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f8b4806d750 0x7f8b4806fc00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8b64102d00 0x7f8b64115340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.374 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 --2- 172.21.15.148:0/1294761407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b64102360 0x7f8b64114e00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.386+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 >> 172.21.15.148:0/1294761407 conn(0x7f8b640f7ef0 msgr2=0x7f8b640f97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:11.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.387+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 shutdown_connections 2024-02-28T16:41:11.375 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.387+0000 7f8b6c200640 1 -- 172.21.15.148:0/1294761407 wait complete. 2024-02-28T16:41:11.392 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-28T16:41:11.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:11 smithi157 ceph-mon[89328]: pgmap v314: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:11.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:11 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3787748771' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T16:41:11.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:11 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/233389713' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T16:41:11.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 -- 172.21.15.148:0/283948036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 msgr2=0x7f7798104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 --2- 172.21.15.148:0/283948036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798104930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f778c0048d0 tx=0x7f778c009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 -- 172.21.15.148:0/283948036 shutdown_connections 2024-02-28T16:41:11.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 --2- 172.21.15.148:0/283948036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7798104f00 0x7f77980fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 --2- 172.21.15.148:0/283948036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798104930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.592 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 -- 172.21.15.148:0/283948036 >> 172.21.15.148:0/283948036 conn(0x7f77980fa160 msgr2=0x7f77980fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:11.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 -- 172.21.15.148:0/283948036 shutdown_connections 2024-02-28T16:41:11.593 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.604+0000 7f77a0200640 1 -- 172.21.15.148:0/283948036 wait complete. 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.605+0000 7f77a0200640 1 Processor -- start 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.605+0000 7f77a0200640 1 -- start start 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f77a0200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798114e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f77a0200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7798104f00 0x7f7798115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f77a0200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7798115960 con 0x7f7798104560 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f77a0200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779810eef0 con 0x7f7798104f00 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f779d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798114e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:11.594 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f779d800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798114e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41378/0 (socket says 172.21.15.148:41378) 2024-02-28T16:41:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f779d800640 1 -- 172.21.15.148:0/1380395404 learned_addr learned my addr 172.21.15.148:0/1380395404 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f779d800640 1 -- 172.21.15.148:0/1380395404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7798104f00 msgr2=0x7f7798115360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.606+0000 7f779d800640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7798104f00 0x7f7798115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.607+0000 7f779d800640 1 -- 172.21.15.148:0/1380395404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c005040 con 0x7f7798104560 2024-02-28T16:41:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.607+0000 7f779d800640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798114e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f778c031720 tx=0x7f778c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:11.595 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.607+0000 7f7795600640 1 -- 172.21.15.148:0/1380395404 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f778c0094c0 con 0x7f7798104560 2024-02-28T16:41:11.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.607+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779810f170 con 0x7f7798104560 2024-02-28T16:41:11.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.607+0000 7f7795600640 1 -- 172.21.15.148:0/1380395404 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f778c009620 con 0x7f7798104560 2024-02-28T16:41:11.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.607+0000 7f7795600640 1 -- 172.21.15.148:0/1380395404 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f778c03b640 con 0x7f7798104560 2024-02-28T16:41:11.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.607+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779810f690 con 0x7f7798104560 2024-02-28T16:41:11.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.609+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7798064480 con 0x7f7798104560 2024-02-28T16:41:11.596 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.609+0000 7f7795600640 1 -- 172.21.15.148:0/1380395404 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f778c02f070 con 0x7f7798104560 2024-02-28T16:41:11.597 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.610+0000 7f7795600640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f778006d750 0x7f778006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.610+0000 7f7795600640 1 -- 172.21.15.148:0/1380395404 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f778c0af570 con 0x7f7798104560 2024-02-28T16:41:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.610+0000 7f779ce00640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f778006d750 0x7f778006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:11.598 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.611+0000 7f779ce00640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f778006d750 0x7f778006fc00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f77981106e0 tx=0x7f7784009c50 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:11.602 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.615+0000 7f7795600640 1 -- 172.21.15.148:0/1380395404 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f778c078cb0 con 0x7f7798104560 2024-02-28T16:41:11.839 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.852+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f779810f820 con 0x7f7798104560 2024-02-28T16:41:11.841 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.853+0000 7f7795600640 1 -- 172.21.15.148:0/1380395404 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+5011 (secure 0 0 0) 0x7f778c07c370 con 0x7f7798104560 2024-02-28T16:41:11.841 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:11.841 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44299,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/3119390220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3119390220},{"type":"v1","addr":"172.21.15.157:6827","nonce":3119390220}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:39:07.727332+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":0,"incarnation":30,"state":"up:reconnect","state_seq":25,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:11.841 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 32 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f778006d750 msgr2=0x7f778006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f778006d750 0x7f778006fc00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f77981106e0 tx=0x7f7784009c50 comp rx=0 tx=0).stop 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 msgr2=0x7f7798114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798114e20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f778c031720 tx=0x7f778c009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 shutdown_connections 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f778006d750 0x7f778006fc00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7798104f00 0x7f7798115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 --2- 172.21.15.148:0/1380395404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7798104560 0x7f7798114e20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 >> 172.21.15.148:0/1380395404 conn(0x7f77980fa160 msgr2=0x7f77980fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 shutdown_connections 2024-02-28T16:41:11.844 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:11.856+0000 7f77a0200640 1 -- 172.21.15.148:0/1380395404 wait complete. 2024-02-28T16:41:11.864 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 -- 172.21.15.148:0/3968062454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 msgr2=0x7f8988102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 --2- 172.21.15.148:0/3968062454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988102730 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f89780048d0 tx=0x7f8978009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 -- 172.21.15.148:0/3968062454 shutdown_connections 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 --2- 172.21.15.148:0/3968062454 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8988102d00 0x7f89880fc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 --2- 172.21.15.148:0/3968062454 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988102730 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 -- 172.21.15.148:0/3968062454 >> 172.21.15.148:0/3968062454 conn(0x7f89880f7ef0 msgr2=0x7f89880fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 -- 172.21.15.148:0/3968062454 shutdown_connections 2024-02-28T16:41:12.066 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.078+0000 7f898d000640 1 -- 172.21.15.148:0/3968062454 wait complete. 2024-02-28T16:41:12.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.079+0000 7f898d000640 1 Processor -- start 2024-02-28T16:41:12.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.079+0000 7f898d000640 1 -- start start 2024-02-28T16:41:12.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f898d000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988109d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:12.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f898d000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8988102d00 0x7f898810a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:12.067 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f898d000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898810dc90 con 0x7f8988102360 2024-02-28T16:41:12.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f898d000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898810de00 con 0x7f8988102d00 2024-02-28T16:41:12.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f8985e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:12.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f8985e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53742/0 (socket says 172.21.15.148:53742) 2024-02-28T16:41:12.068 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f8985e00640 1 -- 172.21.15.148:0/3721644298 learned_addr learned my addr 172.21.15.148:0/3721644298 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f8985e00640 1 -- 172.21.15.148:0/3721644298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8988102d00 msgr2=0x7f898810a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f8985e00640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8988102d00 0x7f898810a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.080+0000 7f8985e00640 1 -- 172.21.15.148:0/3721644298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978005040 con 0x7f8988102360 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.081+0000 7f8985e00640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988109d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f897802bda0 tx=0x7f8978009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.081+0000 7f897e000640 1 -- 172.21.15.148:0/3721644298 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89780094c0 con 0x7f8988102360 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.081+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898810a7e0 con 0x7f8988102360 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.081+0000 7f897e000640 1 -- 172.21.15.148:0/3721644298 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8978032e50 con 0x7f8988102360 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.081+0000 7f897e000640 1 -- 172.21.15.148:0/3721644298 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89780435f0 con 0x7f8988102360 2024-02-28T16:41:12.069 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.081+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898811d6c0 con 0x7f8988102360 2024-02-28T16:41:12.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.082+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8988064480 con 0x7f8988102360 2024-02-28T16:41:12.070 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.083+0000 7f897e000640 1 -- 172.21.15.148:0/3721644298 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f897802f070 con 0x7f8988102360 2024-02-28T16:41:12.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.084+0000 7f897e000640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f896c06d760 0x7f896c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:12.071 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.084+0000 7f897e000640 1 -- 172.21.15.148:0/3721644298 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f89780aeef0 con 0x7f8988102360 2024-02-28T16:41:12.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.084+0000 7f8985400640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f896c06d760 0x7f896c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:12.072 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.085+0000 7f8985400640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f896c06d760 0x7f896c06fc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f898810b4b0 tx=0x7f8974009c50 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:12.077 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.089+0000 7f897e000640 1 -- 172.21.15.148:0/3721644298 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8978078690 con 0x7f8988102360 2024-02-28T16:41:12.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:12 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1294761407' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T16:41:12.124 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:12 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/1380395404' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T16:41:12.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.312+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f898811d850 con 0x7f8988102360 2024-02-28T16:41:12.300 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.313+0000 7f897e000640 1 -- 172.21.15.148:0/3721644298 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+5008 (secure 0 0 0) 0x7f897807bd50 con 0x7f8988102360 2024-02-28T16:41:12.301 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:12.301 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44299,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/3119390220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3119390220},{"type":"v1","addr":"172.21.15.157:6827","nonce":3119390220}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:39:07.786058+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":0,"incarnation":30,"state":"up:rejoin","state_seq":26,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:12.301 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 33 2024-02-28T16:41:12.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f896c06d760 msgr2=0x7f896c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f896c06d760 0x7f896c06fc10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f898810b4b0 tx=0x7f8974009c50 comp rx=0 tx=0).stop 2024-02-28T16:41:12.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 msgr2=0x7f8988109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988109d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f897802bda0 tx=0x7f8978009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 shutdown_connections 2024-02-28T16:41:12.304 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f896c06d760 0x7f896c06fc10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8988102d00 0x7f898810a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 --2- 172.21.15.148:0/3721644298 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8988102360 0x7f8988109d60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.316+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 >> 172.21.15.148:0/3721644298 conn(0x7f89880f7ef0 msgr2=0x7f89880f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:12.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.317+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 shutdown_connections 2024-02-28T16:41:12.305 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.317+0000 7f898d000640 1 -- 172.21.15.148:0/3721644298 wait complete. 2024-02-28T16:41:12.321 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-28T16:41:12.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:12 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1294761407' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T16:41:12.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:12 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/1380395404' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T16:41:12.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.540+0000 7fa8cca00640 1 -- 172.21.15.148:0/727335760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 msgr2=0x7fa8c806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.532 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.540+0000 7fa8cca00640 1 --2- 172.21.15.148:0/727335760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c806fc10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80048d0 tx=0x7fa8b8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.540+0000 7fa8cca00640 1 -- 172.21.15.148:0/727335760 shutdown_connections 2024-02-28T16:41:12.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.540+0000 7fa8cca00640 1 --2- 172.21.15.148:0/727335760 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8c8070150 0x7fa8c8108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.540+0000 7fa8cca00640 1 --2- 172.21.15.148:0/727335760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c806fc10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.540+0000 7fa8cca00640 1 -- 172.21.15.148:0/727335760 >> 172.21.15.148:0/727335760 conn(0x7fa8c80f7cf0 msgr2=0x7fa8c80fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:12.533 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.541+0000 7fa8cca00640 1 -- 172.21.15.148:0/727335760 shutdown_connections 2024-02-28T16:41:12.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.541+0000 7fa8cca00640 1 -- 172.21.15.148:0/727335760 wait complete. 2024-02-28T16:41:12.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.541+0000 7fa8cca00640 1 Processor -- start 2024-02-28T16:41:12.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.541+0000 7fa8cca00640 1 -- start start 2024-02-28T16:41:12.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8cca00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c8114c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:12.534 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8cca00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8c8070150 0x7fa8c8115180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8cca00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8115780 con 0x7fa8c806f840 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8cca00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81158f0 con 0x7fa8c8070150 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8c6800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c8114c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8c6800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c8114c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53754/0 (socket says 172.21.15.148:53754) 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8c6800640 1 -- 172.21.15.148:0/2028705314 learned_addr learned my addr 172.21.15.148:0/2028705314 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8c6800640 1 -- 172.21.15.148:0/2028705314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8c8070150 msgr2=0x7fa8c8115180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8c6800640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8c8070150 0x7fa8c8115180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.542+0000 7fa8c6800640 1 -- 172.21.15.148:0/2028705314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8005040 con 0x7fa8c806f840 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.543+0000 7fa8c6800640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c8114c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80316b0 tx=0x7fa8b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.543+0000 7fa8bea00640 1 -- 172.21.15.148:0/2028705314 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b80094c0 con 0x7fa8c806f840 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.543+0000 7fa8bea00640 1 -- 172.21.15.148:0/2028705314 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8b8009620 con 0x7fa8c806f840 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.543+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c810ee60 con 0x7fa8c806f840 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.543+0000 7fa8bea00640 1 -- 172.21.15.148:0/2028705314 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8b803b640 con 0x7fa8c806f840 2024-02-28T16:41:12.535 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.543+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c810f380 con 0x7fa8c806f840 2024-02-28T16:41:12.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.545+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c804bcc0 con 0x7fa8c806f840 2024-02-28T16:41:12.536 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.545+0000 7fa8bea00640 1 -- 172.21.15.148:0/2028705314 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa8b802f070 con 0x7fa8c806f840 2024-02-28T16:41:12.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.546+0000 7fa8bea00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa8ac06d750 0x7fa8ac06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:12.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.546+0000 7fa8bea00640 1 -- 172.21.15.148:0/2028705314 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa8b80af5a0 con 0x7fa8c806f840 2024-02-28T16:41:12.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.546+0000 7fa8c5e00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa8ac06d750 0x7fa8ac06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:12.537 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.547+0000 7fa8c5e00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa8ac06d750 0x7fa8ac06fc00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8110540 tx=0x7fa8b0007c30 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:12.538 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.551+0000 7fa8bea00640 1 -- 172.21.15.148:0/2028705314 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa8b8078ca0 con 0x7fa8c806f840 2024-02-28T16:41:12.776 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.788+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fa8c8105560 con 0x7fa8c806f840 2024-02-28T16:41:12.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.790+0000 7fa8bea00640 1 -- 172.21.15.148:0/2028705314 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+5008 (secure 0 0 0) 0x7fa8b807c360 con 0x7fa8c806f840 2024-02-28T16:41:12.777 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:12.778 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34460,"name":"cephfs.smithi148.nqnotw","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6829/1814235745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1814235745},{"type":"v1","addr":"172.21.15.148:6829","nonce":1814235745}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":44279,"name":"cephfs.smithi157.hinycn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6825/1511558367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":1511558367},{"type":"v1","addr":"172.21.15.157:6825","nonce":1511558367}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44299,"name":"cephfs.smithi157.dreayg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6827/3119390220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":3119390220},{"type":"v1","addr":"172.21.15.157:6827","nonce":3119390220}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-28T16:22:25.044836+0000","modified":"2024-02-28T16:39:08.928047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34428":{"gid":34428,"name":"cephfs.smithi148.mgdxsi","rank":0,"incarnation":30,"state":"up:active","state_seq":27,"addr":"172.21.15.148:6827/1742396885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":1742396885},{"type":"v1","addr":"172.21.15.148:6827","nonce":1742396885}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T16:41:12.778 INFO:teuthology.orchestra.run.smithi148.stderr:dumped fsmap epoch 34 2024-02-28T16:41:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa8ac06d750 msgr2=0x7fa8ac06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa8ac06d750 0x7fa8ac06fc00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8110540 tx=0x7fa8b0007c30 comp rx=0 tx=0).stop 2024-02-28T16:41:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 msgr2=0x7fa8c8114c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c8114c40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80316b0 tx=0x7fa8b8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 shutdown_connections 2024-02-28T16:41:12.780 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa8ac06d750 0x7fa8ac06fc00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8c8070150 0x7fa8c8115180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.792+0000 7fa8cca00640 1 --2- 172.21.15.148:0/2028705314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa8c806f840 0x7fa8c8114c40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.793+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 >> 172.21.15.148:0/2028705314 conn(0x7fa8c80f7cf0 msgr2=0x7fa8c8102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.793+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 shutdown_connections 2024-02-28T16:41:12.781 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:12.793+0000 7fa8cca00640 1 -- 172.21.15.148:0/2028705314 wait complete. 2024-02-28T16:41:12.799 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-28T16:41:12.809 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-28T16:41:12.810 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:41:12.810 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:41:12.861 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:41:12.861 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:41:12.959 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:41:13.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:13 smithi148 ceph-mon[112463]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:13.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:13 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3721644298' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T16:41:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:13.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:13 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2028705314' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T16:41:13.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 -- 172.21.15.148:0/2677536692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4104530 msgr2=0x7fcda4104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 --2- 172.21.15.148:0/2677536692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4104530 0x7fcda4104900 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd980048d0 tx=0x7fcd98009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 -- 172.21.15.148:0/2677536692 shutdown_connections 2024-02-28T16:41:13.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 --2- 172.21.15.148:0/2677536692 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda40fe4f0 0x7fcda40fe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 --2- 172.21.15.148:0/2677536692 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda4104530 0x7fcda4104900 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 -- 172.21.15.148:0/2677536692 >> 172.21.15.148:0/2677536692 conn(0x7fcda40fa090 msgr2=0x7fcda40fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:13.165 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 -- 172.21.15.148:0/2677536692 shutdown_connections 2024-02-28T16:41:13.166 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.177+0000 7fcdac200640 1 -- 172.21.15.148:0/2677536692 wait complete. 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.178+0000 7fcdac200640 1 Processor -- start 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.178+0000 7fcdac200640 1 -- start start 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcdac200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda40fe4f0 0x7fcda4114d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcdac200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda4104530 0x7fcda41152c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcdac200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4115950 con 0x7fcda40fe4f0 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcdac200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda410ee50 con 0x7fcda4104530 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcda9800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda40fe4f0 0x7fcda4114d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcda9800640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda40fe4f0 0x7fcda4114d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53766/0 (socket says 172.21.15.148:53766) 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcda9800640 1 -- 172.21.15.148:0/626271142 learned_addr learned my addr 172.21.15.148:0/626271142 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcda9800640 1 -- 172.21.15.148:0/626271142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda4104530 msgr2=0x7fcda41152c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.167 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcda9800640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda4104530 0x7fcda41152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.179+0000 7fcda9800640 1 -- 172.21.15.148:0/626271142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd98005040 con 0x7fcda40fe4f0 2024-02-28T16:41:13.168 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.180+0000 7fcda9800640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda40fe4f0 0x7fcda4114d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcd9802bda0 tx=0x7fcd98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:13.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.180+0000 7fcda1600640 1 -- 172.21.15.148:0/626271142 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd980094c0 con 0x7fcda40fe4f0 2024-02-28T16:41:13.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.180+0000 7fcda1600640 1 -- 172.21.15.148:0/626271142 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd98009620 con 0x7fcda40fe4f0 2024-02-28T16:41:13.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.180+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda410f0d0 con 0x7fcda40fe4f0 2024-02-28T16:41:13.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.180+0000 7fcda1600640 1 -- 172.21.15.148:0/626271142 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd980435f0 con 0x7fcda40fe4f0 2024-02-28T16:41:13.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.180+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda410f590 con 0x7fcda40fe4f0 2024-02-28T16:41:13.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.181+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda4064030 con 0x7fcda40fe4f0 2024-02-28T16:41:13.169 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.182+0000 7fcda1600640 1 -- 172.21.15.148:0/626271142 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcd9802f070 con 0x7fcda40fe4f0 2024-02-28T16:41:13.170 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.183+0000 7fcda1600640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcd8c06d760 0x7fcd8c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:13.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.183+0000 7fcda1600640 1 -- 172.21.15.148:0/626271142 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fcd980aef80 con 0x7fcda40fe4f0 2024-02-28T16:41:13.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.184+0000 7fcda8e00640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcd8c06d760 0x7fcd8c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:13.171 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.184+0000 7fcda8e00640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcd8c06d760 0x7fcd8c06fc10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcda4110640 tx=0x7fcd90006d20 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:13.175 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.188+0000 7fcda1600640 1 -- 172.21.15.148:0/626271142 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcd98078720 con 0x7fcda40fe4f0 2024-02-28T16:41:13.372 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.385+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcda410f870 con 0x7fcda40fe4f0 2024-02-28T16:41:13.376 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.388+0000 7fcda1600640 1 -- 172.21.15.148:0/626271142 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16873 (secure 0 0 0) 0x7fcd9807bde0 con 0x7fcda40fe4f0 2024-02-28T16:41:13.376 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:13.377 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":84,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","created":"2024-02-28T16:12:27.413792+0000","modified":"2024-02-28T16:38:58.553270+0000","last_up_change":"2024-02-28T16:37:18.170766+0000","last_in_change":"2024-02-28T16:20:18.870154+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:18:56.502433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:22:23.698334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:22:24.552110+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14a7fb44-646e-4c79-82b1-a6911b120a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6803","nonce":2918467650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6805","nonce":2918467650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6809","nonce":2918467650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6807","nonce":2918467650}]},"public_addr":"172.21.15.148:6803/2918467650","cluster_addr":"172.21.15.148:6805/2918467650","heartbeat_back_addr":"172.21.15.148:6809/2918467650","heartbeat_front_addr":"172.21.15.148:6807/2918467650","state":["exists","up"]},{"osd":1,"uuid":"86d4be70-889a-48bb-8354-5c1191cd11d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6811","nonce":3822469407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6813","nonce":3822469407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6817","nonce":3822469407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6815","nonce":3822469407}]},"public_addr":"172.21.15.148:6811/3822469407","cluster_addr":"172.21.15.148:6813/3822469407","heartbeat_back_addr":"172.21.15.148:6817/3822469407","heartbeat_front_addr":"172.21.15.148:6815/3822469407","state":["exists","up"]},{"osd":2,"uuid":"fb9f2df8-5f7c-4a5d-897b-7816093d2f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6819","nonce":1849077371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6821","nonce":1849077371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6825","nonce":1849077371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6823","nonce":1849077371}]},"public_addr":"172.21.15.148:6819/1849077371","cluster_addr":"172.21.15.148:6821/1849077371","heartbeat_back_addr":"172.21.15.148:6825/1849077371","heartbeat_front_addr":"172.21.15.148:6823/1849077371","state":["exists","up"]},{"osd":3,"uuid":"387e95f1-fb7d-493e-a953-e3a0480bab84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6801","nonce":2446981625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6803","nonce":2446981625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6807","nonce":2446981625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6805","nonce":2446981625}]},"public_addr":"172.21.15.157:6801/2446981625","cluster_addr":"172.21.15.157:6803/2446981625","heartbeat_back_addr":"172.21.15.157:6807/2446981625","heartbeat_front_addr":"172.21.15.157:6805/2446981625","state":["exists","up"]},{"osd":4,"uuid":"687be313-3bfd-461c-97bd-1286d0df4890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6809","nonce":1675329690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6811","nonce":1675329690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6815","nonce":1675329690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6813","nonce":1675329690}]},"public_addr":"172.21.15.157:6809/1675329690","cluster_addr":"172.21.15.157:6811/1675329690","heartbeat_back_addr":"172.21.15.157:6815/1675329690","heartbeat_front_addr":"172.21.15.157:6813/1675329690","state":["exists","up"]},{"osd":5,"uuid":"30cd920d-07ad-4006-b70d-801862f0301a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6817","nonce":2009672957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6819","nonce":2009672957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6823","nonce":2009672957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6821","nonce":2009672957}]},"public_addr":"172.21.15.157:6817/2009672957","cluster_addr":"172.21.15.157:6819/2009672957","heartbeat_back_addr":"172.21.15.157:6823/2009672957","heartbeat_front_addr":"172.21.15.157:6821/2009672957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:37.865181+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:15.892468+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:54.360175+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:19:29.555324+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:05.461264+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:41.106302+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:6827/2090793909":"2024-02-29T16:38:58.553214+0000","172.21.15.157:6826/2090793909":"2024-02-29T16:38:58.553214+0000","172.21.15.157:6825/696390101":"2024-02-29T16:38:25.908437+0000","172.21.15.148:6829/2703268165":"2024-02-29T16:37:56.402458+0000","172.21.15.157:6828/3805996438":"2024-02-29T16:27:50.385710+0000","172.21.15.148:6800/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1252596380":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/3934075057":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/941593238":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3379725707":"2024-02-29T16:15:25.792039+0000","172.21.15.157:6829/3805996438":"2024-02-29T16:27:50.385710+0000","172.21.15.157:0/3983227890":"2024-02-29T16:27:50.385710+0000","172.21.15.157:0/40255861":"2024-02-29T16:27:50.385710+0000","172.21.15.148:6801/2883262037":"2024-02-29T16:31:57.561143+0000","172.21.15.157:6824/696390101":"2024-02-29T16:38:25.908437+0000","172.21.15.148:0/1885326731":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/2808488860":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/3872489504":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/3437363100":"2024-02-29T16:25:16.416587+0000","172.21.15.148:6800/2883262037":"2024-02-29T16:31:57.561143+0000","172.21.15.148:6801/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3440184585":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6801/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1142907915":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/2841519785":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6828/2703268165":"2024-02-29T16:37:56.402458+0000","172.21.15.148:6801/3437363100":"2024-02-29T16:25:16.416587+0000","172.21.15.157:0/3810037133":"2024-02-29T16:27:50.385710+0000","172.21.15.148:0/2552402434":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/2298274885":"2024-02-29T16:25:16.416587+0000","172.21.15.148:6801/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/1960926651":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/3059678121":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/4201431226":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6826/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:6827/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:0/1938685931":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/2468996293":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6800/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.157:0/792112074":"2024-02-29T16:27:50.385710+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcd8c06d760 msgr2=0x7fcd8c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcd8c06d760 0x7fcd8c06fc10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcda4110640 tx=0x7fcd90006d20 comp rx=0 tx=0).stop 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda40fe4f0 msgr2=0x7fcda4114d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda40fe4f0 0x7fcda4114d80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcd9802bda0 tx=0x7fcd98009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 shutdown_connections 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fcd8c06d760 0x7fcd8c06fc10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcda4104530 0x7fcda41152c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 --2- 172.21.15.148:0/626271142 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcda40fe4f0 0x7fcda4114d80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.379 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.391+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 >> 172.21.15.148:0/626271142 conn(0x7fcda40fa090 msgr2=0x7fcda40fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.392+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 shutdown_connections 2024-02-28T16:41:13.380 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.392+0000 7fcdac200640 1 -- 172.21.15.148:0/626271142 wait complete. 2024-02-28T16:41:13.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:18:56.502433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:22:23.698334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:22:24.552110+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:41:13.398 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:41:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:13 smithi157 ceph-mon[89328]: pgmap v315: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:13 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3721644298' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T16:41:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:13 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2028705314' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T16:41:13.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.617+0000 7f3592600640 1 -- 172.21.15.148:0/3488004014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 msgr2=0x7f358c0fe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.617+0000 7f3592600640 1 --2- 172.21.15.148:0/3488004014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c0fe5c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f35780048d0 tx=0x7f3578009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.617+0000 7f3592600640 1 -- 172.21.15.148:0/3488004014 shutdown_connections 2024-02-28T16:41:13.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.617+0000 7f3592600640 1 --2- 172.21.15.148:0/3488004014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c0fe5c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.605 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.617+0000 7f3592600640 1 --2- 172.21.15.148:0/3488004014 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f358c104560 0x7f358c104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.617+0000 7f3592600640 1 -- 172.21.15.148:0/3488004014 >> 172.21.15.148:0/3488004014 conn(0x7f358c0fa120 msgr2=0x7f358c0fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:13.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.618+0000 7f3592600640 1 -- 172.21.15.148:0/3488004014 shutdown_connections 2024-02-28T16:41:13.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.618+0000 7f3592600640 1 -- 172.21.15.148:0/3488004014 wait complete. 2024-02-28T16:41:13.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.618+0000 7f3592600640 1 Processor -- start 2024-02-28T16:41:13.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.618+0000 7f3592600640 1 -- start start 2024-02-28T16:41:13.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.619+0000 7f3592600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f358c104560 0x7f358c114e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:13.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.619+0000 7f3592600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c115390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:13.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.619+0000 7f3592600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c115990 con 0x7f358c104f00 2024-02-28T16:41:13.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.619+0000 7f3592600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c10ef20 con 0x7f358c104560 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.619+0000 7f358aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c115390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.619+0000 7f358aa00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c115390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53784/0 (socket says 172.21.15.148:53784) 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.619+0000 7f358aa00640 1 -- 172.21.15.148:0/489906238 learned_addr learned my addr 172.21.15.148:0/489906238 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f358b400640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f358c104560 0x7f358c114e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f358aa00640 1 -- 172.21.15.148:0/489906238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f358c104560 msgr2=0x7f358c114e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f358aa00640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f358c104560 0x7f358c114e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f358aa00640 1 -- 172.21.15.148:0/489906238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578005040 con 0x7f358c104f00 2024-02-28T16:41:13.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f358aa00640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c115390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3578034040 tx=0x7f3578009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:13.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f3583400640 1 -- 172.21.15.148:0/489906238 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35780094c0 con 0x7f358c104f00 2024-02-28T16:41:13.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c10f1a0 con 0x7f358c104f00 2024-02-28T16:41:13.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f3583400640 1 -- 172.21.15.148:0/489906238 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3578032e70 con 0x7f358c104f00 2024-02-28T16:41:13.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f3583400640 1 -- 172.21.15.148:0/489906238 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35780433b0 con 0x7f358c104f00 2024-02-28T16:41:13.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.620+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c10f660 con 0x7f358c104f00 2024-02-28T16:41:13.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.621+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c064030 con 0x7f358c104f00 2024-02-28T16:41:13.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.622+0000 7f3583400640 1 -- 172.21.15.148:0/489906238 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f357802f070 con 0x7f358c104f00 2024-02-28T16:41:13.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.623+0000 7f3583400640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f357006d760 0x7f357006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:13.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.623+0000 7f3583400640 1 -- 172.21.15.148:0/489906238 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f35780aefd0 con 0x7f358c104f00 2024-02-28T16:41:13.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.624+0000 7f358b400640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f357006d760 0x7f357006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:13.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.624+0000 7f358b400640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f357006d760 0x7f357006fc10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f357c004ce0 tx=0x7f357c00b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:13.616 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.629+0000 7f3583400640 1 -- 172.21.15.148:0/489906238 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f35780e2d20 con 0x7f358c104f00 2024-02-28T16:41:13.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.823+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f358c10b6e0 con 0x7f358c104f00 2024-02-28T16:41:13.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.824+0000 7f3583400640 1 -- 172.21.15.148:0/489906238 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35780786d0 con 0x7f358c104f00 2024-02-28T16:41:13.811 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-02-28T16:41:13.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.826+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f357006d760 msgr2=0x7f357006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.826+0000 7f3592600640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f357006d760 0x7f357006fc10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f357c004ce0 tx=0x7f357c00b040 comp rx=0 tx=0).stop 2024-02-28T16:41:13.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.826+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 msgr2=0x7f358c115390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:13.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.826+0000 7f3592600640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c115390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3578034040 tx=0x7f3578009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.826+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 shutdown_connections 2024-02-28T16:41:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.827+0000 7f3592600640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f358c104f00 0x7f358c115390 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.827+0000 7f3592600640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f357006d760 0x7f357006fc10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.827+0000 7f3592600640 1 --2- 172.21.15.148:0/489906238 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f358c104560 0x7f358c114e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.827+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 >> 172.21.15.148:0/489906238 conn(0x7f358c0fa120 msgr2=0x7f358c0fbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.827+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 shutdown_connections 2024-02-28T16:41:13.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:13.827+0000 7f3592600640 1 -- 172.21.15.148:0/489906238 wait complete. 2024-02-28T16:41:13.831 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:41:14.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 -- 172.21.15.148:0/2469893049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc100110 msgr2=0x7f42fc100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 --2- 172.21.15.148:0/2469893049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc100110 0x7f42fc100560 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f42e40048d0 tx=0x7f42e4009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 -- 172.21.15.148:0/2469893049 shutdown_connections 2024-02-28T16:41:14.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 --2- 172.21.15.148:0/2469893049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc100110 0x7f42fc100560 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 --2- 172.21.15.148:0/2469893049 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42fc0fe9c0 0x7f42fc0fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 -- 172.21.15.148:0/2469893049 >> 172.21.15.148:0/2469893049 conn(0x7f42fc0fa160 msgr2=0x7f42fc0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:14.040 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 -- 172.21.15.148:0/2469893049 shutdown_connections 2024-02-28T16:41:14.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 -- 172.21.15.148:0/2469893049 wait complete. 2024-02-28T16:41:14.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.052+0000 7f4302600640 1 Processor -- start 2024-02-28T16:41:14.041 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f4302600640 1 -- start start 2024-02-28T16:41:14.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f4302600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc0fe9c0 0x7f42fc114dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f4302600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42fc100110 0x7f42fc115300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f4302600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc115900 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f4302600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42fc10ee90 con 0x7f42fc100110 2024-02-28T16:41:14.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f42fb400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc0fe9c0 0x7f42fc114dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f42fb400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc0fe9c0 0x7f42fc114dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53810/0 (socket says 172.21.15.148:53810) 2024-02-28T16:41:14.042 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.053+0000 7f42fb400640 1 -- 172.21.15.148:0/3887164506 learned_addr learned my addr 172.21.15.148:0/3887164506 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f42fb400640 1 -- 172.21.15.148:0/3887164506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42fc100110 msgr2=0x7f42fc115300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f42fb400640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42fc100110 0x7f42fc115300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f42fb400640 1 -- 172.21.15.148:0/3887164506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4005040 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f42fb400640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc0fe9c0 0x7f42fc114dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c790 tx=0x7f42ec0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f42f3e00640 1 -- 172.21.15.148:0/3887164506 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42ec00a820 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f42f3e00640 1 -- 172.21.15.148:0/3887164506 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42ec00ae50 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42fc10f170 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f42f3e00640 1 -- 172.21.15.148:0/3887164506 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42ec0115e0 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.043 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.054+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42fc10f690 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.055+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42fc064030 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.044 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.056+0000 7f42f3e00640 1 -- 172.21.15.148:0/3887164506 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f42ec012400 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.057+0000 7f42f3e00640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42e006d760 0x7f42e006fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.057+0000 7f42f3e00640 1 -- 172.21.15.148:0/3887164506 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f42ec08d0f0 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.057+0000 7f42f2a00640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42e006d760 0x7f42e006fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.045 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.058+0000 7f42f2a00640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42e006d760 0x7f42e006fc10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f42e40048a0 tx=0x7f42e4009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:14.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.062+0000 7f42f3e00640 1 -- 172.21.15.148:0/3887164506 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f42ec056910 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:14 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/626271142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:41:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:14 smithi148 ceph-mon[112463]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:14.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:14 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/489906238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:41:14.246 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.259+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f42fc10f910 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.247 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.260+0000 7f42f3e00640 1 -- 172.21.15.148:0/3887164506 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f42ec059fd0 con 0x7f42fc0fe9c0 2024-02-28T16:41:14.248 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42e006d760 msgr2=0x7f42e006fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42e006d760 0x7f42e006fc10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f42e40048a0 tx=0x7f42e4009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc0fe9c0 msgr2=0x7f42fc114dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc0fe9c0 0x7f42fc114dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c790 tx=0x7f42ec0043c0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 shutdown_connections 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f42e006d760 0x7f42e006fc10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42fc100110 0x7f42fc115300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 --2- 172.21.15.148:0/3887164506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42fc0fe9c0 0x7f42fc114dc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 >> 172.21.15.148:0/3887164506 conn(0x7f42fc0fa160 msgr2=0x7f42fc0fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 shutdown_connections 2024-02-28T16:41:14.251 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.263+0000 7f4302600640 1 -- 172.21.15.148:0/3887164506 wait complete. 2024-02-28T16:41:14.270 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 -- 172.21.15.148:0/3850896129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 msgr2=0x7f4ea8104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 --2- 172.21.15.148:0/3850896129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8104950 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e980048d0 tx=0x7f4e98009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 -- 172.21.15.148:0/3850896129 shutdown_connections 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 --2- 172.21.15.148:0/3850896129 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ea8104e90 0x7f4ea80fe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 --2- 172.21.15.148:0/3850896129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8104950 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 -- 172.21.15.148:0/3850896129 >> 172.21.15.148:0/3850896129 conn(0x7f4ea80fa160 msgr2=0x7f4ea80fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 -- 172.21.15.148:0/3850896129 shutdown_connections 2024-02-28T16:41:14.477 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.489+0000 7f4eaf000640 1 -- 172.21.15.148:0/3850896129 wait complete. 2024-02-28T16:41:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.490+0000 7f4eaf000640 1 Processor -- start 2024-02-28T16:41:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.490+0000 7f4eaf000640 1 -- start start 2024-02-28T16:41:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.490+0000 7f4eaf000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8114e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.490+0000 7f4eaf000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ea8104e90 0x7f4ea8115350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.479 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.490+0000 7f4eaf000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea8115950 con 0x7f4ea8104580 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.490+0000 7f4eaf000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea810eee0 con 0x7f4ea8104e90 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4ea7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8114e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4ea7e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8114e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53836/0 (socket says 172.21.15.148:53836) 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4ea7e00640 1 -- 172.21.15.148:0/4254149426 learned_addr learned my addr 172.21.15.148:0/4254149426 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4e9f400640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ea8104e90 0x7f4ea8115350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4ea7e00640 1 -- 172.21.15.148:0/4254149426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ea8104e90 msgr2=0x7f4ea8115350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4ea7e00640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ea8104e90 0x7f4ea8115350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4ea7e00640 1 -- 172.21.15.148:0/4254149426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98005040 con 0x7f4ea8104580 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.491+0000 7f4ea7e00640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8114e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4e98031720 tx=0x7f4e98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.492+0000 7f4ea4c00640 1 -- 172.21.15.148:0/4254149426 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e980094c0 con 0x7f4ea8104580 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.492+0000 7f4ea4c00640 1 -- 172.21.15.148:0/4254149426 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e98009620 con 0x7f4ea8104580 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.492+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea810f160 con 0x7f4ea8104580 2024-02-28T16:41:14.480 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.492+0000 7f4ea4c00640 1 -- 172.21.15.148:0/4254149426 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e9803b640 con 0x7f4ea8104580 2024-02-28T16:41:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.492+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea810f680 con 0x7f4ea8104580 2024-02-28T16:41:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.493+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea8064480 con 0x7f4ea8104580 2024-02-28T16:41:14.481 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.494+0000 7f4ea4c00640 1 -- 172.21.15.148:0/4254149426 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4e9802f070 con 0x7f4ea8104580 2024-02-28T16:41:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.495+0000 7f4ea4c00640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e8c06d750 0x7f4e8c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.495+0000 7f4ea4c00640 1 -- 172.21.15.148:0/4254149426 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4e980af3d0 con 0x7f4ea8104580 2024-02-28T16:41:14.482 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.495+0000 7f4e9f400640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e8c06d750 0x7f4e8c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.483 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.496+0000 7f4e9f400640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e8c06d750 0x7f4e8c06fc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ea81106d0 tx=0x7f4e9000b040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:14.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:14 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/626271142' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:41:14.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:14 smithi157 ceph-mon[89328]: pgmap v316: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:14.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:14 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/489906238' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:41:14.487 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.499+0000 7f4ea4c00640 1 -- 172.21.15.148:0/4254149426 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4e98078bf0 con 0x7f4ea8104580 2024-02-28T16:41:14.681 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.693+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f4ea810f860 con 0x7f4ea8104580 2024-02-28T16:41:14.682 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.694+0000 7f4ea4c00640 1 -- 172.21.15.148:0/4254149426 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4e9807c2b0 con 0x7f4ea8104580 2024-02-28T16:41:14.682 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:41:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e8c06d750 msgr2=0x7f4e8c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e8c06d750 0x7f4e8c06fc00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ea81106d0 tx=0x7f4e9000b040 comp rx=0 tx=0).stop 2024-02-28T16:41:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 msgr2=0x7f4ea8114e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8114e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4e98031720 tx=0x7f4e98009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 shutdown_connections 2024-02-28T16:41:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f4e8c06d750 0x7f4e8c06fc00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.685 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4ea8104e90 0x7f4ea8115350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 --2- 172.21.15.148:0/4254149426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ea8104580 0x7f4ea8114e10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 >> 172.21.15.148:0/4254149426 conn(0x7f4ea80fa160 msgr2=0x7f4ea80fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.697+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 shutdown_connections 2024-02-28T16:41:14.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.698+0000 7f4eaf000640 1 -- 172.21.15.148:0/4254149426 wait complete. 2024-02-28T16:41:14.704 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T16:41:14.908 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 -- 172.21.15.148:0/4176282850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 msgr2=0x7f41780fe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 --2- 172.21.15.148:0/4176282850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f41780fe5c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f41600048d0 tx=0x7f4160009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 -- 172.21.15.148:0/4176282850 shutdown_connections 2024-02-28T16:41:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 --2- 172.21.15.148:0/4176282850 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f41780fe5c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 --2- 172.21.15.148:0/4176282850 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4178104560 0x7f4178104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.911 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 -- 172.21.15.148:0/4176282850 >> 172.21.15.148:0/4176282850 conn(0x7f41780fa160 msgr2=0x7f41780fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 -- 172.21.15.148:0/4176282850 shutdown_connections 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.921+0000 7f417dc00640 1 -- 172.21.15.148:0/4176282850 wait complete. 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.922+0000 7f417dc00640 1 Processor -- start 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.922+0000 7f417dc00640 1 -- start start 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.922+0000 7f417dc00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4178104560 0x7f4178114e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.922+0000 7f417dc00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f4178115370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.922+0000 7f417dc00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178115970 con 0x7f4178104f00 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.922+0000 7f417dc00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417810ef00 con 0x7f4178104560 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.922+0000 7f416e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f4178115370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.923+0000 7f416e000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f4178115370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53852/0 (socket says 172.21.15.148:53852) 2024-02-28T16:41:14.914 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.923+0000 7f416e000640 1 -- 172.21.15.148:0/2400375165 learned_addr learned my addr 172.21.15.148:0/2400375165 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.923+0000 7f4176a00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4178104560 0x7f4178114e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.923+0000 7f416e000640 1 -- 172.21.15.148:0/2400375165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4178104560 msgr2=0x7f4178114e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.923+0000 7f416e000640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4178104560 0x7f4178114e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.923+0000 7f416e000640 1 -- 172.21.15.148:0/2400375165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160005040 con 0x7f4178104f00 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.923+0000 7f416e000640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f4178115370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4160034040 tx=0x7f4160009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.924+0000 7f416f400640 1 -- 172.21.15.148:0/2400375165 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41600094c0 con 0x7f4178104f00 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.924+0000 7f416f400640 1 -- 172.21.15.148:0/2400375165 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4160009620 con 0x7f4178104f00 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.924+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417810f180 con 0x7f4178104f00 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.924+0000 7f416f400640 1 -- 172.21.15.148:0/2400375165 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41600435f0 con 0x7f4178104f00 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.924+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417810f640 con 0x7f4178104f00 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.925+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4178064480 con 0x7f4178104f00 2024-02-28T16:41:14.915 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.926+0000 7f416f400640 1 -- 172.21.15.148:0/2400375165 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f416002f070 con 0x7f4178104f00 2024-02-28T16:41:14.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.927+0000 7f416f400640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f415c06d760 0x7f415c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:14.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.927+0000 7f416f400640 1 -- 172.21.15.148:0/2400375165 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f41600aef30 con 0x7f4178104f00 2024-02-28T16:41:14.916 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.928+0000 7f4176a00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f415c06d760 0x7f415c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:14.917 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.928+0000 7f4176a00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f415c06d760 0x7f415c06fc10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f41680041d0 tx=0x7f4168009040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:14.919 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:14.932+0000 7f416f400640 1 -- 172.21.15.148:0/2400375165 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f41600e2d20 con 0x7f4178104f00 2024-02-28T16:41:15.132 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.145+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41781104c0 con 0x7f4178104f00 2024-02-28T16:41:15.133 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.146+0000 7f416f400640 1 -- 172.21.15.148:0/2400375165 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v84) v1 ==== 81+0+2473 (secure 0 0 0) 0x7f41600786d0 con 0x7f4178104f00 2024-02-28T16:41:15.133 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6827/2090793909 2024-02-29T16:38:58.553214+0000 2024-02-28T16:41:15.133 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6826/2090793909 2024-02-29T16:38:58.553214+0000 2024-02-28T16:41:15.133 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6825/696390101 2024-02-29T16:38:25.908437+0000 2024-02-28T16:41:15.133 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6829/2703268165 2024-02-29T16:37:56.402458+0000 2024-02-28T16:41:15.133 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6828/3805996438 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/3553564677 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1252596380 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3934075057 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/941593238 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3379725707 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6829/3805996438 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/3983227890 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/40255861 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/2883262037 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6824/696390101 2024-02-29T16:38:25.908437+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1885326731 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2808488860 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3872489504 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/3437363100 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:15.134 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/2883262037 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/1096845265 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3440184585 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/3553564677 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1142907915 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2841519785 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6828/2703268165 2024-02-29T16:37:56.402458+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/3437363100 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/3810037133 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2552402434 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2298274885 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/3589982370 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1960926651 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3059678121 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/4201431226 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:15.135 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/1096845265 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:15.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6826/1588947397 2024-02-29T16:22:43.947556+0000 2024-02-28T16:41:15.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6827/1588947397 2024-02-29T16:22:43.947556+0000 2024-02-28T16:41:15.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1938685931 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:15.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2468996293 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:15.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/3589982370 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:15.136 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/792112074 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:listed 41 entries 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f415c06d760 msgr2=0x7f415c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f415c06d760 0x7f415c06fc10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f41680041d0 tx=0x7f4168009040 comp rx=0 tx=0).stop 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 msgr2=0x7f4178115370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f4178115370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4160034040 tx=0x7f4160009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 shutdown_connections 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4178104f00 0x7f4178115370 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f415c06d760 0x7f415c06fc10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 --2- 172.21.15.148:0/2400375165 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4178104560 0x7f4178114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 >> 172.21.15.148:0/2400375165 conn(0x7f41780fa160 msgr2=0x7f41780fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.148+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 shutdown_connections 2024-02-28T16:41:15.137 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.149+0000 7f417dc00640 1 -- 172.21.15.148:0/2400375165 wait complete. 2024-02-28T16:41:15.155 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-02-28T16:41:15.155 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T16:41:15.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T16:41:15.327 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:15 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3887164506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:41:15.327 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:15 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4254149426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:41:15.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 -- 172.21.15.148:0/3492830224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c1043e0 msgr2=0x7f469c1047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 --2- 172.21.15.148:0/3492830224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c1043e0 0x7f469c1047b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f468c009c50 tx=0x7f468c004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:15.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 -- 172.21.15.148:0/3492830224 shutdown_connections 2024-02-28T16:41:15.458 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 --2- 172.21.15.148:0/3492830224 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c104d80 0x7f469c0fe410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 --2- 172.21.15.148:0/3492830224 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c1043e0 0x7f469c1047b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 -- 172.21.15.148:0/3492830224 >> 172.21.15.148:0/3492830224 conn(0x7f469c0f9ff0 msgr2=0x7f469c0fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 -- 172.21.15.148:0/3492830224 shutdown_connections 2024-02-28T16:41:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 -- 172.21.15.148:0/3492830224 wait complete. 2024-02-28T16:41:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.470+0000 7f469b200640 1 Processor -- start 2024-02-28T16:41:15.459 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f469b200640 1 -- start start 2024-02-28T16:41:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f469b200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c1043e0 0x7f469c114c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f469b200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c104d80 0x7f469c115170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f469b200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c115770 con 0x7f469c104d80 2024-02-28T16:41:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f469b200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c10ed00 con 0x7f469c1043e0 2024-02-28T16:41:15.463 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f4699400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c104d80 0x7f469c115170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f4699400640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c104d80 0x7f469c115170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53872/0 (socket says 172.21.15.148:53872) 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.471+0000 7f4699400640 1 -- 172.21.15.148:0/3149094796 learned_addr learned my addr 172.21.15.148:0/3149094796 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f4699400640 1 -- 172.21.15.148:0/3149094796 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c1043e0 msgr2=0x7f469c114c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f4699400640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c1043e0 0x7f469c114c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f4699400640 1 -- 172.21.15.148:0/3149094796 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0098b0 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f4699400640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c104d80 0x7f469c115170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f468400c790 tx=0x7f46840043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f4692000640 1 -- 172.21.15.148:0/3149094796 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f468400a820 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f4692000640 1 -- 172.21.15.148:0/3149094796 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f468400ae50 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f4692000640 1 -- 172.21.15.148:0/3149094796 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46840115e0 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c10efe0 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.472+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c10f530 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.473+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c04bcc0 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.474+0000 7f4692000640 1 -- 172.21.15.148:0/3149094796 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4684012400 con 0x7f469c104d80 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.475+0000 7f4692000640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468006d750 0x7f468006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:15.464 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.475+0000 7f4692000640 1 -- 172.21.15.148:0/3149094796 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f468408d190 con 0x7f469c104d80 2024-02-28T16:41:15.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.476+0000 7f4699e00640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468006d750 0x7f468006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:15.465 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.476+0000 7f4699e00640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468006d750 0x7f468006fc00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f468c009c20 tx=0x7f468c004d10 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:15.467 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.480+0000 7f4692000640 1 -- 172.21.15.148:0/3149094796 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4684056910 con 0x7f469c104d80 2024-02-28T16:41:15.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:15 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3887164506' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:41:15.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:15 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4254149426' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:41:15.663 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.675+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f469c10f800 con 0x7f469c104d80 2024-02-28T16:41:15.665 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.677+0000 7f4692000640 1 -- 172.21.15.148:0/3149094796 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16873 (secure 0 0 0) 0x7f4684059fd0 con 0x7f469c104d80 2024-02-28T16:41:15.665 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-02-28T16:41:15.665 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":84,"fsid":"004ac12e-d654-11ee-95c3-87774f69a715","created":"2024-02-28T16:12:27.413792+0000","modified":"2024-02-28T16:38:58.553270+0000","last_up_change":"2024-02-28T16:37:18.170766+0000","last_in_change":"2024-02-28T16:20:18.870154+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T16:18:56.502433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T16:22:23.698334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T16:22:24.552110+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14a7fb44-646e-4c79-82b1-a6911b120a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6803","nonce":2918467650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6805","nonce":2918467650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6809","nonce":2918467650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":2918467650},{"type":"v1","addr":"172.21.15.148:6807","nonce":2918467650}]},"public_addr":"172.21.15.148:6803/2918467650","cluster_addr":"172.21.15.148:6805/2918467650","heartbeat_back_addr":"172.21.15.148:6809/2918467650","heartbeat_front_addr":"172.21.15.148:6807/2918467650","state":["exists","up"]},{"osd":1,"uuid":"86d4be70-889a-48bb-8354-5c1191cd11d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6811","nonce":3822469407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6813","nonce":3822469407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6817","nonce":3822469407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":3822469407},{"type":"v1","addr":"172.21.15.148:6815","nonce":3822469407}]},"public_addr":"172.21.15.148:6811/3822469407","cluster_addr":"172.21.15.148:6813/3822469407","heartbeat_back_addr":"172.21.15.148:6817/3822469407","heartbeat_front_addr":"172.21.15.148:6815/3822469407","state":["exists","up"]},{"osd":2,"uuid":"fb9f2df8-5f7c-4a5d-897b-7816093d2f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6819","nonce":1849077371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6821","nonce":1849077371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6825","nonce":1849077371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1849077371},{"type":"v1","addr":"172.21.15.148:6823","nonce":1849077371}]},"public_addr":"172.21.15.148:6819/1849077371","cluster_addr":"172.21.15.148:6821/1849077371","heartbeat_back_addr":"172.21.15.148:6825/1849077371","heartbeat_front_addr":"172.21.15.148:6823/1849077371","state":["exists","up"]},{"osd":3,"uuid":"387e95f1-fb7d-493e-a953-e3a0480bab84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6801","nonce":2446981625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6803","nonce":2446981625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6807","nonce":2446981625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":2446981625},{"type":"v1","addr":"172.21.15.157:6805","nonce":2446981625}]},"public_addr":"172.21.15.157:6801/2446981625","cluster_addr":"172.21.15.157:6803/2446981625","heartbeat_back_addr":"172.21.15.157:6807/2446981625","heartbeat_front_addr":"172.21.15.157:6805/2446981625","state":["exists","up"]},{"osd":4,"uuid":"687be313-3bfd-461c-97bd-1286d0df4890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6809","nonce":1675329690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6811","nonce":1675329690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6815","nonce":1675329690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":1675329690},{"type":"v1","addr":"172.21.15.157:6813","nonce":1675329690}]},"public_addr":"172.21.15.157:6809/1675329690","cluster_addr":"172.21.15.157:6811/1675329690","heartbeat_back_addr":"172.21.15.157:6815/1675329690","heartbeat_front_addr":"172.21.15.157:6813/1675329690","state":["exists","up"]},{"osd":5,"uuid":"30cd920d-07ad-4006-b70d-801862f0301a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6817","nonce":2009672957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6819","nonce":2009672957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6823","nonce":2009672957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":2009672957},{"type":"v1","addr":"172.21.15.157:6821","nonce":2009672957}]},"public_addr":"172.21.15.157:6817/2009672957","cluster_addr":"172.21.15.157:6819/2009672957","heartbeat_back_addr":"172.21.15.157:6823/2009672957","heartbeat_front_addr":"172.21.15.157:6821/2009672957","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:17:37.865181+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:15.892468+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:18:54.360175+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:19:29.555324+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:05.461264+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T16:20:41.106302+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.157:6827/2090793909":"2024-02-29T16:38:58.553214+0000","172.21.15.157:6826/2090793909":"2024-02-29T16:38:58.553214+0000","172.21.15.157:6825/696390101":"2024-02-29T16:38:25.908437+0000","172.21.15.148:6829/2703268165":"2024-02-29T16:37:56.402458+0000","172.21.15.157:6828/3805996438":"2024-02-29T16:27:50.385710+0000","172.21.15.148:6800/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1252596380":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/3934075057":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/941593238":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3379725707":"2024-02-29T16:15:25.792039+0000","172.21.15.157:6829/3805996438":"2024-02-29T16:27:50.385710+0000","172.21.15.157:0/3983227890":"2024-02-29T16:27:50.385710+0000","172.21.15.157:0/40255861":"2024-02-29T16:27:50.385710+0000","172.21.15.148:6801/2883262037":"2024-02-29T16:31:57.561143+0000","172.21.15.157:6824/696390101":"2024-02-29T16:38:25.908437+0000","172.21.15.148:0/1885326731":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/2808488860":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/3872489504":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/3437363100":"2024-02-29T16:25:16.416587+0000","172.21.15.148:6800/2883262037":"2024-02-29T16:31:57.561143+0000","172.21.15.148:6801/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:0/3440184585":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6801/3553564677":"2024-02-29T16:15:25.792039+0000","172.21.15.148:0/1142907915":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/2841519785":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6828/2703268165":"2024-02-29T16:37:56.402458+0000","172.21.15.148:6801/3437363100":"2024-02-29T16:25:16.416587+0000","172.21.15.157:0/3810037133":"2024-02-29T16:27:50.385710+0000","172.21.15.148:0/2552402434":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/2298274885":"2024-02-29T16:25:16.416587+0000","172.21.15.148:6801/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.148:0/1960926651":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/3059678121":"2024-02-29T16:25:16.416587+0000","172.21.15.148:0/4201431226":"2024-02-29T16:13:08.852987+0000","172.21.15.148:6800/1096845265":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6826/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:6827/1588947397":"2024-02-29T16:22:43.947556+0000","172.21.15.148:0/1938685931":"2024-02-29T16:31:57.561143+0000","172.21.15.148:0/2468996293":"2024-02-29T16:13:48.090150+0000","172.21.15.148:6800/3589982370":"2024-02-29T16:13:08.852987+0000","172.21.15.157:0/792112074":"2024-02-29T16:27:50.385710+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468006d750 msgr2=0x7f468006fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468006d750 0x7f468006fc00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f468c009c20 tx=0x7f468c004d10 comp rx=0 tx=0).stop 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c104d80 msgr2=0x7f469c115170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c104d80 0x7f469c115170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f468400c790 tx=0x7f46840043c0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 shutdown_connections 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c104d80 0x7f469c115170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f468006d750 0x7f468006fc00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 --2- 172.21.15.148:0/3149094796 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f469c1043e0 0x7f469c114c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 >> 172.21.15.148:0/3149094796 conn(0x7f469c0f9ff0 msgr2=0x7f469c0fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 shutdown_connections 2024-02-28T16:41:15.668 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.680+0000 7f469b200640 1 -- 172.21.15.148:0/3149094796 wait complete. 2024-02-28T16:41:15.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T16:18:56.502433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T16:22:23.698334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T16:22:24.552110+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T16:41:15.688 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T16:41:15.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 -- 172.21.15.148:0/1823044855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102d00 msgr2=0x7f3db40fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 --2- 172.21.15.148:0/1823044855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102d00 0x7f3db40fc390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0048d0 tx=0x7f3d9c009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 -- 172.21.15.148:0/1823044855 shutdown_connections 2024-02-28T16:41:15.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 --2- 172.21.15.148:0/1823044855 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102d00 0x7f3db40fc390 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 --2- 172.21.15.148:0/1823044855 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3db4102360 0x7f3db4102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 -- 172.21.15.148:0/1823044855 >> 172.21.15.148:0/1823044855 conn(0x7f3db40f7ef0 msgr2=0x7f3db40fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:15.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 -- 172.21.15.148:0/1823044855 shutdown_connections 2024-02-28T16:41:15.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.903+0000 7f3db8e00640 1 -- 172.21.15.148:0/1823044855 wait complete. 2024-02-28T16:41:15.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.904+0000 7f3db8e00640 1 Processor -- start 2024-02-28T16:41:15.892 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.904+0000 7f3db8e00640 1 -- start start 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.904+0000 7f3db8e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102360 0x7f3db4114d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.904+0000 7f3db8e00640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3db4102d00 0x7f3db41152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.904+0000 7f3db8e00640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db41158d0 con 0x7f3db4102360 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.904+0000 7f3db8e00640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db410ee60 con 0x7f3db4102d00 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102360 0x7f3db4114d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102360 0x7f3db4114d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53886/0 (socket says 172.21.15.148:53886) 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1e00640 1 -- 172.21.15.148:0/3756024875 learned_addr learned my addr 172.21.15.148:0/3756024875 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1400640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3db4102d00 0x7f3db41152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1e00640 1 -- 172.21.15.148:0/3756024875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3db4102d00 msgr2=0x7f3db41152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1e00640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3db4102d00 0x7f3db41152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1e00640 1 -- 172.21.15.148:0/3756024875 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c005040 con 0x7f3db4102360 2024-02-28T16:41:15.894 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.905+0000 7f3db1e00640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102360 0x7f3db4114d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3da400c830 tx=0x7f3da4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.906+0000 7f3daa000640 1 -- 172.21.15.148:0/3756024875 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3da400a850 con 0x7f3db4102360 2024-02-28T16:41:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.906+0000 7f3daa000640 1 -- 172.21.15.148:0/3756024875 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3da400ae80 con 0x7f3db4102360 2024-02-28T16:41:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.906+0000 7f3daa000640 1 -- 172.21.15.148:0/3756024875 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3da4012ea0 con 0x7f3db4102360 2024-02-28T16:41:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.906+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db410f140 con 0x7f3db4102360 2024-02-28T16:41:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.906+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db410f660 con 0x7f3db4102360 2024-02-28T16:41:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.907+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db4064480 con 0x7f3db4102360 2024-02-28T16:41:15.895 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.908+0000 7f3daa000640 1 -- 172.21.15.148:0/3756024875 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f3da4012400 con 0x7f3db4102360 2024-02-28T16:41:15.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.909+0000 7f3daa000640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3d9806d750 0x7f3d9806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:15.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.909+0000 7f3daa000640 1 -- 172.21.15.148:0/3756024875 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f3da408d0f0 con 0x7f3db4102360 2024-02-28T16:41:15.896 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.909+0000 7f3db1400640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3d9806d750 0x7f3d9806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:15.897 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.910+0000 7f3db1400640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3d9806d750 0x7f3d9806fc00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c02bda0 tx=0x7f3d9c009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:15.901 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:15.914+0000 7f3daa000640 1 -- 172.21.15.148:0/3756024875 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3da40569b0 con 0x7f3db4102360 2024-02-28T16:41:16.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.111+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3db41104a0 con 0x7f3db4102360 2024-02-28T16:41:16.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.112+0000 7f3daa000640 1 -- 172.21.15.148:0/3756024875 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3da40126b0 con 0x7f3db4102360 2024-02-28T16:41:16.100 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 1 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3d9806d750 msgr2=0x7f3d9806fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3d9806d750 0x7f3d9806fc00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c02bda0 tx=0x7f3d9c009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102360 msgr2=0x7f3db4114d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102360 0x7f3db4114d90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3da400c830 tx=0x7f3da4004430 comp rx=0 tx=0).stop 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 shutdown_connections 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f3d9806d750 0x7f3d9806fc00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3db4102d00 0x7f3db41152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 --2- 172.21.15.148:0/3756024875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3db4102360 0x7f3db4114d90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 >> 172.21.15.148:0/3756024875 conn(0x7f3db40f7ef0 msgr2=0x7f3db40f97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 shutdown_connections 2024-02-28T16:41:16.103 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.115+0000 7f3db8e00640 1 -- 172.21.15.148:0/3756024875 wait complete. 2024-02-28T16:41:16.121 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T16:41:16.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 -- 172.21.15.148:0/157725923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 msgr2=0x7fa36806fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 --2- 172.21.15.148:0/157725923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa36806fc10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa3580048d0 tx=0x7fa358009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 -- 172.21.15.148:0/157725923 shutdown_connections 2024-02-28T16:41:16.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 --2- 172.21.15.148:0/157725923 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa368070150 0x7fa368108430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.336 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 --2- 172.21.15.148:0/157725923 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa36806fc10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 -- 172.21.15.148:0/157725923 >> 172.21.15.148:0/157725923 conn(0x7fa3680f7cf0 msgr2=0x7fa3680fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:16.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 -- 172.21.15.148:0/157725923 shutdown_connections 2024-02-28T16:41:16.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.348+0000 7fa367200640 1 -- 172.21.15.148:0/157725923 wait complete. 2024-02-28T16:41:16.337 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.349+0000 7fa367200640 1 Processor -- start 2024-02-28T16:41:16.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.349+0000 7fa367200640 1 -- start start 2024-02-28T16:41:16.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.349+0000 7fa367200640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa368114c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:16.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.349+0000 7fa367200640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa368070150 0x7fa3681151b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:16.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.349+0000 7fa367200640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa368115840 con 0x7fa36806f840 2024-02-28T16:41:16.339 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.349+0000 7fa367200640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36810ed40 con 0x7fa368070150 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa368114c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365e00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa368114c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53894/0 (socket says 172.21.15.148:53894) 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365e00640 1 -- 172.21.15.148:0/2290239995 learned_addr learned my addr 172.21.15.148:0/2290239995 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365e00640 1 -- 172.21.15.148:0/2290239995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa368070150 msgr2=0x7fa3681151b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365400640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa368070150 0x7fa3681151b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365e00640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa368070150 0x7fa3681151b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365e00640 1 -- 172.21.15.148:0/2290239995 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358005040 con 0x7fa36806f840 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365400640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa368070150 0x7fa3681151b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.350+0000 7fa365e00640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa368114c70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa3580048a0 tx=0x7fa358009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.351+0000 7fa35e000640 1 -- 172.21.15.148:0/2290239995 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3580094c0 con 0x7fa36806f840 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.351+0000 7fa35e000640 1 -- 172.21.15.148:0/2290239995 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa358009620 con 0x7fa36806f840 2024-02-28T16:41:16.340 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.351+0000 7fa35e000640 1 -- 172.21.15.148:0/2290239995 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3580435f0 con 0x7fa36806f840 2024-02-28T16:41:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.351+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36810efc0 con 0x7fa36806f840 2024-02-28T16:41:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.351+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36810f480 con 0x7fa36806f840 2024-02-28T16:41:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.352+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36804bcc0 con 0x7fa36806f840 2024-02-28T16:41:16.341 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.353+0000 7fa35e000640 1 -- 172.21.15.148:0/2290239995 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa35802f070 con 0x7fa36806f840 2024-02-28T16:41:16.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.354+0000 7fa35e000640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa34c06d760 0x7fa34c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:16.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.355+0000 7fa35e000640 1 -- 172.21.15.148:0/2290239995 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa3580aee10 con 0x7fa36806f840 2024-02-28T16:41:16.342 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.355+0000 7fa365400640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa34c06d760 0x7fa34c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:16.343 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.355+0000 7fa365400640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa34c06d760 0x7fa34c06fc10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa354006fd0 tx=0x7fa354008040 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:16.346 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.359+0000 7fa35e000640 1 -- 172.21.15.148:0/2290239995 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa358078590 con 0x7fa36806f840 2024-02-28T16:41:16.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:16 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2400375165' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:41:16.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:16 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3149094796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:41:16.373 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:16 smithi148 ceph-mon[112463]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:16 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2400375165' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:41:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:16 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3149094796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T16:41:16.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:16 smithi157 ceph-mon[89328]: pgmap v317: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.552+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa368110360 con 0x7fa36806f840 2024-02-28T16:41:16.540 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.553+0000 7fa35e000640 1 -- 172.21.15.148:0/2290239995 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa358076e60 con 0x7fa36806f840 2024-02-28T16:41:16.540 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:41:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.555+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa34c06d760 msgr2=0x7fa34c06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.555+0000 7fa367200640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa34c06d760 0x7fa34c06fc10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa354006fd0 tx=0x7fa354008040 comp rx=0 tx=0).stop 2024-02-28T16:41:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.555+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 msgr2=0x7fa368114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.555+0000 7fa367200640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa368114c70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa3580048a0 tx=0x7fa358009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.555+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 shutdown_connections 2024-02-28T16:41:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.555+0000 7fa367200640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fa34c06d760 0x7fa34c06fc10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.543 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.556+0000 7fa367200640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa368070150 0x7fa3681151b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.556+0000 7fa367200640 1 --2- 172.21.15.148:0/2290239995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa36806f840 0x7fa368114c70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.556+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 >> 172.21.15.148:0/2290239995 conn(0x7fa3680f7cf0 msgr2=0x7fa368102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:16.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.556+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 shutdown_connections 2024-02-28T16:41:16.544 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.556+0000 7fa367200640 1 -- 172.21.15.148:0/2290239995 wait complete. 2024-02-28T16:41:16.561 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T16:41:16.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.783+0000 7f52fb600640 1 -- 172.21.15.148:0/1608528364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 msgr2=0x7f52f4071da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.783+0000 7f52fb600640 1 --2- 172.21.15.148:0/1608528364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4071da0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f52e80048d0 tx=0x7f52e8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.783+0000 7f52fb600640 1 -- 172.21.15.148:0/1608528364 shutdown_connections 2024-02-28T16:41:16.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.783+0000 7f52fb600640 1 --2- 172.21.15.148:0/1608528364 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f40722e0 0x7f52f410cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.771 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.783+0000 7f52fb600640 1 --2- 172.21.15.148:0/1608528364 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4071da0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.783+0000 7f52fb600640 1 -- 172.21.15.148:0/1608528364 >> 172.21.15.148:0/1608528364 conn(0x7f52f40fa120 msgr2=0x7f52f40fc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:16.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.784+0000 7f52fb600640 1 -- 172.21.15.148:0/1608528364 shutdown_connections 2024-02-28T16:41:16.772 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.784+0000 7f52fb600640 1 -- 172.21.15.148:0/1608528364 wait complete. 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.784+0000 7f52fb600640 1 Processor -- start 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.784+0000 7f52fb600640 1 -- start start 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52fb600640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4119190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52fb600640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f40722e0 0x7f52f41196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52fb600640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4119cd0 con 0x7f52f40719d0 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52fb600640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4113260 con 0x7f52f40722e0 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52f8c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4119190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52f8c00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4119190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53910/0 (socket says 172.21.15.148:53910) 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52f8c00640 1 -- 172.21.15.148:0/2638954700 learned_addr learned my addr 172.21.15.148:0/2638954700 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52f8c00640 1 -- 172.21.15.148:0/2638954700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f40722e0 msgr2=0x7f52f41196d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52f8c00640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f40722e0 0x7f52f41196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.774 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.785+0000 7f52f8c00640 1 -- 172.21.15.148:0/2638954700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8005040 con 0x7f52f40719d0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.786+0000 7f52f8c00640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4119190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52e802bda0 tx=0x7f52e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.786+0000 7f52f0c00640 1 -- 172.21.15.148:0/2638954700 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e80094c0 con 0x7f52f40719d0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.786+0000 7f52f0c00640 1 -- 172.21.15.148:0/2638954700 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52e8032e50 con 0x7f52f40719d0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.786+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f41134e0 con 0x7f52f40719d0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.786+0000 7f52f0c00640 1 -- 172.21.15.148:0/2638954700 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52e80435f0 con 0x7f52f40719d0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.786+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f41139a0 con 0x7f52f40719d0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.787+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f4064480 con 0x7f52f40719d0 2024-02-28T16:41:16.775 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.788+0000 7f52f0c00640 1 -- 172.21.15.148:0/2638954700 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f52e802f070 con 0x7f52f40719d0 2024-02-28T16:41:16.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.790+0000 7f52f0c00640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f52dc06d760 0x7f52dc06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:16.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.790+0000 7f52f0c00640 1 -- 172.21.15.148:0/2638954700 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f52e80aeed0 con 0x7f52f40719d0 2024-02-28T16:41:16.777 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.790+0000 7f52f3e00640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f52dc06d760 0x7f52dc06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:16.778 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.791+0000 7f52f3e00640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f52dc06d760 0x7f52dc06fc10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f52f4114a50 tx=0x7f52e0009c50 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:16.782 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.794+0000 7f52f0c00640 1 -- 172.21.15.148:0/2638954700 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f52e80785d0 con 0x7f52f40719d0 2024-02-28T16:41:16.979 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.992+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f52f4114790 con 0x7f52f40719d0 2024-02-28T16:41:16.980 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.993+0000 7f52f0c00640 1 -- 172.21.15.148:0/2638954700 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f52e807bc90 con 0x7f52f40719d0 2024-02-28T16:41:16.980 INFO:teuthology.orchestra.run.smithi148.stdout:pg_num: 32 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f52dc06d760 msgr2=0x7f52dc06fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f52dc06d760 0x7f52dc06fc10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f52f4114a50 tx=0x7f52e0009c50 comp rx=0 tx=0).stop 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 msgr2=0x7f52f4119190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4119190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52e802bda0 tx=0x7f52e8009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 shutdown_connections 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7f52dc06d760 0x7f52dc06fc10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f52f40722e0 0x7f52f41196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 --2- 172.21.15.148:0/2638954700 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f40719d0 0x7f52f4119190 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.995+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 >> 172.21.15.148:0/2638954700 conn(0x7f52f40fa120 msgr2=0x7f52f40fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:16.983 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.996+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 shutdown_connections 2024-02-28T16:41:16.984 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:16.996+0000 7f52fb600640 1 -- 172.21.15.148:0/2638954700 wait complete. 2024-02-28T16:41:17.003 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T16:41:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.220+0000 7fad65000640 1 -- 172.21.15.148:0/3642468935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad60100110 msgr2=0x7fad60100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.220+0000 7fad65000640 1 --2- 172.21.15.148:0/3642468935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad60100110 0x7fad60100560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0048d0 tx=0x7fad4c009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.221+0000 7fad65000640 1 -- 172.21.15.148:0/3642468935 shutdown_connections 2024-02-28T16:41:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.221+0000 7fad65000640 1 --2- 172.21.15.148:0/3642468935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad60100110 0x7fad60100560 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.221+0000 7fad65000640 1 --2- 172.21.15.148:0/3642468935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad600fe9c0 0x7fad600fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.221+0000 7fad65000640 1 -- 172.21.15.148:0/3642468935 >> 172.21.15.148:0/3642468935 conn(0x7fad600fa160 msgr2=0x7fad600fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.221+0000 7fad65000640 1 -- 172.21.15.148:0/3642468935 shutdown_connections 2024-02-28T16:41:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.221+0000 7fad65000640 1 -- 172.21.15.148:0/3642468935 wait complete. 2024-02-28T16:41:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.221+0000 7fad65000640 1 Processor -- start 2024-02-28T16:41:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad65000640 1 -- start start 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad65000640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600fe9c0 0x7fad60114de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad65000640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad60100110 0x7fad60115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad65000640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad60115920 con 0x7fad600fe9c0 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad65000640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6010eeb0 con 0x7fad60100110 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad5de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600fe9c0 0x7fad60114de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad5de00640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600fe9c0 0x7fad60114de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:53926/0 (socket says 172.21.15.148:53926) 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.222+0000 7fad5de00640 1 -- 172.21.15.148:0/4186000920 learned_addr learned my addr 172.21.15.148:0/4186000920 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad5de00640 1 -- 172.21.15.148:0/4186000920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad60100110 msgr2=0x7fad60115320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad5de00640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad60100110 0x7fad60115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad5de00640 1 -- 172.21.15.148:0/4186000920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c005040 con 0x7fad600fe9c0 2024-02-28T16:41:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad5de00640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600fe9c0 0x7fad60114de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad50002a50 tx=0x7fad50004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad56000640 1 -- 172.21.15.148:0/4186000920 <== mon.0 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad50007c30 con 0x7fad600fe9c0 2024-02-28T16:41:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad56000640 1 -- 172.21.15.148:0/4186000920 <== mon.0 v2:172.21.15.148:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad5000f040 con 0x7fad600fe9c0 2024-02-28T16:41:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad56000640 1 -- 172.21.15.148:0/4186000920 <== mon.0 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad5000db50 con 0x7fad600fe9c0 2024-02-28T16:41:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6010f190 con 0x7fad600fe9c0 2024-02-28T16:41:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.223+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6010f6b0 con 0x7fad600fe9c0 2024-02-28T16:41:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.224+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad60064030 con 0x7fad600fe9c0 2024-02-28T16:41:17.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.225+0000 7fad56000640 1 -- 172.21.15.148:0/4186000920 <== mon.0 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 40) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fad5001c400 con 0x7fad600fe9c0 2024-02-28T16:41:17.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.226+0000 7fad56000640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fad4406d750 0x7fad4406fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T16:41:17.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.226+0000 7fad56000640 1 -- 172.21.15.148:0/4186000920 <== mon.0 v2:172.21.15.148:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fad5008c850 con 0x7fad600fe9c0 2024-02-28T16:41:17.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.227+0000 7fad5d400640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fad4406d750 0x7fad4406fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T16:41:17.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.227+0000 7fad5d400640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fad4406d750 0x7fad4406fc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad4c034040 tx=0x7fad4c009da0 comp rx=0 tx=0).ready entity=mgr.34100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T16:41:17.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.231+0000 7fad56000640 1 -- 172.21.15.148:0/4186000920 <== mon.0 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad50055ff0 con 0x7fad600fe9c0 2024-02-28T16:41:17.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:17 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/3756024875' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:41:17.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:17 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2290239995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:41:17.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:17 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/2638954700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:41:17.425 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.438+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad601103e0 con 0x7fad600fe9c0 2024-02-28T16:41:17.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.439+0000 7fad56000640 1 -- 172.21.15.148:0/4186000920 <== mon.0 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v84) v1 ==== 81+0+2473 (secure 0 0 0) 0x7fad500596b0 con 0x7fad600fe9c0 2024-02-28T16:41:17.427 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6827/2090793909 2024-02-29T16:38:58.553214+0000 2024-02-28T16:41:17.427 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6826/2090793909 2024-02-29T16:38:58.553214+0000 2024-02-28T16:41:17.427 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6825/696390101 2024-02-29T16:38:25.908437+0000 2024-02-28T16:41:17.427 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6829/2703268165 2024-02-29T16:37:56.402458+0000 2024-02-28T16:41:17.427 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6828/3805996438 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:17.427 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/3553564677 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1252596380 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3934075057 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/941593238 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3379725707 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6829/3805996438 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/3983227890 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/40255861 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/2883262037 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:6824/696390101 2024-02-29T16:38:25.908437+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1885326731 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2808488860 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3872489504 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/3437363100 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:17.428 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/2883262037 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/1096845265 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3440184585 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/3553564677 2024-02-29T16:15:25.792039+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1142907915 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2841519785 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6828/2703268165 2024-02-29T16:37:56.402458+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/3437363100 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/3810037133 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2552402434 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2298274885 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6801/3589982370 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1960926651 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/3059678121 2024-02-29T16:25:16.416587+0000 2024-02-28T16:41:17.429 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/4201431226 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:17.430 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/1096845265 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:17.430 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6826/1588947397 2024-02-29T16:22:43.947556+0000 2024-02-28T16:41:17.430 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6827/1588947397 2024-02-29T16:22:43.947556+0000 2024-02-28T16:41:17.430 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/1938685931 2024-02-29T16:31:57.561143+0000 2024-02-28T16:41:17.430 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:0/2468996293 2024-02-29T16:13:48.090150+0000 2024-02-28T16:41:17.430 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148:6800/3589982370 2024-02-29T16:13:08.852987+0000 2024-02-28T16:41:17.430 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.157:0/792112074 2024-02-29T16:27:50.385710+0000 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:listed 41 entries 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fad4406d750 msgr2=0x7fad4406fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fad4406d750 0x7fad4406fc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fad4c034040 tx=0x7fad4c009da0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600fe9c0 msgr2=0x7fad60114de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600fe9c0 0x7fad60114de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fad50002a50 tx=0x7fad50004600 comp rx=0 tx=0).stop 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 shutdown_connections 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:6800/3381255335,v1:172.21.15.148:6801/3381255335] conn(0x7fad4406d750 0x7fad4406fc00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fad60100110 0x7fad60115320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 --2- 172.21.15.148:0/4186000920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fad600fe9c0 0x7fad60114de0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 >> 172.21.15.148:0/4186000920 conn(0x7fad600fa160 msgr2=0x7fad600fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 shutdown_connections 2024-02-28T16:41:17.431 INFO:teuthology.orchestra.run.smithi148.stderr:2024-02-28T16:41:17.442+0000 7fad65000640 1 -- 172.21.15.148:0/4186000920 wait complete. 2024-02-28T16:41:17.446 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi148.front.sepia.ceph.com... 2024-02-28T16:41:17.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T16:41:17.447 DEBUG:teuthology.orchestra.run.smithi148:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-28T16:41:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:17 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/3756024875' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T16:41:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:17 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2290239995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T16:41:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:17 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/2638954700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T16:41:17.538 INFO:teuthology.orchestra.run:waiting for 300 2024-02-28T16:41:18.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:18 smithi148 ceph-mon[112463]: from='client.? 172.21.15.148:0/4186000920' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:41:18.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:18 smithi148 ceph-mon[112463]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:18.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:18 smithi157 ceph-mon[89328]: from='client.? 172.21.15.148:0/4186000920' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T16:41:18.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:18 smithi157 ceph-mon[89328]: pgmap v318: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:21.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:20 smithi148 ceph-mon[112463]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:21.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:20 smithi157 ceph-mon[89328]: pgmap v319: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:23.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:22 smithi148 ceph-mon[112463]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:23.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:22 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:41:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:22 smithi157 ceph-mon[89328]: pgmap v320: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:23.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:22 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:41:24.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:23 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:41:24.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:23 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:41:24.123 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:23 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:41:24.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:23 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:41:24.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:23 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:41:24.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:23 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:41:25.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:24 smithi148 ceph-mon[112463]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:25.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:24 smithi157 ceph-mon[89328]: pgmap v321: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:27.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:26 smithi148 ceph-mon[112463]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:27.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:26 smithi157 ceph-mon[89328]: pgmap v322: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:28.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:28.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:29.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:28 smithi157 ceph-mon[89328]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:29.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:28 smithi148 ceph-mon[112463]: pgmap v323: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:31.230 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:30 smithi148 ceph-mon[112463]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:31.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:30 smithi157 ceph-mon[89328]: pgmap v324: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:33.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:32 smithi157 ceph-mon[89328]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:33.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:32 smithi148 ceph-mon[112463]: pgmap v325: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:35.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:34 smithi157 ceph-mon[89328]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:35.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:34 smithi148 ceph-mon[112463]: pgmap v326: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:37.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:36 smithi157 ceph-mon[89328]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:37.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:36 smithi148 ceph-mon[112463]: pgmap v327: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:39.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:38 smithi157 ceph-mon[89328]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:39.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:38 smithi148 ceph-mon[112463]: pgmap v328: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:41.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:40 smithi157 ceph-mon[89328]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:41.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:40 smithi148 ceph-mon[112463]: pgmap v329: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:42 smithi157 ceph-mon[89328]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:43.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:42 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:43.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:42 smithi148 ceph-mon[112463]: pgmap v330: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:43.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:42 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:45.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:44 smithi157 ceph-mon[89328]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:45.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:44 smithi148 ceph-mon[112463]: pgmap v331: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:47.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:46 smithi157 ceph-mon[89328]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:47.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:46 smithi148 ceph-mon[112463]: pgmap v332: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:49.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:48 smithi157 ceph-mon[89328]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:49.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:48 smithi148 ceph-mon[112463]: pgmap v333: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:51.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:50 smithi157 ceph-mon[89328]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:51.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:50 smithi148 ceph-mon[112463]: pgmap v334: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:53.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:52 smithi157 ceph-mon[89328]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:53.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:52 smithi148 ceph-mon[112463]: pgmap v335: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:55.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:54 smithi157 ceph-mon[89328]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:55.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:54 smithi148 ceph-mon[112463]: pgmap v336: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:57.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:56 smithi157 ceph-mon[89328]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:57.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:56 smithi148 ceph-mon[112463]: pgmap v337: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:41:58.236 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:57 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:41:58.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:57 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:00.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:41:59 smithi148 ceph-mon[112463]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:00.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:41:59 smithi157 ceph-mon[89328]: pgmap v338: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:02.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:02 smithi148 ceph-mon[112463]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:02.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:02 smithi157 ceph-mon[89328]: pgmap v339: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:04.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:04 smithi148 ceph-mon[112463]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:04.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:04 smithi157 ceph-mon[89328]: pgmap v340: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:05.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:05 smithi148 ceph-mon[112463]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:05.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:05 smithi157 ceph-mon[89328]: pgmap v341: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:07.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:07 smithi157 ceph-mon[89328]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:07.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:07 smithi148 ceph-mon[112463]: pgmap v342: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:09.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:09 smithi157 ceph-mon[89328]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:09.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:09 smithi148 ceph-mon[112463]: pgmap v343: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:11.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:11 smithi157 ceph-mon[89328]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:11.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:11 smithi148 ceph-mon[112463]: pgmap v344: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:13 smithi157 ceph-mon[89328]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:13.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:13.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:13 smithi148 ceph-mon[112463]: pgmap v345: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:13.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:15.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:15 smithi157 ceph-mon[89328]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:15.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:15 smithi148 ceph-mon[112463]: pgmap v346: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:17.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:17 smithi157 ceph-mon[89328]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:17.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:17 smithi148 ceph-mon[112463]: pgmap v347: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:19.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:19 smithi157 ceph-mon[89328]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:19.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:19 smithi148 ceph-mon[112463]: pgmap v348: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:21.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:21 smithi157 ceph-mon[89328]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:21.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:21 smithi148 ceph-mon[112463]: pgmap v349: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:23.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:23 smithi157 ceph-mon[89328]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:23.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:23 smithi148 ceph-mon[112463]: pgmap v350: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:24.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:24 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:42:24.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:24 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:42:25.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:25 smithi157 ceph-mon[89328]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:25.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:25 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:42:25.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:25 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:42:25.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:25 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:42:25.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:25 smithi148 ceph-mon[112463]: pgmap v351: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:25.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:25 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:42:25.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:25 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:42:25.623 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:25 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:42:27.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:27 smithi157 ceph-mon[89328]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:27.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:27 smithi148 ceph-mon[112463]: pgmap v352: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:28.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:28.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:29.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:29 smithi157 ceph-mon[89328]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:29.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:29 smithi148 ceph-mon[112463]: pgmap v353: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:31.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:31 smithi157 ceph-mon[89328]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:31.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:31 smithi148 ceph-mon[112463]: pgmap v354: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:33.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:33 smithi157 ceph-mon[89328]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:33.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:33 smithi148 ceph-mon[112463]: pgmap v355: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:35.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:35 smithi157 ceph-mon[89328]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:35.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:35 smithi148 ceph-mon[112463]: pgmap v356: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:37.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:37 smithi148 ceph-mon[112463]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:37.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:37 smithi157 ceph-mon[89328]: pgmap v357: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:39.538 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:39 smithi157 ceph-mon[89328]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:39.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:39 smithi148 ceph-mon[112463]: pgmap v358: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:41.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:41 smithi148 ceph-mon[112463]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:41.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:41 smithi157 ceph-mon[89328]: pgmap v359: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:43.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:43 smithi148 ceph-mon[112463]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:43.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:43.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:43 smithi157 ceph-mon[89328]: pgmap v360: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:43.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:45.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:45 smithi148 ceph-mon[112463]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:45.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:45 smithi157 ceph-mon[89328]: pgmap v361: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:47.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:47 smithi148 ceph-mon[112463]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:47.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:47 smithi157 ceph-mon[89328]: pgmap v362: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:49.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:49 smithi148 ceph-mon[112463]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:49.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:49 smithi157 ceph-mon[89328]: pgmap v363: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:51.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:51 smithi148 ceph-mon[112463]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:51.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:51 smithi157 ceph-mon[89328]: pgmap v364: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:53.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:53 smithi148 ceph-mon[112463]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:53.738 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:53 smithi157 ceph-mon[89328]: pgmap v365: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:55.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:55 smithi148 ceph-mon[112463]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:55.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:55 smithi157 ceph-mon[89328]: pgmap v366: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:57.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:57 smithi148 ceph-mon[112463]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:57.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:57 smithi157 ceph-mon[89328]: pgmap v367: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:58.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:58.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:42:59.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:42:59 smithi148 ceph-mon[112463]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:42:59.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:42:59 smithi157 ceph-mon[89328]: pgmap v368: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:01.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:01 smithi148 ceph-mon[112463]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:01.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:01 smithi157 ceph-mon[89328]: pgmap v369: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:03.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:03 smithi148 ceph-mon[112463]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:03.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:03 smithi157 ceph-mon[89328]: pgmap v370: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:05.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:05 smithi148 ceph-mon[112463]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:05.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:05 smithi157 ceph-mon[89328]: pgmap v371: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:07.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:07 smithi148 ceph-mon[112463]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:07.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:07 smithi157 ceph-mon[89328]: pgmap v372: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:09.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:09 smithi148 ceph-mon[112463]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:09.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:09 smithi157 ceph-mon[89328]: pgmap v373: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:11.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:11 smithi148 ceph-mon[112463]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:11.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:11 smithi157 ceph-mon[89328]: pgmap v374: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:13.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:13 smithi148 ceph-mon[112463]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:13.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:13.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:13 smithi157 ceph-mon[89328]: pgmap v375: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:13.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:15.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:15 smithi148 ceph-mon[112463]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:15.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:15 smithi157 ceph-mon[89328]: pgmap v376: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:17.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:17 smithi148 ceph-mon[112463]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:17.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:17 smithi157 ceph-mon[89328]: pgmap v377: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:19.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:19 smithi157 ceph-mon[89328]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:19.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:19 smithi148 ceph-mon[112463]: pgmap v378: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:21.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:21 smithi157 ceph-mon[89328]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:21.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:21 smithi148 ceph-mon[112463]: pgmap v379: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:23.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:23 smithi157 ceph-mon[89328]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:23.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:23 smithi148 ceph-mon[112463]: pgmap v380: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:25.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:25 smithi157 ceph-mon[89328]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:25.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:25 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:43:25.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:25 smithi148 ceph-mon[112463]: pgmap v381: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:25.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:25 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:43:27.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:27 smithi157 ceph-mon[89328]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:27.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:43:27.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:43:27.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:43:27.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:27 smithi148 ceph-mon[112463]: pgmap v382: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:27.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:43:27.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:43:27.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:43:28.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:28.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:29.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:29 smithi157 ceph-mon[89328]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:29.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:29 smithi148 ceph-mon[112463]: pgmap v383: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:31.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:31 smithi157 ceph-mon[89328]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:31.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:31 smithi148 ceph-mon[112463]: pgmap v384: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:33.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:33 smithi157 ceph-mon[89328]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:33.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:33 smithi148 ceph-mon[112463]: pgmap v385: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:35.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:35 smithi157 ceph-mon[89328]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:35.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:35 smithi148 ceph-mon[112463]: pgmap v386: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:37.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:37 smithi157 ceph-mon[89328]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:37.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:37 smithi148 ceph-mon[112463]: pgmap v387: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:39.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:39 smithi157 ceph-mon[89328]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:39.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:39 smithi148 ceph-mon[112463]: pgmap v388: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:41.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:41 smithi157 ceph-mon[89328]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:41.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:41 smithi148 ceph-mon[112463]: pgmap v389: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:43.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:43 smithi157 ceph-mon[89328]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:43.736 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:43.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:43 smithi148 ceph-mon[112463]: pgmap v390: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:43.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:45.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:45 smithi157 ceph-mon[89328]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:45.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:45 smithi148 ceph-mon[112463]: pgmap v391: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:47.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:47 smithi157 ceph-mon[89328]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:47.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:47 smithi148 ceph-mon[112463]: pgmap v392: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:49.737 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:49 smithi157 ceph-mon[89328]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:49.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:49 smithi148 ceph-mon[112463]: pgmap v393: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:51.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:51 smithi157 ceph-mon[89328]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:51.874 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:51 smithi148 ceph-mon[112463]: pgmap v394: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:53.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:53 smithi157 ceph-mon[89328]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:53.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:53 smithi148 ceph-mon[112463]: pgmap v395: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:55.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:55 smithi148 ceph-mon[112463]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:55.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:55 smithi157 ceph-mon[89328]: pgmap v396: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:57.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:57 smithi148 ceph-mon[112463]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:57.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:57 smithi157 ceph-mon[89328]: pgmap v397: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:58.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:58.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:43:59.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:43:59 smithi148 ceph-mon[112463]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:43:59.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:43:59 smithi157 ceph-mon[89328]: pgmap v398: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:01.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:01 smithi148 ceph-mon[112463]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:01.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:01 smithi157 ceph-mon[89328]: pgmap v399: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:03.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:03 smithi148 ceph-mon[112463]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:03.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:03 smithi157 ceph-mon[89328]: pgmap v400: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:05.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:05 smithi148 ceph-mon[112463]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:05.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:05 smithi157 ceph-mon[89328]: pgmap v401: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:07.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:07 smithi148 ceph-mon[112463]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:07.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:07 smithi157 ceph-mon[89328]: pgmap v402: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:09.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:09 smithi148 ceph-mon[112463]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:09.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:09 smithi157 ceph-mon[89328]: pgmap v403: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:11.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:11 smithi148 ceph-mon[112463]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:11.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:11 smithi157 ceph-mon[89328]: pgmap v404: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:13.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:13 smithi148 ceph-mon[112463]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:13.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:13.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:13 smithi157 ceph-mon[89328]: pgmap v405: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:13.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:15.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:15 smithi148 ceph-mon[112463]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:15.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:15 smithi157 ceph-mon[89328]: pgmap v406: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:17.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:17 smithi148 ceph-mon[112463]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:17.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:17 smithi157 ceph-mon[89328]: pgmap v407: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:19.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:19 smithi148 ceph-mon[112463]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:19.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:19 smithi157 ceph-mon[89328]: pgmap v408: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:21.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:21 smithi148 ceph-mon[112463]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:21.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:21 smithi157 ceph-mon[89328]: pgmap v409: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:23.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:23 smithi148 ceph-mon[112463]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:23.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:23 smithi157 ceph-mon[89328]: pgmap v410: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:25.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:25 smithi148 ceph-mon[112463]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:25.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:25 smithi157 ceph-mon[89328]: pgmap v411: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:27.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:27 smithi148 ceph-mon[112463]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:27.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:44:27.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:27 smithi157 ceph-mon[89328]: pgmap v412: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:27.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:44:28.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:28.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:44:28.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:44:28.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:28 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:44:28.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:28.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:44:28.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:44:28.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:28 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:44:29.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:29 smithi148 ceph-mon[112463]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:29.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:29 smithi157 ceph-mon[89328]: pgmap v413: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:31.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:31 smithi148 ceph-mon[112463]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:31.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:31 smithi157 ceph-mon[89328]: pgmap v414: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:33.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:33 smithi157 ceph-mon[89328]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:34.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:33 smithi148 ceph-mon[112463]: pgmap v415: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:35.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:35 smithi157 ceph-mon[89328]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:36.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:35 smithi148 ceph-mon[112463]: pgmap v416: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:37.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:37 smithi157 ceph-mon[89328]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:38.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:37 smithi148 ceph-mon[112463]: pgmap v417: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:39.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:39 smithi157 ceph-mon[89328]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:40.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:39 smithi148 ceph-mon[112463]: pgmap v418: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:41.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:41 smithi157 ceph-mon[89328]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:42.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:41 smithi148 ceph-mon[112463]: pgmap v419: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:43.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:43 smithi157 ceph-mon[89328]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:43.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:44.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:43 smithi148 ceph-mon[112463]: pgmap v420: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:44.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:45.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:45 smithi157 ceph-mon[89328]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:46.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:45 smithi148 ceph-mon[112463]: pgmap v421: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:47.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:47 smithi157 ceph-mon[89328]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:48.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:47 smithi148 ceph-mon[112463]: pgmap v422: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:49.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:49 smithi157 ceph-mon[89328]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:50.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:49 smithi148 ceph-mon[112463]: pgmap v423: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:51.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:51 smithi157 ceph-mon[89328]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:52.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:51 smithi148 ceph-mon[112463]: pgmap v424: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:53.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:53 smithi157 ceph-mon[89328]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:54.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:53 smithi148 ceph-mon[112463]: pgmap v425: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:55.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:55 smithi157 ceph-mon[89328]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:56.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:55 smithi148 ceph-mon[112463]: pgmap v426: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:57.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:57 smithi157 ceph-mon[89328]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:58.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:57 smithi148 ceph-mon[112463]: pgmap v427: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:44:58.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:59.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:44:59.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:44:59 smithi157 ceph-mon[89328]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:00.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:44:59 smithi148 ceph-mon[112463]: pgmap v428: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:01.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:01 smithi157 ceph-mon[89328]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:02.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:01 smithi148 ceph-mon[112463]: pgmap v429: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:03.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:03 smithi157 ceph-mon[89328]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:04.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:03 smithi148 ceph-mon[112463]: pgmap v430: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:05.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:05 smithi157 ceph-mon[89328]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:06.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:05 smithi148 ceph-mon[112463]: pgmap v431: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:07.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:07 smithi157 ceph-mon[89328]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:08.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:07 smithi148 ceph-mon[112463]: pgmap v432: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:10.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:09 smithi148 ceph-mon[112463]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:10.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:09 smithi157 ceph-mon[89328]: pgmap v433: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:12.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:11 smithi148 ceph-mon[112463]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:12.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:11 smithi157 ceph-mon[89328]: pgmap v434: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:13.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:12 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:13.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:12 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:14.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:13 smithi148 ceph-mon[112463]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:14.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:13 smithi157 ceph-mon[89328]: pgmap v435: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:16.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:15 smithi148 ceph-mon[112463]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:16.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:15 smithi157 ceph-mon[89328]: pgmap v436: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:18.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:17 smithi148 ceph-mon[112463]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:18.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:17 smithi157 ceph-mon[89328]: pgmap v437: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:20.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:19 smithi148 ceph-mon[112463]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:20.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:19 smithi157 ceph-mon[89328]: pgmap v438: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:22.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:21 smithi148 ceph-mon[112463]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:22.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:21 smithi157 ceph-mon[89328]: pgmap v439: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:24.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:23 smithi148 ceph-mon[112463]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:24.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:23 smithi157 ceph-mon[89328]: pgmap v440: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:26.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:25 smithi148 ceph-mon[112463]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:26.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:25 smithi157 ceph-mon[89328]: pgmap v441: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:28.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:27 smithi148 ceph-mon[112463]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:28.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:27 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:28.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:27 smithi157 ceph-mon[89328]: pgmap v442: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:28.235 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:27 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:29.621 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:29 smithi148 ceph-mon[112463]: pgmap v443: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:29.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:29 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:45:29.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:29 smithi157 ceph-mon[89328]: pgmap v443: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:29.735 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:29 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T16:45:30.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:30 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:45:30.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:30 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:45:30.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:30 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:45:30.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:30 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:45:31.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:31 smithi148 ceph-mon[112463]: pgmap v444: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:31.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:31 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:45:31.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:31 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:45:31.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:31 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:45:31.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:31 smithi157 ceph-mon[89328]: pgmap v444: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:31.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:31 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T16:45:31.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:31 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T16:45:31.986 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:31 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' 2024-02-28T16:45:33.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:33 smithi148 ceph-mon[112463]: pgmap v445: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:33.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:33 smithi157 ceph-mon[89328]: pgmap v445: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:35.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:35 smithi148 ceph-mon[112463]: pgmap v446: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:35.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:35 smithi157 ceph-mon[89328]: pgmap v446: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:37.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:37 smithi148 ceph-mon[112463]: pgmap v447: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:37.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:37 smithi157 ceph-mon[89328]: pgmap v447: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:39.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:39 smithi148 ceph-mon[112463]: pgmap v448: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:39.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:39 smithi157 ceph-mon[89328]: pgmap v448: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:41.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:41 smithi148 ceph-mon[112463]: pgmap v449: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:41.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:41 smithi157 ceph-mon[89328]: pgmap v449: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:43.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:43 smithi148 ceph-mon[112463]: pgmap v450: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:43.875 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:43 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:43.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:43 smithi157 ceph-mon[89328]: pgmap v450: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:43.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:43 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:45.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:45 smithi148 ceph-mon[112463]: pgmap v451: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:45.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:45 smithi157 ceph-mon[89328]: pgmap v451: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:47.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:47 smithi148 ceph-mon[112463]: pgmap v452: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:47.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:47 smithi157 ceph-mon[89328]: pgmap v452: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:49.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:49 smithi148 ceph-mon[112463]: pgmap v453: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:49.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:49 smithi157 ceph-mon[89328]: pgmap v453: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:51.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:51 smithi148 ceph-mon[112463]: pgmap v454: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:51.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:51 smithi157 ceph-mon[89328]: pgmap v454: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:53.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:53 smithi148 ceph-mon[112463]: pgmap v455: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:53.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:53 smithi157 ceph-mon[89328]: pgmap v455: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:55.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:55 smithi157 ceph-mon[89328]: pgmap v456: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:56.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:55 smithi148 ceph-mon[112463]: pgmap v456: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:57.987 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:57 smithi157 ceph-mon[89328]: pgmap v457: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:58.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:57 smithi148 ceph-mon[112463]: pgmap v457: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:45:58.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:58 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:59.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:58 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:45:59.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:45:59 smithi157 ceph-mon[89328]: pgmap v458: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:00.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:45:59 smithi148 ceph-mon[112463]: pgmap v458: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:01.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:01 smithi157 ceph-mon[89328]: pgmap v459: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:02.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:01 smithi148 ceph-mon[112463]: pgmap v459: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:03.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:03 smithi157 ceph-mon[89328]: pgmap v460: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:04.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:03 smithi148 ceph-mon[112463]: pgmap v460: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:05.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:05 smithi157 ceph-mon[89328]: pgmap v461: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:06.121 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:05 smithi148 ceph-mon[112463]: pgmap v461: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:07.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:07 smithi157 ceph-mon[89328]: pgmap v462: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:08.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:07 smithi148 ceph-mon[112463]: pgmap v462: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:09.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:09 smithi157 ceph-mon[89328]: pgmap v463: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:10.115 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:09 smithi148 ceph-mon[112463]: pgmap v463: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:11.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:11 smithi157 ceph-mon[89328]: pgmap v464: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:12.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:11 smithi148 ceph-mon[112463]: pgmap v464: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:13.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:13 smithi157 ceph-mon[89328]: pgmap v465: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:13.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:13 smithi157 ceph-mon[89328]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:46:14.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:13 smithi148 ceph-mon[112463]: pgmap v465: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:14.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:13 smithi148 ceph-mon[112463]: from='mgr.34100 172.21.15.148:0/1706581348' entity='mgr.smithi148.gelspy' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T16:46:15.985 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:15 smithi157 ceph-mon[89328]: pgmap v466: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:16.122 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:15 smithi148 ceph-mon[112463]: pgmap v466: 65 pgs: 65 active+clean; 256 MiB data, 975 MiB used, 535 GiB / 536 GiB avail 2024-02-28T16:46:16.607 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-02-28T16:46:16.608 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:46:16.609 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-28T16:46:16.627 INFO:tasks.cephadm:Teardown begin 2024-02-28T16:46:16.628 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:46:16.629 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:46:16.734 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:46:16.836 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-28T16:46:16.837 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:46:16.893 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T16:46:16.949 INFO:tasks.cephadm:Stopping all daemons... 2024-02-28T16:46:16.949 INFO:tasks.cephadm.mon.smithi148:Stopping mon.smithi148... 2024-02-28T16:46:16.949 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148 2024-02-28T16:46:17.372 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:17 smithi148 systemd[1]: Stopping Ceph mon.smithi148 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:46:17.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:17 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[112459]: 2024-02-28T16:46:17.580+0000 7fe00da00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi148 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:46:17.872 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:17 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148[112459]: 2024-02-28T16:46:17.580+0000 7fe00da00700 -1 mon.smithi148@0(leader) e3 *** Got Signal Terminated *** 2024-02-28T16:46:17.873 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:17 smithi148 podman[155166]: 2024-02-28 16:46:17.765867239 +0000 UTC m=+0.343435648 container died c5c988485518fd6ff10bd3b251585fbdc65e921de4dd4a1c444170a9506d209d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222) 2024-02-28T16:46:18.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:18 smithi148 podman[155166]: 2024-02-28 16:46:18.322285468 +0000 UTC m=+0.899853887 container cleanup c5c988485518fd6ff10bd3b251585fbdc65e921de4dd4a1c444170a9506d209d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-28T16:46:18.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:18 smithi148 bash[155166]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148 2024-02-28T16:46:18.622 INFO:journalctl@ceph.mon.smithi148.smithi148.stdout:Feb 28 16:46:18 smithi148 podman[155192]: 2024-02-28 16:46:18.540284121 +0000 UTC m=+0.760268902 container remove c5c988485518fd6ff10bd3b251585fbdc65e921de4dd4a1c444170a9506d209d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi148, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:46:18.971 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi148.service' 2024-02-28T16:46:19.119 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:46:19.119 INFO:tasks.cephadm.mon.smithi148:Stopped mon.smithi148 2024-02-28T16:46:19.119 INFO:tasks.cephadm.mon.smithi157:Stopping mon.smithi157... 2024-02-28T16:46:19.120 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi157 2024-02-28T16:46:19.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:19 smithi157 systemd[1]: Stopping Ceph mon.smithi157 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:46:20.130 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:19 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157[89324]: 2024-02-28T16:46:19.825+0000 7f5945800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi157 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:46:20.130 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:19 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157[89324]: 2024-02-28T16:46:19.825+0000 7f5945800700 -1 mon.smithi157@1(peon) e3 *** Got Signal Terminated *** 2024-02-28T16:46:20.130 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:19 smithi157 podman[122087]: 2024-02-28 16:46:19.856826893 +0000 UTC m=+0.266396946 container died d8fb0fa2111ff76bc738457aea7679e7483767ea3287e7d3dba0f2039fdb0060 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T16:46:20.485 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:20 smithi157 podman[122087]: 2024-02-28 16:46:20.343814844 +0000 UTC m=+0.753384913 container cleanup d8fb0fa2111ff76bc738457aea7679e7483767ea3287e7d3dba0f2039fdb0060 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:46:20.486 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:20 smithi157 bash[122087]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157 2024-02-28T16:46:20.959 INFO:journalctl@ceph.mon.smithi157.smithi157.stdout:Feb 28 16:46:20 smithi157 podman[122101]: 2024-02-28 16:46:20.545355262 +0000 UTC m=+0.667447719 container remove d8fb0fa2111ff76bc738457aea7679e7483767ea3287e7d3dba0f2039fdb0060 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-mon-smithi157, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-28T16:46:20.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@mon.smithi157.service' 2024-02-28T16:46:21.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:46:21.125 INFO:tasks.cephadm.mon.smithi157:Stopped mon.smithi157 2024-02-28T16:46:21.125 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-28T16:46:21.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.0 2024-02-28T16:46:21.622 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:21 smithi148 systemd[1]: Stopping Ceph osd.0 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:46:22.122 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:21 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[124518]: 2024-02-28T16:46:21.748+0000 7f2b5d600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:46:22.122 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:21 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[124518]: 2024-02-28T16:46:21.748+0000 7f2b5d600700 -1 osd.0 84 *** Got signal Terminated *** 2024-02-28T16:46:22.122 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:21 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0[124518]: 2024-02-28T16:46:21.748+0000 7f2b5d600700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:46:27.610 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:27 smithi148 podman[155311]: 2024-02-28 16:46:27.327829625 +0000 UTC m=+5.734402875 container died 7f09adadd58744df1a14130d13b79543cc713d821ef241989150d91239f2ea6c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-02-28T16:46:27.872 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:27 smithi148 podman[155311]: 2024-02-28 16:46:27.734682439 +0000 UTC m=+6.141255730 container cleanup 7f09adadd58744df1a14130d13b79543cc713d821ef241989150d91239f2ea6c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:46:27.872 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:27 smithi148 bash[155311]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0 2024-02-28T16:46:28.371 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:28 smithi148 podman[155329]: 2024-02-28 16:46:28.02751336 +0000 UTC m=+0.682220973 container remove 7f09adadd58744df1a14130d13b79543cc713d821ef241989150d91239f2ea6c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-28T16:46:28.964 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:28 smithi148 podman[155420]: 2024-02-28 16:46:28.572070947 +0000 UTC m=+0.038576141 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:46:28.965 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:28 smithi148 podman[155420]: 2024-02-28 16:46:28.68916259 +0000 UTC m=+0.155667807 container create 4211b2c9a5797addb0bf852230c627b4cf6069e0aa85175313e9aa3676dd9e36 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222) 2024-02-28T16:46:29.372 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:28 smithi148 podman[155420]: 2024-02-28 16:46:28.977391801 +0000 UTC m=+0.443897045 container init 4211b2c9a5797addb0bf852230c627b4cf6069e0aa85175313e9aa3676dd9e36 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-28T16:46:29.372 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:28 smithi148 podman[155420]: 2024-02-28 16:46:28.991140203 +0000 UTC m=+0.457645393 container start 4211b2c9a5797addb0bf852230c627b4cf6069e0aa85175313e9aa3676dd9e36 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:46:29.372 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:29 smithi148 podman[155420]: 2024-02-28 16:46:29.083548971 +0000 UTC m=+0.550054171 container attach 4211b2c9a5797addb0bf852230c627b4cf6069e0aa85175313e9aa3676dd9e36 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-28T16:46:29.778 INFO:journalctl@ceph.osd.0.smithi148.stdout:Feb 28 16:46:29 smithi148 podman[155420]: 2024-02-28 16:46:29.427674359 +0000 UTC m=+0.894179582 container died 4211b2c9a5797addb0bf852230c627b4cf6069e0aa85175313e9aa3676dd9e36 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-28T16:46:30.176 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.0.service' 2024-02-28T16:46:30.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:46:30.281 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-28T16:46:30.282 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-28T16:46:30.282 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.1 2024-02-28T16:46:30.766 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:30 smithi148 systemd[1]: Stopping Ceph osd.1 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:46:31.122 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:30 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[130330]: 2024-02-28T16:46:30.870+0000 7fb89dc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:46:31.122 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:30 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[130330]: 2024-02-28T16:46:30.870+0000 7fb89dc00700 -1 osd.1 84 *** Got signal Terminated *** 2024-02-28T16:46:31.122 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:30 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1[130330]: 2024-02-28T16:46:30.870+0000 7fb89dc00700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:46:36.622 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:36 smithi148 podman[155526]: 2024-02-28 16:46:36.34529757 +0000 UTC m=+5.586784702 container died b31a8f1e54838295c624b598cdb36eef67f07932b72d965fa09b9aa20a93ac2f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, org.label-schema.build-date=20240222, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:46:37.046 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:36 smithi148 podman[155526]: 2024-02-28 16:46:36.764952209 +0000 UTC m=+6.006439369 container cleanup b31a8f1e54838295c624b598cdb36eef67f07932b72d965fa09b9aa20a93ac2f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10) 2024-02-28T16:46:37.046 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:36 smithi148 bash[155526]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1 2024-02-28T16:46:37.371 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:37 smithi148 podman[155546]: 2024-02-28 16:46:37.05950687 +0000 UTC m=+0.704095173 container remove b31a8f1e54838295c624b598cdb36eef67f07932b72d965fa09b9aa20a93ac2f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-28T16:46:38.242 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:37 smithi148 podman[155634]: 2024-02-28 16:46:37.81640131 +0000 UTC m=+0.036783780 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:46:38.242 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:37 smithi148 podman[155634]: 2024-02-28 16:46:37.950539524 +0000 UTC m=+0.170922026 container create 34846c8740328649ee9d9cbe4e41df75975d3d02ed28ca9fd7b96a74a34bafd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:46:38.242 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:38 smithi148 podman[155634]: 2024-02-28 16:46:38.254877646 +0000 UTC m=+0.475260191 container init 34846c8740328649ee9d9cbe4e41df75975d3d02ed28ca9fd7b96a74a34bafd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-02-28T16:46:38.622 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:38 smithi148 podman[155634]: 2024-02-28 16:46:38.265870206 +0000 UTC m=+0.486252715 container start 34846c8740328649ee9d9cbe4e41df75975d3d02ed28ca9fd7b96a74a34bafd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-28T16:46:38.622 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:38 smithi148 podman[155634]: 2024-02-28 16:46:38.344857612 +0000 UTC m=+0.565240137 container attach 34846c8740328649ee9d9cbe4e41df75975d3d02ed28ca9fd7b96a74a34bafd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-02-28T16:46:38.998 INFO:journalctl@ceph.osd.1.smithi148.stdout:Feb 28 16:46:38 smithi148 podman[155634]: 2024-02-28 16:46:38.701284226 +0000 UTC m=+0.921666691 container died 34846c8740328649ee9d9cbe4e41df75975d3d02ed28ca9fd7b96a74a34bafd0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-1-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T16:46:39.381 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.1.service' 2024-02-28T16:46:39.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:46:39.511 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-28T16:46:39.512 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-28T16:46:39.512 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.2 2024-02-28T16:46:40.113 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:39 smithi148 systemd[1]: Stopping Ceph osd.2 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:46:40.372 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:40 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[136218]: 2024-02-28T16:46:40.125+0000 7fb576c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:46:40.372 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:40 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[136218]: 2024-02-28T16:46:40.125+0000 7fb576c00700 -1 osd.2 84 *** Got signal Terminated *** 2024-02-28T16:46:40.372 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:40 smithi148 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2[136218]: 2024-02-28T16:46:40.125+0000 7fb576c00700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:46:46.038 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:45 smithi148 podman[155738]: 2024-02-28 16:46:45.710132259 +0000 UTC m=+5.728629397 container died 79bbadb9075d63ce3e790caf0f25d320001a95c21210b1a35733f342f51f9be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-28T16:46:46.372 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:46 smithi148 podman[155738]: 2024-02-28 16:46:46.184742666 +0000 UTC m=+6.203239841 container cleanup 79bbadb9075d63ce3e790caf0f25d320001a95c21210b1a35733f342f51f9be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-02-28T16:46:46.372 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:46 smithi148 bash[155738]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2 2024-02-28T16:46:46.872 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:46 smithi148 podman[155759]: 2024-02-28 16:46:46.413567769 +0000 UTC m=+0.684844767 container remove 79bbadb9075d63ce3e790caf0f25d320001a95c21210b1a35733f342f51f9be3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-28T16:46:47.519 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:47 smithi148 podman[155846]: 2024-02-28 16:46:47.155476259 +0000 UTC m=+0.033660633 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:46:47.519 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:47 smithi148 podman[155846]: 2024-02-28 16:46:47.253426709 +0000 UTC m=+0.131611144 container create c9f28e5a26e4086827dcd10ad1592095a99ce615a34baed52c82cb3f53cb6b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222) 2024-02-28T16:46:47.872 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:47 smithi148 podman[155846]: 2024-02-28 16:46:47.532472615 +0000 UTC m=+0.410657082 container init c9f28e5a26e4086827dcd10ad1592095a99ce615a34baed52c82cb3f53cb6b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10) 2024-02-28T16:46:47.872 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:47 smithi148 podman[155846]: 2024-02-28 16:46:47.54392047 +0000 UTC m=+0.422104868 container start c9f28e5a26e4086827dcd10ad1592095a99ce615a34baed52c82cb3f53cb6b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-28T16:46:47.872 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:47 smithi148 podman[155846]: 2024-02-28 16:46:47.630674336 +0000 UTC m=+0.508858770 container attach c9f28e5a26e4086827dcd10ad1592095a99ce615a34baed52c82cb3f53cb6b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:46:48.319 INFO:journalctl@ceph.osd.2.smithi148.stdout:Feb 28 16:46:47 smithi148 podman[155846]: 2024-02-28 16:46:47.980098653 +0000 UTC m=+0.858283071 container died c9f28e5a26e4086827dcd10ad1592095a99ce615a34baed52c82cb3f53cb6b2c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:46:48.668 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.2.service' 2024-02-28T16:46:48.794 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:46:48.794 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-28T16:46:48.794 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-28T16:46:48.794 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.3 2024-02-28T16:46:49.235 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:48 smithi157 systemd[1]: Stopping Ceph osd.3 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:46:49.735 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:49 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:46:49.443+0000 7fbc0d000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:46:49.735 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:49 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:46:49.443+0000 7fbc0d000700 -1 osd.3 84 *** Got signal Terminated *** 2024-02-28T16:46:49.736 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:49 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:46:49.443+0000 7fbc0d000700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:46:50.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:49 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:49.943+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:51.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:50 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:50.911+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:51.235 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:50 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:46:50.922+0000 7fbc04200700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.672598+0000 front 2024-02-28T16:46:25.672933+0000 (oldest deadline 2024-02-28T16:46:50.372614+0000) 2024-02-28T16:46:52.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:51 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:51.898+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:52.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:51 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:51.994+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:52.236 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:51 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:46:51.967+0000 7fbc04200700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.672598+0000 front 2024-02-28T16:46:25.672933+0000 (oldest deadline 2024-02-28T16:46:50.372614+0000) 2024-02-28T16:46:53.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:52 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:52.911+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:53.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:52 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:52.988+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:53.236 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:52 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:46:52.945+0000 7fbc04200700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.672598+0000 front 2024-02-28T16:46:25.672933+0000 (oldest deadline 2024-02-28T16:46:50.372614+0000) 2024-02-28T16:46:54.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:53 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:53.932+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:54.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:53 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:53.991+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:54.236 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:53 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3[98838]: 2024-02-28T16:46:53.908+0000 7fbc04200700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.672598+0000 front 2024-02-28T16:46:25.672933+0000 (oldest deadline 2024-02-28T16:46:50.372614+0000) 2024-02-28T16:46:55.235 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:54 smithi157 podman[122221]: 2024-02-28 16:46:54.956167039 +0000 UTC m=+5.737096741 container died 95f4d72b6933f6f5bafc428382f27e1ce25b4ca41c260af7e7b3760447c9cd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T16:46:55.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:54 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:54.918+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:55.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:54 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:54.949+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:55.650 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:55 smithi157 podman[122221]: 2024-02-28 16:46:55.379003377 +0000 UTC m=+6.159933116 container cleanup 95f4d72b6933f6f5bafc428382f27e1ce25b4ca41c260af7e7b3760447c9cd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-28T16:46:55.650 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:55 smithi157 bash[122221]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3 2024-02-28T16:46:55.979 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:55 smithi157 podman[122239]: 2024-02-28 16:46:55.663271022 +0000 UTC m=+0.694161375 container remove 95f4d72b6933f6f5bafc428382f27e1ce25b4ca41c260af7e7b3760447c9cd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-28T16:46:55.980 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:55 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:55.880+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:56.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:55 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:55.991+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:56.736 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:56 smithi157 podman[122327]: 2024-02-28 16:46:56.393932682 +0000 UTC m=+0.036102494 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:46:56.736 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:56 smithi157 podman[122327]: 2024-02-28 16:46:56.514045458 +0000 UTC m=+0.156215277 container create f23169d66006ef1450c84e0e2bc7d3a2070a560a273a9c10b2610239f7fedfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222) 2024-02-28T16:46:57.234 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:56 smithi157 podman[122327]: 2024-02-28 16:46:56.801098114 +0000 UTC m=+0.443268029 container init f23169d66006ef1450c84e0e2bc7d3a2070a560a273a9c10b2610239f7fedfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T16:46:57.234 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:56 smithi157 podman[122327]: 2024-02-28 16:46:56.813329912 +0000 UTC m=+0.455499733 container start f23169d66006ef1450c84e0e2bc7d3a2070a560a273a9c10b2610239f7fedfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-28T16:46:57.234 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:56 smithi157 podman[122327]: 2024-02-28 16:46:56.916992556 +0000 UTC m=+0.559162429 container attach f23169d66006ef1450c84e0e2bc7d3a2070a560a273a9c10b2610239f7fedfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222) 2024-02-28T16:46:57.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:56 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:56.970+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:57.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:56 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:56.930+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:57.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:56 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:56.930+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:32.356556+0000 front 2024-02-28T16:46:32.356513+0000 (oldest deadline 2024-02-28T16:46:56.455917+0000) 2024-02-28T16:46:57.485 INFO:journalctl@ceph.osd.3.smithi157.stdout:Feb 28 16:46:57 smithi157 podman[122327]: 2024-02-28 16:46:57.248252447 +0000 UTC m=+0.890422326 container died f23169d66006ef1450c84e0e2bc7d3a2070a560a273a9c10b2610239f7fedfc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-02-28T16:46:58.004 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.3.service' 2024-02-28T16:46:58.105 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:46:58.105 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-28T16:46:58.106 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-28T16:46:58.106 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.4 2024-02-28T16:46:58.223 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:57 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:57.916+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:58.223 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:57 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:57.916+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:32.356556+0000 front 2024-02-28T16:46:32.356513+0000 (oldest deadline 2024-02-28T16:46:56.455917+0000) 2024-02-28T16:46:58.223 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:58 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:58.011+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:58.223 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:58 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:58.011+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:46:58.485 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:58 smithi157 systemd[1]: Stopping Ceph osd.4 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:46:58.940 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:58 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:58.686+0000 7fa0ec000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:46:58.940 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:58 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:58.686+0000 7fa0ec000700 -1 osd.4 84 *** Got signal Terminated *** 2024-02-28T16:46:58.940 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:58 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:58.686+0000 7fa0ec000700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:46:58.941 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:58 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:58.952+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:46:58.941 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:58 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:58.952+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:32.356556+0000 front 2024-02-28T16:46:32.356513+0000 (oldest deadline 2024-02-28T16:46:56.455917+0000) 2024-02-28T16:46:59.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:59 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:59.052+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:46:59.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:46:59 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:46:59.052+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:00.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:00 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:00.052+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:00.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:00 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:00.052+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:00.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:59 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:59.946+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:47:00.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:46:59 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:46:59.946+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:32.356556+0000 front 2024-02-28T16:46:32.356513+0000 (oldest deadline 2024-02-28T16:46:56.455917+0000) 2024-02-28T16:47:01.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:01 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:01.031+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:01.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:01 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:01.031+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:01.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:00 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:47:00.956+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:47:01.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:00 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:47:00.956+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:32.356556+0000 front 2024-02-28T16:46:32.356513+0000 (oldest deadline 2024-02-28T16:46:56.455917+0000) 2024-02-28T16:47:02.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:01 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:47:01.957+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:47:02.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:01 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:47:01.957+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:32.356556+0000 front 2024-02-28T16:46:32.356513+0000 (oldest deadline 2024-02-28T16:46:56.455917+0000) 2024-02-28T16:47:02.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:02 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:02.073+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:02.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:02 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:02.073+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:03.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:03 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:03.113+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:03.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:03 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:03.113+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:03.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:02 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:47:02.983+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:23.554990+0000 front 2024-02-28T16:46:23.554914+0000 (oldest deadline 2024-02-28T16:46:49.454724+0000) 2024-02-28T16:47:03.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:02 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4[104029]: 2024-02-28T16:47:02.983+0000 7fa0e8200700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:32.356556+0000 front 2024-02-28T16:46:32.356513+0000 (oldest deadline 2024-02-28T16:46:56.455917+0000) 2024-02-28T16:47:04.487 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:04 smithi157 podman[122445]: 2024-02-28 16:47:04.241318963 +0000 UTC m=+5.691079489 container died 93c28b8b835a6e0a2236fa4cb8a26cdced2fc495a3502125d9570eb26ae2fafa (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, GIT_CLEAN=True, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-28T16:47:04.488 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:04 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:04.104+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:04.488 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:04 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:04.104+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:04.817 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:04 smithi157 podman[122445]: 2024-02-28 16:47:04.621365012 +0000 UTC m=+6.071125559 container cleanup 93c28b8b835a6e0a2236fa4cb8a26cdced2fc495a3502125d9570eb26ae2fafa (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-28T16:47:04.818 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:04 smithi157 bash[122445]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4 2024-02-28T16:47:05.235 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:04 smithi157 podman[122466]: 2024-02-28 16:47:04.830524103 +0000 UTC m=+0.577890636 container remove 93c28b8b835a6e0a2236fa4cb8a26cdced2fc495a3502125d9570eb26ae2fafa (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-28T16:47:05.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:05 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:05.071+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:05.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:05 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:05.071+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:05.906 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:05 smithi157 podman[122553]: 2024-02-28 16:47:05.499178352 +0000 UTC m=+0.037974635 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:47:05.906 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:05 smithi157 podman[122553]: 2024-02-28 16:47:05.606433393 +0000 UTC m=+0.145229720 container create 16492a392c0003987378f562a29a9b0e87bdb7bfd80579ce70cca4092008ecd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2) 2024-02-28T16:47:05.906 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:05 smithi157 podman[122553]: 2024-02-28 16:47:05.918476659 +0000 UTC m=+0.457272979 container init 16492a392c0003987378f562a29a9b0e87bdb7bfd80579ce70cca4092008ecd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T16:47:06.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:06 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:06.052+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:06.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:06 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:06.052+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:06.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:05 smithi157 podman[122553]: 2024-02-28 16:47:05.93028129 +0000 UTC m=+0.469077607 container start 16492a392c0003987378f562a29a9b0e87bdb7bfd80579ce70cca4092008ecd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-28T16:47:06.236 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:06 smithi157 podman[122553]: 2024-02-28 16:47:06.009195407 +0000 UTC m=+0.547991754 container attach 16492a392c0003987378f562a29a9b0e87bdb7bfd80579ce70cca4092008ecd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T16:47:06.689 INFO:journalctl@ceph.osd.4.smithi157.stdout:Feb 28 16:47:06 smithi157 podman[122553]: 2024-02-28 16:47:06.355312292 +0000 UTC m=+0.894108608 container died 16492a392c0003987378f562a29a9b0e87bdb7bfd80579ce70cca4092008ecd9 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-02-28T16:47:07.093 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.4.service' 2024-02-28T16:47:07.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:47:07.217 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-28T16:47:07.217 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-28T16:47:07.217 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.5 2024-02-28T16:47:07.345 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:07 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:07.003+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:07.346 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:07 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:07.003+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:07.735 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:07 smithi157 systemd[1]: Stopping Ceph osd.5 for 004ac12e-d654-11ee-95c3-87774f69a715... 2024-02-28T16:47:08.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:07 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:07.839+0000 7fa178a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T16:47:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:07 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:07.839+0000 7fa178a00700 -1 osd.5 84 *** Got signal Terminated *** 2024-02-28T16:47:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:07 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:07.839+0000 7fa178a00700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T16:47:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:08.018+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:08.018+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:08.237 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:08.018+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6822 osd.2 since back 2024-02-28T16:46:42.338951+0000 front 2024-02-28T16:46:42.339058+0000 (oldest deadline 2024-02-28T16:47:07.638431+0000) 2024-02-28T16:47:09.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:08.987+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:09.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:08.987+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:09.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:08 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:08.987+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6822 osd.2 since back 2024-02-28T16:46:42.338951+0000 front 2024-02-28T16:46:42.339058+0000 (oldest deadline 2024-02-28T16:47:07.638431+0000) 2024-02-28T16:47:10.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:09 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:09.959+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:10.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:09 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:09.959+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:10.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:09 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:09.959+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6822 osd.2 since back 2024-02-28T16:46:42.338951+0000 front 2024-02-28T16:46:42.339058+0000 (oldest deadline 2024-02-28T16:47:07.638431+0000) 2024-02-28T16:47:11.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:11 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:11.002+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:11.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:11 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:11.002+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:11.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:11 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:11.002+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6822 osd.2 since back 2024-02-28T16:46:42.338951+0000 front 2024-02-28T16:46:42.339058+0000 (oldest deadline 2024-02-28T16:47:07.638431+0000) 2024-02-28T16:47:12.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:12 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:12.042+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6806 osd.0 since back 2024-02-28T16:46:25.534553+0000 front 2024-02-28T16:46:25.534969+0000 (oldest deadline 2024-02-28T16:46:51.434309+0000) 2024-02-28T16:47:12.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:12 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:12.042+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6814 osd.1 since back 2024-02-28T16:46:31.936112+0000 front 2024-02-28T16:46:31.936171+0000 (oldest deadline 2024-02-28T16:46:57.835998+0000) 2024-02-28T16:47:12.486 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:12 smithi157 ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5[109175]: 2024-02-28T16:47:12.042+0000 7fa16fc00700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.148:6822 osd.2 since back 2024-02-28T16:46:42.338951+0000 front 2024-02-28T16:46:42.339058+0000 (oldest deadline 2024-02-28T16:47:07.638431+0000) 2024-02-28T16:47:13.484 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:13 smithi157 podman[122659]: 2024-02-28 16:47:13.232744396 +0000 UTC m=+5.537371383 container died 860ae8452ebf625983fbe4efe3a15fbc1b163e0b60fcacc83938031eb1f00128 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5) 2024-02-28T16:47:13.736 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:13 smithi157 podman[122659]: 2024-02-28 16:47:13.606586104 +0000 UTC m=+5.911213077 container cleanup 860ae8452ebf625983fbe4efe3a15fbc1b163e0b60fcacc83938031eb1f00128 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-28T16:47:13.736 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:13 smithi157 bash[122659]: ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5 2024-02-28T16:47:14.235 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:13 smithi157 podman[122680]: 2024-02-28 16:47:13.799305431 +0000 UTC m=+0.561520744 container remove 860ae8452ebf625983fbe4efe3a15fbc1b163e0b60fcacc83938031eb1f00128 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:47:14.824 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:14 smithi157 podman[122771]: 2024-02-28 16:47:14.459645429 +0000 UTC m=+0.036180711 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T16:47:14.824 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:14 smithi157 podman[122771]: 2024-02-28 16:47:14.57506518 +0000 UTC m=+0.151600488 container create 0d53cb7c018cb22067b90ca4de8ed9c5ec3d9ee5a1286928b46499bda0b9a39c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T16:47:14.824 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:14 smithi157 podman[122771]: 2024-02-28 16:47:14.837169782 +0000 UTC m=+0.413705094 container init 0d53cb7c018cb22067b90ca4de8ed9c5ec3d9ee5a1286928b46499bda0b9a39c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T16:47:15.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:14 smithi157 podman[122771]: 2024-02-28 16:47:14.848721077 +0000 UTC m=+0.425256382 container start 0d53cb7c018cb22067b90ca4de8ed9c5ec3d9ee5a1286928b46499bda0b9a39c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10) 2024-02-28T16:47:15.236 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:14 smithi157 podman[122771]: 2024-02-28 16:47:14.961095075 +0000 UTC m=+0.537630403 container attach 0d53cb7c018cb22067b90ca4de8ed9c5ec3d9ee5a1286928b46499bda0b9a39c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True) 2024-02-28T16:47:15.583 INFO:journalctl@ceph.osd.5.smithi157.stdout:Feb 28 16:47:15 smithi157 podman[122771]: 2024-02-28 16:47:15.279409571 +0000 UTC m=+0.855944883 container died 0d53cb7c018cb22067b90ca4de8ed9c5ec3d9ee5a1286928b46499bda0b9a39c (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-004ac12e-d654-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-28T16:47:15.978 DEBUG:teuthology.orchestra.run.smithi157:> sudo pkill -f 'journalctl -f -n 0 -u ceph-004ac12e-d654-11ee-95c3-87774f69a715@osd.5.service' 2024-02-28T16:47:16.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T16:47:16.099 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-28T16:47:16.099 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 004ac12e-d654-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T16:47:21.597 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi148.stderr:ceph-fuse[76602]: fuse finished with error 0 and tester_r 0 2024-02-28T16:47:43.039 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 004ac12e-d654-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T16:47:59.862 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:47:59.966 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T16:48:00.060 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-28T16:48:00.062 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591/remote/smithi148/crash 2024-02-28T16:48:00.064 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/crash -- . 2024-02-28T16:48:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:tar: /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T16:48:00.157 INFO:teuthology.orchestra.run.smithi148.stderr:tar: Error is not recoverable: exiting now 2024-02-28T16:48:00.162 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591/remote/smithi157/crash 2024-02-28T16:48:00.163 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/crash -- . 2024-02-28T16:48:00.240 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/004ac12e-d654-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T16:48:00.240 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2024-02-28T16:48:00.242 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-28T16:48:00.243 DEBUG:teuthology.orchestra.run.smithi148:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-28T16:48:00.344 INFO:teuthology.orchestra.run.smithi148.stdout:1709137800.0001283 mon.smithi148 (mon.0) 1068 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-28T16:48:00.345 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-28T16:48:00.345 INFO:tasks.cephadm:Compressing logs... 2024-02-28T16:48:00.346 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T16:48:00.349 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T16:48:00.414 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-28T16:48:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T16:48:00.415 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-02-28T16:48:00.417 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi148.nqnotw.log 2024-02-28T16:48:00.417 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T16:48:00.418 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi148.nqnotw.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.1.log 2024-02-28T16:48:00.420 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mgr.smithi148.gelspy.log 2024-02-28T16:48:00.421 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mon.smithi148.log 2024-02-28T16:48:00.424 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mgr.smithi148.gelspy.log: /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mon.smithi148.log: 90.9% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T16:48:00.425 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.0.log 2024-02-28T16:48:00.426 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T16:48:00.429 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.0.log: /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.log 2024-02-28T16:48:00.429 INFO:teuthology.orchestra.run.smithi157.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-28T16:48:00.430 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T16:48:00.430 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi157.dreayg.log 2024-02-28T16:48:00.431 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mgr.smithi157.cmcxzj.log 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi157.dreayg.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr: 92.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.4.log 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mgr.smithi157.cmcxzj.log: /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.5.log 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi157.hinycn.log 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.3.log 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.log: 85.2%gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.2.log 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi148.stderr: -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T16:48:00.438 INFO:teuthology.orchestra.run.smithi148.stderr: 90.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T16:48:00.439 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T16:48:00.439 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi157.hinycn.log: 91.1% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T16:48:00.440 INFO:teuthology.orchestra.run.smithi148.stderr: 88.2% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T16:48:00.440 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi148.mgdxsi.log 2024-02-28T16:48:00.441 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mon.smithi157.log 2024-02-28T16:48:00.442 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mon.smithi157.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T16:48:00.446 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.log 2024-02-28T16:48:00.448 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T16:48:00.454 INFO:teuthology.orchestra.run.smithi157.stderr: 85.2%/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-volume.log: /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.log: -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T16:48:00.456 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-02-28T16:48:00.459 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T16:48:00.497 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.2.log: /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi148.mgdxsi.log: 90.9% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T16:48:00.502 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.1.log: 90.9% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T16:48:00.506 INFO:teuthology.orchestra.run.smithi157.stderr: 89.0% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mgr.smithi157.cmcxzj.log.gz 2024-02-28T16:48:00.891 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mgr.smithi148.gelspy.log.gz 2024-02-28T16:48:01.054 INFO:teuthology.orchestra.run.smithi157.stderr: 92.5% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mon.smithi157.log.gz 2024-02-28T16:48:01.997 INFO:teuthology.orchestra.run.smithi148.stderr: 90.4% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mon.smithi148.log.gz 2024-02-28T16:48:04.743 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.2.log.gz 2024-02-28T16:48:05.161 INFO:teuthology.orchestra.run.smithi157.stderr: 93.6% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.5.log.gz 2024-02-28T16:48:05.542 INFO:teuthology.orchestra.run.smithi157.stderr: 93.5% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.4.log.gz 2024-02-28T16:48:06.157 INFO:teuthology.orchestra.run.smithi148.stderr: 93.5% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.0.log.gz 2024-02-28T16:48:06.978 INFO:teuthology.orchestra.run.smithi148.stderr: 94.8% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi148.mgdxsi.log.gz 2024-02-28T16:48:06.990 INFO:teuthology.orchestra.run.smithi157.stderr: 94.8% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi157.dreayg.log.gz 2024-02-28T16:48:07.079 INFO:teuthology.orchestra.run.smithi148.stderr: 93.6% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.1.log.gz 2024-02-28T16:48:07.628 INFO:teuthology.orchestra.run.smithi157.stderr: 93.6% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-osd.3.log.gz 2024-02-28T16:48:08.463 INFO:teuthology.orchestra.run.smithi157.stderr: 94.8% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi157.hinycn.log.gz 2024-02-28T16:48:16.113 INFO:teuthology.orchestra.run.smithi157.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-02-28T16:48:16.114 INFO:teuthology.orchestra.run.smithi157.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-02-28T16:48:16.117 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-02-28T16:48:16.117 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m15.720s 2024-02-28T16:48:16.117 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m45.047s 2024-02-28T16:48:16.117 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m2.922s 2024-02-28T16:48:17.189 INFO:teuthology.orchestra.run.smithi148.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-02-28T16:49:29.547 INFO:teuthology.orchestra.run.smithi148.stderr: 92.8% -- replaced with /var/log/ceph/004ac12e-d654-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi148.nqnotw.log.gz 2024-02-28T16:49:29.550 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-02-28T16:49:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:real 1m29.166s 2024-02-28T16:49:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:user 2m2.007s 2024-02-28T16:49:29.550 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m9.157s 2024-02-28T16:49:29.551 INFO:tasks.cephadm:Archiving logs... 2024-02-28T16:49:29.551 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591/remote/smithi148/log 2024-02-28T16:49:29.553 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T16:49:47.889 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591/remote/smithi157/log 2024-02-28T16:49:47.890 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T16:49:53.980 INFO:tasks.cephadm:Removing cluster... 2024-02-28T16:49:53.980 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 004ac12e-d654-11ee-95c3-87774f69a715 --force 2024-02-28T16:49:55.481 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 004ac12e-d654-11ee-95c3-87774f69a715 --force 2024-02-28T16:49:56.661 INFO:tasks.cephadm:Removing cephadm ... 2024-02-28T16:49:56.661 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T16:49:56.716 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T16:49:56.773 INFO:tasks.cephadm:Teardown complete 2024-02-28T16:49:56.774 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-28T16:49:56.785 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:49:56.786 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-28T16:49:56.786 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T16:49:56.794 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T16:49:56.934 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-28T16:49:56.946 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-28T16:49:56.946 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:49:56.954 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T16:49:56.997 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:49:57.006 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:49:57.007 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-02-28T16:49:57.007 INFO:teuthology.orchestra.run.smithi148.stdout:^- hv01.front.sepia.ceph.com 2 6 377 7 +2208us[+2208us] +/- 176ms 2024-02-28T16:49:57.007 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 -333us[ -777us] +/- 52ms 2024-02-28T16:49:57.007 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +413us[ +413us] +/- 76ms 2024-02-28T16:49:57.007 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:49:57.008 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-02-28T16:49:57.017 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T16:49:57.018 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-02-28T16:49:57.018 INFO:teuthology.orchestra.run.smithi157.stdout:^- hv01.front.sepia.ceph.com 2 6 377 14 +2201us[+1767us] +/- 175ms 2024-02-28T16:49:57.018 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -312us[ -746us] +/- 52ms 2024-02-28T16:49:57.018 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +421us[ -13us] +/- 76ms 2024-02-28T16:49:57.018 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T16:49:57.019 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-28T16:49:57.030 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-28T16:49:57.031 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-28T16:49:57.049 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T16:49:57.280 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T16:49:57.526 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:49:57.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:49:57.631 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T16:49:57.732 INFO:teuthology.orchestra.run.smithi157.stdout:type=AVC msg=audit(1709136086.953:202): avc: denied { checkpoint_restore } for pid=1154 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-02-28T16:49:57.734 DEBUG:teuthology.task.selinux:ubuntu@smithi157.front.sepia.ceph.com has 1 denials 2024-02-28T16:49:57.734 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi157.front.sepia.ceph.com: ['type=AVC msg=audit(1709136086.953:202): avc: denied { checkpoint_restore } for pid=1154 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-02-28T16:49:57.735 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-28T16:49:57.748 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-28T16:49:57.785 INFO:teuthology.task.internal:Duration was 2912.320479 seconds 2024-02-28T16:49:57.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-28T16:49:57.816 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-28T16:49:57.816 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T16:49:57.823 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T16:49:57.974 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:49:57.987 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T16:49:58.575 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-28T16:49:58.576 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-02-28T16:49:58.576 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T16:49:58.636 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-02-28T16:49:58.636 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T16:49:58.712 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-28T16:49:58.712 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T16:49:58.716 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T16:49:58.797 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-28T16:49:58.797 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T16:49:58.801 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T16:49:59.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-28T16:49:59.566 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-28T16:49:59.567 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T16:49:59.655 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T16:49:59.755 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-28T16:49:59.768 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:49:59.775 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:49:59.876 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-02-28T16:49:59.880 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-02-28T16:49:59.945 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:49:59.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:49:59.995 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T16:50:00.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:50:00.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-28T16:50:00.060 INFO:teuthology.task.internal:Transferring archived files... 2024-02-28T16:50:00.061 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591/remote/smithi148 2024-02-28T16:50:00.061 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T16:50:00.182 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591/remote/smithi157 2024-02-28T16:50:00.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T16:50:00.294 INFO:teuthology.task.internal:Removing archive directory... 2024-02-28T16:50:00.294 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T16:50:00.302 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T16:50:00.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-28T16:50:00.366 INFO:teuthology.task.internal:Not uploading archives. 2024-02-28T16:50:00.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-28T16:50:00.400 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-28T16:50:00.400 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T16:50:00.408 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T16:50:00.456 INFO:teuthology.orchestra.run.smithi148.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 28 16:50 /home/ubuntu/cephtest 2024-02-28T16:50:00.456 INFO:teuthology.orchestra.run.smithi148.stdout: 663725 4 d--------- 2 ubuntu ubuntu 4096 Feb 28 16:23 /home/ubuntu/cephtest/mnt.0 2024-02-28T16:50:00.457 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-02-28T16:50:00.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T16:50:00.459 INFO:teuthology.orchestra.run.smithi148.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-28T16:50:00.459 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi148 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-28T16:50:00.460 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-28T16:50:00.473 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-28T16:50:00.500 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T16:50:00.500 INFO:teuthology.nuke:Checking targets against current locks 2024-02-28T16:50:00.522 DEBUG:teuthology.nuke:shortname: smithi148 2024-02-28T16:50:00.523 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T16:50:00.544 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:51:32.655004', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAnKwgqZEHMe4RsBy/ThSntGNITYD4uXGQ71h3JR5FkTkHpfEYNTKv7WE9kwcDWseoxksxLi1Fp3uVam+3lB18='} 2024-02-28T16:50:00.548 DEBUG:teuthology.nuke:shortname: smithi157 2024-02-28T16:50:00.548 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T16:50:00.569 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 15:51:32.656875', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP6F2wes8Bf4zUMco5ITBlbFlUppRalAgJMJh5rnZvcc4gfxK43zRz/g/HzNzZ4qnPMOAq6DcbUb4bvw1+8InV0='} 2024-02-28T16:50:00.586 INFO:teuthology.orchestra.console.smithi148:Power off 2024-02-28T16:50:00.586 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T16:50:00.608 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-02-28T16:50:00.608 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:00.627 INFO:teuthology.orchestra.console.smithi157:Power off 2024-02-28T16:50:00.627 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T16:50:00.639 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-02-28T16:50:00.654 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-02-28T16:50:00.654 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:00.677 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-28T16:50:04.640 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:04.678 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:04.751 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-02-28T16:50:04.788 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-28T16:50:08.756 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:08.789 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:08.866 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-02-28T16:50:08.899 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-02-28T16:50:12.868 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:12.900 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T16:50:12.977 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-02-28T16:50:13.009 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-02-28T16:50:13.079 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-02-28T16:50:13.110 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-02-28T16:50:13.215 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2912.320478916168 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 host.b-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 owner: scheduled_vshankar@teuthology status: fail success: false 2024-02-28T16:50:13.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T16:50:13.307 INFO:teuthology.run:FAIL